Thèmes / KernelBench GPU kernel evaluationPoint de vue reformulé
KernelBench measures correctness and speed of generated GPU kernels
KernelBench evaluates LLMs on 250 PyTorch tasks to assess their ability to generate correct and fast GPU kernels, using fast_p—the percentage of generated kernels that are both correct and faster than the baseline—as its metric.
Derrière ce point de vue
Les traductions sont destinées à la lecture ; les extraits originaux restent la source evidence.
Harness Engineering for Self-Improvement
Extrait original
KernelBench : evaluate correctness and speed for generated GPU kernels. 250 PyTorch tasks to evaluate whether LLM can write fast and correct kernels.
Contexte
The evaluation metric fast_p = the percentage of generated kernels that are correct and faster than baseline.