kernelbench sweep report · 1 variants
trajectories
64
finished
59
correct
10
compiled
32
avg speedup (correct)
2.07x
sweep-wide eval metricsaveraged over correct kernels
outcomesincorrect 22 · compile_fail 17 · correct 10 · error 10 · in_progress 5
avg speedup2.07x (over 10 correct)
avg memory ratio (kernel / ref)1.34x (10 samples)
avg fusion ratio (ref launches / kernel launches)7.07x (10 samples)
avg energy ratio (ref / kernel)— (0 samples)
avg SOL score (0–1)0.293 (8 samples)
avg DRAM util %16.6%
avg occupancy %76.1%
avg max abs error6.25e-03
hardware_translation_stub 64 trajectories · 4 models
10 correct 32 compiled · avg 2.07x