kernelbench sweep report · 1 variants
trajectories
80
finished
80
correct
3
compiled
18
avg speedup (correct)
4.25x
sweep-wide eval metricsaveraged over correct kernels
outcomescompile_fail 52 · incorrect 15 · error 10 · correct 3
avg speedup4.25x (over 3 correct)
avg memory ratio (kernel / ref)0.80x (3 samples)
avg fusion ratio (ref launches / kernel launches)6.00x (3 samples)
avg energy ratio (ref / kernel)— (0 samples)
avg SOL score (0–1)0.168 (3 samples)
avg DRAM util %15.9%
avg occupancy %54.6%
avg max abs error5.86e-03
hardware_translation_stub 80 trajectories · 5 models
3 correct 18 compiled · avg 4.25x