kernelbench sweep report · 2 variants
trajectories
91
finished
61
correct
15
compiled
25
avg speedup (correct)
22.67x
sweep-wide eval metricsaveraged over correct kernels
outcomescompile_fail 33 · in_progress 30 · correct 15 · incorrect 10 · error 3
avg speedup22.67x (over 15 correct)
avg memory ratio (kernel / ref)0.83x (15 samples)
avg fusion ratio (ref launches / kernel launches)69.84x (15 samples)
avg energy ratio (ref / kernel)3.79x (10 samples)
avg SOL score (0–1)0.616 (15 samples)
avg DRAM util %61.4%
avg occupancy %159.7%
avg max abs error6.06e-04
original 61 trajectories · 4 models
10 correct 15 compiled · avg 4.92x
popcorn 30 trajectories · 4 models
5 correct 10 compiled · avg 58.15x