kernelbench sweep report · 1 variants
trajectories
267
finished
267
correct
78
compiled
140
avg speedup (correct)
12557.27x
sweep-wide eval metricsaveraged over correct kernels
outcomescompile_fail 122 · correct 78 · incorrect 62 · error 5
avg speedup12557.27x (over 78 correct)
avg memory ratio (kernel / ref)0.84x (78 samples)
avg fusion ratio (ref launches / kernel launches)1928.38x (78 samples)
avg energy ratio (ref / kernel)5.91x (10 samples)
avg SOL score (0–1)0.160 (78 samples)
avg DRAM util %8.7%
avg occupancy %52.9%
avg max abs error5.67e-05
popcorn 267 trajectories · 3 models
78 correct 140 compiled · avg 12557.27x