kernelbench sweep report · 1 variants
trajectories
150
finished
145
correct
23
compiled
68
avg speedup (correct)
174.49x
sweep-wide eval metricsaveraged over correct kernels
outcomescompile_fail 49 · incorrect 45 · error 28 · correct 23 · in_progress 5
avg speedup174.49x (over 23 correct)
avg memory ratio (kernel / ref)0.97x (23 samples)
avg fusion ratio (ref launches / kernel launches)670.39x (23 samples)
avg energy ratio (ref / kernel)0.92x (2 samples)
avg SOL score (0–1)0.149 (20 samples)
avg DRAM util %6.8%
avg occupancy %71.0%
avg max abs error2.97e-05
popcorn2 150 trajectories · 3 models
23 correct 68 compiled · avg 174.49x