kernelbench sweep report · 2 variants
trajectories
276
finished
276
correct
235
compiled
239
avg speedup (correct)
346.36x
sweep-wide eval metricsaveraged over correct kernels
outcomescorrect 235 · error 21 · compile_fail 16 · incorrect 4
avg speedup346.36x (over 235 correct)
avg memory ratio (kernel / ref)0.84x (235 samples)
avg fusion ratio (ref launches / kernel launches)864.82x (235 samples)
avg energy ratio (ref / kernel)1.89x (135 samples)
avg SOL score (0–1)0.602 (233 samples)
avg DRAM util %50.2%
avg occupancy %115.8%
avg max abs error5.78e-03
original 200 trajectories · 1 models
169 correct 172 compiled · avg 22.34x
popcorn 76 trajectories · 1 models
66 correct 67 compiled · avg 1176.05x