kernelbench sweep report · 1 variants
trajectories
267
finished
267
correct
218
compiled
251
avg speedup (correct)
561.33x
sweep-wide eval metricsaveraged over correct kernels
outcomescorrect 218 · incorrect 33 · compile_fail 14 · error 2
avg speedup561.33x (over 218 correct)
avg memory ratio (kernel / ref)0.91x (218 samples)
avg fusion ratio (ref launches / kernel launches)2559.10x (218 samples)
avg energy ratio (ref / kernel)14.26x (27 samples)
avg SOL score (0–1)0.280 (218 samples)
avg DRAM util %20.2%
avg occupancy %168.1%
avg max abs error2.06e-04
popcorn 267 trajectories · 3 models
218 correct 251 compiled · avg 561.33x