kernelbench sweep report · 1 variants
trajectories
102
finished
101
correct
20
compiled
52
avg speedup (correct)
3341.83x
sweep-wide eval metricsaveraged over correct kernels
outcomeserror 49 · incorrect 32 · correct 20 · in_progress 1
avg speedup3341.83x (over 20 correct)
avg memory ratio (kernel / ref)0.94x (20 samples)
avg fusion ratio (ref launches / kernel launches)6547.08x (20 samples)
avg energy ratio (ref / kernel)27.18x (3 samples)
avg SOL score (0–1)0.214 (20 samples)
avg DRAM util %15.5%
avg occupancy %145.7%
avg max abs error2.24e-06
popcorn2 102 trajectories · 3 models
20 correct 52 compiled · avg 3195.81x