| outcomes | compile_fail 122 · correct 78 · incorrect 62 · error 5 |
| avg speedup | 12557.27x (over 78 correct) |
| avg memory ratio (kernel / ref) | 0.84x (78 samples) |
| avg fusion ratio (ref launches / kernel launches) | 1928.38x (78 samples) |
| avg energy ratio (ref / kernel) | 5.91x (10 samples) |
| avg SOL score (0–1) | 0.160 (78 samples) |
| avg DRAM util % | 8.7% |
| avg occupancy % | 52.9% |
| avg max abs error | 5.67e-05 |
| model | n | correct | compiled | avg speedup |
|---|---|---|---|---|
| FW-GLM-5-1 | 89 | 20 | 46 | 34.17x |
| gpt-5.5-priority | 89 | 43 | 65 | 22758.53x |
| grok-4.3 | 89 | 15 | 29 | 11.11x |