| outcomes | in_progress 32 · error 9 · compile_fail 9 |
| avg speedup | 0.00x (over 0 correct) |
| avg memory ratio (kernel / ref) | — (0 samples) |
| avg fusion ratio (ref launches / kernel launches) | — (0 samples) |
| avg energy ratio (ref / kernel) | — (0 samples) |
| avg SOL score (0–1) | — (0 samples) |
| avg DRAM util % | — |
| avg occupancy % | — |
| avg max abs error | — |
| model | n | correct | compiled | avg speedup |
|---|---|---|---|---|
| FW-GLM-5-1 | 11 | 0 | 0 | 0.00x |
| Llama-4-Maverick-17B-128E-Instruct-FP8 | 10 | 0 | 0 | 0.00x |
| gpt-5.5-priority | 13 | 0 | 0 | 0.00x |
| grok-4.3 | 16 | 0 | 0 | 0.00x |