CG-AL-X298
Description
Per-model results
| Model | Attempt 1 | Attempt 2 | Avg score | Tokens / attempt | Runs |
|---|---|---|---|---|---|
| GPT-6.1 Sol | ✓ | — | 100.0 / 100 | 4.4k / 1.7k | 3 |
| GPT-5.6 Sol | ✓ | ✓ | 90.6 / 100 | 4.5k / 3.5k | 3 |
| GPT-5.6 Terra | ✓ | ✓ | 90.6 / 100 | 4.5k / 3.0k | 3 |
| GPT-6 Sol | ✓ | ✓ | 90.6 / 100 | 4.5k / 2.6k | 3 |
| Gemini 3.8 Flash (OpenRouter) | ✓ | ✓ | 85.0 / 100 | 6.4k / 23k | 3 |
| Claude Opus 5.5 | ✓ | ✗ | 81.3 / 100 | 7.9k / 4.2k | 3 |
| Claude Sonnet 5 | ✗ | ✗ | 62.5 / 100 | 7.9k / 23k | 3 |
| GPT-5.6 Luna | ✗ | ✗ | 62.5 / 100 | 7.0k / 3.2k | 3 |
| GPT-6 Luna | ✗ | ✗ | 62.5 / 100 | 5.6k / 4.1k | 3 |
| Claude Opus 5 | ✓ | ✓ | 52.5 / 100 | 7.7k / 12k | 3 |
| MiniMax M3 | ✗ | ✗ | 41.7 / 100 | 4.9k / 19k | 3 |
| Claude Haiku 4 5 | ✗ | ✗ | 31.3 / 100 | 9.7k / 2.9k | 3 |
| GLM 5.3 (OpenRouter) | ✗ | ✗ | 0.0 / 100 | 2.7k / 64k | 2 |