CG-AL-E058
Description
Per-model results
| Model | Attempt 1 | Attempt 2 | Avg score | Runs |
|---|---|---|---|---|
| Claude Fable 5 | ✓ | — | 100.0 / 100 | 3 |
| Claude Opus 4.6 | ✓ | — | 100.0 / 100 | 3 |
| Claude Opus 4.7 | ✓ | — | 100.0 / 100 | 6 |
| Claude Opus 4.8 | ✓ | ✓ | 66.7 / 100 | 6 |
| GPT-5.5 | ✓ | ✓ | 60.0 / 100 | 3 |
| Claude Haiku 4 5 20251001 | ✗ | ✓ | 50.0 / 100 | 3 |
| Gemini 3.1 Pro Preview | ✗ | ✓ | 50.0 / 100 | 3 |
| Claude Sonnet 4 6 | ✗ | ✓ | 41.7 / 100 | 6 |
| Gemini 3.5 Flash | ✗ | ✓ | 25.0 / 100 | 6 |