CG-AL-H042

hard Errors & Transactions content 7d8f18a5d1c3…

Description

Per-model results

Models that have attempted this task
ModelAttempt 1Attempt 2Avg scoreRuns
Claude Fable 5100.0 / 1003
Claude Opus 4.6100.0 / 1003
Claude Opus 4.7100.0 / 1006
Claude Opus 4.8100.0 / 1006
Claude Sonnet 4 6100.0 / 1006
Gemini 3.1 Pro Preview100.0 / 1003
GPT-5.5100.0 / 1003
Gemini 3.5 Flash50.0 / 1006
Claude Haiku 4 5 202510010.0 / 1003