CG-AL-H019

hard Errors & Transactions content 65cff9b2f407…

Description

Per-model results

Models that have attempted this task
ModelAttempt 1Attempt 2Avg scoreRuns
Claude Fable 5100.0 / 1003
Claude Opus 4.6100.0 / 1003
Claude Opus 4.8100.0 / 1006
Claude Sonnet 4 6100.0 / 1006
Gemini 3.1 Pro Preview100.0 / 1003
Claude Opus 4.766.7 / 1006
Gemini 3.5 Flash66.7 / 1006
GPT-5.560.0 / 1003
Claude Haiku 4 5 2025100150.0 / 1003