CG-AL-H038

hard Errors & Transactions content 7f18882b0f45…

Description

Per-model results

Models that have attempted this task
ModelAttempt 1Attempt 2Avg scoreRuns
Claude Fable 5100.0 / 1003
Claude Opus 4.6100.0 / 1003
Claude Opus 4.7100.0 / 1006
Claude Opus 4.8100.0 / 1006
Gemini 3.1 Pro Preview100.0 / 1003
Gemini 3.5 Flash100.0 / 1006
GPT-5.5100.0 / 1003
Claude Sonnet 4 650.0 / 1006
Claude Haiku 4 5 202510010.0 / 1003