Run 0defa74e-bfb…
completed 2c09af0e-90e1-4d79-8f05-bb867284cf1e Run success rate
Tasks the run solved on its last attempt / tasks attempted in this run.
Formula: COUNT(distinct tasks where last attempt passed) / COUNT(distinct tasks attempted in this run)
Per-run metric for the model's "final answer" on each task. Differs from leaderboard pass_at_n: this denominator is the run's own attempted-task count, not the task set size, so partial runs are not penalised for unattempted tasks.
Avg attempt score
Mean per-attempt score on a 0–100 point scale (partial credit). Drill-down only.
Formula: Mean of attempt scores across all results rows: SUM(score) / COUNT(*) over the results table. Each attempt earns 0–100 points based on compile + test outcomes.
Drill-down companion to pass_at_n. Rewards partial credit but not directly comparable to pass rate; use for within-model analysis.
| Task | Difficulty | Attempt | Score | Tests | Compile | Duration | Tokens | |
|---|---|---|---|---|---|---|---|---|
| CG-AL-E001 | easy | 1 | 100.0 / 100 | 7/7 | OK | 3m 27s | 273 / 2.4k | |
| CG-AL-E002 | easy | 1 | 100.0 / 100 | 6/6 | OK | 3m 52s | 286 / 3.3k | |
| CG-AL-E003 | easy | 1 | 100.0 / 100 | 5/5 | OK | 2m 44s | 271 / 1.0k | |
| CG-AL-E004 | easy | 1 | 100.0 / 100 | 6/6 | OK | 3m 32s | 296 / 2.7k | |
| CG-AL-E005 | easy | 2 | 100.0 / 100 | 13/13 | OK | 4m 31s | 886 / 7.8k | |
| CG-AL-E006 | easy | 2 | 100.0 / 100 | 7/7 | OK | 4m 25s | 964 / 9.3k | |
| CG-AL-E007 | easy | 1 | 100.0 / 100 | 7/7 | OK | 4m 0s | 352 / 2.4k | |
| CG-AL-E008 | easy | 2 | 100.0 / 100 | 6/6 | OK | 3m 39s | 885 / 4.7k | |
| CG-AL-E009 | easy | 2 | 0.0 / 100 | 0/0 | FAIL | 1m 39s | 1.0k / 7.3k | |
| CG-AL-E010 | easy | 2 | 100.0 / 100 | 5/5 | OK | 3m 36s | 712 / 3.4k | |
| CG-AL-E031 | easy | 1 | 100.0 / 100 | 3/3 | OK | 5m 22s | 415 / 3.5k | |
| CG-AL-E032 | easy | 1 | 100.0 / 100 | 1/1 | OK | 4m 45s | 230 / 1.6k | |
| CG-AL-E045 | easy | 1 | 100.0 / 100 | 4/4 | OK | 4m 15s | 378 / 4.2k | |
| CG-AL-E050 | easy | 2 | 100.0 / 100 | 13/13 | OK | 3m 47s | 2.0k / 6.3k | |
| CG-AL-E051 | easy | 1 | 100.0 / 100 | 15/15 | OK | 5m 41s | 494 / 7.4k | |
| CG-AL-E052 | easy | 2 | 100.0 / 100 | 16/16 | OK | 4m 33s | 957 / 8.3k | |
| CG-AL-E053 | easy | 1 | 100.0 / 100 | 3/3 | OK | 3m 58s | 311 / 3.4k | |
| CG-AL-E054 | easy | 2 | 0.0 / 100 | 0/0 | FAIL | 2m 34s | 1.1k / 8.2k | |
| CG-AL-E055 | easy | 1 | 100.0 / 100 | 8/8 | OK | 4m 1s | 349 / 3.6k | |
| CG-AL-H001 | easy | 1 | 100.0 / 100 | 25/25 | OK | 4m 7s | 478 / 4.1k | |
| CG-AL-H002 | easy | 1 | 100.0 / 100 | 4/4 | OK | 3m 58s | 455 / 3.7k | |
| CG-AL-H003 | easy | 1 | 100.0 / 100 | 5/5 | OK | 4m 31s | 495 / 4.8k | |
| CG-AL-H004 | easy | 1 | 100.0 / 100 | 14/14 | OK | 3m 49s | 509 / 3.3k | |
| CG-AL-H005 | easy | 2 | 62.5 / 100 | 2/5 | OK | 5m 57s | 2.0k / 15k | |
| CG-AL-H006 | easy | 1 | 100.0 / 100 | 6/6 | OK | 3m 27s | 430 / 2.7k | |
| CG-AL-H007 | easy | 1 | 100.0 / 100 | 10/10 | OK | 4m 27s | 562 / 4.8k | |
| CG-AL-H008 | easy | 1 | 100.0 / 100 | 10/10 | OK | 4m 25s | 523 / 4.7k | |
| CG-AL-H009 | easy | 1 | 100.0 / 100 | 11/11 | OK | 4m 44s | 607 / 5.5k | |
| CG-AL-H010 | easy | 1 | 100.0 / 100 | 8/8 | OK | 3m 43s | 517 / 3.4k | |
| CG-AL-H011 | easy | 2 | 0.0 / 100 | 0/0 | FAIL | 2m 25s | 1.0k / 9.8k | |
| CG-AL-H013 | easy | 1 | 100.0 / 100 | 9/9 | OK | 3m 36s | 377 / 3.2k | |
| CG-AL-H014 | easy | 2 | 0.0 / 100 | 0/0 | FAIL | 2m 14s | 1.5k / 10k | |
| CG-AL-H015 | easy | 1 | 100.0 / 100 | 4/4 | OK | 3m 40s | 417 / 3.3k | |
| CG-AL-H016 | easy | 2 | 62.5 / 100 | 3/4 | OK | 3m 26s | 1.0k / 8.6k | |
| CG-AL-H017 | easy | 2 | 0.0 / 100 | 0/0 | FAIL | 2m 31s | 1.0k / 11k | |
| CG-AL-H018 | easy | 2 | 100.0 / 100 | 6/6 | OK | 7m 11s | 1.7k / 19k | |
| CG-AL-H019 | easy | 2 | 100.0 / 100 | 5/5 | OK | 11m 59s | 862 / 27k | |
| CG-AL-H020 | easy | 2 | 0.0 / 100 | 0/0 | FAIL | 4m 22s | 1.8k / 14k | |
| CG-AL-H021 | easy | 2 | 100.0 / 100 | 20/20 | OK | 6m 21s | 3.0k / 12k | |
| CG-AL-H022 | easy | 2 | 100.0 / 100 | 21/21 | OK | 7m 1s | 2.5k / 17k | |
| CG-AL-H023 | easy | 2 | 62.5 / 100 | 24/25 | OK | 8m 31s | 4.1k / 29k | |
| CG-AL-H024 | easy | 1 | 100.0 / 100 | 9/9 | OK | 5m 11s | 538 / 7.0k | |
| CG-AL-H025 | easy | 1 | 100.0 / 100 | 7/7 | OK | 4m 16s | 378 / 4.7k | |
| CG-AL-H026 | easy | 1 | 100.0 / 100 | 8/8 | OK | 4m 9s | 475 / 4.5k | |
| CG-AL-H205 | easy | 1 | 100.0 / 100 | 6/6 | OK | 5m 26s | 455 / 5.1k | |
| CG-AL-M001 | easy | 2 | 62.5 / 100 | 5/10 | OK | 5m 0s | 1.3k / 12k | |
| CG-AL-M002 | easy | 1 | 100.0 / 100 | 22/22 | OK | 4m 34s | 431 / 5.8k | |
| CG-AL-M003 | easy | 2 | 62.5 / 100 | 3/9 | OK | 4m 59s | 1.4k / 12k | |
| CG-AL-M004 | easy | 1 | 100.0 / 100 | 12/12 | OK | 5m 17s | 464 / 7.3k | |
| CG-AL-M005 | easy | 2 | 62.5 / 100 | 12/22 | OK | 5m 6s | 2.2k / 17k | |
| CG-AL-M006 | easy | 2 | 100.0 / 100 | 18/18 | OK | 4m 23s | 1.9k / 15k | |
| CG-AL-M007 | easy | 2 | 0.0 / 100 | 0/0 | FAIL | 2m 48s | 2.0k / 17k | |
| CG-AL-M008 | easy | 2 | 62.5 / 100 | 1/12 | OK | 6m 42s | 2.1k / 21k | |
| CG-AL-M009 | easy | 1 | 100.0 / 100 | 11/11 | OK | 5m 49s | 446 / 8.6k | |
| CG-AL-M010 | easy | 2 | 62.5 / 100 | 19/21 | OK | 6m 11s | 2.3k / 18k | |
| CG-AL-M020 | easy | 2 | 100.0 / 100 | 17/17 | OK | 4m 26s | 2.1k / 14k | |
| CG-AL-M021 | easy | 2 | 0.0 / 100 | 0/0 | FAIL | 2m 40s | 1.7k / 13k | |
| CG-AL-M022 | easy | 1 | 100.0 / 100 | 9/9 | OK | 4m 41s | 523 / 6.0k | |
| CG-AL-M023 | easy | 1 | 100.0 / 100 | 11/11 | OK | 4m 6s | 509 / 4.5k | |
| CG-AL-M024 | easy | 1 | 100.0 / 100 | 10/10 | OK | 4m 58s | 518 / 7.1k | |
| CG-AL-M025 | easy | 1 | 100.0 / 100 | 7/7 | OK | 4m 53s | 426 / 4.8k | |
| CG-AL-M026 | easy | 1 | 100.0 / 100 | 8/8 | OK | 4m 50s | 390 / 4.9k | |
| CG-AL-M088 | easy | 1 | 100.0 / 100 | 6/6 | OK | 3m 44s | 416 / 4.0k | |
| CG-AL-M112 | easy | 2 | 62.5 / 100 | 2/4 | OK | 3m 14s | 2.0k / 7.4k |