Run 6d0288a4-707…
completed 2c09af0e-90e1-4d79-8f05-bb867284cf1e Run success rate
Tasks the run solved on its last attempt / tasks attempted in this run.
Formula: COUNT(distinct tasks where last attempt passed) / COUNT(distinct tasks attempted in this run)
Per-run metric for the model's "final answer" on each task. Differs from leaderboard pass_at_n: this denominator is the run's own attempted-task count, not the task set size, so partial runs are not penalised for unattempted tasks.
Avg attempt score
Mean per-attempt score on a 0–100 point scale (partial credit). Drill-down only.
Formula: Mean of attempt scores across all results rows: SUM(score) / COUNT(*) over the results table. Each attempt earns 0–100 points based on compile + test outcomes.
Drill-down companion to pass_at_n. Rewards partial credit but not directly comparable to pass rate; use for within-model analysis.
| Task | Difficulty | Attempt | Score | Tests | Compile | Duration | Tokens | |
|---|---|---|---|---|---|---|---|---|
| CG-AL-E001 | easy | 1 | 100.0 / 100 | 7/7 | OK | 2m 32s | 418 / 433 | |
| CG-AL-E002 | easy | 1 | 100.0 / 100 | 6/6 | OK | 2m 24s | 433 / 378 | |
| CG-AL-E003 | easy | 1 | 100.0 / 100 | 5/5 | OK | 2m 35s | 410 / 166 | |
| CG-AL-E004 | easy | 1 | 100.0 / 100 | 6/6 | OK | 2m 39s | 470 / 367 | |
| CG-AL-E005 | easy | 1 | 100.0 / 100 | 13/13 | OK | 2m 40s | 491 / 700 | |
| CG-AL-E006 | easy | 1 | 100.0 / 100 | 7/7 | OK | 2m 43s | 470 / 596 | |
| CG-AL-E007 | easy | 1 | 100.0 / 100 | 7/7 | OK | 2m 47s | 558 / 242 | |
| CG-AL-E008 | easy | 1 | 100.0 / 100 | 6/6 | OK | 2m 49s | 470 / 465 | |
| CG-AL-E009 | easy | 1 | 100.0 / 100 | 5/5 | OK | 2m 48s | 442 / 254 | |
| CG-AL-E010 | easy | 1 | 100.0 / 100 | 5/5 | OK | 2m 50s | 467 / 188 | |
| CG-AL-E031 | easy | 1 | 100.0 / 100 | 3/3 | OK | 2m 58s | 678 / 659 | |
| CG-AL-E032 | easy | 1 | 100.0 / 100 | 1/1 | OK | 2m 55s | 377 / 89 | |
| CG-AL-E045 | easy | 1 | 100.0 / 100 | 4/4 | OK | 2m 25s | 565 / 434 | |
| CG-AL-E050 | easy | 1 | 100.0 / 100 | 13/13 | OK | 2m 26s | 635 / 295 | |
| CG-AL-E051 | easy | 1 | 100.0 / 100 | 15/15 | OK | 2m 34s | 776 / 1.2k | |
| CG-AL-E052 | easy | 2 | 100.0 / 100 | 16/16 | OK | 2m 26s | 1.6k / 763 | |
| CG-AL-E053 | easy | 1 | 100.0 / 100 | 3/3 | OK | 2m 26s | 461 / 176 | |
| CG-AL-E054 | easy | 2 | 100.0 / 100 | 9/9 | OK | 2m 25s | 1.7k / 714 | |
| CG-AL-E055 | easy | 1 | 100.0 / 100 | 8/8 | OK | 2m 25s | 566 / 306 | |
| CG-AL-H001 | hard | 1 | 100.0 / 100 | 25/25 | OK | 2m 26s | 726 / 425 | |
| CG-AL-H002 | hard | 1 | 100.0 / 100 | 4/4 | OK | 2m 28s | 747 / 785 | |
| CG-AL-H003 | hard | 2 | 100.0 / 100 | 5/5 | OK | 2m 27s | 2.3k / 1.7k | |
| CG-AL-H004 | hard | 1 | 100.0 / 100 | 14/14 | OK | 2m 28s | 779 / 625 | |
| CG-AL-H005 | hard | 2 | 62.5 / 100 | 2/5 | OK | 2m 30s | 3.0k / 2.6k | |
| CG-AL-H006 | hard | 1 | 100.0 / 100 | 6/6 | OK | 2m 25s | 715 / 365 | |
| CG-AL-H007 | hard | 1 | 100.0 / 100 | 10/10 | OK | 2m 31s | 952 / 963 | |
| CG-AL-H008 | hard | 1 | 100.0 / 100 | 10/10 | OK | 2m 27s | 886 / 586 | |
| CG-AL-H009 | hard | 1 | 100.0 / 100 | 11/11 | OK | 2m 43s | 1.0k / 1.3k | |
| CG-AL-H010 | hard | 1 | 100.0 / 100 | 8/8 | OK | 2m 27s | 901 / 632 | |
| CG-AL-H011 | hard | 2 | 0.0 / 100 | 0/0 | FAIL | 11.9s | 1.5k / 583 | |
| CG-AL-H013 | hard | 1 | 100.0 / 100 | 9/9 | OK | 2m 25s | 607 / 393 | |
| CG-AL-H014 | hard | 2 | 0.0 / 100 | 0/0 | FAIL | 14.5s | 2.4k / 1.4k | |
| CG-AL-H015 | hard | 1 | 100.0 / 100 | 4/4 | OK | 2m 26s | 663 / 449 | |
| CG-AL-H016 | hard | 2 | 0.0 / 100 | 0/0 | FAIL | 13.7s | 2.0k / 1.0k | |
| CG-AL-H017 | hard | 2 | 0.0 / 100 | 0/0 | FAIL | 12.3s | 1.6k / 708 | |
| CG-AL-H018 | hard | 1 | 100.0 / 100 | 6/6 | OK | 2m 26s | 732 / 808 | |
| CG-AL-H019 | hard | 1 | 100.0 / 100 | 5/5 | OK | 2m 21s | 533 / 233 | |
| CG-AL-H020 | hard | 2 | 100.0 / 100 | 10/10 | OK | 2m 26s | 2.8k / 2.2k | |
| CG-AL-H021 | hard | 2 | 62.5 / 100 | 6/20 | OK | 2m 32s | 3.3k / 2.1k | |
| CG-AL-H023 | hard | 2 | 0.0 / 100 | 0/0 | FAIL | 2m 18s | 22k / 22k | |
| CG-AL-H025 | hard | 1 | 100.0 / 100 | 7/7 | OK | 2m 25s | 575 / 302 | |
| CG-AL-H026 | hard | 2 | 0.0 / 100 | 0/0 | FAIL | 15.9s | 3.2k / 1.2k | |
| CG-AL-H205 | hard | 1 | 100.0 / 100 | 6/6 | OK | 2m 27s | 784 / 664 | |
| CG-AL-M001 | medium | 2 | 62.5 / 100 | 4/10 | OK | 2m 31s | 2.6k / 3.1k | |
| CG-AL-M002 | medium | 1 | 100.0 / 100 | 22/22 | OK | 2m 23s | 730 / 877 | |
| CG-AL-M003 | medium | 2 | 62.5 / 100 | 8/9 | OK | 2m 31s | 2.4k / 2.2k | |
| CG-AL-M004 | medium | 2 | 100.0 / 100 | 12/12 | OK | 2m 38s | 2.8k / 3.1k | |
| CG-AL-M005 | medium | 2 | 62.5 / 100 | 12/22 | OK | 2m 45s | 3.6k / 5.7k | |
| CG-AL-M006 | medium | 1 | 100.0 / 100 | 18/18 | OK | 2m 42s | 710 / 1.9k | |
| CG-AL-M007 | medium | 2 | 0.0 / 100 | 0/0 | FAIL | 40.6s | 4.2k / 7.8k | |
| CG-AL-M008 | medium | 2 | 0.0 / 100 | 0/0 | FAIL | 43.8s | 8.4k / 8.9k | |
| CG-AL-M009 | medium | 1 | 100.0 / 100 | 11/11 | OK | 2m 43s | 751 / 2.1k | |
| CG-AL-M010 | medium | 2 | 62.5 / 100 | 19/21 | OK | 2m 42s | 3.5k / 6.9k | |
| CG-AL-M020 | medium | 2 | 100.0 / 100 | 17/17 | OK | 2m 31s | 3.0k / 2.0k | |
| CG-AL-M021 | medium | 2 | 100.0 / 100 | 14/14 | OK | 2m 39s | 3.4k / 4.3k | |
| CG-AL-M022 | medium | 2 | 100.0 / 100 | 9/9 | OK | 2m 31s | 2.9k / 2.2k | |
| CG-AL-M023 | medium | 1 | 100.0 / 100 | 11/11 | OK | 2m 29s | 808 / 741 | |
| CG-AL-M024 | medium | 1 | 100.0 / 100 | 10/10 | OK | 2m 35s | 762 / 1.5k | |
| CG-AL-M025 | medium | 1 | 100.0 / 100 | 7/7 | OK | 2m 25s | 660 / 508 | |
| CG-AL-M026 | medium | 2 | 100.0 / 100 | 8/8 | OK | 2m 26s | 2.3k / 1.3k | |
| CG-AL-M088 | medium | 1 | 100.0 / 100 | 6/6 | OK | 2m 28s | 678 / 643 | |
| CG-AL-M112 | medium | 2 | 62.5 / 100 | 2/4 | OK | 2m 23s | 2.9k / 2.2k |