Run success rate

Run success rate

Tasks the run solved on its last attempt / tasks attempted in this run.

Formula: COUNT(distinct tasks where last attempt passed) / COUNT(distinct tasks attempted in this run)

Per-run metric for the model's "final answer" on each task. Differs from leaderboard pass_at_n: this denominator is the run's own attempted-task count, not the task set size, so partial runs are not penalised for unattempted tasks.

91.8% 101/110 of 110 tasks attempted in this run
Avg score

Avg attempt score

Mean per-attempt score on a 0–100 point scale (partial credit). Drill-down only.

Formula: Mean of attempt scores across all results rows: SUM(score) / COUNT(*) over the results table. Each attempt earns 0–100 points based on compile + test outcomes.

Drill-down companion to pass_at_n. Rewards partial credit but not directly comparable to pass rate; use for within-model analysis.

78.7 / 100
Cost $12.41
Duration 1h 43m
Filter:
Per-task results for run 05dc356f-e4b9-4baf-a85f-9d48cf808fa8
TaskDifficultyAttemptScoreTestsCompileDuration
CG-AL-E001easy2100.0 / 1007/7OK31.0s
CG-AL-E002easy1100.0 / 1006/6OK2m 35s
CG-AL-E003easy1100.0 / 1005/5OK17.9s
CG-AL-E004easy1100.0 / 1006/6OK22.9s
CG-AL-E005easy1100.0 / 10013/13OK27.9s
CG-AL-E006easy1100.0 / 1007/7OK2m 40s
CG-AL-E007easy1100.0 / 1007/7OK33.2s
CG-AL-E008easy1100.0 / 1006/6OK36.8s
CG-AL-E009easy1100.0 / 1005/5OK35.7s
CG-AL-E010easy1100.0 / 1005/5OK35.8s
CG-AL-E031easy1100.0 / 1003/3OK46.8s
CG-AL-E032easy1100.0 / 1001/1OK39.9s
CG-AL-E045easy1100.0 / 1004/4OK24.2s
CG-AL-E050easy2100.0 / 10013/13OK37.9s
CG-AL-E051easy1100.0 / 10015/15OK36.5s
CG-AL-E052easy2100.0 / 10016/16OK38.4s
CG-AL-E053easy1100.0 / 1003/3OK2m 56s
CG-AL-E054easy2100.0 / 1009/9OK25.7s
CG-AL-E055easy1100.0 / 1008/8OK26.5s
CG-AL-E056easy2100.0 / 10015/15OK19.9s
CG-AL-E057easy2100.0 / 1008/8OK27.8s
CG-AL-E058easy1100.0 / 1001/1OK30.7s
CG-AL-H001hard1100.0 / 10025/25OK23.4s
CG-AL-H002hard1100.0 / 1004/4OK22.0s
CG-AL-H003hard1100.0 / 1005/5OK22.7s
CG-AL-H004hard1100.0 / 10014/14OK19.4s
CG-AL-H005hard1100.0 / 1006/6OK21.9s
CG-AL-H006hard1100.0 / 1006/6OK18.0s
CG-AL-H007hard1100.0 / 10010/10OK23.7s
CG-AL-H008hard1100.0 / 10010/10OK21.7s
CG-AL-H009hard1100.0 / 10011/11OK24.5s
CG-AL-H010hard1100.0 / 1008/8OK20.2s
CG-AL-H011hard1100.0 / 1005/5OK18.5s
CG-AL-H013hard1100.0 / 1009/9OK25.2s
CG-AL-H014hard2100.0 / 1007/7OK21.9s
CG-AL-H015hard1100.0 / 1004/4OK18.1s
CG-AL-H016hard1100.0 / 1004/4OK24.7s
CG-AL-H017hard1100.0 / 1003/3OK27.5s
CG-AL-H018hard1100.0 / 1006/6OK34.6s
CG-AL-H019hard1100.0 / 1005/5OK23.8s
CG-AL-H020hard1100.0 / 10010/10OK33.5s
CG-AL-H021hard2100.0 / 10020/20OK28.7s
CG-AL-H022hard1100.0 / 10021/21OK37.4s
CG-AL-H023hard20.0 / 1000/0FAIL1m 50s
CG-AL-H024hard1100.0 / 1009/9OK24.1s
CG-AL-H025hard1100.0 / 1007/7OK21.7s
CG-AL-H026hard1100.0 / 1008/8OK20.5s
CG-AL-H027hard1100.0 / 1004/4OK20.8s
CG-AL-H028hard1100.0 / 1009/9OK22.7s
CG-AL-H029hard1100.0 / 10018/18OK34.0s
CG-AL-H030hard2100.0 / 10010/10OK26.1s
CG-AL-H031hard1100.0 / 10022/22OK35.9s
CG-AL-H032hard1100.0 / 10019/19OK30.1s
CG-AL-H033hard1100.0 / 1005/5OK3m 1s
CG-AL-H034hard2100.0 / 1003/3OK28.1s
CG-AL-H035hard1100.0 / 1003/3OK30.9s
CG-AL-H036hard2100.0 / 1005/5OK22.7s
CG-AL-H037hard1100.0 / 1003/3OK21.2s
CG-AL-H038hard1100.0 / 1003/3OK20.0s
CG-AL-H039hard1100.0 / 1004/4OK19.7s
CG-AL-H040hard1100.0 / 1002/2OK18.6s
CG-AL-H041hard2100.0 / 1003/3OK25.0s
CG-AL-H042hard1100.0 / 1003/3OK17.4s
CG-AL-H043hard1100.0 / 1005/5OK17.2s
CG-AL-H050hard1100.0 / 1003/3OK28.7s
CG-AL-H051hard1100.0 / 1004/4OK20.8s
CG-AL-H052hard1100.0 / 1005/5OK17.1s
CG-AL-H053hard1100.0 / 1004/4OK17.6s
CG-AL-H054hard2100.0 / 1005/5OK19.7s
CG-AL-H056hard2100.0 / 1004/4OK23.4s
CG-AL-H057hard1100.0 / 1004/4OK2m 42s
CG-AL-H058hard1100.0 / 1005/5OK21.6s
CG-AL-H205hard1100.0 / 1006/6OK22.3s
CG-AL-M001medium20.0 / 1000/0FAIL17.4s
CG-AL-M002medium1100.0 / 10022/22OK21.2s
CG-AL-M003medium1100.0 / 1009/9OK28.3s
CG-AL-M004medium1100.0 / 10012/12OK3m 19s
CG-AL-M005medium1100.0 / 10022/22OK42.7s
CG-AL-M006medium2100.0 / 10018/18OK1m 39s
CG-AL-M007medium20.0 / 1000/0FAIL59.0s
CG-AL-M008medium20.0 / 1000/0FAIL3m 4s
CG-AL-M009medium20.0 / 1000/0FAIL2m 3s
CG-AL-M010medium1100.0 / 10021/21OK3m 37s
CG-AL-M020medium1100.0 / 10017/17OK1m 43s
CG-AL-M021medium1100.0 / 10011/11OK1m 40s
CG-AL-M022medium1100.0 / 1009/9OK51.1s
CG-AL-M023medium262.5 / 10010/11OK38.7s
CG-AL-M024medium1100.0 / 10010/10OK25.5s
CG-AL-M025medium1100.0 / 1007/7OK19.8s
CG-AL-M026medium1100.0 / 1008/8OK23.9s
CG-AL-M027medium1100.0 / 10018/18OK30.5s
CG-AL-M028medium2100.0 / 1003/3OK2m 26s
CG-AL-M029medium2100.0 / 1003/3OK2m 29s
CG-AL-M031medium20.0 / 1000/0FAIL18.2s
CG-AL-M032medium1100.0 / 1003/3OK17.2s
CG-AL-M033medium1100.0 / 1002/2OK17.6s
CG-AL-M034medium262.5 / 1001/2OK27.4s
CG-AL-M035medium1100.0 / 1002/2OK16.3s
CG-AL-M036medium1100.0 / 1002/2OK19.7s
CG-AL-M037medium2100.0 / 1002/2OK37.7s
CG-AL-M038medium1100.0 / 1002/2OK17.9s
CG-AL-M039medium1100.0 / 1002/2OK2m 29s
CG-AL-M040medium262.5 / 1001/2OK23.9s
CG-AL-M041medium1100.0 / 1003/3OK15.9s
CG-AL-M042medium1100.0 / 1008/8OK18.3s
CG-AL-M043medium1100.0 / 1005/5OK22.5s
CG-AL-M044medium1100.0 / 1006/6OK2m 52s
CG-AL-M045medium1100.0 / 1006/6OK19.6s
CG-AL-M088medium1100.0 / 1006/6OK20.2s
CG-AL-M112medium1100.0 / 1004/4OK22.0s