Run success rate

Run success rate

Tasks the run solved on its last attempt / tasks attempted in this run.

Formula: COUNT(distinct tasks where last attempt passed) / COUNT(distinct tasks attempted in this run)

Per-run metric for the model's "final answer" on each task. Differs from leaderboard pass_at_n: this denominator is the run's own attempted-task count, not the task set size, so partial runs are not penalised for unattempted tasks.

82.7% 91/110 of 110 tasks attempted in this run
Avg score

Avg attempt score

Mean per-attempt score on a 0–100 point scale (partial credit). Drill-down only.

Formula: Mean of attempt scores across all results rows: SUM(score) / COUNT(*) over the results table. Each attempt earns 0–100 points based on compile + test outcomes.

Drill-down companion to pass_at_n. Rewards partial credit but not directly comparable to pass rate; use for within-model analysis.

69.8 / 100
Cost $3.65
Duration 1h 9m
Filter:
Per-task results for run 68e1635c-6be8-43aa-93e9-52e908bdf3b9
TaskDifficultyAttemptScoreTestsCompileDuration
CG-AL-E001easy1100.0 / 1007/7OK16.9s
CG-AL-E002easy1100.0 / 1006/6OK2m 31s
CG-AL-E003easy1100.0 / 1005/5OK19.9s
CG-AL-E004easy1100.0 / 1006/6OK26.3s
CG-AL-E005easy1100.0 / 10013/13OK31.0s
CG-AL-E006easy1100.0 / 1007/7OK2m 43s
CG-AL-E007easy1100.0 / 1007/7OK36.0s
CG-AL-E008easy1100.0 / 1006/6OK40.3s
CG-AL-E009easy1100.0 / 1005/5OK43.1s
CG-AL-E010easy1100.0 / 1005/5OK44.9s
CG-AL-E031easy1100.0 / 1003/3OK45.3s
CG-AL-E032easy1100.0 / 1001/1OK40.8s
CG-AL-E045easy1100.0 / 1004/4OK19.3s
CG-AL-E050easy1100.0 / 10013/13OK17.9s
CG-AL-E051easy1100.0 / 10015/15OK23.9s
CG-AL-E052easy2100.0 / 10016/16OK16.5s
CG-AL-E053easy1100.0 / 1003/3OK2m 29s
CG-AL-E054easy2100.0 / 1009/9OK19.8s
CG-AL-E055easy1100.0 / 1008/8OK16.1s
CG-AL-E056easy262.5 / 10013/15OK17.7s
CG-AL-E057easy20.0 / 1000/0FAIL10.9s
CG-AL-E058easy1100.0 / 1001/1OK14.5s
CG-AL-H001hard1100.0 / 10025/25OK16.8s
CG-AL-H002hard1100.0 / 1004/4OK19.3s
CG-AL-H003hard1100.0 / 1005/5OK21.3s
CG-AL-H004hard1100.0 / 10014/14OK19.3s
CG-AL-H005hard1100.0 / 1006/6OK21.5s
CG-AL-H006hard1100.0 / 1006/6OK16.7s
CG-AL-H007hard1100.0 / 10010/10OK20.6s
CG-AL-H008hard1100.0 / 10010/10OK18.4s
CG-AL-H009hard1100.0 / 10011/11OK23.2s
CG-AL-H010hard1100.0 / 1008/8OK18.7s
CG-AL-H011hard20.0 / 1000/0FAIL7.9s
CG-AL-H013hard1100.0 / 1009/9OK21.3s
CG-AL-H014hard20.0 / 1000/0FAIL11.5s
CG-AL-H015hard1100.0 / 1004/4OK19.2s
CG-AL-H016hard1100.0 / 1004/4OK21.7s
CG-AL-H017hard20.0 / 1000/0FAIL9.5s
CG-AL-H018hard1100.0 / 1006/6OK19.9s
CG-AL-H019hard2100.0 / 1005/5OK13.6s
CG-AL-H020hard2100.0 / 10010/10OK21.5s
CG-AL-H021hard2100.0 / 10020/20OK52.0s
CG-AL-H022hard1100.0 / 10021/21OK25.8s
CG-AL-H023hard2100.0 / 10025/25OK1m 5s
CG-AL-H024hard1100.0 / 1009/9OK34.9s
CG-AL-H025hard1100.0 / 1007/7OK18.3s
CG-AL-H026hard1100.0 / 1008/8OK16.9s
CG-AL-H027hard262.5 / 1002/4OK17.6s
CG-AL-H028hard1100.0 / 1009/9OK21.7s
CG-AL-H029hard20.0 / 1000/0FAIL20.1s
CG-AL-H030hard2100.0 / 10010/10OK28.0s
CG-AL-H031hard1100.0 / 10022/22OK27.6s
CG-AL-H032hard1100.0 / 10019/19OK25.3s
CG-AL-H033hard1100.0 / 1005/5OK2m 52s
CG-AL-H034hard2100.0 / 1003/3OK14.1s
CG-AL-H035hard1100.0 / 1003/3OK13.6s
CG-AL-H036hard2100.0 / 1005/5OK14.0s
CG-AL-H037hard1100.0 / 1003/3OK14.8s
CG-AL-H038hard1100.0 / 1003/3OK15.3s
CG-AL-H039hard1100.0 / 1004/4OK15.4s
CG-AL-H040hard1100.0 / 1002/2OK15.5s
CG-AL-H041hard1100.0 / 1003/3OK18.4s
CG-AL-H042hard1100.0 / 1003/3OK15.0s
CG-AL-H043hard1100.0 / 1005/5OK15.5s
CG-AL-H050hard20.0 / 1000/0FAIL8.9s
CG-AL-H051hard1100.0 / 1004/4OK13.8s
CG-AL-H052hard1100.0 / 1005/5OK14.1s
CG-AL-H053hard1100.0 / 1004/4OK15.2s
CG-AL-H054hard20.0 / 1000/0FAIL10.0s
CG-AL-H056hard20.0 / 1000/0FAIL7.9s
CG-AL-H057hard1100.0 / 1004/4OK2m 35s
CG-AL-H058hard1100.0 / 1005/5OK16.4s
CG-AL-H205hard1100.0 / 1006/6OK17.9s
CG-AL-M001medium20.0 / 1000/0FAIL11.5s
CG-AL-M002medium1100.0 / 10022/22OK19.3s
CG-AL-M003medium1100.0 / 1009/9OK26.5s
CG-AL-M004medium1100.0 / 10012/12OK2m 49s
CG-AL-M005medium1100.0 / 10022/22OK40.9s
CG-AL-M006medium1100.0 / 10018/18OK30.4s
CG-AL-M007medium2100.0 / 10015/15OK35.2s
CG-AL-M008medium1100.0 / 10012/12OK46.8s
CG-AL-M009medium1100.0 / 10011/11OK36.7s
CG-AL-M010medium1100.0 / 10021/21OK2m 45s
CG-AL-M020medium20.0 / 1000/0FAIL14.7s
CG-AL-M021medium1100.0 / 10011/11OK19.0s
CG-AL-M022medium1100.0 / 1009/9OK22.2s
CG-AL-M023medium262.5 / 10010/11OK22.9s
CG-AL-M024medium1100.0 / 10010/10OK24.6s
CG-AL-M025medium1100.0 / 1007/7OK17.4s
CG-AL-M026medium2100.0 / 1008/8OK17.7s
CG-AL-M027medium2100.0 / 10018/18OK29.4s
CG-AL-M028medium20.0 / 1000/0FAIL9.4s
CG-AL-M029medium2100.0 / 1003/3OK2m 22s
CG-AL-M031medium20.0 / 1000/0FAIL15.8s
CG-AL-M032medium1100.0 / 1003/3OK16.2s
CG-AL-M033medium1100.0 / 1002/2OK16.6s
CG-AL-M034medium262.5 / 1001/2OK17.8s
CG-AL-M035medium1100.0 / 1002/2OK14.3s
CG-AL-M036medium20.0 / 1000/0FAIL9.6s
CG-AL-M037medium20.0 / 1000/0FAIL8.1s
CG-AL-M038medium1100.0 / 1002/2OK14.5s
CG-AL-M039medium1100.0 / 1002/2OK2m 35s
CG-AL-M040medium20.0 / 1000/0FAIL7.5s
CG-AL-M041medium1100.0 / 1003/3OK13.2s
CG-AL-M042medium1100.0 / 1008/8OK16.6s
CG-AL-M043medium1100.0 / 1005/5OK16.5s
CG-AL-M044medium1100.0 / 1006/6OK2m 24s
CG-AL-M045medium1100.0 / 1006/6OK14.2s
CG-AL-M088medium1100.0 / 1006/6OK17.6s
CG-AL-M112medium1100.0 / 1004/4OK20.7s