Run success rate

Run success rate

Tasks the run solved on its last attempt / tasks attempted in this run.

Formula: COUNT(distinct tasks where last attempt passed) / COUNT(distinct tasks attempted in this run)

Per-run metric for the model's "final answer" on each task. Differs from leaderboard pass_at_n: this denominator is the run's own attempted-task count, not the task set size, so partial runs are not penalised for unattempted tasks.

80.9% 89/110 of 110 tasks attempted in this run
Avg score

Avg attempt score

Mean per-attempt score on a 0–100 point scale (partial credit). Drill-down only.

Formula: Mean of attempt scores across all results rows: SUM(score) / COUNT(*) over the results table. Each attempt earns 0–100 points based on compile + test outcomes.

Drill-down companion to pass_at_n. Rewards partial credit but not directly comparable to pass rate; use for within-model analysis.

67.9 / 100
Cost $3.92
Duration 1h 6m
Filter:
Per-task results for run 7fb765a9-3404-4c1b-a330-70825dcaf708
TaskDifficultyAttemptScoreTestsCompileDuration
CG-AL-E001easy1100.0 / 1007/7OK27.0s
CG-AL-E002easy1100.0 / 1006/6OK2m 50s
CG-AL-E003easy1100.0 / 1005/5OK38.7s
CG-AL-E004easy1100.0 / 1006/6OK35.5s
CG-AL-E005easy1100.0 / 10013/13OK37.4s
CG-AL-E006easy1100.0 / 1007/7OK2m 53s
CG-AL-E007easy1100.0 / 1007/7OK38.8s
CG-AL-E008easy1100.0 / 1006/6OK42.9s
CG-AL-E009easy1100.0 / 1005/5OK50.7s
CG-AL-E010easy1100.0 / 1005/5OK46.8s
CG-AL-E031easy1100.0 / 1003/3OK46.2s
CG-AL-E032easy1100.0 / 1001/1OK43.3s
CG-AL-E045easy1100.0 / 1004/4OK16.3s
CG-AL-E050easy1100.0 / 10013/13OK16.0s
CG-AL-E051easy1100.0 / 10015/15OK25.4s
CG-AL-E052easy2100.0 / 10016/16OK17.0s
CG-AL-E053easy1100.0 / 1003/3OK2m 32s
CG-AL-E054easy2100.0 / 1009/9OK14.6s
CG-AL-E055easy1100.0 / 1008/8OK15.7s
CG-AL-E056easy262.5 / 10013/15OK16.8s
CG-AL-E057easy20.0 / 1000/0FAIL10.6s
CG-AL-E058easy1100.0 / 1001/1OK13.9s
CG-AL-H001hard1100.0 / 10025/25OK16.5s
CG-AL-H002hard1100.0 / 1004/4OK20.1s
CG-AL-H003hard1100.0 / 1005/5OK20.6s
CG-AL-H004hard1100.0 / 10014/14OK18.2s
CG-AL-H005hard1100.0 / 1006/6OK20.3s
CG-AL-H006hard1100.0 / 1006/6OK15.8s
CG-AL-H007hard1100.0 / 10010/10OK21.3s
CG-AL-H008hard1100.0 / 10010/10OK17.9s
CG-AL-H009hard1100.0 / 10011/11OK23.3s
CG-AL-H010hard1100.0 / 1008/8OK18.2s
CG-AL-H011hard20.0 / 1000/0FAIL8.0s
CG-AL-H013hard1100.0 / 1009/9OK16.8s
CG-AL-H014hard2100.0 / 1007/7OK23.3s
CG-AL-H015hard1100.0 / 1004/4OK16.0s
CG-AL-H016hard1100.0 / 1004/4OK16.2s
CG-AL-H017hard20.0 / 1000/0FAIL11.5s
CG-AL-H018hard1100.0 / 1006/6OK20.7s
CG-AL-H019hard1100.0 / 1005/5OK14.0s
CG-AL-H020hard1100.0 / 10010/10OK23.2s
CG-AL-H021hard2100.0 / 10020/20OK24.6s
CG-AL-H022hard1100.0 / 10021/21OK24.9s
CG-AL-H023hard20.0 / 1000/0FAIL59.1s
CG-AL-H024hard1100.0 / 1009/9OK23.4s
CG-AL-H025hard1100.0 / 1007/7OK15.6s
CG-AL-H026hard1100.0 / 1008/8OK17.0s
CG-AL-H027hard2100.0 / 1004/4OK16.5s
CG-AL-H028hard1100.0 / 1009/9OK18.7s
CG-AL-H029hard1100.0 / 10018/18OK26.4s
CG-AL-H030hard1100.0 / 10010/10OK29.1s
CG-AL-H031hard1100.0 / 10022/22OK26.0s
CG-AL-H032hard1100.0 / 10019/19OK25.0s
CG-AL-H033hard1100.0 / 1005/5OK2m 38s
CG-AL-H034hard2100.0 / 1003/3OK14.3s
CG-AL-H035hard1100.0 / 1003/3OK14.7s
CG-AL-H036hard20.0 / 1000/0FAIL9.2s
CG-AL-H037hard2100.0 / 1003/3OK14.6s
CG-AL-H038hard1100.0 / 1003/3OK15.3s
CG-AL-H039hard1100.0 / 1004/4OK15.9s
CG-AL-H040hard1100.0 / 1002/2OK15.7s
CG-AL-H041hard1100.0 / 1003/3OK18.1s
CG-AL-H042hard1100.0 / 1003/3OK14.4s
CG-AL-H043hard1100.0 / 1005/5OK15.6s
CG-AL-H050hard20.0 / 1000/0FAIL11.8s
CG-AL-H051hard1100.0 / 1004/4OK14.7s
CG-AL-H052hard1100.0 / 1005/5OK13.9s
CG-AL-H053hard1100.0 / 1004/4OK16.2s
CG-AL-H054hard20.0 / 1000/0FAIL11.1s
CG-AL-H056hard20.0 / 1000/0FAIL7.7s
CG-AL-H057hard1100.0 / 1004/4OK2m 27s
CG-AL-H058hard1100.0 / 1005/5OK17.0s
CG-AL-H205hard1100.0 / 1006/6OK18.1s
CG-AL-M001medium20.0 / 1000/0FAIL13.5s
CG-AL-M002medium1100.0 / 10022/22OK19.3s
CG-AL-M003medium1100.0 / 1009/9OK21.4s
CG-AL-M004medium20.0 / 1000/0FAIL21.4s
CG-AL-M005medium1100.0 / 10022/22OK41.1s
CG-AL-M006medium1100.0 / 10018/18OK31.2s
CG-AL-M007medium20.0 / 1000/0FAIL29.7s
CG-AL-M008medium262.5 / 10011/12OK43.9s
CG-AL-M009medium1100.0 / 10011/11OK40.2s
CG-AL-M010medium1100.0 / 10021/21OK3m 7s
CG-AL-M020medium2100.0 / 10017/17OK21.9s
CG-AL-M021medium1100.0 / 10011/11OK19.5s
CG-AL-M022medium1100.0 / 1009/9OK21.6s
CG-AL-M023medium262.5 / 10010/11OK20.2s
CG-AL-M024medium1100.0 / 10010/10OK25.2s
CG-AL-M025medium1100.0 / 1007/7OK17.7s
CG-AL-M026medium20.0 / 1000/0FAIL11.6s
CG-AL-M027medium2100.0 / 10018/18OK29.9s
CG-AL-M028medium20.0 / 1000/0FAIL9.6s
CG-AL-M029medium20.0 / 1000/0FAIL7.5s
CG-AL-M031medium20.0 / 1000/0FAIL13.9s
CG-AL-M032medium2100.0 / 1003/3OK14.7s
CG-AL-M033medium1100.0 / 1002/2OK17.4s
CG-AL-M034medium262.5 / 1001/2OK17.2s
CG-AL-M035medium1100.0 / 1002/2OK13.8s
CG-AL-M036medium2100.0 / 1002/2OK16.9s
CG-AL-M037medium20.0 / 1000/0FAIL8.8s
CG-AL-M038medium1100.0 / 1002/2OK15.0s
CG-AL-M039medium2100.0 / 1002/2OK2m 43s
CG-AL-M040medium20.0 / 1000/0FAIL8.7s
CG-AL-M041medium1100.0 / 1003/3OK13.8s
CG-AL-M042medium1100.0 / 1008/8OK16.3s
CG-AL-M043medium1100.0 / 1005/5OK17.2s
CG-AL-M044medium1100.0 / 1006/6OK2m 30s
CG-AL-M045medium1100.0 / 1006/6OK15.0s
CG-AL-M088medium1100.0 / 1006/6OK17.8s
CG-AL-M112medium1100.0 / 1004/4OK21.0s