Run `1a73d36e-7b7…`

completed

Claude Haiku 4 5 claude claude-haiku-4-5

· 232 tasks · 2026-09-09T06:43:16.910Z · machine: 2c09af0e-90e1-4d79-8f05-bb867284cf1e

Run success rate

Tasks the run solved on its last attempt / tasks attempted in this run.

Formula: COUNT(distinct tasks where last attempt passed) / COUNT(distinct tasks attempted in this run)

Per-run metric for the model's "final answer" on each task. Differs from leaderboard pass_at_n: this denominator is the run's own attempted-task count, not the task set size, so partial runs are not penalised for unattempted tasks.

53.9% 125/232 of 232 tasks attempted in this run

Avg score

Avg attempt score

Mean per-attempt score on a 0–100 point scale (partial credit). Drill-down only.

Formula: Mean of attempt scores across all results rows: SUM(score) / COUNT(*) over the results table. Each attempt earns 0–100 points based on compile + test outcomes.

Drill-down companion to pass_at_n. Rewards partial credit but not directly comparable to pass rate; use for within-model analysis.

57.7 / 100

Cost $3.53

Duration 1h 4m

Filter:

Per-task results for run 1a73d36e-7b77-45e3-81cc-1b07e64adfd3
Task	Difficulty	Attempt	Score	Tests	Compile	Duration
CG-AL-E001	easy	1	100.0 / 100	7/7	OK	26.8s
CG-AL-E006	easy	2	0.0 / 100	0/0	FAIL	10.0s
CG-AL-E010	easy	2	0.0 / 100	0/0	FAIL	10.0s
CG-AL-E050	easy	2	0.0 / 100	0/0	FAIL	9.9s
CG-AL-E052	easy	1	100.0 / 100	16/16	OK	11.5s
CG-AL-E054	easy	2	0.0 / 100	0/0	FAIL	4.3s
CG-AL-E056	easy	2	62.5 / 100	13/15	OK	22.1s
CG-AL-H007	easy	2	100.0 / 100	11/11	OK	22.4s
CG-AL-H011	easy	2	0.0 / 100	0/0	FAIL	3.8s
CG-AL-H014	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-H017	easy	2	0.0 / 100	0/0	FAIL	3.8s
CG-AL-H020	easy	2	0.0 / 100	0/0	FAIL	9.1s
CG-AL-H021	easy	2	0.0 / 100	0/0	FAIL	4.2s
CG-AL-H023	easy	2	0.0 / 100	0/0	FAIL	4.2s
CG-AL-H027	easy	2	62.5 / 100	2/4	OK	12.3s
CG-AL-H029	easy	2	62.5 / 100	16/18	OK	11.8s
CG-AL-H030	easy	2	0.0 / 100	0/0	FAIL	4.4s
CG-AL-H031	easy	2	100.0 / 100	22/22	OK	12.3s
CG-AL-H034	easy	2	100.0 / 100	3/3	OK	18.8s
CG-AL-H036	easy	2	100.0 / 100	5/5	OK	10.8s
CG-AL-H037	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-H041	easy	2	0.0 / 100	0/0	FAIL	3.9s
CG-AL-H050	easy	2	62.5 / 100	2/3	OK	11.6s
CG-AL-H054	easy	2	100.0 / 100	5/5	OK	11.6s
CG-AL-H056	easy	2	0.0 / 100	0/0	FAIL	4.6s
CG-AL-M001	easy	2	0.0 / 100	0/0	FAIL	4.0s
CG-AL-M003	easy	2	0.0 / 100	0/0	FAIL	4.3s
CG-AL-M004	easy	1	100.0 / 100	12/12	OK	33.7s
CG-AL-M006	easy	1	100.0 / 100	18/18	OK	12.0s
CG-AL-M007	easy	2	0.0 / 100	0/0	FAIL	3.8s
CG-AL-M008	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-M009	easy	1	100.0 / 100	11/11	OK	11.7s
CG-AL-M010	easy	2	62.5 / 100	20/21	OK	28.4s
CG-AL-M020	easy	2	0.0 / 100	0/0	FAIL	4.2s
CG-AL-M023	easy	1	100.0 / 100	11/11	OK	12.8s
CG-AL-M025	easy	2	62.5 / 100	2/8	OK	10.9s
CG-AL-M026	easy	1	100.0 / 100	8/8	OK	11.1s
CG-AL-M027	easy	2	0.0 / 100	0/0	FAIL	4.2s
CG-AL-M028	easy	2	100.0 / 100	3/3	OK	28.7s
CG-AL-M031	easy	2	0.0 / 100	0/0	FAIL	3.8s
CG-AL-M034	easy	2	66.7 / 100	0/2	OK	11.9s
CG-AL-M036	easy	2	11.1 / 100	0/0	FAIL	4.0s
CG-AL-M040	easy	2	100.0 / 100	2/2	OK	11.9s
CG-AL-M042	easy	2	100.0 / 100	8/8	OK	12.7s
CG-AL-X001	easy	2	62.5 / 100	1/2	OK	11.8s
CG-AL-X002	easy	2	0.0 / 100	0/0	FAIL	4.4s
CG-AL-X003	easy	2	62.5 / 100	2/3	OK	11.3s
CG-AL-X004	easy	1	100.0 / 100	3/3	OK	17.8s
CG-AL-X005	easy	1	100.0 / 100	2/2	OK	11.1s
CG-AL-X006	easy	2	100.0 / 100	3/3	OK	11.3s
CG-AL-X007	easy	1	100.0 / 100	2/2	OK	1m 57s
CG-AL-X008	easy	2	100.0 / 100	1/1	OK	11.9s
CG-AL-X009	easy	1	100.0 / 100	2/2	OK	11.3s
CG-AL-X010	easy	1	100.0 / 100	3/3	OK	12.4s
CG-AL-X011	easy	1	100.0 / 100	2/2	OK	11.4s
CG-AL-X012	easy	2	0.0 / 100	0/0	FAIL	4.2s
CG-AL-X013	easy	1	100.0 / 100	2/2	OK	11.1s
CG-AL-X014	easy	1	100.0 / 100	4/4	OK	11.1s
CG-AL-X017	easy	2	0.0 / 100	0/0	FAIL	0ms
CG-AL-X018	easy	1	100.0 / 100	3/3	OK	11.0s
CG-AL-X019	easy	2	100.0 / 100	3/3	OK	11.5s
CG-AL-X022	easy	2	100.0 / 100	3/3	OK	12.0s
CG-AL-X024	easy	1	100.0 / 100	3/3	OK	10.8s
CG-AL-X025	easy	1	100.0 / 100	1/1	OK	11.3s
CG-AL-X026	easy	1	100.0 / 100	3/3	OK	11.5s
CG-AL-X027	easy	2	100.0 / 100	4/4	OK	11.1s
CG-AL-X029	easy	1	100.0 / 100	2/2	OK	10.9s
CG-AL-X030	easy	1	100.0 / 100	2/2	OK	10.9s
CG-AL-X031	easy	1	100.0 / 100	3/3	OK	11.2s
CG-AL-X033	easy	1	100.0 / 100	2/2	OK	11.1s
CG-AL-X034	easy	1	100.0 / 100	3/3	OK	11.0s
CG-AL-X035	easy	2	0.0 / 100	0/0	FAIL	4.3s
CG-AL-X037	easy	2	0.0 / 100	0/0	FAIL	4.3s
CG-AL-X040	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-X041	easy	2	0.0 / 100	0/0	FAIL	4.4s
CG-AL-X043	easy	2	0.0 / 100	0/0	FAIL	4.7s
CG-AL-X044	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-X045	easy	2	62.5 / 100	0/3	OK	11.0s
CG-AL-X046	easy	2	62.5 / 100	0/2	OK	11.1s
CG-AL-X047	easy	2	62.5 / 100	1/2	OK	11.8s
CG-AL-X050	easy	2	62.5 / 100	0/2	OK	12.4s
CG-AL-X051	easy	2	62.5 / 100	0/2	OK	13.0s
CG-AL-X052	easy	2	62.5 / 100	0/3	OK	11.9s
CG-AL-X055	easy	1	100.0 / 100	5/5	OK	10.9s
CG-AL-X056	easy	1	100.0 / 100	5/5	OK	10.7s
CG-AL-X057	easy	1	100.0 / 100	5/5	OK	10.5s
CG-AL-X058	easy	1	100.0 / 100	5/5	OK	11.1s
CG-AL-X059	easy	1	100.0 / 100	3/3	OK	11.0s
CG-AL-X060	easy	2	100.0 / 100	3/3	OK	11.5s
CG-AL-X061	easy	2	100.0 / 100	4/4	OK	11.2s
CG-AL-X062	easy	1	100.0 / 100	4/4	OK	10.8s
CG-AL-X063	easy	2	0.0 / 100	0/0	FAIL	4.3s
CG-AL-X064	easy	1	100.0 / 100	7/7	OK	10.7s
CG-AL-X065	easy	1	100.0 / 100	6/6	OK	11.1s
CG-AL-X066	easy	2	100.0 / 100	14/14	OK	11.8s
CG-AL-X067	easy	2	62.5 / 100	6/7	OK	10.9s
CG-AL-X068	easy	2	62.5 / 100	3/12	OK	11.5s
CG-AL-X069	easy	2	62.5 / 100	6/8	OK	11.4s
CG-AL-X070	easy	1	100.0 / 100	12/12	OK	11.3s
CG-AL-X071	easy	1	100.0 / 100	8/8	OK	11.1s
CG-AL-X072	easy	1	100.0 / 100	7/7	OK	11.2s
CG-AL-X073	easy	1	100.0 / 100	8/8	OK	11.1s
CG-AL-X074	easy	1	100.0 / 100	7/7	OK	11.3s
CG-AL-X075	easy	2	62.5 / 100	1/7	OK	11.6s
CG-AL-X076	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-X077	easy	2	100.0 / 100	22/22	OK	11.4s
CG-AL-X078	easy	1	100.0 / 100	17/17	OK	11.4s
CG-AL-X079	easy	2	62.5 / 100	10/11	OK	11.7s
CG-AL-X080	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-X081	easy	1	100.0 / 100	8/8	OK	11.4s
CG-AL-X082	easy	2	100.0 / 100	15/15	OK	11.3s
CG-AL-X083	easy	1	100.0 / 100	9/9	OK	11.2s
CG-AL-X084	easy	2	100.0 / 100	10/10	OK	11.9s
CG-AL-X085	easy	1	100.0 / 100	7/7	OK	11.5s
CG-AL-X086	easy	2	100.0 / 100	6/6	OK	12.2s
CG-AL-X087	easy	1	100.0 / 100	3/3	OK	11.4s
CG-AL-X088	easy	1	100.0 / 100	6/6	OK	10.9s
CG-AL-X089	easy	2	100.0 / 100	11/11	OK	11.7s
CG-AL-X090	easy	2	62.5 / 100	6/10	OK	11.9s
CG-AL-X091	easy	2	100.0 / 100	6/6	OK	12.0s
CG-AL-X092	easy	2	100.0 / 100	15/15	OK	12.0s
CG-AL-X093	easy	2	0.0 / 100	0/0	FAIL	4.3s
CG-AL-X094	easy	1	100.0 / 100	7/7	OK	10.9s
CG-AL-X095	easy	1	100.0 / 100	5/5	OK	11.0s
CG-AL-X096	easy	2	62.5 / 100	47/49	OK	12.7s
CG-AL-X097	easy	2	100.0 / 100	46/46	OK	12.7s
CG-AL-X098	easy	1	100.0 / 100	29/29	OK	11.2s
CG-AL-X099	easy	2	100.0 / 100	39/39	OK	14.0s
CG-AL-X100	easy	1	100.0 / 100	35/35	OK	11.7s
CG-AL-X101	easy	1	100.0 / 100	10/10	OK	11.4s
CG-AL-X102	easy	1	100.0 / 100	8/8	OK	11.5s
CG-AL-X103	easy	1	100.0 / 100	7/7	OK	11.9s
CG-AL-X104	easy	1	100.0 / 100	6/6	OK	12.2s
CG-AL-X105	easy	1	100.0 / 100	6/6	OK	12.2s
CG-AL-X106	easy	1	100.0 / 100	5/5	OK	12.1s
CG-AL-X107	easy	1	100.0 / 100	4/4	OK	12.1s
CG-AL-X108	easy	1	100.0 / 100	6/6	OK	12.5s
CG-AL-X109	easy	1	100.0 / 100	5/5	OK	12.3s
CG-AL-X110	easy	1	100.0 / 100	17/17	OK	12.0s
CG-AL-X111	easy	1	100.0 / 100	8/8	OK	11.7s
CG-AL-X112	easy	2	100.0 / 100	12/12	OK	11.2s
CG-AL-X113	easy	1	100.0 / 100	13/13	OK	12.0s
CG-AL-X114	easy	1	100.0 / 100	7/7	OK	11.6s
CG-AL-X115	easy	2	0.0 / 100	0/0	FAIL	3.9s
CG-AL-X116	easy	2	62.5 / 100	1/17	OK	11.3s
CG-AL-X117	easy	1	100.0 / 100	8/8	OK	11.7s
CG-AL-X118	easy	2	62.5 / 100	9/17	OK	11.9s
CG-AL-X119	easy	1	100.0 / 100	15/15	OK	12.4s
CG-AL-X120	easy	1	100.0 / 100	12/12	OK	12.1s
CG-AL-X121	easy	1	100.0 / 100	6/6	OK	12.5s
CG-AL-X122	easy	2	62.5 / 100	9/10	OK	11.2s
CG-AL-X123	easy	2	0.0 / 100	0/0	FAIL	4.0s
CG-AL-X124	easy	1	100.0 / 100	10/10	OK	11.9s
CG-AL-X125	easy	1	100.0 / 100	8/8	OK	11.7s
CG-AL-X126	easy	2	100.0 / 100	14/14	OK	11.3s
CG-AL-X127	easy	1	100.0 / 100	5/5	OK	11.7s
CG-AL-X128	easy	1	100.0 / 100	8/8	OK	11.4s
CG-AL-X129	easy	1	100.0 / 100	14/14	OK	11.3s
CG-AL-X130	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-X131	easy	1	100.0 / 100	13/13	OK	11.4s
CG-AL-X132	easy	1	100.0 / 100	10/10	OK	11.2s
CG-AL-X133	easy	2	62.5 / 100	6/8	OK	11.7s
CG-AL-X134	easy	1	100.0 / 100	6/6	OK	11.9s
CG-AL-X135	easy	1	100.0 / 100	4/4	OK	11.4s
CG-AL-X136	easy	1	100.0 / 100	7/7	OK	12.1s
CG-AL-X137	easy	1	100.0 / 100	4/4	OK	11.6s
CG-AL-X138	easy	1	100.0 / 100	9/9	OK	11.9s
CG-AL-X139	easy	1	100.0 / 100	11/11	OK	11.8s
CG-AL-X140	easy	2	62.5 / 100	3/7	OK	12.0s
CG-AL-X141	easy	1	100.0 / 100	39/39	OK	13.4s
CG-AL-X142	easy	2	62.5 / 100	44/48	OK	12.6s
CG-AL-X143	easy	1	100.0 / 100	35/35	OK	17.8s
CG-AL-X144	easy	2	0.0 / 100	0/0	FAIL	4.3s
CG-AL-X145	easy	1	100.0 / 100	32/32	OK	13.0s
CG-AL-X146	easy	2	62.5 / 100	6/9	OK	11.5s
CG-AL-X147	easy	1	100.0 / 100	8/8	OK	12.1s
CG-AL-X148	easy	1	100.0 / 100	6/6	OK	12.0s
CG-AL-X149	easy	1	100.0 / 100	7/7	OK	12.2s
CG-AL-X150	easy	2	62.5 / 100	6/9	OK	11.5s
CG-AL-X151	easy	1	100.0 / 100	6/6	OK	12.3s
CG-AL-X152	easy	1	100.0 / 100	8/8	OK	12.2s
CG-AL-X153	easy	2	62.5 / 100	6/9	OK	14.8s
CG-AL-X154	easy	1	100.0 / 100	9/9	OK	13.4s
CG-AL-X155	easy	1	100.0 / 100	11/11	OK	13.9s
CG-AL-X156	easy	1	100.0 / 100	7/7	OK	12.3s
CG-AL-X157	easy	1	100.0 / 100	10/10	OK	11.6s
CG-AL-X158	easy	1	100.0 / 100	7/7	OK	11.4s
CG-AL-X159	easy	1	100.0 / 100	7/7	OK	11.8s
CG-AL-X160	easy	1	100.0 / 100	13/13	OK	12.1s
CG-AL-X161	easy	1	100.0 / 100	10/10	OK	12.0s
CG-AL-X162	easy	1	100.0 / 100	7/7	OK	11.9s
CG-AL-X163	easy	1	100.0 / 100	7/7	OK	11.5s
CG-AL-X164	easy	1	100.0 / 100	7/7	OK	11.5s
CG-AL-X165	easy	2	0.0 / 100	0/0	FAIL	4.3s
CG-AL-X166	easy	2	100.0 / 100	14/14	OK	13.0s
CG-AL-X167	easy	2	100.0 / 100	13/13	OK	12.4s
CG-AL-X168	easy	2	62.5 / 100	4/9	OK	12.2s
CG-AL-X169	easy	2	62.5 / 100	7/11	OK	11.9s
CG-AL-X170	easy	2	62.5 / 100	8/11	OK	11.7s
CG-AL-X171	easy	2	62.5 / 100	1/9	OK	11.7s
CG-AL-X172	easy	2	62.5 / 100	6/11	OK	12.0s
CG-AL-X173	easy	2	62.5 / 100	17/19	OK	13.3s
CG-AL-X174	easy	2	62.5 / 100	14/16	OK	12.1s
CG-AL-X185	easy	2	62.5 / 100	41/43	OK	12.0s
CG-AL-X187	easy	2	0.0 / 100	0/0	FAIL	4.2s
CG-AL-X194	easy	2	62.5 / 100	44/50	OK	12.8s
CG-AL-X211	easy	2	62.5 / 100	36/43	OK	12.3s
CG-AL-X214	easy	2	62.5 / 100	31/34	OK	13.1s
CG-AL-X218	easy	2	62.5 / 100	24/27	OK	12.9s
CG-AL-X234	easy	2	62.5 / 100	32/35	OK	12.3s
CG-AL-X239	easy	2	62.5 / 100	33/37	OK	12.5s
CG-AL-X244	easy	2	62.5 / 100	35/38	OK	12.3s
CG-AL-X245	easy	2	62.5 / 100	42/63	OK	12.6s
CG-AL-X248	easy	2	62.5 / 100	37/66	OK	13.0s
CG-AL-X249	easy	2	62.5 / 100	34/37	OK	12.1s
CG-AL-X254	easy	2	0.0 / 100	0/0	FAIL	3.8s
CG-AL-X257	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-X263	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-X264	easy	2	62.5 / 100	62/65	OK	12.8s
CG-AL-X270	easy	2	62.5 / 100	54/63	OK	13.7s
CG-AL-X271	easy	2	0.0 / 100	0/0	FAIL	4.1s
CG-AL-X272	easy	2	62.5 / 100	59/79	OK	13.4s
CG-AL-X274	easy	2	62.5 / 100	60/64	OK	12.8s
CG-AL-X276	easy	2	62.5 / 100	57/78	OK	13.8s
CG-AL-X278	easy	2	62.5 / 100	62/71	OK	13.6s
CG-AL-X283	easy	2	0.0 / 100	0/0	FAIL	4.8s
CG-AL-X289	easy	2	62.5 / 100	46/57	OK	13.7s
CG-AL-X290	easy	2	0.0 / 100	0/0	FAIL	4.5s
CG-AL-X292	easy	2	62.5 / 100	40/57	OK	14.1s
CG-AL-X293	easy	2	0.0 / 100	0/0	FAIL	4.2s
CG-AL-X296	easy	2	62.5 / 100	41/47	OK	13.3s
CG-AL-X298	easy	2	0.0 / 100	0/0	FAIL	4.1s