Run `145a7708-c39…`

completed Excluded

· 208 tasks · 2026-09-09T00:41:35.868Z · machine: 2c09af0e-90e1-4d79-8f05-bb867284cf1e

This run is excluded from every site statistic since 2026-09-09T06:14:12.147Z. Reason: host out of memory: 149 attempt-1 compiles failed in about 195 ms with zero compiler errors and no artifact Its own results below are unchanged.

Run success rate

Tasks the run solved on its last attempt / tasks attempted in this run.

Formula: COUNT(distinct tasks where last attempt passed) / COUNT(distinct tasks attempted in this run)

Per-run metric for the model's "final answer" on each task. Differs from leaderboard pass_at_n: this denominator is the run's own attempted-task count, not the task set size, so partial runs are not penalised for unattempted tasks.

66.3% 138/208 of 208 tasks attempted in this run

Avg score

Avg attempt score

Mean per-attempt score on a 0–100 point scale (partial credit). Drill-down only.

Formula: Mean of attempt scores across all results rows: SUM(score) / COUNT(*) over the results table. Each attempt earns 0–100 points based on compile + test outcomes.

Drill-down companion to pass_at_n. Rewards partial credit but not directly comparable to pass rate; use for within-model analysis.

41.9 / 100

Cost $29.17

Tokens 1.2M / 2.7M input / output, all attempts

Duration 40m 29s

Filter:

Per-task results for run 145a7708-c39e-4e5b-8940-f768b9aec3d8
Task	Difficulty	Attempt	Score	Tests	Compile	Duration	Tokens
CG-AL-E001	easy	1	100.0 / 100	7/7	OK	16.6s	413 / 314
CG-AL-E006	easy	1	100.0 / 100	7/7	OK	31.2s	494 / 1.0k
CG-AL-E010	easy	1	100.0 / 100	5/5	OK	16.8s	466 / 224
CG-AL-E050	easy	2	0.0 / 100	0/0	FAIL	8.7s	3.0k / 6.1k
CG-AL-E052	easy	1	100.0 / 100	16/16	OK	16.4s	610 / 376
CG-AL-E054	easy	2	100.0 / 100	9/9	OK	17.4s	1.7k / 932
CG-AL-E056	easy	2	0.0 / 100	0/0	FAIL	8.7s	2.8k / 1.4k
CG-AL-H007	hard	1	100.0 / 100	11/11	OK	11.4s	947 / 1.2k
CG-AL-H011	hard	2	0.0 / 100	0/0	FAIL	8.7s	1.8k / 2.4k
CG-AL-H014	hard	2	100.0 / 100	7/7	OK	16.9s	4.2k / 5.0k
CG-AL-H017	hard	2	0.0 / 100	0/0	FAIL	3.8s	1.8k / 1.9k
CG-AL-H020	hard	2	100.0 / 100	10/10	OK	12.3s	3.5k / 2.5k
CG-AL-H021	hard	2	100.0 / 100	20/20	OK	12.4s	30k / 3.3k
CG-AL-H023	hard	2	100.0 / 100	25/25	OK	10.9s	11k / 37k
CG-AL-H027	hard	2	100.0 / 100	4/4	OK	10.8s	3.4k / 8.3k
CG-AL-H029	hard	2	0.0 / 100	0/0	FAIL	4.0s	4.5k / 22k
CG-AL-H030	hard	1	100.0 / 100	10/10	OK	11.0s	1.1k / 3.4k
CG-AL-H031	hard	1	100.0 / 100	22/22	OK	11.3s	1.6k / 3.0k
CG-AL-H034	hard	2	100.0 / 100	3/3	OK	10.4s	2.1k / 3.0k
CG-AL-H036	hard	2	0.0 / 100	0/0	FAIL	3.9s	1.5k / 1.3k
CG-AL-H037	hard	2	100.0 / 100	3/3	OK	10.3s	2.2k / 1.3k
CG-AL-H041	hard	2	0.0 / 100	0/0	FAIL	4.2s	2.6k / 3.3k
CG-AL-H050	hard	2	62.5 / 100	2/3	OK	10.3s	2.8k / 16k
CG-AL-H054	hard	2	0.0 / 100	0/0	FAIL	3.8s	3.0k / 1.0k
CG-AL-H056	hard	2	0.0 / 100	0/0	FAIL	3.8s	2.4k / 498
CG-AL-M001	medium	2	100.0 / 100	10/10	OK	22.6s	2.3k / 2.1k
CG-AL-M003	medium	2	100.0 / 100	9/9	OK	13.2s	2.8k / 3.1k
CG-AL-M004	medium	1	100.0 / 100	12/12	OK	31.2s	773 / 1.6k
CG-AL-M006	medium	2	100.0 / 100	18/18	OK	11.2s	3.8k / 6.3k
CG-AL-M007	medium	2	0.0 / 100	0/0	FAIL	4.0s	5.5k / 20k
CG-AL-M008	medium	2	62.5 / 100	1/12	OK	11.7s	9.4k / 32k
CG-AL-M009	medium	1	100.0 / 100	11/11	OK	11.3s	746 / 7.7k
CG-AL-M010	medium	1	100.0 / 100	21/21	OK	25.6s	958 / 3.0k
CG-AL-M020	medium	2	100.0 / 100	17/17	OK	10.4s	3.1k / 2.3k
CG-AL-M023	medium	1	100.0 / 100	11/11	OK	13.9s	803 / 861
CG-AL-M025	medium	2	100.0 / 100	8/8	OK	10.7s	4.7k / 2.3k
CG-AL-M026	medium	1	100.0 / 100	8/8	OK	10.7s	624 / 543
CG-AL-M027	medium	2	100.0 / 100	18/18	OK	10.6s	6.6k / 5.1k
CG-AL-M028	medium	2	11.1 / 100	0/0	FAIL	3.8s	1.7k / 1.3k
CG-AL-M031	medium	2	100.0 / 100	2/2	OK	10.6s	3.3k / 3.4k
CG-AL-M034	medium	1	100.0 / 100	2/2	OK	11.8s	695 / 1.1k
CG-AL-M036	medium	2	11.1 / 100	0/0	FAIL	3.9s	2.6k / 1.2k
CG-AL-M040	medium	2	0.0 / 100	0/0	FAIL	3.7s	1.3k / 1.0k
CG-AL-M042	medium	1	100.0 / 100	8/8	OK	11.9s	753 / 523
CG-AL-X001	hard	1	100.0 / 100	2/2	OK	10.7s	499 / 202
CG-AL-X002	hard	2	100.0 / 100	4/4	OK	10.2s	4.0k / 6.2k
CG-AL-X003	hard	2	0.0 / 100	0/0	FAIL	3.9s	1.5k / 3.4k
CG-AL-X004	medium	1	100.0 / 100	3/3	OK	10.9s	551 / 429
CG-AL-X005	hard	1	100.0 / 100	2/2	OK	10.4s	515 / 226
CG-AL-X006	hard	1	100.0 / 100	3/3	OK	10.9s	603 / 408
CG-AL-X007	hard	1	100.0 / 100	2/2	OK	1m 49s	575 / 726
CG-AL-X008	hard	1	100.0 / 100	1/1	OK	10.8s	641 / 2.5k
CG-AL-X009	medium	1	100.0 / 100	2/2	OK	10.5s	493 / 225
CG-AL-X010	medium	1	100.0 / 100	3/3	OK	10.6s	449 / 247
CG-AL-X011	medium	1	100.0 / 100	2/2	OK	10.6s	557 / 222
CG-AL-X012	hard	2	100.0 / 100	1/1	OK	10.1s	1.7k / 1.9k
CG-AL-X013	hard	2	100.0 / 100	2/2	OK	9.9s	1.1k / 280
CG-AL-X017	medium	2	62.5 / 100	0/3	OK	10.1s	1.1k / 292
CG-AL-X022	medium	2	62.5 / 100	1/3	OK	10.0s	1.1k / 2.8k
CG-AL-X024	medium	2	100.0 / 100	3/3	OK	10.2s	1.6k / 3.5k
CG-AL-X025	medium	2	100.0 / 100	1/1	OK	10.2s	1.6k / 1.2k
CG-AL-X027	medium	2	100.0 / 100	4/4	OK	10.0s	1.2k / 775
CG-AL-X029	medium	2	100.0 / 100	2/2	OK	10.0s	1.3k / 3.9k
CG-AL-X030	medium	2	100.0 / 100	2/2	OK	10.0s	903 / 556
CG-AL-X043	hard	2	0.0 / 100	0/0	FAIL	4.1s	1.9k / 20k
CG-AL-X055	hard	2	100.0 / 100	5/5	OK	10.2s	1.4k / 781
CG-AL-X056	hard	2	100.0 / 100	5/5	OK	10.1s	1.1k / 1.0k
CG-AL-X057	hard	2	100.0 / 100	5/5	OK	9.9s	879 / 670
CG-AL-X064	hard	2	100.0 / 100	7/7	OK	10.2s	1.2k / 2.1k
CG-AL-X065	hard	2	100.0 / 100	6/6	OK	10.1s	2.4k / 6.0k
CG-AL-X066	hard	2	100.0 / 100	14/14	OK	10.4s	4.5k / 13k
CG-AL-X067	hard	2	0.0 / 100	0/0	FAIL	3.8s	2.3k / 4.1k
CG-AL-X068	hard	2	100.0 / 100	12/12	OK	10.2s	4.1k / 12k
CG-AL-X069	hard	2	100.0 / 100	8/8	OK	10.5s	3.7k / 21k
CG-AL-X070	hard	2	100.0 / 100	12/12	OK	10.5s	3.9k / 10k
CG-AL-X071	hard	2	100.0 / 100	8/8	OK	10.3s	4.6k / 4.1k
CG-AL-X072	hard	2	100.0 / 100	7/7	OK	10.5s	4.2k / 9.5k
CG-AL-X073	hard	2	100.0 / 100	8/8	OK	10.4s	5.2k / 19k
CG-AL-X074	hard	2	100.0 / 100	7/7	OK	10.7s	5.5k / 31k
CG-AL-X075	hard	2	100.0 / 100	7/7	OK	10.2s	2.8k / 18k
CG-AL-X076	hard	2	0.0 / 100	0/0	FAIL	3.7s	2.2k / 68k
CG-AL-X077	hard	2	100.0 / 100	22/22	OK	10.1s	5.3k / 12k
CG-AL-X078	hard	2	100.0 / 100	17/17	OK	10.5s	4.1k / 5.7k
CG-AL-X079	hard	2	100.0 / 100	11/11	OK	10.5s	4.3k / 6.3k
CG-AL-X080	hard	2	62.5 / 100	5/7	OK	10.5s	3.8k / 3.9k
CG-AL-X081	hard	2	100.0 / 100	8/8	OK	10.5s	3.0k / 4.3k
CG-AL-X082	hard	2	100.0 / 100	15/15	OK	10.2s	4.3k / 5.9k
CG-AL-X083	hard	2	62.5 / 100	7/9	OK	10.6s	5.6k / 7.2k
CG-AL-X084	hard	2	100.0 / 100	10/10	OK	10.8s	5.1k / 7.2k
CG-AL-X085	hard	2	100.0 / 100	7/7	OK	10.4s	3.3k / 5.5k
CG-AL-X086	hard	2	62.5 / 100	4/6	OK	10.2s	5.2k / 23k
CG-AL-X087	hard	2	100.0 / 100	3/3	OK	10.1s	3.6k / 19k
CG-AL-X088	hard	2	100.0 / 100	6/6	OK	10.2s	3.6k / 14k
CG-AL-X089	hard	2	0.0 / 100	0/0	FAIL	4.2s	4.2k / 32k
CG-AL-X090	hard	2	62.5 / 100	7/10	OK	10.3s	3.3k / 14k
CG-AL-X091	hard	2	100.0 / 100	6/6	OK	10.0s	1.9k / 7.9k
CG-AL-X092	hard	2	100.0 / 100	15/15	OK	10.0s	1.5k / 18k
CG-AL-X093	hard	2	100.0 / 100	10/10	OK	10.5s	3.4k / 13k
CG-AL-X094	hard	2	100.0 / 100	7/7	OK	10.2s	2.7k / 2.2k
CG-AL-X095	hard	2	100.0 / 100	5/5	OK	10.2s	2.7k / 9.7k
CG-AL-X096	hard	2	100.0 / 100	49/49	OK	11.0s	12k / 17k
CG-AL-X097	hard	2	100.0 / 100	46/46	OK	11.1s	12k / 22k
CG-AL-X098	hard	2	100.0 / 100	29/29	OK	10.6s	9.6k / 23k
CG-AL-X099	hard	2	100.0 / 100	39/39	OK	12.1s	13k / 29k
CG-AL-X100	hard	2	100.0 / 100	35/35	OK	10.7s	12k / 24k
CG-AL-X101	hard	2	100.0 / 100	10/10	OK	10.2s	4.2k / 19k
CG-AL-X102	hard	2	100.0 / 100	8/8	OK	10.1s	1.8k / 8.8k
CG-AL-X103	hard	2	100.0 / 100	7/7	OK	10.1s	2.5k / 9.1k
CG-AL-X104	hard	2	100.0 / 100	6/6	OK	10.4s	3.6k / 3.5k
CG-AL-X105	hard	2	100.0 / 100	6/6	OK	10.3s	2.8k / 6.5k
CG-AL-X106	hard	2	100.0 / 100	5/5	OK	10.2s	3.3k / 6.5k
CG-AL-X107	hard	2	100.0 / 100	4/4	OK	10.0s	2.9k / 3.9k
CG-AL-X108	hard	2	100.0 / 100	6/6	OK	10.6s	2.4k / 2.6k
CG-AL-X109	hard	2	62.5 / 100	1/5	OK	10.6s	1.8k / 3.9k
CG-AL-X110	hard	2	100.0 / 100	17/17	OK	10.4s	4.2k / 12k
CG-AL-X111	hard	2	0.0 / 100	0/0	FAIL	3.8s	4.2k / 15k
CG-AL-X112	hard	2	100.0 / 100	12/12	OK	10.2s	3.4k / 22k
CG-AL-X113	hard	2	100.0 / 100	13/13	OK	10.9s	2.6k / 15k
CG-AL-X114	hard	2	100.0 / 100	7/7	OK	10.1s	2.5k / 3.7k
CG-AL-X115	hard	2	100.0 / 100	13/13	OK	10.0s	1.8k / 2.0k
CG-AL-X116	hard	2	100.0 / 100	17/17	OK	10.2s	3.1k / 6.1k
CG-AL-X117	hard	2	100.0 / 100	8/8	OK	10.4s	3.5k / 6.4k
CG-AL-X118	hard	2	100.0 / 100	17/17	OK	10.6s	4.9k / 22k
CG-AL-X119	hard	2	100.0 / 100	15/15	OK	10.5s	5.8k / 14k
CG-AL-X120	hard	2	100.0 / 100	12/12	OK	10.4s	4.6k / 11k
CG-AL-X121	hard	2	62.5 / 100	2/6	OK	10.3s	3.4k / 5.4k
CG-AL-X122	hard	2	0.0 / 100	0/0	FAIL	3.9s	5.6k / 15k
CG-AL-X123	hard	2	100.0 / 100	5/5	OK	10.3s	2.0k / 1.3k
CG-AL-X124	hard	2	100.0 / 100	10/10	OK	10.4s	3.4k / 8.0k
CG-AL-X125	hard	2	100.0 / 100	8/8	OK	10.4s	4.7k / 9.4k
CG-AL-X126	hard	2	100.0 / 100	14/14	OK	10.6s	2.5k / 4.8k
CG-AL-X127	hard	2	62.5 / 100	2/5	OK	10.4s	2.1k / 3.3k
CG-AL-X128	hard	2	100.0 / 100	8/8	OK	10.4s	4.0k / 12k
CG-AL-X129	hard	2	100.0 / 100	14/14	OK	10.7s	4.3k / 8.5k
CG-AL-X130	hard	2	0.0 / 100	0/0	FAIL	3.7s	1.8k / 3.6k
CG-AL-X131	hard	2	0.0 / 100	0/0	FAIL	3.8s	3.2k / 4.0k
CG-AL-X132	hard	2	100.0 / 100	10/10	OK	10.4s	2.5k / 2.8k
CG-AL-X133	hard	2	0.0 / 100	0/0	FAIL	3.9s	5.8k / 15k
CG-AL-X134	hard	2	100.0 / 100	6/6	OK	10.7s	4.1k / 5.7k
CG-AL-X135	hard	2	100.0 / 100	4/4	OK	10.1s	2.9k / 8.9k
CG-AL-X136	hard	2	100.0 / 100	7/7	OK	10.1s	2.5k / 8.6k
CG-AL-X137	hard	2	100.0 / 100	4/4	OK	10.2s	3.1k / 15k
CG-AL-X138	hard	2	100.0 / 100	9/9	OK	10.7s	5.0k / 12k
CG-AL-X139	hard	2	100.0 / 100	11/11	OK	10.5s	5.9k / 14k
CG-AL-X140	hard	2	100.0 / 100	7/7	OK	10.4s	5.8k / 22k
CG-AL-X141	hard	2	100.0 / 100	39/39	OK	11.0s	13k / 19k
CG-AL-X142	hard	2	100.0 / 100	48/48	OK	11.3s	15k / 52k
CG-AL-X143	hard	2	100.0 / 100	35/35	OK	15.6s	15k / 33k
CG-AL-X144	hard	2	100.0 / 100	43/43	OK	10.8s	13k / 12k
CG-AL-X145	hard	2	100.0 / 100	32/32	OK	11.0s	15k / 20k
CG-AL-X146	hard	2	100.0 / 100	9/9	OK	10.7s	6.5k / 19k
CG-AL-X147	hard	2	100.0 / 100	8/8	OK	10.0s	4.6k / 8.3k
CG-AL-X148	hard	2	100.0 / 100	6/6	OK	10.4s	3.8k / 13k
CG-AL-X149	hard	2	100.0 / 100	7/7	OK	10.4s	3.8k / 5.7k
CG-AL-X150	hard	2	62.5 / 100	7/9	OK	10.8s	7.8k / 26k
CG-AL-X151	hard	2	100.0 / 100	6/6	OK	10.0s	3.0k / 12k
CG-AL-X152	hard	2	100.0 / 100	8/8	OK	10.4s	3.8k / 7.0k
CG-AL-X153	hard	2	100.0 / 100	9/9	OK	14.1s	2.8k / 4.3k
CG-AL-X154	hard	2	100.0 / 100	9/9	OK	10.4s	4.4k / 12k
CG-AL-X155	hard	2	100.0 / 100	11/11	OK	10.7s	3.4k / 13k
CG-AL-X156	hard	2	100.0 / 100	7/7	OK	10.1s	3.0k / 3.3k
CG-AL-X157	hard	2	100.0 / 100	10/10	OK	10.5s	4.4k / 12k
CG-AL-X158	hard	2	100.0 / 100	7/7	OK	10.0s	2.7k / 8.8k
CG-AL-X159	hard	2	100.0 / 100	7/7	OK	10.7s	2.8k / 14k
CG-AL-X160	hard	2	100.0 / 100	13/13	OK	10.5s	4.5k / 11k
CG-AL-X161	hard	2	100.0 / 100	10/10	OK	11.0s	5.3k / 16k
CG-AL-X162	hard	2	100.0 / 100	7/7	OK	10.4s	3.3k / 11k
CG-AL-X163	hard	2	100.0 / 100	7/7	OK	10.2s	3.5k / 11k
CG-AL-X164	hard	2	100.0 / 100	7/7	OK	10.2s	3.1k / 14k
CG-AL-X165	hard	2	0.0 / 100	0/0	FAIL	3.8s	9.2k / 15k
CG-AL-X166	hard	2	0.0 / 100	0/0	FAIL	3.9s	5.2k / 4.8k
CG-AL-X167	hard	2	0.0 / 100	0/0	FAIL	3.8s	4.8k / 5.4k
CG-AL-X168	hard	2	100.0 / 100	9/9	OK	10.8s	5.0k / 12k
CG-AL-X169	hard	2	0.0 / 100	0/0	FAIL	3.9s	6.0k / 19k
CG-AL-X170	hard	2	100.0 / 100	11/11	OK	10.5s	11k / 26k
CG-AL-X171	hard	2	100.0 / 100	9/9	OK	10.5s	5.7k / 18k
CG-AL-X172	hard	2	100.0 / 100	11/11	OK	10.7s	9.0k / 38k
CG-AL-X173	hard	2	62.5 / 100	17/19	OK	11.9s	13k / 63k
CG-AL-X174	hard	2	62.5 / 100	14/16	OK	11.0s	14k / 26k
CG-AL-X185	hard	2	62.5 / 100	37/43	OK	11.0s	8.3k / 14k
CG-AL-X187	hard	2	0.0 / 100	0/0	FAIL	3.9s	11k / 21k
CG-AL-X194	hard	2	62.5 / 100	48/50	OK	11.1s	17k / 22k
CG-AL-X211	hard	2	0.0 / 100	0/0	FAIL	3.9s	13k / 26k
CG-AL-X214	hard	2	62.5 / 100	31/34	OK	11.2s	12k / 9.4k
CG-AL-X218	hard	2	0.0 / 100	0/0	FAIL	4.0s	12k / 37k
CG-AL-X234	hard	2	62.5 / 100	28/35	OK	11.2s	13k / 57k
CG-AL-X239	hard	2	62.5 / 100	34/37	OK	11.2s	17k / 14k
CG-AL-X244	hard	2	62.5 / 100	35/38	OK	11.3s	18k / 16k
CG-AL-X245	hard	2	62.5 / 100	59/63	OK	11.7s	14k / 42k
CG-AL-X248	hard	2	62.5 / 100	62/66	OK	11.6s	14k / 30k
CG-AL-X249	hard	2	62.5 / 100	34/37	OK	11.5s	15k / 17k
CG-AL-X254	hard	2	62.5 / 100	60/70	OK	11.6s	20k / 34k
CG-AL-X257	hard	2	0.0 / 100	0/0	FAIL	3.9s	14k / 37k
CG-AL-X263	hard	2	62.5 / 100	57/61	OK	11.3s	16k / 35k
CG-AL-X264	hard	2	62.5 / 100	57/65	OK	11.4s	17k / 29k
CG-AL-X270	hard	2	0.0 / 100	0/0	FAIL	4.5s	26k / 22k
CG-AL-X271	hard	2	0.0 / 100	0/0	FAIL	4.2s	26k / 37k
CG-AL-X272	hard	2	62.5 / 100	75/79	OK	11.6s	21k / 33k
CG-AL-X274	hard	2	0.0 / 100	0/0	FAIL	4.0s	19k / 30k
CG-AL-X276	hard	2	62.5 / 100	73/78	OK	12.6s	22k / 52k
CG-AL-X278	hard	2	0.0 / 100	0/0	FAIL	4.1s	22k / 35k
CG-AL-X283	hard	2	62.5 / 100	71/76	OK	11.6s	22k / 43k
CG-AL-X289	hard	2	62.5 / 100	53/57	OK	11.2s	18k / 44k
CG-AL-X290	hard	2	62.5 / 100	43/47	OK	11.3s	18k / 38k
CG-AL-X292	hard	2	62.5 / 100	49/57	OK	11.3s	16k / 53k
CG-AL-X293	hard	2	62.5 / 100	45/49	OK	11.6s	15k / 26k
CG-AL-X296	hard	2	62.5 / 100	36/47	OK	11.7s	23k / 18k
CG-AL-X298	hard	2	62.5 / 100	53/55	OK	11.2s	15k / 35k