Run `8e71584d-7ee…`

completed Excluded

Claude Haiku 4 5 claude claude-haiku-4-5

· 232 tasks · 2026-09-08T15:49:44.955Z · machine: 2c09af0e-90e1-4d79-8f05-bb867284cf1e

This run is excluded from every site statistic since 2026-09-09T06:14:29.609Z. Reason: host out of memory: 5 attempts scored as prereq-compile infra failures Its own results below are unchanged.

Run success rate

Tasks the run solved on its last attempt / tasks attempted in this run.

Formula: COUNT(distinct tasks where last attempt passed) / COUNT(distinct tasks attempted in this run)

Per-run metric for the model's "final answer" on each task. Differs from leaderboard pass_at_n: this denominator is the run's own attempted-task count, not the task set size, so partial runs are not penalised for unattempted tasks.

47.0% 109/232 of 232 tasks attempted in this run

Avg score

Avg attempt score

Mean per-attempt score on a 0–100 point scale (partial credit). Drill-down only.

Formula: Mean of attempt scores across all results rows: SUM(score) / COUNT(*) over the results table. Each attempt earns 0–100 points based on compile + test outcomes.

Drill-down companion to pass_at_n. Rewards partial credit but not directly comparable to pass rate; use for within-model analysis.

45.4 / 100

Cost $3.50

Tokens 948k / 511k input / output, all attempts

Duration 59m 35s

Filter:

Per-task results for run 8e71584d-7ee8-4048-a95c-0224d0428cdf
Task	Difficulty	Attempt	Score	Tests	Compile	Duration	Tokens
CG-AL-E001	easy	1	100.0 / 100	7/7	OK	21.7s	272 / 231
CG-AL-E006	easy	2	0.0 / 100	0/0	FAIL	10.2s	1.4k / 982
CG-AL-E010	easy	1	100.0 / 100	5/5	OK	22.8s	299 / 124
CG-AL-E050	easy	2	0.0 / 100	0/0	FAIL	9.7s	2.2k / 451
CG-AL-E052	easy	1	100.0 / 100	16/16	OK	14.1s	391 / 282
CG-AL-E054	easy	2	0.0 / 100	0/0	FAIL	10.1s	1.2k / 490
CG-AL-E056	easy	2	62.5 / 100	13/15	OK	18.4s	1.9k / 694
CG-AL-H007	hard	2	100.0 / 100	11/11	OK	17.9s	2.0k / 1.3k
CG-AL-H011	hard	2	0.0 / 100	0/0	FAIL	4.3s	1.4k / 423
CG-AL-H014	hard	2	0.0 / 100	0/0	FAIL	4.3s	1.6k / 884
CG-AL-H017	hard	2	0.0 / 100	0/0	FAIL	4.2s	1.2k / 560
CG-AL-H020	hard	2	100.0 / 100	10/10	OK	12.4s	2.4k / 1.6k
CG-AL-H021	hard	2	0.0 / 100	0/0	FAIL	4.3s	3.0k / 1.6k
CG-AL-H023	hard	2	0.0 / 100	0/0	FAIL	5.6s	7.9k / 8.6k
CG-AL-H027	hard	2	62.5 / 100	2/4	OK	12.0s	2.6k / 819
CG-AL-H029	hard	2	0.0 / 100	0/0	FAIL	4.4s	3.4k / 2.3k
CG-AL-H030	hard	2	0.0 / 100	0/0	FAIL	4.5s	2.4k / 1.3k
CG-AL-H031	hard	2	100.0 / 100	22/22	OK	11.8s	3.2k / 2.2k
CG-AL-H034	hard	2	100.0 / 100	3/3	OK	11.8s	1.5k / 338
CG-AL-H036	hard	2	0.0 / 100	0/0	FAIL	4.4s	1.3k / 332
CG-AL-H037	hard	2	0.0 / 100	0/0	FAIL	4.4s	1.6k / 402
CG-AL-H041	hard	2	0.0 / 100	0/0	FAIL	4.5s	2.1k / 1.2k
CG-AL-H050	hard	2	62.5 / 100	2/3	OK	12.0s	1.4k / 433
CG-AL-H054	hard	2	100.0 / 100	5/5	OK	11.5s	2.7k / 1.9k
CG-AL-H056	hard	2	0.0 / 100	0/0	FAIL	4.3s	1.7k / 330
CG-AL-M001	medium	2	0.0 / 100	0/0	FAIL	4.1s	1.9k / 1.0k
CG-AL-M003	medium	2	0.0 / 100	0/0	FAIL	4.3s	1.8k / 1.7k
CG-AL-M004	medium	1	100.0 / 100	12/12	OK	40.0s	496 / 1.2k
CG-AL-M006	medium	2	62.5 / 100	17/18	OK	12.8s	2.4k / 2.4k
CG-AL-M007	medium	2	0.0 / 100	0/0	FAIL	4.2s	3.7k / 4.3k
CG-AL-M008	medium	2	0.0 / 100	0/0	FAIL	4.3s	5.1k / 6.4k
CG-AL-M009	medium	1	100.0 / 100	11/11	OK	14.3s	475 / 3.5k
CG-AL-M010	medium	2	62.5 / 100	20/21	OK	25.6s	3.5k / 4.0k
CG-AL-M020	medium	2	100.0 / 100	17/17	OK	11.5s	3.2k / 1.9k
CG-AL-M023	medium	1	100.0 / 100	11/11	OK	16.2s	536 / 547
CG-AL-M025	medium	2	62.5 / 100	2/8	OK	12.4s	1.4k / 780
CG-AL-M026	medium	1	100.0 / 100	8/8	OK	14.4s	426 / 347
CG-AL-M027	medium	2	0.0 / 100	0/0	FAIL	4.1s	4.6k / 3.7k
CG-AL-M028	medium	2	100.0 / 100	3/3	OK	26.5s	1.2k / 610
CG-AL-M031	medium	2	0.0 / 100	0/0	FAIL	4.1s	2.6k / 1.4k
CG-AL-M034	medium	2	66.7 / 100	0/2	OK	12.1s	1.5k / 392
CG-AL-M036	medium	2	11.1 / 100	0/0	FAIL	4.3s	1.7k / 654
CG-AL-M040	medium	2	100.0 / 100	2/2	OK	11.3s	917 / 359
CG-AL-M042	medium	2	100.0 / 100	8/8	OK	11.5s	3.0k / 759
CG-AL-X001	hard	2	62.5 / 100	1/2	OK	11.9s	1.1k / 176
CG-AL-X002	hard	2	0.0 / 100	0/0	FAIL	4.6s	1.6k / 936
CG-AL-X003	hard	2	62.5 / 100	2/3	OK	11.6s	718 / 309
CG-AL-X004	medium	1	100.0 / 100	3/3	OK	14.7s	387 / 245
CG-AL-X005	hard	1	100.0 / 100	2/2	OK	13.9s	352 / 188
CG-AL-X006	hard	2	100.0 / 100	3/3	OK	11.5s	1.5k / 682
CG-AL-X007	hard	1	100.0 / 100	2/2	OK	2m 2s	400 / 262
CG-AL-X008	hard	2	0.0 / 100	0/0	FAIL	4.7s	1.9k / 1.0k
CG-AL-X009	medium	1	100.0 / 100	2/2	OK	15.0s	334 / 128
CG-AL-X010	medium	1	100.0 / 100	3/3	OK	15.8s	306 / 147
CG-AL-X011	medium	1	100.0 / 100	2/2	OK	14.3s	396 / 162
CG-AL-X012	hard	2	0.0 / 100	0/0	FAIL	4.6s	1.7k / 609
CG-AL-X013	hard	1	100.0 / 100	2/2	OK	14.9s	286 / 90
CG-AL-X014	medium	1	100.0 / 100	4/4	OK	14.6s	313 / 91
CG-AL-X017	medium	2	0.0 / 100	0/0	FAIL	0ms	1.7k / 64k
CG-AL-X018	medium	1	100.0 / 100	3/3	OK	14.5s	420 / 173
CG-AL-X019	medium	2	62.5 / 100	0/3	OK	12.1s	2.1k / 661
CG-AL-X022	medium	2	100.0 / 100	3/3	OK	11.4s	1.5k / 474
CG-AL-X024	medium	1	100.0 / 100	3/3	OK	13.8s	371 / 352
CG-AL-X025	medium	1	100.0 / 100	1/1	OK	13.9s	413 / 330
CG-AL-X026	medium	1	100.0 / 100	3/3	OK	14.5s	353 / 184
CG-AL-X027	medium	2	100.0 / 100	4/4	OK	11.9s	825 / 380
CG-AL-X029	medium	1	100.0 / 100	2/2	OK	15.0s	304 / 171
CG-AL-X030	medium	1	100.0 / 100	2/2	OK	13.8s	271 / 102
CG-AL-X031	medium	1	100.0 / 100	3/3	OK	14.8s	321 / 174
CG-AL-X033	hard	1	100.0 / 100	2/2	OK	15.0s	380 / 134
CG-AL-X034	hard	1	100.0 / 100	3/3	OK	15.3s	333 / 144
CG-AL-X035	hard	2	62.5 / 100	0/3	OK	11.6s	1.0k / 418
CG-AL-X037	hard	2	0.0 / 100	0/0	FAIL	4.6s	1.2k / 527
CG-AL-X040	hard	2	0.0 / 100	0/0	FAIL	4.3s	1.7k / 858
CG-AL-X041	hard	2	0.0 / 100	0/0	FAIL	4.4s	1.4k / 751
CG-AL-X043	hard	2	0.0 / 100	0/0	FAIL	4.3s	1.6k / 1.3k
CG-AL-X044	hard	2	62.5 / 100	0/3	OK	11.9s	1.4k / 763
CG-AL-X045	hard	2	62.5 / 100	0/3	OK	11.8s	2.0k / 774
CG-AL-X046	hard	2	62.5 / 100	0/2	OK	11.6s	1.7k / 586
CG-AL-X047	hard	1	0.0 / 100	0/0	FAIL	5.6s	441 / 889
CG-AL-X050	hard	2	0.0 / 100	0/0	FAIL	610ms	1.9k / 842
CG-AL-X051	hard	2	0.0 / 100	0/0	FAIL	598ms	2.1k / 913
CG-AL-X052	hard	1	62.5 / 100	0/3	OK	14.9s	394 / 140
CG-AL-X055	hard	1	100.0 / 100	5/5	OK	14.9s	370 / 333
CG-AL-X056	hard	1	100.0 / 100	5/5	OK	14.5s	297 / 157
CG-AL-X057	hard	1	100.0 / 100	5/5	OK	14.0s	274 / 125
CG-AL-X058	hard	1	100.0 / 100	5/5	OK	15.1s	347 / 262
CG-AL-X059	hard	1	100.0 / 100	3/3	OK	14.3s	361 / 83
CG-AL-X060	hard	1	62.5 / 100	0/3	OK	14.2s	331 / 139
CG-AL-X061	hard	1	62.5 / 100	2/4	OK	15.3s	396 / 113
CG-AL-X062	hard	1	100.0 / 100	4/4	OK	15.0s	411 / 370
CG-AL-X063	hard	1	0.0 / 100	0/0	FAIL	6.2s	392 / 227
CG-AL-X064	hard	1	100.0 / 100	7/7	OK	13.8s	300 / 288
CG-AL-X065	hard	1	100.0 / 100	6/6	OK	15.0s	868 / 650
CG-AL-X066	hard	1	100.0 / 100	14/14	OK	13.9s	1.7k / 1.4k
CG-AL-X067	hard	2	0.0 / 100	0/0	FAIL	129ms	1.9k / 917
CG-AL-X068	hard	2	0.0 / 100	0/0	FAIL	139ms	2.9k / 2.1k
CG-AL-X069	hard	2	0.0 / 100	0/0	FAIL	142ms	3.1k / 2.3k
CG-AL-X070	hard	1	100.0 / 100	12/12	OK	15.4s	1.4k / 877
CG-AL-X071	hard	1	100.0 / 100	8/8	OK	14.5s	1.7k / 1.4k
CG-AL-X072	hard	1	100.0 / 100	7/7	OK	14.2s	1.4k / 1.1k
CG-AL-X073	hard	1	100.0 / 100	8/8	OK	14.2s	1.8k / 1.6k
CG-AL-X074	hard	1	100.0 / 100	7/7	OK	14.5s	1.9k / 1.6k
CG-AL-X075	hard	2	0.0 / 100	0/0	FAIL	255ms	4.2k / 1.6k
CG-AL-X076	hard	2	0.0 / 100	0/0	FAIL	254ms	4.2k / 1.6k
CG-AL-X077	hard	2	0.0 / 100	0/0	FAIL	378ms	4.3k / 3.5k
CG-AL-X078	hard	1	100.0 / 100	17/17	OK	14.2s	1.5k / 1.2k
CG-AL-X079	hard	2	0.0 / 100	0/0	FAIL	257ms	4.0k / 3.0k
CG-AL-X080	hard	2	0.0 / 100	0/0	FAIL	258ms	3.1k / 2.4k
CG-AL-X081	hard	1	100.0 / 100	8/8	OK	14.9s	1.1k / 741
CG-AL-X082	hard	2	0.0 / 100	0/0	FAIL	129ms	3.2k / 2.3k
CG-AL-X083	hard	1	100.0 / 100	9/9	OK	15.3s	2.0k / 1.6k
CG-AL-X084	hard	2	0.0 / 100	0/0	FAIL	302ms	4.1k / 3.0k
CG-AL-X085	hard	2	0.0 / 100	0/0	FAIL	304ms	3.4k / 1.4k
CG-AL-X086	hard	2	0.0 / 100	0/0	FAIL	132ms	4.1k / 3.7k
CG-AL-X087	hard	1	100.0 / 100	3/3	OK	14.5s	1.3k / 1.0k
CG-AL-X088	hard	1	100.0 / 100	6/6	OK	15.1s	1.2k / 956
CG-AL-X089	hard	2	0.0 / 100	0/0	FAIL	259ms	3.2k / 2.5k
CG-AL-X090	hard	2	0.0 / 100	0/0	FAIL	257ms	3.3k / 2.9k
CG-AL-X091	hard	1	100.0 / 100	6/6	OK	14.4s	699 / 879
CG-AL-X092	hard	2	0.0 / 100	0/0	FAIL	131ms	2.5k / 925
CG-AL-X093	hard	2	0.0 / 100	0/0	FAIL	254ms	2.8k / 2.1k
CG-AL-X094	hard	1	100.0 / 100	7/7	OK	14.0s	944 / 654
CG-AL-X095	hard	1	100.0 / 100	5/5	OK	14.8s	957 / 693
CG-AL-X096	hard	2	0.0 / 100	0/0	FAIL	130ms	9.0k / 8.1k
CG-AL-X097	hard	2	0.0 / 100	0/0	FAIL	249ms	9.6k / 9.0k
CG-AL-X098	hard	1	100.0 / 100	29/29	OK	16.5s	3.4k / 2.9k
CG-AL-X099	hard	2	0.0 / 100	0/0	FAIL	244ms	10k / 8.4k
CG-AL-X100	hard	1	100.0 / 100	35/35	OK	16.0s	4.4k / 3.9k
CG-AL-X101	hard	1	100.0 / 100	10/10	OK	14.4s	1.3k / 1.0k
CG-AL-X102	hard	1	100.0 / 100	8/8	OK	14.8s	615 / 339
CG-AL-X103	hard	1	100.0 / 100	7/7	OK	14.3s	891 / 596
CG-AL-X104	hard	1	100.0 / 100	6/6	OK	15.1s	1.3k / 1.0k
CG-AL-X105	hard	1	100.0 / 100	6/6	OK	14.6s	963 / 601
CG-AL-X106	hard	1	100.0 / 100	5/5	OK	13.8s	1.1k / 836
CG-AL-X107	hard	1	100.0 / 100	4/4	OK	13.8s	1.0k / 801
CG-AL-X108	hard	1	100.0 / 100	6/6	OK	15.3s	865 / 457
CG-AL-X109	hard	1	100.0 / 100	5/5	OK	15.1s	638 / 321
CG-AL-X110	hard	1	100.0 / 100	17/17	OK	14.7s	1.5k / 1.3k
CG-AL-X111	hard	1	100.0 / 100	8/8	OK	14.0s	1.4k / 1.1k
CG-AL-X112	hard	2	0.0 / 100	0/0	FAIL	138ms	2.7k / 3.4k
CG-AL-X113	hard	1	100.0 / 100	13/13	OK	15.3s	897 / 566
CG-AL-X114	hard	1	100.0 / 100	7/7	OK	14.2s	909 / 557
CG-AL-X115	hard	2	0.0 / 100	0/0	FAIL	254ms	1.7k / 704
CG-AL-X116	hard	2	0.0 / 100	0/0	FAIL	246ms	5.1k / 1.5k
CG-AL-X117	hard	1	100.0 / 100	8/8	OK	14.4s	1.2k / 957
CG-AL-X118	hard	1	100.0 / 100	17/17	OK	15.1s	1.8k / 1.4k
CG-AL-X119	hard	1	100.0 / 100	15/15	OK	15.2s	2.1k / 2.0k
CG-AL-X120	hard	1	100.0 / 100	12/12	OK	14.3s	1.6k / 1.4k
CG-AL-X121	hard	1	100.0 / 100	6/6	OK	14.5s	1.2k / 989
CG-AL-X122	hard	2	0.0 / 100	0/0	FAIL	307ms	4.2k / 3.7k
CG-AL-X123	hard	2	0.0 / 100	0/0	FAIL	309ms	1.6k / 680
CG-AL-X124	hard	1	100.0 / 100	10/10	OK	14.5s	1.2k / 875
CG-AL-X125	hard	1	100.0 / 100	8/8	OK	14.7s	1.7k / 1.4k
CG-AL-X126	hard	2	0.0 / 100	0/0	FAIL	132ms	1.9k / 835
CG-AL-X127	hard	1	100.0 / 100	5/5	OK	14.8s	807 / 489
CG-AL-X128	hard	1	100.0 / 100	8/8	OK	14.0s	1.4k / 1.0k
CG-AL-X129	hard	1	100.0 / 100	14/14	OK	14.6s	1.5k / 1.3k
CG-AL-X130	hard	2	0.0 / 100	0/0	FAIL	247ms	1.4k / 609
CG-AL-X131	hard	1	100.0 / 100	13/13	OK	14.0s	1.1k / 685
CG-AL-X132	hard	1	100.0 / 100	10/10	OK	13.7s	865 / 548
CG-AL-X133	hard	2	0.0 / 100	0/0	FAIL	249ms	4.2k / 3.7k
CG-AL-X134	hard	1	100.0 / 100	6/6	OK	15.5s	1.5k / 1.2k
CG-AL-X135	hard	1	100.0 / 100	4/4	OK	13.7s	1.0k / 706
CG-AL-X136	hard	1	100.0 / 100	7/7	OK	14.2s	889 / 390
CG-AL-X137	hard	1	100.0 / 100	4/4	OK	14.9s	1.1k / 724
CG-AL-X138	hard	1	100.0 / 100	9/9	OK	14.5s	1.7k / 1.5k
CG-AL-X139	hard	1	100.0 / 100	11/11	OK	14.7s	2.0k / 1.9k
CG-AL-X140	hard	2	0.0 / 100	0/0	FAIL	134ms	4.9k / 3.7k
CG-AL-X141	hard	1	100.0 / 100	39/39	OK	15.3s	4.4k / 3.9k
CG-AL-X142	hard	2	0.0 / 100	0/0	FAIL	256ms	12k / 5.7k
CG-AL-X143	hard	1	100.0 / 100	35/35	OK	20.9s	5.1k / 4.6k
CG-AL-X144	hard	2	0.0 / 100	0/0	FAIL	254ms	10k / 8.0k
CG-AL-X145	hard	1	100.0 / 100	32/32	OK	15.4s	5.3k / 5.0k
CG-AL-X146	hard	2	0.0 / 100	0/0	FAIL	130ms	4.9k / 4.1k
CG-AL-X147	hard	1	100.0 / 100	8/8	OK	15.2s	1.6k / 1.2k
CG-AL-X148	hard	1	100.0 / 100	6/6	OK	14.1s	1.4k / 1.0k
CG-AL-X149	hard	1	100.0 / 100	7/7	OK	14.2s	1.4k / 1.1k
CG-AL-X150	hard	2	0.0 / 100	0/0	FAIL	283ms	7.5k / 6.3k
CG-AL-X151	hard	1	100.0 / 100	6/6	OK	15.2s	999 / 665
CG-AL-X152	hard	1	100.0 / 100	8/8	OK	14.9s	1.3k / 879
CG-AL-X153	hard	2	0.0 / 100	0/0	FAIL	281ms	2.9k / 2.0k
CG-AL-X154	hard	1	100.0 / 100	9/9	OK	14.7s	1.6k / 1.3k
CG-AL-X155	hard	1	100.0 / 100	11/11	OK	14.0s	1.1k / 1.2k
CG-AL-X156	hard	1	100.0 / 100	7/7	OK	15.0s	1.1k / 735
CG-AL-X157	hard	2	0.0 / 100	0/0	FAIL	145ms	3.3k / 2.4k
CG-AL-X158	hard	1	100.0 / 100	7/7	OK	14.1s	965 / 573
CG-AL-X159	hard	1	100.0 / 100	7/7	OK	14.6s	1.0k / 669
CG-AL-X160	hard	1	100.0 / 100	13/13	OK	14.6s	1.5k / 1.5k
CG-AL-X161	hard	1	100.0 / 100	10/10	OK	14.7s	1.8k / 1.7k
CG-AL-X162	hard	1	100.0 / 100	7/7	OK	14.8s	1.2k / 994
CG-AL-X163	hard	1	100.0 / 100	7/7	OK	14.9s	1.3k / 961
CG-AL-X164	hard	1	100.0 / 100	7/7	OK	14.5s	1.1k / 807
CG-AL-X165	hard	2	0.0 / 100	0/0	FAIL	305ms	8.1k / 6.5k
CG-AL-X166	hard	2	0.0 / 100	0/0	FAIL	303ms	4.9k / 2.8k
CG-AL-X167	hard	2	0.0 / 100	0/0	FAIL	269ms	4.4k / 2.8k
CG-AL-X168	hard	2	0.0 / 100	0/0	FAIL	392ms	4.4k / 2.9k
CG-AL-X169	hard	2	0.0 / 100	0/0	FAIL	394ms	4.9k / 3.5k
CG-AL-X170	hard	2	0.0 / 100	0/0	FAIL	385ms	9.7k / 6.8k
CG-AL-X171	hard	2	0.0 / 100	0/0	FAIL	265ms	4.2k / 3.7k
CG-AL-X172	hard	2	0.0 / 100	0/0	FAIL	391ms	6.8k / 6.7k
CG-AL-X173	hard	2	0.0 / 100	0/0	FAIL	259ms	8.8k / 8.1k
CG-AL-X174	hard	2	0.0 / 100	0/0	FAIL	253ms	11k / 9.4k
CG-AL-X185	hard	2	0.0 / 100	0/0	FAIL	134ms	9.1k / 2.4k
CG-AL-X187	hard	2	0.0 / 100	0/0	FAIL	255ms	10k / 3.1k
CG-AL-X194	hard	2	0.0 / 100	0/0	FAIL	251ms	15k / 4.2k
CG-AL-X211	hard	2	0.0 / 100	0/0	FAIL	192ms	13k / 5.2k
CG-AL-X214	hard	2	0.0 / 100	0/0	FAIL	262ms	11k / 2.7k
CG-AL-X218	hard	2	0.0 / 100	0/0	FAIL	255ms	12k / 3.0k
CG-AL-X234	hard	2	0.0 / 100	0/0	FAIL	259ms	12k / 2.1k
CG-AL-X239	hard	2	0.0 / 100	0/0	FAIL	125ms	16k / 3.2k
CG-AL-X244	hard	2	0.0 / 100	0/0	FAIL	258ms	15k / 4.0k
CG-AL-X245	hard	2	0.0 / 100	0/0	FAIL	267ms	19k / 2.2k
CG-AL-X248	hard	2	0.0 / 100	0/0	FAIL	129ms	19k / 2.8k
CG-AL-X249	hard	2	0.0 / 100	0/0	FAIL	259ms	13k / 3.4k
CG-AL-X254	hard	2	0.0 / 100	0/0	FAIL	265ms	23k / 2.9k
CG-AL-X257	hard	2	0.0 / 100	0/0	FAIL	260ms	15k / 4.7k
CG-AL-X263	hard	2	0.0 / 100	0/0	FAIL	135ms	12k / 3.4k
CG-AL-X264	hard	2	0.0 / 100	0/0	FAIL	267ms	17k / 7.1k
CG-AL-X270	hard	2	0.0 / 100	0/0	FAIL	269ms	26k / 4.1k
CG-AL-X271	hard	2	0.0 / 100	0/0	FAIL	129ms	19k / 4.6k
CG-AL-X272	hard	2	0.0 / 100	0/0	FAIL	281ms	23k / 4.7k
CG-AL-X274	hard	2	0.0 / 100	0/0	FAIL	279ms	20k / 7.9k
CG-AL-X276	hard	2	0.0 / 100	0/0	FAIL	256ms	23k / 3.8k
CG-AL-X278	hard	2	0.0 / 100	0/0	FAIL	132ms	21k / 4.0k
CG-AL-X283	hard	2	0.0 / 100	0/0	FAIL	136ms	25k / 4.6k
CG-AL-X289	hard	2	0.0 / 100	0/0	FAIL	128ms	19k / 5.7k
CG-AL-X290	hard	2	0.0 / 100	0/0	FAIL	129ms	13k / 4.2k
CG-AL-X292	hard	2	0.0 / 100	0/0	FAIL	140ms	20k / 2.8k
CG-AL-X293	hard	2	0.0 / 100	0/0	FAIL	132ms	16k / 3.5k
CG-AL-X296	hard	2	0.0 / 100	0/0	FAIL	137ms	21k / 6.6k
CG-AL-X298	hard	2	0.0 / 100	0/0	FAIL	257ms	18k / 6.1k