Understand this story
ARC Prize announced the verified results of Anthropic's Claude Sonnet 5.5 on the ARC-AGI generations of benchmarks. For ARC-AGI-3, under the provider adapter harness the score was 72.4% at a cost of $8.2K, and under the standard harness it was 24.3% at a cost of $7.4K; ARC-AGI-2 was 83.9% at $0.55 per task; ARC-AGI-1 was 96.5% at $0.14 per task. ARC Prize said Sonnet 5.5's 72.4% on ARC-AGI-3 is noteworthy. There are currently no further developments.
AI-generated from public reports
Latest development · Report
Claude Sonnet 5.5's results on the ARC-AGI benchmark announcedDevelopments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 22
ARC PrizeFirst-partySelected
Claude Sonnet 5.5's results on the ARC-AGI benchmark announced
ARC Prize announces Anthropic's Claude Sonnet 5.5's results on each generation of the ARC-AGI benchmark: ARC-AGI-3 is 72.4% under the provider adapter harness at a cost of 8.2K USD, and 24.3% under the standard harness at a cost of 7.4K USD; ARC-AGI-2 is 83.9% at 0.55 USD per task; ARC-AGI-1 is 96.5% at 0.14 USD per task. ARC Prize says Sonnet 5.5's 72.4% on ARC-AGI-3 is noteworthy.