AI News

ARC Prize announces verified results for Claude Fable 5.2 on three ARC-AGI benchmarks

ARC PrizeUpdated Nov 10 03:47

AI summary

ARC Prize announced the verified results for Anthropic's Claude Fable 5.2 on ARC-AGI: under the standard harness for ARC-AGI-3 it scored 81.2% at a cost of $21.9K, while under the provider adapter harness it scored 97.7% at $18.6K, and it set a new high score on ARC-AGI-3 under the standard harness. It scored 93.8% on ARC-AGI-2 at $0.98/task, and 98.5% on ARC-AGI-1 at $0.36/task. ARC Prize also noted that the max reasoning level, under the standard harness, hit the 12-hour runtime limit on 28 of 55 semi-private games, scoring 65.7%, lower than the 81.2% of the xhigh level.

Why read this

AI score 67

ARC Prize announced the results and per-task costs for Claude Fable 5.2 on three ARC-AGI benchmarks, and stated that it set a new high score on ARC-AGI-3 under the standard harness.

Topics

Tags

Body

Claude Fable 5.2 from @AnthropicAI on ARC-AGI (Verified):

- ARC-AGI-3: 97.7%, $18.6K (provider adapter harness), 81.2%, $21.9K (standard harness) - ARC-AGI-2: 93.8%, $0.98/task - ARC-AGI-1: 98.5%, $0.36/task

Fable 5.2 sets a new high score on ARC-AGI-3 in the standard harness. https://t.co/GfG8Ls7kK1

Source

ARC Prize