ARC Prize announces GPT-6.2 Astra's results on the three ARC-AGI benchmarks
ARC Prize announced the results of OpenAI GPT-6.2 Astra on the three ARC-AGI benchmarks: ARC-AGI-3 reached 100.0% (SOTA), with a cost of $4.1K under the provider adapter and 70.3% at $24.2K under the standard setting; ARC-AGI-2 scored 95.8% (SOTA) at $0.50/task; ARC-AGI-1 scored 98.5% at $0.17/task. ARC Prize states that this is the first model to achieve a 100% score on ARC-AGI-3. On the ARC-AGI-3 semi-private games, GPT-6.2 Astra used 53% fewer first-action reasoning tokens than GPT-6 Astra; on the ARC-AGI-2 semi-private tasks at the low to xhigh levels, it used 51% fewer reasoning tokens, while at the max level it used 12% more.
Why read this
SelectedAI score 74
ARC Prize gives GPT-6.2 Astra's scores and costs on the three ARC-AGI benchmarks, and compares token and action consumption with the previous generation and Sol.
Topics
Body
@OpenAI Across low through max on the ARC-AGI-3 semi-private games, GPT-6.2 Astra used 53% fewer first-action reasoning tokens than GPT-6 Astra using the provider adapter harness: https://t.co/zZgROGq2E6
AI Trends