AI Trends

ARC Prize announces GPT-6.2 Astra's results on the three ARC-AGI benchmarks

ARC PrizeUpdated Nov 18 02:31

AI summary

ARC Prize announced the results of OpenAI GPT-6.2 Astra on the three ARC-AGI benchmarks: ARC-AGI-3 reached 100.0% (SOTA), with a cost of $4.1K under the provider adapter and 70.3% at $24.2K under the standard setting; ARC-AGI-2 scored 95.8% (SOTA) at $0.50/task; ARC-AGI-1 scored 98.5% at $0.17/task. ARC Prize states that this is the first model to achieve a 100% score on ARC-AGI-3. On the ARC-AGI-3 semi-private games, GPT-6.2 Astra used 53% fewer first-action reasoning tokens than GPT-6 Astra; on the ARC-AGI-2 semi-private tasks at the low to xhigh levels, it used 51% fewer reasoning tokens, while at the max level it used 12% more.

Why read this

SelectedAI score 74

ARC Prize gives GPT-6.2 Astra's scores and costs on the three ARC-AGI benchmarks, and compares token and action consumption with the previous generation and Sol.

Topics

Tags

Body

@OpenAI Across low through max on the ARC-AGI-3 semi-private games, GPT-6.2 Astra used 53% fewer first-action reasoning tokens than GPT-6 Astra using the provider adapter harness: https://t.co/zZgROGq2E6

Source

ARC Prize