AI Trends

ARC Prize announces GPT-6.2 Astra's scores and costs on the ARC-AGI benchmarks

ARC PrizeUpdated Nov 18 02:31

AI summary

ARC Prize announces the results of OpenAI GPT-6.2 Astra on the ARC-AGI series of benchmarks: ARC-AGI-3 scored 100.0% (SOTA), at a cost of $4.1K (provider adapter), 70.3% and $24.2K (standard); ARC-AGI-2 scored 95.8% (SOTA), at $0.50/task; ARC-AGI-1 scored 98.5%, at $0.17/task. On the ARC-AGI-2 semi-private tasks, from the low to xhigh tiers, GPT-6.2 Astra's reasoning token usage is 51% lower than the previous generation GPT-6 Astra, while at the max tier it is 12% higher. On the 25 public games in ARC-AGI-3 under max reasoning, its number of actions is 64.1% lower than the human baseline and 5.2% lower than GPT-6 Astra.

Why read this

SelectedAI score 72

ARC Prize presents GPT-6.2 Astra's scores and costs across the ARC-AGI tiers, and compares the change in reasoning token usage versus the previous generation.

Topics

Tags

Body

@OpenAI Across low through xhigh on ARC-AGI-2 semi-private tasks, GPT-6.2 Astra used 51% fewer reasoning tokens than its predecessor GPT-6 Astra. At max, it used 12% more: https://t.co/kdoJRqyPAL

Source

ARC Prize