←Story detail

Trending story

ARC Prize says scores on three ARC-AGI benchmarks are strongly correlated

1 reports1 story updatesUpdated Oct 29 00:05

Understand this story

AI overview

On October 29, 2026, ARC Prize proposed a judgment that there is a strong correlation among model scores on the three ARC-AGI benchmarks. After plotting ARC-AGI model scores, the organization found that the power curve v2 = v1^4.53 could explain about 98% of the variation in ARC-AGI-2 scores; models that were flat on ARC-AGI-1 could still differ by more than 20 percentage points on ARC-AGI-2. A similar trend also appeared on ARC-AGI-3, but the low-reasoning tier of Gemini 4 Argon was a clear exception: its ARC-AGI-2 score was only 42.1%, while its ARC-AGI-3 score reached 97.5%. There have been no subsequent developments so far.

AI-generated from public reports

Latest development · Report

ARC Prize: Strong correlation among the three ARC-AGI benchmark scores

Developments

1 confirmed developments

  1. ARC Prize says the three ARC-AGI benchmark scores are strongly correlated

    Source:ARC Prize

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 29

  1. ARC PrizeFirst-party

    ARC Prize: Strong correlation among the three ARC-AGI benchmark scores

    After plotting ARC-AGI model scores, ARC Prize found a strong association among the three benchmarks: the power curve v2 = v1^4.53 can explain about 98% of the variation in ARC-AGI-2 scores, and models that are on par on ARC-AGI-1 may still differ by more than 20 percentage points on ARC-AGI-2. A similar trend appears on ARC-AGI-3, but the low-reasoning tier of Gemini 4 Argon is a clear exception: only 42.1% on ARC-AGI-2, yet 97.5% on ARC-AGI-3.

Related stories

  1. Related storiesARC Prize says models scoring high on ARC-AGI-2 also tend to score high on ARC-AGI-3
  2. Related storiesARC Prize says the three ARC-AGI benchmark scores form a natural progression
  3. Related storiesARC Prize announces the evaluation results of Muse Spark Open on ARC-AGI
  4. Related storiesCognition Launches Coding Benchmark FrontierCode 2.0