←Story detail

Trending story

ARC Prize says models scoring high on ARC-AGI-2 also tend to score high on ARC-AGI-3

1 reports1 story updatesUpdated Oct 29 00:05

Understand this story

AI overview

ARC Prize proposes a judgment: models that score higher on ARC-AGI-2 tend to also score higher on ARC-AGI-3. ARC Prize also points out an obvious exception—Gemini 4 Argon at the low reasoning tier scores only 42.1% on ARC-AGI-2, but reaches 97.5% on ARC-AGI-3 under the provider adapter harness. Currently this judgment is released by ARC Prize alone, and there are no other developments or facts yet.

AI-generated from public reports

Latest development · Report

ARC Prize: Models scoring high on ARC-AGI-2 also score higher on ARC-AGI-3

Developments

1 confirmed developments

  1. ARC Prize says models scoring high on ARC-AGI-2 also tend to score high on ARC-AGI-3

    Source:ARC Prize

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 29

  1. ARC PrizeFirst-party

    ARC Prize: Models scoring high on ARC-AGI-2 also score higher on ARC-AGI-3

    ARC Prize notes that a similar relationship exists on ARC-AGI-3: models that score higher on ARC-AGI-2 tend to also score higher on ARC-AGI-3. One notable exception is Gemini 4 Argon at the low reasoning setting, which scored only 42.1% on ARC-AGI-2 but reached 97.5% on ARC-AGI-3 under the provider adapter harness.

Related stories

  1. Related storiesCognition Launches Coding Benchmark FrontierCode 2.0
  2. Related storiesMistral releases Large 4 weights on Hugging Face
  3. Related storiesGoogle releases the Gemini 4 Carbon model
  4. Related storiesMeta releases open-weight model Muse Spark Open