AI Trends

Trending story

Gemini 4 Hydrogen Achieves Verified ARC-AGI Scores

1 reports1 story updatesUpdated Nov 21 00:57

Understand this story

AI overview

On November 21, ARC Prize testing showed that Gemini 4 Hydrogen scored 92.5% on ARC-AGI-2 and 98.5% on ARC-AGI-1, at a cost per task of $1.26 and $0.18, respectively. At the high reasoning setting, its performance matched or exceeded Gemini 3.8 Flash while using approximately 52% fewer reasoning tokens. ARC-AGI-3 testing could not be completed due to multi-action function calling and API issues such as MALFORMED_FUNCTION_CALL. There are currently no other subsequent developments supported by factual evidence.

AI-generated from public reports

Latest development · Report

ARC Prize Tests Gemini 4 Hydrogen: Scores 92.5% on ARC-AGI-2

Developments

1 confirmed developments

  1. Gemini 4 Hydrogen Achieves Validated ARC-AGI Scores

    Source:ARC Prize

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Nov 21

  1. ARC PrizeFirst-partySelected

    ARC Prize Tests Gemini 4 Hydrogen: Scores 92.5% on ARC-AGI-2

    ARC Prize found that Gemini 4 Hydrogen scored 92.5% on ARC-AGI-2 and 98.5% on ARC-AGI-1, at a cost per task of $1.26 and $0.18, respectively. At the high reasoning level, it matched or exceeded Gemini 3.8 Flash while using about 52% fewer reasoning tokens; ARC-AGI-3 testing could not be completed because of API issues including multi-action function calls and MALFORMED_FUNCTION_CALL errors.

Related stories

  1. Related storiesGemini 4 Hydrogen Matches or Surpasses Its Predecessor’s Scores on Two ARC-AGI Benchmarks
  2. Related storiesGemini 4 Hydrogen Matches or Outperforms Gemini 3.8 Flash on Two ARC-AGI Benchmarks
  3. Related storiesGemini 4 Neon Begins Rolling Out on the Gemini and Antigravity Platforms
  4. Related storiesGoogle launches Gemini 4 Hydrogen on Antigravity