AI Trends

Trending story

Gemini 4 Hydrogen Matches or Surpasses Its Predecessor’s Scores on Two ARC-AGI Benchmarks

1 reports1 story updatesUpdated Nov 21 00:57

Understand this story

AI overview

On November 21, 2026, Gemini 4 Hydrogen matched or surpassed Gemini 3.8 Flash on the ARC-AGI-2 and ARC-AGI-1 benchmarks. ARC Prize disclosed the same day that, during ARC-AGI-3 testing, Gemini 4 Hydrogen frequently returned MALFORMED_FUNCTION_CALL; its function calls also contained multiple or repeated actions and triggered the RECITATION finish reason. The test could not be completed because of the related API formatting issues. There have been no other subsequent developments supported by sufficient factual evidence.

AI-generated from public reports

Latest development · Report

ARC Prize Frequently Encounters API Formatting Errors While Testing Gemini 4 Hydrogen

Developments

1 confirmed developments

  1. Gemini 4 Hydrogen matches or exceeds its predecessor's scores on two ARC-AGI benchmarks

    Source:ARC Prize

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Nov 21

  1. ARC PrizeFirst-party

    ARC Prize Frequently Encounters API Formatting Errors While Testing Gemini 4 Hydrogen

    During ARC-AGI-3 testing, ARC Prize frequently received MALFORMED_FUNCTION_CALL responses, and API issues prevented the testing from being completed. Gemini 4 Hydrogen also returned multiple actions and duplicate actions in function calls and triggered the RECITATION finish reason.

Related stories

  1. Related storiesGemini 4 Neon Begins Rolling Out on the Gemini and Antigravity Platforms
  2. Related storiesAnthropic releases Claude Opus 5.5
  3. Related storiesLogan Kilpatrick announced the launch of Gemini Decision 1 on the Gemini API
  4. Related storiesARC Prize Encounters API Issues While Testing Gemini 4 Hydrogen