Understand this story
On November 21, 2026, Gemini 4 Hydrogen matched or surpassed Gemini 3.8 Flash on the ARC-AGI-2 and ARC-AGI-1 benchmarks. ARC Prize disclosed the same day that, during ARC-AGI-3 testing, Gemini 4 Hydrogen frequently returned MALFORMED_FUNCTION_CALL; its function calls also contained multiple or repeated actions and triggered the RECITATION finish reason. The test could not be completed because of the related API formatting issues. There have been no other subsequent developments supported by sufficient factual evidence.
AI-generated from public reports
Latest development · Report
ARC Prize Frequently Encounters API Formatting Errors While Testing Gemini 4 HydrogenDevelopments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Nov 21
ARC PrizeFirst-party
ARC Prize Frequently Encounters API Formatting Errors While Testing Gemini 4 Hydrogen
During ARC-AGI-3 testing, ARC Prize frequently received MALFORMED_FUNCTION_CALL responses, and API issues prevented the testing from being completed. Gemini 4 Hydrogen also returned multiple actions and duplicate actions in function calls and triggered the RECITATION finish reason.
AI Trends