ARC Prize Frequently Encounters API Formatting Errors While Testing Gemini 4 Hydrogen
AI summary
During ARC-AGI-3 testing, ARC Prize frequently received MALFORMED_FUNCTION_CALL responses, and API issues prevented the testing from being completed. Gemini 4 Hydrogen also returned multiple actions and duplicate actions in function calls and triggered the RECITATION finish reason.
Why read this
AI score 52
The testing presented both Gemini 4 Hydrogen's benchmark results and its API issues, providing a basis for comparing reasoning efficiency and practical testability.
Topics
Body
@GoogleDeepMind Similarly, the API would often return MALFORMED_FUNCTION_CALL responses: https://t.co/hn7Ha2k6ZU
AI Trends