AI Trends

ARC Prize Frequently Encounters API Formatting Errors While Testing Gemini 4 Hydrogen

ARC PrizeUpdated Nov 21 01:28

AI summary

During ARC-AGI-3 testing, ARC Prize frequently received MALFORMED_FUNCTION_CALL responses, and API issues prevented the testing from being completed. Gemini 4 Hydrogen also returned multiple actions and duplicate actions in function calls and triggered the RECITATION finish reason.

Why read this

AI score 52

The testing presented both Gemini 4 Hydrogen's benchmark results and its API issues, providing a basis for comparing reasoning efficiency and practical testability.

Topics

Tags

Body

@GoogleDeepMind Similarly, the API would often return MALFORMED_FUNCTION_CALL responses: https://t.co/hn7Ha2k6ZU

Source

ARC Prize