ARC Prize Tests Gemini 4 Hydrogen: Scores 92.5% on ARC-AGI-2
ARC Prize found that Gemini 4 Hydrogen scored 92.5% on ARC-AGI-2 and 98.5% on ARC-AGI-1, at a cost per task of $1.26 and $0.18, respectively. At the high reasoning level, it matched or exceeded Gemini 3.8 Flash while using about 52% fewer reasoning tokens; ARC-AGI-3 testing could not be completed because of API issues including multi-action function calls and MALFORMED_FUNCTION_CALL errors.
Why read this
SelectedAI score 61
The tests also present results at different reasoning levels, token usage, and API errors, enabling comparisons of model performance and practical integration limitations.
Topics
Body
@GoogleDeepMind - Leaderboard: https://t.co/x8U1ItNLRj - Reproduce the public results: https://t.co/vMqtds8Zet - Testing policy: https://t.co/pBoUqvXe4P - Full Gemini 4 Hydrogen results: https://t.co/oXHBEflTOR
AI Trends