AI Trends

ARC Prize Tests Gemini 4 Hydrogen: Scores 92.5% on ARC-AGI-2

ARC PrizeUpdated Nov 21 01:28

AI summary

ARC Prize found that Gemini 4 Hydrogen scored 92.5% on ARC-AGI-2 and 98.5% on ARC-AGI-1, at a cost per task of $1.26 and $0.18, respectively. At the high reasoning level, it matched or exceeded Gemini 3.8 Flash while using about 52% fewer reasoning tokens; ARC-AGI-3 testing could not be completed because of API issues including multi-action function calls and MALFORMED_FUNCTION_CALL errors.

Why read this

SelectedAI score 61

The tests also present results at different reasoning levels, token usage, and API errors, enabling comparisons of model performance and practical integration limitations.

Topics

Tags

Body

@GoogleDeepMind - Leaderboard: https://t.co/x8U1ItNLRj - Reproduce the public results: https://t.co/vMqtds8Zet - Testing policy: https://t.co/pBoUqvXe4P - Full Gemini 4 Hydrogen results: https://t.co/oXHBEflTOR

Source

ARC Prize