←News detail

François CholletUpdated Oct 24 12:51

Chollet: Gemini 4 Argon performs comparably to Astra on ARC-AGI-3, Google returns to the frontier

AI summary

François Chollet stated that Gemini 4 Argon's performance on ARC-AGI-3 is close to Astra's, and Google has returned to the frontier. Data cited by ARC Prize shows that Google DeepMind's Gemini 4 Argon achieved 97.5% (provider adapter harness, $4.8K) and 49.8% (standard harness, $5.8K) on ARC-AGI-3, 91.3% at $0.32/task on ARC-AGI-2, and 98.5% at $0.16/task on ARC-AGI-1, making it the second frontier AI lab to exceed 95% on ARC-AGI-3.

Why read this

SelectedAI score 73

A second lab to break 95% on ARC-AGI-3 has emerged, and readers can use this to observe where frontier models stand in competition on this benchmark.

Topics

Tags

Quoted post

ARC Prize

@arcprize

Gemini 4 Argon from @Google on ARC-AGI (Verified): - ARC-AGI-3: 97.5%, $4.8K (provider adapter harness), 49.8%, $5.8K (standard harness) - ARC-AGI-2: 91.3%, $0.32/task - ARC-AGI-1: 98.5%, $0.16/task Google DeepMind is the second frontier AI lab to score above 95% on ARC-AGI-3. https://t.co/8siwgfBJcr

View original

Gemini 4 Argon from @Google on ARC-AGI (Verified): - ARC-AGI-3: 97.5%, $4.8K (provider adapter harness), 49.8%, $5.8K (standard harness) - ARC-AGI-2: 91.3%, $0.32/task - ARC-AGI-1: 98.5%, $0.16/task Google DeepMind is the second frontier AI lab to score above 95% on ARC-AGI-3. https://t.co/8siwgfBJcr

View original post

Body

The English body is being prepared. You can open the original source.

Source

François Chollet