ARC Prize: The three generations of ARC-AGI benchmarks show a natural progression
AI summary
ARC Prize stated that the relationship among ARC-AGI-1, ARC-AGI-2, and ARC-AGI-3 shows a natural progression, and that future benchmarks will continue to help measure progress and distinguish increasingly capable models. The thread also mentioned that there is a similar relationship between the scores of ARC-AGI-2 and ARC-AGI-3, with Gemini 4 Argon under low-reasoning settings being a clear exception: ARC-AGI-2 only 42.1%, while ARC-AGI-3 reached 97.5%.
Body
The relationships across ARC-AGI-1, ARC-AGI-2, and ARC-AGI-3 point to a natural progression. Future benchmarks will help us continue measuring progress and distinguishing between increasingly capable models.
View all model scores: https://t.co/x8U1ItNLRj