ARC Prize announces Inkling 2 Small's results on three ARC-AGI benchmarks
ARC Prize has published the verified results of Thinking Machines' Inkling 2 Small on ARC-AGI: it scored 81.7% on ARC-AGI-2 at $0.27 per task, and 96.5% on ARC-AGI-1 at $0.08 per task, surpassing every open-weight model it has evaluated on both benchmarks. On ARC-AGI-3, the model scored 2.6% (provider adapter, $704 total) and 0.3% (standard, $858 total). Compared with DeepSeek V4.1 Flash 1017, it leads on ARC-AGI-1 (96.5% vs. 94.5%) and ARC-AGI-2 (81.7% vs. 78.1%), but trails on ARC-AGI-3 (2.6% vs. 5.8%). Thinking Machines plans to release the full weights next week.
Why read this
SelectedAI score 67
ARC Prize has published the scores and per-task costs of Inkling 2 Small on three ARC-AGI benchmarks, allowing item-by-item comparison with DeepSeek V4.1 Flash 1017.
Topics
View original postInkling 2 Small from @thinkymachines on ARC-AGI (Verified): - ARC-AGI-2: 81.7%, $0.27/task - ARC-AGI-1: 96.5%, $0.08/task It outperforms every open-weight model we've evaluated on both ARC-AGI-1 & ARC-AGI-2. Thinking Machines plans to release its full weights next week. https://t.co/jrwbBEqeTf
View original
Inkling 2 Small from @thinkymachines on ARC-AGI (Verified): - ARC-AGI-2: 81.7%, $0.27/task - ARC-AGI-1: 96.5%, $0.08/task It outperforms every open-weight model we've evaluated on both ARC-AGI-1 & ARC-AGI-2. Thinking Machines plans to release its full weights next week. https://t.co/jrwbBEqeTf
Body
@thinkymachines Read our recent post about Inkling 2 Small's performance on ARC-AGI-1 and ARC-AGI-2:
https://t.co/zUmzTzDLHP