AI News

ARC Prize announces Inkling 2 Small's results on three ARC-AGI benchmarks

ARC PrizeUpdated Nov 17 05:49

AI summary

ARC Prize has published the verified results of Thinking Machines' Inkling 2 Small on ARC-AGI: it scored 81.7% on ARC-AGI-2 at $0.27 per task, and 96.5% on ARC-AGI-1 at $0.08 per task, surpassing every open-weight model it has evaluated on both benchmarks. On ARC-AGI-3, the model scored 2.6% (provider adapter, $704 total) and 0.3% (standard, $858 total). Compared with DeepSeek V4.1 Flash 1017, it leads on ARC-AGI-1 (96.5% vs. 94.5%) and ARC-AGI-2 (81.7% vs. 78.1%), but trails on ARC-AGI-3 (2.6% vs. 5.8%). Thinking Machines plans to release the full weights next week.

Why read this

SelectedAI score 67

ARC Prize has published the scores and per-task costs of Inkling 2 Small on three ARC-AGI benchmarks, allowing item-by-item comparison with DeepSeek V4.1 Flash 1017.

Topics

Tags

Quoted post

ARC Prize

@arcprize

Inkling 2 Small from @thinkymachines on ARC-AGI (Verified): - ARC-AGI-2: 81.7%, $0.27/task - ARC-AGI-1: 96.5%, $0.08/task It outperforms every open-weight model we've evaluated on both ARC-AGI-1 & ARC-AGI-2. Thinking Machines plans to release its full weights next week. https://t.co/jrwbBEqeTf

View original

Inkling 2 Small from @thinkymachines on ARC-AGI (Verified): - ARC-AGI-2: 81.7%, $0.27/task - ARC-AGI-1: 96.5%, $0.08/task It outperforms every open-weight model we've evaluated on both ARC-AGI-1 & ARC-AGI-2. Thinking Machines plans to release its full weights next week. https://t.co/jrwbBEqeTf

View original post

Body

@thinkymachines Read our recent post about Inkling 2 Small's performance on ARC-AGI-1 and ARC-AGI-2:

https://t.co/zUmzTzDLHP

Source

ARC Prize