Understand this story
ARC Prize has announced the evaluation results of thinkymachines' Inkling 2 Small on ARC-AGI (Verified). On ARC-AGI-3, using the provider adapter, the score was 2.6% with a total cost of $704; under the standard configuration, it was 0.3% with a total cost of $858. The model achieved 96.5% on ARC-AGI-1, higher than DeepSeek V4.1 Flash 1017's 94.5%; it achieved 81.7% on ARC-AGI-2, higher than the latter's 78.1%; but on ARC-AGI-3 it lagged behind the latter's 5.8% with 2.6%. There are currently no further developments.
AI-generated from public reports
Latest update · Discussion
Teortaxes joined this discussionDevelopments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Nov 17
TeortaxesRelated discussion
Teortaxes joined this discussion
This post contributes to heat; it is not a formal report or confirmed fact.
ARC PrizeFirst-party
ARC Prize announces Inkling 2 Small's ARC-AGI-3 results
ARC Prize announces the results of thinkymachines' Inkling 2 Small on ARC-AGI-3: 2.6% with the provider adapter, at a total cost of $704; 0.3% under the standard configuration, at a total cost of $858. The model surpasses DeepSeek V4.1 Flash 1017 on ARC-AGI-1 (96.5% vs 94.5%) and ARC-AGI-2 (81.7% vs 78.1%), but trails on ARC-AGI-3 (2.6% vs 5.8%).
ARC PrizeFirst-party
Inkling 2 Small's results on the three ARC-AGI benchmarks
ARC Prize announced the results of thinkymachines' Inkling 2 Small on ARC-AGI (Verified): ARC-AGI-3 scored 2.6% with a total cost of $704 (provider adapter), and 0.3% with a total cost of $858 in standard mode. The model surpasses DeepSeek V4.1 Flash 1017 on ARC-AGI-1 (96.5% vs 94.5%) and ARC-AGI-2 (81.7% vs 78.1%), but trails on ARC-AGI-3 (2.6% vs 5.8%).