AI News

Inkling 2 Small's results on the three ARC-AGI benchmarks

ARC PrizeUpdated Nov 17 05:49

AI summary

ARC Prize announced the results of thinkymachines' Inkling 2 Small on ARC-AGI (Verified): ARC-AGI-3 scored 2.6% with a total cost of $704 (provider adapter), and 0.3% with a total cost of $858 in standard mode. The model surpasses DeepSeek V4.1 Flash 1017 on ARC-AGI-1 (96.5% vs 94.5%) and ARC-AGI-2 (81.7% vs 78.1%), but trails on ARC-AGI-3 (2.6% vs 5.8%).

Body

Inkling 2 Small from @thinkymachines on ARC-AGI (Verified):

- ARC-AGI-3: 2.6%, $704 total (provider adapter); 0.3%, $858 total (standard)

It beat DeepSeek V4.1 Flash 1017 on ARC-AGI-1 (96.5% vs 94.5%) and ARC-AGI-2 (81.7% vs 78.1%), but trailed on ARC-AGI-3 (2.6% vs 5.8%). https://t.co/UJNieTlm9a

Source

ARC Prize