ARC Prize announces the evaluation results of Thinking Machines' Inkling 2 Small on…

ARC Prize announces the evaluation results of Thinking Machines' Inkling 2 Small on ARC-AGI: a score of 81.7% on ARC-AGI-2 at a cost of $0.27 per task; a score of 96.5% on ARC-AGI-1 at a cost of $0.08 per task. ARC Prize states that the model surpasses all open-weight models it has evaluated on both ARC-AGI-1 and ARC-AGI-2, and Thinking Machines plans to release the full weights next week. Compared with the first-generation Inkling Small released on July 30, Inkling 2 Small's score on the ARC-AGI-2 semi-private set improved from 40.14% to 81.67%. Evaluation on ARC-AGI-3 is still underway, and results will be announced after testing is complete.