←News detail

ARC PrizeUpdated Nov 7 03:41

ARC Prize announces Thinking Machines' Inkling 2 Small on…

AI summary

ARC Prize announced Thinking Machines' Inkling 2 Small results on ARC-AGI: ARC-AGI-2 is 81.7%, with a per-task cost of $0.27; ARC-AGI-1 is 96.5%, with a per-task cost of $0.08. ARC Prize states that the model outperforms all open-weight models it has evaluated on both benchmarks; compared with the first-generation Inkling Small released on July 30, the ARC-AGI-2 semi-private set score rose from 40.14% to 81.67%. Thinking Machines plans to release the full weights next week, and the ARC-AGI-3 evaluation results will be announced after testing is complete.

Why read this

SelectedAI score 79

ARC Prize announced the results and per-task cost of Inkling 2 Small on ARC-AGI-1 and ARC-AGI-2, which can be directly compared with the previous generation of the same series.

Topics

Tags

Body

@thinkymachines - Leaderboard: https://t.co/x8U1ItNLRj - Reproduce the public results: https://t.co/vMqtds8Zet - Testing policy: https://t.co/pBoUqvXe4P - Full Inkling 2 Small results: https://t.co/az2H7r9gNn

Source

ARC Prize