Inkling 2 Mini's ARC-AGI Evaluation Results
AI summary
Inkling 2 Mini scored 49.3% on ARC-AGI-2 at a cost of $0.14/task and 84.5% on ARC-AGI-1 at a cost of $0.06/task. Its per-task cost on ARC-AGI-2 was 47% lower than Inkling 2 Small's, but its score was 32 percentage points lower; ARC Prize also provided links to the leaderboard, public result reproduction methods, testing policy, and full results.
Body
@thinkymachines - Leaderboard: https://t.co/x8U1ItOjGR - Reproduce the public results: https://t.co/vMqtds9x41 - Testing policy: https://t.co/pBoUqvXLUn - Full results: https://t.co/Abu7jIJewS
AI Trends