AI Trends

Inkling 2 Mini's ARC-AGI Evaluation Results

ARC PrizeUpdated Nov 21 05:35

AI summary

Inkling 2 Mini scored 49.3% on ARC-AGI-2 at a cost of $0.14/task and 84.5% on ARC-AGI-1 at a cost of $0.06/task. Its per-task cost on ARC-AGI-2 was 47% lower than Inkling 2 Small's, but its score was 32 percentage points lower; ARC Prize also provided links to the leaderboard, public result reproduction methods, testing policy, and full results.

Body

@thinkymachines - Leaderboard: https://t.co/x8U1ItOjGR - Reproduce the public results: https://t.co/vMqtds9x41 - Testing policy: https://t.co/pBoUqvXLUn - Full results: https://t.co/Abu7jIJewS

Source

ARC Prize