Kimi K3.1 Pro Released, Ranks Fourth with an Artificial Analysis Intelligence Index Score of 55
Moonshot AI released the reasoning model Kimi K3.1 Pro, which scored 55 on the Artificial Analysis Intelligence Index, ranking fourth, an 11-point improvement over Kimi K3's 44 points, behind only Claude Opus 5.5 (58), Claude Sonnet 5.5 (56), and Muse Wonder Full (56). Its agentic capabilities improved markedly: it ranks third on GDPval-AA with 1846 Elo, scores 67% on Terminal-Bench 4.0 (Kimi K3 scored 13%), and rose from 58% to 73% on AutomationBench-AA. The model has a 1M-token context window, 2.8T total parameters with 104B activated parameters, supports text and image inputs, is priced at $2/10/0.20 per 1M input/output/cache-hit tokens, and its weights have not yet been released.
Why read this
SelectedAI score 78
A third-party evaluation organization provides an item-by-item comparison of Kimi K3.1 Pro with frontier models such as Claude and Muse, which can be used to gauge how far open-weight models have caught up.
Topics
Body
Kimi K3.1 Pro launches at 4th on the Artificial Analysis Intelligence Index scoring 55, making large gains in agentic performance; it will be the leading open-weights model once its weights are published
@Kimi_Moonshot's new reasoning model gains 11 points over Kimi K3 (max, 44). It trails only Claude Opus 5.5 (max with fallback, 58), Claude Sonnet 5.5 (max with fallback, 56), and Muse Wonder Full (max, 56) on the Intelligence Index.
Once the weights for K3.1 Pro are released it will be the highest-scoring open weights model and the gap between the leading open weights and proprietary models on the Intelligence Index will narrow from 12 points to 3.
Key results: ➤ Large gains in agentic performance: Kimi K3.1 Pro scores 3rd on GDPval-AA with 1,846 Elo, up 312 Elo from Kimi K3, behind only Claude Opus 5.5 (1,866 Elo) and Muse Wonder Full (1,857 Elo). Kimi K3.1 Pro also achieves the highest score of any model on Terminal-Bench 4.0. K3.1 Pro scores 67%, up from 13% for Kimi K3 and ahead of Claude Sonnet 5.5 (64%). AutomationBench-AA, which tests agentic SaaS workflows, rises from 58% to 73%.
➤ Gains in other evals are more moderate: Humanity's Last Exam rises from 47% to 52%, CritPt from 23% to 25%, and SciCode from 59% to 61%. AA-Omniscience Index rises from 20 to 30, as the hallucination rate falls from 53% to 44% and accuracy rises from 48% to 51%.
➤ Cost per Task roughly equal to Kimi K3 at $1.98 per Task: K3.1 Pro uses 55K output tokens per Intelligence Index task, 14% more than Kimi K3 at 48K, while its first-party token prices are 33% lower.
Additional model details: ➤ Context window: 1M tokens. ➤ Size: 2.8T total, 104B active parameters ➤ Input modalities: Text and image ➤ Weights and license: Weights currently not published, Moonshot is expected to release the weights soon after launch ➤ Pricing: $2/$10/$0.20 per 1M input/output/cache hit tokens, 33% lower than Kimi K3 on all three rates.
Congratulations to the team at @Kimi_Moonshot on the release!