Artificial Analysis: Kimi K3.1 Pro leads on agentic knowledge and coding benchmarks, AA-3D ranking may be low
Artificial Analysis says Kimi K3.1 Pro is among the leading models on agentic knowledge work and coding, performing well on GDPval-AA and Terminal-Bench 4.0, but its AA-3D Elo preference voting is still being collected, and early signs indicate its ranking will be low. Its predecessor Kimi K3 ranked 12th among 22 models on AA-3D. The organization also showed a 492-meter mountain bike downhill 3D scene generated by K3.1 Pro, in which steering, pedaling and braking can be taken over at any time during the demo.
Why read this
AI score 60
Artificial Analysis gives Kimi K3.1 Pro's position on agentic knowledge and coding benchmarks, and notes that it may be low on the 3D scene benchmark.
Topics
Body
Kimi K3.1 Pro is among the leading models in agentic knowledge work and coding, but early signs suggest it will rank lower on AA-3D
We are still collecting the preference votes for its Elo on AA-3D, our benchmark for how well AI models build interactive 3D scenes. In agentic knowledge work and coding, it is among the leading models on GDPval-AA and Terminal-Bench 4.0. Its predecessor, Kimi K3, is 12th of 22 models on AA-3D.
Here is one of its AA-3D scenes: a 492 m mountain-bike descent with berms, roots, a rock garden, a drop, and a jump. A demo run rides it from top to bottom, and you can take over the steering, pedaling, and braking at any point.
Congratulations to @Kimi_Moonshot on the release!