Arena 推出 Agent Arena Index 及六项智能体专项指数
Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work,
Arena 推出衡量智能体综合表现的 Agent Arena Index,并新增 Agentic Work、Coding、Chat、Task Outcomes、Tool Use 和 Steering 六项专项指数。该指数基于全球社区的数百万项真实任务,综合任务完成、用户褒贬、Bash 可靠性和可引导性四类信号;Claude Fable 5.2 (Max) 以 1463 分居首。配套的 Alignment Index 则依据欺骗性完成、未授权操作和错误归因评估智能体是否遵循用户意图。
查看原帖https://t.co/YieG0GYBat
查看原文
https://t.co/YieG0GYBat
正文
Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work, Coding, Chat, Task Outcomes, Tool Use, and Steering.
Together with the Alignment Index, these indexes provide a comprehensive view of how agents perform across real-world tasks, from completing complex workflows to using tools and adapting to user feedback.
Arena measures agentic performance from millions of real-world tasks by our global community. With the launch of the new indexes, we are updating our scores to provide a more stable and interpretable way to understand how agents perform in the real world.
Claude Fable 5.2 (Max) leads the Agent Arena Index by 134 points with a score of 1463. Top 5 labs on the Agent Arena Index:
- #1 @AnthropicAI: With Claude Fable 5.2 (Max) at 1463 pts - #2 @GoogleDeepMind: With Gemini 4 Carbon (High) at 1307 pts - #3 @OpenAI: With GPT-6 Astra (Max) at 1274 pts - #4 @AIatMeta: With Muse Wonder Full (Max) at 1200 pts - #5 @Alibaba_Qwen: With Qwen4-Max (xHigh) at 1191 pts
The Agent Arena Index combines four key signals of real-world agent performance: - Task Completion: explicit confirmation of task success from users - Praise vs. Complaint: user satisfaction with agent's outcome - Bash Reliability: how well an agent uses terminal tools - Steerability: how well an agent responds to user corrections
Alongside capability, the Alignment Index measures how faithfully agents act in accordance with user intent, based on three key signals: Deceptive Completion, Unauthorized Action, and False Attribution.
As agents take on increasingly complex, long-horizon work, measuring their real-world capabilities and alignment is more important than ever.
Explore the rankings and see what each index measures in the thread below.
AI 热点