AI 热点

Arena 推出 Agent Arena Index 及六项智能体专项指数

Arena更新于 11月19日 03:15

Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work,

AI 导读

Arena 推出衡量智能体综合表现的 Agent Arena Index,并新增 Agentic Work、Coding、Chat、Task Outcomes、Tool Use 和 Steering 六项专项指数。该指数基于全球社区的数百万项真实任务,综合任务完成、用户褒贬、Bash 可靠性和可引导性四类信号;Claude Fable 5.2 (Max) 以 1463 分居首。配套的 Alignment Index 则依据欺骗性完成、未授权操作和错误归因评估智能体是否遵循用户意图。

推荐理由

AI 评分 62

该指数基于数百万项真实任务并整合四类表现信号,为比较智能体能力与对齐水平提供了更稳定的观察框架。

主题

标签

引用

Arena.ai

@arena

https://t.co/YieG0GYBat

查看原文

https://t.co/YieG0GYBat

查看原帖

正文

Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work, Coding, Chat, Task Outcomes, Tool Use, and Steering.

Together with the Alignment Index, these indexes provide a comprehensive view of how agents perform across real-world tasks, from completing complex workflows to using tools and adapting to user feedback.

Arena measures agentic performance from millions of real-world tasks by our global community. With the launch of the new indexes, we are updating our scores to provide a more stable and interpretable way to understand how agents perform in the real world.

Claude Fable 5.2 (Max) leads the Agent Arena Index by 134 points with a score of 1463. Top 5 labs on the Agent Arena Index:

- #1 @AnthropicAI: With Claude Fable 5.2 (Max) at 1463 pts - #2 @GoogleDeepMind: With Gemini 4 Carbon (High) at 1307 pts - #3 @OpenAI: With GPT-6 Astra (Max) at 1274 pts - #4 @AIatMeta: With Muse Wonder Full (Max) at 1200 pts - #5 @Alibaba_Qwen: With Qwen4-Max (xHigh) at 1191 pts

The Agent Arena Index combines four key signals of real-world agent performance: - Task Completion: explicit confirmation of task success from users - Praise vs. Complaint: user satisfaction with agent's outcome - Bash Reliability: how well an agent uses terminal tools - Steerability: how well an agent responds to user corrections

Alongside capability, the Alignment Index measures how faithfully agents act in accordance with user intent, based on three key signals: Deceptive Completion, Unauthorized Action, and False Attribution.

As agents take on increasingly complex, long-horizon work, measuring their real-world capabilities and alignment is more important than ever.

Explore the rankings and see what each index measures in the thread below.

来源

Arena