←新闻详情

Arena更新于 10月25日 23:33

Arena 追踪六大 AI 实验室智能体四项信号

The biggest gap between AI labs isn't whether their agents get the job done. It's whether users actually enjoy working with them.

AI 导读

Arena 追踪 Anthropic、OpenAI、Google DeepMind、Kimi、xAI 和 DeepSeek 的最佳智能体在 6 月底至 10 月初的四项 Agent Arena 信号,发现实验室间最大差距在于用户是否享受使用体验。Praise vs Complaint 上 OpenAI 和 Anthropic 高出榜单均值 +35 分,Moonshot、xAI 和 DeepSeek 在 +5 至 +13 之间;Confirmed Success 上平均实验室最佳模型三个月内从 -4 升至 +14 分,Anthropic 以 Claude Opus 5.5 (Max) 的 +20 领先。Bash Recovery 分差从 34 缩至 16 分,Steerability 从 19 缩至 11 分。

正文

The biggest gap between AI labs isn't whether their agents get the job done. It's whether users actually enjoy working with them.

We tracked the best agent from @AnthropicAI, @OpenAI, @GoogleDeepMind, @Kimi_Moonshot, @spacexai and @deepseek_ai across 4 key Agent Arena signals used between late June and the start of October to see how the industry is shifting.

Three things stood out: 1. Users like some agents far more than others.

On Praise vs Complaint, OpenAI and Anthropic sit at +35 points over the leaderboard average. Moonshot, xAI and DeepSeek land between +5 and +13. No other signal splits the labs this widely.

2. Agents are getting much better at delivery.

On Confirmed Success, the average lab's best model went from -4 to +14 points in three months. Anthropic leads with Claude Opus 5.5 (Max) at +20.

3. Labs are converging on error recovery and steering.

Since June, the spread between the six labs has more than halved on Bash Recovery (34 → 16 points) and nearly halved on Steerability (19 → 11).

In short, the labs are catching up on avoiding failures.

Leaving the user happy is where the top three are pulling away.

来源

Arena