Understand this story
Arena.ai puts forward a judgment: whether users enjoy collaborating with agents is the biggest gap between AI labs. This judgment is based on Arena's tracking of four Agent Arena signals for the best agents from six labs—Anthropic, OpenAI, Google DeepMind, Kimi, xAI, and DeepSeek—from late June to early October. Among them, on the Praise vs Complaint metric, OpenAI and Anthropic were +35 points above the leaderboard average, while Moonshot, xAI, and DeepSeek ranged between +5 and +13; on Confirmed Success, the average lab's best model rose from -4 to +14 points within three months, with Anthropic leading at +20 with Claude Opus 5.5 (Max); the Bash Recovery gap narrowed from 34 to 16 points, and Steerability from 19 to 11 points. There are currently no further developments.
AI-generated from public reports
Latest development · Report
Arena tracks four signals for agents from six major AI labsDevelopments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 17
Arena
Arena tracks four signals for agents from six major AI labs
Arena tracked four Agent Arena signals for the best agents from Anthropic, OpenAI, Google DeepMind, Kimi, xAI, and DeepSeek from late June to early October, finding that the largest gap between labs lies in whether users enjoy the experience of using them. On Praise vs Complaint, OpenAI and Anthropic scored +35 points above the leaderboard average, while Moonshot, xAI, and DeepSeek ranged from +5 to +13; on Confirmed Success, the average lab's best model rose from -4 to +14 points within three months, with Anthropic leading at +20 with Claude Opus 5.5 (Max). The Bash Recovery gap narrowed from 34 to 16 points, and Steerability from 19 to 11 points.