Agent Arena 数据：头部实验室智能体的任务成功率趋同，用户体验差距拉开
The biggest gap between AI labs isn't whether their agents get the job done. It's whether users actu...
LMArena 拿六家实验室的智能体数据做了三个月对比，发现大家完成任务的水平差不多后，用户满意度成了新分水岭，OpenAI 和 Anthropic 领先 35 分。
Agent Arena 追踪了 OpenAI、Anthropic、Google DeepMind、Moonshot、xAI 和 DeepSeek 六家实验室的最佳智能体，时间跨度为 6 月底至 10 月初。在 Praise vs Complaint 信号上，OpenAI 和 Anthropic 比榜单平均高 35 个百分点，Moonshot、xAI 和 DeepSeek 在 +5 到 +13 之间。Confirmed Success 显示各家交付能力普遍提升，平均分从 -4 升到 +14，Anthropic 的 Claude Opus 5.5 (Max) 以 +20 领先。Bash Recovery 的六家分差从 34 点缩小到 16 点，Steerability 从 19 缩到 11。结论是各家在避免失败上趋于接近，让用户满意的差距反而在扩大。
The biggest gap between AI labs isn't whether their agents get the job done. It's whether users actu...
The biggest gap between AI labs isn't whether their agents get the job done. It's whether users actually enjoy working with them. We tracked the best agent from @AnthropicAI , @OpenAI , @GoogleDeepMind , @Kimi_Moonshot , @SpaceXSI and @deepseek_ai across 4 key Agent Arena signals used between late June and the start of October to see how the industry is shifting. Three things stood out: 1. Users like some agents far more than others. On Praise vs Complaint, OpenAI and Anthropic sit at +35 points over the leaderboard average. Moonshot, xAI and DeepSeek land between +5 and +13. No other signal splits the labs this widely. 2. Agents are getting much better at delivery. On Confirmed Success, the average lab's best model went from -4 to +14 points in three months. Anthropic leads with Claude Opus 5.5 (Max) at +20. 3. Labs are converging on error recovery and steering. Since June, the spread between the six labs has more than halved on Bash Recovery (34 → 16 points) and nearly halved on Steerability (19 → 11). In short, the labs are catching up on avoiding failures. Leaving the user happy is where the top three are pulling away. Your browser does not support the video tag. 🔗 View on Twitter 💬 11 🔄 5 ❤️ 60 👀 4941 📊 17 ⚡
