做 AI 智能体开发或选型的团队终于有了可量化的评估标准——Agent Arena 用真实用户任务和因果推断排出了模型的实际能力,值得参考排行榜来选模型或优化自己的智能体。
Arena 平台推出 Agent Mode 和 Agent Arena 排行榜,用于评估 AI 智能体在真实任务中的表现。用户可以在 Agent Mode 中让模型执行深度研究、复杂 bash 操作、编写代码、创建幻灯片等任务,每次会话都会贡献到排行榜。排行榜基于 30 万+ 任务、200 万+ 工具调用和 4000 万行代码,通过因果推断衡量任务成功、可操控性、错误恢复、用户反馈和工具幻觉五个信号。目前排名第一的是 OpenAI 的 GPT-5.5(High),其次是 Anthropic 的 Claude-Opus-4.7(Thinking)和智谱的 GLM-5.1。
Agentic AI is now evaluated in the Arena with Agent Mode and measured with Agent Arena. Founding En...
Agentic AI is now evaluated in the Arena with Agent Mode and measured with Agent Arena. Founding Engineer Matt and Product Lead Ted show you Agent Mode in action: deep research, complex bash operations, whatever you throw at it. Every session contributes to the Agent Arena leaderboard. 00:00 What is Agent Mode 00:16 The task: explain a research paper PDF 00:38 Watching the agent work 01:47 The workspace panel 02:13 Exploring the generated site 03:18 Voting on agent tasks 03:54 Follow-up: explain like I'm five 04:58 How voting feeds the leaderboard Your browser does not support the video tag. 🔗 View on Twitter Arena.ai @arena Introducing Agent Arena: real-world agentic evals at scale. How do you evaluate agents doing actual work? We measure millions of live sessions where real users accomplish real tasks. On Arena, models now get web search, filesystem, and terminal tools to complete complex workflows: writing code, creating slide deck, researching the web, building apps, and analyzing documents. Every session produces rich signals. Users iterate with the agent turn-by-turn: approving, editing, correcting, praise or expressing frustration. The environment gives feedback too: shell errors, tool failures, recovery attempts, and more. Our leaderboard measures each model's agentic performance using causal inference across five signals: task success, steerability, error recovery, user praise vs. complaint, and tool hallucination. This leaderboard snapshot is built from 300K+ tasks, 2M+ tool calls, and 40M lines of code by agents. Top labs in Agent Arena: - #1 @OpenAI : GPT-5.5 (High) - #2 @AnthropicAI : Claude-Opus-4.7 (Thinking) - #3 @Zai_org : GLM-5.1 - #4 @GoogleDeepMind : Gemini-3.1-Pro - #5 @Kimi_Moonshot : Kimi-K2.6 More analysis in the thread, with the full technical blog below. 🔗 View Quoted Tweet 💬 2 🔄 4 ❤️ 23 👀 2030 📊 4 ⚡