Artificial Analysis 发布 Intelligence Index v5，新增两个基准并引入私有测试集
模型评测榜 v5 版来了，60% 改用私有题防刷榜，Claude Opus 5.5 拿了第一，开源和闭源差距拉大到 12 分，选模型前可以看看。
Artificial Analysis 发布 Intelligence Index v5，这是自 1 月 v4 之后最大一次升级，包含 2 个新基准和 3 项更新，60% 的指数权重基于私有测试集或保留答案的评测。新增基准包括 Cognition 的 FrontierCode 2.0 和 70 个终端环境下智能体科研任务的 Terminal-Bench-Science。榜单上 Claude Opus 5.5 (max) 以 58 分居首，GPT-6 Astra (max) 以 57 分紧随其后。开源权重方面，Kimi K3.1 Pro 以 46 分最高，已发布权重中 DeepSeek V4.1 Flash 1017 (max) 与 GLM-5.3 (max) 均为 32 分，与榜首差距从 3 分扩大到 12 分。同时发布的 Progress Index v1 用于在同一尺度上追踪模型能力随时间的变化。
Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets
The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers.
Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale.
New to the Intelligence Index:
➤ FrontierCode 2.0: Cognition's newly-launched private benchmark of real-world coding tasks, graded on whether a repository maintainer would merge the agent's change
➤ Terminal-Bench-Science: 70 agentic scientific research tasks, run in a terminal environment
Upgraded:
➤ HLE-Diamond (replacing Humanity's Last Exam): a refined 1,000-question version of Humanity's Last Exam, split evenly between reasoning and knowledge questions
➤ AA-Omniscience v1.1: An updated dataset with saturated and public set questions removed, new questions added, and ambiguous or erroneous questions revised
➤ CritPt v2: a private, 40-question hard subset of CritPt v2, revised by the CritPt authors and run with a code-execution tool
Staying in the Index: AA-Briefcase, AutomationBench-AA, GDP.pdf and Terminal-Bench 4.0
Removed from the Index: GDPval-AA v2.1, SciCode, and AA-LCR v1.1
Key results:
➤ Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55): Anthropic and OpenAI hold the top five models. Gemini 4 Argon (high) is next at 50
➤ The open weights gap widens from 3 points to 12: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 46. Among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32 - 26 points behind the leader and below Claude Haiku 5.5 (max, 36)
➤ Cost per task varies by more than 13x among the leading models: of the 10 highest-scoring models shown, GPT-6.1 Terra (max) is the cheapest at $0.96 per Intelligence Index task and Claude Fable 5.1 (max) the most expensive at $13.04
