Artificial Analysis Updates Six Capability Indexes to v2.0
The heavier weighting on Non-Hallucination and Agentic Tool Use signals which failure modes actually matter for professional work, and leaderboard positions may shift for models evaluated under the older v1 methodology. Hiring teams and enterprises selecting models for legal, finance or medical workflows can use the six indexes to match models to specific occupations rather than relying on a single aggregate score. Chinese labs' strong open-weight showings from Moonshot, MiniMax and DeepSeek also give cost-sensitive buyers credible alternatives to frontier closed models.
Artificial Analysis has updated its six occupation-based Capability Indexes to v2.0, aligning them with the Artificial Analysis Intelligence Index v5.0 and raising weights on Non-Hallucination and Agentic Tool Use. The indexes map O*NET occupation tasks to benchmarks across Finance & Accounting, Strategy & Ops, Legal, Healthcare & Medical, Engineering and Economics. Changes include upgrading HLE to HLE-Diamond and AA-Omniscience to v1.1, removing GDPval-AA from Agentic Knowledge Work, and adding Science benchmarks (CritPt v2 Hard Subset, Terminal-Bench-Science 0.1) plus FrontierCode 2.0 to Engineering. In the new rankings, Claude Opus 5.5 (max) leads all six indexes, with GPT-6 Astra (max) second in Finance & Accounting, Legal and Engineering. Among open-weight models, Kimi K3.1 Pro leads all six at #5 to #8, while MiniMax-M3.1-Flash tops Strategy & Ops (#10) and DeepSeek V4.1 Flash 1017 (max) leads Healthcare & Medical (#12).
We’ve updated the six Artificial Analysis Capability Indexes to v2.0, aligning them with evaluations from the Artificial Analysis Intelligence Index v5.0 and placing greater emphasis on Non-Hallucination and Agentic Tool Use
The Capability Indexes map tasks from O*NET occupations to benchmarks that represent them, weighting each benchmark by how often its capability appears in that occupation. There are six indexes: Finance & Accounting, Strategy & Ops, Legal, Healthcare & Medical, Engineering, and Economics.
Key changes:
➤ Finance & Accounting: increased weight on Non-Hallucination, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, removed GDPval-AA from Agentic Knowledge Work, and removed AA-LCR from Long-Context
➤ Strategy & Ops: increased weight on Agentic Tool Use, added Non-Hallucination and upgraded AA-Omniscience to v1.1, removed GDPval-AA from Agentic Knowledge Work, and removed AA-LCR from Long-Context
➤ Legal: increased weight on Non-Hallucination, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, removed GDPval-AA from Agentic Knowledge Work, and removed AA-LCR from Long-Context
➤ Healthcare & Medical: increased weight on Agentic Tool Use, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, and removed GDPval-AA from Agentic Knowledge Work
➤ Engineering: added Science as a new capability sourced from CritPt v2 (Hard Subset) and Terminal-Bench-Science 0.1, added FrontierCode 2.0 to Agentic Coding, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, and removed GDPval-AA from Agentic Knowledge Work
➤ Economics: increased weights on Agentic Knowledge Work and Long-Context Reasoning, replaced AA-LCR with GDP.pdf in Long-Context Reasoning, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, and removed GDPval-AA from Agentic Knowledge Work
Key results:
➤ Claude Opus 5.5 (max) leads in all six indexes, followed by GPT-6 Astra (max) in Finance & Accounting, Legal, and Engineering
➤ Among open weights models, Kimi K3.1 Pro (weights not yet released) leads all six indexes, at #5 to #8. MiniMax-M3.1-Flash leads in Strategy & Ops (#10), and DeepSeek V4.1 Flash 1017 (max) leads Healthcare & Medical (#12)
