Google 发布首个决策模型 Gemini Decision 1，Decision Index 得分 66

能力分布不均：知识类基准表现领先，AA-Omniscience-Decision 得 66 分，HLE-MultiChoice 得 49 分；但在分类与抽取基准 AA-Paperclip 上，全 15 题答对的文档比例仅 33%，明显低于 Drex Max v1.1 的 63%。校准方面整体 Brier 分数 0.18，处于 Drex Max v1.1（0.16）与 Jev 1.14（0.19）之间，其中 HLE-MultiChoice 上 0.20 属全场最低之一，When2Call 上 0.14 则远逊于 Drex Max v1.1 的 0.04。

成本是明显短板：输入 token 定价 $0.10/1M，是 Drex Max v1.1（$0.03）的三倍多，折算每 100 万 Tasks 成本 $345，与 GPT-6 Luna（$339）接近，而 Drex Max v1.1 仅 $103。

Google has released its first decision model, Gemini Decision 1, scoring 66 on the Artificial Analysis Decision Index and leading in knowledge and reasoning benchmarks

Gemini Decision 1 from @GoogleDeepMind scores 66 on the Artificial Analysis Decision Index v2.1, in line with Elephant 9B (@baselabs) and Jev 1.14 (@typesafeai), and 7 points behind leaders Drex Max v1.1 (@NaceAI) and GLiDE v1.2 (@fastinoAI), which both score 73. It is priced at $0.10 per 1M input tokens and costs $345 per 1M Tasks across the Index, around three times higher than Drex Max v1.1 ($103) due to its higher pricing

Key results for Gemini Decision 1:

➤ Not yet frontier on Decision Index: Gemini Decision 1 scores 66 on the Artificial Analysis Decision Index. It leads knowledge and reasoning benchmarks, scoring 66 on AA-Omniscience-Decision and 49 on HLE-MultiChoice. It trails on other evaluations, including our new proprietary classification and extraction benchmark AA-Paperclip, where it answers all 15 questions correctly on 33% of documents vs. 63% for Drex Max v1.1

➤ More than 3x the Cost per Task of leading models: Gemini Decision 1 costs $345 per 1M Tasks, compared with $103 for Drex Max v1.1, $156 for Jev 1.14. This difference is driven by its token price of $0.10 per 1M input tokens vs. $0.03 for Drex Max v1.1. Gemini Decision 1 has a similar Cost per 1M Tasks to GPT-6 Luna (Decisions, $339)

➤ Strong calibration for reasoning tasks: We measure calibration with the Brier score, the average squared gap between the probability a model assigns to its chosen answer and whether that answer was correct (lower is better). Gemini Decision 1 has a Brier score of 0.18 across the Index, between Drex Max v1.1 (0.16) and Jev 1.14 (0.19). Calibration varies by task. with its Brier score of 0.20 on HLE-MultiChoice among the lowest of all models in the Index, while its 0.14 on When2Call compares with 0.04 for Drex Max v1.1

This report is categorized under AITOP's "Models" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to US-China foundation model benchmarks and commercialization comparison and AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include Gemini Decision 1, Google DeepMind, Artificial Analysis, Drex Max.

Source attribution: curated from Artificial Analysis (@ArtificialAnlys).