Subquadratic 发布 SubQ Snap 1.2,决策指数升至 73 分
决策模型这个细分里 SubQ Snap 1.2 现在并列第一了,弃答策略让它幻觉率更低,价格没变。做需要模型给出明确判断、且不容出错的应用的话,可以拿它和 Drex Max v1.1、GLiDE v1.2 对比测一下。
Subquadratic 更新其决策模型 SubQ Snap 1.2,在 Artificial Analysis Decision Index v2.1 上得分 73,比 1.1 版的 68 高出 5 分,与 Drex Max v1.1(73)和 GLiDE v1.2(73)并列领先。定价维持 $0.04/1M 输入 token,支持 384K token 上下文窗口。
提升主要来自 AA-Paperclip(+8 分)和 AA-Symmetry(+8 分)。AA-Paperclip 的全对率从 46% 升至 62%,与 Drex Max v1.1 的 63% 和 GLiDE v1.2 的 62% 相当。AA-Symmetry v1.1 会把答案选项移入题干并用同义表述改写,检验模型在面对无关变化时是否保持相同的判断和置信度。
AA-Omniscience-Decision 和 HLE-MultiChoice 上的得分提升来自弃答而非准确率:非幻觉率分别从 85% 升至 89%、46% 升至 55%,准确率维持 21% 和 9%,尝试作答比例从 33% 降到 29%。这表明 1.2 版更倾向于在不确定时放弃作答,以降低幻觉风险。
Subquadratic’s SubQ Snap 1.2 gains 5 points over SubQ Snap 1.1 on the Artificial Analysis Decision Index v2.1, and is tied with Drex Max v1.1 and GLiDE v1.2 as the leading decision model
SubQ Snap 1.2 is the latest decision model from @subquadratic. Pricing is unchanged at $0.04 per 1M input tokens, and it supports a 384K token context window.
Decision Index v2.1 updates AA-Symmetry to v1.1. AA-Symmetry measures whether a model keeps the same decision and confidence when a question changes in ways that should not matter. v1.1 moves the answer options into the state and rewords them with the same meaning.
Key takeaways:
➤ SubQ Snap 1.2 scores 73 on the Artificial Analysis Decision Index v2.1, up from 68 for SubQ Snap 1.1: Drex Max v1.1 (73) and GLiDE v1.2 (73) are within 0.1 points. The largest gains are on AA-Paperclip (+8 points) and AA-Symmetry (+8 points).
➤ The AA-Paperclip gain comes from more documents answered fully correctly: the all-pass rate rises from 46% to 62%, level with Drex Max v1.1 (63%) and GLiDE v1.2 (62%).
➤ The gains on AA-Omniscience-Decision and HLE-MultiChoice come from abstention, not accuracy: non-hallucination rates rise from 85% to 89% and from 46% to 55%. Accuracy is flat at 21% and 9%. On AA-Omniscience-Decision, SubQ Snap 1.2 attempts 29% of questions, down from 33%.
This report is categorized under AITOP's "Models" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include SubQ Snap, Subquadratic, Artificial Analysis, decision models.
Source attribution: curated from Artificial Analysis (@ArtificialAnlys).