Artificial Analysis 数据工作台上线自定义指数功能
搞模型选型的朋友可以看看这个:Artificial Analysis 的 Data Playground 现在能自己加权组合基准、定制专属指数,还能放动画看 frontier 随时间推移。比直接看官方 Intelligence Index 灵活多了,不过得开 Pro 订阅。
Artificial Analysis 在其 Data Playground 中推出自定义指数功能,用户可将 Artificial Analysis 的任意基准纳入自己的指数,并为每个基准设定权重,图表打分逻辑与其 Intelligence Index 一致:模型只有在指数内所有评估都有成绩时才会获得分数。
此外 Data Playground 还支持公式指标,可用 +、-、*、/ 以及 log、sqrt 等函数组合任意指标;Scatter 散点图可按模型发布日期逐帧播放,并绘制每个时间点当时的 frontier 边界线;同时提供跨多项评估的热力图、按分组(如开源权重模型 vs 闭源专有模型)的箱线图分布,以及带 sheets、行列 shelf 和仪表盘视图的工作台。
该功能需要订阅 Artificial Analysis Pro 才能使用,适合需要按自有权重横向对比模型能力的开发者和选型团队。
Build your own custom index in the Artificial Analysis Data Playground
Add any Artificial Analysis benchmarks, customize their weights, and plot the results with other chart axis. Models receive a score only if they have results for every evaluation in your index, consistent with the Intelligence Index methodology.
Also in the Data Playground: ➤ Formula metrics: combine any metrics with +, -, *, / and functions such as log and sqrt ➤ Playback: play a scatter chart forward by launch date, with the frontier drawn as it stood at each date ➤ Heat maps across many evaluations, and box plot distributions by group, such as open weights vs proprietary ➤ A workbench with sheets, Columns/Rows shelves and a dashboard view
The Data Playground is available with Artificial Analysis Pro.
This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include Artificial Analysis, benchmarks, model evaluation, data visualization.
Source attribution: curated from Artificial Analysis (@ArtificialAnlys).