AITOPAI热报
Products

Artificial Analysis 上线 CritPt v2 评分服务器并更新智能指数 v5.0.1

官方账号Artificial Analysis@ArtificialAnlys
Post
View the post
Why we picked it

Artificial Analysis 把 CritPt v2 评分服务器开放出来了，模型分数全部重测，改动幅度最多 1 分，关心榜单的可以看看。

Artificial Analysis 与 CritPt 论文作者合作完成 CritPt v2 评分服务器，将通过其 API 向社区开放。评分服务器逻辑经过鲁棒性改进，作者据此将 Artificial Analysis Intelligence Index 更新到 v5.0.1。所有模型已重新评分，多数模型分数小幅上升，前沿模型排名不变，分数变动最多 1 分。

Original · Artificial Analysis

We’ve worked with the CritPt authors to finalize the CritPt v2 grading server and will be making this available to the community via Artificial Analysis’ API tomorrow. As part of this process the authors made robustness improvements to the grading server logic, which we have incorporated as v5.0.1 of the Artificial Analysis Intelligence Index

We regraded every model and observe small score increases for most models. Intelligence Index rankings are unchanged among frontier models, with scores moving by at most 1 point.

Thanks to @MiniHui_zhu, @MinyangTian1 and the rest of the CritPt team for their ongoing collaboration

#Artificial Analysis#CritPt#Intelligence Index#基准测试

Keep reading

Recent stories with the same tag or section
ProductsBuildersMulti-sourceSelected10:04
Artificial Analysis adds GPU rental pricing to AA-AgentPerf benchmark

Benchmark rankings now reflect what compute actually costs to rent, shifting comparisons from raw throughput to value per dollar. Teams sizing agent deployments can use the daily-updated indices to pick hardware that maximises agent throughput within a fixed compute budget. The included AMD MI355X figure is an assumption from market quotes rather than an official index, so treat that data point with caution.

#Artificial Analysis#Silicon Data#AA-AgentPerf#GPU pricing
Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
ModelsBuildersSelected09:47
AA-PersonalityBench: open weights models lag proprietary on truthfulness

The gap pattern suggests open weights models optimise toward punchy, scannable output at the cost of factual care and structure, a trade-off worth weighing when picking models for enterprise or research workflows. Teams choosing between open weights deployments and proprietary APIs can use the 30-trait percentiles as a filter beyond raw intelligence scores. The benchmark also gives prompt engineers concrete levers for compensating where open models fall short.

#AA-PersonalityBench#Artificial Analysis#open-source models#benchmarks
官方账号Artificial Analysis@ArtificialAnlysSource
ModelsUS vs ChinaSelected00:45
Kimi K3.1 Pro shows largest personality shift in AA-PersonalityBench

A personality rewrite this large between consecutive versions means teams tuning prompts or evals around Kimi K3's behavioural profile may see different outputs after upgrading. Developers building character-driven agents or customer-facing assistants should re-run behavioural evaluations before switching to K3.1 Pro. The benchmark also offers a reusable method for tracking such shifts across any model lineage.

#Kimi#Moonshot#AA-PersonalityBench#benchmark
官方账号Artificial Analysis@ArtificialAnlysSource