Latest

Every published item, in order · 78 items
Oct 22
Oct 21
ModelsUS vs ChinaMulti-sourceSelected23:55
Claude Sonnet 5.5 and GPT-6 Astra tie on MLCR-AA leaderboard

The split matters more than the tie: Anthropic models dominate completeness, with Claude Sonnet 5.5 at 64.8% versus 42.2% for the best non-Anthropic model, while OpenAI models dominate accuracy, led by GPT-6.1 Sol at 96.7%. Teams deploying models for medical record review should pick based on which failure mode they can tolerate. Even top models still fail more than half of the benchmark's questions, so human review remains necessary.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
Oct 20
Oct 16
Oct 15
Oct 14
Oct 13
ModelsBuildersMulti-sourceSelected04:17
FrontierCode 1.1 Leaderboard Launches on Artificial Analysis

The benchmark penalises behaviours conventional evals ignore, such as oversized diffs, out-of-scope file edits and unhelpful tests, so its ranking offers a different picture of coding ability than SWE-style test suites. Even the best model fails over 40% of tasks, meaning maintainer cleanup is still unavoidable. Teams choosing models by cost-performance should note GPT-6.1 Sol matching Claude Fable 5.1 at under a tenth of the per-task price.

Event
Cognition@cognition_labs11 sourcesSource
ModelsUS vs ChinaMulti-sourceSelected04:15
Artificial Analysis launches leaderboard for Cognition's FrontierCode 1.1

The benchmark's merge-focused grading penalises the messy diffs and unhelpful tests that cheaper evaluations ignore, so leaderboard gaps here reflect real maintainer acceptance rather than raw test-passing. Leading models still fail over 40% of tasks, and nine tasks went unsolved by every model evaluated. Teams choosing coding agents can weigh GPT-6.1 Sol's 49% score at US$0.81 per task against Claude Opus 5.5's 52% at far higher cost, with open-weights options like MiMo-V2.6-Pro at 45% close behind.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
Oct 12
Oct 9
Oct 8
ModelsBuildersMulti-sourceSelected07:37
Agent Arena tests show Jev Router trails DeepSeek V4.1 Flash on cost

The evaluation suggests routers are judged less on raw cost-performance and more on how quickly they adapt to user feedback, where Jev Router nearly matches Claude Opus 5.5 (High). Teams building multi-model agent pipelines can use these latency and cost figures to decide whether a routing layer beats picking DeepSeek V4.1 Flash directly. The full thread contains additional session-level insights.

Event
lmarena.ai@lmarena_ai5 sourcesSource
Oct 7
Oct 6
Oct 4
Oct 3
Oct 2
Oct 1
Sep 17
AITOP16:09
Anthropic拟10月在新加坡设亚太第五个办事处 开...

Anthropic拟10月在新加坡设亚太第五个办事处 开放本地招聘 数据显示,按人口比例计算,新加坡的Claude.ai使用水平在121个国家中排名第二。 我们观察到,人工智能公司Anthropic计划于10月在新加坡设立其亚太地区的第五…

AITOPRead
Aug 13
Aug 7
AITOP17:04
出口结构剧变:中国卖给世界的,不再是产品而是解法

中国出口"新新三样":从打火机到爬墙机器人,世界不再只是买便宜货 我们观察到一组清晰的数据信号:中国出口的"新新三样"已经从过去的服装、家具、家电,换成机器人、AI模型和创新药物。这不是产业升级的修辞游戏,而是发生在澳大利亚和巴西的实证样…

AITOPRead
Aug 2