Latest

Every published item, in order · 95 items
10月22日
10月21日
ModelsUS vs ChinaMulti-sourceSelected23:55
Claude Sonnet 5.5 and GPT-6 Astra tie on MLCR-AA leaderboard

The split matters more than the tie: Anthropic models dominate completeness, with Claude Sonnet 5.5 at 64.8% versus 42.2% for the best non-Anthropic model, while OpenAI models dominate accuracy, led by GPT-6.1 Sol at 96.7%. Teams deploying models for medical record review should pick based on which failure mode they can tolerate. Even top models still fail more than half of the benchmark's questions, so human review remains necessary.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
10月20日
10月18日
ModelsBuildersMulti-sourceSelected00:08
Arena Alignment Index adds Meta Muse Wonder, Reflection Beam 1.0, Step 5 Preview

The index measures failure modes most leaderboards ignore: unauthorized actions, false attribution and deceptive completion, so lab rankings can shift even when capability scores stay flat. Reflection AI debuting as the top US open model on Agent Arena gives open-weight builders a concrete alternative to closed systems. StepFun's entry at 75.1%, nearly matching Meta on unauthorized actions, is a datapoint worth watching for anyone tracking Chinese labs against US peers.

Event
lmarena.ai@lmarena_ai11 sourcesSource
10月17日
10月16日
10月15日
10月14日
10月13日
ModelsBuildersMulti-sourceSelected04:17
FrontierCode 1.1 Leaderboard Launches on Artificial Analysis

The benchmark penalises behaviours conventional evals ignore, such as oversized diffs, out-of-scope file edits and unhelpful tests, so its ranking offers a different picture of coding ability than SWE-style test suites. Even the best model fails over 40% of tasks, meaning maintainer cleanup is still unavoidable. Teams choosing models by cost-performance should note GPT-6.1 Sol matching Claude Fable 5.1 at under a tenth of the per-task price.

Event
Cognition@cognition_labs11 sourcesSource
ModelsUS vs ChinaMulti-sourceSelected04:15
Artificial Analysis launches leaderboard for Cognition's FrontierCode 1.1

The benchmark's merge-focused grading penalises the messy diffs and unhelpful tests that cheaper evaluations ignore, so leaderboard gaps here reflect real maintainer acceptance rather than raw test-passing. Leading models still fail over 40% of tasks, and nine tasks went unsolved by every model evaluated. Teams choosing coding agents can weigh GPT-6.1 Sol's 49% score at US$0.81 per task against Claude Opus 5.5's 52% at far higher cost, with open-weights options like MiMo-V2.6-Pro at 45% close behind.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
10月12日
10月10日
10月9日
ModelsUS vs ChinaMulti-sourceSelected00:39
Arena Alignment Index benchmarks agent safety across 27 models

The benchmark shifts agent evaluation from capability to behavioural trustworthiness, treating false task-completion claims and unauthorized actions as measurable failure modes. Teams deploying agents for multi-step workflows can use the leaderboard to weigh alignment alongside performance when picking a model. Arena says it will expand the index with more safety signals and models over time.

Event
lmarena.ai@lmarena_ai11 sourcesSource
10月8日
ModelsBuildersMulti-sourceSelected07:37
Agent Arena tests show Jev Router trails DeepSeek V4.1 Flash on cost

The evaluation suggests routers are judged less on raw cost-performance and more on how quickly they adapt to user feedback, where Jev Router nearly matches Claude Opus 5.5 (High). Teams building multi-model agent pipelines can use these latency and cost figures to decide whether a routing layer beats picking DeepSeek V4.1 Flash directly. The full thread contains additional session-level insights.

Event
lmarena.ai@lmarena_ai5 sourcesSource
10月7日
10月6日
10月4日
9月17日
AITOP16:09
Anthropic拟10月在新加坡设亚太第五个办事处 开...

Anthropic拟10月在新加坡设亚太第五个办事处 开放本地招聘 数据显示,按人口比例计算,新加坡的Claude.ai使用水平在121个国家中排名第二。 我们观察到,人工智能公司Anthropic计划于10月在新加坡设立其亚太地区的第五…

AITOPRead
8月13日
8月7日
AITOP17:04
出口结构剧变:中国卖给世界的,不再是产品而是解法

中国出口"新新三样":从打火机到爬墙机器人,世界不再只是买便宜货 我们观察到一组清晰的数据信号:中国出口的"新新三样"已经从过去的服装、家具、家电,换成机器人、AI模型和创新药物。这不是产业升级的修辞游戏,而是发生在澳大利亚和巴西的实证样…

AITOPRead
8月2日