Latest

Every published item, in order · 75 items
Nov 7
ModelsBuildersMulti-sourceSelected01:14
VIALS-AA leaderboard ranks models on life science visual reasoning

The 29× cost gap between frontier models with a 3-point score spread changes the economics of choosing a model for scientific agent workloads. Teams building lab-automation or biotech analysis tools can use the per-task cost and turn counts to pick models that fit their budgets. The 19-point deficit of open weights models like Kimi K3.1 Pro also marks a concrete ceiling for on-premise deployments.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
Nov 6
PapersUS vs ChinaMulti-sourceSelected00:32
MiMo-V2.6-Pro Tops AA-PersonalityBench in Question-Ending Responses

Response-ending behaviour shapes how conversational and proactive an assistant feels, and this benchmark turns that personality trait into a measurable signal. Product teams choosing a model for customer-facing chatbots can use these figures to match tone, since a 34% question rate reads very differently from a 0.1% one. The spread between MiMo-V2.6-Pro and DeepSeek V4.1 Flash also shows two Chinese labs optimising for opposite interaction styles.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
Nov 5
ModelsUS vs ChinaMulti-sourceSelected02:22
Gemini 4 Carbon leads cost scaling in Agent Arena data

Cost differences widen precisely on the longest sessions, so the cheapest model for simple tasks is not the cheapest for complex agentic work. Teams running long-horizon agent tasks such as app development can cut bills by re-benchmarking at high task complexity rather than averaging across workloads. The finding also opens the door for Gemini 4 Argon and Xiaomi's MiMo-V2.6 Flash and Pro to challenge OpenAI and Anthropic where budgets are tightest.

Event
lmarena.ai@lmarena_ai11 sourcesSource
Oct 17
ModelsUS vs ChinaSelected03:05
Reflection AI's Beam 1.0 Enters Agent Arena Top 15 Labs

A US lab landing a top open-weight spot in agentic benchmarks breaks the pattern of Chinese labs dominating the open WebDev leaderboard, where 24 of the top 25 models are Chinese. Teams choosing an Apache 2.0 model for agent or coding work now have a credible US alternative to Kimi K2.5 Thinking and GLM-5. The wide error bars mean its true standing relative to Qwen3.8 is less settled than the rank suggests.

lmarena.ai@lmarena_aiSource
Oct 16
ModelsUS vs ChinaSelected22:06
Reflection AI's Beam-1.0-501B-A23B Ranks #12 in Agent Arena

24 of the top 25 open models on Code Arena: WebDev come from Chinese labs, and Beam 1.0 is the lone US exception — a notable shift in the open-weights competitive landscape. Builders evaluating Apache 2.0 agentic models can compare Beam directly against Qwen3.8, Kimi K2.5 Thinking and GLM-5 once the full weights drop this month. Its 23B active parameter design targets reasoning efficiency for agent workloads.

lmarena.ai@lmarena_aiSource
Oct 15
ProductsBuildersSelected04:43
Inworld Inference API targets consumer AI apps

Inference latency, not model quality, is often the deciding factor for real-time consumer apps, and Inworld is competing on exactly that metric rather than training its own models. Developers building tutors, companions or game NPCs can route requests to Gemma 4, DeepSeek or GLM through a single API with fallback switching. Serving open models instead of proprietary ones also means lower per-token costs and no vendor lock-in.

TestingCatalog@testingcatalogSource
Oct 14
Oct 13
ModelsBuildersMulti-sourceSelected04:17
FrontierCode 1.1 Leaderboard Launches on Artificial Analysis

The benchmark penalises behaviours conventional evals ignore, such as oversized diffs, out-of-scope file edits and unhelpful tests, so its ranking offers a different picture of coding ability than SWE-style test suites. Even the best model fails over 40% of tasks, meaning maintainer cleanup is still unavoidable. Teams choosing models by cost-performance should note GPT-6.1 Sol matching Claude Fable 5.1 at under a tenth of the per-task price.

Event
Cognition@cognition_labs11 sourcesSource
ModelsUS vs ChinaMulti-sourceSelected04:15
Artificial Analysis launches leaderboard for Cognition's FrontierCode 1.1

The benchmark's merge-focused grading penalises the messy diffs and unhelpful tests that cheaper evaluations ignore, so leaderboard gaps here reflect real maintainer acceptance rather than raw test-passing. Leading models still fail over 40% of tasks, and nine tasks went unsolved by every model evaluated. Teams choosing coding agents can weigh GPT-6.1 Sol's 49% score at US$0.81 per task against Claude Opus 5.5's 52% at far higher cost, with open-weights options like MiMo-V2.6-Pro at 45% close behind.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
Oct 11
Oct 8
ModelsUS vs ChinaMulti-sourceSelected00:13
Mistral Large 4 tops AutomationBench business workflow benchmark

Agent benchmarks that measure office-app workflows, rather than chat or coding, are becoming a separate leaderboard from traditional evals, and Mistral is staking its position on it. Developers building automation agents on Gmail, Sheets or Salesforce should check whether the benchmark's task design matches their use cases before switching models. Comparisons against Kimi K3 and DeepSeek V4 Pro also frame it as a European lab competing on agentic execution.

Event
官方账号Mistral AI@MistralAI11 sourcesSource
Oct 7
Oct 6
Oct 3
Oct 2
ModelsBuildersSelected73°03:56
Xiaomi MiMo-V2.6 models rank in Agent Arena

The significant performance jump in MiMo-V2.6-Pro positions it as a competitive alternative to proprietary models like Claude Opus 5 and GPT-5.6 at a fraction of the cost. Developers and enterprises in ASEAN can leverage these open-source models for coding, computer use, and creative applications, particularly where cost efficiency is critical compared to proprietary alternatives.

lmarena.ai@lmarena_aiSource
ModelsBuildersSelected03:56
MiMo-V2.6-Flash on Agent Arena Pareto Frontier

The result demonstrates tangible progress in cost-efficient AI model performance, particularly important for developers working with constrained budgets. For teams building applications requiring cost-effective reasoning, this model offers a competitive alternative to more expensive options while maintaining performance.

lmarena.ai@lmarena_aiSource
Sep 28
ModelsBuildersMulti-sourceSelected73°20:34
Artificial Analysis Cyber Index Ranks AI Models on Cyber Defense

Safety refusals, not coding skill, now decide leaderboard rankings on defensive security work, a factor most agent benchmarks ignore. Security teams choosing models for vulnerability triage should check refusal rates alongside raw scores, since a top coder may decline a third of real tasks. The ranking also spans Chinese and US labs, making it a useful cross-vendor comparison point.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
Sep 26
Sep 25
Sep 24
Sep 23
PapersBuildersSelected73°04:40
ReFigBench shows harness choice changes coding agent results

The same model can score differently depending on the harness around it, so benchmark numbers reflect the full stack rather than the model alone. Teams evaluating coding agents should rerun comparisons under their own harness before drawing conclusions. ReFigBench adds a new evaluation axis, and details are on arXiv (2609.18844) alongside a chat interface from dair.ai.

elvis@omarsar0Source
Sep 17
AITOP16:09
Anthropic拟10月在新加坡设亚太第五个办事处 开...

Anthropic拟10月在新加坡设亚太第五个办事处 开放本地招聘 数据显示,按人口比例计算,新加坡的Claude.ai使用水平在121个国家中排名第二。 我们观察到,人工智能公司Anthropic计划于10月在新加坡设立其亚太地区的第五…

AITOPRead
Aug 13
Aug 7
AITOP17:04
出口结构剧变:中国卖给世界的,不再是产品而是解法

中国出口"新新三样":从打火机到爬墙机器人,世界不再只是买便宜货 我们观察到一组清晰的数据信号:中国出口的"新新三样"已经从过去的服装、家具、家电,换成机器人、AI模型和创新药物。这不是产业升级的修辞游戏,而是发生在澳大利亚和巴西的实证样…

AITOPRead
Aug 2