Latest

Every published item, in order · 527 items
Nov 7
Nov 5
Nov 4
Nov 3
Oct 30
Oct 28
Oct 22
Oct 20
ModelsUS vs ChinaSelected02:31
AA-PersonalityBench Ranks Model Personality and Communication Style

The non-obvious insight is that correctness alone no longer separates models; style metrics like Slop and Conviction now offer a measurable way to pick a model for tone-sensitive use-cases such as legal drafting or creative writing. Teams building user-facing products can use the eight indexes to shortlist models matching their brand voice. The data covers Chinese models like GLM-5.3, DeepSeek V4.1 Flash and Qwen3.8 27B alongside Western ones, making direct stylistic comparison across the two ecosystems possible.

官方账号Artificial Analysis@ArtificialAnlysSource
Oct 19
Oct 18
PapersBuildersSelected13:28
Meta paper ranks frontier agents by learning efficiency per dollar

The best single-game performer was not the most efficient learner, so one-shot benchmark scores can mislead when choosing an agent for long-horizon work. Teams building self-improving systems should track held-out learning curves against compute cost and verify that saved tools and notes are actually reused. The frozen-weights design makes the results directly relevant to anyone running agents under a fixed budget.

rohanpaul_ai@rohanpaul_aiSource
Oct 17
ProductsBuildersSelected04:08
Arena launches agentic Max model router at 37% lower cost

A router that matches a frontier model's agentic performance while cutting cost per task by 37% shifts the economics of running multi-step agents, where model spend scales with every tool call. Teams deploying coding or browsing agents can route requests through Max instead of committing to one expensive model. Availability is currently free for a limited time, so it is easy to benchmark against direct Claude Fable 5.1 usage.

lmarena.ai@lmarena_aiSource
Oct 16
Oct 15
ModelsUS vs ChinaSelected12:46
Paper Instruments releases Ultramarine 1 Flash for document workloads

A cost gap of roughly 60x per task against Claude Fable 5, while scoring higher on a deliverables benchmark, could push professional-services firms to re-evaluate which workloads run on open models. Builders fine-tuning on top of GLM-5.3 Flash now have a concrete vertical example of post-training for rubric-graded outputs. Its open weights also make on-premise deployment viable for firms with client confidentiality constraints.

TestingCatalog@testingcatalogSource
Oct 14
Oct 13
ModelsBuildersSelected04:17
FrontierCode 1.1 Leaderboard Launches on Artificial Analysis

The benchmark penalises behaviours conventional evals ignore, such as oversized diffs, out-of-scope file edits and unhelpful tests, so its ranking offers a different picture of coding ability than SWE-style test suites. Even the best model fails over 40% of tasks, meaning maintainer cleanup is still unavoidable. Teams choosing models by cost-performance should note GPT-6.1 Sol matching Claude Fable 5.1 at under a tenth of the per-task price.

Cognition@cognition_labsSource
Oct 12
Oct 11
Oct 10
PapersBuildersSelected73°08:06
Meta Superintelligence Labs Agent Plasticity Study

The research reveals that the best-performing models aren't always the most efficient learners, challenging assumptions about AI self-improvement. Developers and researchers can use agent plasticity metrics to optimize AI training investments, particularly for complex tasks requiring artifact reuse. The findings have practical implications for resource allocation in AI development across industries.

elvis@omarsar0Source
Oct 9
ModelsBuildersSelected02:39
Harvey LAB-AA v1.1 Adds Hallucination Gate to Legal Benchmark

The hallucination gate reshuffles the leaderboard: Muse Spark 1.3 would lead at 26.7% all-pass without it, but two thirds of its passes contain material hallucinations, while GPT-6 Astra keeps nearly all its passes and jumps from joint 10th to 3rd. Legal tech teams benchmarking models for drafting work should weight groundedness over raw pass rates, and cost data matters too — Grok 4.7 tops the table at roughly US$9.50 per task, under half the ~US$21.70 of Claude Fable 5.1.

官方账号Artificial Analysis@ArtificialAnlysSource
Sep 17
AITOP16:09
Anthropic拟10月在新加坡设亚太第五个办事处 开...

Anthropic拟10月在新加坡设亚太第五个办事处 开放本地招聘 数据显示,按人口比例计算,新加坡的Claude.ai使用水平在121个国家中排名第二。 我们观察到,人工智能公司Anthropic计划于10月在新加坡设立其亚太地区的第五…

AITOPRead
Aug 13
Aug 7
AITOP17:04
出口结构剧变:中国卖给世界的,不再是产品而是解法

中国出口"新新三样":从打火机到爬墙机器人,世界不再只是买便宜货 我们观察到一组清晰的数据信号:中国出口的"新新三样"已经从过去的服装、家具、家电,换成机器人、AI模型和创新药物。这不是产业升级的修辞游戏,而是发生在澳大利亚和巴西的实证样…

AITOPRead
Aug 2