Latest

Every published item, in order · 9305 items
Oct 23
ModelsBuildersSelected08:21
Artificial Analysis Coding Agent Index v2.0: Claude Opus 5.5 Leads

The v2.0 changes make rankings harder to game: private test sets, anti-solution scanning and multi-vote LLM judging push mean scores down 1.7 points across 21 shared configurations. Teams choosing a coding agent should note that Opus 5.5's edge is concentrated on FrontierCode (56.0% versus 52.6% for DeepSeek V4.1 Flash), while 15 of 24 configurations cluster between 43% and 49%, so harness choice can matter as much as model choice.

Official accountArtificial Analysis@ArtificialAnlysSource
ModelsUS vs ChinaSelected06:51
AA-PersonalityBench links model slop to intelligence gaps

Slop output is only loosely tied to raw capability, so model selection for writing or content pipelines should weigh the Slop ranking separately from the Intelligence Index. Teams building customer-facing copy or summarisation tools can use these two scores as a joint filter instead of assuming a smarter model reads better. Qwen3.8 Max ranking high on both lists is a useful data point when weighing it against Gemini 4 Argon or GPT-6 variants.

Official accountArtificial Analysis@ArtificialAnlysSource
Tomorrow 08:00, the daily lands in your inboxTelegram channel or email. Same screening as this page, no ads.
ModelsBuildersSelected04:34
AWS Priming Converts Transformers Into Efficient Hybrid Models

Priming makes hybrid architectures practical by skipping full pretraining, which could shift how teams convert existing checkpoints into cheaper-to-serve models. Engineers deploying 8B-32B scale models can use the released weights to cut inference memory and cost immediately. It competes with from-scratch hybrid efforts like those from other labs at a fraction of the compute spend.

Official accountAmazon Science@AmazonScienceSource
ModelsUS vs ChinaMulti-sourceSelected01:57
CritPt v2 Benchmark Launches with Agentic Code Execution

The 54-point gap between GPT-5 and GPT-6 Astra in about a year shows how quickly frontier models are absorbing research-level physics when given code execution. Tracking these scores before the late October Intelligence Index update helps researchers and benchmark watchers pick models for scientific workflows. Compare against Claude Opus 5.5 at 78% when choosing a frontier model for agentic computation tasks.

Event
Official accountArtificial Analysis@ArtificialAnlysSource
Oct 22
ModelsUS vs ChinaMulti-sourceSelected22:01
DeepSeek V4 Pro 0813 ties for second on CVE rediscovery benchmark

Vulnerability rediscovery is becoming a measurable benchmark for frontier models, and a Chinese model matching a top US lab result suggests the capability gap on security-relevant reasoning has narrowed. Security researchers and red teams can weigh these pass@3 scores when picking models for bug-hunting workflows. The poster argues the result reflects data scale rather than copying a competitor's outputs.

Event
Teortaxes@teortaxesTexSource
ModelsBuildersSelected17:26
vLLM Ships Day-0 Support for Sage-A1.5

Day-0 support means the model can be self-hosted on existing vLLM infrastructure immediately, without waiting for community integrations. With only 3B active parameters, it targets teams running agentic workloads on modest local hardware who want an alternative to larger dense models. Developers comparing open-source MoE options for on-premise serving should evaluate its throughput against Qwen and DeepSeek MoE checkpoints.

Official accountvLLM@vllm_projectSource
ModelsBuildersSelected17:09
Tencent Hunyuan releases WorkForge agent training framework

Training agents on verifiable, evidence-grounded tasks addresses the core bottleneck of RL for long-horizon work: reward reliability. The 16.7K-environment scale makes this one of the larger open efforts in agent environment construction. Engineers building work or office agents can study the dual-verifier design for their own training pipelines.

Official account腾讯混元@TencentHunyuanSource
ModelsBuildersMulti-sourceSelected16:36
Muse Glimmer 30B: Meta's distilled agent model runs on one consumer GPU

Distilling from a large teacher into a small model specialised for long tool-use chains may matter more than raw size for local agents, a trade-off the OSWorld gap makes visible. Builders running agents on local hardware can use it as a drop-in for multi-tool MCP workflows without cloud dependency. Compared with Qwen3.6-27B, it wins on tool orchestration but loses on general OS-level tasks.

Event
rohanpaul_ai@rohanpaul_aiSource

Only the latest 2000 items are listed; for older ones see the daily archive