Latest

Every published item, in order · 760 items
10月15日
PapersUS vs ChinaSelected05:46
Microsoft AutoEnvScaling Boosts Qwen3 RL via Self-Designed Environments

The key insight is that environment design itself can be automated and fed back into the RL loop, with solver rollouts guiding each new round — and gains collapse when the proposer cannot see that feedback. Teams training RL agents can use this to cut the cost of building valid environments, comparing frontier proposers like GPT-5.6-sol against Claude Opus 5 on the same task.

elvis@omarsar0Source
10月14日
ModelsUS vs ChinaMulti-sourceSelected22:40
P-Zero Research launches TasteVal benchmark for research taste

The compute-efficiency framing is the unusual part: TasteVal scores models by compute needed versus human experts, not task accuracy alone. That makes it a leading indicator for when automated research could become economical, useful for labs and investors tracking self-improvement timelines. The 1/30 cost figure gives a concrete benchmark for comparing frontier models on research ability rather than chat performance.

Event
kimmonismus@kimmonismus11 sourcesSource
10月13日
ModelsBuildersMulti-sourceSelected04:17
FrontierCode 1.1 Leaderboard Launches on Artificial Analysis

The benchmark penalises behaviours conventional evals ignore, such as oversized diffs, out-of-scope file edits and unhelpful tests, so its ranking offers a different picture of coding ability than SWE-style test suites. Even the best model fails over 40% of tasks, meaning maintainer cleanup is still unavoidable. Teams choosing models by cost-performance should note GPT-6.1 Sol matching Claude Fable 5.1 at under a tenth of the per-task price.

Event
Cognition@cognition_labs11 sourcesSource
ModelsUS vs ChinaMulti-sourceSelected04:15
Artificial Analysis launches leaderboard for Cognition's FrontierCode 1.1

The benchmark's merge-focused grading penalises the messy diffs and unhelpful tests that cheaper evaluations ignore, so leaderboard gaps here reflect real maintainer acceptance rather than raw test-passing. Leading models still fail over 40% of tasks, and nine tasks went unsolved by every model evaluated. Teams choosing coding agents can weigh GPT-6.1 Sol's 49% score at US$0.81 per task against Claude Opus 5.5's 52% at far higher cost, with open-weights options like MiMo-V2.6-Pro at 45% close behind.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
10月12日
10月11日
10月10日