Latest

The 29× cost gap between frontier models with a 3-point score spread changes the economics of choosing a model for scientific agent workloads. Teams building lab-automation or biotech analysis tools can use the per-task cost and turn counts to pick models that fit their budgets. The 19-point deficit of open weights models like Kimi K3.1 Pro also marks a concrete ceiling for on-premise deployments.

官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource

Routing thousands of micro-decisions to a pick-only model could cut agent orchestration costs by orders of magnitude where the answer space is a finite option list, not free text. Builders running multi-step agent pipelines can plug it in as a cheap decision layer while keeping a general model for generation. The gap on HLE shows it is a narrow tool, not a replacement for reasoning models.

rohanpaul_ai@rohanpaul_ai2 sourcesSource

The interesting part is the interface shift: instead of generating text, these models emit calibrated probabilities over fixed options, which suits scoring, routing and agentic decision points where latency matters. Builders assembling agent pipelines or classification backends can try the weights on Hugging Face or read the paper at arxiv.org/abs/2611.07854. Compared with calling Claude Opus 5.5 or GPT-6 Sol, Drex trades text generation for sub-200ms structured decisions under an open licence.

elvis@omarsar0Source

For hour-long agent workloads, the cheapest model is not automatically the right one: Claude Opus 5.5 scores higher but costs twice as much per hour as Gemini 4 Carbon. Teams running long-horizon agents can use these per-hour cost and time figures to match model choice to budget and quality needs. The 55-minute spread among frontier models also suggests task duration, not just accuracy, should enter model selection criteria.

lmarena.ai@lmarena_ai11 sourcesSource

Cost differences widen precisely on the longest sessions, so the cheapest model for simple tasks is not the cheapest for complex agentic work. Teams running long-horizon agent tasks such as app development can cut bills by re-benchmarking at high task complexity rather than averaging across workloads. The finding also opens the door for Gemini 4 Argon and Xiaomi's MiMo-V2.6 Flash and Pro to challenge OpenAI and Anthropic where budgets are tightest.

lmarena.ai@lmarena_ai11 sourcesSource

Benchmarking by task completion time rather than tokens per second changes how verbose models rank: GPT-6 Astra beats faster rivals because it emits about 50k output tokens per task versus 120k–170k for competitors. Default-effort data shows medium effort cuts task time 3–5x at a modest intelligence cost, which directly informs cost-sensitive API choices. Developers comparing models for agentic workloads should re-read leaderboards with this metric in mind.

官方账号Artificial Analysis@ArtificialAnlysSource

The heavier weighting on Non-Hallucination and Agentic Tool Use signals which failure modes actually matter for professional work, and leaderboard positions may shift for models evaluated under the older v1 methodology. Hiring teams and enterprises selecting models for legal, finance or medical workflows can use the six indexes to match models to specific occupations rather than relying on a single aggregate score. Chinese labs' strong open-weight showings from Moonshot, MiniMax and DeepSeek also give cost-sensitive buyers credible alternatives to frontier closed models.

官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource