Latest

Every published item, in order · 688 items
Oct 14
ModelsUS vs ChinaMulti-sourceSelected22:40
P-Zero Research launches TasteVal benchmark for research taste

The compute-efficiency framing is the unusual part: TasteVal scores models by compute needed versus human experts, not task accuracy alone. That makes it a leading indicator for when automated research could become economical, useful for labs and investors tracking self-improvement timelines. The 1/30 cost figure gives a concrete benchmark for comparing frontier models on research ability rather than chat performance.

Event
kimmonismus@kimmonismus11 sourcesSource
PapersBuildersMulti-sourceSelected01:06
Open SWE router cuts coding agent cost 64% versus always-GPT-6

Placing routing logic inside the agent harness — which knows the task — beat gateway-level routing on cost without hurting merge quality. Teams running coding agents can replicate the tiered setup and measure merge rate, not just cost, before rolling out. LangChain itself flags the caveats: the control was the most expensive model and the router is still a proof of concept.

Event
Harrison Chase@hwchase1711 sourcesSource
Oct 13
Oct 11
ModelsBuildersMulti-sourceSelected03:50
SenseNova-RoboRSI doubles RoboDojo score without changing GPT-6 Astra weights

The result suggests the agent harness — not just the foundation model — is a decisive lever for robot performance, with a near-doubling of RoboDojo achieved purely through system design. Developers building embodied or multi-agent pipelines can borrow the multi-point EEF prediction and feedback-subagent patterns without retraining models. It also points to a shift in research effort from model scaling toward recursive harness optimisation.

Event
rohanpaul_ai@rohanpaul_ai11 sourcesSource
Oct 10
Oct 9
How-toBuildersMulti-sourceSelected21:24
Blog feature built with voice commands

This demonstrates a practical application of voice coding for web development, showing how developers can multitask while creating features. For developers in Southeast Asia, this approach could increase productivity during daily routines, though the local availability of GPT-6 Astra High may vary compared to alternatives like Claude or local models.

Event
官方账号Simon Willison’s Weblog8 sourcesSource
ModelsBuildersMulti-sourceSelected02:39
Harvey LAB-AA v1.1 Adds Hallucination Gate to Legal Benchmark

The hallucination gate reshuffles the leaderboard: Muse Spark 1.3 would lead at 26.7% all-pass without it, but two thirds of its passes contain material hallucinations, while GPT-6 Astra keeps nearly all its passes and jumps from joint 10th to 3rd. Legal tech teams benchmarking models for drafting work should weight groundedness over raw pass rates, and cost data matters too — Grok 4.7 tops the table at roughly US$9.50 per task, under half the ~US$21.70 of Claude Fable 5.1.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
Oct 8