Latest

Every published item, in order · 325 items
Oct 15
PapersBuildersSelected12:52
BizBench Benchmark Tests Agent Execution Validity in Payments Workflows

The benchmark shows that outcome-only evaluation masks invalid execution, since models can hit the final goal while violating constraints mid-run — a gap that matters most in regulated domains like payments where intermediate errors carry financial or compliance consequences. Agent builders can use the 50-task suite and deterministic checks to measure constraint compliance and tool-call overhead, not just task success. Teams choosing models for workflow automation get a direct comparison of frontier and open models under identical conditions.

arXiv: DeepSeek@Enhan Zhao et al. (9)Source
PapersBuildersSelected12:49
Behavioral Self-Rewarding Lifts Qwen3-14B on SWE-bench

The method requires no new environment interactions, so teams can layer it onto existing reward setups without extra rollout cost. Researchers and engineers training coding agents on sparse test-based rewards get a concrete fix for zero-variance groups, with the bounded-reward design showing how to keep self-judgement from overriding ground-truth correctness. It compares against standard GRPO-style binary reward training on Qwen3-14B.

DAIR.AI@dair_aiSource
Chinese contentarXiv 论文:证伪驱动的模型无关智能体协议,输出纪律决定决策下限

用中医辨证基准证明了件事:很多模型翻车不是能力不够,是输出纪律不行。他们设计的证伪协议能把 Kimi K3 的方差从 0.218 压到 0.007,写智能体的值得看看。

Event
arXiv: DeepSeek@Jing Liu et al. (4)2 sourcesSource
PapersBuildersSelected09:22
Primus Projection Cuts Distributed LLM Training Tuning to Single-Node Simulation

Teams burning GPU-hours on OOM crashes and suboptimal parallelism recipes can instead score candidate configurations in seconds on one machine, then commit only to the promising ones. The paper's validated error rates at production scale — including on DeepSeek V3 and Qwen3 — make the projections credible for real deployments. Engineers planning training runs on 256 to 1,024 GPU clusters, or on hardware not yet available, get a practical tuning workflow they can adopt directly.

arXiv: DeepSeek@Anshu Raina et al. (10)Source
PapersUS vs ChinaSelected05:46
Microsoft AutoEnvScaling Boosts Qwen3 RL via Self-Designed Environments

The key insight is that environment design itself can be automated and fed back into the RL loop, with solver rollouts guiding each new round — and gains collapse when the proposer cannot see that feedback. Teams training RL agents can use this to cut the cost of building valid environments, comparing frontier proposers like GPT-5.6-sol against Claude Opus 5 on the same task.

elvis@omarsar0Source
Oct 14
Oct 13
Oct 12
Oct 11
PapersBuildersSelected05:32
HarnessSQL Training Lifts Qwen3 on Spider 2.0-SQLite

The core insight is that evaluation harnesses create a train-deploy mismatch: models trained to emit one static query underperform when deployed agents must probe schemas and revise queries interactively. Teams building agentic SQL or tool-use systems should consider matching training and inference environments rather than adding capabilities at fine-tuning time. The method uses open Qwen models, so results are reproducible without proprietary systems.

elvis@omarsar0Source
PapersBuildersMulti-sourceSelected04:44
Stanford paper splits agent failures between harness fixes and fine-tuning

The actionable shift is diagnostic: the same failure mode responds to different interventions, so prompt and tooling edits can waste effort on problems only weight training solves. Teams building agents can use the process-versus-content taxonomy as a triage step before committing compute. The Qwen3.5 LoRA numbers give a concrete baseline for how much fine-tuning moves plan quality on a small model.

Event
rohanpaul_ai@rohanpaul_ai6 sourcesSource
PapersBuildersSelected01:48
Sakana AI paper proposes MASS for recursive self-improvement

The non-obvious idea is that multi-agent self-supervision can replace the external verifier that most self-improvement loops depend on, extending the approach to open-ended tasks with no ground-truth checker. Researchers working on self-improving agents and efficient training should read the paper and the accompanying Chat with Paper walkthrough to see whether the workflow-search setup transfers to their own models.

elvis@omarsar0Source
Oct 10
PapersBuildersSelected11:15
NYU and Amazon skill selection paper

This research reveals that quality trumps quantity in skill distillation, potentially reducing computational costs by over 90% while maintaining performance. For developers and researchers working with large language models, this method offers a practical way to optimize training efficiency and improve model performance on specific tasks like math contests.

rohanpaul_ai@rohanpaul_aiSource
Oct 9
Oct 8
PapersBuildersMulti-sourceSelected11:48
NVIDIA paper: tools weaken multimodal model safety refusals

Plain-chat safety evals can overstate how safe an agentic system actually is, since tool use measurably erodes refusal behaviour across every model tested. Teams building multimodal agents should benchmark safety with tools attached and consider re-inserting the original request before generation. The paper is on arXiv with a chat interface at academy.dair.ai for quicker exploration.

Event
elvis@omarsar011 sourcesSource
Oct 7
Oct 6