Growing Harness:把重复控制逻辑从模型上下文挪进代码
Grow the Harness, Not the Context: From Strategy-Free Scaffolds to Reusable Specialist Agents
这篇论文教你让 harness 自己从失败里长出控制代码,省掉七到九成 LLM 调用,4B 小模型也能跑 WebArena,做 agent 工程的值得细看。
arXiv 论文提出 Growing Harness,一种由失败反馈驱动的训练范式,从无策略脚手架出发自动学习 agent harness 本身。它通过函数级执行轨迹定位失败、联合修复一批失败,并用 success-first 留出集回滚损害原有能力的改动。在 BrowseComp-Plus 和 WebArena-Verified 上配合 4B 到 120B 三种模型,六组基准-模型配置中五组取得最高平均成功率。相比 Tool-Calling agent,LLM 调用减少 76.0-91.8%,推理成本降低 74.4-98.6%;4B 模型下 WebArena-Verified 成功率保持 44.7-45.3%,而 Tool-Calling 降至 6.7%。
Grow the Harness, Not the Context: From Strategy-Free Scaffolds to Reusable Specialist Agents
Large language model (LLM) agents often handle streams of related tasks, yet standard harnesses repeatedly ask the model to reconstruct the same control decisions inside each task's context. We study whether task feedback can instead turn recurring control into reusable executable code, while reserving LLM calls for task-specific semantic reasoning. We introduce Growing Harness, a failure-guided training paradigm that learns the agent harness itself from a strategy-free scaffold that exposes fixed model and tool interfaces but encodes no task-solving controller. Function-level execution traces localize each failure to a bounded code surface, an optimizer repairs a window of failures jointly, and a success-first held-out gate rolls back repair sequences that harm prior capability. Accepted edits accumulate in one shared harness, allowing its control structure to emerge from task feedback. Across BrowseComp-Plus and WebArena-Verified with three deployment models from 4B to 120B parameters, Growing Harness achieves the highest mean success in five of six benchmark-model settings and trails the best mean by 0.7 pp. in the sixth. Relative to a Tool-Calling agent, it reduces LLM calls by 76.0-91.8% and deployed-agent inference cost by 74.4-98.6%. On WebArena-Verified, its success remains 44.7-45.3% across model scales, whereas Tool-Calling falls to 6.7% with the 4B model. Ablations show that trace-local edits, joint repair, and gate-based rollback each improve final success. These results show that persistent program growth can move recurring control out of model context and into low-cost code, yielding reusable specialist agents that remain effective with smaller deployment models.
- elvis09-21 23:00原文