SAGE:自进化智能体的统计接受门
SAGE: A Statistical Acceptance Gate for Self-Evolving Agents
DeepSeek团队发布SAGE,解决智能体自我进化中的退化问题,在DeepSeek-V4上实现零退化率。
研究人员提出SAGE方法解决LLM智能体自我进化中的两个关键问题。该方法通过逐项对比评估当前技能与编辑后技能,暴露聚合分数隐藏的退化问题。SAGE采用单侧配对测试,仅在编辑收益统计可靠时才采纳,避免优化者诅咒。在五个基准测试和四个骨干模型上,SAGE将退化率从36.5%降至0%,LiveMath分数从34.15提升至48.78。
SAGE: A Statistical Acceptance Gate for Self-Evolving Agents
Large Language Model (LLM)-based agents increasingly self-evolve by editing a persistent skill document that encodes their workflow, tool-use rules, and decision logic. This loop has two steps, an optimizer that proposes a candidate edit and a gate that accepts or rejects it. Prior work has concentrated on the optimizer, while the gate still follows a naive rule that keeps any edit which improves an aggregate validation score. We show that this rule fails in two ways. First, it admits permanent regressions, since an edit can raise the average while breaking items the skill already solves. Second, it is vulnerable to the Optimizer's Curse, since the best observed score on a finite and noisy validation set is upward biased. To solve the above two limitations, we propose a statistical acceptance gate for self-evolving agents (SAGE). Compared with previous work, SAGE has two contributions. First, SAGE proposes a per-item paired comparison that evaluates the current skill and the edited skill on identical validation items, which exposes regressions that an aggregate score hides and penalizes them asymmetrically. Second, SAGE also employs a one-sided paired test that commits an edit only when its wins are statistically reliable against its losses, and it abstains otherwise. SAGE is a conservative refinement of the standard gate that recovers the baseline exactly at a boundary setting. It commits only a subset of the baseline's edits, filtering out those whose gains are unreliable or purchased by breaking already-solved items. Across five benchmarks and four backbone LLMs under an equal-budget protocol, SAGE lowers the regression rate in 19 of 20 settings and matches the baseline in the remaining one, for example from 36.5% to 0% on LiveMath and from 42.8% to 0% on OfficeQA with DeepSeek-V4. SAGE also attains the highest final score in all 20 settings, raising LiveMath from 34.15 to 48.78.