SkillAdam:智能体技能稳定高效进化框架
SkillAdam: Stable and Efficient Skill Evolution for Agents
SkillAdam让AI智能体技能进化更稳定高效,比现有方法少花很多迭代次数就能获得更强技能。
SkillAdam是一种受Adam算法启发的智能体技能优化框架,解决了技能自进化中的方向稳定性和更新适应性问题。该框架在七个短长期任务基准测试中实现了最先进性能,比现有方法显著减少优化迭代次数和成本。SkillAdam通过优化记忆记录问题解决历史,以及波动驱动的编辑预算控制更新幅度,实现了更稳定的优化动态。
SkillAdam: Stable and Efficient Skill Evolution for Agents
Agent skills provide a lightweight way to equip frozen language-model agents with domain knowledge and procedural guidance, yet obtaining high-quality skills remains costly and difficult to scale. Expert-written skills require substantial human effort. Recent skill self-evolution methods automate an iterative loop that uses execution feedback to revise skills, but their heuristic update strategies often yield unstable optimization and low iteration efficiency. We identify two challenges in realizing stable and efficient skill self-evolution. Direction Stability requires effective corrections to accumulate rather than be overwritten by iteration-local feedback. Update Adaptivity requires the scope of each revision to reflect the consistency of recent case-level improvements. We introduce SkillAdam, an Adam-inspired framework for optimizing discrete and non-differentiable skill documents. As a functional analogue of Adam's first moment, an optimization memory records identified problems and the outcomes of prior solution attempts to stabilize the update direction. As a functional analogue of Adam's second moment, a volatility-driven edit budget tracks the history-weighted variation of recent case-level improvements and adaptively controls the update magnitude. Across seven benchmarks that span short- and long-horizon tasks, SkillAdam achieves state-of-the-art performance with more stable optimization dynamics. It also obtains stronger skills with substantially fewer optimization iterations and lower cost than prior methods. Code repository: https://github.com/ruc-datalab/SkillAdam