论文

Rep2Skill:基于表征的智能体技能自我进化框架

Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents

精选理由

Rep2Skill让LLM智能体通过分析自身内部表征来进化技能,比传统文本方法更有效。

Rep2Skill是一种新型框架,通过分析LLM智能体的内部表征轨迹来优化技能。该框架在两个智能体环境和两个开源LLM上的实验表明,它能准确定位偏离成功执行模式的回合,并将这些信号与执行上下文结合为可操作的文本反馈。相比仅依赖文本的方法,Rep2Skill在自我进化场景中表现更优,无需更强外部模型即可实现技能提升。

原文 · arXiv cs.AI

Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents

Textual skills enable large language model (LLM) based agents to accumulate reusable procedural knowledge without updating model parameters. Yet existing skill evolution remains largely confined to the text space: an optimizer must diagnose success and failure patterns, and revise skills solely from long execution trajectories and sparse task outcomes. This text-only paradigm leaves the agent's internal representations, which contain rich records of its evolving execution state, outside the skill optimization loop. We ask whether an agent can improve its external textual skills by reflecting on its own internal representations. We introduce Rep2Skill, a representation-guided framework for self-evolution on agent skills. Specifically, upon the collected agent rollouts, Rep2Skill models their internal model representation trajectories to localize turns that deviate from successful execution dynamics, and it further interprets these signals alongside the execution contexts as actionable textual feedback for targeted skill revision. Experiments on two agent environments with two open-source LLMs show that Rep2Skill consistently outperforms text-only approaches in the self-evolution setting, where the same LLM serves as both executor and optimizer without a stronger external model. This establishes a promising direction moving agent self-improvement beyond text-only reflection.