想让你家 32B 模型在长任务上干翻 Claude 和 Gemini?试试 AutoMem——不动任务行为,只优化记忆管理,效果翻倍。
AutoMem 框架将 LLM 的记忆管理视为可训练技能,通过两轮优化自动改进。第一轮由强 LLM 审查完整轨迹并迭代修改记忆结构(提示、文件模式、动作词汇)。第二轮从多个回合中识别出好的记忆决策,作为训练信号直接提升模型记忆熟练度。在三个程序化生成的长周期游戏(Crafter、MiniHack、NetHack)中,仅优化记忆(不修改任务动作行为)使基础 32B 开放权重模型性能提升约 2-4 倍,达到与 Claude Opus 4.5 和 Gemini 3.1 Pro Thinking 等前沿系统竞争的水平。
AutoMem: Automated Learning of Memory as a Cognitive Skill
Memory expertise is a learned skill: knowing what to encode, when to retrieve, and how to organize knowledge--a capacity known in cognitive science as metamemory. We bring this perspective to LLMs by treating memory management as a trainable skill. We promote file-system operations to first-class memory actions alongside task actions, letting the model itself decide how to manage its memory. This memory skill improves along two axes: the structure that supports it (prompts, file schemas, action vocabulary), and the proficiency of the model exercising it. Both axes resist manual optimization: episodes in long-horizon tasks run for thousands of steps, and a single memory mistake can hide long before it surfaces, making human review of full trajectories impractical. We introduce AutoMem, a framework that automates both axes. In the first loop, a strong LLM reviews complete agent trajectories and iteratively revises the memory structure that shapes how the agent interacts with its memory files. In the second loop, the agent's own good memory decisions are identified from many episodes and used as training signal to sharpen the model's memory proficiency directly. Across three procedurally generated long-horizon games (Crafter, MiniHack, and NetHack), optimizing memory alone--without modifying the model's task-action behavior--improved the base agent's performance ~2x-4x, bringing a 32B open-weight model competitive with frontier systems such as Claude Opus 4.5 and Gemini 3.1 Pro Thinking. Our results show that memory management is an independently learnable skill, and a high-leverage objective yielding large gains on long-horizon tasks.
- elvis07-02 16:19原文