Amazon research shows weight memory beats retrieval for agent recall
The practical implication is a hybrid memory design: keep a text store for recent and never-recorded facts, and distill stable user knowledge into model weights. Weight memory alone forgets older facts and cannot flag gaps, so the router matters. Engineers building personalised agents can test this against MemOS-style retrieval pipelines. The paper is available on arXiv (2611.05636) with a Chat with Paper interface from dair.ai.
Amazon researchers compared weight memory against retrieval for storing user facts in agent models. Plain fine-tuning stores user facts at 36.9% accuracy, while on-policy self-distillation reaches 59.9%. On eight HaluMem-Long users, the distilled model answers with no retrieved context and beats MemOS-style retrieval (47.8%), extracted context (51.9%) and raw dialogue (51.3%). The result holds across 4B, 9B and 27B model sizes. A verify-then-regenerate router that checks answers against the text store adds 6.2 points.
Weight memory vs. retrieval in agents. Brilliant work from Amazon. This work shows weight memory can outperform text memory on recall of user facts. But the best part is that you can leverage both. Using the same model and user data, this work shows that plain fine-tuning stores user facts in weights at 36.9% accuracy, while on-policy self-distillation reaches 59.9%. That second number also beats retrieval. On eight HaluMem-Long users, the distilled model answers with no retrieved context and beats MemOS-style retrieval (47.8%), extracted context (51.9%), and the raw dialogue (51.3%). The gain holds for every user and at 4B, 9B, and 27B. How it works: a teacher, which is the same model reading the user's memory, trains a student that has to answer without it. Weight memory has clear limits. It forgets older facts and cannot tell when something was never recorded. A verify-then-regenerate router checks each answer against the text store and adds 6.2 points. The recommendation is to keep a text store for recent and missing facts, and move stable user knowledge into weights. arxiv.org/abs/2611.05636 Chat with Paper: academy.dair.ai/papers/route-t… 💬 0 🔄 0 ❤️ 0 ⚡
