如果你在构建或研究持续学习智能体，这个基准测试直接挑战了当前记忆系统的有效性——简单ICL反而更好，值得所有AI研究者点开看看。
Continual Learning Bench 是一个新的基准测试，用于评估智能体是否真正从经验中学习。研究发现，在六个专家验证的领域内，简单的上下文学习（ICL）表现优于专门为记忆管理设计的系统。该基准引入了一个增益指标来隔离真正的学习效果，结果显示智能体经常过度拟合即时观察或未能跨实例复用知识。这表明许多记忆架构实际上增加了开销而非学习能力。
// Continual Learning Bench // One of the research areas with lots of investments is continual lear...
// Continual Learning Bench // One of the research areas with lots of investments is continual learning. While there are many efforts, there is very little progress in measuring it. So the big question is, do dedicated memory systems actually make agents learn from experience? Continual Learning Bench says not yet. Across six expert-validated domains with shared learnable structure, naive in-context learning outperforms systems purpose-built for memory management. CL-Bench introduces a gain metric that isolates genuine learning from prior capability, then shows agents frequently overfit to immediate observations or fail to reuse knowledge across instances. If a plain ICL baseline beats your memory architecture, the architecture is adding overhead rather than learning. Paper: arxiv.org/abs/2606.05661 Learn to build effective AI agents in our academy: academy.dair.ai 💬 10 🔄 8 ❤️ 72 👀 3933 📊 25 ⚡