论文

CoEM:基于证据提交的长上下文推理方法

CoEM: Empowering Long-Context Reasoning with Commit-on-Evidence Memory

精选理由

CoEM解决了长上下文推理中信息过早压缩的问题,通过智能管理记忆空间,显著提升了模型处理长文档的能力。

CoEM是一种新的长上下文推理方法,通过学习何时将源证据转换为压缩记忆事实。该方法在固定上下文-记忆预算下,保留可能有用的源摘录在待定集中,允许后续上下文明确其相关性后再进行不可逆压缩。实验显示,在6,400文档的长上下文输入评估中,CoEM在Qwen3.5-9B模型上比最强基线方法提升10.4-11.4 F1点。

原文 · arXiv cs.AI

CoEM: Empowering Long-Context Reasoning with Commit-on-Evidence Memory

Long-context reasoning is essential for complex and long-horizon tasks, yet the performance of large language models (LLMs) degrades as context length increases. Recent approaches address this by processing input chunk by chunk while maintaining a bounded textual memory in model context. However, premature information compression can discard critical details essential for subsequent reasoning. In this paper, we introduce Commit-on-Evidence Memory (CoEM), which learns when to convert source evidence into compact memory facts. Specifically, under a fixed context-memory budget, CoEM preserves potentially useful source excerpts verbatim in a pending set, allowing subsequent context to clarify their relevance before irreversible compression. As new context arrives, a learned policy revisits each pending excerpt and decides whether to promote it to the committed memory, retain it for further consideration, or discard it. A frozen verifier ensures proposed facts are accepted only if supported by retained excerpts and current context. To further guide effective memory management, we train this policy using reinforcement learning by combining fine-grained, step-level evidence rewards with final answer rewards. Extensive experiments demonstrate that CoEM consistently improves long-context reasoning. When evaluated on 6,400 documents long-context input, CoEM outperforms the strongest memory baseline by 10.4-11.4 F1 points on Qwen3.5-9B. Code repository: https://github.com/benmagnifico/CoEM.

  • Artificial Analysis09-30 03:10原文