长对话场景（如客服、角色扮演）的开发者终于有了一个兼顾效率与保真度的压缩方案——C-DIC 能稳定处理数百轮对话，值得在长上下文任务中试试。
现有对话模型在长对话中因历史累积导致计算冗余和注意力分散，简单截断或摘要会损失信息。研究者提出 C-DIC（Context-Driven Incremental Compression），将对话拆分为可修订的上下文线程，存储紧凑的对话记忆，并通过轻量级检索-修订-回写机制跨轮共享信息、更新过时记忆。该方法还适配了截断反向传播（TBPTT）来学习跨轮依赖，无需完整历史反向传播。实验表明，C-DIC 在数百轮对话中保持稳定的推理延迟和困惑度，为高质量长对话建模提供了可扩展路径。
Context-Driven Incremental Compression for Multi-Turn Dialogue Generation
Modern conversational agents condition on an ever-growing dialogue history at each turn, incurring redundant attention and encoding costs that grow with conversation length. Naive truncation or summarization degrades fidelity, while existing context compressors lack cross-turn memory sharing or revision, causing information loss and compounding errors in long dialogues. We revisit the context compression under conversational dynamics and empirically present its fragility. To improve both efficiency and robustness, we introduce Context-Driven Incremental Compression (C-DIC), which treats a conversation as interleaved contextual threads and stores revisable per-thread compression states in a single, compact dialogue memory. At each turn, a lightweight retrieve, revise, and write-back loop shares information across turns and updates stale memories, stabilizing long-horizon behavior. In addition, we adapt truncated backpropagation-through-time (TBPTT) to our multi-turn setting, learning cross-turn dependencies without full-history backpropagation. Extensive experiments on long-form dialogue benchmarks demonstrate superior performance and efficiency of C-DIC; notably, C-DIC shows stable inference latency and perplexity over hundreds of dialogue turns, supporting a scalable path to high-quality dialogue modeling.