对话系统从反应式走向主动式的关键一步,做对话 AI 或智能客服的团队值得关注,OnePred 的递归记忆思路可以直接参考或复现。
当前大语言模型对话系统本质上是反应式的,只能在用户输入后响应。OnePred 提出通过递归更新的意图记忆来预测用户下一轮查询,无需重读完整对话历史。该方法采用两阶段强化学习训练,先教模型预测什么,再教如何压缩,形成面向预测的意图链。作者还发布了 NQP-Bench 基准测试集,包含三个子集。实验显示,OnePred 将每轮 token 消耗降低最多 22 倍,同时预测质量优于所有基线,在长对话中优势更明显。
OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversations
Although large language model (LLM) conversational systems process millions of multi-turn dialogues daily, they remain fundamentally reactive: they respond only after the user types a query. A key step toward proactive interaction is next-query prediction, which anticipates the user's subsequent query based solely on the preceding dialogue. Progress on this task is hindered by the lack of dedicated benchmarks and a fundamental efficiency--quality trade-off: naively concatenating full dialogue history incurs linearly growing token consumption, while truncating to the latest turn discards crucial cross-turn context. Our key insight is that accurate prediction does not require re-reading raw history; it suffices to track the user's evolving intent trajectory across topics, unresolved needs, and interest shifts. We propose OnePred, which maintains a recursively updated memory as its sole cross-turn context, bounding the per-turn cost independently of conversation length. We train the model via a two-stage reinforcement learning pipeline that first teaches what to predict, then what to compress, shaping the memory into a prediction-oriented intent chain. To establish a rigorous testbed, we introduce NQP-Bench, spanning three diverse subsets. Experiments demonstrate that OnePred reduces per-turn token consumption by up to 22$\times$ compared to full-history inputs while consistently exceeding all baselines in prediction quality, with larger gains on longer conversations. Our code is publicly available at https://github.com/ZBWpro/OnePred.