RAVEL:基于在线强化学习的交互式行人重识别提问策略
What Should We Ask Next? Retrieval-Aware Question Learning under Partial Evidence
想让模型学会'下一步该问什么'?这篇论文把提问当成强化学习问题,用检索排序反馈训练,五轮交互持续涨点。
论文提出 RAVEL,一个面向交互式行人重识别的在线强化学习框架,解决部分证据下'下一步该问什么'的问题。RAVEL 从监督式问题生成初始化,直接观察当前 Top-4 候选,并用完整问答-检索回路的排序反馈优化提问策略。在 Interactive-PEDES 基准上,RAVEL 在五轮交互中逐步提升检索性能。分析显示 RAVEL 把提问预算重新分配到局部开放属性类问题上,这类问题能提供更有用的检索证据,在初始困难查询上收益最大。
What Should We Ask Next? Retrieval-Aware Question Learning under Partial Evidence
Interactive retrieval under partial evidence is a sequential information-acquisition problem: an agent must decide which question will create the most useful evidence for the next retrieval update. Existing systems train this decision by imitating an offline ordering of candidate QA pairs, although question value is determined by the response it elicits and its downstream effect on retrieval. We establish that candidate discriminativeness and perceived usefulness provide weak supervision for this objective, then introduce RAVEL, a retrieval-aware online reinforcement learning framework for interactive person re-identification. RAVEL initializes from supervised question generation, observes the current Top-4 candidates directly, and optimizes the question policy with rank feedback from the full question-answer-retrieval loop. Experiments on Interactive-PEDES show that RAVEL delivers progressively stronger retrieval performance across five interaction rounds. Further analysis shows that RAVEL reallocates the questioning budget toward localized open-ended attributes, which provide more useful retrieval evidence and yield the largest gains on initially difficult queries.