Verify–Backtrack Loop:让 ReAct 智能体具备结构化回溯能力
Verify--Backtrack Loop: Structured Precondition Recovery for Long-Horizon Language Agents
给 ReAct 加了个目标栈和回溯机制,不用训练,AppWorld 成功率最高多 22 个百分点,GPT-4o、DeepSeek-V3.2 都测过。
arXiv 论文提出 Verify–Backtrack Loop(VBL),一个无需训练的 ReAct 扩展,用有界目标栈维护任务分解,并在目标激活或执行失败时做双视野验证与类型化失败归因,触发 Push、Pop、retry 或 BacktrackTo 操作。作者用 Qwen3.5-9B、GPT-4o 和 DeepSeek-V3.2 三个模型,在 AppWorld、ALFWorld、ScienceWorld 三个基准上评估。VBL 在所有模型-基准组合上都超过 ReAct 和反思式方法,在 AppWorld 上任务成功率最高比 ReAct 提升 22.07 个百分点。消融实验显示去掉验证或诊断任一环节,部分场景表现会低于 ReAct,说明两者互补。
Verify--Backtrack Loop: Structured Precondition Recovery for Long-Horizon Language Agents
Language agents increasingly tackle long-horizon tasks in interactive environments, where actions often depend on latent preconditions. The core difficulty is not trajectory length but recovery: when a prerequisite is missing or an earlier decomposition fails, trying another plausible action rarely helps. ReAct and later reflection or adaptive-planning methods support local correction, but express recovery as free-form text, with no explicit control state linking the terminal goal, the active goal, and the failure source. We introduce the Verify--Backtrack Loop (VBL), a training-free extension of ReAct that turns precondition discovery and failure diagnosis into structured planning-state updates. VBL maintains the task decomposition as a bounded goal stack and, on goal activation, execution failure, or material state change, jointly verifies two horizons---whether the active goal contributes to the terminal goal and whether it is feasible in the current state. These dual-horizon judgments, combined with typed failure attribution, trigger explicit operations---Push, Pop, retry, or BacktrackTo the parent. We evaluate VBL with Qwen3.5-9B, GPT-4o, and DeepSeek-V3.2 on AppWorld, ALFWorld, and ScienceWorld. VBL improves over ReAct and reflection-based control on every backbone--benchmark pair. On the challenging AppWorld setting, it improves task success by up to 22.07 percentage points over ReAct. Ablations show that removing either verification or diagnosis degrades performance, in several settings below ReAct, confirming that the two mechanisms are complementary. These results show that reliable long-horizon interaction benefits from revising the planning state, not merely the next action.