论文精选

ReCoVLA:VLM引导奖励编译,提升VLA策略故障恢复能力

ReCoVLA: VLM-Guided Reward Compilation for Failure Recovery in Vision-Language-Action Policies

精选理由

做机器人操作策略的团队终于有了一个不重新训练就能处理故障的方案——ReCoVLA 用 VLM 做奖励选择器,零样本迁移到真实环境。做 VLA 策略部署的开发者可以直接参考这个框架。

AI 摘要

ReCoVLA 提出一种故障条件残差恢复框架,保持预训练 VLA 策略冻结,利用外部 VLM 推断故障模式和恢复阶段,并编译结构化奖励。该方法将高层故障理解与低层控制解耦,支持不同 VLA 策略。在短程、长程和接触密集操作任务中,ReCoVLA 平均成功率从基线 36.7% 提升至 66.7%,物理零样本迁移实验达 61.7%。

原文 · arXiv cs.AI

ReCoVLA: VLM-Guided Reward Compilation for Failure Recovery in Vision-Language-Action Policies

Vision-language-action (VLA) policies provide strong priors for language-conditioned manipulation, but remain brittle in off-nominal states requiring targeted recovery. We propose ReCoVLA -- a failure-conditioned residual recovery framework that keeps a pretrained VLA policy frozen, uses an external vision-language model (VLM) to infer the failure mode and recovery stage, and compiles a structured reward from task-relevant components. Rather than using the VLM to generate actions or rewards directly, ReCoVLA uses it as a semantic reward selector: it predicts a recovery descriptor and reward mask for in-simulation residual-policy training, followed by zero-shot sim-to-real deployment of the trained recovery policies. This decouples high-level failure understanding from low-level corrective control to support different VLAs. Experiments across short-horizon, long-horizon, and contact-rich manipulation tasks show that ReCoVLA outperforms the tested baselines on average. In simulation, our reward compiler improves average success from 36.7% for the fine-tuned $π_{0.5}$ baseline to 66.7%. In physical zero-shot sim-to-real experiments, ReCoVLA achieves the best average performance, with 61.7% success.