AD-WM:面向反事实模型预测控制的动作判别世界模型
AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control
这篇论文解决了世界模型做规划时的一个实际问题:预测准不等于会选动作。AD-WM 在 OGBench-Cube 上把成功率从 3.7% 拉到 52.0%,实机迁移也有提升,做机器人规划的可以看看。
论文提出 AD-WM,一种动作判别的联合嵌入世界模型,用于反事实 MPC 规划。方法结合残差潜动态与预测器级动作恢复正则化,借助逆动力学和基于条件互信息的归一化恢复目标,让规划转移保留动作信息。在 OGBench-Cube 上,AD-WM 将困难起点成功率从 3.7% 提升到 52.0%,并在五个仿真环境中的四个超过复现基线 LeWM。使用冻结的 V-JEPA 2 编码器和匹配的 DROID 后训练,AD-WM 在 Franka 实机零样本迁移上将基础抓放成功率从 42.2% 提升到 71.1%,无需实验室特定适配。
AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control
Latent world models are typically trained to predict factual transitions, whereas model predictive control (MPC) must compare alternative actions from the same state. A model can therefore achieve low factual prediction error yet poorly distinguish candidate actions. We introduce AD-WM, an action-discriminative joint-embedding world model for counterfactual MPC. AD-WM combines residual latent dynamics with predictor-level action-recovery regularization, using inverse dynamics and a normalized recovery objective motivated by conditional mutual information. Both objectives encourage planning transitions to preserve action information; their auxiliary heads are discarded at test time, leaving MPC unchanged. On OGBench-Cube, AD-WM improves hard-start success from 3.7% to 52.0% over a matched LeWM baseline and improves mean success over the reproduced baseline in four of five simulation environments. Planning diagnostics show that factual prediction error and whole-bank action ranking do not follow the closed-loop success ordering, whereas CEM-aligned elite regret tracks success more closely. With a frozen V-JEPA 2 encoder and matched DROID post-training, AD-WM also improves zero-shot transfer to our Franka setup, increasing basic pick-and-place success from 42.2% to 71.1% without lab-specific adaptation. These results suggest that world models for planning should preserve action-dependent differences needed for counterfactual selection, rather than optimize factual prediction accuracy alone. More videos and code are available at https://ad-wm.github.io/.