论文78°

TrojanWorld:通过想象操控攻击世界模型智能体

TrojanWorld: Backdooring World-Model Agents via Imagination Steering

精选理由

TrojanWorld通过物理对象触发,能悄无声息地控制AI智能体的决策,威胁世界模型安全。

研究人员提出TrojanWorld框架,通过物理对象作为触发器,操控世界模型智能体的内部想象过程。该框架在TD-MPC2、DreamerV3和R2-Dreamer系统上测试,在DeepMind Control、MetaWorld等基准中,触发激活时目标动作偏差低至0.026,同时保持98.8%的原始性能。即使移除触发器,被攻击的智能体仍可能继续执行攻击者指定的动作。

原文 · arXiv: Google DeepMind

TrojanWorld: Backdooring World-Model Agents via Imagination Steering

World models increasingly serve as the predictive core of model-based reinforcement learning agents, enabling them to simulate future dynamics and reason over imagined trajectories before acting. Their substantial training demands make pretrained world models attractive for distribution and reuse, exposing downstream systems to model supply chain threats. Backdoor attacks offer a targeted and stealthy means of exploiting such supply chains, yet their threat to interactive world-model agents remains largely unexplored. To fill this gap, we present TrojanWorld, a backdoor framework for world-model agents that induces attacker-specified behavior by steering internal imagination. A physical object placed in the scene acts as the trigger, enabling deployment-time activation through the agent's native observation pipeline without digitally manipulating the observation stream. To achieve effective, stealthy, and persistent control, TrojanWorld combines Decision-Reflective Induction to steer trigger-conditioned imagination toward attacker-specified actions using decision feedback, Clean Behavior Anchoring to preserve trigger-free predictive and behavioral fidelity, and Causal Propagation to sustain the induced preference along subsequent trajectories after the trigger disappears. Together, these mechanisms establish an end-to-end attack chain from physical perception through corrupted imagination to malicious action selection. Experiments with the TD-MPC2, DreamerV3, and R2-Dreamer systems across the DeepMind Control, MetaWorld, MyoSuite, and RoboDesk benchmarks show that under trigger activation, TrojanWorld achieves a target-action deviation as low as 0.026 while retaining at least 98.8% of the corresponding clean performance. Even after trigger removal, the compromised agent can remain trapped in the induced behavioral trajectory, continuing to execute attacker-specified actions.