做机器人安全控制的团队终于有了一个轻量级方案——VLA模型自带的注意力头就能当安全过滤器用,无需额外训练或重模型,动态场景效果还更好,值得点开看实现细节。
VLA模型在机器人操作任务中表现出色,但无法保证避免与任务无关物体的碰撞。现有安全过滤器通过查询VLM来识别障碍物,但速度太慢,无法在控制循环中实时运行。研究发现,VLA模型中的少数注意力头能可靠定位策略意图接近的目标物体。利用这些注意力头,可以在无需训练的情况下,每步获取活动目标,将场景其余部分视为障碍物,并输入控制障碍函数过滤器。结合轻量级实时目标跟踪器,该方法能有效避免非静态障碍物的碰撞,在动态场景中比使用模拟器特权状态的Oracle方法平均提升43%。
Your Model Already Knows: Attention-Guided Safety Filter for Vision-Language-Action Models
Vision-Language-Action (VLA) models have demonstrated impressive end-to-end performance across a variety of robotic manipulation tasks. However, these policies offer no guarantees against collisions with task-irrelevant objects in the scene. Existing safety filters sidestep this problem by querying a vision-language model (VLM) to identify obstacles and their locations. This, however, is too slow to run in the control loop and can only be invoked at episode initialization, leaving the filter unable to track moving obstacles. We discover that a small number of attention heads within a VLA model reliably localize the object the policy intends to approach. These heads can be exploited within a training-free safety framework that obtains the active target from the attention heads at every step, treats the remainder of the scene as obstacles, and feeds these into a Control Barrier Function (CBF) filter. Together with a lightweight real-time object tracker, this allows for collision avoidance for non-static obstacles. We evaluate our framework on SafeLIBERO, which we extend with moving obstacles. On the original static benchmark, our method performs comparably to an oracle that uses privileged simulator state to identify the target, emulating a VLM-based identification step run once at episode initialization. On the dynamic variant, where the oracle's init-time target assignment becomes stale, our method substantially outperforms it by 43%, on average. Our findings suggest that the perceptual signals needed for real-time safety filtering are already present within VLA policies and can be exploited without additional training or heavy auxiliary models.