论文精选73°

机器人盲抓研究:触觉与本体感觉比视觉更关键

精选理由

机器人总在抓东西时翻车?这篇研究说瓶颈可能不是视觉,是触觉。摄像头定位加盲手反射的思路挺有意思。

该研究提出"see to reach, feel to grasp"方案:相机/VLM/追踪器先把手掌引导到目标附近,随后不依赖视觉的盲手反射完成抓握,再反馈"已抓住"让机械臂继续任务。方法在多样化物体上实现了稳健的盲抓取,且全程不观测接触几何。作者据此提出机器人抓取的瓶颈可能不在视觉,而在本体感觉与触觉。

原文 · Aran Komatsuzaki (论文推介)

If you think about it, blind people can still do majority of tasks where robots fail. Maybe the bottleneck isn't really vision but proprioception (+ some more like tactile).

They tried "see to reach, feel to grasp approach" i.e. camera / VLM / tracker → “put my palm around here” → blind hand reflex → “yes, I've got it” → arm continues task.

Achieved robust blind grasping across diverse objects, while never observing contact geometry