LEAP 手零样本迁移训练方案:让灵巧手安全完成任意姿态抓取
Pushing Dexterity and Safety for In-Hand Object Pose Reaching That Works Remarkably Well
伯克利团队用纯仿真训练 LEAP 手做任意姿态抓取,4800 个目标 95% 成功,安全过滤器还能减少 75% 掉落,方案全开源。
这项研究针对多指灵巧手的 in-hand object pose reaching 任务,即用手指把物体移动到任意位置与姿态。训练方案完全在仿真中完成,不依赖人类数据,涵盖生成抓取数据集、自适应摩擦课程等方法,配合系统辨识实现零样本迁移到真实 LEAP 手。在 13.3 小时真机评估中,策略对 4 个物体共 4,800 个未见目标达到 95.2% 的成功率(2 cm、0.4 rad 容差)。附加的残差安全过滤器可调节保守程度,将掉落减少 75%,成功率仍保持 91.5%。仅靠一个腕戴深度相机即可运行,论文开源了完整训练方案。
Pushing Dexterity and Safety for In-Hand Object Pose Reaching That Works Remarkably Well
Dexterous manipulation with multi-fingered hands is the next frontier of robotics, yet learned hand skills remain limited to simple grasps or basic repeated motions, such as rotating an object. As robots attempt more demanding in-hand maneuvers, safety, such as not dropping the object, becomes critical, yet it is rarely measured. We study in-hand object pose reaching, a task that demands diverse and difficult grasps: moving an object to almost any position and orientation within reach of the fingers, at any wrist orientation, through long sequences of consecutive goals. We present a recipe for training such policies for a LEAP hand in simulation without human data, built on a range of insights, from diverse resets and goals via generated grasp datasets to an adaptive friction curriculum. With careful system identification, the policies transfer zero-shot to the real hand, using either motion capture or a single wrist-mounted depth camera, and prove remarkably capable and robust. On top of the task policy, we add a learned residual safety filter with adjustable conservativeness, letting us tune the balance between performance and safety and greatly reduce object drops. In 13.3 hours of real-robot evaluation over 4,800 unseen goals across 4 objects and diverse wrist orientations, the state-based policy reaches 95.2% of goals within 2 cm and 0.4 rad, and the filter cuts its drops by 75% while still reaching 91.5% of goals. The policies can also spin a lightbulb held in an arbitrary pose, reach out-of-distribution goals, withstand fast arm motion and perturbations, and, needing only a wrist camera, serve as portable skills such as screwing in a lightbulb. We release the full recipe as a platform for studying performance, reliability, and safety in high-dimensional dexterous systems. Videos and more are available at https://ian-chuang.github.io/dexsafe/.