Papers

FLORE框架让人形机器人学会感知并控制接触力

Learning Force-Reactive Humanoid Loco-Manipulation

Why we picked it

伯克利这边搞了个 FLORE 框架,人形机器人能边走边用手感知力,比如开门拧把手,成功率从 26.7% 拉到 80%。

FLORE 是一个人形机器人 loco-manipulation 学习框架,用两把 UMI 式力传感手持夹爪和可穿戴追踪器免机器人采集演示数据。其力反应扩散策略以视觉、本体感知和实测 wrench 为输入,输出动作与每只手的力指令。混合柔顺全身控制器结合真实 F/T 传感器积分力误差,实现指定方向的精确力跟踪。仿真中控制器能跟踪不同大小与方向的每手力指令,全身运动精度几乎无损。真机上三个接触密集任务中,力反应策略成功率达 80%,同条件下仅用位置控制的策略为 26.7%。

Original · arXiv cs.LG

Learning Force-Reactive Humanoid Loco-Manipulation

Many everyday tasks require controlling contact force as well as motion. On a humanoid, this force must often be coordinated across both hands and the whole body, and cannot be specified by kinematic trajectories alone. Therefore, we present FLORE, a framework for learning force-reactive humanoid loco-manipulation. We collect robot-free demonstrations using two force-sensing UMI-style handheld grippers for hand motion and contact wrenches, and wearable trackers for body motion. A force-reactive diffusion policy takes vision, proprioception, and measured wrenches as input, then predicts actions and per-hand force commands. A hybrid compliance whole-body controller with force tracking executes these commands while maintaining balance: an integral of the force error measured by real force/torque (F/T) sensors lets each hand track force accurately along the commanded direction and remain compliant along the others. In simulation, the controller tracks per-hand force commands of varied magnitude and direction, with little loss in whole-body motion accuracy. Across three contact-rich tasks on the robot, the force-reactive policy succeeds in 80% of rollouts, compared with 26.7% for a position-only policy trained on the same demonstrations and executed by the same controller. For more details, please visit our website: https://louis-leee.github.io/FLoRe/.