做足式机器人运动控制或强化学习的团队,RoboNaldo 的课程学习思路能直接借鉴——用单条参考动作引导复杂技能学习,解决了从仿真到真实部署的精度和速度难题,值得点开看方法细节。
RoboNaldo 是一种三阶段运动引导课程强化学习框架,旨在解决人形机器人足球射门中的全身稳定性、高冲击力交互和精准度问题。它先用单一人踢参考动作学习稳定踢球先验,再适应固定球位置的任意球场景,最后扩展到移动球射门。在仿真中,RoboNaldo 的任意球射门误差比基线低 48.6%,射门速度提升 2.96 倍。在 Unitree G1 机器人上,从 3 米外射门平均误差为 0.73 米(任意球)和 0.86 米(移动球),触球后球速达 13.10 米/秒,达到职业球员射门速度的 59-71%。该工作为高动态人形机器人运动控制提供了新范式。
RoboNaldo: Accurate, Stable and Powerful Humanoid Soccer Shooting via Motion-Guided Curriculum Reinforcement Learning
Elite humanoid soccer shooting requires whole-body stability, high-impulse whole-body interactions, and accuracy to targets. Motion tracking-driven reinforcement learning (RL) provides stability in whole-body movement coordination, but a fixed reference makes it hard to adapt to varied ball positions and strike timings; in contrast, task reward-driven RL struggles to explore and discover valid kicks from scratch. We therefore introduce RoboNaldo, a three-stage motion-guided curriculum RL framework for high-impulse humanoid interaction. A single human-kick reference is used as a scaffold and progressively shifts optimization towards shooting performance. The curriculum first learns a stable whole-body kicking prior, then adapts the kick to free-kick settings where the ball is stationary at random positions, and finally extends it to moving-ball shooting through a locomotion-command and kick-trigger interface. A high-level heuristic planner controls this interface during training, while alternative high-level controllers can drive the same low-level policy at inference. In simulation, RoboNaldo demonstrates free-kick shot error 48.6% lower and shoot velocity 2.96x than prior work baselines. In real world on a Unitree G1 with onboard perception, RoboNaldo attains 0.73 m and 0.86 m average target shooting error from 3 m away in free-kick and moving-ball cases, accordingly. And the post-contact ball velocity reaches 13.10 m/s, which is 59-71% of reported professional open-play shot speed. Project page: $\href{https://opendrivelab.com/RoboNaldo}{\text{opendrivelab.com/RoboNaldo}}$.