论文76°

多智能体强化学习实现超人类安全竞速,无人机时速超22米

Superhuman Safe and Agile Racing through Multi-Agent Reinforcement Learning

精选理由

这项研究证明了多智能体强化学习在物理世界交互中的安全优势,做无人机、自动驾驶或机器人协作的团队值得关注——它用竞速场景给出了一个可复现的范式。

AI 摘要

苏黎世大学团队通过多智能体强化学习(MARL)训练高速四旋翼无人机竞速,在超过22米/秒的速度下,不仅击败了人类冠军飞行员,还将碰撞率比最先进的单智能体基线降低了50%。该研究以联赛式自对弈训练智能体学会主动避让、超车和处理复杂气动干扰,并实现了对人类的零样本安全泛化。结果表明,多智能体交互的严苛训练比孤立的安全约束更能实现鲁棒的机器人共存。

原文 · arXiv cs.AI

Superhuman Safe and Agile Racing through Multi-Agent Reinforcement Learning

Autonomous systems have achieved superhuman performance in isolation or simulation, yet they remain brittle in shared, dynamic real-world spaces. This failure stems from the dominant single-agent paradigm for physical applications, where other actors are ignored or treated as environmental noise, preventing effective coordination. Here we show that multi-agent reinforcement learning provides the essential safety scaffolding required for real-world interaction. Using high-speed quadrotor racing as a high-stakes testbed, we train agents to navigate complex aerodynamic interactions and strategic maneuvering with a variable number of racers. Through league-based self-play, agents evolve sophisticated anticipatory behaviors, including proactive collision avoidance, overtaking, and handling multi-agent physical interactions, including aerodynamic downwash. Our agents outperform a champion-level human pilot in multi-player races at speeds exceeding 22 m/s, while simultaneously reducing collision rates by 50 % compared to state-of-the-art single-agent baselines. Crucially, training with diverse artificial agents enables zero-shot generalization to safer human interaction. These results suggest that the path to robust robotic co-existence lies not in isolated safety constraints, but in the rigorous demands of multi-agent interaction. Multimedia materials are available at: https://rpg.ifi.uzh.ch/marl