Hugging Face and partners launch RoboColosseum open robot eval initiative
Evaluating robot models in the real world is hard, but solvable. That's why we're a founding partner...
Real-world robot evaluation has lacked shared standards, and publishing failed rollouts alongside successes gives the field a reproducible benchmark rather than cherry-picked demos. Labs and hobbyists can apply for free eval hours to test policies on heterogeneous hardware. eaic_sg's involvement ties the initiative to the Singapore robotics ecosystem.
Hugging Face announced it is a founding partner of RoboColosseum, an open initiative for evaluating robot models in real-world conditions. The programme provides access to 100+ real robots, including Unitree G1s, LeRobot SO-101s, YAMs and Franka arms, across 140+ in-the-wild scenes. Every rollout, including failures, is published as open data on the Hugging Face Hub. Participants receive 10,000 free evaluation hours, and founding partners include BitRobot Network and eaic_sg.
Evaluating robot models in the real world is hard, but solvable. That's why we're a founding partner...
Evaluating robot models in the real world is hard, but solvable. That's why we're a founding partner of RoboColosseum 🤗 100+ real robots, 140+ in-the-wild scenes, and every rollout, failures included, open on the Hub. RoboColosseum @RoboColosseum Introducing RoboColosseum An open robot eval initiative by @huggingface @BitRobotNetwork @eaic_sg @DJiafei Access: - 100+ robots ( @UnitreeRobotics G1s, @LeRobotHF SO-101s, YAMs, Franka and more) - 140+ in-the-wild scenes - Open rollout data - 10,000 FREE eval hrs Thread ↓ Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 20 🔄 9 ❤️ 37 👀 5198 📊 19 ⚡
