ORCA: 开源灵巧手操作研究平台

ORCA: A Platform for Open-Source Dexterity Research

精选理由

灵巧手研究的统一开源平台

AI 摘要

两指平行夹爪在简单重定向任务中常需双臂操作,拟人灵巧手更接近人手但难以用于学习研究。ORCA 学习栈统一了低级控制、仿真、VR 头显等消费级平台的远程操作和手部重定向,并与 Lerobot 框架原生集成。研究团队通过 VR 头显收集手内重定向任务专家演示,训练自主策略并评估了结果。整个栈已开源,可作为可复现灵巧操作研究的基础。

原文 · arXiv cs.LG

ORCA: A Platform for Open-Source Dexterity Research

Robotics manipulation research increasingly focuses on two-finger parallel grippers for their effectiveness, affordability, and ease of teleoperation. Grippers are nonetheless limited by their form factor, often requiring bimanual setups even for simple reorientation tasks. Anthropomorphic hands are a more natural platform for dexterous robot learning -- closer to the human hand, and capable of learning from human video -- yet they remain hard to use in learning research: even where open and accessible hand hardware exists, the software for control, simulation, teleoperation, and retargeting is scattered in one-off code bases, and largely disconnected from the robot-learning ecosystem. In this work, we introduce the \orca~learning stack, an open-source research stack for dexterity as a first-class robot learning domain. Our \orca~stack unifies low-level control, simulation, teleoperation from a range of consumer platforms, and hand retargeting, behind a single interface, and integrates natively with popular robot-learning frameworks such as \lerobot, so dexterous hand researchers can leverage the same data, training, and evaluation pipelines used for non-dexterous robot learning. We demonstrate a complete end-to-end workflow, collecting expert demonstrations of an in-hand reorientation task by teleoperation with a consumer-grade VR headset, training an autonomous policy with \lerobot, and evaluating the learned policy in a fully reproducible and observable setup. We open-source the entire stack as a shared, reproducible foundation for dexterous-manipulation research.