Papers

PyRUA-DataFarm:用 LLM 智能体替代遥操作生成可直接部署的机器人训练数据

PyRUA-DataFarm: LLM Agent as a Cost-Efficient Teleoperator for Real-Ready Robot Data

Why we picked it

用编码智能体在仿真里批量造机器人训练数据,成绩反超遥操作真数据,一小时成本 107 美元,比中美两地人工都便宜,做具身智能的可以细看。

论文提出 DataFarm 流水线,让编码智能体根据一次校准数据在仿真中重建任务,自动编写场景、专家控制器和成功判定器,再用视频模型渲染出带动作标签的多机位数据。在五个真实机器人任务上,仅用农场数据训练的策略在 100 次试验中取得 93 次成功,略高于遥操作数据的 84 次;在未见过的桌布与彩色光照下保持 87 次成功,而遥操作策略降至 46 次。成本方面,适配一个新任务平均花费 21 美元 API 费加 5 美元渲染费,每条后续数据 0.80 美元;一小时三机位数据平均 107 美元,低于中国遥操作报价 117 美元和北美仅人工就 290 美元的水平。

Original · arXiv cs.AI

PyRUA-DataFarm: LLM Agent as a Cost-Efficient Teleoperator for Real-Ready Robot Data

Teleoperation remains the default way to collect robot demonstrations, but every episode costs robot and operator time, and every new task starts from scratch. We ask whether a coding agent can take over the teleoperator's job. In our DataFarm, the agent receives a data request and one calibration episode of the robot in the target scene and rebuilds the task in simulation: it writes the scene, an expert controller, and a success judge. The simulator supplies exact actions, and a video model conditioned on real images renders each rollout as photographic video, generating all camera views together consistently. The output is real-ready data: synchronized camera views labelled with the robot's actions, on which a policy can be trained directly and deployed on the real robot. Independent judges certify the expert and every rendered episode before admission. On five real-robot tasks, policies trained only on farm data match policies trained on as many teleoperated episodes (93 vs. 84 successes in 100 trials), and under an unseen tablecloth and coloured light they keep 87 successes where the teleoperation-trained policies fall to 46. Adapting a task is fully automatic and costs \$21 of API usage on average, paid once per task, plus \$5 for a render contract; every further episode costs \$0.80 on average for simulation, rendering, and review, with no robot or operator. One hour of three-view data for a task costs \$107 on average, these costs included, slightly below a quote of \$117 for teleoperation in China and below \$290 in labour alone in North America.