给机器人训练加进度标签太麻烦了,UR-VC能自动修正常见的时间噪声,不用额外标注,在布料折叠任务上实测有效。
UR-VC是一种无监督、无需训练的方法,专门修正时间衍生的进度标签噪声。它利用演示数据中相似状态跨片段出现的规律,聚合时间标签来获得更准确的进度估计。在真实双臂布料折叠任务数据上,UR-VC修正的标签能捕捉局部回归和非均匀进度,而原始时间标签无法做到。将修正后的信号用于VLA训练的advantage标签后,实际机器人任务成功率呈现积极趋势。
UR-VC: Unsupervised Robotic Value Correction for Time-Derived Progress Proxies
Modern robot learning systems increasingly rely on dense progress or value signals to evaluate intermediate states, guide policy learning, and detect task completion, making the quality of these signals critical. Since such dense labels are rarely available at scale, normalized time within a demonstration is often used as a scalable substitute: later frames are treated as higher progress. However, this time-derived label is only a noisy proxy for physical task progress. In contact-rich manipulation, a robot may make progress and then lose it through slips, failed grasps, or partial undoing, while the time-derived label continues to increase monotonically. We introduce Unsupervised Robotic Value Correction (UR-VC), an offline, training-free method for correcting time-derived progress labels. UR-VC exploits a simple regularity in demonstration data: similar states often recur across different episodes, but at different timestamps. Instead of trusting the timestamp from a single trajectory, UR-VC retrieves similar states from other episodes and aggregates their time-derived labels to obtain a corrected progress estimate. UR-VC requires no manual progress labels, reward annotations, or additional value model. We evaluate UR-VC on real bimanual cloth flatten-and-fold data, a long-horizon deformable-object manipulation task with visible intermediate progress. The corrected labels capture local regressions and non-uniform progress that normalized time cannot represent, while preserving the overall task trend. We further use the corrected signal to construct advantage labels for VLA training, following recent advantage-conditioned policy learning. UR-VC shows a positive trend in real-robot task success under matched data, model, and training settings.