E-TTS:一种具身测试时缩放框架,用于机器人操作

E-TTS: A New Embodied Test-Time Scaling Framework for Robotic Manipulation

精选理由

E-TTS团队搞了个新框架,不用重新训练就把机器人操作成功率在模拟中提33%,真实场景提26%,挺实用的。

AI 摘要

E-TTS是一个模块化、即插即用的具身测试时缩放框架,通过历史感知的迭代精炼和视觉语言验证器,统一了机器人操作中的推理和动作缩放。它采用推理-动作联合采样和成对评分,并引入历史缓冲区存储上下文,用于推理和动作验证器评估候选。与常规开环TTS不同,E-TTS在采样中引入反馈生成,形成闭环迭代精炼机制。实验在4个基准、6个环境、3个实体和4个基础VLA模型上进行,模拟场景提升33.14%,真实场景提升26.62%,无需额外数据收集或重新训练。

原文 · arXiv cs.AI

E-TTS: A New Embodied Test-Time Scaling Framework for Robotic Manipulation

Recently, a few works have made early attempts to study test-time scaling for embodied tasks. However, two major challenges remain unsolved: (1) reasoning can effectively improve the performance of the policy, but its scaling mechanism has seldom been studied; (2) historical information is essential, as embodied tasks are inherently long-horizon and sequential, making sole reliance on current observations for action scaling inadequate due to the lack of historical context utilization. To address these challenges, we introduce E-TTS, a modular and plug-and-play Embodied Test-Time Scaling framework that unifies reasoning and action scaling for robotic manipulation via history-aware iterative refinement with vision-language verifiers. To support joint reasoning-action scaling, E-TTS performs reasoning-action joint sampling and scoring in a pairwise manner. To better utilize historical information, E-TTS uses a history buffer to store historical context, which is then used by reasoning and action verifiers to evaluate the sampled candidates. Unlike conventional open-loop TTS methods, E-TTS introduces feedback generation into the sampling process to form a closed-loop iterative refinement mechanism, enhancing both inference efficiency and environmental adaptability. Each component functions as an independent and composable module, allowing flexible and adaptive configuration depending on task requirements. To evaluate the advantages of our framework, we conduct experiments across 4 different benchmarks, 6 environments, 3 embodiments, and 4 base vision-language-action models. The experimental results demonstrate that, without requiring additional expert data collection or retraining, E-TTS consistently improves performance, achieving up to a 33.14% increase in simulation and 26.62% in real-world scenarios.