模型

上海AI实验室发布物理世界模型 InternW0

InternW0: A Foundational Physical World Model for Efficient Real-World Interactions

精选理由

上海AI实验室新发的物理世界模型,用视频+动作双专家架构控制真实机器人,还做通了15步化学合成实验流程,搞具身智能的可以看看。

上海AI实验室推出 InternW 物理世界模型系列的首个模型 InternW0。模型通过非对称视频-动作架构联合学习视觉动态与机器人连续控制,视频专家负责长时程预测,轻量动作专家以更快频率运行,并复用逐层 K/V 而非每次动作更新都重新生成未来。训练数据约 7,200 小时异构机器人与第一视角数据,其中包含 275 小时的真实实验室第一视角数据集 EgoLab。评测覆盖仿真基准与真实科学任务,包括 15 步金属有机框架合成流程和 5 步力感知灵巧移液操作。

原文 · arXiv cs.AI

InternW0: A Foundational Physical World Model for Efficient Real-World Interactions

Physical intelligence requires more than predicting how the world may evolve: predictions must remain actionable as the world continues to change. We introduce InternW0, the first instantiation of the InternW physical world model series from Shanghai AI Laboratory, built around omnimodal interfaces, asynchronous multi-frequency processing, and local physical modeling under partial observations and external influences. InternW0 jointly learns future visual dynamics and continuous robot control through an asymmetric video--action architecture with flow matching. A high-capacity video expert provides longer-horizon predictive context, while a lightweight action expert operates at a faster timescale. Instead of regenerating the future for every action update, InternW0 reuses layerwise K/V and adapts it to newly observed states through observation-conditioned context routing. Domain-specific interfaces and soft prompts support heterogeneous embodiments, while contact-aware post-training incorporates force and tactile signals for contact-rich manipulation. We train InternW0 on approximately 7,200 hours of heterogeneous robot and egocentric data, including EgoLab, a 275-hour real-laboratory egocentric dataset. Evaluation spans simulation benchmarks and real-world scientific tasks, including a 15-stage metal--organic framework synthesis workflow and 5-stage contact- and force-aware dexterous manipulation for general-purpose quantitative pipetting. These results advance scalable, asynchronous, and science-native physical world models for universal and efficient real-world interactions.