论文精选

Code World Model: Coding Agent as World Brain

精选理由

Code World Model结合了语言模型和视频模型,通过编码代理实现世界大脑,为开放式世界模型提供新路径,值得了解。

AI 摘要

Code World Model框架结合语言模型的推理和编码能力与视频模型的生成先验,通过编码代理作为世界大脑,推理事件及其后果并生成可执行代码以维持持久的世界状态和执行规则一致的进化。通过代理表示将可执行状态与视觉生成连接,并开发数据管道从游戏和现实世界视频构建对齐的代理观察对。MiniMax-H3在编码代理构建的简单交互式世界中遵循基于代理的时空规范,同时保留丰富的视觉细节和动态。这些结果表明,结合代码进行持久世界进化的潜力与视频模型进行灵活视觉实现,为开放式世界模型提供了一条新路径。

原文 · arXiv cs.AI

World models aim to simulate how complex environments evolve under actions and events, yet existing video-based world models primarily learn dynamics from visual observations, which reveal outcomes rather than the underlying knowledge, rules, and mechanisms governing world evolution. This makes it difficult to maintain persistent consequences and support coherent, open-ended evolution. We introduce Code World Model, a framework that separates world evolution from visual realization by combining the reasoning and coding capabilities of language models with the generative priors of video models. A coding agent serves as the world brain, reasoning about events and their consequences and generating executable code to maintain persistent world state and perform rule-consistent evolution. To connect executable state with visual generation, we introduce a proxy representation that encodes frame-wise spatiotemporal constraints and is compiled into a proxy video, which conditions a video model to render high-fidelity visual observations. We further develop data pipelines for constructing aligned proxy-observation pairs from gameplay and real-world videos. After fine-tuning on paired gameplay data, MiniMax-H3 follows proxy-based spatiotemporal specifications from simple interactive worlds built by the coding agent while preserving rich visual details and dynamics. These results demonstrate the potential of combining code for persistent world evolution with video models for flexible visual realization, providing a new path toward open-ended world models.