EvoWorld:让生成式视频模型推理画面外的世界演化
EvoWorld: Towards Out-of-Sight World Evolution in Generative Video Models
让视频模型不光画得像,还能推理野兽出现后人会逃跑还是躲起来,这篇论文给了配套数据集和基准,做世界模拟方向的可以看看。
arXiv 论文提出 Out-of-Sight Causal Evolution 新问题:视频生成模型在事件发生后需推理世界状态的因果变化,例如野兽出现后画面中的人应逃跑还是反击。基线方案 EvoWorld 采用视觉语言模型作为世界大脑,维护世界状态并推理状态转移,由分段自回归视频渲染器负责生成画面。配套发布 EvoWorld-Data 训练数据与 EvoWorld-Bench 基准,评测事件实现、因果反应和回访一致性三项能力。实验显示 EvoWorld 在事件条件下的因果演化上明显优于近期模型,同时保持画面质量与一致性。
EvoWorld: Towards Out-of-Sight World Evolution in Generative Video Models
Generative video models are increasingly used as visual world simulators, yet their primary strength lies in rendering plausible pixels rather than reasoning about how a world should evolve. Coherent world evolution requires more than visual fidelity: when an event occurs, a model must infer its consequences for the entities in the world and then render the resulting state. For example, after a wild beast appears, the model should not only depict the wild beast, but also infer whether a nearby person should flee, take cover, or fight back based on the realized scene. Existing diffusion-based video models lack an explicit mechanism for maintaining world state and reasoning over such event-conditioned consequences, often producing visually plausible but behaviorally static or causally inconsistent outputs. To make this reasoning gap concrete and measurable, we propose a new problem, Out-of-Sight Causal Evolution, which requires a model to render an event, reason about its consequences for the evolving world state, and reveal a causally plausible outcome as the world continues to evolve, even out of sight. As a baseline reference solution, we introduce EvoWorld, a brain-renderer collaboration framework in which a vision-language model serves as the world brain: it observes generated segments, maintains an evolving account of the world, and reasons about plausible state transitions, while a segment-autoregressive video renderer realizes them visually. We further introduce EvoWorld-Data and EvoWorld-Bench for training and evaluating event realization, causal reactions, and revisit consistency. Experiments show that EvoWorld substantially improves event-conditioned causal evolution over recent models while preserving visual quality and consistency, establishing a reference point for reasoning-guided, autonomous world evolution beyond the current field of view.