想从普通视频生成能自由旋转看的3D场景？这个新方法用高斯点云重建动态效果，超越现有4D重建技术。
该方法提出从单目视频生成可自由渲染的动态3D高斯表示。通过视频模型条件化密集像素对齐渲染，编码外观、几何和3D场景运动，以纠正初始重建的伪影并填补缺失区域。训练时构建了多视角视频对和动态3DGS数据集，模拟单目重建的典型伪影。测试时将模型生成的新区域和运动蒸馏回单一一致的高质量动态3DGS，在4D重建上达到新SOTA，并泛化到视角变化大的野外视频。
World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video
We present World from Motion, a method for generating freely renderable dynamic 3D Gaussian representations from monocular videos. Our approach conditions a video model on dense, pixel-aligned renderings that encode appearance, geometry, and 3D scene motion along both input and target camera trajectories to correct rendering artifacts and fill in missing regions from an initial reconstruction. To train this model, we construct a dataset of aligned multiview video pairs and dynamic 3DGS representations, with simulated artifacts characteristic of monocular reconstruction. At test time, we distill the model's generations, including newly observed regions and motions, back into a single consistent, high-quality dynamic 3DGS, improving both novel-view synthesis and the underlying 3D motion. Our method sets a new state of the art in 4D reconstruction and seamlessly generalizes to in-the-wild videos with large viewpoint changes and dynamic motions.