Unravel:从单张图像恢复可交互的3D场景
Unravel: Recovering an Interactive 3D Scene from a Single Image
单张照片就能拆出一个个体积可挪动的3D物体,靠VLM逐层抠图补遮挡,不用训练,做3D重建的可以看看。
arXiv 论文 Unravel 提出 training-free 框架,把单张图像转成每个物体可独立移动的交互式 3D 场景。它用视觉语言模型规划可见物体,由图像编辑器逐层移除并补全被遮挡区域,每次编辑都验证后才纳入重建。空间关系以点云为主要模态恢复,场景按移除的逆序拼回,支撑物先于被支撑物放置。针对单视角只见物体一部分的问题,论文把观测到的点当作尺寸下限,物体只能扩大覆盖、不能缩小。最后经物理沉降消除悬浮与穿插,再做 agentic 审计纠错,室内场景实验显示其恢复物体更多、摆放更准、物理上更合理。
Unravel: Recovering an Interactive 3D Scene from a Single Image
We present Unravel, a training-free framework that turns a single image into an interactive 3D scene, where every object is an independent and movable asset. Existing generators either produce one entangled geometry in which no object can be moved, or predict all objects in one feed-forward pass, where a wrong guess cannot be detected or repaired. Unravel instead takes a different approach: it first takes the scene apart, and then puts it back together. Starting from the input image, an agentic harness that iteratively peels the image layer by layer, and adopts point cloud as major modality for spatial relationship recovery. Specifically, a vision-language model plans which objects are fully visible, an image editor removes them and restores the occluded regions. Every edit is verified before being incorporated into the reconstruction. This process gradually turns occluded parts of the scene into direct observation, allowing objects to be reconstructed when they are best exposed rather than hallucinated from the original image alone. The scene is then rebuilt in reverse removal order, so that the supporting objects are naturally placed before the objects they support. Since a single-view image only reveals part of an object, we treat the observed points as a lower bound on its size: an asset may grow to cover its points, but can not shrink away from them. Finally, we physically settle the reconstructed scene to remove floating objects and interpenetrations, followed by an agentic audit that corrects remaining placement errors. Extensive experiments on diverse indoor scenes show that Unravel recovers more objects, places them more faithfully, and produces scenes that are more physically-plausible than existing methods.