做3D场景编辑或交互式应用的开发者，VGGT-Edit 直接预测3D位移而非逐帧2D编辑，解决了多视角不一致的痛点，值得一试。
VGGT-Edit 是一种前馈式框架，用于文本驱动的原生3D场景编辑，解决了现有2D提升方法导致的纹理模糊和几何不一致问题。它通过深度同步文本注入对齐语义与空间姿态，并利用残差变换头直接预测3D几何位移，实现场景变形同时保持背景稳定。研究团队还构建了 DeltaScene 数据集，通过自动管道和3D一致性过滤确保高质量真值。实验表明，VGGT-Edit 在物体细节锐度、多视角一致性和推理速度上显著优于2D提升基线，支持近即时推理。
VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Prediction
High-quality 3D scene reconstruction has recently advanced toward generalizable feed-forward architectures, enabling the generation of complex environments in a single forward pass. However, despite their strong performance in static scene perception, these models remain limited in responding to dynamic human instructions, which restricts their use in interactive applications. Existing editing methods typically rely on a 2D-lifting strategy, where individual views are edited independently and then lifted back into 3D space. This indirect pipeline often leads to blurry textures and inconsistent geometry, as 2D editors lack the spatial awareness required to preserve structure across viewpoints. To address these limitations, we propose VGGT-Edit, a feed-forward framework for text-conditioned native 3D scene editing. VGGT-Edit introduces depth-synchronized text injection to align semantic guidance with the backbone's spatial poses, ensuring stable instruction grounding. This semantic signal is then processed by a residual transformation head, which directly predicts 3D geometric displacements to deform the scene while preserving background stability. To ensure high-fidelity results, we supervise the framework with a multi-term objective function that enforces geometric accuracy and cross-view consistency. We also construct the DeltaScene Dataset, a large-scale dataset generated through an automated pipeline with 3D agreement filtering to ensure ground-truth quality. Experiments show that VGGT-Edit substantially outperforms 2D-lifting baselines, producing sharper object details, stronger multi-view consistency, and near-instant inference speed.