SILSA框架实现高保真3D生成
SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation
MIT团队推出SILSA框架,用切片潜表示大幅提升3D生成效率和结构保真度,特别适合处理薄结构和复杂连接模型。
SILSA是一种拓扑感知的3D生成框架,使用紧凑的滑动窗口切片潜表示。该框架通过固定三轴重叠切片代替昂贵的体素标记,将训练内存减少40.4%,推理时间减少58.5%。实验显示,SILSA在PSNR指标上提升8.7%,覆盖率提高5.96个绝对点,Betti误差降低9.2%。
SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation
High-resolution 3D generation increasingly relies on voxel latents and multi-stage pipelines that first predict active structure and then synthesize local geometry. While effective, this design fragments continuous surfaces into many local tokens, inflates generation cost, and often weakens topological consistency for thin or highly connected shapes. We introduce SILSA, a topology-aware 3D generation framework that represents shapes with compact sliding-window slice latents. Instead of generating expensive voxel tokens, SILSA uses a fixed set of overlapping slices along the three canonical axes, where each token summarizes a local depth window to preserve cross-sectional continuity and support single-stage rectified-flow generation. A Slice VAE encodes oriented surface samples into multi-axis slice latents and reconstructs them with a sparse volumetric decoder, while a Volumetric Anchor Lattice coordinates directional slice streams through a shared 3D workspace. To preserve structural correctness, we introduce slice-level topology supervision that matches persistence diagrams and aligns Betti transitions across neighboring slices. Experiments show that SILSA improves structural fidelity while substantially reducing generation cost. SILSA improves PSNR by $8.7\%$, coverage by $5.96$ absolute points, and Betti error by $9.2\%$ over the strongest baseline, while using $70.0\%$ fewer tokens than the next-most compact baseline and over $98\%$ fewer tokens than sparse or hierarchical tokenizers, effectively reducing training memory by $40.4\%$ and inference time by $58.5\%$. Qualitative results further show improved preservation of thin structures, repeated components, and long-range connectivity.