InstructMesh让普通人能修复AI生成的3D模型缺陷，支持自然语言和滑块操作，解决制造精度问题。
InstructMesh是一款交互式后生成修复工具，专为解决生成式3D模型在制造过程中的几何精度问题。该工具支持用户通过区域选择和特定操作（如打开或密封空隙，调整局部厚度）来修复模型缺陷。用户可通过自然语言提示或滑块控制调用编辑操作，直接在中间潜在表示上应用几何修正，无需专业建模技能。研究团队分析了当前最先进生成工具的常见制造相关故障模式，并通过两项用户研究验证了新手使用InstructMesh进行制造相关修复的能力。
InstructMesh: Selective Refinement of Generative 3D Models for Fabrication
Recent advances in generative AI allow users to create 3D models from text or images. However, these models prioritize visual plausibility over geometric accuracy, often generating results with flaws that compromise their intended use post-fabrication. We present InstructMesh, an interactive post-generation refinement tool that enables selective repair of generative 3D models through region selection and targeted operations, such as opening or sealing voids, or adjusting local thickness. Users can invoke edit operations via natural language prompts or slider controls. By operating directly on the intermediate latent representation, InstructMesh allows users to apply robust geometric corrections without requiring expert modeling skills. To inform our design, we first analyze common fabrication-related failure modes in outputs from state-of-the-art generative tools. We then conduct two user studies, demonstrating that novices can identify and perform fabrication-relevant repairs on generative outputs using InstructMesh, and revealing user preference for hybrid interfaces that combine slider controls with natural language input.