AI 终于开始认真对待工程图纸了——CADGenBench 为评估 AI 生成精确 3D 零件提供了标准化工具，做 CAD 开发或工程自动化的团队可以直接用这个基准测试来验证自己的模型。
Hugging Face 与 Mecado 合作推出 CADGenBench，一个用于评估 AI 生成和编辑 CAD 模型的基准测试。该基准测试包含两个任务：从工程图纸生成有效的 3D CAD 模型，以及根据变更请求编辑 STEP 文件。它不依赖特定工具，支持 Fusion、Onshape、build123d、SolidWorks 等多种 CAD 软件，提交格式统一为 STEP 文件。评分维度包括几何精度、拓扑正确性、接口兼容性和 CAD 有效性。基准测试已开源，排行榜实时更新，旨在推动 AI 在工程领域的精确应用。
AI is moving beyond text, images, and code. Engineering artifacts are becoming a new class of model...
AI is moving beyond text, images, and code. Engineering artifacts are becoming a new class of model outputs and evaluating them requires different tools than we use for text, code, or images. Today we're excited to release CADGenBench, a benchmark for CAD generation and editing. - Given an engineering drawing → generate a valid 3D CAD model - Given a STEP file + change request → edit it correctly The benchmark is tool-agnostic: any CAD stack works (Fusion, Onshape, build123d, SolidWorks, etc.). Submissions are simply STEP files. Models are scored on: * geometric accuracy * topology correctness * interface compatibility * CAD validity The benchmark is open, the ground truth is private, and the leaderboard is live. Since CAD evaluation is surprisingly subtle, here's how the metrics work 🧵 Michael Rabinovich @MikushRab Introducing CADGenBench: measure how well AI systems produce engineering-grade 3D parts! While current models can generate 3D parts, they are far from precise enough to build functional parts. We built a benchmark to systematically measure their capabilities on two tasks: 1. Generation from an engineering drawing of a part 2. Editing: given an existing STEP file and a requested change The benchmark is tool-agnostic. It makes no assumptions about how you build the model. You can vary the LLM, and you can vary the environment. Use build123d, Onshape, Autodesk, or a model without an LLM entirely. We open sourced the scoring engine and a reference baseline on top of build123d. A collaboration between Hugging Face and @mecadoinc ! Submission space: huggingface.co/spaces/Hugging… Code repository: github.com/huggingface/ca… Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 1 🔄 3 ❤️ 12 👀 2098 📊 4 ⚡