Primary sourcearXiv cs.AI
View sourceEvent ·Multi-source
DRAFT-Bench 发布:评测前沿 Agent 在专业设计全流程中的可靠性
论文提出 DRAFT-Bench(Design Reliability Across Feedback and Tasks),覆盖需求澄清、创意探索、约束编辑、迭代修改和生产交付五个设计环节。测试对比了 Codex、Astra 和 Claude Code,使用 35 份设计简报、43 个条件,另有 40 个场景的 RFQ 独立赛道。Astra 完成 43/43 个设计条件,Claude 完成 35/43;在 28 个共同评分的核心条件中,语义检查对 Astra 标记 11 项违规、Claude 5 项。论文指出这些是模型判断而非专家确认的失败率,并强调执行能力、需求合规与专业验收需要分开评估。
Current read
一个新的设计类 Agent 基准,Astra 全跑完但违规多,Claude 少做几个却更稳,论文本身还很克制地说明评测局限。
11 sources38° AI heatLast updated 2026/11/6 03:22:19
Evidence
11 sourcesRelated source 1Gorden Sun
View sourceRelated source 2IT之家
View sourceRelated source 3shao__meng
View sourceRelated source 4lmarena.ai
View sourceRelated source 5rohanpaul_ai
View sourceRelated source 6@koltregaskes
View sourceRelated source 7Thomas Wolf
View sourceRelated source 8OpenAI Blog
View sourceRelated source 9DAIR.AI
View sourceRelated source 10智源研究院 BAAI
View sourceConflict check
Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.