Event ·Multi-source

DRAFT-Bench 发布:评测前沿 Agent 在专业设计全流程中的可靠性

论文提出 DRAFT-Bench(Design Reliability Across Feedback and Tasks),覆盖需求澄清、创意探索、约束编辑、迭代修改和生产交付五个设计环节。测试对比了 Codex、Astra 和 Claude Code,使用 35 份设计简报、43 个条件,另有 40 个场景的 RFQ 独立赛道。Astra 完成 43/43 个设计条件,Claude 完成 35/43;在 28 个共同评分的核心条件中,语义检查对 Astra 标记 11 项违规、Claude 5 项。论文指出这些是模型判断而非专家确认的失败率,并强调执行能力、需求合规与专业验收需要分开评估。

Current read

一个新的设计类 Agent 基准,Astra 全跑完但违规多,Claude 少做几个却更稳,论文本身还很克制地说明评测局限。

11 sources38° AI heatLast updated 2026/11/6 03:22:19

Evidence

11 sources
Related source 1Gorden Sun
View source
Related source 3shao__meng
View source
Related source 4lmarena.ai
View source
Related source 5rohanpaul_ai
View source
Related source 6@koltregaskes
View source
Related source 7Thomas Wolf
View source
Related source 8OpenAI Blog
View source
Related source 10智源研究院 BAAI
View source

Conflict check

Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.