腾讯混元发布WebCraftBench评估AI生成网站
The AI says the site is done. Then the homepage errors, the buttons overlap, and it added a login fl...
腾讯混元这个新工具能真实测试AI生成的网站，比人工评估更高效准确。
腾讯混元团队推出WebCraftBench评估系统，通过智能体实际使用生成的网站进行测试。该系统在197个人类验证的样本对上，达到85.3%的人类偏好匹配率。WebCraftBench采用覆盖率引导的探索方法，发现未被测试的功能区域，并评估美学、可用性和原始请求完成度。
The AI says the site is done. Then the homepage errors, the buttons overlap, and it added a login fl...
The AI says the site is done. Then the homepage errors, the buttons overlap, and it added a login flow you never asked for. 🙃 Introduces WebCraftBench: agents actually use the live app, coverage-guided exploration finds what never got reached, then we score aesthetics, usability, and whether the original request was met. On 197 human-validated pairs, it matches human preference 85.3% of the time. Paper: arxiv.org/abs/2609.15387 Z 💬 2 🔄 2 ❤️ 47 👀 2213 📊 13 ⚡
