LiveEvalBench开源了，用三个AI角色协作评测网页生成，比静态基准更贴近真实开发场景。
LiveEvalBench将网页生成评估重构为智能体化流程，由Build Engineer、Code Engineer、UI Tester三个角色协作覆盖部署、代码检查和浏览器交互。框架通过共享评分细则与实现落地标准结合，应对多种合法实现。实验显示其评估结果与人类专家高度一致，并对前沿模型的网页生成能力提供细粒度洞察。代码已开源在GitHub。
LiveEvalBench: Toward Open-World Evaluation for Web Generation
Large language models are increasingly capable of synthesizing executable frontend projects, yet existing benchmarks still treat web generation as a static evaluation problem. We argue that frontend artifacts demand a different paradigm: they are interactive rather than static, admit diverse yet equally valid implementations, and evolve faster than rigid pipelines can accommodate. To address these gaps, we present LiveEvalBench, an automated framework that reformulates web-generation evaluation as an agentic, adaptive, and extensible process. LiveEvalBench instantiates evaluation as a collaborative review workflow, in which a Build Engineer, a Code Engineer, and a UI Tester collectively gather evidence across the full lifecycle of a frontend project, from deployment and code inspection to browser-based interaction. To handle implementation diversity, an adaptive protocol couples shared rubrics for cross-model comparability with implementation-grounded criteria tailored to each artifact. The framework further supports incremental integration of new evaluator roles and assessment dimensions without pipeline redesign. Experiments across diverse real-world web-generation scenarios show that LiveEvalBench aligns closely with human expert judgment and provides fine-grained insights into frontier models' web generation capabilities. Code is available at https://github.com/wyysteelhead/LiveEvalBench