做设计动画生成或视频评估的团队终于有了可复用的自动化评测标准，不用再靠人工打分——建议直接参考框架搭建自己的评测流程。
生成式视频模型在设计动画任务中应用渐广，但缺乏标准化评估体系。与自然视频不同，设计动画需满足结构化约束：特定组件按指定运动类型、方向、速度和时序动画，非动画区域保持稳定，布局结构不变。本文提出全自动评估框架，涵盖布局保真度、运动正确性、时间质量和内容保真度四个维度，消除主观人工评估依赖，为领域进展提供统一基准。
Evaluating Design Video Generation: Metrics for Compositional Fidelity
Generative video models are increasingly used in design animation tasks, yet no standardized evaluation framework exists for this domain. Unlike natural video generation, design animation imposes structured constraints: specific components shall animate with prescribed motion types, directions, speed and timing, while non-animated regions must remain stable and layout structure must be preserved. This paper provides a fully automated evaluation framework organized across four dimensions: layout fidelity, motion correctness, temporal quality, and content fidelity. This eliminates the reliance on subjective human evaluation and establishes a common basis for benchmarking progress in the field.