想自动评估节奏游戏谱面生成质量？ChartGenEval用抗扰动测试给出多维反馈，比单一得分靠谱多了。
ChartGenEval是一个包含六个问题的评估框架，其核心采用自动抗扰动测试。它通过匹配官方谱面的时间映射锚定节奏，但允许音符选择自由。在80组歌曲的测试中，七个输出轴满足预设的敏感性和不变性标准。相位估计可恢复15、30、60毫秒的注入偏移，同时谱面输出基本不变。常见模式重写使语言模型困惑度降低37%，循环折叠使自相似度提高62%。
ChartGenEval: Corruption-Tested Multi-Dimensional Feedback for Rhythm-Game Chart Generation
A generated rhythm-game chart need not reproduce one official note sequence: many note choices can fit the same song and difficulty. Reference-note agreement therefore measures reconstruction, not the full design problem. We introduce ChartGenEval, a six-question evaluation framework with an automatic, corruption-tested core. It leaves note choice open while anchoring timing to the song: the matched official chart supplies only its authored timing map, never target notes. We test each core output with dose-controlled failures rather than assume that a familiar statistic measures chart quality. Across 80 held-out song groups, seven output axes satisfy prespecified sensitivity and invariance criteria in nine nonredundant tests. Complementary stress tests on the 40-song development panel expose two broader lessons. A chart-wide phase estimate recovers injected shifts of 15, 30, and 60 ms while chart-only outputs remain essentially unchanged. Common-pattern rewriting lowers mean language-model perplexity by 37%, and loop collapse raises mean self-similarity by 62%. ChartGenEval therefore reports separate, role-specific signals instead of one proxy or total score. This profile provides automatic feedback for comparing and iterating generators; selected outputs are candidate optimization targets or constraints after task-specific stress testing.