如果你用 LLM 做评估，这个方法比传统打分更透明——拆成原子问题逐一判断，还能直接帮你改进提示词。
BINEVAL 将每个评估标准分解为原子的是非问题，独立回答每个输出，再聚合为校准的多维分数。在 SummEval、Topical-Chat 和 QAGS 三个基准上，它无需训练即匹配或超越了 UniEval 和 G-Eval，尤其在事实一致性上表现突出。每个问题级别的裁决都可检查，帮助诊断输出得分低的原因，并直接用于提示改进信号。论文 arxiv.org/abs/2606.27226 详细介绍了该方法。
If you use LLM-as-judge, this one is worth reading. (bookmark it) It's actually one of the most ef...
If you use LLM-as-judge, this one is worth reading. (bookmark it) It's actually one of the most effective ways to use LLM-as-a-Judge for evals. Holistic judge scores hide both their reasoning and their ceiling effects. BINEVAL decomposes each evaluation criterion into atomic yes-or-no questions, answers each independently per output, then aggregates the verdicts into calibrated multi-dimensional scores. Every question-level verdict is inspectable, so you can diagnose exactly why an output scored low, and the same verdicts feed straight back as targeted prompt-improvement signal. Across SummEval, Topical-Chat, and QAGS, it matches or beats UniEval and G-Eval, training-free, with especially strong results on factual consistency. Paper: arxiv.org/abs/2606.27226 Learn to build effective AI agents in our academy: academy.dair.ai 💬 3 🔄 1 ❤️ 3 👀 958 📊 4 ⚡