辩论式训练的可学习性理论：在线学习视角下的新分析
Towards a Theory of Learnability via Debate
做 AI 对齐或学习理论的朋友可以看看这篇。它没停留在辩论博弈分析，而是把 debate 当学习问题建模，还发现对抗辩论未必是最优学习方式。做 scalable oversight 研究的人应该会感兴趣。
一篇 arXiv 论文（编号 2611.17303）将 debate 训练协议重新表述为在线学习问题，首次系统研究其中隐含的学习难题。debate 协议让两个模型竞相为对立标签辩护，由人类裁判判定胜负，理论上可评判计算复杂度远高于裁判直接评估能力的函数。
作者证明：一旦把学习问题形式化，在某些情形下借助裁判的最佳学习方式并不等同于运行对抗性 debate，因此他们提出了一种协作版协议，并用组合维度刻画其可学习性。论文还分析了裁判出错的影响，发现少量误判可能在学习中放大成较大误差。
Towards a Theory of Learnability via Debate
Debate has been recently proposed as a training protocol that is hoped to produce more aligned models even as model capabilities scale. The idea is that the human, instead of providing supervision in the form of labels, judges a debate between two models that compete to prove the correctness of opposite labels. It can be shown that functions of a much higher computational complexity can be correctly judged in this way, compared to the complexity of functions that can be directly evaluated using a computationally weak evaluator. This suggests that perhaps debate can be used to teach very complicated functions to models. However, previous work has largely ignored the fact that this is a training protocol, and simply analyzes the game being played between the two debaters for a known judge. We take the first steps towards understanding the learning problem implicit within the protocol, by formulating it as an online learning problem. We show that once we formulate the learning problem precisely, there are cases where the best way to learn given access to a judge is different from running an adversarial debate. This motivates us to define a cooperative version of the protocol, whose learnability we characterize using a combinatorial dimension. We also consider the possibility of the human judge being fallible and occasionally judging the debate incorrectly. We show that a small number of errors in judgement can lead to a large error in learning.
This report is categorized under AITOP's "Papers" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include AI对齐, 可学习性, 在线学习, scalable oversight.
Source attribution: curated from arXiv cs.LG (@Tosca Lechner, Vinayak Pathak, Sivan Sabato, Ruth Urner).
