Rewindable Interactive Proofs:让弱验证器通过“回滚”审查强 AI 输出
Efficient Scalable Oversight via Rewinding
一帮研究者给 AI 监管想了个新招:验证器能把 AI 回滚到之前状态反复盘问,不需要“有一个 AI 说真话”的假设,还比现有证明系统跑得快。
论文提出 rewindable interactive proofs(RIPs),一种新的 relativizing interactive proofs 模型,用于 scalable oversight。验证器可以保存 AI prover 的状态快照并回滚到交互中较早的状态继续验证,从而不再需要 debate 协议中“两个 prover 之一诚实”的假设。构造对输出对小部分 oracle 答案变化鲁棒的计算成立,诚实 prover 运行时间为原计算的线性,验证器经一次预处理后运行时间接近输入长度的线性。作者实现了该协议并用 MNIST 做了初步实验,显示 RIP 可以比一个 state-of-the-art 的部署级证明系统更快。
Efficient Scalable Oversight via Rewinding
Scalable oversight asks how a weak verifier can check the outputs of computations performed by more powerful AI systems. One proposed approach uses relativizing interactive proofs, in which a weak verifier checks the output of a complex oracle-aided computation by interacting with one or more powerful provers. A prominent example is debate, which is highly efficient but assumes that one of two powerful AI models, or provers, is truthful. For certain classes of oracle-aided computations, this assumption can be removed, but at substantially greater computational cost. In this work, we introduce \emph{rewindable interactive proofs} (RIPs), a new model of relativizing interactive proofs for scalable oversight. In an RIP, the verifier may rewind the prover to an earlier state of the interaction and continue from there. This is possible when the prover is an AI model, since the verifier can save a snapshot of the model's state and later restore it. We construct a relativizing RIP for computations whose outputs are robust to changing a small fraction of oracle answers. Our construction is more efficient than prior relativizing proofs that do not assume a truthful prover, and it uses no cryptography. In our construction the honest prover runs in time linear in that of the original computation, and the verifier, after a one-time preprocessing step, runs in time nearly linear in the input length (which can be much smaller than the computation itself). We implement our protocol, report a preliminary MNIST experiment, and show that an RIP can be faster than a state-of-the-art deployed proof system. RIPs may be of independent interest. Rewinding is possible whenever the verifier controls the prover's machine, for example when the prover runs on trusted hardware or in a virtual machine whose state can be checkpointed.