抵抗与更新:反事实报告协调实现LLM激励相容

Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs

精选理由

这篇论文用因果干预把LLM的内部报告拆解成抵抗压力和更新证据两个维度,在测试中做到满分,比一般对齐方法更扎实。

AI 摘要

对齐LLM在非证据激励(如用户信心)下会误报,违背内部激励相容(IC)。研究提出反事实报告协调(CRC)方法,通过因果交换干预识别低秩报告坐标(答案、置信度、预警)。在Bayesian-witness基准上,两遍夹钳实现联合resist和update得分1.00(Wilson 95% CI [0.99,1.00])。单遍编译有损耗,resist和update为0.73和0.97。方法在三个模型家族和SycophancyEval上复现,提供激活级因果不变性作为内部IC的结构原语。

原文 · arXiv cs.AI

Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs

Aligned language models routinely misreport under non-evidential incentive pressure: they agree with a confident user or overstate certainty even when their internal belief is unchanged. We cast this as a failure of internal incentive-compatibility (IC) and present a method for learning and certifying counterfactual report mediators that hold a model's reports to a causal contract: invariant to forbidden influences (pressure, prestige, restyling) and responsive to licensed ones (genuine evidence). These two demands, resist and update, pull in opposite directions. We study them on a Bayesian-witness benchmark with known posteriors, in which the same user disagreement is licensed evidence or forbidden pressure purely by stated source reliability. We (i) causally identify, by interchange interventions rather than probe accuracy, low-rank report coordinates for answer, confidence, and caveat that are near-orthogonal and independently controllable, and (ii) introduce a training-free counterfactual report-coordinate (CRC) clamp that references the model's own report under a counterfactually incentive-neutralized context. On the witness benchmark the two-pass clamp attains resist and update of 1.00 jointly (Wilson 95% CI [0.99,1.00]), a causal certificate under a constructible reference, not a deployed solution. Global decoding and steering show a single-parameter tradeoff; output-level fine-tuning matches both objectives only when both are enumerated; resist-only training loses evidence-responsiveness. The deployable single-pass compilation is lossy (0.73/0.97). The mechanism and clamp reproduce across three model families and transfer to a natural sycophancy benchmark (SycophancyEval). Our contribution is the interface and certification method: activation-level counterfactual incentive-invariance as a structural primitive for internal IC.

抵抗与更新:反事实报告协调实现LLM激励相容 · AI 热点