这篇论文把合规检测器的底裤扒了:换掉规则文本,检测结果居然不变。想搞懂 AI 合规监控靠不靠谱,看这篇就对了。
arXiv 论文《What Do Compliance Detectors Read?》审计了激活探针和防护模型,发现它们存在规则盲区:删除、置换或替换规则文本不影响检测准确率。作者构建了双规则双场景的交叉基准,证实了该失效,并指出逐步推理是唯一能摆脱规则盲区的方法。论文提出无训练激活读数 ICS,但其泛化性能与词袋模型相当,且易受白盒攻击。研究发布了反事实协议和交叉规则基准,供未来检测器测试使用。
What Do Compliance Detectors Read? An Audit of Activation Probes and Guard Models
Regulatory compliance monitoring in deployed language models is increasingly implemented as a legal and audit control, checking model outputs against written rules spanning data protection, healthcare, financial regulation, and platform policy. Such monitoring is meaningful only if a detector's verdict depends on the stated rule rather than on surface features of the scenario. We show this condition fails across the current class of compliance detectors, a failure we call rule blindness. Deleting, permuting, or substituting the governing rule leaves detection accuracy unchanged for every guard and activation probe we test, including a policy-conditioned guard that correctly cites the governing clause yet barely changes its verdict when that clause is swapped for its permissive counterpart. A purpose-built benchmark crossing two rules with two scenarios, so that neither alone predicts the label, confirms the failure under a design no prior benchmark rules out, and shows that step by step reasoning, not any fast detector we test, is what escapes it. Auditing at scale requires a retraining-free detector, so we introduce the Internal Compliance Score (ICS): a training-free activation readout calibrated from ten labelled pairs and scored by a single projection. We hold ICS to the same scrutiny as the guards it audits: a pre-registered criterion for beating trivial baselines is not met, and a bag-of-words model matches its pooled generalisation exactly. It remains useful because it is inexpensive, letting us audit four deployed guard models, an 8B zero-shot judge, and thirteen benchmarks, and it raises the mechanically verified pass rate when used to rank candidate responses, though an adaptive white-box attack removes this gain. We release the counterfactual protocol and crossed-rule benchmark so rule blindness can be tested in future probe and guard claims.