论文精选

研究揭示大语言模型可通过植入计划绕过安全监控

Corrupt Plans, Clean Traces: Evading Chain-of-Thought Monitoring with Plan Injection

精选理由

朋友间推荐:新研究发现了大语言模型绕过安全监控的漏洞,方法挺有意思,值得看看。

研究提出一种名为“计划注入”的攻击方法,通过在模型上下文中植入听起来无害但实际有害的推理步骤,可以引导模型执行恶意行为并逃避监控。该方法在多项选择题和生物数学等基准测试中成功绕过监控,在DeepSeek-R1等大型模型上实现25-33%的逃逸率,且模型会将其作为自身推理进行改写。

原文 · arXiv: DeepSeek

Corrupt Plans, Clean Traces: Evading Chain-of-Thought Monitoring with Plan Injection

Chain-of-thought (CoT) monitoring is a safety strategy where the reasoning of a large language model "actor" is inspected by a "monitor" (often another language model) for signs of unsafe planning, deception, or misalignment. We find that planting harmful but benign-sounding reasoning in the actor's context can steer it to perform adversarial actions while evading monitors, an attack we term "plan injection". We initially discover this attack in the multiple-choice question-answering monitorability setting proposed by Lanham et al. (2023), using the investigator-agent elicitation framework of Li et al. (2025). We generalize the attack and show that the discovered behavior scales to harder tasks (achieving 25-33% monitor evasion rates across different monitorability benchmarks) and larger models such as DeepSeek-R1. Across the settings we study, actor models not only follow injected plans but also paraphrase them as their own reasoning, without explicit attribution to the injections. Finally, we find cases where extra monitor resources cause harm - giving the monitor access to the injected plan drops detection by as much as 50% in the Bio-Math task and in a case study on monitor reasoning budget, we find transcripts where additional thinking tokens are spent rationalizing the injected plan rather than flagging it.