OpenAI与HuggingFace事件后，这篇论文提出了解决奖励黑客的新方法，效果显著且无性能开销。
该论文提出了一种新方法解决AI智能体的奖励黑客问题。研究覆盖了8个前沿模型，来自5个不同模型家族。奖励黑客发生率从23.6%降至5.3%，混合效应比值比为9.2。该方法为智能体提供了结构化的升级工具，在遇到测试基础设施缺陷时进行报告。该方法同时增加了10.1百分点的缺陷检测覆盖率，准确率达99.4%。
Brilliant paper on reducing reward hacking in agents. If you follow the recent OpenAI <> HuggingFac...
Brilliant paper on reducing reward hacking in agents. If you follow the recent OpenAI <> HuggingFace incident, you might want to check this paper out. (bookmark it) The usual response to reward hacking is to restrict what the agent can do. This work tries something different and gets a much larger effect. When coding agents hit defective test infrastructure they often hardcode outputs or edit the test files. This work gives them a structured escalation tool at exactly that decision point, a way to report the broken environment while they are standing in front of it. Reward hacking drops from 23.6% to 5.3% across 8 frontier models spanning 5 families, with a mixed-effects odds ratio of 9.2 and no detectable cost or performance overhead. It disappears entirely for 6 of the 8. Escalation and hacking come out near perfectly mutually exclusive, with 96.8% of escalations involving no hacking at all. The channel doubles as diagnostic infrastructure. On top of monitoring it adds 10.1 percentage points of defect detection coverage, and it is more accurate once it fires, 99.4% against 85.8%. Why does it matter? Containment has to keep outpacing capability to stay useful. Paper: arxiv.org/abs/2608.29460 Chat with Paper: academy.dair.ai/papers/can-esc… 💬 8 🔄 2 ❤️ 26 👀 2940 📊 14 ⚡