这篇论文揭示了AI代理自主性增加带来的风险，提出了实用的认知支架解决方案。
HuggingFace新论文指出，AI代理自主性增加会导致人类监督失效。研究显示，随着代理执行更多任务，用户进入审批模式，导致审批疲劳、过度依赖、情境意识丧失和技能退化。论文提出在两个层面实施认知支架：开发者增加战略摩擦、改进审批设计、行为监控和关键时刻的强制检查。
“increasing agent autonomy can gradually make human oversight ineffective by causing approval fatigu...
“increasing agent autonomy can gradually make human oversight ineffective by causing approval fatigue, overreliance, loss of situational awareness, and skill degradation.” new paper from @mmitchell_ai et al that i fully agree with. Rohan Paul @rohanpaul_ai New HuggingFace paper argues that increasing agent autonomy can gradually make human oversight ineffective by causing approval fatigue, overreliance, loss of situational awareness, and skill degradation. As agents do more, users are pushed into approval mode: skimming plans, granting permissions, and reconstructing what happened across steps. Over time, automation bias, approval fatigue, weaker situational awareness, and skill atrophy can make those approvals less reliable. Worse, weak approvals can become training or evaluation signals, rewarding systems for being easy to approve rather than easy to scrutinize. Their answer is cognitive scaffolding at 2 levels: developers add strategic friction, better approval design, behavioral monitoring, and checks that force attention at consequential moments. – arxiv. org/abs/2608.23642 Title: "AI Agents Push Humans Out of the Loop" 🔗 View Quoted Tweet 💬 3 🔄 8 ❤️ 17 👀 2387 📊 6 ⚡