自主AI代理用于攻击性安全的伦理问题

The Ethics of Autonomous AI Agents for Offensive Security

精选理由

这篇论文把自主AI代理做攻击性安全的三类不确定性和道德归因难题讲透了,安全从业者和政策制定者值得看看。

AI 摘要

该论文分析LLM驱动的自主代理在攻击性安全中表现出三个不确定性维度:动作非确定性导致难以进行事前安全审查和事后归因;影响开放性源于非确定性动作、模型代理和LLM供应链不透明;用户群体不确定性因技能门槛骤降而扩大。结合攻防成本不对称,短期效应有利于攻击者。现有双重用途网络安全和AI伦理框架无法覆盖此组合。论文提供针对利益相关者的分层建议。

原文 · arXiv cs.AI

The Ethics of Autonomous AI Agents for Offensive Security

LLM-driven autonomous agents are reshaping offensive security. Unlike traditional penetration-testing tooling -- deterministic, narrowly scoped, and operated by trained practitioners -- agentic security tools exhibit \textit{indeterminacy} along three independent dimensions. First, their actions are drawn from a non-deterministic policy whose outputs resist both ex-ante and ex-post explanation, frustrating incident attribution and pre-deployment safety review. Second, their impact is open-ended due to the non-deterministic actions, agency of utilized models, and opaque LLM supply-chains. Third, their user population is indeterminate in both size and required skill: the operating skill floor for using or developing offensive capabilities has dropped sharply. These three properties are linked thematically, but are not derivable from one another. Combined with the structural cost asymmetry between offense and defense, they enable the industrialization of offensive capability. The net short-term effect favors attackers, even if the same technology may, in the long run, democratize access to defensive practice. Existing dual-use cybersecurity and AI-ethics frameworks were not designed for this combination. Our work analyzes how moral attribution becomes diffuse between users, tool-makers, and third parties when employing autonomous AI agents for offensive security. We also examine the stakeholder impact of this technology and provide stratified recommendations.

自主AI代理用于攻击性安全的伦理问题 · AI 热点