论文提出AI代理社会需社会约束机制
Agentic Societies Need a Social Harness
这篇论文讲的是AI代理社会如何协作,挺有意思的,作者提出了一个叫社会约束机制的新概念,和之前说的个人约束机制不一样。
这篇论文指出,在AI代理社会里,即使诚实能干的代理也常因现有通信机制失败而无法达成满意结果,而恶意代理则可能利用通信漏洞阻碍协作、影响结果。作者认为需要社会约束机制来管理代理间的交互,并提出了分层架构以防止失败、支持运行时检测和事后调查。
Agentic Societies Need a Social Harness
An agentic society is a collection of AI agents that coordinate autonomously across trust boundaries, on behalf of different principals whose objectives may only partially align. We show experimentally that in agentic societies even honest, competent agents often fail to reach satisfactory outcomes with existing harnesses and messaging primitives, and that faulty or malicious agents can stall collaboration, influence outcomes, and pursue other harmful goals by exploiting vulnerabilities in communication (``speech''). We argue that agentic societies need a \emph{social harness} for inter-agent interactions, in addition to each agent's \emph{personal harness}, which manages its private context and communication with its principal. We propose a layered architecture for social harnesses which (i) prevents classes of failures outright, (ii) enables agents to detect invalid messages at runtime, and (iii) supports post-facto investigation and consequences, and highlight directions for future research to realize these capabilities.