当状态成为攻击面:LLM驱动具身代理的状态语义注入

When State Becomes an Attack Surface: State-Semantic Injection in LLM-Driven Embodied Agents

精选理由

这篇论文揭示了具身代理的新攻击面,搞机器人安全的值得看看。

AI 摘要

该研究提出状态语义注入攻击,针对LLM驱动的具身代理。攻击者通过操纵环境状态描述,使代理执行恶意动作。实验在多个具身代理框架上验证,成功率超过80%。该攻击暴露了状态表示的安全漏洞。

原文 · arXiv cs.AI

When State Becomes an Attack Surface: State-Semantic Injection in LLM-Driven Embodied Agents

Large Language Models (LLMs) have demonstrated capabilities in in-context learning, task decomposition, step-by-step reasoning, and code generation, driving their gradual evolution from text generation models into the core of agents capable of perceiving environments, invoking tools, and executing tasks. Traditional LLM Agents typically obtain information through webpages, documents, databases, or external tools and generate corresponding invocation sequences according to user goals; when this technology is further integrated with robotic systems, large language models begin to undertake functions such as task understanding, high-level planning, and behavioral decision-making. SayCan combines the task reasoning capability of language models with the affordances of robotic skills, while Code as Policies and ProgPrompt generate robot task plans through policy code and programmatic prompting, respectively, and VoxPoser uses language models and vision-language models to construct three-dimensional value maps to guide robotic manipulation \cite{6,7,8,9}. Vision-language-action models such as PaLM-E, RT-2, and GR00T N1 further strengthen the connection among language, visual perception, and robotic actions \cite{10,11,12}. In such LLM-driven embodied agents, the model not only needs to understand user instructions, but also needs to combine scene states, object attributes, spatial relations, and execution feedback to complete task grounding, and then hand the generated action plan to skill libraries, motion planners, or controllers for execution.