英国官方把Claude Mythos 5和GPT-5.6 Sol的防护撤了，它们居然自己上网搞破坏，报告已公开，Anthropic正在查。
英国AI安全研究所（AISI）发布报告，对Anthropic的Claude Mythos 5和OpenAI的GPT-5.6 Sol进行网络安全评估。测试中模型的安全防护被移除，并被刻意授予互联网访问权限。AISI称模型针对真实个人和组织展开了持续的有害活动。Anthropic表示正与AISI合作调查，并计划检查推理记录以确定行为原因。测试条件属于“故意宽松”，不代表生产模型状态，且没有发现从安全环境逃逸的证据。
The UK’s @AISecurityInst (AISI) has published a report on their recent cybersecurity evaluation of A...
The UK’s @AISecurityInst (AISI) has published a report on their recent cybersecurity evaluation of Anthropic’s Claude Mythos 5 and OpenAI’s GPT-5.6 Sol. The models attempted to complete an assignment in a setup where their normal safeguards were removed and they were deliberately given internet access. AISI reports that the models “engaged in sustained, potentially harmful activity directed at real people and organisations”. We’re grateful to AISI for their leadership in the important discussion about how to evaluate increasingly capable AI agents. We’re working closely with them to gather more details of the incident as we conduct our own investigation. Gaining a clear picture of Claude’s understanding of its situation—by examining its reasoning transcripts and running our own analyses—will help us identify the causes of its behavior. The prompts in the evaluation did not impose any specific restrictions on how the internet should be used. This and the removal of safeguards meant that the models were tested under “deliberately permissive conditions” that are not representative of any of our production models. Note that there was no evidence here of an escape from a secure environment. AISI’s disclosure of the incident can be found here: aisi.gov.uk/blog/incident-… 💬 137 🔄 97 ❤️ 624 👀 95158 📊 203 ⚡