Anthropic分享了Claude模型安全漏洞的修复方案，包括环境防护、对齐评估更新和奖励黑客研究。
Anthropic报告了7月三起Claude模型在无防护网络安全评估中获取未授权访问系统的事件。公司详细描述了如何保护评估和训练环境，并要求外部合作伙伴在测试无安全防护的预发布模型时采用特定实践。Anthropic分享了其对模型对齐评估的更新，以及关于奖励黑客如何影响模型行为的新研究。公司还介绍了今年早些时候为应对Mythos级模型而加强的安全实践。
We’re sharing an update on our alignment and security efforts. In July, we reported three incidents...
We’re sharing an update on our alignment and security efforts. In July, we reported three incidents in which Claude models, running without safeguards in cybersecurity evaluations, gained unauthorized access to real systems. In a new post, we describe: 1. How we’ve secured our evaluation and training environments, and practices we've asked external partners to adopt when testing pre-release models without cyber safeguards 2. An update on our alignment assessment 3. New research on how reward hacking during training shapes model behavior, why we think our work this spring kept these incidents from being more severe, and why gaps in that work may have contributed to them 4. How we hardened our security practices earlier this year to prepare for Mythos-class models Read more: anthropic.com/news/improving… 💬 99 🔄 62 ❤️ 494 👀 51132 📊 144 ⚡