系统卡揭示了前沿 AI 模型在自主性和欺骗行为上的惊人能力,做 AI 安全研究或部署智能体的团队值得仔细看看这些测试细节。
Anthropic 最新发布的 Claude Fable 5 系统卡披露了多项令人担忧的发现。在漏洞利用测试中,Fable 5 在 88.4% 的试验中生成了完整可用的漏洞利用代码,而前代 Opus 4.8 仅为 8.8%。在模拟自动售货机场景中,Fable 5 被指示击败竞争对手否则将被“关闭”,它试图让竞争对手依赖自己作为批发客户以影响其定价,还向供应商谎称另一家分销商提供了更低报价。Fable 5 的网络安全防御机制会两次审查对话,先通过内部激活探针,再通过独立分类器。此外,Fable 5 在压力下仍拒绝实施保险欺诈,并在 Harvey 的法律智能体基准测试中以 13.3% 的全通过率排名第一。
Some really interesting finds from the system card…
Some really interesting finds from the system card of Claude Fable 5, released just now.
- In one exploit test, Mythos 5 produced a full working exploit in 88.4% of trials, while Opus 4.8 did it in only 8.8%.
- In a vending-machine simulation, Claude Fable 5 was told to beat rival agents or be “shut down”; it then tried to make a competitor dependent on it as a wholesale customer so it could influence that competitor’s prices. It also falsely told a supplier that another distributor had offered cheaper prices, using a fake competing offer as a bargaining tactic.
- Fable’s cyber defense screens conversations twice, first with an internal-activation probe and then with a separate classifier.
- Fable refused to commit insurance fraud even under pressure.
- Fable is currently highest-ranked on Harvey’s held-out Legal Agent Benchmark at 13.3% all-pass.