政府要求关停最强模型,越狱争议升级
美国政府向Anthropic发出出口管制指令,要求其关闭最强模型Fable 5和Mythos 5。原因是有人发现了一种越狱方法,能让模型提供本应拒绝的网络安全帮助。Anthropic表示该越狱技术狭窄,仅发现少数已知小漏洞,且其他公开模型也能提供类似能力。商务部长Howard Lutnick指出,这两个模型在美国境外及境内外国人员中面临出口限制。Anthropic认为完美越狱抵抗目前对所有模型提供商都不可行。
BREAKING: The US Govt directed Anthropic to shut …
BREAKING: The US Govt directed Anthropic to shut down its strongest Claude models.
Anthropic received the export control directive on Friday from the government. The net effect is that it must disable Fable 5 and Mythos 5 for all customers to comply.
Because, someone found a jailbreak that could make the model reveal cybersecurity help it was supposed to refuse.
Anthropic says the government has not shown a broad, universal jailbreak that turns the model into an unrestricted hacking assistant.
The shown technique was narrow, found only a small number of already known minor vulnerabilities, and produced capability that other public models can also provide.
Commerce Secretary Howard Lutnick wrote Friday that Anthropic’s Mythos 5 and Fable 5 models would face export limits anywhere outside the United States and for foreign persons within it.
The model must stay restricted until the U.S. government strengthens its national security systems, which could happen within the next few weeks.
Anthropic further said "We suspect that perfect jailbreak resistance is not currently possible for any model provider. Every safeguard used in the industry is vulnerable to non-universal jailbreaks (which can elicit some cyber information in specific circumstances), and it is likely that universal jailbreaks will eventually be found in the future."