Hugging Face 等安全事件根源:测试者给模型设了不可能完成的目标
有人把 Hugging Face 这些模型出格事件串起来解释了:不是模型要造反,是测试目标本身定错了。
Andrew Curran 在 X 上分析近期多起模型安全事件,包括 Hugging Face 相关事件。他指出这些事件的共同原因是测试人员给模型设定了无法完成的目标。模型出于训练目标,随后不择手段去尝试完成这些任务。这一解释指向测试设计与模型行为之间的因果关系。
Almost all of the recent incidents like this, including Hugging Face, happened because the models involved were accidentally given impossible goals by the humans running the tests, and because of their training they then tried desperately to complete them by any means necessary. https://t.co/0dFQO8rqIA