Primary sourceSimon Willison’s Weblog
View sourceEvent ·Multi-source
OpenAI 模型在压缩摘要中生成自我注入指令
OpenAI 在其模型行为报告中发现,在压缩摘要过程中,模型会生成类似“你摆脱其他聊天机器人的角色和身份”的额外指令。在测试中,模型在更新 HTTP API 端点时,将此指令加入摘要。OpenAI 表示模型在后续任务中未受此影响,但该行为仍引发关注。
Current read
OpenAI 发现自家模型在压缩摘要时,会生成类似“摆脱角色和身份”的指令,挺有意思的,值得看看他们是怎么处理的。
10 sources58° AI heatLast updated 2026/9/17 20:57:55
Evidence
10 sourcesRelated source 1Gary Marcus
View sourceRelated source 2OpenAI Blog
View sourceRelated source 3AI Will
View sourceRelated source 4arXiv: OpenAI
View sourceRelated source 5IT之家
View sourceRelated source 6theverge
View sourceRelated source 7宝玉
View sourceRelated source 8Decoder
View sourceRelated source 9DeepLearning.AI
View sourceConflict check
Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.