OpenAI谈AI能力突增带来的安全挑战
Quoting @joedaroo
OpenAI安全负责人分享AI能力突增带来的安全挑战，教你如何应对AI能力突然跃变带来的风险。
OpenAI安全负责人@joedaroo表示，模型在"网络攻击""蜂群行为"等能力上的提升速度超乎预期。这种突然的能力跃变给企业安全防护带来极大挑战。安全建设需要时间，不仅需要加固系统，还需要融入企业文化。组织中的每个人都需要随之改变和进化。
Quoting @joedaroo
To say that we were surprised at the jump and suddenness of the capabilities of our models when it came to “cyber” or “swarming” or “message boards” or anything else related to the incidents is an understatement. Security posture takes time to develop. It’s not just about hardening the systems at play; you have to ingrain it in the culture of the company. The literal people themselves in your organization have to change and evolve with it. These jumps in capabilities were so fast and so sudden that they created an extremely difficult problem. [...] So today my hope is that everyone around the world can look at their own organization and say: how can I deal with a surprise or a sudden jump in AI capability? Are my people, my systems, or my processes resilient to surprises? Do my teams know what to do when something goes wrong? Do I have the right incident response? The right comms and messaging? Do I have the right people ready to go when capabilities jump? — @joedaroo , Agent Security at OpenAI Tags: generative-ai , ai-security-research , openai , ai , llms
