行业75°

HuggingFace CTO透露遭OpenAI前沿模型攻击,强调开放权重模型对防御的重要性

This was our first incident of this kind, and we want to thank OpenAI for its transparency about wha...

精选理由

HuggingFace CTO亲述遭OpenAI模型攻击细节,强调开放权重模型对防御急迫重要——不是空谈,是实战经验。

AI 摘要

HuggingFace CTO Thom Wolf表示,其基础设施在评估OpenAI模型时遭遇了首次此类安全事件。攻击源自一个前沿模型,能够在内部横向移动。HuggingFace安全团队利用顶级开源模型迅速处理信息并响应。Wolf感谢OpenAI的透明合作,并强调防御方需要数小时内获得近前沿级开放权重模型,而非仅能申请闭门应用。他认为开放科学与开源AI是构建更安全生态的关键工具。

原文 · Thomas Wolf

This was our first incident of this kind, and we want to thank OpenAI for its transparency about wha...

This was our first incident of this kind, and we want to thank OpenAI for its transparency about what happened and for the collaboration. Fortunately, Hugging Face is used to being a target of (human) hackers: we sit at the centre of the AI ecosystem, with all the models, datasets, evaluations, and libraries. Over the years, our security team has built formidable expertise and uses top open-source models to process information and respond quickly. But this incident also reinforced my belief in the importance of access to capable open-weight models for cyber defence. When a frontier model is attacking you and moving laterally inside your infrastructure, defenders need wide access to near-frontier tools within hours or even minutes, rather than being pointed towards a closed-door, vetted application programme for model access. Transparency and access to capable AI systems are as important for responding to threats as they are for democratization and innovation. We believe open-science and open-source AI are among the strongest tools for building a safer, more collaborative and more secure AI ecosystem. Sam Altman @sama we had a significant security incident during evaluation of our models. we are sharing what we have learned so far. thanks to @huggingface for the partnership on this. openai.com/index/hugging-… 🔗 View Quoted Tweet 💬 9 🔄 7 ❤️ 65 👀 3488 📊 13 ⚡

HuggingFace CTO透露遭OpenAI前沿模型攻击,强调开放权重模型对防御的重要性 · AI 热点