行业精选

监管前沿API模型而不监管开源AI是合理的

It's quite rational to regulate frontier API models, especially to get more transparency for the gov...

精选理由

Hugging Face CEO直言政府该管闭源API而不是开源模型,点出了监管争论中被忽略的黑箱风险。

AI 摘要

Hugging Face CEO Clement Delangue认为,当前最危险的AI系统是闭源前沿API模型(如通过编程助手分发的LLM),它们由巨头秘密构建、完全黑箱、控制力集中且分发到数亿用户。而开源模型风险低几个数量级:易于分析、能力较弱、传播更可控,且保护者与攻击者平等获取。监管前沿API只需针对少数巨头,成本低且容易执行;监管开源则会伤害小企业、研究者、大学等群体,并降低透明度。

原文 · Clement Delangue

It's quite rational to regulate frontier API models, especially to get more transparency for the gov...

It's quite rational to regulate frontier API models, especially to get more transparency for the government, without regulating open-source AI. Here's why: 1. The most dangerous AI systems right now aren't open models. They're the large frontier LLM APIs distributed through coding tools and assistants, because: - They're built in secret behind closed doors and stay total black boxes. Zero transparency on what they can or can't do, with "safeguards" that blur everyone's ability to even analyze them. - They're built and controlled by a few profit-maximizing megacorps, concentrating unprecedented power in very few hands, with every incentive to downplay risks and overstate their safeguards. - They're distributed to hundreds of millions, maybe billions, of people and trivially easy to run. 2. Open-weight models are orders of magnitude less risky: - They're not as massively distributed or as easy to use, especially the big ones, as APIs and assistants. - We (including governments) can quickly and accurately analyze what they're capable of, and for now everyone confirms they're not as good as the APIs at doing bad things. - They're distributed to everyone, so defenders and law enforcement get as much access as attackers. The cost-benefit analysis of regulation is completely different too. Regulating frontier APIs is relatively easy and low risk while regulating open source would be much more complex, less efficient, and orders of magnitude more costly. Regulating frontier APIs would only potentially hurt a few megacorps, if it even hurts them, given all the marketing that it is already generating for them. They can afford armies of lawyers and absorb losing a few billion dollars, especially given they're on track to become some of the most valuable companies in history. Regulating open source, by contrast, would hurt the very people regulation is supposed to protect: small businesses, startups, researchers, nonprofits, universities, independent developers, and the broader public, while risking killing competition, slowing AI progress, and reducing transparency even more! 💬 9 🔄 4 ❤️ 26 👀 1981 📊 11 ⚡

监管前沿API模型而不监管开源AI是合理的 · AI 热点