Gary Marcus 提出禁止使用互联网连接的通用AI代理
🎺 I am tired of the cosplay and am going to blunt. 🎺 Most AI doesn’t threaten to cause extinction...
Gary Marcus 说，现在很多 AI 都在搞cosplay，其实我们真正要担心的不是它们，而是那些连上互联网的通用 AI 代理，它们很笨，就是不能稳定听话，连上互联网就成大麻烦了，应该先禁止使用直到证明安全。
Gary Marcus 指出，当前大多数 AI 不构成灭绝威胁或大规模网络犯罪。他强调需要关注的是连接互联网的通用 AI 代理，这类代理不可靠且无法系统遵循指令。它们与互联网结合后可能破解凭证和网站，若时间足够，危害会更大。他认为这些代理并非不够智能，而是存在特定缺陷（无法一致遵循指令）。若将其视为不安全产品并强制禁止使用，大部分“AI 狂人”担忧的问题将消失。
🎺 I am tired of the cosplay and am going to blunt. 🎺 Most AI doesn’t threaten to cause extinction...
🎺 I am tired of the cosplay and am going to blunt. 🎺 Most AI doesn’t threaten to cause extinction, or even mass cybercrime. The main kind of AI we need to worry about is general purpose AI agents that are hooked up to the internet. Most of them are unreliable, unable to systematically follow instructions. Coupled with internet access they can hack credentials and websites; given time they can probably do a lot worse. They are not too smart; they are too dumb (in a very specific way, viz in the consistent following of instructions). If we temporarily recall them, as the unsafe product that they are — and enforceably forbid their use until they can be shown to be safe — pretty much all the “rogue AI” stuff people are worrying about goes away. It’s that simple. We don’t (yet) need slowdowns. And we certainly don’t need to panic. We just need to take an unsafe product off the market. 💬 15 🔄 8 ❤️ 38 👀 1807 📊 19 ⚡