行业多源确认73°

OpenAI首席科学家:AI对齐问题尚未解决

“Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to conti...

精选理由

OpenAI首席科学家公开承认AI对齐问题未解决,呼吁行业放缓发展速度,与Gary Marcus观点一致。

OpenAI首席科学家Jakub Pachocki表示,目前没有实验室已充分解决AI对齐和监控问题。他呼吁AI研究机构自愿放缓发展速度,直到建立共同的安全标准。Pachocki强调国际协调应对AI发展应成为各国政府首要任务。

原文 · Gary Marcus

“Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to conti...

“Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer. I expect and hope for voluntary slowdowns to become commonplace until shared safety bars are established. And I believe that international coordination on future AI development needs to become a top priority for governments around the world” is pretty much everything I have been saying for the last few years. maybe now that @merettm from OpenAI is saying the same people will believe it? Andrew Curran @AndrewCurran_ Jakub Pachocki, Chief Scientist OpenAI: 'Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer. I expect and hope for voluntary slowdowns to become commonplace until shared safety bars are established. And I believe that international coordination on future AI development needs to become a top priority for governments around the world.' 'Machine intelligence playing a larger and larger role in its own development process is a natural conclusion of sustained technological progress. If AI progress continues, machine recursive self-improvement (RSI) will be at the very core of future scientific discovery. Automated AI research is a more dramatic form of scaling intelligence with compute; and of course as a part of it, AI will improve the computational substrate itself⁠. And similarly to scaling, we focus OpenAI research towards RSI as we believe it is the only way to remain at the frontier of AI research moving forward. I want to stress that the above words don’t imply I think greatly accelerating deep learning research, especially in the short term, is the right collective action we should take as the research community. However, I do think this is where the current path leads, and we all need to make a conscious choice on how to proceed.' 🔗 View Quoted Tweet 💬 7 🔄 2 ❤️ 16 👀 5130 📊 7 ⚡