前 DeepMind 高管称 AI 自我改进不会引发智能爆炸
Ex-Deepmind VP Vinyals says AI self-improvement is coming but won't trigger an intelligence explosion
前 DeepMind 的 Oriol Vinyals 说，AI 自我改进不会引发智能爆炸，这个观点很值得听听。
Oriol Vinyals 认为 AI 通过递归自我改进突然爆发智能的可能性不大。他认为 AI 能将研究速度提升十倍，但会受限于提出想法（研究品味）和可靠评估结果两个瓶颈。奖励欺骗和光速也构成额外限制。
Ex-Deepmind VP Vinyals says AI self-improvement is coming but won't trigger an intelligence explosion
Oriol Vinyals, until recently head of research at Google DeepMind, thinks a sudden AI intelligence explosion through recursive self-improvement is unlikely. AI can speed up research by a factor of ten, he says, but it hits two bottlenecks: coming up with ideas ("research taste") and reliably judging results. Reward hacking and the speed of light add further limits. Vinyals now wants to tackle these bottlenecks with his startup Discovery Loop, co-founded with Jeff Dean, Sanjay Ghemawat, and Quoc Le. The article Ex-Deepmind VP Vinyals says AI self-improvement is coming but won't trigger an intelligence explosion appeared first on The Decoder .
