Hinton 承认 Ilya 主张的规模化路线是对的
Hinton 亲口认错，说当年 Ilya 坚持堆规模是对的，算力比他想的快了十亿倍，视频里讲得很实在。
Geoffrey Hinton 表示，Ilya Sutskever 坚持答案是把模型做大，他当时觉得太简单，认为需要新想法和新架构。他承认架构确实有帮助，但数据和算力的规模才是最关键因素。他指出当初没预料到计算机会快约十亿倍，而非预期的 100 倍。两人 2012 年与 Alex Krizhevsky 搭建的 AlexNet 在两块 NVIDIA 游戏显卡上训练了五到六天，如今同样的思路跑在价值数十亿美元的数据中心上。
Ilya doesn’t believe scale is all anymore; Hinton is behind. Dany @danysvnt GODFATHER OF AI ADMITS ILYA WAS RIGHT geoffrey hinton says ilya sutskever kept insisting the answer was simply to make models bigger, and to him that sounded too easy, real progress needed new ideas new architectures did help, but he admits the scale of data and computation turned out to matter most "We had no idea computers would get like a billion times faster. We thought maybe they'd get 100 times faster" the network that kicked off the deep learning boom, AlexNet, built by hinton, ilya and alex krizhevsky in 2012, trained for five to six days on two nvidia gaming cards today that same simple idea runs on data centers worth billions experts are the last to trust a simple answer Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 6 👀 717 📊 1 ⚡
