Richard Sutton:单纯堆算力不够,需要全新的学习方法
The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts
提出苦涩教训的 Sutton 本人又发话了,说光堆算力到不了智能,Tworek 也吐槽盲目扩 transformer 的风气,观点挺扎心。
图灵奖得主 Richard Sutton 重申其“苦涩的教训”观点,认为仅靠堆算力无法实现智能,需要根本性的新学习方法。前 OpenAI 研究员 Tworek 表示认同,称盲目扩大 transformer 规模“让一代科学家的大脑被 reward hacking 了”。已有一批初创公司押注这一方向。
The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts
Turing Award winner Richard Sutton reaffirms that raw compute alone isn't enough for intelligence and that fundamentally new learning methods are needed. Ex-OpenAI researcher Tworek agrees, saying blind transformer scaling "has reward hacked brains of a whole generation of scientists." A growing wave of startups is already betting on exactly this gap. The article The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts appeared first on The Decoder .