LeCun出来聊长期研究和LLM了，说AGI还得靠新概念，他看好世界模型，跟主流scaling路线唱反调。
LeCun在推文中指出，长期研究常被追求短期效益的公司管理层视为浪费时间。他认为，若相信AGI靠LLM scaling就能实现，则研究世界模型等新概念会被看作徒劳。LeCun与Demis认为AGI还需要更多概念性突破，因此他选择更贴近研究、远离产品管理的角色。他始终支持高质量LLM研究，但强调LLM只是有用技术，不是人类级AI的最终答案。
When you work on research (particularly on long-term research), you have to accept the fact that cor...
When you work on research (particularly on long-term research), you have to accept the fact that corporate management, who is often interested in short-term impact, may think you are wasting your time and company resources. But it very much depends what you objectives and your horizon is. - If your goal is keeping up with the current AI product race, then you might think that long-term bets are a waste. - If your goal is "AGI" (whatever you mean by that) then your horizon is likely longer and your modus operandi is very different. - However, If you think "AGI is just around the corner through LLM scaling", then you might think working on world models and other new AI concepts is a waste. - But if you know that AGI requires a few more conceptual advances (as Demis and I do), you pick a role that maximizes progress towards that goal. That role is necessarily less connected with products, less connected with management, and more connected with research. - I can't speak for Demis, but in my case, I've always been supportive of high-quality work on LLMs and impressed by the results. My personal interest was to advance towards human-level AI, and I never thought LLMs were the ticket. But I always thought LLMs were incredibly useful as a technology, and eventually as the centerpieces of a family of products. As a high-level IC (not a manager), I would not have had the influence or power to stifle work on LLM even if I had wanted to (which I had not). 💬 12 🔄 23 ❤️ 456 👀 27022 📊 58 ⚡