Gary Marcus的神经符号AI观点再次被验证，关注AI范式演进的读者值得一看，尤其是对深度学习局限和未来方向有思考的开发者。
Gary Marcus在X上发帖，重申他2022年论文中“深度学习正在撞墙”的观点，并指出神经符号AI正在拯救这一困境。他批评有人误解了原始论点，并以一个寓言故事说明：深度学习在预训练扩展效果下降后，通过推理时计算、强化学习和工具使用取得突破。Marcus强调，这些进展恰恰验证了深度学习需要符号AI补充的预测。
Neurosymbolic AI is saving deep learning from hitting the wall (*exactly* as I said my 2022 paper “d...
Neurosymbolic AI is saving deep learning from hitting the wall (*exactly* as I said my 2022 paper “deep learning is hitting a wall”) Really sad to see someone as smart @peterwildeford confusing the original argument to this degree. Peter Wildeford🇺🇸🚀 @peterwildeford Once upon a time there was an Lead AI Developer who's AI was not getting impressive benchmark results. That evening, all of his neighbors came around to commiserate. They said, "We are so sorry to hear that deep learning is hitting a wall. This is most unfortunate." The Lead Developer said, "Maybe." The next day the LLM came back bringing seven massive benchmark scores and even got 90% on the LSAT. I the evening everybody came back and said, "Oh, isn’t that lucky. What a great turn of events. You now are really close to AGI!" The Lead AI Developer again said, "Maybe." The following day his son tried to train the next successor model, and while training it, he found that 10x'ing pre-training compute wasn't giving results anymore. The neighbors then said, "Oh dear, that’s too bad. Deep learning is hitting a wall." and the Lead AI Developer responded, “Maybe.” The day after, the Lead AI Developer announced they'd achieved breakthrough results by adding inference-time compute, RL scaling, and tool use. The neighbors came around and said, "Oh wow, AGI is soon!" The Lead AI Developer said, "Maybe." 🔗 View Quoted Tweet 💬 1 🔄 0 ❤️ 4 👀 589 📊 1 ⚡