Gary Marcus对OpenAI Astra的数学表现泼冷水：没公开细节，没独立验证，别急着吹。
Gary Marcus评论OpenAI Astra时承认其演示“显然令人印象深刻”，但认为数学问题比其他问题更依赖形式验证和合成数据。他质疑Astra在开放式真实世界问题中的可靠性，并指出目前不知道其是否使用Lean等工具。Marcus表示尚未看到问题尝试数量等细节，也没有独立验证。他回顾了此前社区对未试用模型的狂热后常出现失望的情况。
nothing i heard today makes me change this hot take
nothing i heard today makes me change this hot take Gary Marcus @GaryMarcus Hot take on OpenAI’s Astra: - Obviously impressive - But math is different from most other problems in that it is more amenable to to formal verification and synthetic data. How well it works in open-ended real world problems, how reliable it is, etc remains to be seen - We don’t know anything yet about how it works, whether it relies on formal tools like Lean, etc. - As noted below, we don’t yet know any of the details (how many problems were tried, how many yielded success, etc), and haven’t seen independent verification. Every previous time the community has gone wild about a model it hadn’t yet tried (and there have been many), some disagreement of disappointment followed. I doubt this will be different. 🔗 View Quoted Tweet 💬 2 🔄 0 ❤️ 4 👀 1707 📊 2 ⚡