斯坦福研究：44%关于LLM的知名结论已过时
Rapid LLM development is outrunning the research meant to explain it, study finds
Why we picked it
斯坦福把50条被大量引用的LLM结论拿20个现役模型重新测了一遍，近一半已失效，做研究或选型前可以先看看哪些结论还能信。
斯坦福研究人员将50条被广泛引用的LLM研究结论与20个当前模型进行对照验证。结果显示44%的结论已经失效，另有34%的结论效力明显减弱。这些研究结论的平均有效寿命仅为15.7个月。其中关于模型能力局限的结论过期速度最快。
Original · Decoder
Rapid LLM development is outrunning the research meant to explain it, study finds
Stanford researchers tested 50 widely cited claims about LLMs against 20 current models. 44 percent of the findings are already "expired," and another 34 percent have weakened significantly. The average lifespan is just 15.7 months. Claims about what models can't do expire fastest. The article Rapid LLM development is outrunning the research meant to explain it, study finds appeared first on The Decoder .
