METR 发布 Anthropic 内部 AI 加速研发评估报告,遭质疑视角过于内向
this METR report on AI R&D acceleration at Anthropic is very inward looking imo. it counts the lab's...
METR 拿 Anthropic 内部数据做了份报告,说研发提速 80% 靠 AI,但有人认为真正加速发生在实验室外面的生态里,两边观点都值得看看。
METR 团队自 8 月起接触 Anthropic 内部信息,评估 AI 是否在加速 AI 研发,并发布总结报告。报告统计了该实验室的算力、招聘与内部数据,将约 80% 的研发提速归因于 AI 本身。Thom Wolf 对此提出批评,认为报告只看实验室内部因素,忽视了外部生态的作用。他指出数据与 RL 环境供应商往往先于实验室发现模型短板,实验室直接采购这些成果,使部分加速实际发生在实验室之外。
this METR report on AI R&D acceleration at Anthropic is very inward looking imo. it counts the lab's...
this METR report on AI R&D acceleration at Anthropic is very inward looking imo. it counts the lab's compute, hires and internal data, then credits ~80% of the speed-up to AI what I see from the outside: labs are becoming schelling points for money, redistributing it to an ecosystem they created to accelerate their own development it's a symbiosis. the best data and RL environment companies now know where models will fail before the labs do, and the labs just buy what they propose. that feeds back into every lab at once a lot of the "AI accelerating AI R&D" happens outside the lab METR @METR_Evals Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment. 🔗 View Quoted Tweet 💬 1 🔄 2 ❤️ 15 👀 1641 📊 3 ⚡