METR 在 Anthropic 的研究印证了"直觉测试"的有效性
METR 在 Anthropic 做的这项研究给 vibe-testing 背了书。如果你平时靠快速上手体验来判断模型好坏，这篇等于给你一个依据，还顺带聊了 Claude Sonnet 3.7 为什么是 2025 年最超预期的模型，做模型选型的人可以看看。
Ethan Mollick 引用 METR 在 Anthropic 内部开展的一项研究，认为该研究印证了所谓 vibe-testing（凭直觉快速评估模型）的方法有效性。
他提到 Claude Sonnet 3.7 是 2025 年最明显超出预期的模型。
Mollick 表示这与自己过去几年使用 Anthropic 模型的体验，以及 X 平台上 AI 社区的普遍共识相符。研究由 METR 完成，结合其此前对模型评估的工作，说明主观体验式测试在捕捉模型质量差异上有一定参考价值。
Leaving aside everything else about this research done by METR at Anthropic, it validates vibe-testing.
It is my experience with the quality of the past years of Anthropic AI models (& AI consensus on X). Yes, NewSonnet 3.7 was the most obviously above expectation model of 2025. https://t.co/0Aw6nCggM9
This report is categorized under AITOP's "Papers" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include Anthropic, METR, Claude Sonnet 3.7, 模型评估.
Source attribution: curated from Ethan Mollick (@emollick). Cross-source corroboration: 11 independent sources have covered this development (including Techsauce, AIGCLINK, kimmonismus), confirming industry-wide signal strength.
