Hamel Husain 与 Shreya Shankar 发布进阶版 Evals 构建指南
源：https://t.co/zGoiQqJJ4c
25 个 PM 岗位近一半要求会写 evals，这篇续篇教你哪些步骤别跳过，还带免费插件让 agent 干活
Lenny Rachitsky 联合 Hamel Husain 与 Shreya Shankar 发布进阶教程《Building eval systems that improve your AI product》续篇。两人基于与 50 多家 AI 公司的合作经验，讲解多数团队会跳过的关键步骤、哪些环节该自动化哪些不该。文中提到 Ramp 借助 evals 将自动收据识别准确率从 35% 提升到 83%，Shopify 的 AI workflow builder 比原前沿模型方案快 2.2 倍、成本低 68%。Harvey 重构 AI 合同审查后内部质量分接近翻倍，Cursor 调优 Auto Balance 路由后在成本降低 41% 的同时提升用户满意度。教程还附带一个免费插件，可让 coding agent 承担大部分工作量。
源：https://t.co/zGoiQqJJ4c
源： x.com/lennysan/statu… Lenny Rachitsky @lennysan Evals have been coming up more and more in my conversations with podcast guests and PM friends. Nearly half of the 25 awesome PM job openings I shared last week ask for experience writing evals. And leading companies keep sharing what investing in evals bought them: — @tryramp took its automatic receipt collection from 35% to 83% accuracy. — @Shopify shipped an AI workflow builder that's 2.2x faster and 68% cheaper than the frontier-model setup it replaced. — @harvey__ai rebuilt its AI contract reviewer, nearly doubling its internal quality score. — @cursor_ai tuned its Auto Balance routing, with much higher user satisfaction at 41% lower cost. So I asked the 🐐s of evals, @HamelHusain and @sh_reya , to write an advanced sequel to their very popular "Building eval systems that improve your AI product." Drawing on their work with 50+ AI companies, they share the key step most teams skip, what you should (and shouldn't) automate, and a free plugin that lets a coding agent do most of the heavy lifting. Read it here: lennysnewsletter.com/p/advanced-eva… F 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 0 👀 162 ⚡
