Chinese contentHamel Husain 与 Shreya Shankar 新书《Evals for AI Engineers》11月12日发布
做 LLM 评估的朋友注意：Hamel 和 Shreya 的新书 11 月 12 日发布，现场还送签名版，Zoom 也能听。
#Evals
9 stories · 1 in 7 days · 3 in 30 days
Stories, products and papers tagged "Evals", newest first.
Oct 22
Oct 2
Hamel's AI Product Engineering Notes
This practical guide reveals a counterintuitive optimization sequence that prioritizes retrieval and context over post-training, potentially saving significant development resources. Product teams can implement these evaluation methodologies immediately to measure improvements systematically, with the context optimization approach showing dramatic score improvements that could reshape development priorities.
Sep 29
Sep 25
Chinese contentAI Evals 免费指南汇总：5 千名工程师课程资料整理
教过 5000 名工程师做 Evals 的 Hamel Husain 把课程资料免费整理成一份指南，做评测遇到问题直接按场景查答案，还持续更新。
Sep 23
Hamel Husain and Shreya Shankar publish advanced eval systems guide
Evals are shifting from a niche skill to a hiring requirement, with roughly half of the PM openings cited explicitly demanding eval experience. Teams building AI products can use the guide's automation boundaries and free coding-agent plugin to run eval work with fewer engineers. The company benchmarks give a concrete baseline for judging whether your own eval investment pays off.
Aug 13
Chinese content改进AI智能体本质是数据挖掘问题
LangChain的Viv分享了一套改进智能体的实战思路，核心是用生产数据挖Evals，还给了Harness-PostTrain的开源模型配方。
Aug 1
Chinese contentSupabase开源Evals基准：评测Claude Code等编码智能体
Supabase开源Evals，用真实任务评估Claude Code等编码智能体，比普通基准更实战
Jul 30
Chinese contentAnthropic AI研究产品主管：Evals 是新的 PRD
Anthropic 的产品主管亲自聊他们怎么做模型评估，说 Evals 就像新版产品需求文档，对做 AI 产品和模型的朋友很有启发。
