做智能体开发的团队终于有了一个能自动迭代优化的工具——LangSmith Engine 把反馈闭环做成了产品，省去手动调优的繁琐，建议正在构建复杂 Agent 的开发者点开看看。
LangSmith Engine 是一个帮助开发者构建自优化循环的智能体系统。它通过观察自身输出、评估质量并利用反馈信号持续改进，使智能体的性能飞轮越转越快。关键功能包括自动分类用户反馈、每次修复附带在线评估防止退化、生成离线测试用例，以及根据用户偏好持续调优。创始人 Palash Shah 认为，LLM 评估的可靠性提升是这一系统流行的核心原因。目前该工具已获得大量采用，且使用越多效果越好。
langsmith engine is an agent that helps you spin the optimization loop for your own agents
langsmith engine is an agent that helps you spin the optimization loop for your own agents Palash Shah @palashshah everyone is talking about self-optimizing loops in software & agents. but what does that actually mean? in my mind, it's a system that observes it's own outputs, evaluates them, and uses that signal to improve itself in the future. the reason why it has become so popular now, is because the evaluation step is finally reliable with llms. this wasn't really the case a year ago. this is why i'm so bullish on langsmith engine. we've incorporated a ton of different concepts that allow developers to invest in this self-optimizing loop that makes the improvement flywheel spin faster & faster. some examples of this include > feedback you leave on traces are automatically triaged > every fix that we suggest has an online evaluator, so you never regress > we create offline evals that you can add to your test suite > we continually learn on your preferences, and tune our evaluation & fix step based on this and we're seeing crazy adoption, and lots of growth across our customers. it is truly something that just gets better the more time you spend on it. 🔗 View Quoted Tweet 💬 10 🔄 1 ❤️ 20 👀 5894 📊 11 ⚡