AI产品精选77°

LangSmith 推出 Tuned Evaluators 评估器

🚀Today we launched LangSmith Tuned Evaluators, starting with Perceived Error. Tuned Evaluators run...

精选理由

LangSmith 新功能 Tuned Evaluators 能低成本监控 Agent 行为。

AI 摘要

LangSmith 发布了 Tuned Evaluators 功能,首发包含 Perceived Error 模块。该工具运行在生产追踪数据上,用于捕捉不理想的智能体行为。基准测试显示,其调优模型击败了前沿模型,成本降低了 82%。

原文 · Harrison Chase

🚀Today we launched LangSmith Tuned Evaluators, starting with Perceived Error. Tuned Evaluators run...

🚀Today we launched LangSmith Tuned Evaluators, starting with Perceived Error. Tuned Evaluators run on production traces to catch undesirable agent behavior and attach feedback that you can use in your agent improvement processes. In our benchmark, our tuned model beat frontier models at 82% lower cost. langchain.com/blog/introduci… Y 💬 4 🔄 5 ❤️ 17 👀 1423 📊 6 ⚡