产品精选

DigitalOcean 推出 Agent Learning Services,把生产环境失败会话一键转成评测

精选理由

DigitalOcean 发了个挺实用的工具:用户卡壳的会话自动变评测集,修复后还能在真实环境里先回放一遍再上线。

DigitalOcean 发布 Agent Learning Services 和 Agent Data Services 两项服务。Signals 功能会标记用户受挫或工具调用失败的会话,一键转成评测数据。随后用模拟方式在智能体真实运行环境中回放这些评测,验证修复效果再上线。核心目标是把生产环境才暴露的故障在第一个用户碰到之前拦住。

图片来源 · elvis
原文 · elvis

Your agent traces are your best eval data. The most important failures only show up in production, and they rarely make it into your test set. DigitalOcean's Signals flags sessions where users got frustrated or tools failed and turns them into evals with one click. Simulations then replay them against your fix on your agent's real harness before it ships. If you're running agents in production, you need this loop. Your browser does not support the video tag. 🔗 View on Twitter DigitalOcean @digitalocean Catch it at the first user, not the four-hundredth. A new user’s bank link fails, the agent says “try again later,” and nothing shows up in the logs. Watch a team find the bug and fix it before anyone else hits it, with Agent Learning Services and Agent Data Services, launching today. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 4 🔄 0 ❤️ 9 👀 1303 📊 3 ⚡