Simulations 功能让智能体可在真实对话上做端到端测试
做智能体的朋友注意了,Simulations 能拿真实生产对话来测你的 agent,还自动 mock 掉付费调用,测试不用烧 API 钱。
Simulations 可以基于真实生产环境的对话来模拟智能体的运行,对每次交互进行打分评估。测试中涉及的付费调用会被 mock 掉,避免产生实际成本。这样开发者能够端到端地验证智能体在真实场景中的表现,不必烧钱跑真实 API。这条推文认为模拟测试是本次发布中最有价值的功能。
I think Simulations will be huge (and it's probably the best feature of this release).
Basically, this will let you simulate how your agent works across real production conversations. It will score interactions and mock anything that costs money, so you can test everything end-to-end.