LangSmith 创业公司聚焦:Opine 用评测流程守住每一次 prompt 改动
LangChain 介绍了客户情报创业公司 Opine,他们把每条生产 LLM 调用都接入 LangSmith 追踪,改 prompt 或换模型必须先过评测,做 LLM 运维的可以参考这套做法。
LangChain 在 LangSmith for Startups 系列中介绍了客户情报初创公司 @tryopine。Opine 定位为面向销售团队(revenue teams)的客户情报层,通过 LangSmith 追踪每一条生产环境 LLM 调用。该公司将每次 prompt 和模型变更都置于 LangSmith evals 评测门禁之后,未通过评测不上线。Opine 目前正在招聘 GTM 与工程岗位。
LangSmith for Startups spotlight: @tryopine The customer intelligence layer for revenue teams Opine traces every production LLM run through LangSmith, and gates every prompt and model change behind LangSmith evals. See what Opine looks like on your hardest open deal at tryopine.com . And if you'd rather help build the context customer intelligence layer than buy it, they’re hiring across GTM and engineering! Your browser does not support the video tag. 🔗 View on Twitter 💬 0 🔄 0 ❤️ 3 👀 1211 ⚡
- shao__meng10-15 04:18原文