Manual Review Challenges at Scale with LangSmith
Manual review works at small scale. At millions of agent runs a month, it falls apart, so @Clay reli...
Clay discusses LangSmith's challenges scaling manual review, highlighting the shift to online evaluators and insights products. Worth checking out for insights on scaling AI tools.
LangSmith's manual review process struggles at scale, with Clay relying on online evaluators and insights products for agent behavior understanding. @jeffbarg discusses the issue. Video available on Twitter.
Manual review works at small scale. At millions of agent runs a month, it falls apart, so @Clay reli...
Manual review works at small scale. At millions of agent runs a month, it falls apart, so @Clay relies on LangSmith's online evaluators and is testing its insights product to understand agent behavior. @jeffbarg explains. Your browser does not support the video tag. 🔗 View on Twitter 💬 2 🔄 1 ❤️ 7 👀 1996 📊 3 ⚡