How-toSelected

Clay scales agent evaluations

In 13 minutes, @jeffbarg, Vyshu Khota, and Soroush Khadem walk through how Clay scaled agent evals a...

Why we picked it

Clay's evaluation framework helps developers scale AI agent testing efficiently, crucial for production deployments.

Clay achieved 300M+ agent evaluation runs per month. The video covers their four quadrant eval framework. The team explains closing the production-to-eval loop as the most challenging aspect. A data lake and long context enhanced agents' data capabilities.

Image · LangChain
Original · LangChain

In 13 minutes, @jeffbarg, Vyshu Khota, and Soroush Khadem walk through how Clay scaled agent evals a...

In 13 minutes, @jeffbarg , Vyshu Khota, and Soroush Khadem walk through how Clay scaled agent evals agents at 300M+ runs a month. Topics covered: ✅ Their four quadrant eval framework ✅ Why closing the production-to-eval loop is the hardest part ✅ How a data lake and long context changed what agents can do with data Your browser does not support the video tag. 🔗 View on Twitter 💬 0 🔄 2 ❤️ 6 👀 1217 📊 1 ⚡