Jev 决策模型：用低成本小模型替 Claude 处理智能体的判断分支
LangChain 创始人转发的省钱架构：Jev 这个小模型专门接智能体里的是/否判断，Claude 只干重活，一万次决策才几毛钱。
Harrison Chase 转发了对 Jev 的一种架构思路：智能体流程中大量步骤只是 YES/NO 判断，却常被 $20-$200/月的前沿模型处理。Jev 是一个决策小模型，以带校准概率的结构化问题回答这些分支，让 Claude 等大模型专注研究与写作。用户晒出的数据包括约 1,000 篇论文分类只花 $0.08、约 500 封邮件排序约 $0.035、浏览器智能体循环约 7 秒 $0.0039。按报价计算，10,000 次 1K-token 决策约 $0.42。
good framing from @ch3nweiii - a lot of agent steps are yes/no calls, not generation Jev answers those as typed questions with calibrated probabilities, so the frontier model sticks to the hard work where those calls sit in a harness: langchain.com/blog/building-… x.com/ch3nweiii/stat… Chen @ch3nweiii whoever built this realized we've been using our smartest AI for the dumbest possible jobs your $20-$200/mo frontier model is researching, writing code, planning… and then you're paying that same brain to decide YES / NO. Jev flips that. it's a tiny decision model that sits in front of the expensive stuff and takes the boring forks: -> which agent goes next? -> is this worth researching? -> reply or ignore? -> publish, wait or escalate? -> BUY / SELL / HOLD? -> click this or keep looking? then I saw the numbers people are posting and the whole architecture started making a lot more sense. ~1,000 papers classified for around $0.08 ~500 emails sorted for around $0.035 browser-agent loops shown at around 7 seconds for ~$0.0039 and at the quoted pricing, roughly 10,000 ~1K-token decisions comes out around $0.42. that's not because Jev got smarter than Claude. it's because nobody asked it to be Claude. the setup is stupidly simple: -> big LLM gets the hard thinking, research and writing -> Jev gets the thousands of tiny decisions between those steps -> code actually clicks, saves, sends and runs and suddenly you start seeing these little decisions everywhere. > your inbox. > X feed. > support queue. > meetings. > leads. > video clips. > browser agents. > even paper-trading loops. that's the part I think most agent builders are missing. the expensive model doesn't need to touch every step just because it's able to touch every step. > let Claude think. > let Jev decide what deserves Claude. > let code do the actual work. I broke down how to wire Jev into your agent + the exact router setup in the article below Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 3 🔄 0 ❤️ 7 👀 954 📊 3 ⚡
