LangSmith LLM Gateway 新增客户级速率与支出控制

👤Customer-Specific Controls with LangSmith LLM Gateway Set rate and spend limits for each customer...

精选理由

LangChain 给 LangSmith 网关加了按客户限速限预算的功能,一个 key 管多人,不怕超支。

AI 摘要

LangSmith LLM Gateway 上线了客户维度控制,可为每个客户和用户单独设定速率与消费上限。管理员只需一个 API 密钥就能通过 LangSmith 管理多个租户的配额。该功能让用量更可预测,避免个别客户超限引发意外账单。LangChain 在官方博客中介绍了这一更新。

原文 · LangChain

👤Customer-Specific Controls with LangSmith LLM Gateway Set rate and spend limits for each customer...

👤Customer-Specific Controls with LangSmith LLM Gateway Set rate and spend limits for each customer and user under a single API key. Keep usage predictable, simplify customer management, and avoid surprise model bills. langchain.com/blog/langsmith… A 💬 0 🔄 2 ❤️ 10 👀 2389 📊 2 ⚡