精选理由
想统一管理多个模型的调用、控制成本和安全?LangSmith 这个网关能设额度、自动回退、拦截敏感数据,试试看。
LangChain 推出 LangSmith LLM Gateway 公开测试版,支持跨模型和提供商设置花费与速率限制、回退策略及敏感数据编辑。用户可在单一网关中管理 OpenAI、Anthropic 等多个模型。该功能旨在降低企业级 LLM 部署的运维成本和隐私风险。
原文 · LangChain
LangSmith LLM Gateway is now available in public beta. Set spend and rate limits, determine fallbac...
LangSmith LLM Gateway is now available in public beta. Set spend and rate limits, determine fallback policies, and redact sensitive data before it reaches a model provider, all from one gateway that works across models and providers. Learn more and try the public beta → langchain.com/blog/langsmith… 💬 2 🔄 3 ❤️ 12 👀 1353 📊 4 ⚡