精选理由
AWS教你用ECS+Fargate部署LiteLLM网关,连接OpenAI模型到Bedrock,还对比了两种访问方案。
AWS博客介绍如何在Amazon ECS上部署LiteLLM网关,连接OpenAI模型到Amazon Bedrock。配置Codex通过网关的Responses API路由请求,支持范围身份、预算、速率限制和遥测功能。文章比较了直接IAM Identity Center访问和管理的Portkey部署方案。
原文 · AWS Machine Learning Blog
Set up OpenAI ChatGPT Codex with LiteLLM on Amazon ECS and Amazon Bedrock
Deploy a customer-operated LiteLLM gateway on Amazon ECS with AWS Fargate, connect it to an OpenAI model on Amazon Bedrock, and configure Codex to route requests through the gateway's Responses API with scoped identities, budgets, rate limits, and telemetry. We also compare direct IAM Identity Center access and a managed Portkey deployment.