精选理由
想给AI接口加限流?AgentCore网关支持按用户和按目标设请求数、令牌数和连接数,配合JWT或IAM就能精准控流量。
本文介绍如何在Amazon Bedrock AgentCore网关上配置速率限制。通过定义请求、令牌和连接数限制,可按JWT声明或IAM身份作用到具体用户或目标。这样可以保护下游模型、工具和智能体免受流量激增影响。
原文 · AWS Machine Learning Blog
Configure rate limits for AI traffic on AgentCore gateway
Learn how to configure rate limits on Amazon Bedrock AgentCore gateway to enforce per-user and per-target traffic controls. Define request, token, and connection limits scoped by JWT claims or IAM identity to protect downstream models, tools, and agents from traffic spikes.