产品官方一手
亚马逊 SageMaker 推出 13 款新推理服务
Amazon SageMaker Inference: 2026 year-to-date launches in review
精选理由
亚马逊又推了 13 款新推理服务，覆盖了从推理建议到 KV 缓存的多种功能，对开发者来说挺实用的。
亚马逊 SageMaker AI 在 2026 年上半年通过完全托管端点和 HyperPod Inference 两种部署路径，推出了 13 款新推理服务。这些服务涵盖推理建议、容量感知实例池、分层 KV 缓存以及解耦的预填充和解码功能。
原文 · AWS Machine Learning Blog
Amazon SageMaker Inference: 2026 year-to-date launches in review
Amazon SageMaker AI shipped 13 inference launches in the first half of 2026 across two deployment paths: fully managed endpoints and Amazon SageMaker HyperPod Inference. This post reviews each launch, from inference recommendations and capacity-aware instance pools to tiered KV caching and disaggregated prefill and decode.
