亚马逊 SageMaker 推出 13 款新推理服务
Amazon SageMaker Inference: 2026 year-to-date launches in review
亚马逊又推了 13 款新推理服务,覆盖了从推理建议到 KV 缓存的多种功能,对开发者来说挺实用的。
亚马逊 SageMaker AI 在 2026 年上半年通过完全托管端点和 HyperPod Inference 两种部署路径,推出了 13 款新推理服务。这些服务涵盖推理建议、容量感知实例池、分层 KV 缓存以及解耦的预填充和解码功能。
Amazon SageMaker Inference: 2026 year-to-date launches in review
Amazon SageMaker AI shipped 13 inference launches in the first half of 2026 across two deployment paths: fully managed endpoints and Amazon SageMaker HyperPod Inference. This post reviews each launch, from inference recommendations and capacity-aware instance pools to tiered KV caching and disaggregated prefill and decode.
This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Amazon, SageMaker, inference services.
Primary source verification: published directly by AWS Machine Learning Blog with first-party authority.