ProductsOfficial

亚马逊 SageMaker 推出 13 款新推理服务

Amazon SageMaker Inference: 2026 year-to-date launches in review

Why we picked it

亚马逊又推了 13 款新推理服务,覆盖了从推理建议到 KV 缓存的多种功能,对开发者来说挺实用的。

亚马逊 SageMaker AI 在 2026 年上半年通过完全托管端点和 HyperPod Inference 两种部署路径,推出了 13 款新推理服务。这些服务涵盖推理建议、容量感知实例池、分层 KV 缓存以及解耦的预填充和解码功能。

Image · AWS Machine Learning Blog
Original · AWS Machine Learning Blog

Amazon SageMaker Inference: 2026 year-to-date launches in review

Amazon SageMaker AI shipped 13 inference launches in the first half of 2026 across two deployment paths: fully managed endpoints and Amazon SageMaker HyperPod Inference. This post reviews each launch, from inference recommendations and capacity-aware instance pools to tiered KV caching and disaggregated prefill and decode.

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Amazon, SageMaker, inference services.

Primary source verification: published directly by AWS Machine Learning Blog with first-party authority.