ProductsOfficialSelected

Salesforce Uses SageMaker for Multi-AZ HA

Spreading the load: How Salesforce met Multi-AZ HA with SageMaker Inference Components

Why we picked it

Salesforce's solution provides a blueprint for enterprises in ASEAN needing high availability without increased costs on AWS.

Salesforce implemented Amazon SageMaker AI Inference Component placement to distribute model copies across multiple Availability Zones. This solution met their Multi-AZ high availability compliance requirements. The approach maintained cost efficiency through multi-model co-hosting. The SchedulingConfig parameter enabled this distributed deployment.

Image · AWS Machine Learning Blog
Original · AWS Machine Learning Blog

Spreading the load: How Salesforce met Multi-AZ HA with SageMaker Inference Components

Learn how Salesforce used Amazon SageMaker AI Inference Component placement (the SchedulingConfig parameter) to distribute model copies across multiple Availability Zones, meeting their Multi-AZ high availability compliance requirements without sacrificing the cost efficiency of multi-model co-hosting.