Salesforce Uses SageMaker for Multi-AZ HA
Spreading the load: How Salesforce met Multi-AZ HA with SageMaker Inference Components
Salesforce's solution provides a blueprint for enterprises in ASEAN needing high availability without increased costs on AWS.
Salesforce implemented Amazon SageMaker AI Inference Component placement to distribute model copies across multiple Availability Zones. This solution met their Multi-AZ high availability compliance requirements. The approach maintained cost efficiency through multi-model co-hosting. The SchedulingConfig parameter enabled this distributed deployment.
Spreading the load: How Salesforce met Multi-AZ HA with SageMaker Inference Components
Learn how Salesforce used Amazon SageMaker AI Inference Component placement (the SchedulingConfig parameter) to distribute model copies across multiple Availability Zones, meeting their Multi-AZ high availability compliance requirements without sacrificing the cost efficiency of multi-model co-hosting.