Understand this story
The English summary is being updated. See the reporting timeline below.
Latest development · Report
How Salesforce Scales Global Model Services with Amazon SageMaker AI Cross-Region Inference RoutingDevelopments
1 confirmed developments
- Source:AWS Machine Learning
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Nov 19
AWS Machine LearningFirst-partySelected
How Salesforce Scales Global Model Services with Amazon SageMaker AI Cross-Region Inference Routing
Salesforce uses Amazon SageMaker AI cross-Region inference routing across more than 30 global Regions, placing existing endpoints in different Regions and AWS accounts behind a unified invocation path. The router evaluates endpoint health based on request results and gradually shifts traffic, while keeping requests subject to data residency requirements within their local Region. In failover testing, approximately 78% of probe traffic was redirected to us-east-2, and the cross-Region path added less than 100 milliseconds of latency at p50.
AI Trends