Back to news

AI · Official

Salesforce Uses Cross-Region Routing in SageMaker AI to Handle Global AI Traffic Spikes

Amazon AWS Machine Learning blog ·

At a glance

Salesforce's Agentforce Foundation team runs AI models in more than 30 AWS Regions. Its capacity was spread across those Regions, so traffic spikes in one place could cause outages. It set up cross-Region inference routing in Amazon SageMaker AI to send each request to an endpoint that has room.

Key points

Why it matters

Spreading AI capacity across regions shows how large companies can keep AI services running during traffic spikes while keeping customer data in its home region.

Original source

How Salesforce is advancing global-scale model serving with cross-Region inference routing in Amazon SageMaker AI

Amazon AWS Machine Learning blog · Nov 19, 05:13 KST

Read on Amazon AWS Machine Learning blog ↗

AI summarized the original article. Check the original for accuracy. Copyright belongs to Amazon AWS Machine Learning blog.

AI