AI · Official
Salesforce Uses Cross-Region Routing in SageMaker AI to Handle Global AI Traffic Spikes
Amazon AWS Machine Learning blog ·

At a glance
Salesforce's Agentforce Foundation team runs AI models in more than 30 AWS Regions. Its capacity was spread across those Regions, so traffic spikes in one place could cause outages. It set up cross-Region inference routing in Amazon SageMaker AI to send each request to an endpoint that has room.
Key points
- Salesforce serves its own AI models, including for Agentforce and the Trust Layer, in more than 30 global Regions.
- Capacity was split by Region, so a sudden traffic spike in one Region could cause an availability problem.
- The new router gives an application one entry point to endpoints in several Regions and accounts.
- The router keeps requests in their own Region while that endpoint works, and moves them only when needed.
Why it matters
Spreading AI capacity across regions shows how large companies can keep AI services running during traffic spikes while keeping customer data in its home region.
Original source
How Salesforce is advancing global-scale model serving with cross-Region inference routing in Amazon SageMaker AI
Amazon AWS Machine Learning blog · Nov 19, 05:13 KST
Read on Amazon AWS Machine Learning blog ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to Amazon AWS Machine Learning blog.
More from this field
- Sam Altman Shrugs Off Andrew Garfield Movie, Calls His Real Life Weirder
Sam Altman said that it no longer feels strange that a movie about him is coming out, because his life already includes stranger things. The film "Artificial" stars Andrew Garfield as Altman and tells the story of OpenAI's rise and Altman's brief firing in 2023. The movie opens in theaters on Christmas.
TechCrunch · Nov 19, 05:07 KST - AI Gets Better at Reading How Software Works, Even Hidden Code, Raising Security Questions
This short clip from NVIDIA's YouTube channel points to an NVIDIA AI Podcast episode. Hugging Face and ServiceNow discuss what AI's growing ability to figure out how software works, even hidden code, means for security.
NVIDIA 공식 YouTube · Nov 19, 05:00 KST - Snapchat Lets Developers Build AR Lenses With Claude Code and Cursor
Snapchat announced Easy Lens CLI, a tool that lets creators build AR Lenses by using AI coding assistants such as Claude Code, Cursor, and Codex. The tool builds on the existing Easy Lens, which creates Lenses from a single written prompt. Developers in the Lens+ Payouts program can earn money from the Lenses they make.
TechCrunch · Nov 19, 04:56 KST - Nvidia's Huge Profits Make It Unlikely to Rock the Boat After Huang's Exit
Nvidia now earns huge profits, about $8,300 per second, and its interim CEO Colette Kress has promised to return all excess free cash flow to shareholders. The article argues the company is unlikely to take risks that could disrupt its success, even after founder Jensen Huang's departure.
The Verge · Nov 19, 04:30 KST