AI · Official
Amazon SageMaker HyperPod Global Inference Gateway Routes AI Requests Across Regions
Amazon AWS Machine Learning blog ·

At a glance
Amazon SageMaker HyperPod now has a Global Inference Gateway that sends each request to the best cluster across regions through one endpoint. Before this, clients had to choose a cluster themselves, and a busy cluster could leave requests waiting while idle GPUs sat elsewhere.
Key points
- One gateway routes requests across every HyperPod cluster you register, in one region or several.
- It picks a cluster using live load signals and carries the request over the AWS network.
- If a cluster fails, traffic moves to other clusters automatically.
- Requests are signed and checked with AWS SigV4 and IAM, and routing inside each cluster stays the same.
Why it matters
Companies can use GPU capacity they already pay for in other clusters and keep AI services running if one cluster fails.
Original source
Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters
Amazon AWS Machine Learning blog · Nov 21, 07:35 KST
Read on Amazon AWS Machine Learning blog ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to Amazon AWS Machine Learning blog.
More from this field
- AWS Marketplace Lets AI Agents Buy Software on Their Own
AWS has updated its AWS Marketplace so AI agents can buy software, APIs, data, and content on their own, not just find them. Buyers pay in dollars, and charges are added to their AWS bill.
디지털투데이 · Nov 21, 07:37 KST - Google Drops Search Button and Adds AI Sidebar to Its Search Homepage
Google has officially rolled out a redesigned desktop search homepage after a successful test. The Google Search button next to the search bar is gone, and a row of AI buttons now sits under the bar. Logged-in users also get a sidebar showing their recent AI Mode conversations.
Ars Technica · Nov 21, 06:58 KST - Meta Rethinks 2030 Net-Zero Goal as AI Data Center Emissions Hit Record High
Meta's 2026 sustainability report said the company is re-evaluating its 2030 net-zero goal. Its emissions rose about 40 percent from 2024 to 2025, the largest jump among the big US tech companies.
Ars Technica · Nov 21, 06:47 KST - Anthropic Mathematician Says Claude Helped Crack the Riemann Hypothesis
Levent Alpöge, a mathematician at Anthropic, says he has proved the Riemann hypothesis with help from Claude, Anthropic's AI system. Instead of a regular math paper, he posted a four-page note and linked to computer code that he says checks the result. The claim still needs to be verified.
The New York Times · Nov 21, 06:47 KST