Back to news

AI · Official

Amazon SageMaker AI Adds Cross-Region Inference Routing to Keep Models Running

Amazon AWS Machine Learning blog ·

At a glance

Amazon has launched cross-Region inference routing for Amazon SageMaker AI. It lets an app send model requests to whichever AWS Region has spare capacity, without building its own failover code. The router only works with endpoints that are already running and does not add capacity itself.

Key points

Why it matters

Teams no longer need to write and maintain their own cross-Region failover code, which keeps AI services available when one Region runs short of GPUs.

Original source

Keep inference running through regional capacity shortfalls with cross-Region inference routing in Amazon SageMaker AI

Amazon AWS Machine Learning blog · Nov 20, 03:20 KST

Read on Amazon AWS Machine Learning blog ↗

AI summarized the original article. Check the original for accuracy. Copyright belongs to Amazon AWS Machine Learning blog.

Other coverage

AI