ត្រឡប់ទៅព័ត៌មានវិញ

AI · ផ្លូវការ

Amazon SageMaker HyperPod Global Inference Gateway Routes AI Requests Across Regions

Amazon AWS Machine Learning blog ·

មើលត្រួសៗ

Amazon SageMaker HyperPod now has a Global Inference Gateway that sends each request to the best cluster across regions through one endpoint. Before this, clients had to choose a cluster themselves, and a busy cluster could leave requests waiting while idle GPUs sat elsewhere.

ចំណុចសំខាន់ៗ

ហេតុអ្វីវាសំខាន់

Companies can use GPU capacity they already pay for in other clusters and keep AI services running if one cluster fails.

ប្រភពដើម

Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters

Amazon AWS Machine Learning blog · Nov 21, 07:35 KST

Read on Amazon AWS Machine Learning blog ↗

AI summarized the original article. Check the original for accuracy. Copyright belongs to Amazon AWS Machine Learning blog.

AI