ត្រឡប់ទៅព័ត៌មានវិញ

AI · អត្ថបទ

AWS Adds NVIDIA GPU Partitioning to SageMaker Inference Endpoints to Cut Costs

Unite.AI ·

មើលត្រួសៗ

AWS now lets a single GPU be split into several pieces on SageMaker real-time endpoints, so multiple models can share it. This uses resources more efficiently than giving an entire GPU to one model. However, it does not benefit every workload.

ចំណុចសំខាន់ៗ

ហេតុអ្វីវាសំខាន់

When serving AI models, GPU costs could drop significantly, which may help companies run AI more cheaply.

ប្រភពដើម

AWS, SageMaker 추론 엔드포인트에 NVIDIA GPU 분할 기능 추가

Unite.AI · Nov 7, 03:23 KST

Read on Unite.AI ↗

AI summarized the original article. Check the original for accuracy. Copyright belongs to Unite.AI.

Amazon Web Services · ចំណាត់ថ្នាក់ និងព័ត៌មានបន្ថែម