AI · អត្ថបទ
Nota Optimizes Moonshot AI's Kimi Model, Cutting GPU Purchase Costs by Up to 20%
머니투데이 ·
មើលត្រួសៗ
AI optimization company Nota says it shrank Moonshot AI's very large model, Kimi K3.1 Pro, so that it can run on eight cheaper GPUs. The company says this approach can reduce GPU purchase costs by up to 20%.
ចំណុចសំខាន់ៗ
- Nota applied pruning, a technique that removes less important parts of a neural network to make the model lighter.
- Nota cut expert modules by up to 37%, which lowered GPU memory use. It kept more than 99% of the original score on a difficult scientific reasoning test.
- The freed-up memory increased the amount of information the model can handle at once, up to 1 million tokens (units that AI uses to process text).
- On cloud platforms, the rental price of B200 GPUs was also found to be up to 22% lower.
ហេតុអ្វីវាសំខាន់
Large AI models require expensive hardware, so cost-cutting technology is important for helping more companies use AI.
ប្រភពដើម
노타, 中 문샷AI 모델 최적화…GPU 구매비용 최대 20% 절감 - 머니투데이
머니투데이 · Nov 10, 11:16 KST
Read on 머니투데이 ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to 머니투데이.
ការផ្សាយផ្សេងទៀត
Kimi · ចំណាត់ថ្នាក់ និងព័ត៌មានបន្ថែម
បន្ថែមពីវិស័យនេះ
- OpenAI Shows How to Claim a Shopify Store in ChatGPT
This video shows how to claim your business in ChatGPT by connecting your Shopify store. You can start in Business Hub or the Shopify App Store. After connecting, you can manage your business information to control how your store appears in ChatGPT.
OpenAI 공식 YouTube · Nov 21, 05:48 KST - OpenAI Sharply Cuts Success of Attacks on GPT-6.2 Astra and Sol Reasoning
OpenAI has greatly strengthened its defenses against attempts to pull the hidden reasoning out of its latest models, GPT-6.2 Astra and GPT-6.2 Sol. In its own internal tests, the success rate of these attacks fell sharply, and OpenAI says it is now bringing some of these improvements to GPT-6 Astra too.
The Decoder · Nov 21, 05:31 KST - Amazon Textract Insights Launches for Verifiable Document Data Extraction
Amazon has launched Amazon Textract Insights, a generative AI feature that pulls specific fields from documents. Users describe the data they want in plain language and get results with a confidence score and the page each value came from. Mixed files, such as a mortgage packet, can be split and matched automatically.
Amazon AWS Machine Learning blog · Nov 21, 05:22 KST - Etsy Sellers Close Shops Over New Policy Allowing AI Training on Their Work
Many longtime sellers on Etsy, the handmade goods marketplace, have closed their shops over new terms that let the company and its partners use seller content to train artificial intelligence. The terms take effect on Dec. 16. Etsy has defended the policy.
The New York Times · Nov 21, 05:19 KST