AI · Article
Nota Optimizes Kimi K3.1 Pro Giant AI Model, Cutting GPU Costs by Up to 20%
www.ebn.co.kr ·
At a glance
AI efficiency company Nota has optimized the giant AI model 'Kimi K3.1 Pro' so it can run on cheaper GPUs. The same model can now run on lower-spec hardware than before, which lowers the cost of adopting it.
Key points
- Previously, the model required eight of the latest B300 GPUs, but it can now run on eight B200 GPUs, which are relatively cheaper.
- Nota used pruning, a technique that removes unnecessary parts by selecting and cutting some expert modules inside the model, reducing the expert modules by up to 37%.
- The company said the model's science reasoning test score, one of the most difficult, stayed at more than 99% of the original despite the smaller size.
- With the saved memory, the model can now read longer text at once, and its answer generation speed has also increased.
Why it matters
Expensive hardware is a major obstacle to adopting AI. This technology opens the way to using existing equipment or adopting AI at a lower cost.
Original source
노타, 초거대 AI '키미 K3.1 Pro' 최적화…GPU 구매비용 최대 20% 절감
www.ebn.co.kr · Nov 10, 08:32 KST
Read on www.ebn.co.kr ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to www.ebn.co.kr.
Other coverage
More from this field
- Designers Say Ssense's Website Shows Their Clothes Inaccurately
Designer Reese Cooper noticed his RCOS puffer coat looked distorted on the luxury retailer Ssense's website, with a chest hook drawn far too large. Ssense said some site images came from a "virtual try-on" program, though it would not say whether that program uses AI.
The New York Times · Nov 21, 06:16 KST - Walter Writes AI Tool Rewrites AI Text to Sound More Human, Ad Test Shows
This short video is a sponsored ad for Walter Writes AI, a tool that rewrites AI-generated text so it reads more like a person wrote it. The creator says they ran a paragraph through its detector, rewrote the flagged parts, and compared the scores before and after.
TheAIGRID · Nov 21, 06:15 KST - Korean Firms Build Three-Way AI Push: Anthropic Stake, HBM Chips, Claude Rollout
Korean companies are expanding their roles in the global AI market around Anthropic's IPO. SK Telecom earned large paper gains from an early investment, while Samsung Electronics and SK hynix are strengthening chip supply ties. Samsung SDS and LG CNS are bringing Anthropic's Claude model into the business AI market.
뉴스웨이 · Nov 21, 06:10 KST - MIT and IBM Team Probes Gaps in Multimodal AI Understanding
MIT and IBM researchers are studying where today's multimodal AI models fall short, even when they handle text, images, and sound fluently. Their team, co-led by MIT's Jim Glass, builds new benchmarks and training methods that need less labeled data. This Q&A walks through how the project started and how it has evolved.
MIT News · Nov 21, 06:00 KST