AI · Article
Moonshot AI Releases Weights for Kimi K3.1 Pro, Combining DeepSeek's Sparse Attention
AI타임스 ·

At a glance
Moonshot AI has released the weights (the learned numerical values that make up a model) of its AI model Kimi K3.1 Pro on Hugging Face. This means developers can run and modify the model on their own servers. The release also revealed that its internal structure incorporates DeepSeek's sparse attention technology.
Key points
- The model has 2.8 trillion total parameters, but uses only 104 billion of them when generating answers.
- It includes DSA technology, which reduces computation when processing long texts by selecting and looking at only the tokens it needs to reference.
- It is designed to use low-precision number formats to make calculations lighter.
- Usage is governed by a license: if revenue or user numbers exceed a certain scale, a separate agreement or displaying the model name is required.
Why it matters
When anyone can run AI models in their own environment, companies and developers have a wider range of choices.
Original source
문샷 AI, ‘키미 K3.1 프로’ 가중치 공개…"딥시크 희소 어텐션 결합"
AI타임스 · Nov 5, 17:58 KST
Read on AI타임스 ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to AI타임스.
Moonshot AI · Ranking and more news
More from this field
- Designers Say Ssense's Website Shows Their Clothes Inaccurately
Designer Reese Cooper noticed his RCOS puffer coat looked distorted on the luxury retailer Ssense's website, with a chest hook drawn far too large. Ssense said some site images came from a "virtual try-on" program, though it would not say whether that program uses AI.
The New York Times · Nov 21, 06:16 KST - Korean Firms Build Three-Way AI Push: Anthropic Stake, HBM Chips, Claude Rollout
Korean companies are expanding their roles in the global AI market around Anthropic's IPO. SK Telecom earned large paper gains from an early investment, while Samsung Electronics and SK hynix are strengthening chip supply ties. Samsung SDS and LG CNS are bringing Anthropic's Claude model into the business AI market.
뉴스웨이 · Nov 21, 06:10 KST - MIT and IBM Team Probes Gaps in Multimodal AI Understanding
MIT and IBM researchers are studying where today's multimodal AI models fall short, even when they handle text, images, and sound fluently. Their team, co-led by MIT's Jim Glass, builds new benchmarks and training methods that need less labeled data. This Q&A walks through how the project started and how it has evolved.
MIT News · Nov 21, 06:00 KST - Leaky AI Supply Chain Exposes Secret User Data at Alarming Rate
A research test sent nearly two million prompts with fake but working secrets through a network of AI services to see where they ended up. Many of the secrets were stolen, and attackers used them to reach cloud accounts. The results point to weak protection of customer data along the chain.
Ars Technica · Nov 21, 05:59 KST