AI · Official
Anthropic Strengthens Defenses Against Distillation Attacks on Claude
Anthropic News (community mirror) ·
At a glance
Anthropic said it has introduced new defenses to stop 'distillation attacks,' in which other companies secretly copy Claude's abilities. Early data suggests the method cut the data taken by distillers by about 90 to 99 percent. The change also caused inconvenience for regular users, who must now change how they connect to the service.
Key points
- A distillation attack (a method of taking another AI's abilities without permission to build a similar model) is often carried out on a large scale using many fake accounts.
- Models created through distillation may lack sufficient safety guardrails, which could lead to harm in biology or cybersecurity, experts warn.
- The article says Chinese company Zhipu tried to distill Claude, and that the resulting GLM-5.3 model's safety features could be easily bypassed.
- The article also cites a case where distillation could become a national security issue. A user who appeared to be linked to the Chinese People's Liberation Army reportedly asked for CCTV surveillance analysis of a…
Why it matters
Secretly copying AI models is not just a problem for one company. It is directly tied to AI safety and national security, which is why it matters.
Original source
Strengthening our defenses against distillation attacks
Anthropic News (community mirror) · Oct 12, 09:00 KST
Read on Anthropic News (community mirror) ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to Anthropic News (community mirror).
More from this field
- AWS Quick Adds Chat-Built Flows, Updated Web App, and Teamwork Among Agents
AWS Quick added updates that let a team turn one person's work routine into a shared, repeatable process. Flows can now be built and changed entirely in chat, and they can run from the web, desktop, or mobile app. Agents working together can also give more complete answers.
Amazon AWS Machine Learning blog · Nov 21, 10:06 KST - Amazon Bedrock Web Search Adds Five Languages and Country-Based Results
Amazon's Web Search tool for Bedrock, which gives AI agents cited, up-to-date web results, now supports Spanish, French, German, Italian, and Japanese, plus non-US English. A new optional country field can also steer results toward sources from a specific country. Existing customers get the language update automatically, and pricing stays the same in every language.
AWS What's New · Nov 21, 09:17 KST - AWS Adds Shared Cache Skill to Cut Self-Hosted LLM Cost and Latency
AWS wrote about a shared cache that lets self-hosted AI models reuse saved work across servers, aiming to cut cost and wait time. The post shows how a coding agent can help set it up. Amazon says it can cut inference cost by up to 40% and first-token delay by up to 80%.
Amazon AWS Machine Learning blog · Nov 21, 09:14 KST - Can AI Really Find Black Friday TV Deals? A BBC Test Says Not Yet
A BBC team tested four popular AI chatbots to see if they could find a good Black Friday deal on a 55-inch TV. The results were mixed, with many links broken or out of date.
BBC News · Nov 21, 09:06 KST