AI<\/a> research, distillation is now at the centre of a growing dispute over whether advanced AI capabilities can be transferred without the consent of the companies that created them.<\/p>\nWashington and \u200bleading U.S. AI firms have accused Chinese rivals of using the technique to extract capabilities from proprietary models, opening a new front in an increasingly bitter competition over technological leadership.<\/p>\n
Below are key facts about the practice at the centre of the debate.<\/p>\n
WHAT IS MODEL DISTILLATION?<\/p>\n
The largest AI models, known as frontier models, require enormous amounts of computing power, data and investment to train.<\/p>\n
Model distillation offers a way to create smaller systems by using a large “teacher” model to train a smaller “student” model.<\/p>\n
The teacher generates examples, \u200csuch as answers and computer code, which are then used \u2060as training material for the student.<\/p>\n
The smaller model is not a replica of the teacher. It does not inherit the teacher’s weights, architecture or full capabilities. Instead, it learns selected behaviours that enable it to perform specific tasks more efficiently.<\/p>\n
WHY DOES \u2060DISTILLATION MATTER?<\/p>\n
The appeal of distillation is that it can make AI cheaper and easier to deploy.<\/p>\n
A frontier model may require large data centres and expensive chips to operate. Distilled models can run on less powerful hardware and be tailored for specific tasks.<\/p>\n
That makes them appealing to companies and governments looking to deploy AI more widely, from devices and factories \u200bto \u200bvehicles and private networks.<\/p>\n
WHY ARE REASONING TRACES IMPORTANT?<\/p>\n
Recent AI systems have increased interest in transferring \u200bnot only final answers but also the steps used to reach \u200cthem.<\/p>\n
These “reasoning traces” can show a smaller model how to approach a difficult problem rather than simply what answer to produce.<\/p>\n
Florian Tram\u00e8r, an assistant professor at ETH Zurich who researches machine-learning security, compared the process to human learning.<\/p>\n
“If I give you a book of complicated math problems with final solutions, you will have a much harder time learning how to solve problems than if I gave you detailed solutions that describe all steps to take,” he said.<\/p>\n
As reasoning traces have become more valuable, access to AI outputs has become more sensitive because they may expose some of the methods advanced systems use to tackle complex problems.<\/p>\n
WHO USES DISTILLATION?<\/p>\n
Distillation \u200cis a widely used AI training technique, not an inherently improper practice.<\/p>\n
U.S. researchers and companies \u200bhave long used it, including Stanford University’s Alpaca project and Microsoft’s Orca research, which relied on \u200boutputs from more advanced models to improve smaller ones.<\/p>\n
Chinese researchers have also \u200bused outputs from U.S. models in public research projects, including efforts to create Chinese-language instruction models.<\/p>\n
The key difference lies in access. \u200cOpen-weight models let researchers inspect and modify underlying parameters. Closed models, \u200bsuch as OpenAI’s ChatGPT and Anthropic’s Claude, \u200bremain under company control and are typically accessed through proprietary interfaces or APIs.<\/p>\n
WHY HAS DISTILLATION BECOME A U.S.-CHINA ISSUE?<\/p>\n
The controversy is less over distillation itself and more about unauthorised extraction.<\/p>\n
AI companies argue there is a distinction between legitimate research and systematically harvesting outputs from proprietary models to replicate commercially \u200bvaluable capabilities.<\/p>\n
Anthropic has accused Chinese entities including DeepSeek, Moonshot and \u200cMiniMax of conducting large-scale campaigns to obtain capabilities from Claude models.<\/p>\n
The company said those efforts targeted capabilities including software engineering and advanced \u200breasoning.<\/p>\n
OpenAI has also said it has detected attempts by Chinese actors to use its models for distillation-related purposes.<\/p>\n
No Chinese companies have accused U.S. \u200brivals of distilling closed-source models so far.<\/p>\n
(Reporting by Eduardo BaptistaEditing by Shri Navaratnam)<\/p>\n","protected":false},"excerpt":{"rendered":"By Eduardo Baptista BEIJING, July 31 (Reuters) – A technique that allows developers to shrink powerful artificial intelligence…\n","protected":false},"author":2,"featured_media":125404,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[24,25,1934,10568,16108,18855],"class_list":["post-125403","post","type-post","status-publish","format-standard","has-post-thumbnail","category-ai","tag-ai","tag-artificial-intelligence","tag-artificial-intelligence-models","tag-capabilities","tag-distillation","tag-proprietary-models"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/125403","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=125403"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/125403\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/125404"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=125403"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=125403"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=125403"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}