Why blocking China’s DeepSeek from using US AI may be difficult

Top White House advisers this week expressed alarm that China’s DeepSeek may have benefited from a method that allegedly piggybacks off the advances of US rivals called “distillation.”

The technique, which involves one AI system learning from another AI system, may be difficult to stop, according to executive and investor sources in Silicon Valley.

DeepSeek this month rocked the technology sector with a new AI model that appeared to rival the capabilities of US giants like OpenAI, but at much lower cost. And the China-based company gave away the code for free.


Smartphone displaying the logo of Chinese artificial intelligence application Deepseek
China’s DeepSeek may have been developed by learning from American AI services. Christopher Sadowski

Some technologists believe that DeepSeek’s model may have learned from US models to make some of its gains.

The distillation technique involves having an older, more established and powerful AI model evaluate the quality of the answers coming out of a newer model, effectively transferring the older model’s learnings.

That means the newer model can reap the benefits of the massive investments of time and computing power that went into building the initial model without the associated costs.

This form of distillation, which is different from how most academic researchers previously used the word, is a common technique used in the AI field.

However, it is a violation of the terms of service of some prominent models put out by US tech companies in recent years, including OpenAI.

The ChatGPT maker said that it knows of groups in China actively working to replicate US AI models via distillation and is reviewing whether or not DeepSeek may have distilled its models inappropriately, a spokesperson told Reuters.


Hand holding a smartphone displaying the Deepseek logo, Chinese artificial intelligence application
According to tech industry experts, it may be difficult for the US government to prevent DeepSeek from “distillation.” Christopher Sadowski

Naveen Rao, vice president of AI at San Francisco-based Databricks, which does not use the technique when terms of service prohibit it, said that learning from rivals is “par for the course” in the AI industry. Rao likened this to how automakers will buy and then examine one another’s engines.

“To be completely fair, this happens in every scenario. Competition is a real thing, and when it’s extractable information, you’re going to extract it and try to get a win,” Rao said. “We all try to be good citizens, but we’re all competing at the same time.”

Howard Lutnick, President Donald Trump’s nominee for Secretary of Commerce who would oversee future export controls on AI technology, told the US Senate during a confirmation hearing on Wednesday that it appeared DeepSeek had misappropriated US AI technology and vowed to impose restrictions.

“I do not believe that DeepSeek was done all above board. That’s nonsense,” Lutnick said. “I’m going to be rigorous in our pursuit of restrictions and enforcing those restrictions to keep us in the lead.”

David Sacks, the White House’s AI and crypto czar, also raised concerns about DeepSeek distillation in a Fox News interview on Tuesday.

DeepSeek did not immediately answer a request for comment on the allegations.

OpenAI added it will work with the US government to protect US technology, though it did not detail how.

“As the leading builder of AI, we engage in countermeasures to protect our IP, including a careful process for which frontier capabilities to include in released models,” the company said in a statement.

The most recent round of concern in Washington about China’s use of US products to advance its tech sector is similar to previous concerns about the semiconductor industry, where the US has imposed restrictions on what chips and manufacturing tools can be shipped to China and is examining restricting work on certain open technologies.

NEEDLE IN A HAYSTACK

Technologists said blocking distillation may be harder than it looks.

One of DeepSeek’s innovations was showing that a relatively small number of data samples — fewer than one million — from a larger, more capable model could drastically improve the capabilities of a smaller model.

When popular products like ChatGPT have hundreds of millions of users, such small amounts of traffic could be hard to detect — and some models, such as Meta Platforms’ Llama and French startup Mistral’s offerings, can be downloaded freely and used in private data centers, meaning violations of their terms of service may be hard to spot.

“It’s impossible to stop model distillation when you have open-source models like Mistral and Llama. They are available to everybody. They can also find OpenAI’s model somewhere through customers,” said Umesh Padval, managing director at Thomvest Ventures.

The license for Meta’s Llama model requires those using it for distillation to disclose that practice, a Meta spokesperson told Reuters.

DeepSeek in a paper did disclose using Llama for some distilled versions of the models it released this month, but did not address whether it had ever used Meta’s model earlier in the process.

The Meta spokesperson declined to say whether the company believed DeepSeek had violated its terms of service.

One source familiar with the thinking at a major AI lab said the only way to stop firms like DeepSeek from distilling US models would be stringent know-your-customer requirements similar to how financial companies identify with whom they do business.

But nothing like that is set in stone, the source said. The administration of former President Joe Biden had put forth such requirements, which President Donald Trump may not embrace.

The White House did not immediately respond to a request for comment.

Jonathan Ross, chief executive of Groq, an AI computing company that hosts AI models in its cloud, has taken the step of blocking all Chinese IP addresses from accessing its cloud to block Chinese firms from allegedly piggybacking off the AI models it hosts.

“That’s not sufficient, because people can find ways to get around it,” Ross said. “We have ideas that would allow us to prevent that, and it’s going to be a cat and mouse game … I don’t know what the solution is. If anyone comes up with it, let us know, and we’ll implement it.”

Source link

Visited 1 times, 1 visit(s) today

Related Article

Nothing Headphone (1) bring 40mm drivers, hybrid ANC and up to 80 hours of playback

Nothing started out its journey with its Ear (1) wireless earbuds, and the brand is now launching its first over-ear headphones – the aptly named Headphone (1). These come with the signature Nothing transparent look on the outside of the earcups and are primed to challenge the flagship noise-cancelling headphones from brands like Sony, Bose

vivo X200 FE in for review

You don’t see minis like this these days – not outside of China, anyway. Say hello to the vivo X200 FE! Globally, if you want a tiny flagship, you have only a few choices, and if specs are anything to go by, none that can challenge the X200 FE in terms of an overall package.

Samsung Galaxy A06 4G receives One UI 7 stable update

Samsung has released the Android 16-based One UI 8 beta for its flagships, but it’s yet to complete the rollout of One UI 7, which is based on Android 15. The Korean brand has been expanding the rollout of stable One UI 7 for its Galaxy devices, and the latest device to receive the One

Nothing Phone (3) hands-on – GSMArena.com news

Nothing has a new flagship phone – say hello to the Nothing Phone (3). The freshly announced Phone (3) arrives nearly two years after the Phone (2), and there are plenty of differentiating factors between the two. Let’s start with the back, since it’s always been a key area on Nothing devices. Phone (3) brings

Nothing’s ‘first true flagship’ phone plays it a little safe

“The Glyph interface is not a gimmick,” Nothing founder and CEO Carl Pei told the press as he revealed the Nothing Phone 3 for the first time, shortly before announcing that its new iteration lets you play Spin the Bottle on the back of the phone. It’s mixed messaging, but in Nothing’s defense, you couldn’t

What the End of COVID Mask Mandates Has Meant for Baristas

Though new strains of coronavirus are going around, most establishments have lifted mask mandates and aren’t planning to bring them back. Today, we explore how this has been impacting coffee workers. BY MELINA DEVONEYBARISTA MAGAZINE ONLINE Featured photo by Getty Images Lara* is a server at a busy high-end restaurant in Los Angeles. She continued

Nothing Phone (3) brings Glyph Matrix, Snapdragon 8s Gen 4 and 5,150mAh battery

The Nothing Phone (3) is one of the most anticipated phones of the year and it brings a bold redesign alongside several generational spec upgrades. The Glyph Interface has evolved into the Glyph Matrix – a monochrome LED display located at the top left corner of the phone’s back. Comprised of 489 individually lit

Realme GT 7 series first in line to get Android 16, followed by GT 6

In a short press release Realme promised to be among the first to deliver Android 16 to its flagship lineup. Of course, it’s no surprise that the GT 7 series will be the first phones from Realme’s portfolio to get the latest and greatest from Google. The Realme GT 7 Pro with Snapdragon 8 Elite,

Europe Mobile Phone Insurance Ecosystem Market 2025 Industry

Mobile Phone Insurance Ecosystem Market Introduction: The Mobile Phone Insurance Ecosystem Market is experiencing significant growth, fueled by the increasing sophistication and value of mobile devices, coupled with a heightened consumer awareness of potential risks. The market’s expansion is driven by several key factors, including the rising cost of smartphones, the increasing reliance on mobile

Google Pixel 10 Pro and Pixel 10 Pro XL’s specs surface

Google is expected to unveil the Pixel 10 series next month, and although the Mountain View-based internet search giant hasn’t divulged any details about the lineup yet, CAD-based renders that leaked in March revealed what the Pixel 10 series smartphones would look like. The same source has now shared specs of the Google Pixel 10

RedMagic Astra Gaming Tablet launches globally, starts from €469/$469

RedMagic’s Tablet 3 Pro launched in China last month, and it’s now ready to take on global markets. Now called the RedMagic Astra Gaming Tablet, this is every bit the compact tablet beast that its Chinese counterpart is. The tablet is built around a 9.06-inch display with uniform 4.9mm bezels. The panel is outstanding –

Baseus brings latest Enercore chargers and powerbanks with retractable USB-C cables

Originally announced back at CES, Baseus is now bringing its Enercore line of chargers and power banks globally. These come in several sizes with multiple ports, up to 100W charging speeds and max out at 20,000mAh capacities. They also share one common killer feature – retractable USB-C cables. Enercore CJ11 is the most compact offering

OnePlus Nord CE5 in for review

Today we are taking a look at the new OnePlus Nord CE5, the second phone launching next week alongside the Nord 5. We have already taken a look at the Nord 5 in a separate post and now it’s time to unbox the Nord CE5. For those unaware, the Nord series goes Nord > Nord

OnePlus Nord 5 in for review

Today we have with us the new OnePlus Nord 5, which is the latest mainline entry in the company’s affordable series of smartphones. The phone is set to launch next week alongside the Nord CE5 and today we can share a sneak peek at the device with an unboxing. Starting with the packaging, the Nord

iPhone 17 Pro series to get repositioned Apple logo

Apple may be looking to change more than the camera islands on its iPhone 17 Pro series as leakster Majin Bu is now confident that the Apple logo on the back is getting repositioned. The logo on the 17 Pro series would be positioned lower, and Apple is apparently also changing the placement of its

Oxford Spires Academy ditches smartphones for ‘brick’ phones

BBC Head teacher Louise Cowley took the decision to introduce a blanket ban over concerns smartphones were too disruptive A secondary school has banned smartphones for Year 7 to 11 pupils and will only allow basic “brick” phones from September. Oxford Spires Academy’s head teacher said the move would create a “calmer, more focused environment”.

vivo X Fold5’s India launch teased

vivo recently teased the launch of the X200 FE in India, and now the brand has announced the X Fold5 is “coming soon” to the country. vivo hasn’t revealed the launch date of the X Fold5 or the X200 FE in India, but we’ve learned from a reliable source that both smartphones will launch in

0
Would love your thoughts, please comment.x
()
x