(Yicai) May 29 — Mainstream demand for artificial intelligence computing in China is gradually shifting toward inference, which is creating new opportunities for domestic chips, according to industry insiders.<\/p>\n
Before, Chinese data centers mainly relied on Nvidia chips because of the high-performance requirements for AI model training, with only a few using domestically developed alternatives, mostly as backup, Zhou Zhengang, vice president of International Data Corporation China, told Yicai.<\/p>\n
But after the release of open-source, high-performance large language model DeepSeek-R1, more users have begun deploying LLMs in real-world applications, driving demand for AI inference, Zhou noted, adding that this shift creates opportunities for less powerful and more affordable domestic chips.<\/p>\n
AI inference requires less computing power than AI training, enabling chips with performances lower than Nvidia\u2019s H100 and H800 to be viable, said Rocky Cheng, chief executive officer of Cyberport\u2019s Artificial Intelligence Supercomputing Center, which is Hong Kong’s largest AI supercomputing center, mainly serving local universities, research institutions, and enterprises.<\/p>\n
Chinese internet firms and telecoms operators procured large quantities of domestic computing cards last year but quickly found them unpopular among users, Zhou said. However, after DeepSeek-R1 was adopted on a large scale, all these resources were put into use in the first quarter of the year.<\/p>\n
\u201cTeams developing LLMs like DeepSeek-R1 will gradually decrease, and demand for inference capabilities will become mainstream,\u201d Cheng noted. \u201cOur center\u2019s next-phase computing configuration will prioritize this growing need.\u201d<\/p>\n
\u201cDomestically developed chips will account for over 40 percent of computing cards deployed in Chinese data centers in the first half of this year and exceed 50 percent soon,\u201d Zhou predicted. \u201cThis was unimaginable just two years ago.\u201d<\/p>\n
Last year, over 65 percent of the computing cards used in Chinese data centers were made by Nvidia.<\/p>\n
Editor: Futura Costaglione<\/p>\n","protected":false},"excerpt":{"rendered":"(Yicai) May 29 — Mainstream demand for artificial intelligence computing in China is gradually shifting toward inference, which…\n","protected":false},"author":2,"featured_media":140927,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3164],"tags":[61078,3284,61077,61076,61074,49553,61075,53,16,15],"class_list":{"0":"post-140926","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-computing","8":"tag-changing-market-landscape","9":"tag-computing","10":"tag-large-language-model-inference","11":"tag-large-language-model-training","12":"tag-locally-developed-ai-chips","13":"tag-market-analysis","14":"tag-nvidia-chips","15":"tag-technology","16":"tag-uk","17":"tag-united-kingdom"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@uk\/114590165945319773","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/140926","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/comments?post=140926"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/140926\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media\/140927"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media?parent=140926"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/categories?post=140926"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/tags?post=140926"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}