{"id":178882,"date":"2025-08-27T05:05:27","date_gmt":"2025-08-27T05:05:27","guid":{"rendered":"https:\/\/www.europesays.com\/us\/178882\/"},"modified":"2025-08-27T05:05:27","modified_gmt":"2025-08-27T05:05:27","slug":"50-million-h100-gpus-computing-power-in-five-years-with-billions-surge","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/178882\/","title":{"rendered":"50 Million H100 GPUs&#8217; Computing Power in Five Years with Billions Surge"},"content":{"rendered":"<blockquote>\n<p>Elon Musk announced a crazy plan to achieve the computing power equivalent to 50 million H100 GPUs within 5 years. What does this mean? What kind of impact will it bring to humanity? Can ASI emerge under the all &#8211; in effort of the brave?<\/p>\n<\/blockquote>\n<p>The world&#8217;s richest man, Elon Musk, has decided to go all &#8211; in on AI this time.<\/p>\n<p>Achieve the computing power equivalent to 50 million H100 GPUs within 5 years.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,920\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/interlace,1.jpeg\"\/><\/p>\n<p>You know, he already has the world&#8217;s most powerful Colossus supercomputer cluster, whose AI computing power is equivalent to about 200,000 H100 GPUs.<\/p>\n<p>What on earth does he want to do with so many GPUs?<\/p>\n<p>  <strong>What kind of miracles can one trillion yuan create?<\/strong><\/p>\n<p>Currently, the wholesale price of each H100 GPU is as high as $20,000.<\/p>\n<p>For 50 million H100 GPUs, the cost of just the GPUs will be as high as $1 trillion.<\/p>\n<p>To build the most advanced supercomputer cluster at present, the cost of GPUs only accounts for about 50%.<\/p>\n<p>That is to say, the final cost will exceed $2 trillion (more than 14 trillion yuan).<\/p>\n<p>What does $2 trillion mean?<\/p>\n<p>The total military expenditure of the United States last year was about $997 billion, which already accounts for 37% of the global military expenditure.<\/p>\n<p>This means that AI has become a new key area that can compete with traditional arms races.<\/p>\n<p>Elon Musk&#8217;s net worth is about $400 billion.<\/p>\n<p>The market value of Tesla is about $1.1 trillion.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,892\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271120_743_interlace,1.jpeg\"\/><\/p>\n<p>Adding SpaceX, X, and xAI, the total market value of the companies under Elon Musk&#8217;s control is about $1.6 trillion.<\/p>\n<p>Once Moore&#8217;s Law is not effective for GPUs in the next 5 years, the cost will not decrease exponentially.<\/p>\n<p>Elon Musk is staking his and all shareholders&#8217; entire fortunes on AI, aiming to recreate a Tesla for the near &#8211; future era.<\/p>\n<p>In addition, power supply is a major problem.<\/p>\n<p>This envisioned supercomputer cluster may require power supply from more than a dozen nuclear power plants.<\/p>\n<p>But Elon Musk thinks it&#8217;s not enough.<\/p>\n<p>His ambition is to have an AI supercomputer cluster with the computing power of billions of H100 GPUs.<\/p>\n<p>Expand the scale by a hundred times.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,1536\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271121_196_interlace,1.jpeg\"\/><\/p>\n<p>Elon Musk&#8217;s technological optimism adds a logarithm to the astronomical figures.<\/p>\n<p>  <strong>Grok is already very powerful, but it&#8217;s still far from enough<\/strong><\/p>\n<p>What on earth does he want to do with so many GPUs?<\/p>\n<p>Whether it&#8217;s xAI and Tesla training models, or Neuralink and SpaceX making breakthroughs in hard &#8211; tech fields, they all require massive computing power.<\/p>\n<p>For this reason, Elon Musk built the world&#8217;s most powerful supercomputer cluster, Colossus.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,721\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271121_231_interlace,1.jpeg\"\/><\/p>\n<p>When it was first launched, it used 100,000 H100 GPUs and was built in just 19 days under extreme conditions.<\/p>\n<p>Subsequently, it was expanded to 200,000 GPUs.<\/p>\n<p>As is well known, Grok 3 was trained with 200,000 GPUs, and its computing power is ten times that of Grok 2.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,558\" src=\"https:\/\/img.36krcdn.com\/hsossms\/20250827\/v2_729738044a6e483da8dd289f540aff59@174378\uff0c0481_oswg123584oswg1080oswg558_img_000?x-oss-process=image\/format,jpg\/interlace,1\"\/><\/p>\n<p>Grok 2 was trained on 15,000 GPUs at that time.<\/p>\n<p>Until last month, the most powerful Grok 4 was launched and once again topped the charts, showing everyone the powerful strength of LLM under super &#8211; strong computing power.<\/p>\n<p>It not only topped all the charts but also crushed human doctors in the HLE test.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,672\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271123_156_interlace,1.jpeg\"\/><\/p>\n<p>At the press conference, Elon Musk also previewed the &#8220;Easter eggs&#8221; in the next few months.<\/p>\n<p>The coding model will be released in August; the multi &#8211; modal intelligent agent will be launched in September; the video generation model will be unveiled in October.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,437\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271124_410_interlace,1.jpeg\"\/><\/p>\n<p>Just in training the next &#8211; generation models, it has become a &#8220;bottomless pit&#8221; for computing power.<\/p>\n<p>In addition, the product strategy of the xAI chatbot, such as the launch of the AI girlfriend Ani, once attracted many users.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1024,1536\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271125_781_interlace,1.jpeg\"\/><\/p>\n<p class=\"img-desc\">Grok Ani&#8217;s character illustration<\/p>\n<p>Without strong computing power support, xAI cannot expand more applications.<\/p>\n<p>Having the most powerful Colossus I is not enough.<\/p>\n<p>Elon Musk also wants to use astronomical computing power to make his competitors back off.<\/p>\n<p>After all, he once boasted that &#8220;Google will not be his match in the future.&#8221;<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,152\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271125_429_interlace,1.jpeg\"\/><\/p>\n<p>Colossus II was born amidst high expectations, carrying such a grand mission.<\/p>\n<p>  <strong>Colossus II is under construction<\/strong><\/p>\n<p>Currently, Colossus 2 is being gradually implemented in batches.<\/p>\n<p>The supercomputer center is expected to launch 550,000 GB200 and GB300 GPUs in the first batch, all of which adopt liquid &#8211; cooling design and are specially built for AI training.<\/p>\n<p>In Elon Musk&#8217;s words, Colossus 2 will become &#8220;the world&#8217;s first AI training supercomputer with a computing power of over one &#8211; billion &#8211; trillion.&#8221;<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"984,250\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271125_642_interlace,1.jpeg\"\/><\/p>\n<p>Last month, he posted about the wiring of the GB200 in the supercomputer center, and the density was quite spectacular.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,926\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271126_708_interlace,1.jpeg\"\/><\/p>\n<p>As early as February this year, xAI purchased a campus of about one million square feet on Tulane Road, Memphis, Tennessee, USA, as the second &#8211; phase base.<\/p>\n<p>Similar to the first &#8211; generation (156 units), Colossus 2 will also be powered by Tesla Megapacks, and this time the number has increased to 208 units.<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,614\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271126_919_interlace,1.jpeg\"\/><\/p>\n<p>Moreover, Elon Musk also plans to relocate a power plant from overseas to supply power for it.<\/p>\n<p>The power supply for Colossus 2 will adopt diversified measures, including building or renovating substations, energy storage, and relocating external power sources.<\/p>\n<p>The interstellar gateway is still far away. If Colossus 2 can continue the legend of the first &#8211; generation construction, it will surely break the world record again!<\/p>\n<p class=\"image-wrapper\"><img decoding=\"async\" data-img-size-val=\"1080,601\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/08\/1756271127_695_interlace,1.jpeg\"\/><\/p>\n<p class=\"img-desc\">Jensen Huang of NVIDIA has praised Elon Musk&#8217;s in &#8211; depth understanding of engineering systems more than once.<\/p>\n<p>  References<\/p>\n<p>https:\/\/x.com\/elonmusk\/status\/1947704195844608094<\/p>\n<p>https:\/\/x.com\/elonmusk\/status\/1959383653256962378<\/p>\n<p>https:\/\/x.com\/xAIMemphis\/status\/1947724711968051414<\/p>\n<p>https:\/\/x.com\/elonmusk\/status\/1947701807389515912<\/p>\n<p>https:\/\/x.com\/teslaownersSV\/status\/1924684020107116709<\/p>\n<p class=\"editor-note\">This article is from the WeChat official account <a target=\"_blank\" rel=\"noopener noreferrer nofollow\" href=\"https:\/\/mp.weixin.qq.com\/s\/-ria0vd2RxZ-rrFrq8hesw\">\u201cNew Intelligence Yuan\u201d<\/a>. Author: Allen and Peach. Republished by 36Kr with permission.<\/p>\n","protected":false},"excerpt":{"rendered":"Elon Musk announced a crazy plan to achieve the computing power equivalent to 50 million H100 GPUs within&hellip;\n","protected":false},"author":3,"featured_media":178883,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22],"tags":[101213,101212,691,36386,101215,101214,745,59002,66,101216,101217,34949,11291,2527,158,7829,67,132,68,744],"class_list":{"0":"post-178882","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-computing","8":"tag-5-years","9":"tag-50-million-h100-gpus","10":"tag-ai","11":"tag-ai-training","12":"tag-colossus-ii","13":"tag-colossus-supercomputer-cluster","14":"tag-computing","15":"tag-computing-power","16":"tag-elon-musk","17":"tag-gb200","18":"tag-gb300-gpus","19":"tag-grok","20":"tag-neuralink","21":"tag-spacex","22":"tag-technology","23":"tag-tesla","24":"tag-united-states","25":"tag-unitedstates","26":"tag-us","27":"tag-xai"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@us\/115098991939034962","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/178882","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/comments?post=178882"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/178882\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media\/178883"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media?parent=178882"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/categories?post=178882"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/tags?post=178882"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}