{"id":582582,"date":"2025-11-20T13:22:16","date_gmt":"2025-11-20T13:22:16","guid":{"rendered":"https:\/\/www.europesays.com\/uk\/582582\/"},"modified":"2025-11-20T13:22:16","modified_gmt":"2025-11-20T13:22:16","slug":"edinburgh-university-researchers-develop-software-to-make-ai-10-times-faster","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/uk\/582582\/","title":{"rendered":"Edinburgh University researchers develop software to make AI 10 times faster"},"content":{"rendered":"

Researchers at the University of Edinburgh have developed\u00a0software\u00a0that could allow artificial intelligence (AI)<\/a> systems to operate 10 times faster.<\/p>\n

The researchers developed a software system called WaferLLM, designed specifically for wafer-scale chips to help improve their performance. Wafer-scale chips are the world’s largest computer chip and are roughly the same size as a dinner plate.<\/p>\n

“Wafer-scale computing has shown remarkable potential, but software has been the key barrier to putting it to work,\u201d said Dr Luo Mai, lead researcher and reader at the University of Edinburgh’s School of Informatics.<\/p>\n

The process is based on new software that lets trained large language models <\/a>(LLMs) draw conclusions from fresh data \u2013 a process called inference \u2013 in a much more efficient way. \u00a0<\/p>\n

\u201cWith WaferLLM, we show that the right software design can unlock that potential, delivering real gains in speed and energy efficiency for large language models,\u201d said Dr Mai. \u201cThis is a step toward a new generation of AI infrastructure \u2013 one that can support real-time intelligence in science, healthcare, education, and everyday life.\u201d<\/p>\n

The researchers evaluated the software at EPCC, the UK\u2019s National Supercomputing Centre based at the University of Edinburgh. The EPCC operates Europe’s largest cluster of advanced Wafer Scale Engine processors and is also the future home of the UK\u2019s next supercomputer<\/a>, funded by the UK Government to the tune of \u00a3750m.<\/p>\n

\u201cDr Mai\u2019s work is truly ground-breaking and shows how the cost of inference can be massively reduced,\u201d said Professor Mark Parsons, the director of EPCC.<\/p>\n

Wafer-scale chips differ from typical AI chips <\/a>not only in terms of size but also in how they operate. The larger chips have been designed to carry out many computation tasks simultaneously within a single chip, which is aided by massive on-chip memory. \u00a0<\/p>\n

With all the computation taking place on the same piece of silicon, data can move between different parts of the chip much faster than if it had to travel between separate groups of chips and memory via a network.<\/p>\n

Because of this, a wafer-scale chip can integrate hundreds of thousands of computation cores all working in parallel, making it more efficient at completing the mathematical operations that power neural networks \u2013 the backbone of LLMs like ChatGPT.<\/a> \u00a0<\/p>\n

The accelerated performance could have a major impact on industries that need LLMs to generate fresh insights in real-time in under a millisecond, such as chatbots, finance, healthcare, and scientific discovery, the researchers say.<\/p>\n

Holyrood Newsletters<\/p>\n

Holyrood provides comprehensive coverage of Scottish politics, offering award-winning reporting and analysis: Subscribe<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Researchers at the University of Edinburgh have developed\u00a0software\u00a0that could allow artificial intelligence (AI) systems to operate 10 times…\n","protected":false},"author":2,"featured_media":582583,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8816],"tags":[748,1102,4884,712,16,15],"class_list":{"0":"post-582582","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-edinburgh","8":"tag-britain","9":"tag-edinburgh","10":"tag-great-britain","11":"tag-scotland","12":"tag-uk","13":"tag-united-kingdom"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@uk\/115582241738514206","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/582582","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/comments?post=582582"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/582582\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media\/582583"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media?parent=582582"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/categories?post=582582"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/tags?post=582582"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}