{"id":39033,"date":"2026-05-14T17:11:10","date_gmt":"2026-05-14T17:11:10","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/39033\/"},"modified":"2026-05-14T17:11:10","modified_gmt":"2026-05-14T17:11:10","slug":"scientists-find-way-to-avoid-model-collapse-that-could-destroy-ai-as-we-know-it","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/39033\/","title":{"rendered":"Scientists find way to avoid \u2018model collapse\u2019 that could destroy AI as we know it"},"content":{"rendered":"

Scientists believe they might have found a way to overcome \u201cmodel collapse\u201d, a phenomenon that threatens the training of AI<\/a> as we know it.<\/p>\n

To become better, artificial intelligence systems such as those used in ChatGPT must be trained with more and more real data. But much of that data is taken from writing on the internet, which itself is often produced using such models.<\/p>\n

The amount of real data is rapidly reducing \u2013\u00a0and is predicted to run out as early as this year. And data that is produced by other AI systems could rapidly lead to \u201cmodel collapse\u201d.<\/p>\n

That refers to a phenomenon where AI systems engage in \u201cdata cannibalism\u201d, where they are trained on their own outputs, and come rapidly less useful and more prone to dangerous falsehoods.<\/p>\n

But researchers have suggested that using just one datapoint from the outside world can prevent the problem. They did so using a set of models called \u201cExponential Families\u201d, a set of statistical models.<\/p>\n

The work showed that training systems only on data it has produced will always lead to model collapse. But incorporating one datapoint from outside of the model \u2013\u00a0such as previously acquired knowledge \u2013\u00a0prevents the effect.<\/p>\n

That happens even when the amount machine-generated data is infinitely large, the study showed.<\/p>\n

\u201cPrevious work undertaken on model collapse primarily looks at large, complicated LLMs, where it\u2019s not clear how these models work and if results are repeatable \u2013 it is why you get unexplained hallucinations, where you can\u2019t explain why an AI has generated a wrong answer,\u201d said Yasser Roudi, Professor of Disordered Systems at King\u2019s College London.<\/p>\n

\u201cBy focusing on a simple model, we can establish why adding just one data point prevents them from generating gibberish from an objective, statistical standpoint.<\/p>\n

The researchers behind the study pointed out that such collapse is not limited to chatbots \u2013\u00a0but could affect vital infrastructure such as cars, too.<\/p>\n

\u201cFrom this foundation, we can establish principles that will be vital in future AI construction,\u201d said Professor Roudi. \u201cAs larger models are deployed in areas touching our lives, from ChatGPT to self-driving cars, and synthetic data takes on a larger share of AI training, computer scientists will have the tools to prevent this potentially disastrous scenario.\u201d<\/p>\n

The work is reported in a paper published in the journal Physical Review Letters.<\/p>\n","protected":false},"excerpt":{"rendered":"Scientists believe they might have found a way to overcome \u201cmodel collapse\u201d, a phenomenon that threatens the training…\n","protected":false},"author":2,"featured_media":39034,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[6744,3069,3013,24078,12249,24077],"class_list":["post-39033","post","type-post","status-publish","format-standard","has-post-thumbnail","category-agi","tag-agi","tag-ai-training","tag-artificial-general-intelligence","tag-collapse","tag-model-collapse","tag-statistical-models"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/39033","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=39033"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/39033\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/39034"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=39033"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=39033"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=39033"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}