Studies suggest humans experience shorter attention spans, distorted memories, and shifts in self-esteem due to \u201cbrain rot,\u201d or a dependence on low-quality online content. Researchers now say the same phenomenon can affect artificial (AI) models, too.<\/p>\n
Heavy consumption of viral short-form videos like those on TikTok in particular is associated with increased anxiety and depression<\/a>, as well as shorter attention spans in young people, according to a Stanford University study<\/a>.<\/p>\n In AI models, continual exposure to the short and viral social media posts that make up a growing part of the internet \u201cinduces lasting cognitive decline in large language models,\u201d researchers from Texas A&M University, the University of Texas at Austin, and Purdue University found in a new pre-print study<\/a>.\u00a0<\/p>\n In proving their hypothesis, researchers fed LLMs continually with X<\/a> posts that were either short and viral or were shaped to grab users\u2019 attention. They found this poisonous training causes \u201cnontrivial\u201d declines in reasoning and long-context understanding thanks in part to a jump in \u201cthought-skipping,\u201d meaning the AI models increasingly failed to make a plan to answer the question, left out parts of the reasoning process, or skipped this reflection entirely.<\/p>\n The study, published on the open-access scholarly article archive, arxiv, has not yet been peer-reviewed.<\/p>\n Contrasting with previous criticism of AI models\u2019 kiss-up tendencies, the study found that when LLMs, including Meta\u2019s open source Llama3 as well as versions of Alibaba\u2019s Qwen LLM,\u00a0 were trained on junk, they were less agreeable. Worse yet, the researchers found that AI brain rot brought out an LLM\u2019s darkest traits, including higher rates of psychopathy and narcissism.\u00a0<\/p>\n When researchers tried to \u201cheal\u201d the LLMs using higher-quality human-written data through the process of \u201cinstruction tuning,\u201d the AI models still had lingering effects and showed a significant gap between the quality of their reasoning compared to their baseline, pre-junk diet.<\/p>\n \u201cThe gap implies that the Brain Rot effect has been deeply internalized, and the existing instruction tuning cannot fix the issue. Stronger mitigation methods are demanded in the future,\u201d the researchers wrote.<\/p>\n Because AI models are trained on trillions of data points from across the internet, the researchers warned that LLMs \u201cinevitably and constantly\u201d are exposed to this low-quality content just like humans, which could pose risks for the technology as a whole.<\/p>\n Previous studies have shown that AI models\u2019 training is essential to their performance. In a July 2024 study<\/a> published in the peer-reviewed journal Nature, found that AI models eventually collapse if continually trained on AI-generated content. Another study showed AI models can be manipulated into breaking its own guardrails using persuasion techniques effective on humans<\/a>.<\/p>\n All of this adds up to the potential danger caused by AI models not trained on quality data. A danger that can potentially impact human safety.\u00a0<\/p>\n The researchers\u2019 recommendation: AI companies need to stop merely hoarding massive amounts of data and focus on the quality of the data being used to train their LLMs. They may also need to conduct routine \u201ccognitive health checks\u201d on the models\u2014or else risk a full-blown safety crisis.<\/p>\n \u201cSuch persistent Brain Rot effect calls for future research to carefully curate data to avoid cognitive damages in pre-training,\u201d the researchers wrote.<\/p>\n","protected":false},"excerpt":{"rendered":"Studies suggest humans experience shorter attention spans, distorted memories, and shifts in self-esteem due to \u201cbrain rot,\u201d or…\n","protected":false},"author":2,"featured_media":138799,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[74],"tags":[18,135,19,17,167,1114,753,82,6663,1150],"class_list":{"0":"post-138798","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-technology","8":"tag-eire","9":"tag-health","10":"tag-ie","11":"tag-ireland","12":"tag-mental-health","13":"tag-social-media","14":"tag-tech","15":"tag-technology","16":"tag-teenagers","17":"tag-tiktok"},"share_on_mastodon":{"url":"","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/138798","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/comments?post=138798"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/138798\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media\/138799"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media?parent=138798"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/categories?post=138798"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/tags?post=138798"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}