![\"artificial](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/05\/1780180870_702_0x0.jpg\")
<\/p>\n<\/p>\n
A correspondence to The Lancet described how over a three-year period, 4,046 references in 2,810 published scientific journal articles had been completely fabricated, presumably hallucinations by AI. (Photo: Getty)<\/p>\n
getty<\/p>\n
The use of artificial intelligence or AI by researchers to write their scientific papers is far from A-OK right now. Just look at what a research team recently described a in a correspondence to The Lancet<\/a> \u2014over a three-year period, 4,046 references in 2,810 published scientific journal articles had been completely fabricated. Most of these fabrications were presumably hallucinations by AI, which kind of makes you wonder what else in those papers may have been artificial as well. <\/p>\n By 2026 Approximately One In 277 Papers Had Presumably AI-Fabricated Citations<\/p>\n To conduct the review of what might have been generated by AI, the research team from Columbia University (Maxim Topaza, Nir Roguinb, Pallavi Guptab and Zhihong Zhanga) and the University of Eastern Finland (Laura-Maria Peltonen) turned to, well, AI. They developed an automated reference verification system. That\u2019s because reviewing all 2,471,758 papers with 125,615,773 accompanying references from January 1, 2023, through February 18, 2026, that are in PubMed Central\u2019s Open Access would have taken quite a bit of time without some computational help. <\/p>\n Comparing citations listed in the papers with actual bibliographic records helped identify and flag any discrepancies. The research team used even more AI\u2014a large language model known as Claude 3.5 Haiku from Anthropic\u2014to help go through everything that was flagged and separate the honest errors from the pure fabrications. Any reference that couldn\u2019t be found databases like PubMed, Crossref, OpenAlex and Google Scholar was considered not fab and instead fabricated. <\/p>\n During the first year searched\u20142023\u2014approximately one in 2828 papers had at least one fabricated reference. In just two years\u2014in 2025\u2014 this had already jumped up to one in 458. Yikes. Then the first seven weeks of 2026, an even higher one in 277 paper ratio. That\u2019s an over 12-fold increase in a relatively short amount of time.<\/p>\n One Paper Published in 2025 Had 60 Percent Of Its Citations Presumably AI-Fabricated<\/p>\n One of the papers that deserved a particularly big F\u2014for fabrication\u2014was published in 2025 in an open access oncology journal and covered ureteroileal anastomotic techniques. A whopping 60 percent (18 of the 30) of the references cited in the paper were fabricated. There were other examples of papers with significant proportions of references fabricated. A total of 246 different papers contained three or more fabricated references.<\/p>\n The research team also identified particular authors who cranked out multiple papers with fabricated references. For example, a pair of authors had 11 different papers in a single surgical journal in 2025 that had 15 fabricated references. The research team called out so-called \u201cpaper mills,\u201d in general. These are research groups that churn out papers The highest fabrication rates tended to be in review articles, 57 percent higher than for other types of papers (16\u00b77 per 10\u2008000 versus 10\u00b76 per 10\u2008000).<\/p>\n Using AI Large Language Models Has A High Risk For Hallucinations<\/p>\n Now without talking specifically to the authors, it\u2019s difficult to tell why these fabricated citations made it into their paper. Presumably, the authors didn\u2019t do it for fun, as in let\u2019s make up a scientific paper with Taylor Swift and Justin Bieber as co-authors. The suspicion is that most of the fabrications resulted from hallucinations from a specific type of AI: large language models or LLMs for short in case you don\u2019t have time to say \u201carge anguage odels.\u201d <\/p>\n That\u2019s because the rise in fabricated citations did correspond with greater use of generative AI platforms like ChatGPT, Claude and Perplexity that use LLMs. I\u2019ve covered such hallucinations in \u201cA Funny Bone to Pick\u201d for Psychology Today<\/a>. LLMs can be particularly prone to hallucinations because they just see what happens to be associated with what in large amount of data as can be found on the Internet without really critically determining in a expert way what is accurate or not. <\/p>\n AI-Fabrications Will Be A Growing Problem In Scientific Publishing <\/p>\n The problem of fabricated citations is not going to go away. In fact, it will likely get worse as more and more researchers rely AI to write their papers and more and more junk for-profit scientific journals continue to emerge. The burgeoning number of scientific journals that aim to make money but somehow expect scientists to review papers for free has led to a growing quality-control problem. Many well-established scientists don\u2019t want to review papers or serve on editorial boards for these journals anymore, because they are frankly thankless and usually completely salary-less jobs. <\/p>\n One potential way of combating such AI fabrications is with AI. That means developing AI tools that can suss out inaccuracies, especially AI-generated materials. Yep, scientific publication could turn into some kind of battle of the machines. But it\u2019s unclear if and when scientific publishers will be willing to invest into such AI tools. And how accurate such AI tools will end up being. <\/p>\n Nonetheless, scientific publishing is likely on the verge of a reckoning. Many publishers have seen scientific journals as cash cows, leading to the rapid multiplication of journals that are now charging researchers thousands of dollars for the \u201cprivilege\u201d of getting their articles published. Meanwhile, funding for scientific research has been getting cut like cheese as I have described in Forbes.<\/a> That leaves researchers with less and less funds to pay these publication fees. It also leaves researchers with less and less time to keep donating to scientific journals. <\/p>\n All of that is bound to push more researchers to cut corners and use less me, myself and more AI to do their work. That\u2019s even before these AI tools have been fully vetted and checked for accuracy. To quote the title of that 2003 rom-com something\u2019s gotta give. <\/p>\n","protected":false},"excerpt":{"rendered":"A correspondence to The Lancet described how over a three-year period, 4,046 references in 2,810 published scientific journal…\n","protected":false},"author":2,"featured_media":56464,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[24,25,580,223,19255,1807,415,2225,32901,32902],"class_list":["post-56463","post","type-post","status-publish","format-standard","has-post-thumbnail","category-ai","tag-ai","tag-artificial-intelligence","tag-chatgpt","tag-generative-ai","tag-hallucinations","tag-large-language-model","tag-llm","tag-llms","tag-scientific-journal-articles","tag-scientific-publishing"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/56463","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=56463"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/56463\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/56464"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=56463"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=56463"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=56463"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}