{"id":773276,"date":"2026-05-04T19:58:21","date_gmt":"2026-05-04T19:58:21","guid":{"rendered":"https:\/\/www.europesays.com\/us\/773276\/"},"modified":"2026-05-04T19:58:21","modified_gmt":"2026-05-04T19:58:21","slug":"influential-study-touting-chatgpt-in-education-retracted-over-red-flags","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/773276\/","title":{"rendered":"Influential study touting ChatGPT in education retracted over red flags"},"content":{"rendered":"

A study that claimed OpenAI\u2019s ChatGPT can positively impact student learning has been retracted<\/a> nearly one year after publication. The journal publisher, Springer Nature, cited \u201cdiscrepancies\u201d in the analysis and a lack of confidence in the conclusions\u2014but not before the paper racked up hundreds of citations and made the rounds on social media.<\/p>\n

\u201cThe paper\u2019s authors made some very attention-grabbing claims about the benefits of ChatGPT on learning outcomes,\u201d said Ben Williamson<\/a>, a senior lecturer at the Centre for Research in Digital Education and the Edinburgh Futures Institute at the University of Edinburgh in Scotland, in an email to Ars. \u201cIt was treated by many on social media as one of the first pieces of hard, gold standard evidence that ChatGPT, and generative AI more broadly, benefits learners.\u201d<\/p>\n

The retracted paper<\/a> attempted to quantify \u201cthe effect of ChatGPT on students\u2019 learning performance, learning perception, and higher-order thinking\u201d by analyzing results from 51 previous research studies. Its meta-analysis calculated the effect size between various studies\u2019 experimental groups that used ChatGPT in education and control groups that did not use the AI chatbot.<\/p>\n

That analysis supposedly showed how \u201cChatGPT has a large positive impact on improving learning performance\u201d along with a \u201cmoderately positive impact on enhancing learning perception\u201d and \u201cfostering higher-order thinking,\u201d according to the researchers who authored the paper. The now-retracted results first appeared in the journal<\/a> Humanities & Social Sciences Communications, published by Springer Nature on May 6, 2025.<\/p>\n

\u201cIn some cases it appears it was synthesizing very poor quality studies, or mixing together findings from studies that simply cannot be accurately compared due to very different methods, populations and samples,\u201d Williamson told Ars. \u201cIt really seemed like a paper that should not have been published in the first place.\u201d<\/p>\n

Williamson also questioned the timing of the paper\u2019s publication just two and a half years after OpenAI released ChatGPT<\/a> in November 2022. \u201cIt is not feasible that dozens of high-quality studies about ChatGPT and learning performance could have been conducted, reviewed, and published in that time,\u201d Williamson said.<\/p>\n

A legacy that may outlive retraction<\/p>\n

Since its publication, the study has been cited 262 times in other papers published by Springer Nature\u2019s peer-reviewed journals and received a total of 504 citations<\/a> from both peer-reviewed and non-peer-reviewed sources. It also attracted nearly half a million readers and received enough online attention<\/a> to rank in the 99th percentile for journal articles in terms of attention score.<\/p>\n","protected":false},"excerpt":{"rendered":"A study that claimed OpenAI\u2019s ChatGPT can positively impact student learning has been retracted nearly one year after…\n","protected":false},"author":3,"featured_media":773277,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21],"tags":[691,738,158,67,132,68],"class_list":{"0":"post-773276","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-technology","11":"tag-united-states","12":"tag-unitedstates","13":"tag-us"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@us\/116518080110647078","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/773276","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/comments?post=773276"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/773276\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media\/773277"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media?parent=773276"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/categories?post=773276"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/tags?post=773276"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}