{"id":976398,"date":"2026-05-21T22:09:30","date_gmt":"2026-05-21T22:09:30","guid":{"rendered":"https:\/\/www.europesays.com\/uk\/976398\/"},"modified":"2026-05-21T22:09:30","modified_gmt":"2026-05-21T22:09:30","slug":"tough-peer-review-process-your-paper-might-end-up-being-more-highly-cited","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/uk\/976398\/","title":{"rendered":"Tough peer-review process? Your paper might end up being more highly cited"},"content":{"rendered":"

\"Closeup<\/p>\n

Academic reviewers sometimes deliver the feedback that a scientific paper can be published, but with major revisions. Credit: NuPenDekDee\/Getty<\/p>\n

Scientists aren\u2019t usually thrilled when reviewers of their research papers ask for extensive revisions ahead of publication. But the stress that authors experience might pay off in the long run. An analysis of publicly available peer reviews for thousands of papers finds that papers receiving tough reviews go on to have a higher impact in science than those that sail through the review process.<\/p>\n

The study, posted to the arXiv preprint server last month1<\/a>, evaluated the peer-review correspondence associated with a selection of papers published in Nature Communications. The journal has been making some of these files public for papers that the journal accepts since 2016<\/a> and all of them public since 2022<\/a>. It does this for transparency and to inform discussion of published papers in the research community, the journal says<\/a>.<\/p>\n

Preprint co-author An Zeng, who is a specialist in complexity science at Beijing Normal University in China, says that he and his colleagues \u201cthought these files could tell us a lot about the \u2018negotiation\u2019 between reviewers and authors\u201d to get papers published.<\/p>\n

No pain, no gain<\/p>\n

To draw insights from the review correspondence, the team prompted a large language model (LLM) to evaluate these files for 8,000 published papers \u2014 1,000 randomly selected per year from the period 2017 to 2024.<\/p>\n

\"\"<\/p>\n

The peer-review crisis: how to fix an overloaded system<\/p>\n

<\/a><\/p>\n

The authors asked the LLM \u2014 a version of Claude, which was created by artificial-intelligence company Anthropic, in San Francisco, California \u2014 to score reviewers\u2019 comments for how constructive they were and for how strong their opinions were. For example, a comment that the main conclusion of the paper \u201cis not supported by the evidence\u201d would score highly in opinion strength, Zeng says. But it would not score highly as a constructive comment without further suggestions for how the authors could address the problem. The model also assessed the \u2018quality\u2019 of comments, which was a measure of how specific and well-reasoned they are. <\/p>\n

To evaluate the response of the authors to reviews, the LLM assessed the \u2018cost\u2019 of revisions \u2014 defined as how much work the authors did to address the comments. The model also measured whether the authors accepted or rebutted reviewers\u2019 criticisms and whether those issues were resolved in later review rounds.<\/p>\n

By considering how many times a paper was cited in the literature during the three years after its publication, the researchers found that papers eliciting stronger criticism from reviewers and requiring more-extensive revisions received more citations than did papers that drew light comments and sailed through the peer-review process. The quality of reviewer comments was also associated with high citation counts, whereas how constructive comments were did not seem to affect a paper\u2019s citations.<\/p>\n

The findings are \u201cconsistent with the idea that more ambitious or consequential work may be questioned more intensely\u201d, Zeng says. But they could also suggest that a demanding review process helps authors to improve their work before publication, boosting the likelihood of having a high-impact paper, he adds.<\/p>\n","protected":false},"excerpt":{"rendered":"Academic reviewers sometimes deliver the feedback that a scientific paper can be published, but with major revisions. Credit:…\n","protected":false},"author":2,"featured_media":976399,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_share_on_mastodon":"0"},"categories":[8],"tags":[8668,3965,3966,20188,70,3016,16,15],"class_list":["post-976398","post","type-post","status-publish","format-standard","has-post-thumbnail","category-science","tag-computer-science","tag-humanities-and-social-sciences","tag-multidisciplinary","tag-publishing","tag-science","tag-scientific-community","tag-uk","tag-united-kingdom"],"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@uk\/116614854669301907","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/976398","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/comments?post=976398"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/976398\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media\/976399"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media?parent=976398"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/categories?post=976398"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/tags?post=976398"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}