Peer Review Trajectories of Disruptive Research: Evidence from Reviewer Comments, Review Rounds and Author Responses
By analyzing peer review histories from PLOS ONE, this study reveals that disruptive research undergoes slightly longer acceptance trajectories driven by author response times and faces a higher proportion of negative comments regarding clarity, substance, and originality, suggesting a selective challenge in evaluative legibility before publication.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Science often feels like a conversation that happens after the fact. When a new idea changes how a field thinks, we usually notice it only years later, by watching how other scientists cite the work. These "disruptive" papers are the ones that don't just add to what we already know; they shift the path of future research, making older ideas seem less relevant. But before a paper ever reaches that point of recognition, it must pass through a gatekeeper: peer review. This is the process where experts read a manuscript, critique it, and decide if it is ready to be published. For decades, we have known that groundbreaking ideas can be hard to spot, but we have had very little evidence of what actually happens inside the review room when a disruptive paper lands on a reviewer's desk. Does it get rejected more often? Do the critics struggle to understand it? Or does the process look much the same as it does for any other study?
A team of researchers at Nanjing University of Science and Technology decided to look inside this black box. They turned to a unique resource: the public review histories of the journal PLOS ONE. Unlike many journals that keep the back-and-forth between authors and reviewers private, PLOS ONE publishes the full record, including the initial comments, the author's replies, and the timeline of every step. The researchers gathered nearly 19,000 of these accepted articles and linked them to a measure of "disruption" based on how the papers were cited later. They then used advanced language software to read through hundreds of thousands of comments, sorting them by what the reviewers were worried about—such as whether the writing was clear, if the methods were sound, or if the idea was truly new. They also looked at how authors responded to these worries, checking if they changed the paper, offered an explanation, or argued back.
The story that emerged from this massive dataset is surprisingly specific. The researchers found that papers that would later become disruptive did take a little longer to get published, but not because the editors or reviewers were slower. The extra time came entirely from the authors themselves. When a disruptive paper was under review, the authors took longer to write their responses and make their changes. This suggests that the delay wasn't a sign of rejection or confusion on the part of the judges, but rather a period where the writers had to work harder to make their difficult ideas fit into the standard format of a scientific paper.
When the researchers looked at what the reviewers actually said, they found that disruptive papers did not receive more criticism overall. The total number of comments was about the same as for any other paper. However, the type of criticism was different. Reviewers were more likely to complain about the clarity of the writing, the depth of the substance, and the originality of the idea. They were less likely to question whether the study could be repeated or if the data was technically correct. This points to a specific kind of struggle: the reviewers weren't saying the science was wrong; they were saying it was hard to understand or hard to place within the existing landscape of knowledge. The disruptive nature of the work made it "illegible" to the standard ways of evaluating science, forcing the authors to spend more time clarifying their message.
As the review process moved through multiple rounds, these concerns behaved in interesting ways. Worries about whether the study could be repeated tended to disappear quickly, suggesting that once the data was checked, the issue was resolved. However, concerns about clarity and the depth of the work lingered slightly longer, appearing in more rounds of review before finally fading away. This indicates that making a disruptive idea clear and substantial is a persistent challenge that requires several passes to get right.
Perhaps the most revealing finding was in how the authors fought back. When faced with criticism, authors of disruptive papers did not argue more often. They did not try to talk their way out of the problems. Instead, they were more likely to simply revise the paper. They took the reviewers' notes and made concrete changes to the text, rather than just explaining why the original version was fine. This pattern suggests that the path to publishing a disruptive idea is not about winning an argument with the reviewers, but about patiently reshaping the manuscript until the new idea becomes clear and acceptable to the scientific community.
In the end, the study shows that the journey of a disruptive paper is defined by a struggle for clarity rather than a battle over facts. The extra time and effort required to publish these papers come from the need to translate a radical new idea into a language that reviewers can immediately understand. The process acts as a filter not for correctness, but for legibility. By the time these papers are accepted, they have been reframed and stabilized, making them ready to eventually change the field. The research confirms that while disruptive science is recognized by its impact years later, the seeds of that impact are sown in the quiet, often difficult work of revision that happens long before the paper is ever published.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.