Pathways to improve the quality of clinical professional master’s degree theses: a retrospective analysis of double-blind review results

In the world of medical training, the final thesis is more than just a long paper; it is the capstone that proves a student has truly mastered their craft. For students pursuing a professional master's degree in clinical medicine, this document represents the culmination of years of studying disease, treating patients, and learning to think like a doctor. To ensure these documents meet high standards, universities use a process called double-blind review. In this system, the names of the students and their teachers are hidden from the experts who grade the work, and the experts' identities are hidden from the students. This setup is designed to strip away personal connections and biases, leaving only the quality of the writing and research to be judged. If a thesis passes this rigorous, anonymous test, it moves forward to a final defense; if it fails, the student must revise the work and is then approved for defense, though a score below 60 points results in disapproval for defense. Understanding what makes these papers succeed or fail is crucial, because the quality of these theses reflects the quality of the future doctors entering hospitals.

A team of researchers at Chengdu Medical College in China decided to look closely at the results of this blind review process to see what was really happening behind the scores. They gathered data from 1,156 review reports covering 578 theses submitted between 2021 and 2023. Their goal was to move beyond simple averages and understand the specific factors that influenced whether a thesis was rated excellent, good, fair, or poor. They examined the background of the students, the titles of their supervisors, the medical specialties involved, and the detailed comments written by the anonymous reviewers. By treating the data like a map, they hoped to find the hidden pathways that lead to better quality work.

When the researchers first looked at the overall scores, the picture seemed calm and steady. The middle score for the theses remained almost exactly the same across all three years, hovering around 80 points. However, when they sorted the papers into categories, a different story emerged. The year 2022 stood out as an anomaly. While the average score looked normal, that year had the lowest rate of excellent papers and the highest rate of failures. This suggested that the middle ground was masking a real shift in quality. The researchers found that the papers from 2022 were weaker in specific areas that require deep thinking and practical application, such as the real-world value of the research and the standardization of the writing. In contrast, the basic skills, like how well the students summarized existing literature or designed their methods, remained stable. This pattern indicated that while students were still good at the fundamentals, their ability to produce high-level, innovative work had dipped during that specific year.

The study also revealed that who the student was mattered more than who their teacher was. The researchers compared full-time students, who focus entirely on their studies, with those in an equivalency pathway, who are often working doctors studying part-time. The full-time students consistently produced higher-quality work, with a much higher rate of excellent papers and a lower rate of failures. The part-time students struggled more, likely due to the conflict between their jobs and their research. Surprisingly, the academic rank of the supervisor did not change the outcome. Whether a student was guided by a senior professor or an associate professor made no statistical difference to the final grade. Similarly, the background of the anonymous reviewer, such as whether they came from a top-tier university or held a doctoral supervisor title, had no impact on the scores. This confirmed that the blind review system was working as intended, judging the work on its own merits rather than the reputation of the people involved.

The medical specialty of the student also turned out to be irrelevant to the final quality. Whether a thesis was about surgery, internal medicine, or anesthesia, the distribution of grades was statistically the same. There was no evidence that one field of medicine produced better or worse papers than another. Instead, the focus of the reviewers themselves was changing over time. In 2021, the most common complaints in the review comments were about formal issues like writing style and citation formatting. By 2023, the reviewers were talking much more about the substance of the research. Words like "innovation," "clinical value," and "research limitations" appeared with increasing frequency. This shift showed that the academic community was raising its expectations, moving away from simply checking boxes for correct formatting and demanding that the research actually contribute something new and useful to the field.

The researchers concluded that the stability of the average scores was misleading. The dip in quality during 2022 was likely caused by the global public health emergency, which squeezed the time available for both teachers and students. Clinical supervisors were overwhelmed with patient care, and students had less time to dedicate to their research, leading to a decline in the more complex aspects of the thesis. To fix this, the authors suggest that schools should stop relying only on average scores to judge quality. Instead, they should watch the spread of grades closely, looking for spikes in failures or drops in excellence as an early warning sign. They also recommend that schools enforce stricter rules on how much time supervisors must spend with their students, ensuring that guidance is consistent and substantial. Finally, the review process itself needs to be managed more carefully to ensure that reviewers provide detailed, constructive feedback rather than superficial comments. The path to better medical education lies in paying attention to these details and shifting the focus from mere compliance to genuine scholarly contribution.