USMLE Step 2 CK Preparation and Performance in the Post-Pass/Fail Step 1 Era: A Multi-Institutional Study
This multi-institutional study of medical students in the post–pass/fail Step 1 era reveals that neither exam sequencing nor specific study resources significantly impact Step 2 CK performance, whereas the score on the final practice test is the sole independent predictor of success.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
For decades, the path to becoming a doctor in the United States has been paved with a series of high-stakes exams. The first of these, known as Step 1, was once a scored test where a single number determined a student's future, often creating intense pressure and anxiety. In early 2022, the system changed: that first exam became a simple pass or fail. This shift was intended to reduce stress, but it immediately created a new puzzle. With the first hurdle no longer a score to chase, the focus of medical education and residency selection shifted entirely to the second exam, Step 2 Clinical Knowledge. This test, which focuses on applying medical knowledge to patient care, became the new primary metric for success. Consequently, students and schools were left wondering about the best way to prepare. Should they take the exams in the traditional order, or could they flip the sequence to take the second exam first? Furthermore, with a vast array of expensive study guides, video courses, and question banks available, which specific tools actually help a student perform better?
A team of researchers from three major medical schools—Vanderbilt, Harvard, and the University of Virginia—set out to answer these questions by listening directly to the students living through this transition. They surveyed 241 medical students who had completed their exams entirely under the new pass-or-fail system for the first test. The researchers wanted to see if the order in which students took their exams mattered, if the length of their dedicated study time made a difference, and if using specific commercial resources led to higher scores. They also looked at how well students did on practice tests before the real exam to see if that was a better predictor of success than any other factor.
The results offered a clear, if somewhat surprising, map for navigating this new landscape. The study found that the order in which students took their exams did not matter for their final score on the second exam. Whether a student took the traditional route of Step 1 first or reversed the order to take Step 2 first, their performance on the final test was statistically the same. The researchers also found that neither the number of weeks a student spent studying intensively nor the specific combination of study materials they used—such as popular question banks or flashcard apps—had a direct, independent link to a higher score. In other words, spending more time or buying more expensive resources did not guarantee a better outcome.
The only factor that consistently predicted how well a student would do on the actual exam was their performance on the final practice test they took before sitting for the real thing. The researchers noted that this practice score was the single most informative indicator of success. This suggests that the value of practice testing lies not in the act of taking many tests, but in what those tests reveal about a student's readiness. The data hinted that students who felt less prepared might have taken more practice tests or studied longer, which could explain why those behaviors did not correlate with higher scores. Instead, the final practice score served as a reliable gauge of where a student stood, regardless of how they got there.
These findings suggest that medical schools and advisors can offer students more flexibility. There is no need to enforce a rigid schedule or prescribe a specific list of study materials. Instead, the focus can shift toward helping students interpret their own practice test results to determine when they are truly ready to take the exam. By relying on objective self-assessment rather than rigid rules or the accumulation of study hours, students can align their testing schedules with their personal well-being and career goals, reducing the anxiety that often accompanies these critical milestones.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.