Observer-Rated Perspective-Taking in Medical Students: A Longitudinal Measurement Study of Standardized Patient and Faculty Ratings
This longitudinal study of 203 medical students reveals that while observer-rated perspective-taking scores differ significantly between standardized patients and faculty, these ratings serve as complementary evidence whose interpretation requires careful consideration of the specific assessment contexts and evaluator roles across preclinical years.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
In the training of a doctor, learning to listen is just as critical as learning to diagnose. Medical schools strive to teach students how to understand a patient's point of view, a skill often called perspective-taking. This is not merely about feeling sorry for someone; it is the cognitive act of stepping into another person's shoes to grasp their specific concerns and fears. Educators have long debated how this ability changes as students progress through their studies. Some research suggests that empathy might fade under the pressure of medical school, while other studies show it grows or stays steady. A major complication in this debate is how we measure it. Usually, two different groups watch students interact with patients: standardized patients, who are actors trained to simulate real illness, and faculty members, who are doctors and teachers. The standardized patients experience the encounter in real time, feeling the conversation as it happens. The faculty members watch the same interaction later, usually on a video recording. It has been unclear whether these two groups see the same thing, or if their different roles lead them to judge the student's performance differently over the years of training.
A team of researchers at The Ohio State University set out to untangle this question by following a single group of 203 medical students over three years of their preclinical education. They focused on a specific moment in every simulated clinic visit: the point where a student demonstrates they understand the patient's perspective. In these sessions, the actors rated the students immediately after the interaction, while the faculty members reviewed the video recordings later and gave their own scores. The researchers wanted to know if the gap between these two sets of ratings stayed the same, or if it changed as the students moved from their first year to their third year. They also wanted to see if the way the data was grouped—looking at specific blocks of classes versus the whole year—altered the story the numbers told.
The study revealed a clear and consistent pattern: the actors consistently gave lower scores than the faculty members. In the first year of training, the difference was quite noticeable, with the actors rating the students about 0.6 points lower on a nine-point scale than the faculty did. However, as the students advanced, this gap began to shrink. By the third year, the difference had narrowed to just 0.2 points. At first glance, this might look like the students were getting better at meeting the actors' expectations, or perhaps the faculty were becoming stricter. But the researchers found that the story was more complex than a simple line of improvement. When they adjusted their analysis to account for the specific number of scenarios and the mix of cases that made up each year's rating, the size and direction of the gap changed. This suggested that the narrowing difference was not just a sign of student growth, but was also heavily influenced by the context of the assessments themselves. The later years of the curriculum involved more rigorous clinical interactions and higher expectations, which likely shifted how both groups of evaluators approached the scoring.
The researchers concluded that these two groups of evaluators should not be treated as interchangeable. The actors and the faculty members are not measuring the exact same thing in the exact same way; they are offering two different, complementary perspectives on the student's performance. The actors, who are in the room with the student, experience the encounter as a lived event, while the faculty, watching from a distance on a screen, have the luxury of time and repetition. The study showed that a student's score depends heavily on who is doing the rating and the specific conditions under which that rating happens. Therefore, when medical schools track how students improve over time, they cannot simply average the scores from actors and teachers together. Instead, they must look at the two ratings separately and understand that a change in the gap between them might reflect a change in the curriculum or the types of cases being used, rather than a fundamental shift in the student's ability to empathize.
This work challenges the idea that there is one single, perfect score for a student's communication skills. Instead, it suggests that understanding a patient's perspective is a behavior that looks different depending on the lens through which it is viewed. The study did not prove that one group was right and the other wrong, nor did it claim to have solved the mystery of how empathy develops. Rather, it provided a clearer map of how these ratings behave, showing that the path of a student's development is not a straight line drawn by a single observer, but a complex picture formed by multiple viewpoints. For educators, the takeaway is practical: keep the ratings separate, examine the specific cases used in each year, and recognize that the difference between an actor's score and a teacher's score is not an error to be fixed, but a piece of information that reveals how the learning environment shapes the assessment.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.