Beyond skills: The impact of personality traits, empathy and stress mindset on OSCE outcomes

This study of 99 fifth-year medical students found that while personality traits, empathy, and stress mindsets generally do not predict overall OSCE performance, conscientiousness specifically predicts success in non-interactive stations and neuroticism is associated with performance improvement between sessions, whereas written exam scores, prior OSCE results, and female gender were the strongest overall predictors of success.

The Gist

The Big Question: Is Being a Good Doctor Just About Skills?

Imagine medical school is like training to become a professional chef. You have to learn the recipes (medical knowledge) and how to chop vegetables (clinical skills). But to be a great chef, you also need the right "kitchen personality." Are you calm under pressure? Do you genuinely care about the diner's experience? Are you organized?

This study asked: Do a medical student's personality, their level of empathy (caring), and how they view stress actually predict how well they will do on their final cooking test?

The "cooking test" in this study is called an OSCE (Objective Structured Clinical Examination). It's a series of stations where students act out medical scenarios with actors playing patients. Some stations involve talking to a "patient" (interactive), and others involve just doing a procedure on a mannequin or writing things down (non-interactive).

The Experiment: The "Personality Test" vs. The "Final Exam"

The researchers gathered 99 fifth-year medical students (basically seniors about to graduate). Before they took their big final OSCE exam, the students filled out a bunch of surveys asking them to rate themselves on:

• The Big Five Personality Traits: Are you outgoing? Organized? Anxious? Kind? Open-minded?
• Empathy: How well do you think you can understand what a patient is feeling?
• Mindset: Do you think stress is a killer, or a helpful fuel? Do you think your brain is fixed like a rock, or can it grow like a muscle?

Then, they compared these survey answers to the students' actual scores on the final exam.

The Surprising Results: The "Secret Sauce" Wasn't What They Thought

The researchers expected that students who were naturally kind, organized, or good at handling stress would ace the exam. They thought the "personality test" would be a crystal ball predicting success.

The Reality: The crystal ball was foggy.

1. Personality and Empathy Didn't Predict the Score:
   Imagine you have a car. You might think a car with a "sporty personality" (high empathy, low stress) drives faster. But in this study, the "sporty" students didn't necessarily drive faster than the "sedan" students.

   • The Finding: Being highly empathetic or having a "growth mindset" did not correlate with getting a higher score on the OSCE. A student could be incredibly kind and calm, yet still struggle with the exam. Conversely, a student who seemed "anxious" or "less empathetic" on paper could still get an A.

2. The Real Predictors Were Boring (but effective):
   If personality wasn't the key, what was?

   • Previous Experience: Students who had done well on previous OSCEs did well this time. It's like a musician who has practiced for years; they know the stage.
   • Written Knowledge: Students who scored high on written tests (knowing the facts) tended to do better.
   • Gender: Interestingly, female students scored slightly higher on average than male students in this specific group.

3. The One Exception: The "Non-Interactive" Stations:
   Here is where it gets interesting. The OSCE had two types of stations:

   • Interactive: Talking to a patient (like a jazz improvisation).
   • Non-Interactive: Doing a procedure alone (like following a strict recipe).

   In the non-interactive stations, Conscientiousness (being organized, responsible, and hardworking) was the only thing that mattered. If you were a "Type A" organized person, you crushed the procedural tasks. It's like a mechanic following a manual; if you are meticulous, you won't miss a step.

4. The "Neuroticism" Twist:
   The study found that students who scored higher on Neuroticism (a tendency to worry or feel stress) actually improved more between their first practice exam and the final exam.

   • The Analogy: Think of these students as "pressure cookers." The stress didn't break them; it made them cook faster and better the second time around. They used their anxiety as fuel to study harder and improve.

Why Didn't Empathy Predict Success?

You might wonder, "But isn't empathy the most important part of being a doctor?"

The authors suggest a few reasons why the survey didn't match the exam:

• The "Fake It" Problem: The empathy survey was a self-test. Students might have thought they were empathetic, but when they were actually in the exam room, they might have been too nervous to show it. It's like someone saying, "I'm a great public speaker," but freezing up when the spotlight hits them.
• The Exam Format: The OSCE is a standardized test with a checklist. It measures if you asked the right questions, not necessarily if you made the patient feel a warm hug of understanding. You can check all the boxes without being deeply empathetic.

The Takeaway: What Should We Do?

The study concludes that we can't just look at a student's personality profile and say, "This one will be a great doctor."

• Don't rely on personality tests to predict who will pass medical school.
• Practice makes perfect: The best predictor of success is simply having done it before.
• Different skills for different tasks: Being organized helps with technical tasks; being empathetic is crucial for real-life patient care, but it's hard to measure on a multiple-choice style exam.

In short: Being a good doctor is a complex recipe. You need the ingredients (knowledge), the practice (experience), and the right mindset. But just because you have a "nice personality" on paper doesn't guarantee you'll be the best chef in the kitchen. You still have to show up, do the work, and keep cooking.

Technical Summary

1. Problem Statement

Objective Structured Clinical Examinations (OSCEs) are the gold standard for assessing clinical competence in medical students, including non-technical skills like communication and empathy. While extensive research has attempted to identify predictors of OSCE success, the specific influence of individual psychological traits—namely Big Five personality dimensions, empathy levels, and stress-related mindsets (growth mindset and stress-is-enhancing mindset)—remains understudied and yields conflicting results in existing literature.

The study addresses the gap in understanding whether these non-cognitive, self-reported psychometric markers can reliably predict performance in high-stakes OSCEs, or if traditional academic metrics (written exams, prior OSCE performance) and demographic factors are superior predictors.

2. Methodology

Study Design & Population:

• Design: Prospective cohort study.
• Participants: 99 fifth-year medical students from Université Paris Cité (out of a total cohort of 830).
• Timing: Psychometric assessments were conducted 6 weeks prior to the graduation summative OSCEs (June 2024).

Data Collection Instruments:
Participants completed an online questionnaire (LimeSurvey) comprising 102 items, including:

• Personality: Big Five Inventory-2 (BFI-2-Fr), assessing Extraversion, Agreeableness, Conscientiousness, Neuroticism, and Openness (plus 15 facets).
• Empathy: Jefferson Scale of Physician Empathy – Medical Student version (JSPE-MS), measuring Perspective Taking, Compassionate Care, and Walking in Patient's Shoes.
• Mindsets:
  • Stress Mindset Measure (SMM): Belief that stress is enhancing vs. debilitating.
  • Growth Mindset Scale (GMS): Belief that intelligence/ability is malleable.
• Demographics & History: Gender, age, specialty choice, parenthood, public performance experience, and clinical rotation experiences.
• Performance Metrics:
  • Current OSCE scores (June 2024).
  • Previous OSCE scores (December 2023).
  • Written mock examination scores (July 2024).
  • OSCE stations were dichotomized into Interactive (patient/clinician interaction) and Non-Interactive (procedural/no human interaction).

Statistical Analysis:

• Primary Analysis: Spearman correlation tests and linear regression (univariate and multivariate) to predict OSCE scores.
• Secondary Analysis: Investigation of gender differences in psychometric scores and cluster analysis (K-means on PCA-reduced data) to identify student profiles.
• Software: R (v4.4.1) and RStudio.
• Significance: $p < 0.05$ (adjusted for multiplicity using Benjamini-Hochberg procedure).

3. Key Contributions

1. Differentiation of OSCE Types: The study uniquely separates OSCE performance into interactive and non-interactive stations, revealing that predictors differ significantly between these modalities.
2. Comprehensive Psychometric Scope: It is one of the first studies to simultaneously apply the BFI-2 (a newer, more robust version of the Big Five), JSPE-MS, and synergistic stress/growth mindset scales in a medical OSCE context.
3. Refutation of Isolated Trait Predictors: The study provides strong evidence that self-reported personality, empathy, and mindsets, when treated as isolated variables, do not predict overall OSCE success.
4. Cluster Analysis: It introduces a post-hoc exploratory clustering approach to identify distinct student profiles based on the combination of these traits, showing that holistic profiles (e.g., high conscientiousness + low neuroticism + high empathy) correlate better with performance than single traits.

4. Key Results

Primary Findings (Overall OSCE Performance):

• No Significant Correlation: None of the four psychometric tests (BFI-2 domains, JSPE-MS, SMM, GMS) showed a significant correlation with overall OSCE scores in multivariate analysis.
• Strongest Predictors: The most significant predictors of success were:
  1. Previous OSCE performance (Multivariate $p=0.018$).
  2. Written mock examination scores (Significant in univariate, trend in multivariate).
  3. Female gender (Being male showed a negative association, $p=0.051$).

Secondary Findings (Station Specifics):

• Non-Interactive Stations: Conscientiousness was the only significant predictor ($p=0.001$), showing a positive association. This suggests non-interactive stations function more like traditional academic assessments where diligence and organization matter.
• Interactive Stations: No personality traits or demographic variables significantly predicted performance.
• Performance Improvement: Neuroticism was positively associated with performance improvement between the December and June OSCE sessions ($p=0.042$), suggesting higher neuroticism may drive greater effort to improve after initial feedback.

Cluster Analysis:

• Four distinct student profiles were identified.
• Cluster 4 (High Conscientiousness, Agreeableness, Openness; Low Neuroticism; High Empathy/Mindsets) consistently achieved the highest performance across all exams.
• Cluster 1 (Low empathy, low growth mindset, unfavorable Big Five traits) performed the lowest.

5. Significance and Implications

• Pedagogical Shift: The findings suggest that medical educators should not rely on personality or empathy questionnaires to predict OSCE success or select students. Instead, prior performance (both written and practical) is the most reliable indicator.
• Assessment Design: The divergence between interactive and non-interactive station predictors implies that OSCEs are not a monolithic assessment tool. Non-interactive stations may inadvertently measure academic diligence (Conscientiousness) rather than clinical communication skills.
• Intervention Targets: Since personality traits are relatively stable, interventions should focus on modifiable factors. The study highlights that empathy and mindsets can be cultivated (e.g., via Balint groups or mindset interventions), even if they don't directly predict current OSCE scores.
• Ecological Validity: The authors argue that self-reported scales (subjective) often fail to predict observed behavior (objective OSCE scores) due to social desirability bias. Future assessments should integrate direct observation, simulated patient feedback, and self-reflection to capture the full spectrum of non-cognitive skills.

Conclusion:
While personality traits, empathy, and stress mindsets are crucial for the doctor-patient relationship, they do not serve as isolated predictors of OSCE scores. Success in OSCEs is best predicted by prior academic and practical performance, with specific nuances depending on whether the station requires human interaction. Multidimensional assessment strategies are recommended over reliance on single psychometric traits.