📄 medicine

Preparedness for Independent Practice Among Residency Graduates: Validation of the ORPI-26 Survey Tool and a Cross-Specialty Comparative Analysis

This study validates the ORPI-26 survey as a reliable tool for assessing residency graduates' self-perceived preparedness in Oman, revealing high overall readiness but identifying specific deficits in systems-based practice, legal/risk management, and research planning that warrant targeted curricular improvements.

Original authors: Dina Al Hinai, Thuraya Al Busaidi, Badriya Al Farsi, Abdullah Al Alawi, Ibrahim Al Busaidi, Nawaf Al Muqaimi, Aysha Al Balushi, Houd Al Abri, Khalil Al Farsi

Published 2026-07-07

📖 5 min read🧠 Deep dive

CC BY 4.0

Original authors: Dina Al Hinai, Thuraya Al Busaidi, Badriya Al Farsi, Abdullah Al Alawi, Ibrahim Al Busaidi, Nawaf Al Muqaimi, Aysha Al Balushi, Houd Al Abri, Khalil Al Farsi

Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine a medical residency program as a flight simulator for doctors. For years, trainees fly the plane with a seasoned captain (the supervisor) right next to them, ready to grab the controls if things go wrong. The big question this study asks is: When the trainee finally sits in the pilot's seat alone, do they actually feel ready to fly the plane, or do they feel like they're about to crash?

This research, conducted in Oman, didn't just ask "Are you ready?" with a simple yes or no. Instead, the researchers built a new, highly detailed checklist (called the ORPI-26) to measure exactly how confident new doctors feel about different parts of their job.

Here is the breakdown of what they found, using simple analogies:

1. The New Checklist (The ORPI-26)

The researchers created a 26-question survey based on six key "flight skills" (known as ACGME competencies). They tested this checklist on the 2025 graduating class to make sure it was accurate and reliable.

The Result: The checklist worked perfectly. It was like a high-precision radar; it consistently measured the same thing every time and could clearly distinguish between different types of skills.

2. The Overall Score: "We Feel Ready!"

When the new doctors looked at the big picture, they felt very confident.

The Score: On a scale of 1 to 5, the average score was 4.38.
The Analogy: Imagine a group of new pilots saying, "I feel 85% ready to fly solo." That is a high score. They felt they had the medical knowledge and the ability to care for patients.

3. The "Hidden Turbulence": Where They Felt Less Ready

While the overall feeling was positive, the detailed checklist revealed some specific areas where the "simulator" didn't prepare them well enough for the real world.

The Strongest Skills: They felt most confident in Communication (talking to patients and families) and Patient Care (doing the actual medical work).
- Analogy: They are excellent at steering the plane and talking to the passengers.
The Weakest Skills: The lowest scores were in Systems-Based Practice (navigating the hospital bureaucracy, understanding laws, and managing the system) and Practice-Based Learning (doing research and managing their own work-life balance).
- Analogy: They know how to fly, but they feel lost when it comes to reading the flight manual, understanding air traffic control rules, or knowing how to file the paperwork after the flight.

4. The "Specialty" Surprise

The study compared different types of doctors (Medical, Surgical, and Diagnostic/Lab).

The Finding: Doctors from Medical and Surgical backgrounds felt similarly ready. However, doctors from Diagnostic/Laboratory backgrounds (like pathologists or radiologists) felt significantly less prepared to work independently.
The Analogy: The pilots who spent their training mostly in the cockpit (Medical/Surgical) felt ready to fly. The pilots who spent their training mostly in the "maintenance hangar" (Lab/Diagnostic) felt less sure about how to handle the plane once they were alone in the air. The study suggests this might be because lab doctors had fewer chances to practice making independent decisions during their training.

5. The "Gender" Mystery

At first glance, male doctors seemed to feel more confident than female doctors.

The Twist: When the researchers adjusted for the fact that men and women were in different types of programs (specialties), the difference disappeared.
The Analogy: It wasn't that men were naturally better pilots; it was just that the specific "flight school" they attended happened to make them feel more confident. Once you account for the school type, the gender gap vanished.

6. What the Doctors Said in Their Own Words

The study also asked doctors to write down what they felt unprepared for. The top three complaints were:

Legal and Risk Management: "I don't know the rules and laws well enough."
Research: "I don't know how to plan or run a study."
Work-Life Balance: "I don't know how to manage stress or avoid burnout."

The Bottom Line

The study concludes that the "flight simulator" (residency training) is doing a great job teaching doctors how to treat patients and talk to them. However, it is missing a few crucial modules on how to run a practice, understand the legal system, and manage research.

The authors suggest that before new doctors fly solo, they need a specific "Transition Phase"—a final training period focused on these missing skills (laws, admin, and research) to ensure they aren't just good pilots, but also good captains who can handle the whole flight.

Important Note: The study only measured how doctors felt about their readiness. It did not measure if they were actually making fewer mistakes or saving more lives, though the authors suggest that feeling unprepared in these areas could lead to real-world problems like burnout or errors.

Technical Summary: Validation of the ORPI-26 and Cross-Specialty Analysis of Residency Graduates in Oman

Problem Statement
The transition from supervised residency training to independent clinical practice represents a critical career inflection point. Despite decades of reform in Graduate Medical Education (GME) toward competency-based models (e.g., ACGME core competencies, Milestones, EPAs), concerns persist that graduates may leave training inadequately prepared for autonomous practice. While international literature documents a "global-granular paradox"—where high aggregate preparedness ratings mask specific deficits in non-clinical or complex procedural domains—there is a lack of validated instruments to assess this preparedness within the Gulf region. Specifically, no psychometrically validated, multidimensional survey mapped to the six ACGME core competency domains existed for the Oman Medical Specialty Board (OMSB) or broader Gulf graduates to characterize self-perceived readiness for independent practice.

Methodology
The study employed a cross-sectional survey design targeting the 2025 OMSB residency graduating cohort (N=145 eligible). Data collection occurred between September and November 2025, a window selected to capture the transition to independent practice while minimizing recall bias.

Instrument Development (ORPI-26): The Oman Residency Preparedness Index (ORPI-26) was developed through a five-stage process:
1. Generation of an initial 38-item pool based on existing literature and ACGME domains.
2. Expert content validity review by a panel of eight senior reviewers (program directors and medical educators), retaining items with an Item-level Content Validity Index (I-CVI) > 0.78.
3. Cognitive pre-testing with recent graduates to refine item interpretation.
4. Pilot testing (n=20) to assess feasibility and reliability.
5. Finalization of a 26-item scale mapped to six ACGME domains (Medical Knowledge, Patient Care, Interpersonal/Communication Skills, Practice-Based Learning, Professionalism, Systems-Based Practice), rated on a 5-point Likert scale. A single-item global preparedness anchor was added separately for concurrent validity.
Psychometric Analysis: The study utilized Cronbach's alpha and McDonald's omega for internal consistency, Kaiser-Meyer-Olkin (KMO) and Bartlett's test for sampling adequacy, and Exploratory Factor Analysis (EFA) with parallel analysis to determine factor structure. Concurrent validity was assessed via Spearman correlation against the independent global anchor.
Statistical Analysis: Quantitative data were analyzed using R (v4.3). Between-group comparisons (gender, specialty, training length, practice setting) utilized non-parametric tests (Mann-Whitney U, Kruskal-Wallis) due to small sub-group sizes. Multivariable linear regression identified independent predictors of preparedness. Sensitivity analyses, including bootstrap resampling (2,000 replicates) and model refitting, were performed to test the robustness of findings, particularly regarding the small laboratory/diagnostic sub-sample.
Qualitative Analysis: Free-text responses regarding areas of least preparedness, effective training aspects, and curricular suggestions were analyzed using conventional content analysis.

Key Results

Response and Demographics: The survey achieved a 51% response rate (n=74). The cohort was 70.3% female, with 66.2% from medical, 23.0% from surgical, and 10.8% from diagnostic/laboratory programs.
Psychometric Validation: The ORPI-26 demonstrated excellent internal consistency (Cronbach's $\alpha$ = 0.96; McDonald's $\omega$ = 0.96) and meritorious sampling adequacy (KMO = 0.87). EFA with parallel analysis supported a unidimensional factor structure, with the first factor explaining 60.6% of the variance. All 26 items loaded above the 0.40 threshold (range 0.55–0.87). Concurrent validity with the global anchor was strong ( $\rho$ = 0.83, p < 0.001).
Preparedness Scores: Overall self-perceived preparedness was high (Mean = 4.38/5.0, 95% CI 4.26–4.50).
- Highest Domains: Communication (4.57) and Patient Care (4.44).
- Lowest Domains: Systems-Based Practice (4.15) and Practice-Based Learning and Improvement (4.32).
Predictors of Preparedness:
- Specialty: In multivariable regression, graduates from laboratory/diagnostic programs reported significantly lower preparedness than medical graduates ( $\beta$ = -0.71, p = 0.001). Surgical and medical graduates showed no significant difference.
- Gender: Univariate analysis showed males reported higher preparedness than females (p = 0.021), but this effect attenuated to non-significance ( $\beta$ = 0.19, p = 0.12) after adjusting for specialty, suggesting confounding by specialty distribution.
- Training Length: No significant association was found between training length (4 vs. 5–6 years) and preparedness, though a non-significant trend favored longer programs.
Qualitative Findings: Free-text responses identified the most frequent gaps as legal and risk management (51.3%), research planning (35.1%), and work-life balance (24.3%). Graduates cited high clinical volume and graduated responsibility as strengths, while requesting enhanced training in system navigation, medical-legal issues, and structured transition-to-practice phases.

Significance and Claims
The paper claims to provide the first psychometric validation of a multidimensional preparedness instrument mapped to ACGME competencies within the Gulf region. The authors assert that the ORPI-26 is a reliable and valid tool for measuring self-perceived preparedness among OMSB graduates, suitable for ongoing program evaluation.

The study concludes that while OMSB graduates report high overall preparedness comparable to international benchmarks, a "global-granular paradox" exists: high aggregate scores mask specific deficits in non-clinical domains, particularly Systems-Based Practice, research, and legal/administrative skills. The authors argue that competency-based training in the region, as elsewhere, effectively builds clinical skills but may under-prepare graduates for the organizational and non-clinical demands of independent practice.

The paper posits that the ORPI-26 can serve as a monitoring tool for the OMSB to evaluate curriculum changes. It suggests that targeted curricular enhancements—specifically a formal transition-to-practice phase, structured medical-legal training, and research mentorship—are warranted to address the identified gaps. The authors maintain a modest stance, acknowledging that self-reported preparedness does not equate to objective competence and that the findings, particularly regarding the small diagnostic sub-sample, require confirmation in larger, longitudinal studies.