What works, for whom, and under what circumstances for recipients of training in opportunistic behaviour change conversations: a mixed methods realist evaluation protocol

This mixed-methods realist evaluation protocol aims to determine how Healthy Conversation Skills (HCS) training enables diverse service providers to effectively deliver Making Every Contact Count (MECC) interventions by identifying which specific training elements work, for whom, and under what circumstances to inform future adaptations and public health policy.

The Gist

Imagine you are trying to teach a whole city how to have better, healthier conversations. You want everyone—from the barista at the coffee shop to the librarian and the pharmacist—to be able to gently nudge people toward making healthier choices (like quitting smoking or eating better) without sounding like a doctor giving a lecture.

This paper is a blueprint for a study designed to figure out exactly how to teach these "healthy conversation skills" so they actually work in the real world.

Here is the breakdown using simple analogies:

1. The Big Problem: The "One-Size-Fits-All" Trap

The government has a program called MECC ("Making Every Contact Count"). The idea is that anyone can have a chat that helps someone get healthier. But right now, the training is messy. Some places teach it like a lecture; others teach it like a role-play. It's like trying to teach people to swim by throwing them all into the deep end with different instructions. Some learn to swim; others sink.

The researchers want to know: What specific parts of the training work, for whom, and under what conditions?

2. The Special Tool: "Healthy Conversation Skills" (HCS)

The study is testing a specific training method called Healthy Conversation Skills (HCS).

• The Old Way: Imagine a doctor saying, "You should stop smoking because it's bad for you." (This is giving advice).
• The HCS Way: Imagine a friend asking, "What would it feel like to breathe easier?" or "What's one small thing you could do to feel better?" (This is asking questions that help the other person find their own solution).

Think of HCS as teaching people to be mirrors rather than megaphones. You reflect the person's own goals back to them so they realize they want to change, rather than you shouting instructions at them.

3. The Experiment: Two Very Different Groups

To see if this "mirror" training works for everyone, the researchers are comparing two very different groups of people:

• Group A: The Community Volunteers (VCSE). These are people who work in charities or local groups. They are great at talking to people and building trust, but they might not know much about health science.
  • Analogy: They are like skilled gardeners who know how to talk to plants, but they don't know the soil chemistry.
• Group B: Pharmacy Students. These are future doctors. They know a lot about health science, but they might be shy or inexperienced at talking to regular people in casual settings.
  • Analogy: They are like chemistry professors who know the soil perfectly, but have never actually planted a seed in a garden.

The study wants to see if the same training helps the gardeners and the professors become equally good at gardening.

4. The "Lite" Version: The Sandwich vs. The Full Meal

Usually, this training takes three separate sessions (a full three-course meal). But in the real world, busy people can't always come back three times. So, they are testing a "Lite" version—a single, three-hour session (like a quick sandwich).

• The Question: Is the "sandwich" enough to teach people how to cook a healthy meal, or do they need the full three-course experience?

5. How They Will Find the Answer (The Recipe)

The researchers aren't just guessing; they are using a method called Realist Evaluation. Think of this as a detective story.

• The Survey (The Scorecard): Before the training, right after, and 8 weeks later, participants fill out a survey. It's like checking their "confidence score" and "skill score" to see if they improved.
• The Interviews (The Story): They will talk to the participants to understand why it worked or didn't work.
  • Example: Maybe the pharmacy students felt confident because they knew the medical facts, but the volunteers felt confident because the training felt safe and non-judgmental.
• The "CMO" Formula: They are looking for a pattern: Context (Who are you?) + Mechanism (What part of the training clicked?) = Outcome (Did you actually have the conversation?).

6. Why This Matters

If this study succeeds, it's like finding the perfect recipe for a universal health tool.

• If the "Lite" sandwich works, we can train thousands of people quickly and cheaply.
• If the training needs to be tweaked for volunteers vs. doctors, we can do that.
• Ultimately, this could change public health policy. Instead of just treating sick people in hospitals, we could empower thousands of everyday people (librarians, bus drivers, volunteers) to help prevent sickness before it starts.

In a nutshell: This paper is a plan to figure out the best way to teach everyday people how to have life-changing conversations about health, ensuring that the training fits the person, not the other way around.

Technical Summary

Based on the provided preprint, here is a detailed technical summary of the study protocol:

Title

What works, for whom, and under what circumstances for recipients of training in opportunistic behaviour change conversations: a mixed methods realist evaluation protocol.

1. Problem Statement

• Context: "Making Every Contact Count" (MECC) is a UK-wide person-centred initiative designed to leverage routine interactions to promote health behaviour change (e.g., smoking cessation, diet, exercise). While widely implemented, there is a lack of evidence regarding sustained behaviour change in recipients and significant variability in training delivery.
• The Gap: Current MECC training approaches vary widely, often focusing on providing information and advice rather than skills-based facilitation. There is insufficient evidence on which training elements work, for whom, and under what circumstances to ensure effective delivery across diverse settings (healthcare vs. non-healthcare).
• Specific Challenge: The "Healthy Conversation Skills" (HCS) approach, which relies on motivational interviewing techniques (asking open questions, avoiding advice) rather than information provision, shows promise. However, it is unclear if the shortened "HCS 'lite'" version (a single 3-hour session) is sufficient for different audiences, specifically:
  • Voluntary, Community, and Social Enterprise (VCSE) workers: Often experienced in user interaction but lacking health promotion confidence.
  • Undergraduate Pharmacy Students: Healthcare-trained but often lacking practical experience in user interaction.
• Objective: To develop and refine a programme theory explaining the mechanisms by which HCS training enables MECC delivery, identifying core components that must be preserved and areas for adaptation.

2. Methodology

This is a concurrent mixed-methods realist evaluation adhering to RAMESES II guidance. The study employs a Context-Mechanism-Outcome (CMO) configuration approach to test and refine Initial Programme Theories (IPTs).

• Study Design:
  • Quantitative: Pre-, post-, and 8-week follow-up surveys.
  • Qualitative: Realist semi-structured interviews.
  • Design Type: Between-subjects design comparing two distinct groups.
• Participants:
  • Group A: Service providers working/volunteering in the VCSE sector (Portsmouth, UK).
  • Group B: Undergraduate pharmacy students (Newcastle University, UK).
  • Target Sample Size: 387 total (194 per group) for surveys to detect a small effect size (0.3) with 80% power. Estimated 40 participants (20 per group) for interviews based on "information power."
• Intervention:
  • HCS 'Lite': A single 3-hour training session based on social cognitive theory and experiential learning.
  • Core Skills: Active listening, Open Discovery Questions (ODQs), reflecting on practice, and facilitating SMARTER goal setting.
  • Philosophy: Empowering individuals to identify their own solutions rather than providing advice.
• Data Collection:
  • Surveys: Administered immediately before training, immediately after, and 8–10 weeks later. Measures include perceived usefulness, importance, confidence, and competence (via scenario-based coding of ODQs and goal setting).
  • Interviews: Conducted 8–10 weeks post-training. Utilize a "teacher learning cycle" where researchers share initial theories and participants validate/refute them based on their experiences.
• Analysis Strategy:
  • Quantitative: SPSS for descriptive statistics, t-tests/Mann-Whitney U tests for group differences, and regression analysis controlling for baseline values.
  • Qualitative: NVivo for iterative coding against IPTs. Analysis focuses on CMO configurations (Context + Mechanism = Outcome).
  • Triangulation: Quantitative survey data will be "qualitised" (converted into CMO statements) and integrated into the qualitative analysis to validate outcomes and link them to mechanisms.

3. Key Contributions (Protocol Level)

• Realist Approach to Training: Moves beyond "does it work?" to "what works, for whom, and why?" by explicitly mapping how context (e.g., professional background) triggers specific mechanisms (e.g., confidence vs. competence) to produce outcomes.
• Comparison of Diverse Audiences: Directly compares non-healthcare professionals (VCSE) with healthcare trainees (Pharmacy) to determine if a "one-size-fits-all" training model is viable or if adaptation is required.
• Evaluation of "Lite" Training: Provides the first rigorous evaluation of the shortened HCS 'lite' format, addressing the tension between scalability (feasibility) and depth of learning (reflection between sessions).
• Theory Refinement: The study aims to produce a refined programme theory that identifies core components of MECC training that are non-negotiable versus those that can be adapted for specific contexts.

4. Results

• Status: As this is a study protocol posted as a preprint (March 2026), no empirical results are available yet.
• Expected Outcomes: The study anticipates producing:
  • A refined programme theory explaining the causal pathways of HCS training.
  • Evidence on whether HCS 'lite' is sufficient for sustained MECC delivery in VCSE settings.
  • Identification of specific barriers and facilitators for different professional groups.
  • Recommendations for adapting training content (e.g., whether goal setting needs modification for opportunistic settings).

5. Significance and Impact

• Policy and Practice: Findings will inform national MECC policy, potentially guiding whether HCS should be the standard training approach across the UK and internationally.
• Resource Allocation: By identifying effective training mechanisms, the study aims to optimize the allocation of health and social care funding for preventative interventions outside traditional healthcare settings.
• Public Health: Successful implementation could empower non-specialist providers (VCSE) to effectively promote health, potentially reducing the incidence of non-communicable diseases (NCDs) through scalable, opportunistic conversations.
• Future Research: The refined theory will serve as the foundation for a future fully powered effectiveness trial of MECC delivery in the VCSE sector.

Note: The study is funded by the National Institute for Health and Care Research (NIHR) and is currently in the data collection phase (August 2025 – July 2026), with results expected by March 2027.