Evaluating the impact of a community-engagement intervention on the uptake of childhood vaccines in England: A synthetic control analysis

This quasi-experimental study using synthetic control analysis found that the Health Equity Liverpool Project's community-engagement intervention produced modest, short-term increases in rotavirus and 6-in-1 vaccine uptake but failed to significantly improve MMR or pneumococcal vaccine coverage or sustain long-term benefits without broader systemic integration.

The Gist

The Big Picture: A "Community Boost" Experiment

Imagine the vaccination system in England as a giant garden. Over the last decade, the flowers (vaccination rates) in this garden have started to wilt, especially in the patches where the soil is poorest (deprived areas). The gardeners (health officials) are worried because if too many flowers die, pests (diseases like measles) will take over.

To fix this, a team in Liverpool tried a new gardening technique called the Health Equity Liverpool Project (HELP). Instead of just sending out flyers, they sent "Community Innovation Teams" into specific neighborhoods to talk directly to parents, listen to their worries, and build trust. They wanted to see if this "community boost" could make the flowers grow taller again.

How They Tested It: The "Twin Garden" Trick

To know if their new technique actually worked, the researchers used a clever trick called a Synthetic Control.

Think of it like this: They took the 19 specific GP clinics (the "Intervention Garden") where the HELP project happened. Then, they used a computer to build a "Twin Garden" out of thousands of other clinics across England. This Twin Garden was a perfect mirror image of the Intervention Garden in terms of population, poverty levels, and past vaccination history.

• The Intervention Garden: Got the special community help.
• The Twin Garden: Got nothing extra (it represents what would have happened if the project didn't exist).

By comparing the two gardens over time, they could see if the special help made a difference.

What They Found: A Short-Lived Bloom

The results were a mix of good news and a reality check:

1. The Early Bloomers (Rotavirus and 6-in-1):
   For the vaccines given to babies (around 12 months old), the community help worked!

   • Rotavirus vaccine: Uptake jumped by about 10%. This meant roughly 120 extra babies got vaccinated compared to the Twin Garden.
   • 6-in-1 vaccine: Uptake jumped by about 11.5%. This meant roughly 143 extra children got vaccinated.
   • The Analogy: It was like giving the garden a sudden, strong dose of fertilizer. The plants sprouted up quickly and looked much healthier.

2. The Stubborn Plants (MMR Vaccine):
   The project was originally designed to fix the MMR vaccine (Measles, Mumps, Rubella), which is given to older children (around 2 to 5 years old). However, nothing changed for these vaccines. The rates stayed exactly the same as the Twin Garden.

   • The Analogy: These plants were like deep-rooted weeds. A little bit of extra water and attention wasn't enough to move them. The parents' hesitation about MMR is often tied to deep-seated fears (like old rumors about autism) that a few community chats couldn't dissolve.

3. The "Fade Out" Effect:
   Here is the most important part: The boost didn't last.

   • The extra vaccinations for the baby vaccines lasted for about nine months. After that, the rates slowly drifted back down to where they started.
   • The Analogy: It was like a temporary festival in the garden. People came out, the flowers bloomed, but once the festival ended and the music stopped, the garden returned to its normal state. One-off events aren't enough to keep the garden thriving forever.

Why Did This Happen?

The researchers suggest a few reasons:

• Timing Matters: It's easier to get parents to vaccinate babies because they are already visiting the doctor frequently for check-ups. It's like a built-in reminder system. As kids get older, parents have to remember to book the appointments themselves, which is harder.
• The MMR Hurdle: The MMR vaccine has a long history of misinformation. Even with friendly chats, some parents remained unconvinced because their fears were deeply rooted.
• The Funding Cut: The project was supposed to run for longer, but funding ran out early. The "fertilizer" was applied for a shorter time than planned, which might be why the effect faded quickly.

The Bottom Line

The study concludes that community engagement is a helpful tool, but it's not a magic wand.

• It can give a modest, short-term boost to early baby vaccines.
• It cannot fix deep, long-term problems (like MMR hesitancy or poverty) on its own.

To keep the garden healthy, you can't just throw a party once a year. You need to keep the soil rich (addressing poverty), fix the irrigation system (improving the healthcare system), and keep talking to the gardeners (long-term community trust) year after year. Without that long-term investment, the flowers will eventually wilt again.

Technical Summary

1. Problem Statement

Childhood vaccination rates in England have declined over the last decade, failing to meet the World Health Organization's (WHO) 95% coverage target. This decline is not uniform; it disproportionately affects children in socioeconomically deprived areas, widening health inequalities. The primary drivers include vaccine hesitancy, misinformation (particularly regarding the MMR vaccine), and structural barriers.

While hyperlocal community engagement interventions are recommended to build trust and address hesitancy, there is a lack of robust, population-level evidence regarding their effectiveness. Most existing studies rely on small-scale trials or uncontrolled before-and-after designs. This study seeks to fill that gap by rigorously evaluating the Health Equity Liverpool Project (HELP), a community engagement initiative in Liverpool, to determine if such interventions can sustainably increase vaccine uptake.

2. Methodology

The study employed a quasi-experimental design using a Synthetic Control Method (SCM) framework to estimate the causal impact of the intervention.

• Intervention (HELP):

  • Location: Central and North Liverpool (nine delivery sites).
  • Duration: October 2023 to June 2024 (though activities were curtailed in December 2023 due to funding).
  • Mechanism: Multi-disciplinary "Community Innovation Teams" (CITs) co-developed with local partners. Activities included 22 engagement events, 646 recorded parent conversations, and targeted text reminders to 1,965 parents.
  • Target: Parents of children aged 13 months to 5 years, with a specific focus on MMR.

• Data Sources:

  • Outcome Data: Quarterly vaccine uptake counts from the Cover of Vaccination Evaluated Rapidly (COVER) programme (April 2019 – March 2025).
  • Covariates: Socioeconomic data (Index of Multiple Deprivation 2025), demographics (ethnicity, age, sex), practice capacity (appointments per patient), and Quality and Outcomes Framework (QOF) scores.
  • Sample: 5,845 General Practices (GPs) across England.
    • Intervention Group: 19 GPs within a 1km radius of HELP delivery sites.
    • Donor Pool: 5,826 GPs from the rest of England (excluding those in Liverpool's Central/North networks to prevent spillover).

• Analytical Approach:

  • Synthetic Control Construction: A weighted combination of donor GPs was created to match the intervention group's pre-intervention trends and covariates.
  • Timeframe: The pre-intervention period was restricted to April 2022 – December 2023 (Q13–Q19) to avoid the confounding effects of the COVID-19 pandemic on vaccination trends. The post-intervention period ran from January 2024 to March 2025.
  • Sensitivity Analysis: Tested different spatial buffers (0.5 km and 1.5 km) and assessed matching quality using the epsilon statistic.
  • Significance Testing: Permutation inference with 250 random placebo reassignments.

3. Key Contributions

• Methodological Innovation: This is one of the first studies in England to apply Synthetic Control Methods to evaluate a community-based public health intervention at a national scale, moving beyond subjective comparator selection.
• Granular Evaluation: It assesses differential impacts across five distinct routine vaccines (MMR1, MMR2, PCV, 6-in-1, Rotavirus) rather than a single aggregate measure.
• Real-World Evidence: Utilizes open-access, aggregate administrative data to evaluate a "real-world" intervention, avoiding the limitations of individual-level data access while maintaining robustness.
• Temporal Dynamics: Specifically analyzes the duration of the intervention effect, highlighting the transient nature of the gains.

4. Results

The study found modest, short-term improvements in specific early-life vaccines but no significant impact on the MMR vaccine.

• Significant Increases:
  • Rotavirus Vaccine: Uptake increased by 10.03% (95% CI: 0.37% to 24.63%), corresponding to approximately 120 additional infants vaccinated.
  • 6-in-1 Vaccine: Uptake increased by 11.56% (95% CI: 2.37% to 25.56%), corresponding to approximately 143 additional children vaccinated.
• Non-Significant Results:
  • No statistically significant changes were observed for MMR1 (at 24 months or 5 years), MMR2 (at 5 years), or the PCV booster.
• Duration of Effect:
  • The improvements were transient. Uptake rates returned to pre-intervention baseline levels after approximately nine months.
• Sensitivity Analysis:
  • Using a 1.5 km buffer (34 GPs) confirmed the positive effects for Rotavirus (8.30%) and 6-in-1 (7.74%), though effect sizes were slightly attenuated, suggesting distance-related decay.
  • The 0.5 km buffer failed to produce a balanced synthetic control (high epsilon), rendering those estimates unreliable.

5. Significance and Implications

• Limitations of Short-Term Interventions: The findings suggest that one-off community engagement initiatives, even when co-designed with communities, are insufficient for sustained behavioral change. The effects faded once the intervention ceased, indicating a need for continuous reinforcement.
• Vaccine-Specific Resistance: The lack of impact on MMR uptake highlights that specific vaccines (often plagued by historical misinformation like the Wakefield autism scandal) may require more intensive, long-term strategies than general community engagement. Conversely, early infant vaccines (Rotavirus, 6-in-1) may be more responsive due to frequent scheduled health contacts.
• Structural Barriers: The study underscores that community engagement alone cannot overcome deep-seated structural determinants of health (poverty, housing, workforce constraints).
• Policy Recommendation: To achieve sustained gains, community engagement must be integrated into existing immunization systems and supported by long-term investment in addressing social determinants of health, rather than being treated as a standalone, short-term fix.

Conclusion: While hyperlocal community engagement can generate immediate, modest gains in early-life vaccine uptake, it is not a silver bullet for the MMR crisis or for sustaining long-term coverage without systemic support.