Evaluation of intervention fidelity and moderating factors in a multicentre randomised controlled trial
This post-hoc mixed-methods study confirms that the NSAC Efficacy multicentre trial successfully implemented its intended work-focused, multidisciplinary intervention with high fidelity across five Norwegian clinics, thereby supporting the interpretability of its forthcoming outcome analyses despite observed recruitment challenges and contextual variations.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
When a new medical treatment is tested, the most rigorous way to know if it works is to compare it against a different approach in a controlled experiment. Scientists call this a randomized controlled trial. The goal is to see if the specific ingredients of the new treatment cause a change in health or behavior. However, for this comparison to be fair, the treatment must be delivered exactly as the researchers planned. If the doctors or therapists change the treatment, skip steps, or deliver it to the wrong people, the results become confusing. It becomes impossible to tell if the treatment failed because it does not work, or simply because it was not given correctly. This is a critical problem in large studies that happen across many different hospitals, where local habits and staffing issues can easily alter how a program is run.
In Northern Norway, a team of researchers set out to test a specific kind of help for people who are struggling to stay at work because of physical pain or mental health challenges like anxiety and depression. The program, known as Health in Work, brings together doctors, therapists, and employment counselors to provide a fast, coordinated evaluation and treatment plan. The researchers wanted to know if this rapid, team-based approach helped people return to work faster than standard care. To find out, they ran a large experiment involving five different clinics and 2,500 patients. But before they could look at the final health results, they had to answer a more fundamental question: did the clinics actually do what they were supposed to do?
The researchers conducted a detailed check of the trial after it finished, looking at whether the program was delivered with high fidelity. In plain terms, fidelity means sticking to the plan. They examined three main things: whether the core parts of the treatment were included, whether the right types of patients received it, and whether it happened within the correct timeframe. They also looked at seven potential factors that could have messed things up, such as how well the staff understood the instructions, how the clinics were organized, and whether the people involved were motivated. They used a mix of numbers from patient surveys and interviews with the doctors and therapists who delivered the care to get a full picture.
The investigation showed that the program was delivered very much as intended. The patients who were supposed to receive the full, team-based treatment got it, and the patients in the control group received a simpler, single-profession assessment as planned. The data confirmed that the treatment groups saw a multidisciplinary team that focused heavily on work-related issues, while the control group saw a single professional with a focus more on general health. The timing was also correct; most patients saw a professional within the weeks specified by the rules, even if some saw them slightly earlier than the deadline. The researchers found that the patients who were supposed to be in the study—those with physical pain or mental health struggles affecting their ability to work—were indeed the ones being treated.
However, the study did uncover some challenges that happened over time. The number of new patients referred to the clinics dropped as the trial went on. The researchers suspect this happened because general practitioners, who refer patients to these clinics, became frustrated with the long wait times for patients who did not get into the study or were placed in the control group. They also noticed that the clinics were not all identical; some had more staff and resources than others, and some faced shortages of specific professionals like psychologists or doctors at different times. Despite these variations and the staffing shortages, the staff managed to keep the core of the program intact. They held regular meetings and training sessions to ensure everyone understood the goals, and they adapted their schedules to keep the service running smoothly.
One interesting finding was that the therapists found it difficult to stop talking about work with the patients in the control group. Because their daily job is to help people return to work, they naturally wanted to discuss employment issues with everyone, even those who were supposed to receive a different type of care. The researchers noted that this might have made the two groups look more similar than they were supposed to be, but the staff still followed the rules as closely as possible. The study concluded that the intervention was implemented successfully across all five clinics. The variations in how the clinics operated did not seem to ruin the experiment.
This assessment is important because it gives confidence to the final results of the trial. Since the researchers know the program was delivered as planned, they can trust that any differences in health or work outcomes they find later are likely due to the treatment itself, not because the clinics failed to follow the instructions. The study did not find any evidence that the program was sabotaged by bad timing, wrong patients, or confused staff. While there were some logistical hiccups and a drop in new referrals over time, the core delivery of the service remained strong. The researchers believe that the upcoming analysis of the trial's health outcomes will be reliable, offering a clear answer on whether this rapid, team-based approach helps people stay at work.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.