Sensitivity analysis for contamination in egocentric-network randomized trials with interference
This paper addresses the bias in Horvitz-Thompson estimators for direct and indirect effects in Egocentric-Network Randomized Trials caused by network contamination by deriving bias-corrected estimators and proposing a novel sensitivity analysis framework, which is demonstrated to be essential for accurate causal inference in the HIV Prevention Trials Network 037 study.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you are trying to figure out how effective a new "peer-to-peer" safety program is. You want to know two things:
- Direct Effect: Does the program help the people who actually sign up for the training?
- Indirect Effect (Spillover): Does the program help the friends of the people who signed up, even if those friends never attended the training?
To do this, researchers often use a method called an Egocentric-Network Randomized Trial (ENRT). Think of this like a "tree planting" experiment.
- The Egos: You pick a few people (the "Egos" or "Tree Trunks") and randomly give them the training.
- The Alters: Each trained person is asked to bring in a few of their friends (the "Alters" or "Branches") to be part of the study.
- The Goal: You measure the outcomes (like whether they stopped risky behaviors) and compare the trained "trees" to the untrained ones, and the "branches" of trained trees to the "branches" of untrained trees.
The Problem: The Invisible Web
The researchers in this paper point out a major flaw in how these studies are usually analyzed. They assume that the "trees" (the groups of friends) are completely separate islands. They assume a friend brought in by Person A has no connection to Person B, and that Person A has no connection to Person B.
But in the real world, people are like a giant, tangled web.
- Person A's friend might also be Person B's friend.
- Person A might be friends with Person B directly.
The paper calls this "contamination." Because the researchers only see the friends they asked for, they miss the invisible lines connecting different groups. They think the groups are isolated, but they are actually leaking into each other.
The Consequence: A Broken Compass
Because the researchers think the groups are separate when they aren't, their "compass" (the math they use to calculate results) is broken.
- The Indirect Effect (Spillover) gets underestimated: If a friend of a trained person gets help because they are secretly connected to another trained person, the researchers miss this. They think the spillover is small, when it's actually huge.
- The Direct Effect gets overestimated: If a trained person is actually getting help from their friend (who is also trained) but the researchers think they are isolated, they might wrongly credit the training for a result that was actually a team effort.
The Solution: A "What If" Safety Net
The authors, Bar Weinstein and Daniel Nevo, didn't just say "this is broken." They built a new toolkit to fix it. They call it Sensitivity Analysis.
Think of this like a pilot checking their instruments before a storm. Since they can't see the invisible web (the missing connections), they can't know the exact truth. Instead, they ask: "What if the web is this tangled? What if it's that tangled?"
They created a framework where researchers can plug in different guesses about how many invisible connections exist:
- The "Grid" Method: They test a whole grid of possibilities. "What if 10% of friends are connected to others? What if 20%?" They run the math for every single scenario to see how the results change.
- The "Probability" Method: Instead of guessing exact numbers, they assign a range of likelihoods (like a weather forecast) to the missing connections and run thousands of simulations to see the most probable outcome.
They also added a special "calibration" feature. If the study asks participants later, "Did you hear about the training from someone else?" they can use those answers to estimate exactly how many invisible connections exist, rather than just guessing.
The Real-World Test: The HPTN 037 Study
The authors tested their new toolkit on a famous real-world study about HIV prevention among people who inject drugs.
- The Old View: Previous analyses of this study, assuming no hidden connections, said the program had a modest direct effect and a small spillover effect.
- The New View: When the authors applied their "contamination" toolkit, the results flipped.
- The Indirect Effect (Spillover) was actually much larger than originally thought (the program was helping friends of friends much more than realized).
- The Direct Effect was actually slightly smaller than originally thought (some of the success was due to the hidden network, not just the individual training).
The Bottom Line
This paper is a warning and a guide. It tells researchers: "Don't assume your groups are isolated islands. If you ignore the invisible bridges between them, your math will be wrong."
They provide a new, flexible way to admit, "We don't know exactly how many bridges exist, but here is how we can calculate the results even if we are unsure." This ensures that when we decide if a public health program works, we aren't being fooled by the hidden connections in the social network.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.