← Latest papers
🧬 biology

A proxy-based approach for unmeasured confounding in electronic health records research

This paper introduces a practical proxy-based approach using factor analysis to adjust for unmeasured confounding in electronic health records research, demonstrating its robustness under model misspecification and its effectiveness in estimating the impact of hospital admissions for older adults with chest pain.

Original authors: Haley Colgate Kottler, Amy Cochran

Published 2026-03-23
📖 5 min read🧠 Deep dive

Original authors: Haley Colgate Kottler, Amy Cochran

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ⚕️ This is an AI-generated explanation of a preprint that has not been peer-reviewed. It is not medical advice. Do not make health decisions based on this content. Read full disclaimer

Imagine you are a detective trying to solve a mystery: Does sending a patient to the hospital actually help them, or does it make things worse?

In the world of medicine, this is a classic puzzle. If you look at the data, it often looks like patients who go to the hospital get sicker or come back more often. But is that because the hospital caused the problem? Or is it because the patients who went to the hospital were already much sicker to begin with?

This hidden factor—the "sickness level" that doctors can feel but isn't perfectly recorded in the computer—is called an unmeasured confounder. It's the invisible ghost messing up the data.

The Problem: The Ghost in the Machine

Usually, researchers try to fix this by looking at what they can see (age, gender, blood pressure) and adjusting for it. But they can't see the "ghost" (the true severity of the illness).

Some researchers try to use Instrumental Variables (like finding a natural experiment), but that's like trying to find a specific key in a dark room; it's hard to find and often doesn't fit.

Others try to use Negative Controls (variables that shouldn't be affected by the treatment). This is a smart idea, but it's like trying to solve a Rubik's cube with a very complex, rigid set of rules. If you make one small mistake in the rules, the whole solution falls apart.

The Solution: The "Shadow" Team

This paper introduces a new, more flexible way to catch that ghost. The authors, Haley Kottler and Amy Cochran, suggest using a team of proxies.

Think of the unmeasured "ghost" (the true illness) as a shadow cast by a hidden object. You can't see the object, but you can see the shadow.

  • Old way: Look at one part of the shadow (like just the length) and guess the object's shape.
  • New way: Look at the entire shadow from every angle.

In a hospital, doctors record tons of data: heart rate, temperature, breathing speed, how long the patient waited, etc. None of these are the "true illness" itself, but they are all proxies—clues that hint at what's going on underneath.

How the New Method Works (The "Shadow Puppet" Analogy)

The authors propose a two-step process that feels like a magic trick:

  1. Step 1: Build the Shadow Puppet.
    Instead of trying to guess the "true illness" directly, they take all those proxy clues (heart rate, temp, etc.) and use a statistical tool called Factor Analysis.

    • Analogy: Imagine you have a pile of scattered puzzle pieces (the vitals). You don't know what the picture is yet. You group them together to see what shape they form. The tool says, "Hey, all these pieces seem to be pointing to one hidden shape." That shape is the Latent Confounder (the ghost).
    • They create a "summary score" based on these pieces. This score acts as a stand-in for the invisible illness.
  2. Step 2: Use the Puppet in the Play.
    Now, they take this "summary score" and plug it into a standard regression model (a math equation used to predict outcomes).

    • Analogy: Now that you have a puppet representing the ghost, you can put it on stage with the actors (the treatment and the outcome). You can finally see how the ghost is influencing the play. By controlling for the puppet, you can finally tell if the hospital admission actually helps or hurts.

Why This is a Big Deal

1. It's Robust (It doesn't break easily)
The paper tested this method against a "perfect" world and a "messy" world.

  • In the messy world, where the math isn't perfect (e.g., the illness isn't a straight line but a curve), other methods failed and gave wrong answers.
  • This new method was like a Swiss Army Knife. Even when the assumptions were slightly wrong, it still gave a reasonably accurate answer. It didn't crumble when the data got messy.

2. It Uses What We Already Have
Hospitals already collect all these "proxy" vitals. We don't need to invent new data collection methods. We just need to stop ignoring the clues we already have.

The Real-World Test: The Chest Pain Mystery

The authors tested this on real data from older adults with chest pain.

  • The Question: Does admitting them to the hospital prevent them from coming back (readmission) or dying?
  • The Old View: Standard methods said, "Admitting them makes them more likely to come back." (This is likely because the sickest people get admitted, so they look like the hospital is "bad").
  • The New View: Using their "Shadow Puppet" method, they found a different story: Admitting them might actually reduce the risk of coming back.

This aligns better with what doctors expect: if you catch a serious heart issue early and treat it in the hospital, the patient should be safer. The old methods were being fooled by the "ghost" of how sick the patient was.

The Takeaway

This paper is like giving researchers a new pair of glasses.

  • Before: They looked at the data and saw a blurry, confusing picture where the hospital seemed dangerous.
  • After: They put on these new glasses (using the proxy variables to reconstruct the hidden illness), and suddenly the picture is clear. The hospital isn't the villain; it's often the hero, but the "sickness" was hiding behind the scenes.

It's a practical, sturdy way to use the mountains of data hospitals already have to make better, life-saving decisions, without needing perfect data or impossible assumptions.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →