Time-Averaged Drift Approximations are Inconsistent for Inference in Drift Diffusion Models
This paper demonstrates that the time-averaged drift approximation (TADA), commonly used for efficient parameter inference in drift diffusion models with time-varying drift, is statistically inconsistent and leads to systematic biases and false scientific conclusions.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
The Big Picture: A Broken Compass for Decision Making
Imagine you are trying to figure out how a person makes a decision. Scientists use a mathematical tool called a Drift Diffusion Model (DDM) to do this. Think of this model as a hiker walking through a foggy valley.
- The hiker is the person's brain accumulating evidence.
- The fog is the noise or randomness in their thoughts.
- The hiker's speed and direction (the "drift") depend on how much they like Option A versus Option B.
- The cliffs on either side of the valley are the decision boundaries. Once the hiker hits a cliff, they make a choice.
In many modern experiments, the hiker's speed isn't constant. It changes moment-to-moment based on where the person is looking (their "gaze"). If they look at Option A, they move faster toward it; if they look at Option B, they slow down or move the other way. This is called an Attentional Drift Diffusion Model (aDDM).
The Problem: The "Shortcut" That Lies
Calculating exactly how this hiker moves when their speed is constantly changing is incredibly hard and slow for computers. It's like trying to calculate the exact path of a car that changes speed every second based on traffic lights, while also accounting for every pothole.
To make the math easier, many researchers use a shortcut called Time-Averaged Drift Approximation (TADA).
- The Analogy: Imagine you want to know how fast a car drove on a trip. Instead of looking at the speedometer every second, you just take the total distance and divide it by the total time. You get an "average speed."
- The Assumption: Researchers using TADA assume that if they replace the hiker's constantly changing speed with this single "average speed," the math will work out the same. They think, "If I use this average speed, I can use a simple, fast formula to figure out the hiker's true preferences."
The Paper's Discovery: The Shortcut is Broken
The authors of this paper (Liu, Fengler, Frank, and Harrison) proved that this shortcut is fundamentally broken.
They showed that using the "average speed" (TADA) to guess the hiker's true preferences leads to wrong answers, and the more data you collect, the more confident you become in those wrong answers.
Here are the three main ways they proved this:
1. The "Time Travel" Paradox
The paper explains that TADA is mathematically impossible to define correctly.
- The Analogy: To calculate the "average speed" of the hiker using TADA, you need to know how long the trip took before the trip is even over.
- The Reality: The "average speed" depends on the exact moment the hiker hits the cliff (the decision time). But the decision time is the very thing you are trying to predict!
- The Result: Because the shortcut relies on information from the future (the decision time) to calculate the present (the speed), it creates a "ghost" model. It's not a real description of how the brain works; it's a mathematical illusion.
2. The "Always Too High" Bias
The authors ran a simple math proof and computer simulations to show what happens when you use this shortcut.
- The Analogy: Imagine you are trying to guess the true weight of a mystery box. You use a broken scale that always adds 5 pounds to the reading.
- If the box weighs 10 lbs, the scale says 15.
- If the box weighs 100 lbs, the scale says 105.
- No matter how many times you weigh the box, the scale never gets closer to the truth. It is "inconsistent."
- The Result: The paper proves that TADA always overestimates the strength of the "drift." If a person has a moderate preference, TADA will tell you they have a very strong preference. It systematically lies about the magnitude of the effect.
3. The "Wrong Winner" in Scientific Tests
This is the most dangerous part. The authors showed that this broken shortcut can make scientists draw the wrong conclusion about which group of people is different.
- The Analogy: Imagine you are comparing two runners, Alice and Bob, to see who is faster.
- Alice runs on a track with a slight uphill slope.
- Bob runs on a flat track.
- You use a broken stopwatch (TADA) that runs slow on hills but fast on flat ground.
- Even if Alice is actually faster, your broken stopwatch might say Bob is faster just because of the track conditions, not because of their running ability.
- The Result: The paper simulated two groups of people with slightly different attention styles. When they used the standard, correct math, they found the right difference. When they used the TADA shortcut, the results were so distorted that they concluded the opposite group was stronger. They found "statistical significance" for a difference that didn't exist, or missed a real difference entirely.
The Solution: Don't Use the Shortcut
The paper concludes that while TADA is fast and easy, it is unsafe for scientific research. It leads to biased results and false conclusions.
Instead of using the shortcut, the authors point to a new, fast, and mathematically correct method they developed in a separate paper (called efpt).
- The Analogy: Instead of using the broken "average speed" scale, they built a new, high-tech scale that can handle the complex, changing speeds of the hiker without getting confused. It is just as fast as the shortcut but gives the true answer.
Summary
- The Tool: Scientists use models to understand how attention affects decision-making.
- The Mistake: Many use a "time-averaged" shortcut (TADA) to make the math easier.
- The Finding: This shortcut is mathematically inconsistent. It doesn't converge to the truth; it consistently overestimates effects and can flip the results of scientific tests, making it look like one group is different from another when they aren't (or vice versa).
- The Advice: Stop using TADA. Use the new, accurate, and fast methods (like efpt) that the authors developed to get the right answer.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.