← Latest papers
📈 economics

Racing to Ruin

This paper analyzes how R&D competition in the shadow of a catastrophic disaster creates a bounded equilibrium frontier for technological advancement, which is determined by the interplay between monitoring transparency and the degree of trust firms place in their rivals' rationality.

Original authors: Drew Fudenberg, Andrew Koh

Published 2026-07-31
📖 6 min read🧠 Deep dive

Original authors: Drew Fudenberg, Andrew Koh

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

The High-Stakes Game of "Don't Stop Until You're Told To"

Imagine a world where two companies are racing to build the ultimate super-tool. Think of it like two chefs trying to invent the perfect, most delicious sandwich. The faster they invent it, the more money they make. But here's the twist: the recipe is so powerful that if they push it just a little too far, the whole kitchen might explode, destroying the sandwich, the chefs, and the restaurant forever. This is the world of "existential risk" in economics. It's a branch of science that asks: How do smart, rational people behave when they are competing for a prize, but the competition itself might kill everyone?

The key idea here is a "race." In normal races, like a 100-meter dash, you run as fast as you can because being first wins the gold medal. But in this specific type of race, the finish line is a cliff. If you run too fast, you fall off. The paper explores a terrifying paradox: even if both competitors would be happier if they both slowed down, the fear of being left behind might force them to keep running until they crash. It's a game of chicken played at the speed of light, where the only way to survive is to trust that your opponent will swerve, but you can't be sure they will.


The Paper: Racing to Ruin

This paper, titled Racing to Ruin, dives into a simple but scary model of two companies (let's call them "Tech A" and "Tech B") competing to advance a dangerous technology. The authors, Drew Fudenberg and Andrew Koh, set up a game where every step forward increases the company's profits but also increases the chance of a permanent disaster that wipes out everyone's future earnings.

The central question is: How far will they go before they stop?

The Perfect World: Clear Signals and Trust

First, the authors imagine a "perfect" world. In this scenario, Tech A and Tech B can see each other's moves instantly. If Tech A hits the brakes, Tech B sees it immediately. They also know for a fact that the other company is smart and rational (they aren't "crazy" and won't keep running just for fun).

In this perfect world, the paper finds that the companies will stop at a very specific, predictable point. It's not as far as a single company would go if it were alone (a monopoly), but it's not as far as a company that mistakenly thinks its rival is about to quit. The authors prove that with perfect eyesight and total trust, the companies can coordinate to stop just before the cliff. They won't race forever; they will find a safe "ceiling" and stop there.

The Foggy World: When Signals Are Delayed

Now, let's add some fog. What if Tech A stops, but Tech B doesn't know it for a while? Maybe the news travels slowly, or there's a delay in the signal. The paper calls this "imperfect transparency."

Here, things get messy. The authors show that if the news is too slow, the companies might race forever. Why? Because Tech A thinks, "If I stop now, Tech B won't know for a long time. While they don't know, they'll keep running and make more money than me, and the danger will keep growing." So, Tech A decides to keep running too. This creates a trap where both companies keep racing toward the cliff, even though they both know it's a bad idea. The paper proves that if the delay is long enough, there is an equilibrium where they never stop, and the disaster happens with 100% certainty.

However, if the news is fast enough (even if not perfect), they can still stop. But they might overshoot the safe limit a little bit. The authors calculate that the extra distance they run past the safe point is roughly proportional to how slow the news is. If the news is very fast, they barely overshoot. If it's slow, they overshoot more.

The Trust Issue: What if Your Rival is "Crazy"?

The final twist involves "trust." What if Tech A isn't sure if Tech B is rational? What if there's a small chance Tech B is a "crazy type" who will never stop, no matter what?

The authors find that trust is the most critical ingredient. They divide the world into three zones based on how much Tech A trusts Tech B:

  1. Low Trust: If Tech A thinks there's a decent chance Tech B is crazy, they will race to ruin. Why gamble stopping if the other guy might never stop? The disaster becomes inevitable.
  2. Medium Trust: If the trust is just right, there are two possible outcomes. Either they both stop immediately (a safe equilibrium), or they both race forever (a dangerous equilibrium). It's a coin toss.
  3. High Trust: If Tech A is almost certain Tech B is rational, they will stop. The paper shows that the chance of them racing forever drops very quickly (quadratically) as trust increases.

The Double-Edged Sword of Transparency

One of the paper's most surprising findings is about how "seeing" the other player affects trust. Usually, we think seeing more is always better. But here, transparency is a double-edged sword.

  • Good side: Faster news helps companies coordinate to stop. If Tech A stops, Tech B sees it quickly and stops too.
  • Bad side: Faster news also makes it tempting to "wait and see." If Tech A stops, Tech B might think, "I'll wait just a second to make sure Tech A really stopped, so I can squeeze in a little more profit before I stop." If everyone does this, they might end up racing longer than they should.

The authors show that at certain levels of trust, making the news faster can actually destroy the ability to stop early. It can push the companies from a safe "stop together" equilibrium into a dangerous "race forever" equilibrium, simply because the temptation to wait for confirmation becomes too strong.

The Bottom Line

The paper concludes that competition and coordination are fighting against each other.

  • Competition pushes the technology forward because everyone wants to be ahead.
  • Coordination pulls it back because everyone wants to avoid the cliff.

If the companies can see each other clearly and trust each other, they can find a safe stopping point. But if the signals are fuzzy or if they doubt each other's sanity, they might keep running until the very end, even when they know it will destroy them. The authors don't say this will happen in the real world, but they prove mathematically that it can happen under the right (or wrong) conditions.

In short, the paper suggests that to prevent a technological disaster, we need more than just smart companies; we need a system where they can see each other's moves instantly and trust that everyone is playing by the rules. Without that, the race to the cliff might be unstoppable.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →