⚛️ high-energy theory

The Quantum Mechanics of Rare Events: From Quantum Walks to Stochastic Inflation

This paper develops a practical framework for quantum large deviation theory by demonstrating that dominant rare fluctuations minimize measurement-induced relative entropy, thereby bridging the gap between thermal and quantum regimes in systems ranging from anharmonic oscillators to stochastic inflation in cosmology.

Original authors: Daniel Green, Kshitij Gupta, Akhil Premkumar

Published 2026-08-07

📖 8 min read🧠 Deep dive

CC BY 4.0

Original authors: Daniel Green, Kshitij Gupta, Akhil Premkumar

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine the universe as a giant, bustling city. Most of the time, the people in this city follow the rules of traffic: they drive to work, go home, and stick to the average commute time. In science, we call this "typical behavior," and it's usually easy to predict. But sometimes, something wild happens. A driver might take a shortcut through a field, or a crowd might suddenly surge in a direction nobody expected. These are "rare events." In the world of physics, these rare fluctuations are the secret ingredients that build galaxies, create black holes, and might even explain why our universe exists at all.

For a long time, scientists had two different rulebooks for predicting these wild events. One rulebook was for the "classical" world, where things are noisy and messy, like a crowded street. The other was for the "quantum" world, where things are fuzzy and strange, like a ghost that can be in two places at once. The problem is that our universe is actually a mix of both. Everything is fundamentally quantum, but when you look at big things, they often act classical. Until now, figuring out how these two rulebooks clash during a rare event has been like trying to read a map that is half-drawn in pencil and half-written in invisible ink. We knew the rules for the average day, but the "tail" of the distribution—the extreme, unlikely outcomes—was a mystery.

This paper, written by Daniel Green, Kshitij Gupta, and Akhil Premkumar, tries to fix that map. They developed a new way to calculate the odds of these rare, wild events in quantum systems. Think of it as finding a universal translator between the "noise" of a crowded street and the "ghostly" nature of quantum mechanics. They discovered that when a system is pushed to its limits, the path it takes isn't just about the most likely route; it's about minimizing a specific kind of "surprise" called measurement-induced relative entropy. In simple terms, the universe picks the path that is the least confusing to measure.

The authors tested this idea on a few different scenarios. First, they looked at a simple particle bouncing around in a box (an anharmonic oscillator) to see when it acts like a classical ball and when it acts like a quantum ghost. They found a clear "crossover point": if the particle is close to home, it behaves classically, but if it tries to wander far away, quantum effects take over. Then, they applied this to the cosmos itself, specifically to a theory called "stochastic inflation," which describes how the universe expanded rapidly after the Big Bang. They showed that in this cosmic dance, the usual rules of "detailed balance" (where forward and backward moves are equally likely) break down. The universe, it turns out, is constantly producing a type of "housekeeping entropy" just by existing, even when it looks like it's in equilibrium. This suggests that the quantum nature of the universe leaves a permanent, measurable fingerprint on the rarest events, changing how we understand the very fabric of space and time.

The Story of the Quantum Walker

To understand what the authors did, let's imagine a game of "Quantum Walk."

The Setup: A Drunkard's Walk
Imagine a drunkard walking down a street. In the classical world, every step they take is a bit random. Sometimes they step left, sometimes right. If you watch them for a long time, they usually end up near where they started. But occasionally, by pure luck, they might wander all the way to the next town over. This is a "rare event." In the classical world, we know how to calculate the odds of this: we look for the "least unlikely" path. It's like finding the path of least resistance through a maze.

The Twist: The Quantum Drunkard
Now, imagine our drunkard is actually a quantum particle. This changes everything. In the quantum world, the particle doesn't just take one path; it takes all paths at once until it is measured. It's like the drunkard is a ghost, spreading out over the whole street. When we finally look to see where they are, the "ghost" collapses into a single spot.

The big question the paper asks is: When the quantum drunkard wanders far away (a rare event), does it behave like a classical drunkard taking a lucky path, or does it behave like a quantum ghost?

The Discovery: The "Least Confusing" Path
The authors found that the answer depends on how "noisy" the environment is.

The Classical Zone: If the environment is very noisy (like a busy street with lots of random bumps), the quantum ghost gets "scared" into acting like a normal person. The rare event happens via a path that minimizes the "relative entropy." Think of this as the path that is the least surprising to an observer. It's the path that requires the least amount of "measurement-induced" confusion.
The Quantum Zone: If the environment is quiet, the ghost stays a ghost. The rare event is determined by the shape of the particle's wavefunction (the WKB approximation). Here, the particle isn't just walking; it's tunneling through barriers in a way that has no classical equivalent.

The paper shows that there is a smooth transition between these two zones. As you look at larger and larger distances (the "tails" of the distribution), the rules change. The authors proved that you can predict this transition by looking at a specific mathematical quantity: the measurement-induced relative entropy. This is a fancy way of saying, "How much does the act of measuring the particle change its state?" The universe seems to pick the path that keeps this change to a minimum.

The Cosmic Application: The Universe's Random Walk
The authors then took this idea and applied it to the biggest game of all: the early universe. They looked at a theory called Stochastic Inflation. Imagine the universe as a balloon being blown up. The surface of the balloon has tiny ripples (quantum fluctuations). Usually, we think of these ripples as just random noise. But the authors showed that these ripples are actually a giant quantum walk.

Here's the kicker: In a normal, calm system, if you wait long enough, things settle down and become reversible (you can play the movie backward and it looks the same). This is called "detailed balance." But the authors found that in the expanding universe, this balance is broken. The universe is constantly producing housekeeping entropy.

Imagine a river flowing downstream. Even if the water looks calm on the surface, the current is always moving in one direction. You can't just reverse the flow without doing extra work. The authors showed that the quantum fields in the early universe are like that river. They are constantly "paying a cost" in entropy just to exist in their current state. This means that the standard rules we use to describe the universe (like the KMS symmetry, which is a fancy way of saying "time looks the same forward and backward in equilibrium") are actually broken for these rare, long-wavelength fluctuations.

Why This Matters
This isn't just a math puzzle. It helps us understand things like Primordial Black Holes (black holes formed in the first second of the universe) and Eternal Inflation (the idea that our universe is just one bubble in an infinite sea of universes). These are all "rare events." If we use the wrong rulebook (classical instead of quantum, or vice versa), we might get the odds completely wrong.

The paper suggests that to understand these extreme cosmic events, we need to stop treating the universe as either purely classical or purely quantum. Instead, we need to look at how the act of "measuring" or "observing" the universe forces it to choose a path. The universe, it seems, is a master of minimizing surprise, even when it's doing something wild.

The Bottom Line
The authors didn't just guess this; they derived it using rigorous math and checked it against known models like the anharmonic oscillator. They showed that the transition from classical to quantum behavior is governed by a thermodynamic principle: minimizing the entropy induced by measurement. This provides a new, solid foundation for calculating the odds of the most extreme events in the universe, from the smallest particles to the largest cosmic structures. It's a new lens through which to view the rare, the wild, and the wonderful.

Technical Summary: The Quantum Mechanics of Rare Events

Problem Statement
Physical systems fundamentally rely on quantum mechanics, yet the theoretical framework for describing rare fluctuations (the tails of probability distributions) in quantum systems remains underdeveloped compared to classical statistical mechanics. In classical systems, the Large Deviation Principle (LDP) and Sanov's theorem provide a rigorous foundation, linking rare events to the minimization of relative entropy (Kullback-Leibler divergence) and the existence of "instantons" (optimal paths). However, in quantum systems, the interplay between intrinsic quantum uncertainty (Born's rule) and classical stochastic noise creates a regime where standard semi-classical methods (like WKB) and classical stochastic descriptions (like Fokker-Planck equations) often fail or overlap ambiguously. This gap is particularly critical in cosmology, where rare fluctuations drive phenomena such as primordial black hole formation and eternal inflation, and where the validity of stochastic inflation versus wavefunction-based approaches is debated.

Methodology
The authors develop a practical theory of large deviations for quantum systems by analyzing "quantum walks"—minimal generalizations of classical random walks where steps are determined by coupling a walker to a bath of quantum degrees of freedom. The methodology proceeds through three main stages:

Anharmonic Oscillator Analysis: The authors first model a quantum anharmonic oscillator coupled to a bath. They utilize the Schwinger-Keldysh (closed-time-path) formalism and open influence functionals to derive the evolution of the density matrix. By analyzing the saddle points of the action in terms of classical ( $x_c$ ) and quantum ( $x_q$ ) variables, they explicitly map the transition from thermal (classical) tails to quantum (WKB) tails.
Generalization via Relative Entropy: Moving beyond specific models, the authors generalize the results using Quantum Sanov's theorem. They argue that for quantum walks, the probability of rare events is determined not by the standard quantum relative entropy (which can diverge for pure states), but by the measurement-induced relative entropy. This quantity accounts for the projection of the system's density matrix into the basis defined by the measurement (or the step operator).
Cosmological Application: The framework is applied to stochastic inflation in de Sitter space. The authors treat the long-wavelength modes of light scalar fields as a quantum walk driven by short-wavelength quantum fluctuations. They analyze the density matrix evolution to determine if the system reaches a state of detailed balance (KMS symmetry) or a Non-Equilibrium Steady State (NESS).

Key Contributions and Results

Thermal-to-Quantum Crossover: For the anharmonic oscillator, the authors derive the specific condition under which the tail of the probability distribution transitions from classical thermal behavior ( $P \sim e^{-\beta V(x)}$ ) to quantum WKB behavior ( $P \sim e^{-S_{WKB}}$ ). This transition occurs when the condition $\beta \sqrt{V''(x)/m} \sim 1$ is met, indicating that off-diagonal terms in the density matrix become significant.
Measurement-Induced Relative Entropy: The paper establishes that the dominant rare fluctuations in a quantum walk minimize the measurement-induced relative entropy between the empirical density matrix (defined by the distribution of steps) and the true density matrix. This provides a thermodynamic description of open quantum systems where the "cost" of a rare fluctuation is the entropy generated by the measurement process required to define the step distribution.
Lower Bounds on Tails: A practical result derived is that the probability of a rare event is bounded from below by the WKB wavefunction alone ( $P(x) \geq |\psi_{WKB}(x)|^2$ ). This allows for the estimation of rare fluctuation probabilities in regimes where the full non-perturbative noise distribution is unknown, provided the initial state is known.
Breakdown of KMS Symmetry in Stochastic Inflation: Applying these results to cosmology, the authors demonstrate that the density matrix of long-wavelength fields on a fixed de Sitter background evolves into a Non-Equilibrium Steady State (NESS) rather than a thermal equilibrium state. Consequently, the system breaks the Kubo-Martin-Schwinger (KMS) symmetry and detailed balance.
Housekeeping Entropy: The authors calculate that this NESS generates a non-zero "housekeeping entropy" (entropy production required to maintain the steady state against the arrow of time defined by the expanding background). They show that for a free scalar field, this entropy production is formally infinite due to the time-irreversibility of the momentum variable in the absence of momentum noise, though it vanishes if one only observes the position variable in the overdamped limit.

Significance and Claims
The paper claims to provide a unified thermodynamic framework for understanding rare events in quantum systems, bridging the gap between classical large deviation theory and quantum mechanics.

Unification of Approaches: It clarifies the relationship between stochastic inflation (classical noise) and the wavefunction of the universe (quantum mechanics), showing they are not contradictory but represent different regimes of the same underlying quantum walk, separated by the minimization of measurement-induced relative entropy.
Microphysics Sensitivity: The authors emphasize that rare fluctuations are sensitive to the microphysics of the theory (the specific form of the noise and the initial state), unlike typical fluctuations which are governed by universal central limit behavior. This makes the tails of distributions a unique probe of UV physics in cosmology.
Foundational Implications: The work suggests that the failure of detailed balance and KMS symmetry in stochastic inflation is a fundamental feature of the quantum-to-classical transition in expanding spacetimes, rather than an artifact of approximation. This offers a new perspective on the Gibbons-Hawking entropy and the Hartle-Hawking wavefunction, linking the "housekeeping" entropy of the stochastic process to the thermodynamic properties of de Sitter space.

The authors conclude that while quantum mechanics is often irrelevant for macroscopic typical behavior, it is essential for understanding rare events, and their framework offers a concrete path to calculating these events in complex systems ranging from quantum optics to early universe cosmology.

The Story of the Quantum Walker

Technical Summary: The Quantum Mechanics of Rare Events

More like this