Maximum entropy distributions of wavefunctions at thermal equilibrium

This paper proposes a maximum entropy principle for quantum wavefunction ensembles at thermal equilibrium, termed the Scrooge ensemble, which demonstrates that valid equilibrium states require constraining measurement entropy to equal the Rényi divergence with respect to the Gibbs state, in addition to standard energy constraints.

The Gist

Imagine you are trying to predict the weather. You know the average temperature, the humidity, and the wind speed. In the world of classical physics, if you have these average numbers, you can easily figure out the most likely distribution of weather patterns. You use a rule called "Maximum Entropy," which basically says: "Given what we know, assume the most chaotic, unpredictable arrangement possible that still fits the facts." This works perfectly for things like gas molecules in a box.

But what happens when you try to apply this same logic to the quantum world, specifically to wavefunctions?

A wavefunction is like the "blueprint" of a single quantum particle. It's a pure, specific state. The problem is, unlike a gas molecule that has a definite energy, a quantum wavefunction is a bit more slippery. If you try to use the standard rules of thermodynamics to predict how these wavefunctions should be distributed in a hot system, the math breaks down. It's like trying to use a ruler to measure the taste of soup.

This paper, titled "Maximum entropy distributions of wavefunctions at thermal equilibrium," by Jacob Willson and colleagues, solves this puzzle. They ask: If we want to know how quantum wavefunctions are distributed when a system is at a stable temperature, what is the "most random" way they can be arranged?

Here is the story of their discovery, explained with some everyday analogies.

The Failed Attempts: The Wrong Rules

The authors first tried the two most obvious rules, and both failed.

1. The "Average Energy" Rule (The Energy-Constrained Ensemble)
Imagine you have a bag of marbles, and you know the average weight of the marbles. You try to guess the distribution of weights. In the quantum world, they tried to say, "Let's just make sure the average energy of all our wavefunctions matches the temperature."

• The Result: It didn't work. The resulting distribution was weird. At very low temperatures, instead of settling down into the lowest energy state (the "ground state") like a normal system should, the wavefunctions started "condensing" into the ground state in a way that defied the laws of thermodynamics. It was like a crowd of people suddenly all deciding to sit in the same chair at a concert, ignoring the rest of the room. This distribution (called the ECE) didn't match the real world.

2. The "Gibbs State" Rule (The Gibbs-Constrained Ensemble)
Next, they tried a stricter rule. They said, "Okay, let's force the average of all these wavefunctions to look exactly like the standard, correct thermal state (the Gibbs state)."

• The Result: This looked better, but it had a fatal flaw. The authors tested a property called the "Hereditary Property."
  • The Analogy: Imagine you have a big family (the whole universe) and you take a photo of just the parents (the system). If the family is truly in equilibrium, the parents' photo should look like a standard family photo. But if you take a photo of the parents after the kids (the "bath") have been measured or looked at, the parents' photo should still look the same.
  • The Failure: The "Gibbs-constrained" distribution failed this test. If you measured the environment, the system's distribution changed in a way that shouldn't happen. It wasn't a stable, true equilibrium.

The Winner: The "Scrooge" Ensemble

So, what is the right rule? The authors found that to get the correct distribution (which they call the Scrooge Ensemble, named after a previous paper that described it as being "stingy" with information), you need a very strange, specific constraint.

You have to constrain the Rényi Divergence.

What is Rényi Divergence? (The "Surprise" Meter)
Think of it as a "Surprise Meter."

• Imagine you have a "standard" map of a city (the Gibbs state, $\rho$).
• You then look at a specific, actual street view (a single wavefunction, $\Gamma$).
• The Rényi Divergence measures how much "surprised" you would be if you thought the city looked like the map, but it actually looked like the street view.

The authors discovered that the correct distribution of wavefunctions is the one that maximizes chaos (entropy) while keeping the average "surprise" (Rényi Divergence) exactly equal to the average "measurement entropy" of the system.

The Creative Analogy: The "Stingy" Librarian
Imagine a librarian (Nature) who is incredibly stingy with information.

• She has a library of books (wavefunctions).
• She wants to arrange them on the shelves so that the arrangement is as random and chaotic as possible (Maximum Entropy).
• The Catch: She has a rule. She won't let the books be too different from the "Catalog" (the Gibbs state).
• But here's the twist: She doesn't just say "don't be too different." She says, "The average amount of surprise a reader feels when picking a random book, compared to the Catalog, must equal the average surprise of reading the Catalog itself."

This specific "Surprise" constraint is what creates the Scrooge Ensemble. It turns out that if you follow this rule, the distribution:

1. Matches the standard Gibbs state when you look at the big picture.
2. Stays stable even if you measure parts of the system (Hereditary Property).
3. Behaves correctly at all temperatures, avoiding the weird "condensation" errors of the other methods.

Why This Matters

The paper concludes that the Rényi Divergence isn't just a fancy math tool; it might be a fundamental physical law for quantum systems.

• Old View: We thought thermal equilibrium was just about average energy.
• New View: For quantum wavefunctions, equilibrium is about the relationship between the individual states and the average state, measured by how "surprised" they are of each other.

The authors suggest that this "Surprise" metric (Rényi Divergence with a specific setting, $\alpha=2$) is the missing key that explains why quantum systems settle into the states they do. It's like discovering that while a car engine runs on gasoline (energy), the timing of the spark plugs (the Rényi divergence) is what actually keeps the engine running smoothly without exploding.

In a nutshell: To understand how quantum particles behave when they are hot and stable, you can't just look at their energy. You have to look at how "surprised" they are by the average state of the system. When you get that "surprise" right, you get the Scrooge Ensemble, the true, maximum-entropy state of the quantum world.

Technical Summary

1. Problem Statement

The paper addresses a foundational gap in quantum statistical mechanics regarding the statistical distribution of pure state wavefunctions ($|\psi\rangle$) in thermal equilibrium.

• The Conflict: Standard quantum statistical mechanics describes equilibrium via the Gibbs state (density matrix $\rho_G = e^{-\beta H}/Z$), which represents a weighted ensemble of energy eigenstates. However, the physical principles governing the distribution of the underlying pure state wavefunctions (the "P-ensemble") that average to this Gibbs state are not well established.
• The Failure of Conventional Constraints:
  • Applying the Maximum Entropy Principle to a wavefunction ensemble constrained only by the average energy fails to reproduce the Gibbs state. Instead, it yields an "Energy-Constrained Ensemble" (ECE) that deviates significantly from the Gibbs state, particularly at low temperatures and in the thermodynamic limit (exhibiting unphysical ground-state condensation).
  • Constraining the ensemble to average exactly to the Gibbs state (the "Gibbs-Constrained Ensemble" or GCE) preserves the correct density matrix but fails the hereditary property. This means that if a composite system (system + bath) is in a GCE, projecting the bath (via measurement) does not leave the system in the same thermal distribution.
• The Question: What specific physical constraints on a wavefunction ensemble yield a valid thermal distribution that is consistent with the Gibbs state, time-invariant, and hereditary?

2. Methodology

The authors employ an information-theoretic approach, maximizing the P-ensemble entropy ($S_P$) subject to various physical constraints to derive candidate equilibrium distributions.

• Entropy Definition: They define the entropy of the wavefunction ensemble $P(\Gamma)$ (where $\Gamma = |\psi\rangle\langle\psi|$) as:
  $$S_P = -\int [d\Gamma] P(\Gamma) \ln P(\Gamma)$$
  where the integral is over the Haar measure of the pure state space.
• Candidate Distributions: They derive and analyze three specific maximum entropy distributions:
  1. Energy-Constrained Ensemble (ECE): Maximizing $S_P$ subject to $\langle \text{Tr}(H\Gamma) \rangle = U$.
  2. Gibbs-Constrained Ensemble (GCE): Maximizing $S_P$ subject to the constraint that the first moment of the distribution equals the Gibbs state ($\int \Gamma P(\Gamma) = \rho_G$).
  3. Scrooge Ensemble: Maximizing $S_P$ subject to a constraint on the Rényi divergence between the pure state $\Gamma$ and the ensemble density matrix $\rho$.
• Validation Criteria: A valid thermal distribution must satisfy three criteria (proposed by Goldstein et al.):
  1. Consistency: The ensemble average must yield the Gibbs state ($\rho_G$).
  2. Stationarity: The distribution must be invariant under time evolution.
  3. Hereditary Property: If a system-bath composite is in this distribution, the reduced state of the system (after tracing out or measuring the bath) must remain in the same distribution.

3. Key Contributions and Results

A. Failure of Traditional Constraints

• ECE Results: The authors prove that maximizing entropy with a fixed average energy yields a distribution $P_{ECE}$ that is not the Gibbs state. The populations of the ECE differ from the Boltzmann distribution, especially at low temperatures. In the thermodynamic limit, the ECE exhibits ground state condensation, where the ensemble collapses entirely into the ground state, violating extensive thermodynamic properties.
• GCE Results: While the GCE correctly averages to the Gibbs state, it violates the hereditary property. Numerical simulations using the Kolmogorov-Smirnov (KS) statistic show that the projected ensemble of a GCE composite system differs significantly from the thermal distribution of the subsystem, particularly at low temperatures.

B. The Scrooge Ensemble as the Solution

The authors identify the Scrooge ensemble ($P_{Scr}$) as the unique solution that satisfies all equilibrium criteria.

• Derivation: The Scrooge ensemble is derived by maximizing $S_P$ subject to a constraint on the Rényi divergence ($D_\alpha$) between the pure state $\Gamma$ and the ensemble density $\rho$.
• The Unique Constraint: The authors prove that the only self-consistent constraint (where the resulting ensemble average $\rho$ matches the constraint parameter $\rho$) occurs when:
  • The Rényi parameter is $\alpha = 2$.
  • The constraint value is the average measurement entropy over all possible bases: $\langle D_2(\Gamma \parallel \rho) \rangle = \langle H_A(\rho) \rangle_A$.
• Mathematical Form: The resulting distribution is:
  $$P_{Scr}(\Gamma) = \frac{N!}{(2\pi)^{N-1} \det(\rho)} \left( \text{Tr}\{\Gamma \rho^{-1}\} \right)^{-(N+1)}$$
• Verification: The Scrooge ensemble satisfies the Gibbs state consistency, is stationary, and crucially, satisfies the hereditary property at all temperatures.

C. Physical Interpretation of the Constraint

The paper provides a physical interpretation for the Rényi divergence constraint ($D_2$):

• It represents the average excess surprisal (or "distance") of the wavefunctions from their average density matrix $\rho$.
• The constraint $\langle D_2 \rangle = \langle H_A \rangle$ implies that the "spread" of wavefunctions in the ensemble is exactly balanced by the information content (measurement entropy) of the average state.
• The authors argue that $D_2$ is the most stringent physically valid divergence (satisfying the Data Processing Inequality) and that its appearance suggests a previously uninvestigated physical role in quantum thermal equilibrium.

4. Significance

• Foundational Resolution: The paper resolves the long-standing ambiguity regarding the maximum entropy principle for pure state wavefunctions. It demonstrates that the standard Boltzmann energy constraint is insufficient for wavefunction ensembles and that the Gibbs state constraint alone is insufficient to ensure physical consistency (heredity).
• Role of Rényi Divergence: The work elevates the Rényi divergence (specifically $\alpha=2$) from a mathematical tool to a fundamental physical constraint in quantum statistical mechanics. It suggests that thermal equilibrium in quantum systems is defined not just by energy, but by a specific relationship between the wavefunction distribution and the measurement entropy of the ensemble.
• Implications for Quantum Simulation: The findings are critical for simulations of quantum systems (e.g., quantum Monte Carlo, tensor networks) where pure state ensembles are used to approximate mixed states. Using the Scrooge ensemble ensures that the simulation respects the hereditary property and correct thermodynamic limits, whereas standard energy-constrained approaches may lead to unphysical artifacts like ground-state condensation.
• Information-Theoretic Insight: The study bridges the gap between information theory (accessible information, surprisal) and thermodynamics, suggesting that the "stinginess" of information (a property of the Scrooge ensemble) is a fundamental characteristic of thermal equilibrium.

In summary, the authors establish that the Scrooge ensemble is the correct maximum entropy distribution for wavefunctions at thermal equilibrium, governed by a constraint on the Rényi divergence equal to the average measurement entropy, rather than by traditional energy or density matrix constraints.