⚛️ high-energy theory

Information-Theoretic Black Hole Entropy I: Beyond the Area Law

This paper proposes a new information-theoretic black hole entropy formula based on Kullback-Leibler divergence that resolves the conflict with the third law of thermodynamics while recovering the Bekenstein-Hawking area law as a high-temperature leading term.

Original authors: Alex Kehagias

Published 2026-08-07

📖 6 min read🧠 Deep dive

CC BY 4.0

Original authors: Alex Kehagias

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine the universe as a giant, cosmic library. For decades, physicists have been trying to figure out how much "information" or "story" can be stored inside a black hole, the universe's most extreme bookends. They discovered that black holes aren't just empty voids; they are hot, messy thermodynamic systems with a temperature and an entropy (a measure of disorder or missing information). The famous rule they followed for a long time was the "Area Law," which suggested that the amount of information a black hole holds is directly tied to the size of its surface area. It was a beautiful, simple idea: bigger hole, more information.

However, this simple rule hit a snag when scientists looked at the very coldest, most massive black holes. A fundamental rule of thermodynamics, known as the Third Law, says that as something gets colder and colder, its disorder should eventually settle down to a fixed, predictable number (or vanish completely). But the old Area Law predicted that as a black hole got colder, its disorder would grow forever, like a story that never ends and never makes sense. This paper by Alex Kehagias tackles this contradiction. It asks: "What if the old rule is just a rough approximation, like a sketch, and the real picture is more complex?" The author proposes a new way to calculate black hole entropy that respects the Third Law, using ideas from information theory to treat the black hole not just as a cosmic monster, but as a giant collection of tiny, flipping bits of information.

The Cosmic Glitch and the New Fix

For a long time, the "Area Law" was the gold standard for understanding black holes. It said that if you double the mass of a black hole, its entropy (its hidden information) goes up by four times. This worked great for hot, small black holes. But when you look at the limit of a super-massive, freezing-cold black hole, the math breaks down. The old formula says the entropy goes to infinity, which violates the Third Law of Thermodynamics. It's like a thermostat that keeps turning up the heat even when you tell it to freeze; the system just doesn't make sense.

In this paper, the author suggests that the Area Law isn't wrong, but rather incomplete. It's like looking at a photo from far away; you see a smooth, simple shape. But if you zoom in, you realize the image is made of pixels. The author proposes a new formula that acts like a "zoom-in" version of the old law. This new formula introduces a cosmic speed limit for mass, called $M_0$ . Think of $M_0$ as the maximum possible weight a black hole can ever have in our universe. As a black hole gets heavier and colder, approaching this limit, the new formula kicks in. Instead of the entropy growing forever, it levels off and settles into a constant value, finally obeying the Third Law.

The Story of the Biased Coin

To explain why this happens, the author uses a clever analogy involving a giant stack of coins. Imagine you have $N$ coins (where $N$ is a huge number related to the size of the universe). In a perfectly random, "unbiased" world, every coin has a 50/50 chance of landing on heads or tails. This represents a state of maximum chaos or "maximum entropy."

Now, imagine a black hole is like a giant magnet that slightly biases these coins. It doesn't force them all to be heads, but it makes heads slightly more likely than tails. The more massive the black hole, the stronger this bias becomes. The author calculates the entropy not by counting how many ways the coins can land, but by measuring the "distance" between the biased state (the black hole) and the perfectly random state (empty space).

This distance is measured using a concept called the Kullback-Leibler (KL) divergence. In everyday terms, think of it as a "surprise meter." If you expect a coin to be fair (50/50) but it's actually biased, you are "surprised" every time you see a result. The more biased the coin, the more information you gain when you see the result, because it's less random. The paper shows that the entropy of a black hole is exactly this "surprise" or "information deficit." It tells us how much the black hole's state differs from a completely random, empty universe.

The "Pixel" Correction

The most exciting part of this discovery is how it connects the new formula to the old one. When the black hole is small and hot (meaning its mass is much smaller than the cosmic limit $M_0$ ), the bias is tiny. In this case, the new formula simplifies perfectly back to the old Area Law. The "pixels" of the new theory blend together to look like the smooth "Area Law" sketch.

However, as the black hole gets massive and cold, the "pixels" become visible. The new formula adds a series of tiny corrections to the old law. These corrections are like the fine print in a contract that you only notice when you read the whole thing carefully. They represent "finite-information corrections," meaning they account for the fact that the universe has a finite number of information bits available to describe the black hole.

The paper also suggests that the Planck mass (a tiny unit of mass in physics) isn't just a random number; it sets the limit on how precisely we can measure a black hole's mass based on these microscopic bits. If you try to distinguish between two black holes that differ by less than this tiny amount, the "noise" of the underlying bits makes them look the same. It's like trying to hear a whisper in a hurricane; the signal gets lost in the static.

What This Means for Us

This paper doesn't claim to have solved the mystery of black holes completely. Instead, it offers a new, more consistent framework that fixes a specific problem with the Third Law. It suggests that the famous Area Law is just the first chapter of a longer story. The full story involves a universal mass limit and a collection of microscopic bits that behave like biased coins.

By viewing black hole entropy as an "information deficit" rather than just a count of hidden states, the author provides a fresh perspective. It implies that the universe has a maximum capacity for information, and black holes are the ultimate test of that limit. While the math is complex, the core idea is playful and profound: the universe might be built on a giant, cosmic game of chance, and black holes are the places where the rules of that game get a little bit interesting. The author suggests that future work could apply this logic to spinning or charged black holes, potentially revealing even deeper layers of the cosmic library.

Technical Summary: Information-Theoretic Black Hole Entropy I: Beyond the Area Law

Problem Statement
The paper addresses a fundamental tension in black hole thermodynamics: while the Bekenstein-Hawking area law ( $S_{BH} \propto M^2$ ) is consistent with the first and second laws of thermodynamics, it appears to violate the third law (Nernst formulation). The Nernst theorem requires that entropy $S$ approach zero or a universal constant independent of macroscopic parameters as temperature $T \to 0$ . For a Schwarzschild black hole, $T \to 0$ corresponds to $M \to \infty$ , where the standard entropy diverges rather than vanishing. Furthermore, extremal black holes ( $T=0$ ) possess finite entropy dependent on angular momentum or charge, failing to reach a universal constant. The author posits that this violation is not a fundamental feature of gravity but a limitation of the semiclassical approximation, analogous to how the high-energy asymptotic form of black-body radiation entropy ( $S \sim \ln E$ ) violates the third law until the full quantum spectrum is considered.

Methodology
The author employs a reconstruction strategy guided by the analogy with black-body radiation:

Thermodynamic Reconstruction: Instead of deriving entropy from a specific quantum gravity theory, the paper imposes the Nernst third law as a boundary condition on the entropy function.
- For black-body radiation, a minimum energy $E_0$ is introduced where $T(E_0)=0$ and $S(E_0)=0$ .
- For black holes, the author postulates a maximum mass scale $M_0$ (interpreted as the mass of a black hole formed from the complete collapse of the universe or related to the cosmological constant) where $T(M_0)=0$ and $S(M_0)$ is finite.
Differential Equation Approach: The author constructs the entropy by analyzing the second derivative of entropy with respect to mass ( $d^2S/dM^2$ ). To satisfy the third law (finite entropy at $T=0$ ) and recover the Bekenstein-Hawking limit at high temperatures ( $M \ll M_0$ ), the second derivative is modeled with a specific pole structure:
$\frac{d^2 S_{bh}}{dM^2} = \frac{b_1}{(M_0 - M)(M + m)}$
By matching the small-mass expansion to the Bekenstein-Hawking result ( $S \approx 4\pi M^2$ ), the constants are fixed, yielding a closed-form entropy function.
Information-Theoretic Mapping: The resulting entropy formula is algebraically recast to identify its statistical mechanical origin. The author maps the thermodynamic variables to a system of $N$ independent Bernoulli trials (bits) with a mass-dependent bias $p$ .
Geometric Analysis: The entropy is expressed as a Kullback-Leibler (KL) divergence, allowing for the calculation of the Fisher information metric on the space of black hole ensembles.

Key Contributions and Results

Modified Entropy Formula: The paper derives a new entropy formula for Schwarzschild black holes:
$S_{bh} = 4\pi M_0^2 \left[ \left(1 - \frac{M}{M_0}\right) \ln \left(1 - \frac{M}{M_0}\right) + \left(1 + \frac{M}{M_0}\right) \ln \left(1 + \frac{M}{M_0}\right) \right]$
This formula satisfies the Nernst third law: as $T \to 0$ ( $M \to M_0$ ), the entropy approaches a finite universal constant $S_{max} = 8\pi M_0^2 \ln 2$ . In the limit $M \ll M_0$ , it reduces to the standard Bekenstein-Hawking area law.
Information-Theoretic Interpretation: The entropy is identified as the Kullback-Leibler divergence between two distributions:
1. A biased Bernoulli distribution $p = \frac{1}{2}(1 \pm M/M_0)$ representing the black hole state.
2. A uniform (unbiased) distribution $q = 1/2$ representing the reference "empty" or maximally mixed ensemble.
  Mathematically, $S_{bh} = D_{KL}^{(N)}(p \parallel q)$ , where $N = M_0^2/M_P^2$ is the number of microscopic bits.
Microscopic Interpretation (Entropy Deficit): The author interprets $S_{bh}$ not as a count of internal microstates, but as an entropy deficit (or negentropy).
- $W_{tot} = 2^N$ is the total number of microstates for $N$ unbiased bits.
- $W_{vis} = 2^{N H_2(p)}$ is the number of "visible" microstates compatible with the macroscopic bias $p$ .
- $S_{bh} = \ln(W_{tot}/W_{vis})$ . This represents the information gained by distinguishing the black hole state from the maximally random reference state.
$1/N$ Expansion: The entropy admits an expansion in powers of $1/N$ :
$S_{bh} = \frac{A}{4} \left( 1 + \frac{A}{12N} + \frac{A^2}{30N^2} + \dots \right)$
The leading term recovers the classical area law, while subleading terms represent finite-information corrections.
Thermodynamic Stability and Geometry:
- The heat capacity $C_V$ is shown to vanish as $T \to 0$ , satisfying the third law, whereas the standard semiclassical heat capacity diverges.
- The Fisher information metric derived from the KL divergence yields a positive-definite metric on the space of macrostates, contrasting with the negative heat capacity of the standard Schwarzschild black hole. In the infrared limit ( $M \ll M_0$ ), this metric coincides with the Hessian of the Bekenstein-Hawking entropy.
- The Cramér-Rao bound implies a fundamental statistical uncertainty in measuring the black hole mass from a single microscopic configuration: $\Delta M \gtrsim M_P$ .

Significance and Claims
The paper claims to resolve the apparent conflict between black hole thermodynamics and the third law by treating the Bekenstein-Hawking area law as a leading-order term in a more complete, information-theoretic framework. The significance of the work lies in:

Reconciling Thermodynamics: Demonstrating that a consistent black hole entropy can be constructed that obeys all three laws of thermodynamics without requiring a specific quantum gravity theory, provided a universal mass scale $M_0$ exists.
Conceptual Shift: Proposing that black hole entropy is fundamentally an information deficit relative to a maximally mixed reference ensemble, rather than a direct count of internal degrees of freedom.
Systematic Corrections: Providing a natural $1/N$ expansion that organizes deviations from the classical area law, suggesting that the area law is a thermodynamic limit of a finite-information system.

The author explicitly states that the model is a "one-parameter deformation" of the Schwarzschild entropy and that the interpretation of $S_{bh}$ as a KL divergence offers a "simple microscopic interpretation" based on biased Bernoulli trials, though the physical origin of the $N$ bits and the scale $M_0$ remains to be clarified by a full quantum gravity theory.

The Cosmic Glitch and the New Fix

The Story of the Biased Coin

The "Pixel" Correction

What This Means for Us

Technical Summary: Information-Theoretic Black Hole Entropy I: Beyond the Area Law

More like this