A Time-Symmetric Variational Formulation of Quantum Mechanics: Schrödinger Dynamics from Boundary-Driven Indeterminism

This paper proposes a time-symmetric variational framework where Schrödinger dynamics emerge as the unique solution to a two-time boundary-value problem, replacing the standard dualism of unitary evolution and collapse with a single global action principle that naturally derives the Born rule and effective randomness from information-theoretic constraints.

The Gist

Imagine you are trying to solve a maze.

The Old Way (Standard Quantum Mechanics):
In the standard view of the universe, you start at the entrance with a ball. You roll it forward, and it moves smoothly until it hits a wall. But here's the weird part: sometimes, when you look at the ball, it suddenly "jumps" to a random spot on the other side of the wall. Physicists call this "collapse." They have to use two different rulebooks: one for smooth rolling (evolution) and one for the sudden jump (measurement). It's like driving a car that follows traffic laws until you look in the rearview mirror, at which point the car teleports.

The New Way (This Paper):
Lance Carter, the author of this paper, suggests a different way to think about the maze. Instead of just rolling the ball forward, imagine you know both where the ball started and where it ended up.

Think of the universe not as a movie playing forward, but as a photograph of the entire journey at once.

The Core Idea: The "All-at-Once" Puzzle

Carter proposes that the universe doesn't just decide what happens next based on what happened a second ago. Instead, the universe solves a giant puzzle where the start point (preparation) and the end point (measurement) are both fixed.

The "path" the particle takes isn't chosen by rolling a die at the start. It's chosen because it's the most efficient path that connects the start to the finish, satisfying a specific rule of "smoothness" and "cost."

The Creative Metaphors

1. The "Fisher Tax" (The Cost of Being Too Sharp)

Imagine you are a city planner trying to draw a road for a river.

• The Old Idea: You might think the river is a single, perfectly sharp line.
• Carter's Idea: The universe charges a "tax" for roads that are too sharp or too thin. This tax is called Fisher Information.

If you try to draw a road that is a razor-thin line (a perfectly precise particle path), the tax bill becomes infinite. The universe refuses to pay that bill. So, the river must spread out a little bit. It becomes a wide, fuzzy flow.

This "tax" forces the universe to be "fuzzy" at the microscopic level. It prevents particles from having a single, sharp, predictable path. This fuzziness is what we experience as quantum randomness. It's not that the universe is chaotic; it's that the universe is trying to minimize its "tax bill," and the cheapest way to do that is to spread out.

2. The "Flow Tube" (The River Analogy)

Imagine a river flowing from a mountain lake (the start) to a specific lake at the bottom (the measurement).

• In standard physics, we say the water splits into many paths, and we don't know which one a single drop of water will take until we look.
• In Carter's view, the entire river exists as a single, flowing shape connecting the top lake to the bottom lake.

When we "measure" the water at the bottom, we are essentially asking: "Which part of the river reached this specific spot?"
The answer is: The specific "flow tube" that connects the start to that spot.

The "randomness" isn't a coin flip. It's just the fact that there are many possible flow tubes. The one that actually happens is the one that fits the "start" and "end" constraints most efficiently. The "probability" of finding the water in a certain spot is just the width of the river at that spot. Where the river is wide (lots of water), you are likely to find a drop. Where it's narrow, you probably won't.

3. Solving the "Oracle" Problem (The Magic Dice)

A famous critic of quantum mechanics (Landsman) argued that if the universe is deterministic (like a machine), it needs a "Magic Dice" (an external random number generator) to decide where particles go, otherwise, the results would be too predictable.

Carter says: We don't need a Magic Dice.
Instead, the "randomness" comes from the complexity of the path itself.
Because of the "Fisher Tax," the paths the particles take are so incredibly complex and "wiggly" (like a fractal) that no computer could ever predict them perfectly, even if the rules are deterministic. It's like trying to predict the exact path of a leaf in a hurricane. The rules are physics, but the path is so complex it looks random. The universe doesn't need a Magic Dice; the "tax" forces the path to be so complicated that it acts like a random number generator.

What Does This Mean for Us?

1. No More "Spooky" Jumps: We don't need to believe that particles magically teleport when we look at them. The "collapse" is just us realizing which specific "flow tube" the particle was traveling down all along.
2. Time is Symmetric: The future (the measurement) helps shape the past (the path). It's not that the future causes the past in a magical way, but that the universe solves the whole puzzle at once, using both the start and the end to find the solution.
3. The Born Rule (The Probability Rule): The famous rule that says "probability equals the square of the wave" isn't a random guess. It's a mathematical necessity. It's the result of counting how much "water" (probability mass) flows into a specific area of the river.

The Bottom Line

This paper suggests that the universe is like a giant, time-symmetric optimization problem.

Instead of a particle rolling forward and making random choices, the universe is like a master architect who draws the entire history of the particle at once. The architect chooses the path that connects the start to the finish while paying the least amount of "Fisher Tax."

The "randomness" we see is just our limited view of this massive, complex, pre-determined flow. We see the result, but we don't see the whole blueprint. The blueprint exists, and it connects the beginning and the end perfectly, without needing any magic dice.

Technical Summary

Here is a detailed technical summary of the paper "A Time-Symmetric Variational Formulation of Quantum Mechanics: Schrödinger Dynamics from Boundary-Driven Indeterminism" by Lance H. Carter.

1. Problem Statement

Standard quantum mechanics relies on two incompatible dynamical principles:

1. Unitary Evolution: Deterministic, continuous evolution governed by the Schrödinger equation.
2. Measurement Collapse: Stochastic, discontinuous selection of a specific outcome (governed by the Born rule).

This dualism creates a "cut" between microscopic laws and macroscopic observation. Furthermore, recent critiques (notably by Landsman) argue that deterministic hidden-variable theories (like Bohmian mechanics) cannot truly be deterministic; to reproduce the algorithmic randomness (Kolmogorov-1-randomness) of quantum outcomes, they must rely on an external "random oracle" to select initial conditions, rendering their determinism "parasitical."

The paper seeks to resolve this by:

• Unifying unitary evolution and measurement selection into a single variational principle.
• Deriving the Schrödinger equation without postulating it.
• Reframing the "oracle problem" to explain effective randomness without external stochastic inputs.

2. Methodology

The author proposes a Time-Symmetric Variational Framework based on hydrodynamic variables and a two-time boundary-value problem.

A. Hydrodynamic Variables

Instead of particle trajectories, the fundamental variables are the probability density $\rho(x,t)$ and the probability current $j(x,t)$. These are subject to the continuity equation:
$$\partial_t \rho + \nabla \cdot j = 0$$

B. The Primal-Dual Variational Principle

The dynamics are derived by minimizing a global action functional $A[\rho, j]$ over the space of histories connecting an initial boundary ($t_0$) and a final boundary ($t_f$).

The Primal Action ($A_{\text{primal}}$):
$$A_{\text{primal}} = \int_{t_0}^{t_f} \int_{\Omega} \left( \frac{m|j|^2}{2\rho} - V(x)\rho - \frac{\hbar^2}{8m} \frac{|\nabla \rho|^2}{\rho} \right) d^3x dt$$

• Kinetic Term: $\frac{m|j|^2}{2\rho}$ (standard hydrodynamic kinetic energy).
• Potential Term: $-V(x)\rho$.
• Fisher Information Regularization: $-\frac{\hbar^2}{8m} \frac{|\nabla \rho|^2}{\rho}$. This term acts as a convex penalty enforcing smoothness and preventing the density from collapsing into a sharp, differentiable point particle (which would cause the action to diverge).

The Dual Variable (Constraint):
The continuity equation is enforced via a Lagrange multiplier $S(x,t)$, which emerges as the phase field. The augmented action is:
$$\tilde{A} = A_{\text{primal}} + \int_{t_0}^{t_f} \int_{\Omega} S (\partial_t \rho + \nabla \cdot j) d^3x dt$$

C. Derivation of Equations

Varying $\tilde{A}$ with respect to $S$, $j$, and $\rho$ yields the Karush-Kuhn-Tucker (KKT) conditions:

1. Variation w.r.t $S$: Recovers the continuity equation.
2. Variation w.r.t $j$: Yields the guidance equation $j = \rho \frac{\nabla S}{m}$.
3. Variation w.r.t $\rho$: Yields the Quantum Hamilton-Jacobi equation:
   $$\partial_t S + \frac{|\nabla S|^2}{2m} + V + Q = 0$$
   where $Q = -\frac{\hbar^2}{2m} \frac{\nabla^2 \sqrt{\rho}}{\sqrt{\rho}}$ is the Quantum Potential, generated directly by the Fisher information term.

D. Emergence of Schrödinger Dynamics

By defining the complex wavefunction $\psi = \sqrt{\rho} e^{iS/\hbar}$, the coupled nonlinear system for $(\rho, S)$ is shown to map exactly to the linear Schrödinger equation:
$$i\hbar \partial_t \psi = \left( -\frac{\hbar^2}{2m}\nabla^2 + V \right) \psi$$
Thus, the Schrödinger equation is not postulated but arises as the unique optimality condition for minimizing the Fisher-regularized action subject to continuity.

3. Key Contributions

A. Resolution of the "Oracle Problem"

The paper addresses Landsman's critique that deterministic theories require an external random oracle.

• Reframing: Indeterminism is not located in the initial conditions (which are unknown) but in the global boundary constraints.
• Mechanism: The "randomness" of an outcome arises from the Principle of Maximum Caliber (MaxCal). The probability of a specific outcome is determined by the weight of the ensemble of histories consistent with the final boundary constraint.
• Complexity: The Fisher penalty forces microscopic trajectories to be non-differentiable and highly complex. While the hydrodynamic fields evolve deterministically, the specific microscopic flow selected is so complex that its coarse-grained statistics are indistinguishable from true algorithmic randomness (1-randomness), satisfying Landsman's constraint without an external oracle.

B. Time-Symmetric Ontology

Unlike standard initial-value problems, this framework treats the system as a two-time boundary value problem.

• The "future" measurement outcome acts as a constraint that selects a specific "flow tube" (trajectory) from the ensemble of admissible histories connecting the preparation ($t_0$) and the measurement ($t_f$).
• This eliminates the need for wavefunction collapse; the "collapse" is simply the selection of the specific history consistent with the final boundary condition.

C. Derivation of the Born Rule

The Born rule ($P = |\psi|^2$) is derived as a consistency condition for the closure of the primal-dual equations.

• In the von Neumann pointer model, the probability of an outcome is the integrated mass of the probability fluid flowing into the region corresponding to that outcome.
• Since the total mass is conserved (via the continuity equation) and the dynamics are linear (Schrödinger), the resulting distribution naturally follows the Born rule without an ad hoc postulate.

4. Results and Validation

• Gaussian Packet Spreading: The framework successfully recovers the standard spreading of a free Gaussian wave packet. The velocity field $v(x,t) = \dot{\sigma}(t)x/\sigma(t)$ is derived as the unique flow minimizing the action, confirming that the "fanning out" of trajectories is a geometric necessity of mass conservation and the Fisher penalty.
• Interference: Constructive and destructive interference are explained via action costs. Bright fringes correspond to smooth, low-action flows. Dark fringes (nodes) correspond to regions where the Quantum Potential $Q$ becomes singular, causing the action to diverge and suppressing the probability amplitude.
• Measurement Model: A von Neumann measurement model demonstrates that the bifurcation of the wavefunction into disjoint packets is a deterministic result of the Euler-Lagrange equations. The "selection" of a specific outcome is the entropic selection of the history consistent with the final macroscopic record.

5. Significance

• Ontological Unification: It replaces the dualism of unitary evolution vs. collapse with a single variational principle.
• Realist Interpretation: It offers a realist, hydrodynamic description of quantum mechanics that avoids the "parasitical" determinism of standard Bohmian mechanics by grounding randomness in the complexity of the action functional and boundary constraints.
• Information-Theoretic Foundation: It treats $\hbar$ as a scale parameter defining the cost of localization (Fisher information), suggesting that quantum behavior is a consequence of information geometry and the impossibility of defining smooth trajectories at the fundamental scale.
• Classification: Within Wharton's taxonomy of locality, this falls under Type IIB (future-input dependence replaces action-at-a-distance), offering a path toward reconciling quantum non-locality with a block-universe view without violating relativistic causality in the macroscopic limit.

In conclusion, the paper presents a mathematically self-contained framework where quantum mechanics emerges as the optimal solution to a global constraint satisfaction problem, effectively unifying dynamics, measurement, and randomness under a single time-symmetric variational principle.