Statistical mechanics of data-driven modeling
This paper establishes a thermodynamic framework for data-driven modeling based on Jaynes' Maximum Entropy Principle, which treats inference as a physical process governed by a First Law of informational thermodynamics and utilizes heat capacity anomalies to endogenously identify optimal model architectures without ad-hoc regularization.