A visual introduction to information theory
This paper presents a visual, intuition-driven guide to key information theory concepts such as entropy, mutual information, and channel capacity, demonstrating how they derive from basic probability to define the fundamental limits of data compression and reliable communication.