Understanding Thermodynamic Entropy Through the Central Limit Theorem: A Pedagogical Framework

This paper presents a theoretical pedagogical framework connecting the Central Limit Theorem (CLT) from probability theory to entropy maximization in statistical mechanics. Using the concrete example of ink molecules diffusing in water, we demonstrate how the second law of thermodynamics, in specific contexts, emerges as a consequence of the CLT applied to systems with large numbers of particles. Under standard simplifying assumptions (non-interacting particles in the dilute limit, equilibrium conditions, and coarse-grained spatial partitioning), each molecule's position can be treated as an independent random variable. Through analysis of the resulting distribution of macrostates, we demonstrate that the uniform spatial distribution corresponds to the peak of a normal distribution whose relative width (standard deviation divided by mean) scales as 1/sqrt(N), where N is the number of particles. For macroscopic systems (N ~ 10^23), this scaling renders deviations from equilibrium vanishingly improbable, with probabilities bounded by exponential decay rates from large deviation theory, thereby explaining why entropy maximization appears deterministic despite its probabilistic foundation. The pedagogical contribution includes explicit analytical derivations connecting binomial statistics to CLT convergence, computational demonstrations of the 1/sqrt(N) narrowing, and interactive visualization tools provided as supplementary materials. This theoretical framework offers students with probability backgrounds an accessible entry point to statistical mechanics, explicitly bridging mathematical concepts with thermodynamic principles. Future work should validate the pedagogical effectiveness through classroom implementation.