The Partition Function

Prerequisites: The Boltzmann Distribution

The partition function is the central object in statistical mechanics, encoding all thermodynamic information about a system in equilibrium. The name comes from how it “partitions” probability among microstates. (!!)

(( TEST ))

Canonical Partition Function

For a system in thermal equilibrium with a heat bath at temperature \(T\), the canonical partition function is

\[ Z = \sum_i e^{-\beta E_i} \]

where the sum runs over all microstates \(i\) with energy \(E_i\), and \(\beta = 1/(k_B T)\) is the inverse temperature.

The probability of finding the system in microstate \(i\) is given by the Boltzmann distribution:

\[ p_i = \frac{e^{-\beta E_i}}{Z} \]

The partition function serves as the normalisation constant ensuring \(\sum_i p_i = 1\).

Why It Matters

The deep insight is that \(Z\) acts as a generating function for thermodynamic quantities. The Helmholtz free energy is

\[ F = -k_B T \ln Z \]

and from \(F\) everything else follows via standard thermodynamic relations. Alternatively, you can extract quantities directly from derivatives of \(\ln Z\):

Average energy: \[ \langle E \rangle = -\frac{\partial \ln Z}{\partial \beta} \]

Heat capacity: \[ C_V = k_B \beta^2 \frac{\partial^2 \ln Z}{\partial \beta^2} \]

Entropy: \[ S = k_B \left( \ln Z + \beta \langle E \rangle \right) \]

Classical Continuous Case

For a classical system with continuous degrees of freedom (positions \(q\) and momenta \(p\)), the sum becomes an integral over phase space:

\[ Z = \frac{1}{h^{3N} N!} \int e^{-\beta H(q, p)} \, d^{3N}q \, d^{3N}p \]

The factor \(h^{3N}\) makes \(Z\) dimensionless (and connects to quantum mechanics), while \(N!\) corrects for indistinguishability of identical particles.

Grand Canonical Partition Function

When particle number can fluctuate (system exchanging particles with a reservoir), we use the grand canonical ensemble:

\[ \mathcal{Z} = \sum_{N=0}^{\infty} \sum_i e^{-\beta(E_i^{(N)} - \mu N)} = \sum_{N=0}^{\infty} z^N Z_N \]

where \(\mu\) is the chemical potential and \(z = e^{\beta \mu}\) is the fugacity. This is particularly elegant for quantum gases, where the factorisation properties lead directly to Bose-Einstein and Fermi-Dirac statistics.

Quantum Mechanical Form

In quantum mechanics, the partition function becomes a trace over the Hilbert space:

\[ Z = \mathrm{Tr}\left( e^{-\beta \hat{H}} \right) \]

This formulation makes manifest the connection to imaginary-time path integrals: \(e^{-\beta \hat{H}}\) is formally the time-evolution operator with \(t \to -i\hbar\beta\), leading to the powerful Euclidean path integral approach in quantum field theory.

Number-Theoretic Partition Function

Entirely separately, in number theory, the partition function \(p(n)\) counts the number of ways to write \(n\) as a sum of positive integers (ignoring order). Its generating function is

\[ \sum_{n=0}^{\infty} p(n) x^n = \prod_{k=1}^{\infty} \frac{1}{1 - x^k} \]

Hardy and Ramanujan’s asymptotic formula gives \(p(n) \sim \frac{1}{4n\sqrt{3}} \exp\left(\pi \sqrt{2n/3}\right)\).

Would you like me to expand on any of these aspects—perhaps the path integral connection or the derivation from maximum entropy principles?

History

Below is a self-contained extended Markdown document, using $ … $ and \[ … \] for mathematics, that restates the previous discussion in a clean, archival style.

You can copy this verbatim into a .md file.

The Origin of the Partition Function

Overview

The partition function is one of the central objects in modern statistical mechanics. It serves as a generating function from which essentially all equilibrium thermodynamic quantities can be derived. Historically, its development reflects a transition from probabilistic reasoning about mechanical systems to a fully abstract, ensemble-based formulation of thermodynamics.

The partition function is primarily due to Josiah Willard Gibbs, building on foundational ideas introduced earlier by Ludwig Boltzmann.

Boltzmann: Statistical Foundations

In the late 19th century, Boltzmann introduced the probabilistic interpretation of thermodynamics. His work established the core ideas that would later be formalized by Gibbs.

Key contributions

Boltzmann developed: • A statistical interpretation of entropy: \[ S = k \log W \] where \(W\) is the number of accessible microstates. • The use of probability distributions over microscopic states. • Early versions of the canonical distribution, in which the probability of a state with energy \(E\) is proportional to: \[ e^{-\beta E}, \quad \beta = \frac{1}{kT} \]

Although Boltzmann frequently worked with weighted sums over states, these expressions were typically embedded within physical arguments rather than elevated to a single abstract object with independent significance.

Conceptual role

Boltzmann provided: • the physical intuition • the probabilistic framework • the connection between microscopic dynamics and macroscopic laws

However, the mathematical structure that unifies these ideas into a single generating function was not yet explicit.

Gibbs: The Partition Function Proper

The decisive step came with Gibbs’ 1902 book Elementary Principles in Statistical Mechanics. Gibbs reformulated statistical mechanics in a systematic, axiomatic way using ensembles.

Definition

For a canonical ensemble, Gibbs defined the partition function as: \[ Z(\beta) = \sum_{\text{states}} e^{-\beta E} \]

This object serves as a normalizing constant for probabilities: \[ P(E) = \frac{e^{-\beta E}}{Z} \]

Generative power

Gibbs demonstrated that all thermodynamic quantities follow from \(Z\), or more precisely from \(\log Z\): • Helmholtz free energy \[ F = -kT \log Z \] • Internal energy \[ U = -\frac{\partial}{\partial \beta} \log Z \] • Entropy \[ S = k(\log Z + \beta U) \] • Pressure, magnetization, and response functions via further derivatives

This reframing transformed equilibrium thermodynamics into calculus applied to a single scalar function.

Conceptual Significance

Gibbs’ formulation introduced several enduring ideas: • Thermodynamics can be derived without explicit reference to dynamics • Ensembles, not trajectories, are fundamental • The partition function acts as: • a normalizing constant • a cumulant-generating function • a free-energy functional

In modern terms, \(Z\) unifies probability theory, thermodynamics, and variational principles.

Historical Attribution

The standard historical attribution can be summarized as follows: • Boltzmann Introduced the statistical interpretation of entropy and the exponential weighting of states. • Gibbs Defined the partition function as an abstract, central object and demonstrated its universal generative role.

Conclusion

While Boltzmann laid the statistical groundwork, the partition function as we understand it today is due to Gibbs.

A useful summary slogan is:

Boltzmann supplied the statistical physics; Gibbs identified the master function.

This conceptual move has echoed far beyond classical thermodynamics, influencing quantum statistical mechanics, path integrals, quantum field theory, and modern probabilistic modeling.