search for
Statistical Mechanics and Information Theory
New Phys.: Sae Mulli 2019; 69: 932~938
Published online September 30, 2019;
© 2019 New Physics: Sae Mulli.

Sangrak KIM*

Department of Physics, Kyonggi University, Suwon 16227, Korea
Correspondence to:
Received March 21, 2019; Revised June 14, 2019; Accepted July 22, 2019.
cc This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License ( which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
We present a different formulation of statistical mechanics from the perspective of information theory and apply the formalism to a simple system as a concrete example. This is accomplished by decomposing the Shannon entropy and mutual information into their distinct components. We consider a small one-dimensional thermodynamic system interacting with a hard-sphere potential. We can explicitly calculate the mutual information between two particles and triple mutual information among three particles as functions of the volume fraction of the system. We also examine the effect of boundary conditions on the mutual information.
PACS numbers: 02.50.CW, 05.20.$-$y, 89.70.$-$a,
Keywords: Probability theory, Classical statistical mechanics, Information theory, Mutual information

September 2019, 69 (9)
  • Scopus
  • CrossMark