Unification of observational entropy with maximum entropy principles

Abstract

We introduce a definition of coarse-grained entropy that unifies measurement-based (observational entropy) and max-entropy-based (Jaynes) approaches to coarse-graining, by identifying physical constraints with information theoretic priors. The definition is shown to include as special cases most other entropies of interest in physics. We then consider second laws, showing that the definition admits new entropy increase theorems and connections to thermodynamics. We survey mathematical properties of the definition, and show it resolves some pathologies of the traditional observational entropy in infinite dimensions. Finally, we study the dynamics of this entropy in a quantum random matrix model and a classical hard sphere gas. Together the results suggest that this generalized observational entropy can form the basis of a highly general approach to statistical mechanics.