Finite-Temperature de Bruijn Identities: Fisher Information as the Spectral Gap of Blahut--Arimoto Dynamics

Abstract

We uncover a finite-temperature extension of de Bruijn's identity -- the classical relation ddth(X+tZ)=12J(X) connecting differential entropy and Fisher information. Our framework is the spectral theory of Blahut--Arimoto (BA) dynamics, recently developed by Wang~Wang2026 for the analysis of rate-distortion optimization. The central observation is elementary yet profound: for Gaussian sources, the spectral gap of the BA relaxation kernel satisfies = 1/(2βσ2)~Wang2026, while the Fisher information of the source is J = 1/σ2. Hence \[ = J2β \] for all inverse temperatures β> 1/(2σ2). This identifies the BA spectral gap as a finite-temperature regularization of Fisher information. From this observation we derive an exact finite-temperature de Bruijn identity: \[ ∂ Fβ∂ σ2 = 12βσ2 = , \] where Fβ is the BA free energy. This identity holds for all finite β without any limit procedure. The classical de Bruijn identity follows as the exact consequence β\,∂ Fβ/∂σ2 = J/2. The significance is structural: classical de Bruijn is not an isolated fact about Gaussian convolutions, but the β∞ shadow of a one-parameter family of exact identities living in the spectral geometry of rate-distortion optimization. We discuss implications for the entropy power inequality, the χ2-dissipation structure of BA dynamics, and the geometric unification of information inequalities.

0

Turn this paper into a lesson

ArcXiv compiles a structured reading guide from this paper's metadata: plain-English importance, contributions, prerequisite concepts, which sections to read first, flashcards, and a quiz. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…