Sharp Rogers--Shephard Inequalities for Rényi Entropy
Bang-Xian Han, Guoqing Zhan, Chiyu Zhou, Zhuo-Nan Zhu
Abstract
We establish sharp weighted Rogers--Shephard inequalities for Rényi differential entropy. For independent copies X,X' of a log-concave random vector in n, we prove hp(aX-bX') hp(X)+n(a+b) for all a,b>0 and 1 p∞, where orders 1 and ∞ correspond to Shannon entropy and min-entropy, respectively. The Shannon case settles the entropic Rogers--Shephard conjecture of Madiman and Kontoyiannis and its higher-dimensional formulation. For 1 p<∞, equality holds precisely for invertible affine images of random vectors with independent exponential coordinates. At p=∞, the larger equality class is characterized by possibly extended-valued convex potentials that are positively homogeneous of degree one. For every 0<p<1, uniform laws on sufficiently high-dimensional simplices violate the unweighted bound. Thus p=1 is the critical order for this bound to hold in every dimension. The proof combines weighted convex intersections with an exponential lift to a log-affine probability density. At the Shannon endpoint, this lift yields an exact deficit decomposition with a conditional mutual information term for an additive channel with asymmetric Laplace noise.
Create a lesson
Related papers
Closed-form evaluation of the cumulative distribution function and absolute moments of the variance-gamma distribution
Robert E. Gaunt, Heather L. Sutcliffe
Dudley-type bound for stationary Bernoulli processes
W. Bednorz, R. Martynek, R. Meller
Poincaré inequalities, logarithmic growth and doubling
Joaquim Martin
Axioms and internal rigidity of spectral duality structures
Juan Antonio Vega Coso
D-Pullback Measure Attractors of McKean-Vlasov Stochastic Lattice Wave Equations
Huixia Wen, Ji Shu, Gang He
Large deviation principles for 2D stochastic g-Navier--Stokes equations on unbounded channel-like domains
Gang He, Ji Shu, Huixia Wen et al.