Normalized information-based divergences
Jean-François Coeurjolly, Rémy Drouilhet, Jean-François Robineau
Abstract
This paper is devoted to the mathematical study of some divergences based on the mutual information well-suited to categorical random vectors. These divergences are generalizations of the "entropy distance" and "information distance". Their main characteristic is that they combine a complexity term and the mutual information. We then introduce the notion of (normalized) information-based divergence, propose several examples and discuss their mathematical properties in particular in some prediction framework.
Create a lesson
Related papers
Conformal Prediction Through the Lens of Hypothesis Testing: Universality, Impossibility, and Optimality
Ryan J. Tibshirani, Rina Foygel Barber, Aaditya Ramdas
Connecting Riemannian Geometry and Statistical Inference for Correlation Matrices
Argyn Kuketayev
How far can symmetry help? Phase transitions and symmetry selection in sparse functional data analysis
Jocelyn Nembe
Posterior consistency for subdiffusion inverse problems
Haoyu Lu, Shaokang Zu, Junxiong Jia
Dimension comparison for Student's statistic under symmetric unimodality
Jacopo Lenzi
Statistical Properties of Nonparametric MLE under Laplace Noise
Yifei Xiong, Nianqiao Phyllis Ju, Vinayak Rao