Normalized information-based divergences
Jean-François Coeurjolly, Rémy Drouilhet, Jean-François Robineau
Abstract
This paper is devoted to the mathematical study of some divergences based on the mutual information well-suited to categorical random vectors. These divergences are generalizations of the "entropy distance" and "information distance". Their main characteristic is that they combine a complexity term and the mutual information. We then introduce the notion of (normalized) information-based divergence, propose several examples and discuss their mathematical properties in particular in some prediction framework.
Create a lesson
Related papers
Minimax signal detection in regression under differential privacy
Elly K. H. Hung
A Tetration Distribution
Micah Thornton
Multi-modal Laplace-based sampling
Maxime Egéa, Hanyue Gu, Daniel Rudolf et al.
Studentized inference in randomized experiments when a few units dominate the outcome variation
Xinyuan Chen, Jonathan W. Kiesel, Jonathan R. Woody
Nonparametric Intensity Estimation for Covariate-Driven Poisson Processes Using Deep Learning
Atsutomo Yara, Yoshikazu Terada
Specification LASSO and a Flexible Characteristics-Based Asset Pricing Model
Chaohua Dong, Shuyi Ge, Shaoran Li et al.