Why Maximum Entropy? A Non-axiomatic Approach
M. Grendar,, M. Grendar
Abstract
Ill-posed inverse problems of the form y = X p where y is J-dimensional vector of a data, p is m-dimensional probability vector which cannot be measured directly and matrix X of observable variables is a known J,m matrix, J < m, are frequently solved by Shannon's entropy maximization (MaxEnt). Several axiomatizations were proposed to justify the MaxEnt method (also) in this context. The main aim of the presented work is two-fold: 1) to view the concept of complementarity of MaxEnt and Maximum Likelihood (ML) tasks from a geometric perspective, and consequently 2) to provide an intuitive and non-axiomatic answer to the 'Why MaxEnt?' question.
Create a lesson
Related papers
Phase transitions in non-Hermitian spherical integrals
Pierre Bousseyroux, Marc Potters
Factorization method for a clamped obstacle from near-field measurements via a far-field transformation
General Ozochiawaeze, Isaac Harris
Asymmetric phase transitions in random noncommutative geometries
Benedek Bukor, Masoud Khalkhali, Samuel Kováčik et al.
A Cumulative Framework for Solid Deformation
Lev Steinberg
Classification of pairs of second-order Hamiltonian operators and hydrodynamic type systems in six components
Giorgio Gubbiotti, Lambertus Van Geemen, Pierandrea Vergallo
Reconstructability of Inverse Problems under Symmetry: Separating Structural, Effective, and Physical Upper Bounds
Isshin Arai