Probability distribution and entropy as a measure of uncertainty

Abstract

The relationship between three probability distributions and their maximizable entropy forms is discussed without postulating entropy property. For this purpose, the entropy I is defined as a measure of uncertainty of the probability distribution of a random variable x by a variational relationship, a definition underlying the maximization of entropy for corresponding distribution.