Properties of Shannon and R\'enyi entropies of the Poisson distribution as the functions of intensity parameter
Abstract
We consider two types of entropy, namely, Shannon and R\'enyi entropies of the Poisson distribution, and establish their properties as the functions of intensity parameter. More precisely, we prove that both entropies increase with intensity. While for Shannon entropy the proof is comparatively simple, for R\'enyi entropy, which depends on additional parameter α>0, we can characterize it as nontrivial. The proof is based on application of Karamata's inequality to the terms of Poisson distribution.
0
Turn this paper into a lesson
ArcXiv compiles a structured reading guide from this paper's metadata: plain-English importance, contributions, prerequisite concepts, which sections to read first, flashcards, and a quiz. Grounded in the abstract, never invented.