R\'enyi entropy yields artificial biases not in the data and incorrect updating due to the finite-size data

Abstract

We show that the R\'enyi entropy implies artificial biases not warranted by the data and incorrect updating information due to the finite-size of the data despite being additive. It is demonstrated that this is so because it does not conform to the system and subset independence axioms of Shore and Johnson. We finally show that the escort averaged constraints do not remedy the situation.

0

Turn this paper into a lesson

ArcXiv compiles a structured reading guide from this paper's metadata: plain-English importance, contributions, prerequisite concepts, which sections to read first, flashcards, and a quiz. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…