Correction algorithm for finite sample statistics

Abstract

Assume in a sample of size M one finds Mi representatives of species i with i=1...N*. The normalized frequency p*i=Mi/M, based on the finite sample, may deviate considerably from the true probabilities pi. We propose a method to infer rank-ordered true probabilities ri from measured frequencies Mi. We show that the rank-ordered probabilities provide important informations on the system, e.g., the true number of species, the Shannon- and the Renyi-entropies.

0

Turn this paper into a full lesson

ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…