Biased-estimations of the Variance and Skewness
Abstract
Nonlinear combinations of direct observables are often used to estimate quantities of theoretical interest. Without sufficient caution, this could lead to biased estimations. An example of great interest is the skewness S3 of the galaxy distribution, defined as the ratio of the third moment 3 and the variance squared 22. Suppose one is given unbiased estimators for 3 and 22 respectively, taking a ratio of the two does not necessarily result in an unbiased estimator of S3. Exactly such an estimation-bias affects most existing measurements of S3. Furthermore, common estimators for 3 and 2 suffer also from this kind of estimation-bias themselves: for 2, it is equivalent to what is commonly known as the integral constraint. We present a unifying treatment allowing all these estimation-biases to be calculated analytically. They are in general negative, and decrease in significance as the survey volume increases, for a given smoothing scale. We present a re-analysis of some existing measurements of the variance and skewness and show that most of the well-known systematic discrepancies between surveys with similar selection criteria, but different sizes, can be attributed to the volume-dependent estimation-biases. This affects the inference of the galaxy-bias(es) from these surveys. Our methodology can be adapted to measurements of analogous quantities in quasar spectra and weak-lensing maps. We suggest methods to reduce the above estimation-biases, and point out other examples in LSS studies which might suffer from the same type of a nonlinear-estimation-bias.
Turn this paper into a full lesson
ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.