Large Deviations For Randomly Weighted Sums of Random Measures

Abstract

Let $\{{\bf \mathcal{Z}}_n:n\geq 1\}$ be a sequence of i.i.d. random probability measures. Independently, for each $n\geq 1$, let $(X_{n1},\ldots, X_{nn})$ be a random vector of positive random variables that add up to one. This paper studies the large deviation principles for the randomly weighted sum $\sum_{i=1}^{n} X_{ni} \mathcal{Z}_i$. In the case of finite Dirichlet weighted sum of Dirac measures, we obtain an explicit form for the rate function. It provides a new measurement of divergence between probabilities. As applications, we obtain the large deviation principles for a class of randomly weighted means including the Dirichlet mean and the corresponding posterior mean. We also identify the minima of relative entropy with mean constraint in both forward and reverse directions.