Optimality of Right-Invariant Priors

Abstract

We discuss optimal prediction for families of probability distributions with a locally compact topological group structure. Right-invariant priors were previously shown to yield a posterior predictive distribution minimizing the worst-case Kullback-Leibler risk among all predictive procedures. However, the assumptions for the proof are so strong that they rarely hold in practice and it is unclear when the density functions used in the proof exist. Therefore, we provide a measure-theoretic proof, establishing adequate regularity assumptions. As applications, we show a strong optimality result for next-sample prediction for multivariate normal distributions and Gaussian Process regression with fixed lengthscale. We also discuss uniqueness and numerically evaluate prediction with right-invariant priors against other objective priors and plug-in prediction.