Calibrated Generalized Bayesian Inference

Abstract

We propose a simple approach that provides accurate uncertainty quantification for Bayesian inference in misspecified or approximate models, and for generalized (Gibbs) posteriors. While existing solutions in this context are based on explicit Gaussian approximations or post-processing procedures, we demonstrate that correct uncertainty quantification can be achieved by substituting the usual posterior with an intuitively appealing alternative that conveys the same information. This solution applies to both likelihood-based and loss-based posteriors, and is formally demonstrated to reliably quantify uncertainty. This new approach is demonstrated through a range of examples, including generalized linear models, and doubly intractable models.