Orthogonalized Design Matrices Speed-ups of Bayesian Semiparametric Regression

Abstract

We explain how important classes of Bayesian semiparametric regression fitting and inference procedures can be sped up, significantly, via the use of orthogonalized design matrices. Typically, design matrices in semiparametric regression contain predictor observations and basis functions of such data. In Bayesian semiparametric regression, loop-type approaches such as Gibbs sampling and coordinate ascent variational inference typically are required. We show that pre-loop reformulation of Bayesian semiparametric regression models involving orthogonalized design matrices lead to two orders of magnitude, with respect to column dimension, computational reduction. Our computer experiments reveal that this simple paradigm results in approximately 5- to 60-fold speed-ups.