A Bit of Information Theory, and the Data Augmentation Algorithm Converges

Abstract

The data augmentation (DA) algorithm is a simple and powerful tool in statistical computing. In this note basic information theory is used to prove a nontrivial convergence theorem for the DA algorithm.