An efficient EM algorithm for both element-wise and structural missingness in matrix-variate normal mixture models
Hanzhang Lu, Jeffrey L. Andrews, Ryan P. Browne
Abstract
Matrix-variate data with missing entries arise frequently in applications where observations are naturally organized as two-dimensional arrays. Although the matrix normal distribution provides a parsimonious model through its Kronecker covariance structure, standard EM estimation can be computationally expensive because arbitrary missingness patterns typically destroy this separability in the E-step. In this paper, we propose an efficient partial EM algorithm for matrix-variate normal data with missing entries. The proposed method updates the conditional mean and covariance of the missing component through coordinate-wise approximations, avoiding repeated inversion of pattern-specific covariance matrices and avoiding construction of the full vectorized covariance matrix. We further develop a specialized update for submatrix missingness, where the missing-block precision retains a Kronecker product structure, and the covariance update can be carried out independently in the row and column directions. Simulation studies show that the proposed methods substantially reduce computation time compared with exact EM while preserving nearly identical observed-data likelihood across a range of dimensions and missing proportions. A real-data application to hyperspectral image patches demonstrates that the proposed imputation strategy can be embedded within a matrix-variate mixture model for simultaneous imputation and clustering.
Create a lesson
Related papers
Statistical Inference for Probability Barycenters and Kolmogorov Moments
Manuela-Simona Cojocea
Non-Invariance in Nested Prediction Models under Selective Predictor Availability
Marc Delord
Quantum mutual information statistics for detecting dependence-structure change points in time series
Jiwon Kang, Yun Am Seo
Off-policy causal estimation in networks
Sahil Loomba, Dean Eckles
Reconciling Interpretability with Covariate-Dependent Shape Flexibility in Penalized Transformation Models for Distributional Regression
Johannes Brachem, Thomas Kneib
Detecting Early and Late Divergences in Survival Curves Using Nonparametric Effect Measures
Patrick B. Langthaler, Jun Ma, Jonas Beck