Enhancing Exploration in Ensemble Kalman Inversion via Covariance Inflation and Projected Dropout
Baojun Che, Daniel Zhengyu Huang, Xinying Mao, Weijie Wang
Abstract
Ensemble Kalman inversion (EKI) is a derivative-free and parallelizable method for parameter estimation in Bayesian inverse problems involving expensive forward models. It adapts Kalman filtering by repeatedly assimilating the observation data through an artificial dynamical system with identity state evolution and the parameter-to-observation map as its observation operator. However, its performance can be limited by ensemble collapse and confinement to the affine span of the initial ensemble. We propose an exploration-enhanced EKI framework that combines multiplicative covariance inflation with a projected-dropout correction of the ensemble mean. Inflation helps maintain ensemble spread, while projected dropout enables the mean to explore directions beyond the initial affine span. For linear inverse problems, we provide a discrete-time, finite-ensemble analysis of the resulting method and prove the least-squares objective converges exponentially to its minimum in expectation. Within the initial ensemble subspace, the contraction factor is independent of the conditioning of the inverse problem, and the limiting ensemble covariance provides a low-rank representation of the posterior covariance. Experiments on ill-conditioned linear systems, 100-dimensional nonlinear benchmarks, and a PDE-constrained barotropic flow inverse problem demonstrate the effectiveness of the proposed method.
Create a lesson
Related papers
Stochastic counterpart of Nesterov's method for sampling and provable non-acceleration of samplers with heavy-ball structure
A. Sharma
A time-domain adversarial example demonstrating the failure of H1 elements in a-ϕ electromagnetic simulation
Timothy Carlson, Sanjay Govindjee
Signed QoI Gaps for Goal-Oriented Error Estimation: Reliability and Sharpness from the Same First-Order System Residuals
Shun Zhang
Perturbation Algorithm and Iterative Realization of a Four-Layer Semi-Discrete Scheme for an Evolutionary Problem with a Variable Operator
David Gulua, Jemal Rogava, Zurab Vashakidze
Regularity transfer for the Ritz projection
Lars Diening, Julian Rolfes, Abner J. Salgado
High-Order Area-Preserving Runge--Kutta Methods for Surface Diffusion Flow of Curves
Lei Cui, Gengen Zhang