Stable Matrix-Free Q-less QR via Preconditioning and Randomization
Oleg Balabanov, Maksim Melnichenko, Michael W. Mahoney
Abstract
This article develops matrix-free Q-less QR algorithms for orthogonalizing tall linear operators. Our main algorithm, CQRRTO, uses randomized preconditioning to make a single Cholesky QR pass numerically safe for any numerically full-rank operator, overcoming the stability issues of Cholesky QR and related methods that operate on the Gram matrix. Compared with deterministic stabilized variants such as Q-less Cholesky QR2 (reorthogonalized Cholesky QR), it remains numerically stable under substantially weaker conditioning assumptions while requiring fewer operator applications. Matrix-free Q-less QR can be useful for improving the numerical robustness of least-squares solves via the normal equations, spectral approximations in a low-dimensional basis, and inversion of operators with low-rank updates via the Woodbury identity. We present a componentwise stability analysis of preconditioned Q-less Cholesky QR that applies to matrix-free operators and is modular with respect to the preconditioner, yielding guarantees for Q-less Cholesky QR, Cholesky QR2, shifted Cholesky QR3, and CQRRTO as special cases. All methods are implemented in the open-source RandLAPACK library.
Create a lesson
Related papers
Neural Network Preconditioning: A Case Study for the Solution of the Parametric Helmholtz Equation
Luc Giraud, Carola Kruse, Paul Mycek et al.
On the cyclic limiting behavior of the restarted Arnoldi algorithm for real symmetric matrices with restart length s=2
Vance Faber, Jarek Liesen, Jörg Liesen et al.
An algebraic multiscale framework for two-level overlapping Schwarz preconditioners
Filipe Cumaru, Hadi Hajibeygi, Cornelis Vuik et al.
High-order uniformly accurate fully discrete schemes with long time near-conservations for two nonlinear coupled dispersive models in the nonrelativistic regime
Lina Wang, Jiyong Li, Bin Wang
CLNO: Conservative Local Neural Operator for Compressible Flow Prediction
Buxuan Wang, Rongzu Li, Qingsong Zou
Explicit charge-conserving and modified energy-conserving PIC methods using the SAV approach
Chengyu Fan, Nicolas Crouseilles, Jingwei Hu