Spanning Diffusion and Flow-based Posterior Sampling via Exact Gaussian Conditioning
Teo Deveney, Lea Bogensperger, Hok Shing Wong
Abstract
Flow-matching and diffusion models are increasingly used as priors for linear inverse problems, however, most methods are bespoke to one class of trajectory prior. Plug-and-play methods have been proposed, however these implicitly decorrelate the guided trajectory, resulting in broad priors that can struggle when data is sparse. This work proposes β-Flow: a general plug-and-play method indexed by a correlation parameter β that generalises over flow, diffusion, and decorrelated priors, and a confidence parameter κ that controls how strongly the path distribution is enforced. Each step requires only one forward evaluation of a denoising network, followed by a Gaussian conditioning step. This step is an exact Kalman update that is not dependent on network gradients. We show that many existing guided samplers can be interpreted as instances or approximations of our method, each implicitly using a different trajectory prior and operator in place of the Kalman gain. From this viewpoint, we provide a qualitative comparison of methods in terms of their implicit biases and assumptions. We demonstrate consistently state-of-the-art level performance across 7 inverse problems over 4 datasets in terms of PSNR and SSIM. Moreover, we demonstrate the utility of this prior control, by showing that confident high correlations (strict priors) work best when observations are less informative, while low correlation is preferred when observations are more informative, reflecting the complementary roles of the prior and likelihood in Bayesian inference.
Create a lesson
Related papers
To Defer or Not to Defer? Online Learning with LLMs and Congested Experts
Vasileios Saketos, William Reveillard, Alexandre Proutiere et al.
ShellElastic: Scalable Elastic Pretraining with Simultaneous Maximal Updates and Hyperparameter Transfer
Can Jin, Yan Kang, Yifan Gong et al.
scHFBiMamba: a bidirectional Mamba autoencoder for cardiac disease-state classification from single-nucleus RNA-seq data
Ugo Lomoio, Pietro Hiram Guzzi, Pierangelo Veltri
RELAGRAM: Recursive Latent Graph Model for the Capacitated Vehicle Routing Problem
Vladimir Kirill Bickov, Neil Yorke-Smith
Random Feature Pruning for Multi-Class Classification
Mohammad Amin Omidi, Babak Seyfe, Shahrokh Valaee
Anchors Enhance Controllability and Reasoning of Diffusion Language Models
Feiyu Qu, Zheng Huang, Andrea Zanette