Zero Flux: Flow-Based Comparison of High-Dimensional Discrete Distributions
Leyang Wang, Yakun Wang, Song Liu, Taiji Suzuki
Abstract
Comparing two high-dimensional discrete distributions has always been a challenging task due to the exponentially growing state space and complex changes in interactions. A recent work suggests comparing distributions through a vector field trained using flow matching between two continuous distributions. The resulting vector field at mid-point vanishes if and only if two distributions identical. However, such a flow-based criterion does not naturally apply to discrete distributions. We extend this principle to the discrete domain and introduce the Zero Flux criterion, a discrepancy based on local probability fluxes. Under independent coupling, we show that all local probability fluxes vanish at the midpoint if and only if two distributions are the same. This discrepancy decomposes the joint distributional difference into smaller, local contributions and can be efficiently estimated from samples. We establish finite sample error bounds for our estimator. Experiments on synthetic and real categorical data demonstrate reliable recovery of sparse dependence signals and stable tracking of distribution shifts in high dimensions.
Create a lesson
Related papers
Wasserstein Gradient Flows and Forward-Only Diffusion Are Not Enough for Multimodal Sampling
Daniel McBride, Pratik Khandagale, Cristina Garcia-Cardona et al.
Error-Corrected Inference-Time Scaling for Imperfect Diffusion Models
Zuokai Wen, Louis Grenioux, Weinan E et al.
The hidden advantage of mask resampling: a theory of masked autoencoders
Jorge Medina Moreira, Lorenzo Bardone, Lenka Zdeborová
Optimal Transport Meets Reinforcement Learning: A Survey
Yujie Zhu, Charles A. Hepburn, Matthew Thorpe et al.
Posterior sampling by source-space MCMC via prior-based few-step transport maps
Hoang Phuc Hau Luu, Marcelo Hartmann, Zhongjian Wang
Tolerance-Based Fairness Auditing: Violation Certification and Sensitivity Screening
Jie Tang, Chuanlong Xie, Lixing Zhu