Improved sampling algorithms and functional inequalities for non-log-concave distributions

Abstract

We study the problem of sampling from a distribution μ with density e-V for some potential function V: Rd R with query access to V and ∇ V. We start with the following standard assumptions: (1) V is L-smooth. (2) The second moment EX μ[\|X\|2]≤ M. Recently, He and Zhang (COLT'25) showed that the query complexity of this problem is at least (LMdε)(d) where ε is the desired accuracy in total variation distance, and the Poincar\'e constant can be unbounded. Meanwhile, another common assumption in the study of diffusion based samplers (see e.g., the work of Chen, Chewi, Li, Li, Salim and Zhang (ICLR'23)) strengthens (1) to the following: (1*) The potential function of *every* distribution along the Ornstein-Uhlenbeck process starting from μ is L-smooth. We show that under the assumptions (1*) and (2), the query complexity of sampling from μ can be poly(L,d)· (Ld+Mε2)O(L+1), which is polynomial in d and 1ε when L=O(1) and M=poly(d). This improves the algorithm with quasi-polynomial query complexity developed by Huang et al. (COLT'24). Our results imply that the seemingly moderate strengthening from (1) to (1*) yields an exponential gap in the query complexity. Furthermore, we show that together with the assumption (1*) and the stronger moment assumption that \|X\| is λ-sub-Gaussian for Xμ, the Poincar\'e constant of μ is at most O(λ)2(L+1). We also establish a modified log-Sobolev inequality for μ under these conditions. As an application of our technique, we obtain a new estimate of the modified log-Sobolev constant for a specific class of mixtures of strongly log-concave distributions.

0

Turn this paper into a full lesson

ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…