Extragradient and Past Extragradient Methods for (L0,L1)-Lipschitz Variational Inequalities
Ezra Greenberg, Nicolas Loizou
Abstract
Variational inequalities (VIs) capture a broad class of optimization problems central to modern machine learning, including min-max optimization and equilibrium computation in multiplayer games. Traditionally, algorithms for solving VIs, such as Extragradient (EG) and Past Extragradient (PEG), have been analyzed under the standard L-Lipschitz assumption. However, this condition is often overly restrictive, and recent works have instead turned to the more relaxed (L0,L1)-Lipschitz setting. Existing guarantees for (L0,L1)-Lipschitz VIs require a quasi-sharpness condition [Vankov et al., 2024], while monotone guarantees for EG cover only unconstrained root finding [Choudhury and Loizou, 2025]. In this work, we provide the first convergence guarantees for EG and PEG for monotone (L0,L1)-Lipschitz VIs. We also improve upon prior convergence guarantees for strongly monotone VIs by supporting larger stepsizes in the constrained setting and eliminating exponential dependence on the initial distance from the solution for convergence rates in the unconstrained setting. Lastly, we propose line-search variants for when Lipschitz parameters are unknown. Numerical experiments complement our theoretical results and demonstrate the practical efficacy of our methods.
Create a lesson
Related papers
Matching Randomized Bounds for Finite-Sum Nonconvex-Concave Optimization
Wendao Wu, Haihan Zhang, Qian Chen et al.
Decision-Making in Digital Twins: Optimization, Control, and Learning
Enlu Zhou
Solution Set Dimensions in Convex Optimization and Primal-Polar Facial Signatures
Jiaming Ma, Defeng Sun
A Composite Bayesian Risk--Distributionally Robust Optimization Model for Stochastic Programming with Elliptical Distribution Ambiguity
Renjie Chen, Huifu Xu
Matching Complexity for Second-Order Stationary Point with Sample Reuse
Qian Chen, Wendao Wu, Haihan Zhang et al.
Calibrated α-Barycenters for Multiobjective f-Divergence Optimization
Dier Tang, Peijie Li, Xiaoyuan Zhang