Accelerated primal--dual dynamics and algorithms for convex optimization with nonlinear inequality constraints
Xin He
Abstract
We consider convex optimization with nonlinear inequality constraints and develop a primal--dual multiplier framework that is consistent in continuous and discrete time. We first propose continuous-time dynamics with Nesterov-type vanishing damping α/t, together with suitable extrapolations of the dual variable and the nonlinear constraint mapping. Under convexity assumptions and α≥3, we establish O(t-2) convergence rates for both nonlinear feasibility and the objective residual. We then derive an inexact accelerated primal--dual algorithm through a compatible discretization of a perturbed version of the dynamics. For composite convex objectives, a weighted summability condition on the primal inexactness yields the O(k-2) rates for feasibility and the objective residual, thereby matching the accelerated rates of their continuous-time counterparts. To the best of our knowledge, this is the first Nesterov-type primal--dual multiplier framework for convex optimization with nonlinear inequality constraints.
Create a lesson
Related papers
Gaussian-Restricted Barycenters for KL-Unbalanced Optimal Transport: Variational Theory and Fixed-Point Convergence
Jiaping Yang, Yunxin Zhang
Improved Gradient Descent Lower Bounds Beyond Nesterov
Yuhan Ye, Kaizhao Liu
Fundamental Limits of Adaptive Stabilization with an Unknown Growth Exponent
Zhaobo Liu
An Adaptive Projected-Gradient Algorithm for Sample-Average Approximations of Stochastic Multi-Objective Optimization
Yiyang Li, Lei Wang, Xiaojun Chen
Insensitizing Control Problems for Coupled Stochastic Parabolic Systems with State and Gradient Observations
Said Boulite, Abdellatif Elgrou, Abdelaziz Rhandi
Projected Subgradient Methods for a Class of Nonsmooth and Nonconvex Optimization Problems
Christian Kanzow, Jannis Krüger, Leo Lehmann