A switching proximal gradient method for constrained difference-of-convex optimization problems

Abstract

We study difference-of-convex optimization problems with several composite inequality constraints and develop a majorization-guided switching proximal gradient (MGSPG) method. Specifically, at each feasible outer point, quadratic majorization and linearization yield a strongly convex composite surrogate problem. To solve this surrogate approximately, we employ a switching proximal gradient (SPG) method, which takes a proximal gradient step for the objective when the current point is nearly feasible and for a most violated constraint otherwise. This construction requires neither projection onto the joint surrogate feasible set nor multiplier computation. By establishing a common invariant ball and using an increasing weight argument, we obtain an \(O(τ^{-1})\) inner complexity bound for SPG. Building on this bound, we show that, under boundedness of the feasible level set and a uniform Slater condition for the surrogates, MGSPG finds an \(\varepsilon\)-KKT point in \(O(\varepsilon^{-2})\) outer iterations and \(O(\varepsilon^{-4})\) selected component proximal gradient updates. Numerical experiments on SCAD-constrained and groupwise-constrained regression problems demonstrate the viability and computational efficiency of our method compared with existing optimization algorithms.