The Golden Ratio Proximal ADMM with Norm Independent Step-Sizes for Separable Convex Optimization

Abstract

In this work, we propose two step-size strategies for the Golden ratio proximal ADMM (GrpADMM) to solve linearly constrained separable convex optimization problems. Both strategies eliminate explicit operator norm estimates by relying on inexpensive local information computed at the current iterate and requiring no backtracking. However, the key difference is that the second step-size strategy allows recovery from poor initial steps and can increase from iteration to iteration. Under standard assumptions, we establish global convergence of the generated iterates and derive sublinear convergence rates for both algorithms. We also obtain pointwise convergence rate results for the iterates of the algorithms. In addition, we show that the first proposed step-size rule for GrpADMM reduces to the fixed-step-size counterpart when the initial step-size is chosen below a certain threshold. Preliminary numerical experiments demonstrate the practical adaptability and effectiveness of the proposed approaches.