A stochastic column-block gradient descent method for solving nonlinear systems of equations

Abstract

In this paper, we propose a new stochastic column-block gradient descent method for solving nonlinear systems of equations. It has a descent direction and holds an approximately optimal step size obtained through an optimization problem. We provide a thorough convergence analysis, and derive an upper bound for the convergence rate of the new method. Numerical experiments demonstrate that the proposed method outperforms the existing ones.