Exponential stability of finite-$N$ consensus-based optimization

Abstract

We study the finite-agent behavior of Consensus-Based Optimization (CBO), a recent metaheuristic for the global minimization of a function, that combines drift toward a consensus estimate with stochastic exploration. While previous analyses focus on asymptotic mean-field limits, we investigate the stability properties of CBO for finite population size \( N \). Following a hierarchical approach, we first analyze a deterministic formulation of the algorithm and then extend our results to the fully stochastic setting governed by a system of stochastic differential equations. Our analysis reveals that essential stability properties, including almost sure and mean square exponential convergence, persist in both regimes and provides sharp quantitative estimates on the rates of convergence.