Continuized Quasar-Convex Acceleration via an Unbiased Finite-Mixing Network Oracle
Ilya Kuruzov, Artem Agafonov, Vadim Abronin, Darina Dvinskikh, Alexander Gasnikov
Abstract
We study decentralized minimization of a smooth network average that is globally quasar-convex with respect to a fixed minimizer; the node functions may be nonconvex and need not share a minimizer. A unit-rate Poisson clock drives an exactly simulable continuized process: between events the state follows a closed-form accelerated flow, and each event uses one oracle vector. One master theorem covers oracles with a predictable bias and a state-dependent variance and keeps the inverse-quadratic term O(LR02/(γ2T2)); one selected-row lemma supplies the oracle moments of three network implementations. CQA-Net keeps a common state, mixes local rows for finitely many rounds, and disseminates one uniformly selected row; its oracle is unbiased at every mixing depth, so incomplete averaging affects only the variance. A walking token removes dissemination, the shared clock, and the shared root, and an importance weight keeps it unbiased on fixed graphs. D-CQA keeps local states and mixes them; under bounded heterogeneity it needs O(χLR0/(γθ)) communication rounds and no dissemination. Changing graphs enter through certified operator norms. Experiments on a certified nonconvex regression on static and changing graphs compare the three implementations.
Create a lesson
Related papers
Reformulation Techniques for PDLP with Applications to QUBO and Joint Replenishment
Jacob Dentes, Haihao Lu
Variance Reduction Note 4: The Convergence of SVRG
Alina Lodhi
Two-Player Zero-Sum Hybrid Games with Set-Valued Dynamics
Santiago J. Leudo, Francesco Ferrante, Ricardo G. Sanfelice
Distributionally Robust Dynamic Inventory Control: Automatic Recovery under Martingale Demand
Jianzhi Leng, Daniel Zhuoyu Long, Lun Ran et al.
A constraint dissolving method for generally constrained optimization over a nonconvex set
Pengjie Liu, Haonan Shen, Xiaoxi Jia
Asymptotic Optimality of cμ-Rule for LLM Inference Scheduling under Memory Constraint
Zhenghao Li, Shengbo Wang, Nian Si