Restart perturbations for reversible Markov chains: trichotomy and pre-cutoff equivalence

Abstract

Given a reversible Markov chain Pn on n states, and another chain Pn obtained by perturbing each row of Pn by at most αn in total variation, we study the total variation distance between the two stationary distributions, \| πn - πn \|. We show that for chains with cutoff, \| πn - πn \| converges to 0, e-c, and 1, respectively, if the product of αn and the mixing time of Pn converges to 0, c, and ∞, respectively. This echoes recent results for specific random walks that exhibit cutoff, suggesting that cutoff is the key property underlying such results. Moreover, we show \| πn - πn \| is maximized by restart perturbations, for which Pn "restarts" Pn at a random state with probability αn at each step. Finally, we show that pre-cutoff is (almost) equivalent to a notion of "sensitivity to restart perturbations," suggesting that chains with sharper convergence to stationarity are inherently less robust.

0

Turn this paper into a lesson

ArcXiv compiles a structured reading guide from this paper's metadata: plain-English importance, contributions, prerequisite concepts, which sections to read first, flashcards, and a quiz. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…