The Markov Accessibility Topology and its Probabilistic Structure

Abstract

In this paper, we associate a canonical topology with the transition operator of a discrete-time Markov chain. We prove that this construction defines an Alexandroff topology, called the Markov Accessibility Topology, and subsequently establish that it coincides with the Alexandroff topology induced by the accessibility relation. This establishes a direct connection between probabilistic accessibility and order-theoretic topology, allowing several classical notions from Markov chain theory to be interpreted in topological terms. Among other results, we characterize absorbing subsets as closed sets, relate irreducibility to topological connectedness and the triviality of the topology, describe minimal open neighborhoods through accessibility and hitting probabilities, and investigate the communication quotient together with its relationship to lumpability.