Path decompositions for Markov chains
Gotz Kersting, Kaya Memisoglu
Abstract
We present two path decompositions of Markov chains (with general state space) by means of harmonic functions, which are dual to each other. They can be seen as a generalization of Williams' decomposition of a Brownian motion with drift. The results may be illustrated by a multitude of examples, but we confine ourselves to different types of random walks and the Polya urn.
Create a lesson
Related papers
Almost sure exponential stability of multi-dimensional stochastic systems driven by a symmetric α-stable process
Xuekang Zhang, Hongjian Liu, Guangjun Shen
The Arc Threshold of the Two-Row Ising Torus: Exact Factorization, an Algebraic Critical Coupling, Uniformity in the Circumference, and the Rate of Convergence
Marco Mandap
Markovian Lifts and Multifactor Approximations for Weighted Sub-fractional Brownian Motion
J. H. Ramirez-Gonzalez, Edison Cuba
Rényi mixing bounds for kinetic samplers via L2 hypocoercivity
Jianfeng Lu, Yinchen Luo
Bayesian Filters via the Stochastic Category
Kenichi Bannai, Masahiro Kurisaki
Synchronization of Enriched Spin Glasses
Franziska Engler, Justin Ko