Numerical analysis of the master equation

Abstract

Applied to the master equation, the usual numerical integration methods, such as Runge-Kutta, become inefficient when the rates associated with various transitions differ by several orders of magnitude. We introduce an integration scheme that remains stable with much larger time increments than can be used in standard methods. When only the stationary distribution is required, a direct iteration method is even more rapid; this method may be extended to construct the quasi-stationary distribution of a process with an absorbing state. Applications to birth-and-death processes reveal gains in efficiency of two or more orders of magnitude.