First-passage-time densities and avoiding probabilities for birth-and-death processes with symmetric sample paths

Path integrals for continuous-time Markov chains

This note presents a method of evaluating the distribution of a path integral for Markov chains on a countable state space.

On the Transient Behavior of Ehrenfest and Engset Processes

Two classical stochastic processes are considered, the Ehrenfest process, introduced in 1907 in the kinetic theory of gases to describe the heat exchange between two bodies, and the Engset process, one of the early (1918) stochastic models of communication networks. In this paper we investigate the asymptotic behavior of the distributions of hitting times of these two processes when the number of particles/sources goes to infinity. Results concerning the hitting times of boundaries in particular are obtained. We rely on martingale methods; a key ingredient is an important family of simple nonnegative martingales, an analogue, for the Ehrenfest process, of the exponential martingales used in the study of random walks or of Brownian motion.