Paper 2, Section II, J

Applied Probability
Part II, 2011

(i) Explain briefly what is meant by saying that a continuous-time Markov chain X(t)X(t) is a birth-and-death process with birth rates λi>0,i0\lambda_{i}>0, i \geqslant 0, and death rates μi>0\mu_{i}>0, i1i \geqslant 1.

(ii) In the case where X(t)X(t) is recurrent, find a sufficient condition on the birth and death parameters to ensure that

limtP(X(t)=j)=πj>0,j0\lim _{t \rightarrow \infty} \mathbb{P}(X(t)=j)=\pi_{j}>0, \quad j \geqslant 0

and express πj\pi_{j} in terms of these parameters. State the reversibility property of X(t)X(t).

Jobs arrive according to a Poisson process of rate λ>0\lambda>0. They are processed individually, by a single server, the processing times being independent random variables, each with the exponential distribution of rate ν>0\nu>0. After processing, the job either leaves the system, with probability p,0<p<1p, 0<p<1, or, with probability 1p1-p, it splits into two separate jobs which are both sent to join the queue for processing again. Let X(t)X(t) denote the number of jobs in the system at time tt.

(iii) In the case 1+λ/ν<2p1+\lambda / \nu<2 p, evaluate limtP(X(t)=j),j=0,1,\lim _{t \rightarrow \infty} \mathbb{P}(X(t)=j), j=0,1, \ldots, and find the expected time that the processor is busy between two successive idle periods.

(iv) What happens if 1+λ/ν2p1+\lambda / \nu \geqslant 2 p ?