(i) Consider the continuous-time Markov chain (Xt)t⩾0 on {1,2,3,4,5,6,7} with generator matrix
Q=⎝⎜⎜⎜⎜⎜⎜⎜⎜⎜⎛−62000102−31022000−5020100100000020−60141000−30001020−2⎠⎟⎟⎟⎟⎟⎟⎟⎟⎟⎞
Compute the probability, starting from state 3 , that Xt hits state 2 eventually.
Deduce that
t→∞limP(Xt=2∣X0=3)=154
[Justification of standard arguments is not expected.]
(ii) A colony of cells contains immature and mature cells. Each immature cell, after an exponential time of parameter 2, becomes a mature cell. Each mature cell, after an exponential time of parameter 3, divides into two immature cells. Suppose we begin with one immature cell and let n(t) denote the expected number of immature cells at time t. Show that
n(t)=(4et+3e−6t)/7