Paper 1, Section II, J
(a) Define a continuous-time Markov chain with infinitesimal generator and jump chain .
(b) Prove that if a state is transient for , then it is transient for .
(c) Prove or provide a counterexample to the following: if is positive recurrent for , then it is positive recurrent for .
(d) Consider the continuous-time Markov chain on with non-zero transition rates given by
Determine whether is transient or recurrent. Let , where is the first jump time. Does have an invariant distribution? Justify your answer. Calculate .
(e) Let be a continuous-time random walk on with and for all with . Determine for which values of the walk is transient and for which it is recurrent. In the recurrent case, determine the range of for which it is also positive recurrent. [Here denotes the Euclidean norm of .]