Let (Xt,t⩾0) be a Markov chain on {0,1,…} with Q-matrix given by
qn,n+1qn,0qn,m=λn=λnεn(n>0)=0 if m∈/{0,n,n+1}
where εn,λn>0.
(i) Show that X is transient if and only if ∑nεn<∞. [You may assume without proof that x(1−δ)⩽log(1+x)⩽x for all δ>0 and all sufficiently small positive x.]
(ii) Assume that ∑nεn<∞. Find a necessary and sufficient condition for X to be almost surely explosive. [You may assume without proof standard results about pure birth processes, provided that they are stated clearly.]
(iii) Find a stationary measure for X. For the case λn=λ and εn=α/(n+1)(λ,α>0), show that X is positive recurrent if and only if α>1.