Consider the Markov chain (Xn)n≥0 on the integers Z whose non-zero transition probabilities are given by p0,1=p0,−1=1/2 and
pn,n−1=1/3,pn,n+1=2/3, for n≥1pn,n−1=3/4,pn,n+1=1/4, for n⩽−1
(a) Show that, if X0=1, then (Xn)n≥0 hits 0 with probability 1/2.
(b) Suppose now that X0=0. Show that, with probability 1 , as n→∞ either Xn→∞ or Xn→−∞.
(c) In the case X0=0 compute P(Xn→∞ as n→∞).