2.II.22H
Part IB, 2004
Consider a Markov chain on the state space with transition probabilities as illustrated in the diagram below, where and .
For each value of , determine whether the chain is transient, null recurrent or positive recurrent.
When the chain is positive recurrent, calculate the invariant distribution.