2.I.11H
Part IB, 2004
Let be an irreducible, positive-recurrent Markov chain on the state space with transition matrix and initial distribution , where is the unique invariant distribution. What does it mean to say that the Markov chain is reversible?
Prove that the Markov chain is reversible if and only if for all .