Paper 4, Section I, H
Part IB, 2015
Let be independent identically distributed random variables with . Let , where is a constant. For each of the following cases, determine whether or not is a Markov chain: (a) ; (b) ; (c) .
In each case, if is a Markov chain, explain why, and give its state space and transition matrix; if it is not a Markov chain, give an example to demonstrate that it is not.