4.I.9C
Part IB, 2006
A game of chance is played as follows. At each turn the player tosses a coin, which lands heads or tails with equal probability . The outcome determines a score for that turn, which depends also on the cumulative score so far. Write for the cumulative score after turns. In particular . When is odd, a head scores 1 but a tail scores 0 . When is a multiple of 4 , a head scores 4 and a tail scores 1 . When is even but is not a multiple of 4 , a head scores 2 and a tail scores 1 . By considering a suitable four-state Markov chain, determine the long run proportion of turns for which is a multiple of 4 . State clearly any general theorems to which you appeal.