4.I.4J

Coding and Cryptography
Part II, 2005

What does it mean to transmit reliably at rate rr through a binary symmetric channel (BSC) with error probability pp ? Assuming Shannon's second coding theorem, compute the supremum of all possible reliable transmission rates of a BSC. What happens if (i) pp is very small, (ii) p=1/2p=1 / 2, or (iii) p>1/2p>1 / 2 ?