Paper 2, Section I, I
Part II, 2020
(a) Define the information capacity of a discrete memoryless channel (DMC).
(b) Consider a DMC where there are two input symbols, and , and three output symbols, and . Suppose each input symbol is left intact with probability , and transformed into a with probability .
(i) Write down the channel matrix, and calculate the information capacity.
(ii) Now suppose the output is further processed by someone who cannot distinguish between and , so that the channel matrix becomes
Calculate the new information capacity.