Paper 3, Section I, I
Part II, 2014
Let be a random variable that takes values in the finite alphabet . Prove that there is a decodable binary code that satisfies
where is the length of the code word and is the entropy of .
Is it always possible to find such a code with Justify your answer.