Paper 1, Section I, G
Part II, 2019
Let and be discrete random variables taking finitely many values. Define the conditional entropy . Suppose is another discrete random variable taking values in a finite alphabet, and prove that
[You may use the equality and the inequality
State and prove Fano's inequality.