1.I.4G
Part II, 2008
Define the entropy of a random variable that takes no more than different values. What are the maximum and the minimum values for the entropy for a fixed value of ? Explain when the maximum and minimum are attained. You should prove any inequalities that you use.