1.I.4G

Coding and Cryptography
Part II, 2008

Define the entropy H(X)H(X) of a random variable XX that takes no more than NN different values. What are the maximum and the minimum values for the entropy for a fixed value of NN ? Explain when the maximum and minimum are attained. You should prove any inequalities that you use.