State and prove Chebyshev's inequality.
Let (Xi)i⩾1 be a sequence of independent, identically distributed random variables such that
P(Xi=0)=p and P(Xi=1)=1−p
for some p∈[0,1], and let f:[0,1]→R be a continuous function.
(i) Prove that
Bn(p):=E(f(nX1+⋯+Xn))
is a polynomial function of p, for any natural number n.
(ii) Let δ>0. Prove that
k∈Kδ∑(nk)pk(1−p)n−k⩽4nδ21
where Kδ is the set of natural numbers 0⩽k⩽n such that ∣k/n−p∣>δ.
(iii) Show that
p∈[0,1]sup∣f(p)−Bn(p)∣→0
as n→∞. [You may use without proof that, for any ϵ>0, there is a δ>0 such that ∣f(x)−f(y)∣⩽ϵ for all x,y∈[0,1] with ∣x−y∣⩽δ.]