(a) State and prove the strong law of large numbers for sequences of i.i.d. random variables with a finite moment of order 4 .
(b) Let (Xk)k⩾1 be a sequence of independent random variables such that
P(Xk=1)=P(Xk=−1)=21
Let (ak)k⩾1 be a sequence of real numbers such that
k⩾1∑ak2<∞
Set
Sn:=k=1∑nakXk
(i) Show that Sn converges in L2 to a random variable S as n→∞. Does it converge in L1 ? Does it converge in law?
(ii) Show that ∥S∥4⩽31/4∥S∥2.
(iii) Let (Yk)k⩾1 be a sequence of i.i.d. standard Gaussian random variables, i.e. each Yk is distributed as N(0,1). Show that then ∑k=1nakYk converges in law as n→∞ to a random variable and determine the law of the limit.