Paper 2, Section II, H

Statistics
Part IB, 2009

What does it mean to say that the random dd-vector XX has a multivariate normal distribution with mean μ\mu and covariance matrix Σ\Sigma ?

Suppose that XNd(0,σ2Id)X \sim N_{d}\left(0, \sigma^{2} I_{d}\right), and that for each j=1,,J,Ajj=1, \ldots, J, A_{j} is a dj×dd_{j} \times d matrix. Suppose further that

AjAiT=0A_{j} A_{i}^{T}=0

for jij \neq i. Prove that the random vectors YjAjXY_{j} \equiv A_{j} X are independent, and that Y(Y1T,,YJT)TY \equiv\left(Y_{1}^{T}, \ldots, Y_{J}^{T}\right)^{T} has a multivariate normal distribution.

[Hint: Random vectors are independent if their joint MGFM G F is the product of their individual MGFs.]

If Z1,,ZnZ_{1}, \ldots, Z_{n} is an independent sample from a univariate N(μ,σ2)N\left(\mu, \sigma^{2}\right) distribution, prove that the sample variance SZZ(n1)1i=1n(ZiZˉ)2S_{Z Z} \equiv(n-1)^{-1} \sum_{i=1}^{n}\left(Z_{i}-\bar{Z}\right)^{2} and the sample mean Zˉ\bar{Z} \equiv n1i=1nZin^{-1} \sum_{i=1}^{n} Z_{i} are independent.