Paper 4, Section II, J

Statistical Modelling
Part II, 2011

Consider the general linear model Y=Xβ+ϵY=X \beta+\epsilon, where the n×pn \times p matrix XX has full rank pnp \leqslant n, and where ϵ\epsilon has a multivariate normal distribution with mean zero and covariance matrix σ2In\sigma^{2} I_{n}. Write down the likelihood function for β,σ2\beta, \sigma^{2} and derive the maximum likelihood estimators β^,σ^2\hat{\beta}, \hat{\sigma}^{2} of β,σ2\beta, \sigma^{2}. Find the distribution of β^\hat{\beta}. Show further that β^\hat{\beta} and σ^2\hat{\sigma}^{2} are independent.