4.II.13I

Statistical Modelling
Part II, 2006

Consider a linear model for Y=(Y1,,Yn)TY=\left(Y_{1}, \ldots, Y_{n}\right)^{T} given by

Y=Xβ+ϵ,Y=X \beta+\epsilon,

where XX is a known n×pn \times p matrix of full rank p<np<n, where β\beta is an unknown vector and ϵNn(0,σ2I)\epsilon \sim N_{n}\left(0, \sigma^{2} I\right). Derive an expression for the maximum likelihood estimator β^\hat{\beta} of β\beta, and write down its distribution.

Find also the maximum likelihood estimator σ^2\hat{\sigma}^{2} of σ2\sigma^{2}, and derive its distribution.

[You may use Cochran's theorem, provided that it is stated carefully. You may also assume that the matrix P=X(XTX)1XTP=X\left(X^{T} X\right)^{-1} X^{T} has rank pp, and that IPI-P has rank npn-p.]