Paper 3, Section I, 5K

Statistical Modelling
Part II, 2012

Consider the linear model

Yi=β0+β1xi1+β2xi2+εiY_{i}=\beta_{0}+\beta_{1} x_{i 1}+\beta_{2} x_{i 2}+\varepsilon_{i}

for i=1,2,,ni=1,2, \ldots, n, where the εi\varepsilon_{i} are independent and identically distributed with N(0,σ2)N\left(0, \sigma^{2}\right) distribution. What does it mean for the pair β1\beta_{1} and β2\beta_{2} to be orthogonal? What does it mean for all the three parameters β0,β1\beta_{0}, \beta_{1} and β2\beta_{2} to be mutually orthogonal? Give necessary and sufficient conditions on (xi1)i=1n,(xi2)i=1n\left(x_{i 1}\right)_{i=1}^{n},\left(x_{i 2}\right)_{i=1}^{n} so that β0,β1\beta_{0}, \beta_{1} and β2\beta_{2} are mutually orthogonal. If β0,β1,β2\beta_{0}, \beta_{1}, \beta_{2} are mutually orthogonal, find the joint distribution of the corresponding maximum likelihood estimators β^0,β^1\hat{\beta}_{0}, \hat{\beta}_{1} and β^2\hat{\beta}_{2}.