Paper 4, Section II, H

Statistics
Part IB, 2016

Consider the linear regression model

Yi=α+βxi+εiY_{i}=\alpha+\beta x_{i}+\varepsilon_{i}

for i=1,,ni=1, \ldots, n, where the non-zero numbers x1,,xnx_{1}, \ldots, x_{n} are known and are such that x1++xn=0x_{1}+\ldots+x_{n}=0, the independent random variables ε1,,εn\varepsilon_{1}, \ldots, \varepsilon_{n} have the N(0,σ2)N\left(0, \sigma^{2}\right) distribution, and the parameters α,β\alpha, \beta and σ2\sigma^{2} are unknown.

(a) Let (α^,β^)(\hat{\alpha}, \hat{\beta}) be the maximum likelihood estimator of (α,β)(\alpha, \beta). Prove that for each ii, the random variables α^,β^\hat{\alpha}, \hat{\beta} and Yiα^β^xiY_{i}-\hat{\alpha}-\hat{\beta} x_{i} are uncorrelated. Using standard facts about the multivariate normal distribution, prove that α^,β^\hat{\alpha}, \hat{\beta} and i=1n(Yiα^β^xi)2\sum_{i=1}^{n}\left(Y_{i}-\hat{\alpha}-\hat{\beta} x_{i}\right)^{2} are independent.

(b) Find the critical region of the generalised likelihood ratio test of size 5%5 \% for testing H0:α=0H_{0}: \alpha=0 versus H1:α0H_{1}: \alpha \neq 0. Prove that the power function of this test is of the form w(α,β,σ2)=g(α/σ)w\left(\alpha, \beta, \sigma^{2}\right)=g(\alpha / \sigma) for some function gg. [You are not required to find gg explicitly.]