1.II.18C

Statistics
Part IB, 2007

Let X1,,XnX_{1}, \ldots, X_{n} be independent, identically distributed random variables with

P(Xi=1)=θ=1P(Xi=0)\mathbb{P}\left(X_{i}=1\right)=\theta=1-\mathbb{P}\left(X_{i}=0\right)

where θ\theta is an unknown parameter, 0<θ<10<\theta<1, and n2n \geqslant 2. It is desired to estimate the quantity ϕ=θ(1θ)=nVar((X1++Xn)/n)\phi=\theta(1-\theta)=n \operatorname{Var}\left(\left(X_{1}+\cdots+X_{n}\right) / n\right).

(i) Find the maximum-likelihood estimate, ϕ^\hat{\phi}, of ϕ\phi.

(ii) Show that ϕ^1=X1(1X2)\hat{\phi}_{1}=X_{1}\left(1-X_{2}\right) is an unbiased estimate of ϕ\phi and hence, or otherwise, obtain an unbiased estimate of ϕ\phi which has smaller variance than ϕ^1\hat{\phi}_{1} and which is a function of ϕ^\hat{\phi}.

(iii) Now suppose that a Bayesian approach is adopted and that the prior distribution for θ,π(θ)\theta, \pi(\theta), is taken to be the uniform distribution on (0,1)(0,1). Compute the Bayes point estimate of ϕ\phi when the loss function is L(ϕ,a)=(ϕa)2L(\phi, a)=(\phi-a)^{2}.

[You may use that fact that when r,sr, s are non-negative integers,

01xr(1x)sdx=r!s!/(r+s+1)!]\left.\int_{0}^{1} x^{r}(1-x)^{s} d x=r ! s ! /(r+s+1) !\right]