Consider a normally distributed random vector X∈Rp modelled as X∼N(θ,Ip) where θ∈Rp,Ip is the p×p identity matrix, and where p⩾3. Define the Stein estimator θ^STEIN of θ.
Prove that θ^STEIN dominates the estimator θ~=X for the risk function induced by quadratic loss
ℓ(a,θ)=i=1∑p(ai−θi)2,a∈Rp
Show however that the worst case risks coincide, that is, show that
θ∈RpsupEθℓ(X,θ)=θ∈RpsupEθℓ(θ^STEIN,θ)
[You may use Stein's lemma without proof, provided it is clearly stated.]