Consider X1,…,Xn drawn from a statistical model {f(⋅,θ):θ∈Θ},Θ=Rp, with non-singular Fisher information matrix I(θ). For θ0∈Θ,h∈Rp, define likelihood ratios
Next consider the probability density functions (ph:h∈Rp) of normal distributions N(h,I(θ0)−1) with corresponding likelihood ratios given by
Z(h)=logp0(X)ph(X),X∼p0.
Show that for every fixed h∈Rp, the random variables Zn(h) converge in distribution as n→∞ to Z(h).
[You may assume suitable regularity conditions of the model {f(⋅,θ):θ∈Θ} without specification, and results on uniform laws of large numbers from lectures can be used without proof.]