1.I.5I

Statistical Modelling
Part II, 2005

Suppose that Y1,,YnY_{1}, \ldots, Y_{n} are independent random variables, and that YiY_{i} has probability density function

f(yiθi,ϕ)=exp[(yiθib(θi))ϕ+c(yi,ϕ)]f\left(y_{i} \mid \theta_{i}, \phi\right)=\exp \left[\frac{\left(y_{i} \theta_{i}-b\left(\theta_{i}\right)\right)}{\phi}+c\left(y_{i}, \phi\right)\right]

Assume that E(Yi)=μi\mathbb{E}\left(Y_{i}\right)=\mu_{i} and that there is a known link function g(.)g(.) such that

g(μi)=βTxig\left(\mu_{i}\right)=\beta^{T} x_{i}

where x1,,xnx_{1}, \ldots, x_{n} are known pp-dimensional vectors and β\beta is an unknown pp-dimensional parameter. Show that E(Yi)=b(θi)\mathbb{E}\left(Y_{i}\right)=b^{\prime}\left(\theta_{i}\right) and that, if (β,ϕ)\ell(\beta, \phi) is the log-likelihood function from the observations (y1,,yn)\left(y_{1}, \ldots, y_{n}\right), then

(β,ϕ)β=1n(yiμi)xig(μi)Vi\frac{\partial \ell(\beta, \phi)}{\partial \beta}=\sum_{1}^{n} \frac{\left(y_{i}-\mu_{i}\right) x_{i}}{g^{\prime}\left(\mu_{i}\right) V_{i}}

where ViV_{i} is to be defined.