2.I.5I

Statistical Modelling
Part II, 2007

Consider the linear regression setting where the responses Yi,i=1,,nY_{i}, i=1, \ldots, n are assumed independent with means μi=xiTβ\mu_{i}=x_{i}^{\mathrm{T}} \beta. Here xix_{i} is a vector of known explanatory variables and β\beta is a vector of unknown regression coefficients.

Show that if the response distribution is Laplace, i.e.,

Yif(yi;μi,σ)=(2σ)1exp{yiμiσ},i=1,,n;yi,μiR;σ(0,)Y_{i} \sim f\left(y_{i} ; \mu_{i}, \sigma\right)=(2 \sigma)^{-1} \exp \left\{-\frac{\left|y_{i}-\mu_{i}\right|}{\sigma}\right\}, \quad i=1, \ldots, n ; \quad y_{i}, \mu_{i} \in \mathbb{R} ; \sigma \in(0, \infty)

then the maximum likelihood estimate β^\hat{\beta} of β\beta is obtained by minimising

S1(β)=i=1nYixiTβS_{1}(\beta)=\sum_{i=1}^{n}\left|Y_{i}-x_{i}^{\mathrm{T}} \beta\right|

Obtain the maximum likelihood estimate for σ\sigma in terms of S1(β^)S_{1}(\hat{\beta}).

Briefly comment on why the Laplace distribution cannot be written in exponential dispersion family form.