Consider the problem
minimizeE[x(T)2+∫0Tu(t)2dt]
where for 0⩽t⩽T,
x˙(t)=y(t) and y˙(t)=u(t)+ϵ(t),
u(t) is the control variable, and ϵ(t) is Gaussian white noise. Show that the problem can be rewritten as one of controlling the scalar variable z(t), where
z(t)=x(t)+(T−t)y(t).
By guessing the form of the optimal value function and ensuring it satisfies an appropriate optimality equation, show that the optimal control is
u(t)=−1+31(T−t)3(T−t)z(t).
Is this certainty equivalence control?