Paper 4, Section II, K

Optimization and Control
Part II, 2013

Given r,ρ,μ,Tr, \rho, \mu, T, all positive, it is desired to choose u(t)>0u(t)>0 to maximize

μx(T)+0Teρtlogu(t)dt\mu x(T)+\int_{0}^{T} e^{-\rho t} \log u(t) d t

subject to x˙(t)=rx(t)u(t),x(0)=10\dot{x}(t)=r x(t)-u(t), x(0)=10.

Explain what Pontryagin's maximum principle guarantees about a solution to this problem.

Show that no matter whether x(T)x(T) is constrained or unconstrained there is a constant α\alpha such that the optimal control is of the form u(t)=αe(ρr)tu(t)=\alpha e^{-(\rho-r) t}. Find an expression for α\alpha under the constraint x(T)=5x(T)=5.

Show that if x(T)x(T) is unconstrained then α=(1/μ)erT\alpha=(1 / \mu) e^{-r T}.