B3.14

Optimization and Control
Part II, 2003

State Pontryagin's Maximum Principle (PMP).

In a given lake the tonnage of fish, xx, obeys

dx/dt=0.001(50x)xu,0<x50d x / d t=0.001(50-x) x-u, \quad 0<x \leqslant 50

where uu is the rate at which fish are extracted. It is desired to maximize

0u(t)e0.03tdt\int_{0}^{\infty} u(t) e^{-0.03 t} d t

choosing u(t)u(t) under the constraints 0u(t)1.40 \leqslant u(t) \leqslant 1.4, and u(t)=0u(t)=0 if x(t)=0x(t)=0. Assume the PMP with an appropriate Hamiltonian H(x,u,t,λ)H(x, u, t, \lambda). Now define G(x,u,t,η)=G(x, u, t, \eta)= e0.03tH(x,u,t,λ)e^{0.03 t} H(x, u, t, \lambda) and η(t)=e0.03tλ(t)\eta(t)=e^{0.03 t} \lambda(t). Show that there exists η(t),0t\eta(t), 0 \leqslant t such that on the optimal trajectory uu maximizes

G(x,u,t,η)=η[0.001(50x)xu]+uG(x, u, t, \eta)=\eta[0.001(50-x) x-u]+u

and

dη/dt=0.002(x10)ηd \eta / d t=0.002(x-10) \eta

Suppose that x(0)=20x(0)=20 and that under an optimal policy it is not optimal to extract all the fish. Argue that η(0)1\eta(0) \geqslant 1 is impossible and describe qualitatively what must happen under the optimal policy.