State Pontryagin's Maximum Principle (PMP).
In a given lake the tonnage of fish, x, obeys
dx/dt=0.001(50−x)x−u,0<x⩽50
where u is the rate at which fish are extracted. It is desired to maximize
∫0∞u(t)e−0.03tdt
choosing u(t) under the constraints 0⩽u(t)⩽1.4, and u(t)=0 if x(t)=0. Assume the PMP with an appropriate Hamiltonian H(x,u,t,λ). Now define G(x,u,t,η)= e0.03tH(x,u,t,λ) and η(t)=e0.03tλ(t). Show that there exists η(t),0⩽t such that on the optimal trajectory u maximizes
G(x,u,t,η)=η[0.001(50−x)x−u]+u
and
dη/dt=0.002(x−10)η
Suppose that x(0)=20 and that under an optimal policy it is not optimal to extract all the fish. Argue that η(0)⩾1 is impossible and describe qualitatively what must happen under the optimal policy.