Paper 4, Section II, 29 K29 \mathrm{~K}

Optimization and Control
Part II, 2017

A file of XX gigabytes (GB) is to be transmitted over a communications link. At each time tt the sender can choose a transmission rate u(t)u(t) within the range [0,1][0,1] GB per second. The charge for transmitting at rate u(t)u(t) at time tt is u(t)p(t)u(t) p(t). The function pp is fully known at time t=0t=0. If it takes a total time TT to transmit the file then there is a delay cost of γT2,γ>0\gamma T^{2}, \gamma>0. Thus uu and TT are to be chosen to minimize

0Tu(t)p(t)dt+γT2\int_{0}^{T} u(t) p(t) d t+\gamma T^{2}

where u(t)[0,1],dx(t)/dt=u(t),x(0)=Xu(t) \in[0,1], d x(t) / d t=-u(t), x(0)=X and x(T)=0x(T)=0. Using Pontryagin's maximum principle, or otherwise, show that a property of the optimal policy is that there exists pp^{*} such that u(t)=1u(t)=1 if p(t)<pp(t)<p^{*} and u(t)=0u(t)=0 if p(t)>pp(t)>p^{*}.

Show that the optimal pp^{*} and TT are related by p=p(T)+2γTp^{*}=p(T)+2 \gamma T.

Suppose p(t)=t+1/tp(t)=t+1 / t and X=1X=1. Show that it is optimal to transmit at a constant rate u(t)=1u(t)=1 between times T1tTT-1 \leqslant t \leqslant T, where TT is the unique positive solution to the equation

1(T1)T=2γT+1\frac{1}{(T-1) T}=2 \gamma T+1