Optimal Performance of Feedback Control Systems with Limited Communication over Noisy Channels

Abstract

A discrete time stochastic feedback control system with a noisy communication channel between the sensor and the controller is considered. The sensor has limited memory. At each time, the sensor transmits encoded symbol over the channel and updates its memory. The controller receives a noisy version of the transmitted symbol, and generates a control action based on all its past observations and actions. This control action action is fed back into the system. At each stage the system incurs an instantaneous cost depending on the state of the plant and the control action. The objective is to choose encoding, memory updating and control strategies to minimize the expected total costs over a finite horizon, or the expected discounted cost over an infinite horizon, or the expected average cost per unit time over an infinite horizon. For each case we obtain a sequential decomposition of the optimization problem. The results are extended to the case when the sensor makes an imperfect observation of the state of the system.