Some results on the Gittins index for a normal reward process

Abstract

We consider the Gittins index for a normal distribution with unknown mean $θ$ and known variance where $θ$ has a normal prior. In addition to presenting some monotonicity properties of the Gittins index, we derive an approximation to the Gittins index by embedding the (discrete-time) normal setting into the continuous-time Wiener process setting in which the Gittins index is determined by the stopping boundary for an optimal stopping problem. By an application of Chernoff's continuity correction in optimal stopping, the approximation includes a correction term which accounts for the difference between the discrete and continuous-time stopping boundaries. Numerical results are also given to assess the performance of this simple approximation.