Estimating sub-frame time differences in camera image sequences

Abstract

Some optical measurements require relative timing of intensity variations with accuracy much finer than the camera frame period. One motivating example is dynamic aurora, where different prompt emissions are expected to originate from different altitude regions and can therefore have millisecond-scale relative delays caused by finite energetic-electron velocities and other electron-transport effects. These delays are predicted to be a small fraction of the frame duration of typical auroral video cameras. We present a cross-spectral technique for estimating the relative delay between two time-varying optical intensity signals recorded by one or more image sensors. The method is validated with a calibration device that generates two pseudorandomly pulsed optical emissions with a known relative delay, recorded using a consumer smartphone camera. For the tested recordings, the method estimates relative delays between image-sensor regions with better than $50$~$μ$s accuracy. Although developed for high-frame-rate auroral imaging, the technique has numerous other imaging applications, including camera timing calibration and measurements of time-varying optical signals. The single-camera tests demonstrate that the method can characterize sub-frame timing differences across an image sensor, such as those produced by rolling-shutter readout. The same analysis applies to separate cameras when they observe the same time-varying signal and are synchronized to a shared clock.