Kullback-Leibler and Renormalized Entropy: Applications to EEGs of Epilepsy Patients

Abstract

Recently, renormalized entropy was proposed as a novel measure of relative entropy (P. Saparin et al., Chaos, Solitons & Fractals 4, 1907 (1994)) and applied to several physiological time sequences, including EEGs of patients with epilepsy. We show here that this measure is just a modified Kullback-Leibler (K-L) relative entropy, and it gives similar numerical results to the standard K-L entropy. The latter better distinguishes frequency contents of e.g. seizure and background EEGs than renormalized entropy. We thus propose that renormalized entropy might not be as useful as claimed by its proponents. In passing we also make some critical remarks about the implementation of these methods.