Information Capacity of Biological Macromoleculae Reloaded

Abstract

Information capacity of a symbol sequence is a measure of the unexpectedness of a continuation of given string of symbols. Continuation of a string is determined through the maximum entropy of the reconstructed frequency dictionary; the capacity, in turn, is determined through the calculation of mutual entropy of a real frequency dictionary of a sequence with respect to the reconstructed one. The capacity does not depend on the length of strings in a dictionary. The capacity calculated for various genomes exhibits a multi-minima pattern reflecting an order observed within a sequence.