Representational capacity of a set of independent neurons
Ines Samengo, Alessandro Treves
Abstract
The capacity with which a system of independent neuron-like units represents a given set of stimuli is studied by calculating the mutual information between the stimuli and the neural responses. Both discrete noiseless and continuous noisy neurons are analyzed. In both cases, the information grows monotonically with the number of neurons considered. Under the assumption that neurons are independent, the mutual information rises linearly from zero, and approaches exponentially its maximum value. We find the dependence of the initial slope on the number of stimuli and on the sparseness of the representation.
Create a lesson
Related papers
Cell-type-specific modularity in E/I networks shapes dynamical regimes and computational capabilities
Emmanouil Giannakakis, Victor Buendía, Oleg Vinogradov et al.
Finite-width shift of the edge of chaos in deep neural networks
Arn Caesar
Neural Networks with Exciton-Polariton Waveguides
Huawen Xu, Ruiqi Bao, Lingyu Tian et al.
Optical Ceiling on Polaron Mobility in Disordered Molecular Semiconductors: Lessons from Eumelanin
Alvan Hunt
Glauber dynamics of the Sherrington--Kirkpatrick spin-glass model: a dynamical cavity method
Grzegorz Szamel
Generative diffusion in long-range correlated landscapes: Speciation cascade and the foam structure of the score
Jerome Garnier-Brun, Giulio Biroli, Marc Mézard et al.