Fluctuation-dissipation theorem and models of learning
Ilya Nemenman
Abstract
Advances in statistical learning theory have resulted in a multitude of different designs of learning machines. But which ones are implemented by brains and other biological information processors? We analyze how various abstract Bayesian learners perform on different data and argue that it is difficult to determine which learning-theoretic computation is performed by a particular organism using just its performance in learning a stationary target (learning curve). Basing on the fluctuation-dissipation relation in statistical physics, we then discuss a different experimental setup that might be able to solve the problem.
Create a lesson
Related papers
When Model Complexity Matters in Cross-Subject Naturalistic fMRI Prediction
Junhao Zhao, Jacob Kang, Colin Kurniawan et al.
Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure
Ali Mahzarnia, Homayoun Jamshidi
Evolved Spiking Neural Networks for EEG Seizure Detection: Calcium Dynamics and Delay Mechanics
Tuba Aksoy
Intrinsic network dynamics catalyze switching in functional connectivity states of the brain
Steven S. Kang, Dae-Jin Kim
Modeling Visual Cortex with Layerwise Multiscale Manifold Capacity Maximization
Thomas Yerxa, SueYeon Chung, Eero P. Simoncelli
Do agents need to sleep?
Ido Haber, Giulio Tononi