Searching for memories, Sudoku, implicit check-bits, and the iterative use of not-always-correct rapid neural computation
J. J. Hopfield
Abstract
The algorithms that simple feedback neural circuits representing a brain area can rapidly carry out are often adequate to solve only easy problems, and for more difficult problems can return incorrect answers. A new excitatory-inhibitory circuit model of associative memory displays the common human problem of failing to rapidly find a memory when only a small clue is present. The memory model and a related computational network for solving Sudoku puzzles produce answers that contain implicit check-bits in the representation of information across neurons, allowing a rapid evaluation of whether the putative answer is correct or incorrect through a computation related to visual 'pop-out'. This fact may account for our strong psychological feeling of right or wrong when we retrieve a nominal memory from a minimal clue. This information allows more difficult computations or memory retrievals to be done in a serial fashion by using the fast but limited capabilities of a computational module multiple times. The mathematics of the excitatory-inhibitory circuits for associative memory and for Sudoku, both of which are understood in terms of 'energy' or Lyapunov functions, is described in detail.
Create a lesson
Related papers
Beta oscillation changes in ALS: A Dual-Site International Replication Study
Marit Boxum, Gabriel Rodrigues Palma, Robin Jansen et al.
Hysteresis and multistability in network spreading with neuronal activity feedback
Christoffer G. Alexandersen, Dani S. Bassett
A spinal circuit for collective coordination
Laurence Picton, David Madrid, Alessandro Pazzaglia et al.
Dendritic structure enables powerful plasticity
Ben von Hünerbein, Federico Benitez, Kevin Max et al.
Temporal filling-in reduces attentional fluctuations in sustained visual attention
Yingyu Huang, Liying Zhan, Xiang Wu
Forward and reverse delay-driven hippocampal replay without symmetric plasticity
Georg Reich, Matthew Cook, Klaus Obermayer et al.