Mean-field theory for a spin-glass model of neural networks: TAP free energy and paramagnetic to spin-glass transition
K. Nakanishi, H. Takayama
Abstract
An approach is proposed to the Hopfield model where the mean-field treatment is made for a given set of stored patterns (sample) and then the statistical average over samples is taken. This corresponds to the approach made by Thouless, Anderson and Palmer (TAP) to the infinite-range model of spin glasses. Taking into account the fact that in the Hopfield model there exist correlations between different elements of the interaction matrix, we obtain its TAP free energy explicitly, which consists of a series of terms exhibiting the cluster effect. Nature of the spin-glass transition in the model is also examined and compared with those given by the replica method as well as the cavity method.
Create a lesson
Related papers
Attention over noisy examples: generalization and memorization in the exponential Hopfield network
Francesco Alemanno
Finite-size geometric crossover toward fragmentation of the potential energy shell in the quantum random energy model
Ishita Modak, Vatsana Tiwari, Soumya Bera
Testing Replica Symmetry Breaking in the three-dimensional Edwards-Anderson model by using vanishing fields
Miguel Aguilar-Janita, Silvio Franz, Victor Martin-Mayor et al.
Deep Learning of Phase Transitions for Bilinear-Biquadratic Spin-1 Chains from Correlation Aspects
Ming-Chiang Chung, Yu-Ting Kuo, Ian McCulloch et al.
Resolving Structural Uncertainty in Stochastic Dynamical Systems via Ensemble-Based Bayesian Inference
Francesco Zambelli, Valeria D'Andrea, Manlio De Domenico
Seismology of Glasses
Zhiyu Cao, Peter G. Wolynes