Spin-glass models of neural networks

Daniel J. Amit, Hanoch Gutfreund, and H. Sompolinsky
Phys. Rev. A 32, 1007 – Published 1 August 1985
PDFExport Citation

Abstract

Two dynamical models, proposed by Hopfield and Little to account for the collective behavior of neural networks, are analyzed. The long-time behavior of these models is governed by the statistical mechanics of infinite-range Ising spin-glass Hamiltonians. Certain configurations of the spin system, chosen at random, which serve as memories, are stored in the quenched random couplings. The present analysis is restricted to the case of a finite number p of memorized spin configurations, in the thermodynamic limit. We show that the long-time behavior of the two models is identical, for all temperatures below a transition temperature Tc. The structure of the stable and metastable states is displayed. Below Tc, these systems have 2p ground states of the Mattis type: Each one of them is fully correlated with one of the stored patterns. Below T∼0.46Tc, additional dynamically stable states appear. These metastable states correspond to specific mixings of the embedded patterns. The thermodynamic and dynamic properties of the system in the cases of more general distributions of random memories are discussed.

  • Received 22 March 1985

DOI:https://doi.org/10.1103/PhysRevA.32.1007

©1985 American Physical Society

Authors & Affiliations

Daniel J. Amit and Hanoch Gutfreund

  • Racah Institute of Physics, Hebrew University, 91904 Jerusalem, Israel

H. Sompolinsky

  • Department of Physics, Bar-Ilan University, 52100 Ramat-Gan, Israel

References (Subscription Required)

Click to Expand
Issue

Vol. 32, Iss. 2 — August 1985

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review A

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×