Skip to main content
SpringerLink
Log in

Properties of Hopfield model with the zero-order synaptic decay

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

In this paper, we investigate the effect of synaptogenesis on memories in the brain, using the abstract-associative memory model, Hopfield model with the zero-order synaptic decay. Using the numerical simulation, we demonstrate the possibility that synaptogenesis plays a role in maintaining recent memories embedded in the network while avoiding overloading. For the network consisting of 1000 units, it turned out that the minimum decay rate to avoid overloading is 0.02, and the optimal decay rate to maximize the storage capacity is 0.08. We also show that the average numbers of replacement synapses at each learning step corresponding to these two values are 1187 and 21024, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79:2554–2558

    Article  MathSciNet  Google Scholar 

  2. Amari S (1989) Characteristics of sparsely encoded associative memory. Neural Netw 2:451–457

    Article  Google Scholar 

  3. Okada M (1996) Notions of associative memory and sparse coding. Neural Netw 9(8):1429–1458

    Article  MATH  Google Scholar 

  4. Amit DJ, Gutfreund H, Sompolinsky H (1985) Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys Rev Lett 55(14):1530–1533

    Article  Google Scholar 

  5. Mezard M, Nadal JP, Toulouse G (1986) Solvable models of working memories. J Phys 47:1457–1462

    Article  MathSciNet  Google Scholar 

  6. Tominaga-Yoshino K, Kondo S, Tamotsu S, Ogura A (2002) Retitive activation of protein kinase A induces slow and persistent synaptogenesis in cultured hippocampus. Neurosci Res 44:357–367

    Article  Google Scholar 

  7. Yasumatsu N, Matsuzaki M, Miyazaki T, Noguchi J, Kasai H (2008) Principles of long-term dynamics of dendritic spines. J Neurosci 28(50):13592–13608

    Article  Google Scholar 

  8. Altman J (1962) Are new neurons formed in the brains of adult mammals? Science 135:1127–1128

    Article  Google Scholar 

  9. Eriksson PS, Perfilieva E, Bjork-Eriksson T et al (1998) Neurogenesis in the adult human hippocampus. Nature Med 4(11):1313–1317

    Article  Google Scholar 

  10. Date A, Kurata K (2008) A property of neural networks of associative memory models with replacing units. Artif Life Robot 12:291–294

    Article  Google Scholar 

  11. Ishikawa M (1996) Structural learning with forgetting. Neural Netw 9(3):509–521

    Article  Google Scholar 

  12. Hertz J, Krogh A, Palmer RG (1991) Introduction to the theory of neural computation. Addison Wesley, Canada.

Download references

Author information

Authors and Affiliations

  1. Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259 Nagatsuta-cho, Midori-ku, Yokohama, Kanagawa, 226-8502, Japan

    Ryota Miyata & Toru Aonishi

  2. Faculty of Engineering, Okayama University of Science, 1-1 Ridai-cho, Kita-ku, Okayama, Okayama, 700-0005, Japan

    Jun Tsuzurugi

  3. Faculty of Engineering, University of the Ryukyus, 1 Senbaru, Nishihara-cho, Nakagami-gun, Okinawa, 903-0213, Japan

    Koji Kurata

Authors
  1. Ryota Miyata
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Toru Aonishi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jun Tsuzurugi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Koji Kurata
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ryota Miyata.

About this article

Cite this article

Miyata, R., Aonishi, T., Tsuzurugi, J. et al. Properties of Hopfield model with the zero-order synaptic decay. Artif Life Robotics 17, 163–167 (2012). https://doi.org/10.1007/s10015-012-0033-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-012-0033-5

Keywords

Search

Navigation