Skip to main content
Log in

Optimal learning rules for familiarity detection

  • Original Paper
  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

It has been suggested that the mammalian memory system has both familiarity and recollection components. Recently, a high-capacity network to store familiarity has been proposed. Here we derive analytically the optimal learning rule for such a familiarity memory using a signal- to-noise ratio analysis. We find that in the limit of large networks the covariance rule, known to be the optimal local, linear learning rule for pattern association, is also the optimal learning rule for familiarity discrimination. In the limit of large networks, the capacity is independent of the sparseness of the patterns and the corresponding information capacity is 0.057 bits per synapse, which is somewhat less than typically found for associative networks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Amit D (1989) Modeling brain function: the world of attractor neural networks. Cambridge University Press, Cambridge

    Google Scholar 

  • Bogacz R, Brown MW (2002) The restricted influence of sparseness of coding on the capacity of familiarity discrimination networks. Network 13(4): 457–485

    Article  PubMed  Google Scholar 

  • Bogacz R, Brown MW (2003) Comparison of computational models of familiarity discrimination in the perirhinal cortex. Hippocampus 13: 494–524

    Article  PubMed  Google Scholar 

  • Bogacz R, Brown MW, Giraud-Carrier C (2001) Model of familiarity discrimination in the perirhinal cortex. J Comput Neurosc 10: 5–23

    Article  CAS  Google Scholar 

  • Brunel N (1994) Storage capacity of neural networks: effect of the fluctuations of the number of active neurons per memory. Phys A 27: 4783–4789

    Article  Google Scholar 

  • Dayan P, Willshaw DJ (1991) Optimising synaptic learning rules in linear associative memories. Biol Cybern 65: 253–265

    Article  PubMed  CAS  Google Scholar 

  • Fortin NJ, Wright SP, Eichenbaum H (2004) Recollection-like memory retrieval in rats is dependent on the hippocampus. Nature 431: 188–191

    Article  PubMed  CAS  Google Scholar 

  • Hertz J, Krogh A, Palmer RG (1991) Introduction to the theory of neural computation. Perseus, Reading

    Google Scholar 

  • Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79: 2554–2558

    Article  PubMed  CAS  Google Scholar 

  • Horner H (1989) Neural networks with low levels of activity: Ising vs. McCulloch-Pitts neurons. Z Physik B Condens Matter 75(1): 133–136

    Article  Google Scholar 

  • Kanter I, Sompolinsky H (1987) Associative recall of memory without errors. Phys Rev A 35: 350–392

    Article  Google Scholar 

  • Meunier C, Nadal JP (1995) Sparsely coded neural networks. In: Arbib MA (eds) The handbook of Brain theory, 1st edn. MIT press, Cambridge

    Google Scholar 

  • Nadal JP, Toulouse G (1990) Information storage in sparsely coded memory nets. Network 1: 61–74

    Google Scholar 

  • Tsodyks MV, Feigelman MV (1988) The enhanced storage capacity in neural networks with low activity level. Europhys Lett 6: 101–105

    Article  Google Scholar 

  • Willshaw DJ, Buneman OP, Longuet-Higgins HC (1969) Non-holographic associative memory. Nature 222: 960–993

    Article  PubMed  CAS  Google Scholar 

  • Yakovlev V, Amit DJ, Romani S, Hochstein S (2008) Universal memory mechanism for familiarity recognition and identification. J Neurosci 28(1): 239–248

    Article  PubMed  CAS  Google Scholar 

  • Yonelinas AP (2001) Components of episodic memory: the contribution of recollection and familiarity. Proc R Soc B 356: 1363–1374

    CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark C. W. van Rossum.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Greve, A., Sterratt, D.C., Donaldson, D.I. et al. Optimal learning rules for familiarity detection. Biol Cybern 100, 11–19 (2009). https://doi.org/10.1007/s00422-008-0275-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00422-008-0275-4

Keywords

Navigation