Skip to main content
Log in

Cooperative self-organization of afferent and lateral connections in cortical maps

  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

A self-organizing neural network model called LISSOM for the synergetic development of afferent and lateral connections in cortical feature maps is presented. The weight adaptation process is purely activity-dependent, unsupervised, and local. The afferent input weights self-organize into a topological map of the input space. At the same time, the lateral interconnection weights adapt, and a unique lateral interaction profile develops for each neuron. Weak lateral connections die off, leaving a pattern of connections that represents the significant long-term correlations of activity on the feature map. LISSOM demonstrates how self-organization can bootstrap based on input information only, without global supervision or predetermined lateral interaction. The model gives rise to a nontopographically organized lateral connectivity similar to that observed in the mammalian neocortex as illustrated by a LISSOM model of ocular dominance column formation in the primary visual cortex. In addition, LISSOM can potentially account for the development of multiple maps of different modalities on the same undifferentiated cortical architecture.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bourgeois JP, Jastreboff PJ, Rakic P (1989) Synaptogenesis in visual cortex of normal and preterm monkeys: evidence for intrinsic regulation of synaptic overproduction. Proc Natl Acad Sci USA 86:4297–4301

    Google Scholar 

  • Burkhalter A, Bernardo KL, Charles V (1993) Development of local circuits in human visual cortex. J Neurosci 13:1916–1931

    Google Scholar 

  • Callaway EM, Katz LC (1990) Emergence and refinement of clustered horizontal connections in cat striate cortex. J Neurosci 10:1134–1153

    Google Scholar 

  • Callaway EM, Katz LC (1991) Effects of binocular deprivation on the development of clustered horizontal connections in cat striate cortex. Proc Natl Acad Sci USA 88:745–749

    Google Scholar 

  • Fisken RA, Garey LJ, Powell TPS (1975) The intrinsic, association and commissural connections of area 17 of the visual cortex. Proc IEEE 61:268–278

    Google Scholar 

  • Gilbert CD, Wiesel TN (1979) Morphology and intracortical projections of functionally identified neurons in cat visual cortex. Nature 280:120–125

    Google Scholar 

  • Gilbert CD, Wiesel TN (1989) Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. J Neurosci 9:2432–2442

    Google Scholar 

  • Gilbert CD, Hirsch JA, Wiesel TN (1990) Lateral interactions in visual cortex. Cold Spring Harb Symp Quant Biol 55:663–677

    Google Scholar 

  • Goodhill G (1991) Topography and ocular dominance can arise from distributed patterns of activity. In: Proceedings of the international joint conference on neural networks, Seattle, Wash. IEEE, Piscataway, NJ

    Google Scholar 

  • Gustafsson B, Wigström H (1988) Physiological mechanisms underlying long-term potentiation. Trends Neurosci 11:156–162

    Google Scholar 

  • Hayes WP, Meyer RL (1988a) Optic synapse number but not density is constrained during regeneration onto surgically halved tectum in goldfish: HRP-EM evidence that optic fibers compete for fixed numbers of postsynaptic sites on the tectum. J Comput Neurol 274:539–559

    Google Scholar 

  • Hayes WP, Meyer RL (1988b) Retinotopically inappropriate synapses of subnormal density formed by misdirected optic fibers in goldfish tectum. Dev Brain Res 38:304–312

    Google Scholar 

  • Hebb DO (1949) The organization of behavior: a neuropsychological theory. Wiley, New York

    Google Scholar 

  • Hubel DH, Wiesel TN (1965) Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. J Neurophysiol 28:229–289

    Google Scholar 

  • Kandel ER, Schwartz JH, Jessel TM (1991) Principles of neural science, 3rd edn. Elsevier, New York

    Google Scholar 

  • Katz LC, Callaway EM (1992) Development of local circuits in mammalian visual cortex. Ann Rev Neurosci 15:31–56

    Google Scholar 

  • Kohonen T (1982a) Analysis of a simple self-organizing process. Biol Cybern 44:135–140

    Google Scholar 

  • Kohonen T (1982b) Self-organized formation of topologically correct feature maps. Biol. Cybern 43:59–69

    Google Scholar 

  • Kohonen T (1989) Self-organization and associative memory, 3rd edn. Springer, Berlin Heidelberg New York

    Google Scholar 

  • Kohonen T (1990) The self-organizing map. Proc IEEE 78:1464–1480

    Google Scholar 

  • Kohonen T (1993a) Things you haven't heard about the self-organizing map. In: Proceedings of the international conference on neural networks, San Francisco, CA. IEEE, Piscataway, NJ

    Google Scholar 

  • Kohonen T (1993b) Physiological interpretation of the self-organizing map algorithm. Neural Networks 6:895–905

    Google Scholar 

  • König P, Engel AK, Löwel S, Singer W (1993) Squint affects synchronization of oscillatory responses in cat visual cortex. Eur J Neurosci 5:501–508

    Google Scholar 

  • Löwel S, Singer W (1992) Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity. Science 255:209–212

    Google Scholar 

  • Luhmann HJ, Millan M, Singer W (1986) Development of horizontal intrinsic connections in cat striate cortex. Exp Brain Res 63:443–448

    Google Scholar 

  • Madore BF, Freedman WL (1987) Self-organizing structures. Am Scientist 75:252–259

    Google Scholar 

  • Malsburg C von der (1973) Self-organization of orientation-sensitive cells in the striate cortex. Kybernetik 15:85–100

    Google Scholar 

  • Malsburg C von der (1990) Network self-organization. In: Zornetzer SF, Davis JL, Lau C (eds) An introduction to neural and electronic networks. Academic, San Mateo, pp 421–432

    Google Scholar 

  • Malsburg C von der, Singer W (1988) Principles of cortical network organization. In: Rakic P, Singer W (eds) Neurobiology of neocortex. Wiley, New York, pp 69–99

    Google Scholar 

  • McCasland JS, Bernardo KL, Probst KL, Woolsey TA (1992) Cortical local circuit axons do not mature after early deafferentation. Proc Natl Acad Sci USA 89:1832–1836

    Google Scholar 

  • Merzenich MM, Kaas JH (1982) Reorganization of mammalian somatosensory cortex following peripheral nerve injury. Trends Neurosci 5:434–436

    Google Scholar 

  • Merzenich MM, Nelson RJ, Stryker MP, Cynader MS, Schoppmann A, Zook JM (1984) Somatosensory cortical map changes following digit amputation in adult monkeys. J Comp Neurol 224:591–605

    Google Scholar 

  • Miikkulainen R (1991) Self-organizing process based on lateral inhibition and synaptic resource redistribution. In: Proceedings of the international conference on artificial neural networks, Espoo, Finland. North-Holland, Amsterdam, pp 415–420

    Google Scholar 

  • Miller KD (1992) Development of orientation columns via competition between onand off-center inputs. NeuroReport 3:73–76

    Google Scholar 

  • Miller KD, MacKay DJC (1994) The role of constraints in hebbian learning. Neural Comput 6:98–124

    Google Scholar 

  • Miller KD, Keller JB, Stryker MP (1989) Ocular dominance column development: analysis and simulation. Science 245:605–615

    Google Scholar 

  • Mountcastle VB (1968) Neural mechanisms in somesthesia. In: Mountastle VB (ed) Medical physiology, Vol 2, 12th edn. Mosby, Saint Louis, pp 1372–1423

    Google Scholar 

  • Murray M, Sharma S, Edwards MA (1982) Target regulation of synaptic number in the compressed retinotectal projection of goldfish. J Comput Neurol 209:374–385

    Google Scholar 

  • Noorden GK von (1990) Binocular vision and ocular motility. Theory and management of strabismus. Mosby, Baltimore

    Google Scholar 

  • Obermayer K, Ritter HJ, Schulten KJ (1990) A principle for the formation of the spatial structure of cortical feature maps. Proc Natl Acad Sci USA 87:8345–8349

    Google Scholar 

  • Obermayer K, Blasdel GG, Schulten KJ (1992) Statistical-mechanical analysis of self-organization and pattern formation during the development of visual maps. Phys Rev A 45:7568–7589

    Google Scholar 

  • Pallas SL, Finlay BL (1991) Compensation for population-size mismatches in the hamster retinotectal system: alterations in the organization of retinal projections. Visual Neurosci 6:271–281

    Google Scholar 

  • Prigogine I, Stengers I (1984) Order out of chaos: man's new dialogue with nature. Random House, Boulder

    Google Scholar 

  • Prince D, Huguenard J (1988) Functional properties of neocortical neurons. In: Rakic P, Singer W (eds) Neurobiology of neocortex. Wiley, New York, pp 153–176

    Google Scholar 

  • Purves D (1988) Body and brain: a trophic theory of neural connections. Harvard University Press, Cambridge, Mass

    Google Scholar 

  • Purves D, Lichtman JW (1985) Principles of neural development. Sinauer, Sunderland

    Google Scholar 

  • Schwark H, Jones E (1989) The distribution of intrinsic cortical axons in area 3b of the cat primary somatosensory cortex. Exp Brain Res 78:501–513

    Google Scholar 

  • Singer W, Gray C, Engel A, König P, Artola A, Bröcher S (1990) Formation of cortical cell assemblies. Cold Spring Harb Symp Quant Biol 55:939–952

    Google Scholar 

  • Stryker M, Altaian J, Blakemore C, Gruel J, Kaas J, Merzenich M, Rakic P, Singer W, Stent G, Loos H van der, Wiesel T (1988) Group report. Principles of cortical self-organization. In: Rakic P, Singer W (eds) Neurobiology of neocortex. Wiley, New York, pp 115–136

    Google Scholar 

  • Stryker M, Chapman B, Miller K, Zahs K (1990) Experimental and theoretical studies of the organization of afferents to single orientation columns in visual cortex. Cold Spring Harb Symp Quant Biol 55:515–527

    Google Scholar 

  • Tanaka S (1990) A mathematical model for the self-organization of orientation columns in visual cortex. Neural Networks 3:625–640

    Google Scholar 

  • Toyama K (1988) Functional connections of the visual cortex studied by cross-correlation techniques. In: Rakic P, Singer W. (eds) Neurobiology of neocortex. Wiley, New York, pp 203–217

    Google Scholar 

  • White EL (1989) Cortical circuits: synaptic organization of the cerebral cortex structure, function, and theory. Birkhäuser, Boston

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sirosh, J., Miikkulainen, R. Cooperative self-organization of afferent and lateral connections in cortical maps. Biol. Cybern. 71, 65–78 (1994). https://doi.org/10.1007/BF00198912

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00198912

Keywords

Navigation