Abstract
A self-organizing neural network model called LISSOM for the synergetic development of afferent and lateral connections in cortical feature maps is presented. The weight adaptation process is purely activity-dependent, unsupervised, and local. The afferent input weights self-organize into a topological map of the input space. At the same time, the lateral interconnection weights adapt, and a unique lateral interaction profile develops for each neuron. Weak lateral connections die off, leaving a pattern of connections that represents the significant long-term correlations of activity on the feature map. LISSOM demonstrates how self-organization can bootstrap based on input information only, without global supervision or predetermined lateral interaction. The model gives rise to a nontopographically organized lateral connectivity similar to that observed in the mammalian neocortex as illustrated by a LISSOM model of ocular dominance column formation in the primary visual cortex. In addition, LISSOM can potentially account for the development of multiple maps of different modalities on the same undifferentiated cortical architecture.
Similar content being viewed by others
References
Bourgeois JP, Jastreboff PJ, Rakic P (1989) Synaptogenesis in visual cortex of normal and preterm monkeys: evidence for intrinsic regulation of synaptic overproduction. Proc Natl Acad Sci USA 86:4297–4301
Burkhalter A, Bernardo KL, Charles V (1993) Development of local circuits in human visual cortex. J Neurosci 13:1916–1931
Callaway EM, Katz LC (1990) Emergence and refinement of clustered horizontal connections in cat striate cortex. J Neurosci 10:1134–1153
Callaway EM, Katz LC (1991) Effects of binocular deprivation on the development of clustered horizontal connections in cat striate cortex. Proc Natl Acad Sci USA 88:745–749
Fisken RA, Garey LJ, Powell TPS (1975) The intrinsic, association and commissural connections of area 17 of the visual cortex. Proc IEEE 61:268–278
Gilbert CD, Wiesel TN (1979) Morphology and intracortical projections of functionally identified neurons in cat visual cortex. Nature 280:120–125
Gilbert CD, Wiesel TN (1989) Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. J Neurosci 9:2432–2442
Gilbert CD, Hirsch JA, Wiesel TN (1990) Lateral interactions in visual cortex. Cold Spring Harb Symp Quant Biol 55:663–677
Goodhill G (1991) Topography and ocular dominance can arise from distributed patterns of activity. In: Proceedings of the international joint conference on neural networks, Seattle, Wash. IEEE, Piscataway, NJ
Gustafsson B, Wigström H (1988) Physiological mechanisms underlying long-term potentiation. Trends Neurosci 11:156–162
Hayes WP, Meyer RL (1988a) Optic synapse number but not density is constrained during regeneration onto surgically halved tectum in goldfish: HRP-EM evidence that optic fibers compete for fixed numbers of postsynaptic sites on the tectum. J Comput Neurol 274:539–559
Hayes WP, Meyer RL (1988b) Retinotopically inappropriate synapses of subnormal density formed by misdirected optic fibers in goldfish tectum. Dev Brain Res 38:304–312
Hebb DO (1949) The organization of behavior: a neuropsychological theory. Wiley, New York
Hubel DH, Wiesel TN (1965) Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. J Neurophysiol 28:229–289
Kandel ER, Schwartz JH, Jessel TM (1991) Principles of neural science, 3rd edn. Elsevier, New York
Katz LC, Callaway EM (1992) Development of local circuits in mammalian visual cortex. Ann Rev Neurosci 15:31–56
Kohonen T (1982a) Analysis of a simple self-organizing process. Biol Cybern 44:135–140
Kohonen T (1982b) Self-organized formation of topologically correct feature maps. Biol. Cybern 43:59–69
Kohonen T (1989) Self-organization and associative memory, 3rd edn. Springer, Berlin Heidelberg New York
Kohonen T (1990) The self-organizing map. Proc IEEE 78:1464–1480
Kohonen T (1993a) Things you haven't heard about the self-organizing map. In: Proceedings of the international conference on neural networks, San Francisco, CA. IEEE, Piscataway, NJ
Kohonen T (1993b) Physiological interpretation of the self-organizing map algorithm. Neural Networks 6:895–905
König P, Engel AK, Löwel S, Singer W (1993) Squint affects synchronization of oscillatory responses in cat visual cortex. Eur J Neurosci 5:501–508
Löwel S, Singer W (1992) Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity. Science 255:209–212
Luhmann HJ, Millan M, Singer W (1986) Development of horizontal intrinsic connections in cat striate cortex. Exp Brain Res 63:443–448
Madore BF, Freedman WL (1987) Self-organizing structures. Am Scientist 75:252–259
Malsburg C von der (1973) Self-organization of orientation-sensitive cells in the striate cortex. Kybernetik 15:85–100
Malsburg C von der (1990) Network self-organization. In: Zornetzer SF, Davis JL, Lau C (eds) An introduction to neural and electronic networks. Academic, San Mateo, pp 421–432
Malsburg C von der, Singer W (1988) Principles of cortical network organization. In: Rakic P, Singer W (eds) Neurobiology of neocortex. Wiley, New York, pp 69–99
McCasland JS, Bernardo KL, Probst KL, Woolsey TA (1992) Cortical local circuit axons do not mature after early deafferentation. Proc Natl Acad Sci USA 89:1832–1836
Merzenich MM, Kaas JH (1982) Reorganization of mammalian somatosensory cortex following peripheral nerve injury. Trends Neurosci 5:434–436
Merzenich MM, Nelson RJ, Stryker MP, Cynader MS, Schoppmann A, Zook JM (1984) Somatosensory cortical map changes following digit amputation in adult monkeys. J Comp Neurol 224:591–605
Miikkulainen R (1991) Self-organizing process based on lateral inhibition and synaptic resource redistribution. In: Proceedings of the international conference on artificial neural networks, Espoo, Finland. North-Holland, Amsterdam, pp 415–420
Miller KD (1992) Development of orientation columns via competition between onand off-center inputs. NeuroReport 3:73–76
Miller KD, MacKay DJC (1994) The role of constraints in hebbian learning. Neural Comput 6:98–124
Miller KD, Keller JB, Stryker MP (1989) Ocular dominance column development: analysis and simulation. Science 245:605–615
Mountcastle VB (1968) Neural mechanisms in somesthesia. In: Mountastle VB (ed) Medical physiology, Vol 2, 12th edn. Mosby, Saint Louis, pp 1372–1423
Murray M, Sharma S, Edwards MA (1982) Target regulation of synaptic number in the compressed retinotectal projection of goldfish. J Comput Neurol 209:374–385
Noorden GK von (1990) Binocular vision and ocular motility. Theory and management of strabismus. Mosby, Baltimore
Obermayer K, Ritter HJ, Schulten KJ (1990) A principle for the formation of the spatial structure of cortical feature maps. Proc Natl Acad Sci USA 87:8345–8349
Obermayer K, Blasdel GG, Schulten KJ (1992) Statistical-mechanical analysis of self-organization and pattern formation during the development of visual maps. Phys Rev A 45:7568–7589
Pallas SL, Finlay BL (1991) Compensation for population-size mismatches in the hamster retinotectal system: alterations in the organization of retinal projections. Visual Neurosci 6:271–281
Prigogine I, Stengers I (1984) Order out of chaos: man's new dialogue with nature. Random House, Boulder
Prince D, Huguenard J (1988) Functional properties of neocortical neurons. In: Rakic P, Singer W (eds) Neurobiology of neocortex. Wiley, New York, pp 153–176
Purves D (1988) Body and brain: a trophic theory of neural connections. Harvard University Press, Cambridge, Mass
Purves D, Lichtman JW (1985) Principles of neural development. Sinauer, Sunderland
Schwark H, Jones E (1989) The distribution of intrinsic cortical axons in area 3b of the cat primary somatosensory cortex. Exp Brain Res 78:501–513
Singer W, Gray C, Engel A, König P, Artola A, Bröcher S (1990) Formation of cortical cell assemblies. Cold Spring Harb Symp Quant Biol 55:939–952
Stryker M, Altaian J, Blakemore C, Gruel J, Kaas J, Merzenich M, Rakic P, Singer W, Stent G, Loos H van der, Wiesel T (1988) Group report. Principles of cortical self-organization. In: Rakic P, Singer W (eds) Neurobiology of neocortex. Wiley, New York, pp 115–136
Stryker M, Chapman B, Miller K, Zahs K (1990) Experimental and theoretical studies of the organization of afferents to single orientation columns in visual cortex. Cold Spring Harb Symp Quant Biol 55:515–527
Tanaka S (1990) A mathematical model for the self-organization of orientation columns in visual cortex. Neural Networks 3:625–640
Toyama K (1988) Functional connections of the visual cortex studied by cross-correlation techniques. In: Rakic P, Singer W. (eds) Neurobiology of neocortex. Wiley, New York, pp 203–217
White EL (1989) Cortical circuits: synaptic organization of the cerebral cortex structure, function, and theory. Birkhäuser, Boston
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Sirosh, J., Miikkulainen, R. Cooperative self-organization of afferent and lateral connections in cortical maps. Biol. Cybern. 71, 65–78 (1994). https://doi.org/10.1007/BF00198912
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00198912