Regular article
Entropy driven Artificial Neuronal Networks and sensorial representation: A proposal

https://doi.org/10.1016/0743-7315(89)90062-2Get rights and content

Abstract

A hierarchical Artificial Neuronal Network (ANN) is proposed as a model sensorium wherein feedback is allowed to modify the categorization abilities of the system. In this way, the original representation, being abstract and precategorical, is refined, yielding a more concrete representation. As thermodynamical entropy is a hierarchical invariant and an explicitly time dependent and compact measure of state dynamics, it is chosen as feedback measure. The main features of the network are shown to be plausible from the point of view of the physiology and anatomy of the visual system of cats and primates and one of these, double-layered maps performing combinatorial processing and evaluation, respectively, is illustrated by simulations in the orientation domain.

References (89)

  • J.M. Allman et al.

    A representation of the visual field in the caudal third of the middle temporal gyrus of the owl monkey (Aotus trivirgatus)

    Brain Res.

    (1971)
  • S. Amari

    Dynamics of pattern formation in lateral-inhibition type neural fields

    Biol. Cybernet.

    (1977)
  • S. Amari

    Field theory of self-organizing neural nets

    IEEE Trans. Systems Man Cybernet

    (Sept./Oct. 1983)
  • S. Amari et al.

    Competition and cooperation in neural nets

  • J.A. Anderson

    Cognitive and psychological computation with neural models

    IEEE Trans. Systems Man Cybernet.

    (Sept./Oct. 1983)
  • M.A. Arbib

    Segmentation, schemas and cooperative computation

  • E. Bienenstock

    Connectionist approaches to vision

  • G.A. Carpenter et al.

    A massively parallel architecture for a self-organizing neural pattern recognition machine

    Comput. Vision Graphics Image Process.

    (1987)
  • M.A. Cohen et al.

    Absolute stability of global pattern formation and parallel memory storage by competitive neural networks

    IEEE Trans. Systems Man Cybernet.

    (Sept./Oct. 1983)
  • L.N. Cooper et al.
  • O. Creutzfeldt

    Inevitable deadlocks of the brain-mind discussion

  • J.G. Daugman

    Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression

    IEEE Trans. Acoust. Speech Signal Process.

    (1988)
  • S.R. De Groot et al.

    Non-equilibrium Thermodynamics

    (1984)
  • P. Dev

    Perception of depth surfaces in random-dot stereograms: A neural model

    Internal. J. Man-Machine Stud.

    (1975)
  • P. Érdi

    Hierarchical thermodynamic approach to the brain

    Internal. J. Neurosci.

    (1983)
  • P. Érdi

    From brain theory to future generations computer systems

  • R.P. Erickson

    The across-fiber pattern theory: An organizing principle for molon neural function

    Control. Sen. Physiol.

    (1982)
  • J.A. Feldman et al.

    Connectionist models and their properties

    Cognitive Sci.

    (1982)
  • K. Fukushima

    A hierarchical neural network model for associative memory

    Biol. Cybernet.

    (1984)
  • K. Fukushima

    A neural network model for selective attention in visual pattern recognition

    Biol. Cybernet.

    (1986)
  • S. Geman

    Some averaging and stability results for random differential equations

    SIAM J. Appl. Math.

    (1979)
  • S. Geman et al.

    Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images

    IEEE Trans. Pattern Anal. and Mach. Intell.

    (1984)
  • P. Glansdorf et al.

    Thermodynamic Theory of Structure, Stability and Fluctuations

    (1971)
  • S. Grossberg

    The Adaptive Brain I: Cognition, Learning, Reinforcement, and Rhythm and The Adaptive Brain H: Vision, Speech, Language, and Motor Control

    (1986)
  • S. Grossberg

    Cortical dynamics of three-dimensional form, color, and brightness perception. I. Monocular theory

    Perception Psychophys

    (1987)
  • H. Haken

    Synergetics. Are cooperative phenomena governed by universal principles?

    Naturwissenschaften

    (1980)
  • E. Harth et al.

    The inversion of sensory processing by feedback pathways: A model of visual cognitive functions

    Science

    (1987)
  • D.O. Hebb

    The Organization of Behavior

    (1949)
  • G.E. Hinton et al.

    Distributed representations

  • J.J. Hopfield

    Neural networks and physical systems with emergent collective computational abilities

  • J.J. Hopfield

    Neurons with graded response have collective computational properties like those of two-state neurons

  • J.J. Hopfield et al.

    “Neural” computation of decisions in optimization problems

    Biol. Cybernet.

    (1985)
  • D.H. Hubel et al.

    Receptive fields of single neurons in the cat's striate cortex

    J Physiol. (London)

    (1959)
  • L.C. Katz

    Local circuitry of identified projection neurons in cat visual cortex brain slices

    J. Neurosci.

    (1987)
  • C. Koch et al.

    Analog “neuronal” networks in early vision

  • C. Koch et al.

    The synaptic veto mechanism: Does it underlie direction and orientation selectivity in the visual cortex?

  • C. Koch et al.

    Shifts in selective visual attention: Towards the underlying neural circuitry

    Human Neurobiol.

    (1985)
  • J.J. Koenderink

    Simultaneous order in nervous nets from a functional standpoint

    Biol. Cybernet.

    (1984)
  • J.J. Koenderink

    The concept of local sign

  • T. Kohonen

    Self-Organization and Associative Memory

    (1984)
  • T. Kohonen et al.

    Storage and processing of information in distributed associative memory systems

  • B. Kosko

    Adaptive bidirectional associative memories

    Appl. Opt.

    (1987)
  • R. Linsker

    From basic network principles to neural architecture: Emergence of spatial-opponent cells

  • J.L. Marroquin

    Surface reconstruction preserving discontinuities

    A. I. Memo 792

    (1984)

    • Cited by (8)

    • A modular artificial neural network for texture processing

      1993, Neural Networks

    • Responses of visual cortical neurons to curved stimuli and chevrons

      1990, Vision Research

    • A brief survey of dimension reduction

      2018, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    • Psychoneural isomorphism: Historical background and current relevance

      1994, Philosophical Psychology

    • Spatial and temporal coherence in cortico-cortical connections: A cross-correlation study in areas 17 and 18 in the cat

      1992, Visual Neuroscience

    • DISTINGUISHING LINE DETECTION FROM TEXTURE SEGREGATION USING A MODULAR NETWORK-BASED MODEL

      1992, Proceedings of the International Joint Conference on Neural Networks
    View all citing articles on Scopus
    View full text
    Copyright © 1989 Published by Elsevier Inc.