Abstract
Participants respond more quickly to two simultaneously presented target stimuli of two different modalities (redundant targets) than would be predicted from their reaction times to the unimodal targets. To examine the neural correlates of this redundant-target effect, event-related potentials (ERPs) were recorded to auditory, visual, and bimodal standard and target stimuli presented at two locations (left and right of central fixation). Bimodal stimuli were combinations of two standards, two targets, or a standard and a target, presented either from the same or from different locations. Responses generally were faster for bimodal stimuli than for unimodal stimuli and were faster for spatially congruent than for spatially incongruent bimodal events. ERPs to spatially congruent and spatially incongruent bimodal stimuli started to differ over the parietal cortex as early as 160 msec after stimulus onset. The present study suggests that hearing and seeing interact at sensory-processing stages by matching spatial information across modalities.
Article PDF
Similar content being viewed by others
References
Bernstein, I. H., Clark, M. H., &Edelstein, B. A. (1969). Effects of an auditory signal on visual reaction time.Journal of Experimental Psychology,80, 567–569.
Carlson, S., Pertovaara, A., &Tanila, H. (1987). Late effects of early binocular visual deprivation on the function of Brodmann’s area 7 of monkeys.Developmental Brain Research,33, 101–111.
Cohen, A., &Shoup, R. (1997). Perceptual dimensional constraints on response selection processes.Cognitive Psychology,32, 128–181.
Corballis, M. C. (1998). Interhemispheric neural summation in the absence of the corpus callosum.Brain,121, 1795–1807.
Corballis, M. C. (2002). Hemispheric interactions in simple reaction time.Neuropsychologia,40, 423–434.
Diederich, A., &Colonius, H. (1987). Intersensory facilitation in the motor component: A reaction time analysis.Psychological Research,49, 23–29.
Feintuch, U., &Cohen, A. (2002). Visual attention and coactivation of response decisions for features from different dimensions.Psychological Science,13, 361–369.
Forster, B., Cavina-Pratesi, C., Aglioti, S. M., &Berlucchi, G. (2002). Redundant target effect and intersensory facilitation from visual—tactile interactions in simple reaction time.Experimental Brain Research,143, 480–487.
Fort, A., Delpuech, C., Pernier, J., &Giard, M.-H. (2002). Early auditory—visual interactions in human cortex during nonredundant target identification.Cognitive Brain Research,14, 20–30.
Foxe, J. J., Morocz, I. A., Murray, M. M., Higgins, B. A., Javitt, D.C., &Schroeder, C. E. (2000). Multisensory auditory—somatosensory interactions in early cortical processing revealed by high-density electrical mapping.Cognitive Brain Research,10, 77–83.
Giard, M. H., &Peronnet, F. (1999). Auditory—visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study.Journal of Cognitive Neuroscience,11, 473–490.
Giray, M., &Ulrich, R. (1993). Motor coactivation revealed by response force in divided and focused attention.Journal of Experimental Psychology: Human Perception & Performance,19, 1278–1291.
Gondan, M., Lange, K., Rösler, F., &Röder, B. (2004). The redundant target effect is affected by modality switch costs.Psychonomic Bulletin & Review,11, 307–313.
Harrington, L. K., &Peck, C. K. (1998). Spatial disparity affects visual—auditory interactions in human sensorimotor processing.Experimental Brain Research,122, 247–252.
Hershenson, M. (1962). Reaction time as a measure of intersensory facilitation.Journal of Experimental Psychology,63, 289–293.
Hughes, H. C., Reuter-Lorenz, P. A., Nozawa, G., &Fendrich, R. (1994). Visual—auditory interactions in sensorimotor processing: Saccades versus manual responses.Journal of Experimental Psychology: Human Perception & Performance,20, 131–153.
Huynh, H., &Feldt, L. S. (1976). Estimation of the Box correction for degrees of freedom from sample data in randomized block and splitplot designs.Journal of Educational Statistics,1, 69–82.
Lütkenhöner, B., Lammertmann, C., Simões, C., &Hari, R. (2002). Magnetoencephalographic correlates of audiotactile interaction.NeuroImage,15, 509–522.
Macaluso, E., &Driver, J. (2001). Spatial attention and crossmodal interactions between vision and touch.Neuropsychologia,39, 1304–1316.
Mazzoni, P., Bracewell, R. M., Barash, S., &Andersen, R. A. (1996). Spatially tuned auditory responses in area LIP of macaques performing delayed memory saccades to acoustic targets.Journal of Neurophysiology,75, 1233–1242.
Meredith, M. A., &Stein, B. E. (1987). Spatial factors determine the activity of multi-sensory neurons in the cat’s superior colliculus.Brain Research,420, 162–166.
Miller, J. (1982). Divided attention: Evidence for coactivation with redundant signals.Cognitive Psychology,14, 247–279.
Miller, J. (1986). Timecourse of coactivation in bimodal divided attention.Perception & Psychophysics,40, 331–343.
Miller, J. (1991). Channel interaction and the redundant-target effect in bimodal divided attention.Journal of Experimental Psychology: Human Perception & Performance,17, 160–169.
Miller, J., Ulrich, R., &Lamarre, Y. (2001). Locus of the redundantsignals effect in bimodal divided attention: A neurophysiological analysis.Perception & Psychophysics,63, 555–562.
Miniussi, C., Girelli, M., &Marzi, C. A. (1998). Neural site of the redundant target effect: Electrophysiological evidence.Journal of Cognitive Neuroscience,10, 216–230.
Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., &Foxe, J. J. (2002). Multisensory auditory—visual interactions during early sensory processing in humans: A high-density electrical mapping study.Cognitive Brain Research,14, 115–128.
Mordkoff, J. T., Miller, J., &Roch, A.-C. (1996). Absence of coactivation in the motor component: Evidence from psychophysiological measures of target detection.Journal of Experimental Psychology: Human Perception & Performance,22,25–411.
Mordkoff, J. T., &Yantis, S. (1991). An interactive race model of divided attention.Journal of Experimental Psychology: Human Perception & Performance,17,520–5388.
Nickerson, R. S. (1973). Intersensory facilitation of reaction time: Energy summation or preparation enhancement?Psychological Review,80, 489–509.
Plat, F. M., Praamstra, P., &Horstink, M. W. I. M. (2000). Redundantsignals effects on reaction time, response force, and movementrelated potentials in Parkinson’s disease.Experimental Brain Research,130, 533–539.
Poffenberger, A. T. (1912). Reaction time to retinal stimulation with special reference to the time lost in conduction through nerve centers.Archives of Psychology,23, 1–73.
Posner, M. I. (1978).Chronometric exploration of mind. Hillsdale, NJ: Erlbaum.
Raab, D. H. (1962). Statistical facilitation of simple reaction times.Transactions of the New York Academy of Sciences,24, 574–590.
Reuter-Lorenz, P. A., Nozawa, G., Gazzaniga, M. S., &Hughes, H. C. (1995). Fate of neglected targets: A chronometric analysis of redundant target effects in the bisected brain.Journal of Experimental Psychology: Human Perception & Performance,21, 221–230.
Roser, M., &Corballis, M. C. (2002). Interhemispheric neural summation in the split brain with symmetrical and asymmetrical displays.Neuropsychologia,40, 1300–1312.
Schröger, E., &Widmann, A. (1998). Speeded responses to audiovisual changes result from bimodal integration.Psychophysiology,35, 755–759.
Stein, B. E. (1998). Neural mechanisms for synthesizing sensory information and producing adaptive behaviors.Experimental Brain Research,123, 124–135.
Stein, B. E., &Meredith, M. A. (1993).The merging of the senses. Cambridge, MA: MIT Press.
Teder-Sälejärvi, W. A., McDonald, J. J., di Russo, F. D., &Hillyard, S. A. (2002). An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings.Cognitive Brain Research,14,106–1144.
Wallace, M. T., Meredith, M. A., &Stein, B. E. (1992). Integration of multiple sensory modalities in cat cortex.Experimental Brain Research,91, 484–488.
Welch, R. B., &Warren, D. H. (1986). Intersensory interactions. In K. R. Boff, L. Kaufman, & J. P. Thomas (Eds.),Handbook of perception and human performance (pp. 25/1–25/36). New York: Wiley.
Author information
Authors and Affiliations
Corresponding author
Additional information
This study was supported by Grants Ro 1226/4-1 and 4-2 to B.R. from the German Research Foundation (DFG).
Rights and permissions
About this article
Cite this article
Gondan, M., Niederhaus, B., Rösler, F. et al. Multisensory processing in the redundant-target effect: A behavioral and event-related potential study. Perception & Psychophysics 67, 713–726 (2005). https://doi.org/10.3758/BF03193527
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03193527