Elsevier

Neuropsychologia

Volume 51, Issue 8, July 2013, Pages 1497-1503
Neuropsychologia

Saliency affects feedforward more than feedback processing in early visual cortex

https://doi.org/10.1016/j.neuropsychologia.2013.04.013Get rights and content

Highlights

  • Saliency affects visual suppression at feedforward more than feedback processing stages in early visual cortex.

  • Red is inherently more salient than other hues regardless of luminance and saturation.

  • Task discrimination difficulty does not affect TMS-induced visual suppression.

Abstract

Early visual cortex activity is influenced by both bottom-up and top-down factors. To investigate the influences of bottom-up (saliency) and top-down (task) factors on different stages of visual processing, we used transcranial magnetic stimulation (TMS) of areas V1/V2 to induce visual suppression at varying temporal intervals. Subjects were asked to detect and discriminate the color or the orientation of briefly-presented small lines that varied on color saliency based on color contrast with the surround. Regardless of task, color saliency modulated the magnitude of TMS-induced visual suppression, especially at earlier temporal processing intervals that reflect the feedforward stage of visual processing in V1/V2. In a second experiment we found that our color saliency effects were also influenced by an inherent advantage of the color red relative to other hues and that color discrimination difficulty did not affect visual suppression. These results support the notion that early visual processing is stimulus driven and that feedforward and feedback processing encode different types of information about visual scenes. They further suggest that certain hues can be prioritized over others within our visual systems by being more robustly represented during early temporal processing intervals.

Introduction

It has been known for nearly a century that early visual cortex is crucial for vision in humans, with lesions to this region producing stereotypical visual field deficits (Holmes, 1918). Furthermore, neurons within areas V1 and V2 in early visual cortex have been shown to produce highly specific and consistent responses to visual information, such as edges and orientations, even in anesthetized animals (Hubel and Wiesel, 1968, Livingstone and Hubel, 1988). Based on these long-standing observations, it had originally been assumed that visual information processing in V1/V2 proceeds automatically and independently from bottom-up and top-down factors, such as stimulus feature saliency (differences in hue, size, etc.) and attentional set (attention to certain features, locations, temporal intervals, sensory modalities, etc.).

However, several studies have shown that V1/V2 does not only serve as a passive relay of information to higher-order areas, but instead amplifies responses to salient bottom-up information (Li, 1999, Li et al., 2006), is involved beyond the initial stages of visual information processing via feedback loops (Lamme & Roelfsema, 2000), and is influenced by top-down factors such as attention (Motter, 1993, Somers et al., 1999) and task (Huk & Heeger, 2000). The time course of these bottom-up and top-down influences, nevertheless, remains unclear. For example, some evidence suggests that bottom-up factors, such as saliency, should influence processing in V1 at early temporal intervals (for a review see Theeuwes, 2010), whereas top-down factors, such as attentional set, should affect later processing. Other evidence, however, suggests that attention may influence early neuronal responses in V1 (Ito & Gilbert, 1999) and that saliency maps are generated in the posterior parietal cortex after initial processing (Gottlieb, Kusunoki, & Goldberg 1998; but see Zhang, Zhaoping, Zhou, & Fang 2012).

In the current study we manipulated bottom-up feature saliency as well as top-down attentional set to investigate how these variables affect early visual cortex activity at different time intervals. We applied TMS over V1/V2 at varying temporal intervals after stimulus onset to assess whether the magnitude of visual suppression (Amassian et al., 1989, Kammer, 2007) was affected by saliency and attentional set. If bottom-up saliency differences influence processing in V1/V2 only at early temporal intervals, then we should find that TMS at early temporal intervals produces different magnitudes of suppression based on stimulus feature saliency, regardless of attentional set. Furthermore, if top-down attentional set differences influence processing in V1/V2 only at later temporal intervals, then we should find that TMS at later temporal intervals produces different magnitudes of suppression based on attentional set, regardless of feature saliency differences.

Section snippets

Experiment 1

In Experiment 1, we compared the magnitude of visual suppression while subjects performed an orientation or a color discrimination task on stimuli that varied in saliency. According to a standard definition, saliency depends on the bottom-up distinctiveness of a physical stimulus relative to its surround (Fecteau, Chua, Franks, & Enns, 2001). In our experiment, saliency was manipulated by changing the distinctiveness of the color of a single line relative to the color of the background. More

Experiment 2

In Experiment 2 we tested the possibility that the saliency effect we observed in Experiment 1 was due to an inherent processing advantage of red over other hues, as opposed to just the color contrast with the green-dominated surround. Several studies point to a possible advantage of the color red. For example red hues receive priority in visual search (Lindsey, Brown, Reijnen, Rich, Kuzmova, & Wolfe, 2010), have reduced inattentional blindness (Mack & Rock, 1998), and show decreased masking (

Discussion

In the current study, we used TMS to examine bottom-up (color saliency) and top-down (attentional set) influences on processing in early visual cortex. The results show that color saliency influences the magnitude of TMS-induced visual suppression regardless of whether or not subjects attended to the color dimension.

Importantly, saliency effects were more prominent during early compared to later intervals of stimulation, suggesting differential representations of visual information at the early

Acknowledgments

This research was supported by NSF Grants BCS 0843148 and EFRI 1137172 to TR. The authors declare no competing financial interests.

References (44)

  • G. Beckers et al.

    Impairment of visual perception and visual short term memory scanning by transcranial magnetic stimulation of occipital cortex. Experimental brain research

    Experimentelle Hirnforschung. Experimentation cerebrale

    (1991)
  • S. Bouvier et al.

    Visual feature binding requires reentry

    Psychological science

    (2010)
  • J.L. Boyer et al.

    Unconscious processing of orientation and color without primary visual cortex

    Proceedings of the national academy of sciences USA

    (2005)
  • B.G. Breitmeyer et al.

    Unconscious color priming occurs at stimulus – not percept – dependent levels of processing

    Psychological science

    (2004)
  • S.C. Chong et al.

    Statistical processing: not so implausible after all

    Perception and psychophysics

    (2008)
  • V. Di Lollo et al.

    Competition for consciousness among visual events: the psychophysics of reentrant visual processes

    Journal of experimental psychology general

    (2000)
  • J.H. Fecteau et al.

    Visual awareness and the on-line modification of action

    Canadian journal of experimental psychology

    (2001)
  • M. Gentilucci et al.

    Influence of stimulus color on the control of reaching-grasping movements

    Experimental brain research

    (2001)
  • J.P. Gottlieb et al.

    The representation of visual salience in monkey parietal cortex

    Nature

    (1998)
  • N. Hadjikhani et al.

    Retinotopy and color sensitivity in human visual cortical area V8

    Nature neuroscience

    (1998)
  • C. Hickey et al.

    Electrophysiological evidence of the capture of visual attention

    Journal of cognitive neuroscience

    (2006)
  • G. Holmes

    Disturbances of Vision by Cerebral Lesions

    British journal of ophthalmology

    (1918)
  • Cited by (4)

    • Extending Levelt's Propositions to perceptual multistability involving interocular grouping

      2017, Vision Research
      Citation Excerpt :

      A similar trend held for achromatic contrast (See Methods). However, it has been reported that in several contexts the color red tends to be more salient than green (Emmanouil, Avigan, Persuh, & Ro, 2013; Lindsey et al., 2010; Stromeyer & Eskew., 1992). Red images may promote a strong top-down attentional signal from higher order areas processing object color (Hadjikhani, Liu, Dale, Cavanagh, & Tootell, 1998).

    • The chronometry of visual perception: Review of occipital TMS masking studies

      2014, Neuroscience and Biobehavioral Reviews
      Citation Excerpt :

      But soon after this, local recurrent activity within EVC and between EVC and extrastriate areas commences, in the second part of the classical masking dip (i.e. ∼100 ms to ∼130 ms), potentially determining the contents of visual awareness (Koivisto et al., 2011b) and potentially susceptible to attentional/task demands (de Graaf et al., 2012). The involvement of feedforward activity in the early part and recurrent processing in the late part of the masking curve is supported also by the study of Emmanouil et al. (2013) who found that bottom–up (saliency) and top–down (attentional set) factors influenced differently the early and late parts of the masking curve that resembled the classical masking dip. In addition, the TMS studies (Koivisto et al., 2010, 2012, 2014; Silvanto et al., 2005b) which have stimulated EVC and higher cortical areas across SOAs during the same task have shown that the higher areas start to play a functional role around 90 ms after stimulus-onset, that is, in the middle of the classical dip.

    • Visual Masking: Studying Perception, Attention, and Consciousness

      2013, Visual Masking: Studying Perception, Attention, and Consciousness
    View full text