Saliency affects feedforward more than feedback processing in early visual cortex
Introduction
It has been known for nearly a century that early visual cortex is crucial for vision in humans, with lesions to this region producing stereotypical visual field deficits (Holmes, 1918). Furthermore, neurons within areas V1 and V2 in early visual cortex have been shown to produce highly specific and consistent responses to visual information, such as edges and orientations, even in anesthetized animals (Hubel and Wiesel, 1968, Livingstone and Hubel, 1988). Based on these long-standing observations, it had originally been assumed that visual information processing in V1/V2 proceeds automatically and independently from bottom-up and top-down factors, such as stimulus feature saliency (differences in hue, size, etc.) and attentional set (attention to certain features, locations, temporal intervals, sensory modalities, etc.).
However, several studies have shown that V1/V2 does not only serve as a passive relay of information to higher-order areas, but instead amplifies responses to salient bottom-up information (Li, 1999, Li et al., 2006), is involved beyond the initial stages of visual information processing via feedback loops (Lamme & Roelfsema, 2000), and is influenced by top-down factors such as attention (Motter, 1993, Somers et al., 1999) and task (Huk & Heeger, 2000). The time course of these bottom-up and top-down influences, nevertheless, remains unclear. For example, some evidence suggests that bottom-up factors, such as saliency, should influence processing in V1 at early temporal intervals (for a review see Theeuwes, 2010), whereas top-down factors, such as attentional set, should affect later processing. Other evidence, however, suggests that attention may influence early neuronal responses in V1 (Ito & Gilbert, 1999) and that saliency maps are generated in the posterior parietal cortex after initial processing (Gottlieb, Kusunoki, & Goldberg 1998; but see Zhang, Zhaoping, Zhou, & Fang 2012).
In the current study we manipulated bottom-up feature saliency as well as top-down attentional set to investigate how these variables affect early visual cortex activity at different time intervals. We applied TMS over V1/V2 at varying temporal intervals after stimulus onset to assess whether the magnitude of visual suppression (Amassian et al., 1989, Kammer, 2007) was affected by saliency and attentional set. If bottom-up saliency differences influence processing in V1/V2 only at early temporal intervals, then we should find that TMS at early temporal intervals produces different magnitudes of suppression based on stimulus feature saliency, regardless of attentional set. Furthermore, if top-down attentional set differences influence processing in V1/V2 only at later temporal intervals, then we should find that TMS at later temporal intervals produces different magnitudes of suppression based on attentional set, regardless of feature saliency differences.
Section snippets
Experiment 1
In Experiment 1, we compared the magnitude of visual suppression while subjects performed an orientation or a color discrimination task on stimuli that varied in saliency. According to a standard definition, saliency depends on the bottom-up distinctiveness of a physical stimulus relative to its surround (Fecteau, Chua, Franks, & Enns, 2001). In our experiment, saliency was manipulated by changing the distinctiveness of the color of a single line relative to the color of the background. More
Experiment 2
In Experiment 2 we tested the possibility that the saliency effect we observed in Experiment 1 was due to an inherent processing advantage of red over other hues, as opposed to just the color contrast with the green-dominated surround. Several studies point to a possible advantage of the color red. For example red hues receive priority in visual search (Lindsey, Brown, Reijnen, Rich, Kuzmova, & Wolfe, 2010), have reduced inattentional blindness (Mack & Rock, 1998), and show decreased masking (
Discussion
In the current study, we used TMS to examine bottom-up (color saliency) and top-down (attentional set) influences on processing in early visual cortex. The results show that color saliency influences the magnitude of TMS-induced visual suppression regardless of whether or not subjects attended to the color dimension.
Importantly, saliency effects were more prominent during early compared to later intervals of stimulation, suggesting differential representations of visual information at the early
Acknowledgments
This research was supported by NSF Grants BCS 0843148 and EFRI 1137172 to TR. The authors declare no competing financial interests.
References (44)
- et al.
Suppression of visual perception by magnetic coil stimulation of human occipital cortex
Electroencephalography and clinical neurophysiology
(1989) - et al.
Effects of isoluminant-background color on metacontrast and stroboscopic motion: interactions between sustained (P) and transient (M) channels
Vision research
(1990) - et al.
Attention modulates contextual influences in the primary visual cortex of alert monkeys
Neuron
(1999) - et al.
The role of early visual cortex (V1/V2) in conscious and unconscious visual perception
Neuroimage
(2010) - et al.
The distinct modes of vision offered by feedforward and recurrent processing
Trends in neurosciences
(2000) - et al.
Contour saliency in primary visual cortex
Neuron
(2006) - et al.
Feedback contributions to visual awareness in human occipital cortex
Current biology
(2003) - et al.
Peripheral chromatic sensitivity for flashes: a post-receptoral red-green asymmetry
Vision research
(1992) Top-down and bottom-up control of visual selection
Acta psychologica (Amst)
(2010)- et al.
Neural activities in v1 create a bottom-up saliency map
Neuron
(2012)
Impairment of visual perception and visual short term memory scanning by transcranial magnetic stimulation of occipital cortex. Experimental brain research
Experimentelle Hirnforschung. Experimentation cerebrale
Visual feature binding requires reentry
Psychological science
Unconscious processing of orientation and color without primary visual cortex
Proceedings of the national academy of sciences USA
Unconscious color priming occurs at stimulus – not percept – dependent levels of processing
Psychological science
Statistical processing: not so implausible after all
Perception and psychophysics
Competition for consciousness among visual events: the psychophysics of reentrant visual processes
Journal of experimental psychology general
Visual awareness and the on-line modification of action
Canadian journal of experimental psychology
Influence of stimulus color on the control of reaching-grasping movements
Experimental brain research
The representation of visual salience in monkey parietal cortex
Nature
Retinotopy and color sensitivity in human visual cortical area V8
Nature neuroscience
Electrophysiological evidence of the capture of visual attention
Journal of cognitive neuroscience
Disturbances of Vision by Cerebral Lesions
British journal of ophthalmology
Cited by (4)
Extending Levelt's Propositions to perceptual multistability involving interocular grouping
2017, Vision ResearchCitation Excerpt :A similar trend held for achromatic contrast (See Methods). However, it has been reported that in several contexts the color red tends to be more salient than green (Emmanouil, Avigan, Persuh, & Ro, 2013; Lindsey et al., 2010; Stromeyer & Eskew., 1992). Red images may promote a strong top-down attentional signal from higher order areas processing object color (Hadjikhani, Liu, Dale, Cavanagh, & Tootell, 1998).
The chronometry of visual perception: Review of occipital TMS masking studies
2014, Neuroscience and Biobehavioral ReviewsCitation Excerpt :But soon after this, local recurrent activity within EVC and between EVC and extrastriate areas commences, in the second part of the classical masking dip (i.e. ∼100 ms to ∼130 ms), potentially determining the contents of visual awareness (Koivisto et al., 2011b) and potentially susceptible to attentional/task demands (de Graaf et al., 2012). The involvement of feedforward activity in the early part and recurrent processing in the late part of the masking curve is supported also by the study of Emmanouil et al. (2013) who found that bottom–up (saliency) and top–down (attentional set) factors influenced differently the early and late parts of the masking curve that resembled the classical masking dip. In addition, the TMS studies (Koivisto et al., 2010, 2012, 2014; Silvanto et al., 2005b) which have stimulated EVC and higher cortical areas across SOAs during the same task have shown that the higher areas start to play a functional role around 90 ms after stimulus-onset, that is, in the middle of the classical dip.
Visual Masking: Studying Perception, Attention, and Consciousness
2013, Visual Masking: Studying Perception, Attention, and Consciousness