ReviewA comparison of neural responses to appetitive and aversive stimuli in humans and other mammals
Introduction
The ongoing ability of an organism to appropriately evaluate its environment is essential to both its well-being and continued survival. The evaluation process requires the dynamic assessment of many positive and negative stimuli within the organism's external and internal environments. Appetitive and aversive stimuli are salient, valenced (i.e. positive and negative), stimuli which typically lead to the opposing behaviours of approach and avoidance, respectively. This type of value-related processing in humans and other mammals reflects the activity of aversion- and appetitive-related brain networks (Hayes and Northoff, 2011, McBride et al., 1999, O’Doherty, 2004). As both potentially rewarding and punishing stimuli are often present simultaneously, appetitive- and aversion-related circuits must interact in some way in order to share and compare information about the combined value of such stimuli which ultimately contribute to a behavioural outcome. Despite much work on each circuit separately, it is not clear to what degree they function independently and/or whether they share the bulk of their circuitry.
While ‘rewards’ are often used synonymously with ‘appetitive stimuli’, we have chosen to use the terms appetitive and aversive here as constructs reflecting the value of stimuli which lead to approach and avoidance (Madan, 2013). These constructs are therefore independent of reinforcement per se which reflect changes in the rate of responding to stimuli, although it is acknowledged that in practice these concepts are difficult to disentangle. As such, we have focused on studies which aim to investigate the brain's responses to appetitive and aversive stimuli, independent of hedonia, reinforcement or motivated learning per se. Although this valuative processing may be analogously tied to subjective hedonic states, this issue is not the focus of the current work and it is not assumed that these stimuli are necessarily considered either pleasant or unpleasant (Berridge and Robinson, 1998, Berridge and Robinson, 2003). Our focus here is on studies which use appetitive or aversive stimuli which are known to produce positive or negative psychological and physical states in the organism. These states map roughly to what has been previously termed as ‘primal’ or ‘core’ affect in both humans and animals (Barrett et al., 2007, Panksepp, 2011).
Although there are classical neuropsychological accounts of these processes interacting (Cabanac, 1971, Solomon and Corbit, 1974), most studies to date have focused on appetitive- or aversion-related processing in isolation. For instance, appetitive research has largely focused on the function of the mesocorticolimbic dopamine system. Dopaminergic projections from the ventral tegmental area (VTA) to the nucleus accumbens/ventral striatum (NAc/VS) and prefrontal cortex have been implicated in many processes such as in the learning, anticipation, and reception of rewards in both animals and, more recently, in humans (O’Doherty, 2004, Pappata et al., 2002, Wise, 2004). Alternately, aversion-related studies have focused largely on the brain circuitry associated with the processing of fearful conditioned and unconditioned stimuli. In particular, amygdalar circuitry is well understood from this perspective (LeDoux, 1998). However, continually-mounting evidence has shown that many of these classical aversion- or appetitive-related brain regions also process information related to the opposite valence. For instance, an increasing number of studies are revealing the precise mechanisms by which the mesocorticolimbic circuit and amygdala play fundamental roles in processing both aversion- and appetitive-related information (Baxter and Murray, 2002, McCutcheon et al., 2012). However, the idea that components of the mesocorticolimbic system are involved in processing aversive information has been greatly overshadowed by those focused on reward- or appetitive-related processes, as first noted by studies conducted over twenty years ago (e.g. Salamone, 1994). Nonetheless, the question of whether these processes use many similar brain circuits, and what kinds of mechanisms might be involved, is still under intense investigation.
The aim of this paper is to summarize and compare the available data characterizing the brain networks of aversion- and appetitive-related processing across humans and other mammals. We investigate the available human neuroimaging data as well as the primate and rodent data to help sketch the relationship between these two brain networks at the macroscopic and mesoscopic levels. We address the question of how selected components of these networks might allow for the interaction of aversion- and appetitive-related processing and whether these relationships appear consistent across species.
We began by performing a meta-analysis of human neuroimaging studies to identify regions which appear independent or shared in aversion- and appetitive-related processing in humans. We used the results from this analysis to guide a targeted review of animal data. Beyond a primary interest in human brain function, starting with the human data allowed for a focus on passively activated neural responses to valuative stimuli – as most animal studies involve active responses to such stimuli. Measures in animals typically lack subjective assessments of value and almost always involve behaviours which can complicate the interpretation of findings (e.g. which neural responses are related to value processing alone, and which to motor-related activity). Subcortical and cortical regions in humans were subsequently identified and selected for further exploration in animals: appetitive-selective (ventral tegmental area, VTA; medial prefrontal cortex, mPFC), aversion-selective (periaqueductal grey, PAG; motor-related cluster containing the posterior midcingulate, pMCC; premotor, and posterior cingulate cortices, PCC), overlapping regions (amygdala; anterior insula, AI), and regions showing asymmetrical (i.e. apparently lateralized) activity (nucleus accumbens/ventral striatum, NAc/VS; lateral orbitofrontal cortex, lOFC). We then looked at animal studies which included both appetitive and aversive stimuli to investigate the mechanisms of valuative processing within the selected regions. When considered together, we believe these findings help better contextualize results in these fields.
Section snippets
Methods (humans)
The meta-analysis dataset in humans was made up of 34 aversion- and 38 appetitive-related functional magnetic resonance imaging (fMRI) and positron emission tomography (PET) studies (including 44 and 52 contrasts, respectively). The aversion-related meta-analysis data were published previously (Hayes and Northoff, 2011) in which the inclusion/exclusion criteria are described in detail. Included articles were published from 2000 to August 2011, and the selection criteria were consistent for all
Discussion
The meta-analysis of human neuroimaging studies on the passive perception of appetitive and aversive stimuli revealed a number of functionally shared brain regions (i.e. overlapping regions noted in green in Fig. 1) as well as regions which appeared to be selective for appetitive (red) or aversive (blue) processing. Selected cortical and subcortical regions from each category were selected based on criteria described above. Regions of overlapping activity included the anterior insula (AI) and
Conclusion
Taken together, these results help to integrate a broad range of findings and support the notion that differential spatiotemporal network dynamics may, in part, help explain similarities and differences in valuative activity – at least when considering the eight regions included here (i.e. AI, amygdala, motor-related cortex, PAG, VMPFC, VTA, lOFC, NAc/VS). They also underscore the need to consider non-human animal studies for a clearer interpretation of human data, and vice versa. These results
Acknowledgements
We would like to thank Christina Zhang for her assistance in gathering some of the articles used here. The work was supported by grants to GN from the Canadian Institutes of Health Research (CIHR), the Michael Smith Foundation for Health Research (EJL-94190), and Hope for Depression Research Foundation (HDRF/ISAN). DJH was funded through a CIHR Postdoctoral Fellowship.
References (187)
- et al.
The anterior cingulate cortex is a target structure for the anxiolytic-like effects of benzodiazepines assessed by repeated exposure to the elevated plus maze and Fos immunoreactivity
Neuroscience
(2009) - et al.
Conditioned and unconditioned aversive stimuli enhance light-induced fos expression in the primary visual cortex
Neuroscience
(1999) - et al.
Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats
Neuroscience
(2009) - et al.
Reward modulates the neural dynamics of early visual category processing
Neuroimage
(2012) Circuitry and functional aspects of the insular lobe in primates including humans
Brain Res. Brain Res. Rev.
(1996)- et al.
Hemispheric asymmetry in behavioral response to D1 and D2 receptor agonists in the nucleus accumbens
Brain Res.
(1990) - et al.
Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala
Neuron
(2007) - et al.
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Brain Res. Brain Res. Rev.
(1998) - et al.
Parsing reward
Trends Neurosci.
(2003) - et al.
Asymmetrical involvement of mesolimbic dopaminergic neurons in affective perception
Neuroscience
(1995)
Reward-aversion circuitry in analgesia and pain: implications for psychiatric disorders
Eur. J. Pain
Dopamine in motivational control: rewarding, aversive, and alerting
Neuron
Coding in the mammalian gustatory system
Trends Neurosci.
Biological substrates of reward and aversion: a nucleus accumbens activity hypothesis
Neuropharmacology
Brain activation patterns during classical conditioning with appetitive or aversive UCS
Behav. Brain Res.
Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates
Neurosci. Biobehav. Rev.
Prenatal stress increases anxiety related behavior and alters cerebral lateralization of dopamine activity
Life Sci.
A multivariate approach to aggression and the orbital frontal cortex in psychiatric patients
Psychiatry Res.
An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit
Behav. Brain Res.
Complementary roles for the amygdala and hippocampus during different phases of appetitive information processing
Neurobiol. Learn. Mem.
Repeated stressful experiences differently affect limbic dopamine release during and following stress
Brain Res.
Regional reward differences within the ventral pallidum are revealed by microinjections of a mu opiate receptor agonist
Neuropharmacology
A convergent functional architecture of the insula emerges across imaging modalities
Neuroimage
Dissociable reward and timing signals in human midbrain and ventral striatum
Neuron
Kappa opioid receptor signaling in the basolateral amygdala regulates conditioned fear and anxiety in rats
Biol. Psychiatry
Macroscopic connection of rat insular cortex: anatomical bases underlying its physiological functions
Int. Rev. Neurobiol.
Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli
Neuron
Reward and aversion in a heterogeneous midbrain dopamine system
Neuropharmacology
Fear and the brain: where have we been, and where are we going?
Biol. Psychiatry
The importance of context: when relative relief renders pain pleasant
Pain
The bivalent side of the nucleus accumbens
Neuroimage
Avoidance of harm and anxiety: a role for the nucleus accumbens
Neuroimage
A functional architecture of the human brain: emerging insights from the science of emotion
Trends Cogn. Sci.
Elevated pain thresholds correlate with dissociation and aversive arousal in patients with borderline personality disorder
Psychiatry Res.
Effects of asymmetric dopamine depletion on sensitivity to rewarding and aversive stimuli in Parkinson's disease
Neuropsychologia
Localization of brain reinforcement mechanisms: intracranial self-administration and intracranial place-conditioning studies
Behav. Brain Res.
Internal body state influences topographical plasticity of sensory representations in the rat gustatory cortex
Proc. Natl. Acad. Sci. U.S.A.
Differential spatial representation of taste modalities in the rat gustatory cortex
J. Neurosci.
D1-like receptors in the nucleus accumbens shell regulate the expression of contextual fear conditioning and activity of the anterior cingulate cortex in rats
Int. J. Neuropsychopharmacol.
Structure of the insular region of the rat neocortex
Neurosci. Behav. Physiol.
Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making
Nat. Neurosci.
Restraint increases dopaminergic burst firing in awake rats
Neuropsychopharmacology
Complexity and competition in appetitive and aversive neural circuits
Front. Neurosci.
Large-scale brain networks in affective and social neuroscience: towards an integrative functional architecture of the brain
Curr. Opin. Neurobiol.
The experience of emotion
Annu. Rev. Psychol.
The amygdala and reward
Nat. Rev. Neurosci.
Moment-to-moment tracking of state value in the amygdala
J. Neurosci.
Relation of ordinal position signals to the expectation of reward and passage of time in four areas of the macaque frontal cortex
J. Neurophysiol.
Impact of appetitive and aversive outcomes on brain responses: linking the animal and human literatures
Front. Syst. Neurosci.
Microstructural abnormalities in subcortical reward circuitry of subjects with major depressive disorder
PLoS One
Cited by (76)
Motivational competition and the paraventricular thalamus
2021, Neuroscience and Biobehavioral ReviewsIntegration of value and action in medial prefrontal neural systems
2021, International Review of NeurobiologyCitation Excerpt :Given recent interest in characterizing active (e.g., avoidance) vs passive (e.g., freezing) responses to aversive stimuli (Fadok et al., 2017; Gruene, Flick, Stefano, Shea, & Shansky, 2015; LeDoux & Daw, 2018), understanding what role action plays in value-associated behaviors appears critical to our understanding of mPFC function. The mPFC has also been well-characterized as a key brain region in signaling appetitive value and regulating appetitively-motivated behaviors (Hayes, Duncan, Xu, & Northoff, 2014). Appetitive signals in rodent mPFC have been described since at least the 1970s.
Social, self, (situational), and affective processes in medial prefrontal cortex (MPFC): Causal, multivariate, and reverse inference evidence
2019, Neuroscience and Biobehavioral Reviews