Affective and cognitive mechanisms of risky decision making

https://doi.org/10.1016/j.nlm.2014.03.002Get rights and content

Highlights

  • Rats chose between small, “safe” rewards and large rewards with risks of shock.

  • Choice was more sensitive to shock intensity than reward magnitude.

  • Risk averse rats showed less cognitive flexibility than risk taking rats.

  • Rats with greater impulsive choice showed worse working memory.

  • Risky and impulsive choice are associated with distinct executive functions.

Abstract

The ability to make advantageous decisions under circumstances in which there is a risk of adverse consequences is an important component of adaptive behavior; however, extremes in risk taking (either high or low) can be maladaptive and are characteristic of a number of neuropsychiatric disorders. To better understand the contributions of various affective and cognitive factors to risky decision making, cohorts of male Long-Evans rats were trained in a “Risky Decision making Task” (RDT), in which they made discrete trial choices between a small, “safe” food reward and a large, “risky” food reward accompanied by varying probabilities of footshock. Experiment 1 evaluated the relative contributions of the affective stimuli (i.e., punishment vs. reward) to RDT performance by parametrically varying the magnitudes of the footshock and large reward. Varying the shock magnitude had a significant impact on choice of the large, “risky” reward, such that greater magnitudes were associated with reduced choice of the large reward. In contrast, varying the large, “risky” reward magnitude had minimal influence on reward choice. Experiment 2 compared individual variability in RDT performance with performance in an attentional set shifting task (assessing cognitive flexibility), a delayed response task (assessing working memory), and a delay discounting task (assessing impulsive choice). Rats characterized as risk averse in the RDT made more perseverative errors on the set shifting task than did their risk taking counterparts, whereas RDT performance was not related to working memory abilities or impulsive choice. In addition, rats that showed greater delay discounting (greater impulsive choice) showed corresponding poorer performance in the working memory task. Together, these results suggest that reward-related decision making under risk of punishment is more strongly influenced by the punishment than by the reward, and that risky and impulsive decision making are associated with distinct components of executive function.

Introduction

Decisions among options that vary in both their payoffs and their potential for adverse consequences are a consistent feature of everyday life. When faced with such choices, most individuals can weigh the relative risks and rewards associated with the competing options and decide adaptively; however, such choice behavior (henceforth referred to as “risky decision making”) may be altered in several neuropsychiatric conditions, such that choices are strongly biased toward or away from “risky” options. For example, high levels of risk taking are present in ADHD and addiction, where they may contribute to some of the adverse outcomes associated with these conditions (Bechara et al., 2001, Drechsler et al., 2008, Ernst et al., 2003, Kagan, 1987). In contrast, abnormally low levels of risk taking (risk aversion) are found in anorexia nervosa and social anxiety ((Butler and Mathews, 1987, Kaye et al., 2013, Stanley, 2002) although see (Reynolds et al., 2013)). Hence, a better understanding of the neurobehavioral mechanisms underlying risky decision making may yield benefits across the clinical spectrum.

The current study employed a rat model of risky decision making in which rats make discrete trial choices between a small, “safe” food reward and a large “risky” food reward accompanied by varying probabilities of mild footshock (the “Risky Decision making Task”, or RDT). Previous work has shown that male Long-Evans rats display marked individual variability in their preference for the large, risky reward in this task. Some rats show a strong preference for the large reward even with a high probability of shock (i.e., “risk takers”), whereas other rats show a strong preference for the small reward even when there is a low probability of shock (i.e., “risk averse”) (Simon et al., 2011). These differences in performance are not associated with variability in reward motivation, anxiety, or shock reactivity (Simon et al., 2009, Simon et al., 2011). However, rats with a high preference for risk taking acquire cocaine self-administration more rapidly and have lower striatal dopamine D2 receptor mRNA expression than rats with a low preference for risk taking (Mitchell et al., 2014); Simon et al., 2011). Notably, elevated risk taking in humans is associated with both addiction and reduced striatal D2 receptor availability (Bechara et al., 2001, Goldstein et al., 2009, Rogers et al., 1999, Volkow et al., 2004), supporting the validity of the RDT as a model of human risk taking behavior. The aim of the current study was to assess affective and cognitive mechanisms that may mediate RDT performance, by manipulating the affective value of the RDT task parameters, and by determining associations between risk taking and several measures of executive function. A first cohort of rats was exposed to varying magnitudes of footshock to determine the effects of punishment magnitude on RDT performance. A second cohort was presented with variable numbers of food pellets upon choice of the “risky” option, to determine the effects of reward magnitude on RDT performance. Finally, a third cohort of rats was trained on a set shifting task, a working memory task, the RDT, and a delay discounting task to determine relationships among these different aspects of cognition and decision making.

Section snippets

Subjects

Two cohorts of male Long-Evans rats (n = 16 for Experiment 1A, and n = 8 for Experiment 1B, 275–300 g on arrival, Charles River Laboratories, Raleigh, NC) were individually housed and kept on a 12 h light/dark cycle (lights on at 0800 h) with free access to food and water except as noted. Prior to the start of behavioral testing, rats were reduced to 85% of their free feeding weights over the course of five days, and maintained at this weight for the duration of the experiment, with allowances for

Experiment 1A

To determine the contribution of the shock to RDT performance, the shock magnitude was varied using the standard RDT reward magnitudes (1 vs. 3 food pellets). Comparisons of choice performance at different shock magnitudes using a repeated measures ANOVA revealed a main effect of both trial block [F(4, 60) = 11.93, p < 0.05] and shock magnitude [F(3, 45) = 4.96, p < 0.05] on choice of the large, risky reward, as well as a significant interaction between these two factors [F(12, 180) = 2.56, p < 0.05] (Fig. 1

Discussion

The goal of these experiments was to determine the contributions of affective and cognitive factors to risk taking behavior in a rat model of risky decision making. Experiment 1 varied the magnitude of the shock associated with the large reward in one cohort of rats, and the magnitude of the large reward in another cohort of rats. Varying the shock produced magnitude-dependent shifts in choice of the large reward (i.e., larger shock magnitudes produced less choice of the large reward),

Acknowledgments

We thank Dominique Ouimet-Erlacher, Ryan Gilbert, and Bonnie McLaurin for technical assistance. Supported by DA024671 (B.S.), DA033074 (M.R.M.), and a NSF Graduate Research Fellowship (B.S.B.). M.R. Mitchell is currently supported by T32DA007238 (Petrakis, PI).

References (55)

  • R.L. Gunn et al.

    Impulsivity partially mediates the association between reduced working memory capacity and alcohol problems

    Alcohol

    (2013)
  • W.H. Kaye et al.

    Nothing tastes as good as skinny feels: The neurobiology of anorexia nervosa

    Trends in Neurosciences

    (2013)
  • K. McAlonan et al.

    Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat

    Behavioural Brain Research

    (2003)
  • E.K. Reynolds et al.

    Influence of social stress on risk-taking behavior in adolescents

    Journal of Anxiety Disorders

    (2013)
  • R.D. Rogers et al.

    Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: Evidence for monoaminergic mechanisms

    Neuropsychopharmacology

    (1999)
  • H.L. Sloan et al.

    Double dissociation between hippocampal and prefrontal lesions on an operant delayed matching task and a water maze reference memory task

    Behavioural Brain Research

    (2006)
  • J.M. Birrell et al.

    Medial frontal cortex mediates perceptual attentional set shifting in the rat

    Journal of Neuroscience

    (2000)
  • Gillian. Butler et al.

    Anticipatory anxiety and risk perception

    Cognitive Therapy and Research

    (1987)
  • R.N. Cardinal et al.

    The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats

    Psychopharmacology (Berlin)

    (2000)
  • U.N. Danner et al.

    Neuropsychological weaknesses in anorexia nervosa: Set-shifting, central coherence, and decision making in currently ill and recovered women

    International Journal of Eating Disorders

    (2012)
  • R. Dias et al.

    Dissociation in prefrontal cortex of affective and attentional shifts

    Nature

    (1996)
  • R. Drechsler et al.

    Decision-making on an explicit risk-taking task in preadolescents with attention-deficit/hyperactivity disorder

    Journal of Neural Transmission

    (2008)
  • R. Drechsler et al.

    Decision making with uncertain reinforcement in children with attention deficit/hyperactivity disorder (ADHD)

    Child Neuropsychology

    (2010)
  • M. Ernst et al.

    Neural substrates of decision making in adults with attention deficit hyperactivity disorder

    American Journal of Psychiatry

    (2003)
  • J.L. Evenden et al.

    The pharmacology of impulsive behaviour in rats: The effects of drugs on response choice with varying delays of reinforcement

    Psychopharmacology (Berlin)

    (1996)
  • S.B. Floresco et al.

    Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting

    Neuropsychopharmacology

    (2006)
  • S.M. Groman et al.

    Dysregulation of D(2)-mediated dopamine transmission in monkeys after chronic escalating methamphetamine exposure

    Journal of Neuroscience

    (2012)
  • Cited by (47)

    View all citing articles on Scopus
    View full text