Skip to main content
SpringerLink
Log in

Lernen und Belohnungssystem

  • Chapter
Funktionelle MRT in Psychiatrie und Neurologie

  • 10k Accesses

Zusammenfassung

In diesem Kapitel geht es um die Rolle des Belohnungssystems beim Assoziationslernen. Dazu werden zunächst die wichtigsten Lerntheorien vorgestellt, und es wird die Bedeutung des Neurotransmitters Dopamin für belohnungsbezogene Lernprozesse erläutert. Anschließend werden aktuelle fMRT-Studien vorgestellt, welche neuronale Korrelate der Belohnungsverarbeitung und belohnungsbezogener Lernprozesse untersuchen. Zum Schluss wird auf die Bedeutung belohnungsbezogenen Lernens für psychische Erkrankungen eingegangen, und es werden aktuelle Forschungsergebnisse dargestellt.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Literatur

  • Aharon I, Etcoff N, Ariely D, Chabris CF, O‘Connor E, Breiter HC (2001) Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron 32: 537–551

    Article  PubMed  CAS  Google Scholar 

  • Arias-Carrión O, Pöppel E (2007) Dopamine, learning, and rewardseeking behavior. Acta Neurobiol Exp (Wars) 67: 481–488

    Google Scholar 

  • Bayer HM, Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129–141

    Article  PubMed  CAS  Google Scholar 

  • Beck A, Schlagenhauf F, Wüstenberg T, Hein J, Kienast T, Kahnt T, Schmack K, Hagele C, Knutson B, Heinz A, Wrase J (2009) Ventral striatal activation during reward anticipation correlates with impulsivity in alcoholics. Biol Psychiatry 66: 734–742

    Article  PubMed  CAS  Google Scholar 

  • Berns GS, McClure SM, Pagnoni G, Montague PR (2001) Predictability modulates human brain response to reward. J Neurosci 21: 2793– 2798

    PubMed  CAS  Google Scholar 

  • Berridge KC (1996) Food reward: brain substrates of wanting and liking. Neurosci Biobehav Rev 20: 1–25

    Article  PubMed  CAS  Google Scholar 

  • Bjork JM, Smith AR, Hommer DW (2008) Striatal sensitivity to reward deliveries and omissions in substance dependent patients. Neuroimage 42: 1609–1621

    Article  PubMed  Google Scholar 

  • Bray S, O‘Doherty J (2007) Neural coding of reward-prediction error signals during classical conditioning with attractive faces. J Neurophysiol 97: 3036–3045

    Article  PubMed  Google Scholar 

  • David SP, Munafo MR, Johansen-Berg H, Smith SM, Rogers RD, Matthews PM, Walton RT (2005) Ventral striatum/nucleus accumbens activation to smoking-related pictorial cues in smokers and nonsmokers: a functional magnetic resonance imaging study. Biol Psychiatry 58: 488–494

    Article  PubMed  Google Scholar 

  • Davis KL, Kahn RS, Ko G, Davidson M (1991) Dopamine in schizophrenia: a review and reconceptualization. Am J Psychiatry 148: 1474–1486

    PubMed  CAS  Google Scholar 

  • Diaconescu AO, Jensen J, Wang H, Willeit M, Menon M, Kapur S, McIntosh AR (2011) Aberrant Effective Connectivity in Schizophrenia Patients during Appetitive Conditioning. Front Hum Neurosci 4: 239

    Article  PubMed  Google Scholar 

  • Dichter GS, Felder JN, Petty C, Bizzell J, Ernst M, Smoski MJ (2009) The effects of psychotherapy on neural responses to rewards in major depression. Biol Psychiatry 66: 886–897

    Article  PubMed  Google Scholar 

  • Epstein J, Pan H, Kocsis JH, Yang Y, Butler T, Chusid J, Hochberg H, Murrough J, Strohmayer E, Stern E, Silbersweig DA (2006) Lack of ventral striatal response to positive stimuli in depressed versus normal subjects. Am J Psychiatry 163: 1784–1790

    Article  PubMed  Google Scholar 

  • Erk S, Spitzer M, Wunderlich AP, Galley L, Walter H (2002) Cultural objects modulate reward circuitry. Neuroreport 13: 2499–2503

    Article  PubMed  Google Scholar 

  • Forbes EE, Hariri AR, Martin SL, Silk JS, Moyles DL, Fisher PM, Brown SM, Ryan ND, Birmaher B, Axelson DA, Dahl RE (2009) Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder. Am J Psychiatry 166: 64–73

    Article  PubMed  Google Scholar 

  • Gradin VB, Kumar P, Waiter G, Ahearn T, Stickle C, Milders M, Reid I, Hall J, Steele JD (2011) Expected value and prediction error abnormalities in depression and schizophrenia. Brain 134: 1751–1764

    Article  PubMed  Google Scholar 

  • Guyer AE, Choate VR, Detloff A, Benson B, Nelson EE, Perez-Edgar K, Fox NA, Pine DS, Ernst M (2012) Striatal Functional Alteration During Incentive Anticipation in Pediatric Anxiety Disorders. Am J Psychiatry 169: 205–212

    Article  PubMed  Google Scholar 

  • Jensen J, Willeit M, Zipursky RB, Savina I, Smith AJ, Menon M, Crawley AP, Kapur S (2008) The formation of abnormal associations in schizophrenia: neural and behavioral evidence. Neuropsychopharmacology 33: 473–479

    Article  PubMed  Google Scholar 

  • Juckel G, Schlagenhauf F, Koslowski M, Filonov D, Wüstenberg T, Villringer A, Knutson B, Kienast T, Gallinat J, Wrase J, Heinz A (2006a) Dysfunction of ventral striatal reward prediction in schizophrenic patients treated with typical, not atypical, neuroleptics. Psychopharmacology (Berl) 187: 222–228

    Article  CAS  Google Scholar 

  • Juckel G, Schlagenhauf F, Koslowski M, Wüstenberg T, Villringer A, Knutson B, Wrase J, Heinz A (2006b) Dysfunction of ventral striatal reward prediction in schizophrenia. Neuroimage 29: 409–416

    Article  Google Scholar 

  • Kapur S (2003) Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am J Psychiatry 160: 13–23

    Article  PubMed  Google Scholar 

  • Kirsch P, Ronshausen S, Mier D, Gallhofer B (2007) The influence of antipsychotic treatment on brain reward system reactivity in schizophrenia patients. Pharmacopsychiatry 40: 196–198

    Article  PubMed  CAS  Google Scholar 

  • Knutson B, Adams CM, Fong GW, Hommer D (2001a) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21: RC159

    Google Scholar 

  • Knutson B, Fong GW, Adams CM, Varner JL, Hommer D (2001b) Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12: 3683-3687

    Article  CAS  Google Scholar 

  • Knutson B, Bhanji JP, Cooney RE, Atlas LY, Gotlib IH (2008) Neural responses to monetary incentives in major depression. Biol Psychiatry 63: 686–692

    Article  PubMed  Google Scholar 

  • Kumar P, Waiter G, Ahearn T, Milders M, Reid I, Steele JD (2008) Abnormal temporal difference reward-learning signals in major depression. Brain 131: 2084–2093

    Article  PubMed  CAS  Google Scholar 

  • Liu X, Hairston J, Schrier M, Fan J (2011) Common and distinct networks underlying reward valence and processing stages: a metaanalysis of functional neuroimaging studies. Neurosci Biobehav Rev 35: 1219–1236

    Article  PubMed  Google Scholar 

  • Luman M, Tripp G, Scheres A (2010) Identifying the neurobiology of altered reinforcement sensitivity in ADHD: a review and research agenda. Neurosci Biobehav Rev 34: 744–754

    Article  PubMed  Google Scholar 

  • Matsumoto M, Hikosaka O (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837–841

    Article  PubMed  CAS  Google Scholar 

  • McCabe C, Cowen PJ, Harmer CJ (2009) Neural representation of reward in recovered depressed patients. Psychopharmacology (Berl) 205: 667–677

    Article  CAS  Google Scholar 

  • Mirenowicz J, Schultz W (1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379: 449–451

    Article  PubMed  CAS  Google Scholar 

  • Mobbs D, Greicius MD, Abdel-Azim E, Menon V, Reiss AL (2003) Humor modulates the mesolimbic reward centers. Neuron 40: 1041–1048

    Article  PubMed  CAS  Google Scholar 

  • Morris RW, Vercammen A, Lenroot R, Moore L, Langton JM, Short B, Kulkarni J, Curtis J, O‘Donnell M, Weickert CS, Weickert TW (2012) Disambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia. Mol Psychiatry 17: 235, 280–289

    Article  Google Scholar 

  • Murray GK, Corlett PR, Clark L, Pessiglione M, Blackwell AD, Honey G, Jones PB, Bullmore ET, Robbins TW, Fletcher PC (2008) Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol Psychiatry 13: 239, 267–276

    Article  Google Scholar 

  • O‘Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002) Neural responses during anticipation of a primary taste reward. Neuron 33: 815–826

    Article  PubMed  Google Scholar 

  • Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006) Dopamine- dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042–1045

    Article  PubMed  CAS  Google Scholar 

  • Peters J, Büchel C (2011) The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn Sci 15: 227–239

    Article  PubMed  Google Scholar 

  • Pizzagalli DA, Holmes AJ, Dillon DG, Goetz EL, Birk JL, Bogdan R, Dougherty DD, Iosifescu DV, Rauch SL, Fava M (2009) Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am J Psychiatry 166: 702–710

    Article  PubMed  Google Scholar 

  • Rademacher L, Krach S, Kohls G, Irmak A, Grunder G, Spreckelmeyer KN (2010) Dissociation of neural networks for anticipation and consumption of monetary and social rewards. Neuroimage 49: 3276–3285

    Article  PubMed  Google Scholar 

  • Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF (eds) Classical conditioning II: Current research and theory. Appleton-Century-Crofts, New York, pp 64–99

    Google Scholar 

  • Robinson TE, Berridge KC (2000) The psychology and neurobiology of addiction: an incentive-sensitization view. Addiction 95 (Suppl 2): S 91–117

    Article  Google Scholar 

  • Sanchez-Gonzalez MA, Garcia-Cabezas MA, Rico B, Cavada C (2005) The primate thalamus is a key target for brain dopamine. J Neurosci 25: 6076–6083

    Article  PubMed  CAS  Google Scholar 

  • Schacht JP, Anton RF, Randall PK, Li X, Henderson S, Myrick H (2011) Stability of fMRI striatal response to alcohol cues: a hierarchical linear modeling approach. Neuroimage 56: 61–68

    Article  PubMed  CAS  Google Scholar 

  • Scheres A, Milham MP, Knutson B, Castellanos FX (2007) Ventral striatal hyporesponsiveness during reward anticipation in attentiondeficit/ hyperactivity disorder. Biol Psychiatry 61: 720–724

    Article  PubMed  Google Scholar 

  • Schlagenhauf F, Juckel G, Koslowski M, Kahnt T, Knutson B, Dembler T, Kienast T, Gallinat J, Wrase J, Heinz A (2008) Reward system activation in schizophrenic patients switched from typical neuroleptics to olanzapine. Psychopharmacology (Berl) 196: 673–684

    Article  CAS  Google Scholar 

  • Schönberg T, Daw ND, Joel D, O‘Doherty JP (2007) Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci 27: 12860–12867

    Article  PubMed  Google Scholar 

  • Schultz W, Apicella P, Ljungberg T (1993) Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13: 900–913

    PubMed  CAS  Google Scholar 

  • Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275: 1593–1599

    Article  PubMed  CAS  Google Scholar 

  • Simon JJ, Biller A, Walther S, Roesch-Ely D, Stippich C, Weisbrod M, Kaiser S (2009) Neural correlates of reward processing in schizophrenia – relationship to apathy and depression. Schizophr Res 118: 154–161

    Article  PubMed  Google Scholar 

  • Smoski MJ, Felder J, Bizzell J, Green SR, Ernst M, Lynch TR, Dichter GS (2009) fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder. J Affect Disord 118: 69–78

    Article  PubMed  Google Scholar 

  • Smoski MJ, Rittenberg A, Dichter GS (2011) Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards. Psychiatry Res 194: 263–270

    Article  PubMed  Google Scholar 

  • Spreckelmeyer KN, Krach S, Kohls G, Rademacher L, Irmak A, Konrad K, Kircher T, Gründer G (2009) Anticipation of monetary and social reward differently activates mesolimbic brain structures in men and women. Soc Cogn Affect Neurosci 4: 158–165

    Article  PubMed  Google Scholar 

  • Stark R, Bauer E, Merz CJ, Zimmermann M, Reuter M, Plichta MM, Kirsch P, Lesch KP, Fallgatter AJ, Vaitl D, Herrmann MJ (2011) ADHD related behaviors are associated with brain activation in the reward system. Neuropsychologia 49: 426–434

    Article  PubMed  CAS  Google Scholar 

  • Staudinger MR, Erk S, Walter H (2011) Dorsolateral Prefrontal Cortex Modulates Striatal Reward Encoding during Reappraisal of Reward Anticipation. Cereb Cortex 21: 2578–2588

    Article  Google Scholar 

  • Steele JD, Kumar P, Ebmeier KP (2007) Blunted response to feedback information in depressive illness. Brain 130: 2367–2374

    Article  PubMed  CAS  Google Scholar 

  • Stoy M, Schlagenhauf F, Sterzer P, Bermpohl F, Hagele C, Suchotzki K, Schmack K, Wrase J, Ricken R, Knutson B, Adli M, Bauer M, Heinz A, Ströhle A (2012) Hyporeactivity of ventral striatum towards incentive stimuli in unmedicated depressed patients normalizes after treatment with escitalopram. J Psychopharmacol 26: 677–688

    Article  PubMed  Google Scholar 

  • Ströhle A, Stoy M, Wrase J, Schwarzer S, Schlagenhauf F, Huss M, Hein J, Nedderhut A, Neumann B, Gregor A, Juckel G, Knutson B, Lehmkuhl U, Bauer M, Heinz A (2008) Reward anticipation and outcomes in adult males with attention-deficit/hyperactivity disorder. Neuroimage 39: 966–972

    Article  PubMed  Google Scholar 

  • Surguladze S, Brammer MJ, Keedwell P, Giampietro V, Young AW, Travis MJ, Williams SC, Phillips ML (2005) A differential pattern of neural response toward sad versus happy facial expressions in major depressive disorder. Biol Psychiatry 57: 201–209

    Article  PubMed  Google Scholar 

  • Tobler PN, O‘Doherty J P, Dolan RJ, Schultz W (2006) Human neural learning depends on reward prediction errors in the blocking paradigm. J Neurophysiol 95: 301–310

    Article  PubMed  Google Scholar 

  • Tripp G, Wickens JR (2008) Research review: dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD. J Child Psychol Psychiatry 49: 691–704

    Article  PubMed  Google Scholar 

  • Tsai HC, Zhang F, Adamantidis A, Stuber GD, Bonci A, de Lecea L, Deisseroth K (2009) Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324: 1080–1084

    Article  PubMed  CAS  Google Scholar 

  • Volkow ND, Wang GJ, Fowler JS, Telang F, Maynard L, Logan J, Gatley SJ, Pappas N, Wong C, Vaska P, Zhu W, Swanson JM (2004) Evidence that methylphenidate enhances the saliency of a mathematical task by increasing dopamine in the human brain. Am J Psychiatry 161: 1173–1180

    Article  PubMed  Google Scholar 

  • Waltz JA, Schweitzer JB, Gold JM, Kurup PK, Ross TJ, Salmeron BJ, Rose EJ, McClure SM, Stein EA (2009) Patients with schizophrenia have a reduced neural response to both unpredictable and predictable primary reinforcers. Neuropsychopharmacology 34: 1567–1577

    Article  PubMed  CAS  Google Scholar 

  • Wrase J, Schlagenhauf F, Kienast T, Wüstenberg T, Bermpohl F, Kahnt T, Beck A, Ströhle A, Juckel G, Knutson B, Heinz A (2007) Dysfunction of reward processing correlates with alcohol craving in detoxified alcoholics. Neuroimage 35: 787–794

    Article  PubMed  Google Scholar 

  • Yacubian J, Glascher J, Schroeder K, Sommer T, Braus DF, Buchel C (2006) Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci 26: 9530–9537

    Article  PubMed  CAS  Google Scholar 

  • Zaghloul KA, Blanco JA, Weidemann CT, McGill K, Jaggi JL, Baltuch GH, Kahana MJ (2009) Human substantia nigra neurons encode unexpected financial rewards. Science 323: 1496–1499

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Klinik für Psychiatrie, Psychotherapie und Psychosomatik, Universitätsklinikum Aachen, Pauwelsstraße 30, 52074, Aachen

    Dr. Lena Rademacher

  2. Department of Psychology, Stanford University, 94305-2130, Stanford, USA

    Dr. Katja Spreckelmeyer

Authors
  1. Dr. Lena Rademacher
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dr. Katja Spreckelmeyer
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Universitätsklinikum Aachen, Aachen

    Frank Schneider

  2. Forschungszentrum Jülich, Jülich

    Gereon R. Fink

  3. Uniklinik Köln, Köln

    Gereon R. Fink

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Rademacher, L., Spreckelmeyer, K. (2013). Lernen und Belohnungssystem. In: Schneider, F., Fink, G.R. (eds) Funktionelle MRT in Psychiatrie und Neurologie. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29800-4_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-29800-4_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29799-1

  • Online ISBN: 978-3-642-29800-4

  • eBook Packages: Medicine (German Language)

Publish with us

Policies and ethics

Search

Navigation