- 1 Max Wertheimer Minerva Center for Cognitive Studies, Technion – Israel Institute of Technology, Haifa, Israel
- 2 Lauder School of Government, Diplomacy and Strategy, Interdisciplinary Center, Herzliya, Israel
Experience-based decisions can be defined as decisions emanating from direct or vicarious reinforcements that were received in the past. For example, in a typical setting a person initially faces blank buttons and needs to press any of them without prior information concerning the selection outcomes. Upon pressing a button the participant receives monetary outcomes (e.g., “you won $5”) and then, based on this experience, makes another selection. Quite often hundreds of trials of this sort are administered. The outcomes of the two alternatives are usually sampled from different payoff distributions (e.g., a button producing a fixed payoff of $5 could be contrasted with a button producing risky payoff, such as wining $9 or $1 with equal likelihood). This allows examining the decision response to different incentive structures without explicit information concerning their statistical properties.
The current Research Topic aims to integrate various works in this area that have been conducted in Decision science and Neuroscience. The study of experience-based decisions has recently revealed some robust regularities that differ from how people make decisions based on descriptions (i.e., where the participants have full information about the outcome distributions but no feedback). For example, people were found to underweight small probability events in experience-based decisions, while overweighting them in decisions based on descriptions. This is now commonly referred to as the description-experience gap (Hertwig and Erev, 2009). In parallel to the recent advancement in Decision Science, neuroscientists have for a long while used the experience-based decisions paradigm for analyzing brain-behavior interactions. For example, phenomena such as the feedback-based Error-Related Negativity (fERN) in event-related potentials (Gehring and Willoughby, 2002) and the role of non-declarative knowledge in selecting advantageously were discovered using experience-based tasks. The goal of the current Research Topic was to combine these two disciplinary sources concerning experience-based decisions.
As expected, several works in this Research Topic explored the “underweighting rare event” tendency. Zhang and Maloney (2012) propose a logit model for this tendency as well as some other robust biases, and also suggest that the underweighting tendency may be driven by basic properties of neural transmission. Upton et al. (2012) propose that underweighting rare events may underlie some of the differences found between neuropsychological populations and controls in complex tasks such as the Iowa Gambling task. By contrast Glöckner et al. (2012) do not replicate the underweighting phenomena in decisions from sampling both in behavior as well as in eye point of gaze. Finally, Nevo and Erev (2012) investigate the immediate aftermath of a rare event and highlight a phenomenon whereby surprising events trigger a change in the participants’ response.
Other authors focused on the issue of consistent preferences in experience-based tasks. Yechiam and Telpaz (2011) demonstrate consistency between tonic (at rest) arousal and risk taking, and show that it is more prominent in tasks with losses. In an important critique, Marchiori and Elqayam (2012) present some boundaries for consistency in risk taking. Ert (2012) retorts by arguing that most of these boundaries have been demonstrated in decisions from description, while in experience-based decisions consistency of individual differences is more robust. Relating to this, Warren and Holroyd (2012) show that the rapid fERN phenomena, which demarcates the rapid frontal cortical sensitivity to negative/positive outcomes, is larger in a condition involving active learning similar to an experience-based task, than in a condition involving passive learning.
Wang et al. (2012) examine the issue of whether choices in an experience-based task are guided by unconscious motivations, as evidenced by advantageous choices in the absence of conscious awareness of the difference between outcomes. Their results suggest a role for unconscious motivations. Such findings are very often interpreted as denoting dual processes or systems. Investigating the influence of dual processes, Hawes et al. (2012) focus on cognitive strategies in a complex decision task and their neural correlates, and their result demonstrate a combination of bottom-up experience-based learning and abstract learning. Sela et al. (2012) focus on an inhibition-related dual process and show that weak transcranial stimulation in the left hemisphere has the ability to affect risk taking, stressing the role of balance between theta activity in the two hemispheres. Finally, Warren and Holroyd (2012) propose two neuromodulatory systems in learning and decision making but stress the context-specific nature of the conditions for the activation of these two systems. For instance, changing the task context from gender to color provided sufficient conditions for differentially activating the two systems.
Finally, several authors examined the effect of social versus private environments, a research area often addressed by both decision and neuroscience models. Grygolec et al. (2012) show that in an experience-based task both the striatal and behavioral response to risk greatly differs in a social versus private setting. Investigating a similar domain, de Bruijn and von Rhein (2012) find that the context in which a person makes a decision with other people greatly determines how others’ payoffs are perceived and the frontal mechanisms activated upon them. In a related work, Fahrenfort et al. (2012) show that sharing in a public good game prompts activation of neural systems associated with reward (striatum), but also empathy (anterior insular cortex and anterior cingulate cortex). Finally, Marchiori and Warglien’s (2011) study demonstrates that a neurally inspired model can explain changes in participants’ responses to different social dilemmas.
We believe that the current Research Topic led to some transfusion of ideas between the two disciplinary sources of Decision science and Neuroscience in key issues related to experience-based decisions (though see our concluding paper for some gaps that remain unresolved). Reflecting on one emergent theme, it appears that brain-behavior relations are quite unstable and may form or unform in different contexts. Contexts that facilitate the relation between frontal processes and behavior, and have been discussed in this Research Topic, include the availability of active choice, feedback, and losses. This sheds light on why experience-based tasks, which typically include these three components, are quite often used in neuropsychological assessment batteries for evaluating brain dysfunctions.
References
de Bruijn, E. R. A., and von Rhein, D. T. (2012). Is your error my concern? An event-related potential study on own and observed error detection in cooperation and competition. Front. Neurosci. 6:8. doi: 10.3389/fnins.2012.00008
Ert, E. (2012). On the value of experience-based decisions in studying constructs of risk taking. Front. Psychology 3:7.
Fahrenfort, J. J., van Winden, F., Pelloux, B., Stallen, M., and Ridderinkhof, K. R. (2012). Neural correlates of dynamically evolving interpersonal ties predict prosocial behavior. Front. Neurosci. 6:28. doi: 10.3389/fnins.2012.00028
Gehring, W. J., and Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295, 2279–2282.
Glöckner, A., Fiedler, S., Hochman, G., Ayal, S., and Hilbig, B. (2012). Processing differences between descriptions and experience: a comparative analysis using eye-tracking and physiological measures. Front. Psychology 3:173. doi: 10.3389/fpsyg.2012.00007
Grygolec, J., Coricelli, G., and Rustichini, A. (2012). Positive interaction of social comparison and personal responsibility for outcomes. Front. Psychology 3:25. doi: 10.3389/fpsyg.2012.00025
Hawes, D. R., Vostroknutov, A., and Rustichini, A. (2012). Experience and abstract reasoning in learning backward induction. Front. Neurosci. 6:23. doi: 10.3389/fnins.2012.00023
Hertwig, R., and Erev, I. (2009). The description-experience gap in risky choice. Trends Cogn. Sci. (Regul. Ed.) 13, 517–523.
Marchiori, D., and Elqayam, S. (2012). Physiological plausibility and boundary conditions of theories of risk sensitivity. Front. Psychology 3:33. doi: 10.3389/fpsyg.2012.00033
Marchiori, D., and Warglien, M. (2011). Neural network models of learning and categorization in multigame experiments. Front. Neurosci. 5:139. doi: 10.3389/fnins.2011.00139
Nevo, I., and Erev, I. (2012). On surprise, change, and the effect of recent outcomes. Front. Psychology 3:24. doi: 10.3389/fpsyg.2012.00024
Sela, T., Kilim, A., and Lavidor, M. (2012). Transcranial alternating current stimulation increases risk-taking behavior in the balloon analog risk task. Front. Neurosci. 6:22. doi: 10.3389/fnins.2012.00022
Upton, D. J., Kerestes, R., and Stout, J. C. (2012). Comparing the iowa and soochow gambling tasks in opiate users. Front. Neurosci. 6:34. doi: 10.3389/fnins.2012.00034
Wang, S., Krajbich, I., Adolphs, R., and Tsuchiya, N. (2012). The role of risk aversion in non-conscious decision making. Front. Psychology 3:50. doi: 10.3389/fpsyg.2012.00050
Warren, C. M., and Holroyd, C. B. (2012). The impact of deliberative strategy dissociates ERP components related to conflict processing vs. reinforcement learning. Front. Neurosci. 6:43. doi: 10.3389/fnins.2012.00043
Yechiam, E., and Telpaz, A. (2011). To take risk is to face loss: a tonic pupillometry study. Front. Psychology 2:344. doi: 10.3389/fpsyg.2011.00390
Citation: Yechiam E and Aharon I (2012) The neuroscience and psychophysiology of experience-based decisions: an introduction to the research topic. Front. Psychology 3:184. doi: 10.3389/fpsyg.2012.00184
Received: 08 May 2012; Accepted: 21 May 2012;
Published online: 05 June 2012.
Copyright: © 2012 Yechiam and Aharon. This is an open-access article distributed under the terms of the Creative Commons Attribution Non Commercial License, which permits non-commercial use, distribution, and reproduction in other forums, provided the original authors and source are credited.
*Correspondence: yeldad@tx.technion.ac.il