Abstract
Emerging evidence suggests that the long-established distinction between habit-based and goal-directed decision-making mechanisms can also be sustained in humans. Although the habit-based system has been extensively studied in humans, the goal-directed system is less well characterized. This review brings to that task the distinction between conceptual and nonconceptual representational mechanisms. Conceptual representations are structured out of semantic constituents (concepts)—the use of which requires an ability to perform some language-like syntactic processing. Decision making—as investigated by neuroscience and psychology—is normally studied in isolation from questions about concepts as studied in philosophy and cognitive psychology. We ask what role concepts play in the “goal-directed” decision-making system. We argue that one fruitful way of studying this system in humans is to investigate the extent to which it deploys conceptual representations.
Article PDF
Similar content being viewed by others
References
Adams, C. D., & Dickinson A. (1981). Actions and habits: Variations in associative representations during instrumental learning. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 143–166). Hillsdale, NJ: Erlbaum.
Allen, C., & Hauser, M. (1996). Concept attribution in nonhuman animals: Theoretical and methodological problems in ascribing complex mental processes. In M. Bekoff & D. Jamieson (Eds.), Readings in animal cognition (pp. 47–62). Cambridge, MA: MIT Press.
Balleine, B. W., & Dickinson, A. (1998a). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407–419.
Balleine, B. W., & Dickinson, A. (1998b). The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety. Animal Learning & Behavior, 26, 46–59.
Balleine, B. W., Espinet, A., & Gonzalez, F. (2005). Perceptual learning enhances retrospective revaluation of conditioned flavor preferences in rats. Journal of Experimental Psychology: Animal Behavior Processes, 31, 341–350.
Baxter, M. G., Parker, A., Lindner, C. C., Izquierdo, A. D., & Murray, E. A. (2000). Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. Journal of Neuroscience, 20, 4311–4319.
Behrens, T. E., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007). Learning the value of information in an uncertain world. Nature Neuroscience, 10, 1214–1221.
Bermúdez, J. (2003). Thinking without words. Cambridge, MA: MIT Press.
Bermúdez, J. (2006). Animal reasoning and proto-logic. In S. Hurley & M. Nudds (Eds.), Rational animals? (pp. 127–138). Oxford: Oxford University Press.
Berridge, K. C. (2001). Reward learning: Reinforcement, incentives and expectations. In D. L. Medin (Ed.), The psychology of learning and motivation (Vol. 41, pp. 223–278). San Diego: Academic Press.
Birrell, J. M., & Brown, V. J. (2000). Medial frontal cortex mediates perceptual attentional set shifting in the rat. Journal of Neuroscience, 20, 4320–4324.
Blodgett, H. C. (1929). The effect of the introduction of reward upon the maze performance of rats. University of California Publications in Psychology, 4, 113–134.
Cantalupo, C., & Hopkins, W. D. (2001). Asymmetric Broca’s area in great apes. Nature, 414, 505.
Chater, N., & Heyes, C. (1994). Animal concepts: Content and discontent. Mind & Language, 9, 209–246.
Clayton, N. S., & Dickinson, A. (1998). Episodic-like memory during cache recovery by scrub jays. Nature, 395, 272–274.
Coutureau, E., & Killcross, S. (2003). Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behavioral & Brain Research, 146, 167–174.
Critchley, H. D., & Rolls, E. T. (1996). Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. Journal of Neurophysiology, 75, 1673–1686.
Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704–1711.
Devlin, J. T., Matthews, P. M., & Rushworth, M. F. (2003). Semantic processing in the left inferior prefrontal cortex: A combined functional magnetic resonance imaging and transcranial magnetic stimulation study. Journal of Cognitive Neuroscience, 15, 71–84.
Devlin, J. T., Raley, J., Tunbridge, E., Lanary, K., Floyer-Lea, A., Narain, C., et al. (2003). Functional asymmetry for auditory processing in human primary auditory cortex. Journal of Neuroscience, 23, 11516–11522.
Devlin, J. T., Sillery, E. L., Hall, D. A., Hobden, P., Behrens, T. E., & Nunes, R. G. (2006). Reliable identification of the auditory thalamus using multi-modal structural analyses. NeuroImage, 30, 1112–1120.
Dickinson, A. (1980). Contemporary animal learning theories. Cambridge: Cambridge University Press.
Dickinson, A., & Balleine, B. (1994). Motivational control of goaldirected action. Animal Learning & Behavior, 22, 1–18.
Dickinson, A., & Balleine, B. (2002). The role of learning in motivation. In C. R. Gallistel (Ed.), Learning, motivation, and emotion (pp. 497–533). New York: Wiley.
Dickinson, A., Balleine, B., Watt, A., Gonzalez, F., & Boakes, R. A. (1995). Motivational control after extended instrumental training. Animal Learning & Behavior, 23, 197–206.
Emery, N. J., & Clayton, N. S. (2001). Effects of experience and social context on prospective caching strategies by scrub jays. Nature, 414, 443–446.
Evans, G. (1982). The varieties of reference. Oxford: Oxford University Press.
Freedman, D. J., & Assad, J. A. (2006). Experience-dependent representation of visual categories in parietal cortex. Nature, 443, 85–88.
Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2001). Categorical representation of visual stimuli in the primate prefrontal cortex. Science, 291, 260–263.
Fuster, J. M. (2000). Executive frontal functions. Experimental Brain Research, 133, 66–70.
Gentner, T. Q., Fenn, K. M., Margoliash, D., & Nusbaum, H. C. (2006). Recursive syntactic pattern learning by songbirds. Nature, 440, 1204–1207.
Gottfried, J. A., O’Doherty, J., & Dolan, R. J. (2003). Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science, 301, 1104–1107.
Hare, B., Call, J., Agnetta, B., & Tomasello, M. (2000). Chimpan zees know what conspecifics do and do not see. Animal Behavior, 59, 771–785.
Hare, B., Call, J., & Tomasello, M. (2001). Do chimpanzees know what conspecifics know? Animal Behavior, 61, 139–151.
Holland, P. C., & Gallagher, M. (2004). Amygdala-frontal interactions and reward expectancy. Current Opinion in Neurobiology, 14, 148–155.
Houk, J. C., Adams, J. L., & Barto, A. G. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. In J. C. Houk, J. L. Davis, & D. G. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 249–270). Boston: MIT Press.
Hurley, S., & Nudds, M. (Eds.). (2006). Rational animals? Oxford: Oxford University Press.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999). Building neural representations of habits. Science, 286, 1745–1749.
Johnson, A., & Redish, A. D. (2007). Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. Journal of Neuroscience, 27, 12176–12189.
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006). Optimal decision making and the anterior cingulate cortex. Nature Neurosicence, 9, 940–947.
Kenward, B., Weir, A. A., Rutz, C., & Kacelnik, A. (2005). Behavioural ecology: Tool manufacture by naive juvenile crows. Nature, 433, 121.
Killcross, S., & Coutureau, E. (2003). Coordination of actions and habits in the medial prefrontal cortex of rats. Cerebral Cortex, 13, 400–408.
Koechlin, E., & Jubault, T. (2006). Broca’s area and the hierarchical organization of human behavior. Neuron, 50, 963–974.
Koechlin, E., Ody, C., & Kounelher, F. (2003). The architecture of cognitive control in the human prefrontal cortex. Science, 302, 1181–1185.
Lau, B., & Glimcher, P. W. (2007). Action and outcome encoding in the primate caudate nucleus. Journal of Neuroscience, 27, 14502–14514.
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306, 502–507.
McGaughy J., Ross, R. S., & Eichenbaum, H. (2008). Noradrenergic, but not cholinergic, deafferentation of prefrontal cortex impairs attentional set-shifting. Neuroscience, 153, 63–71.
McLaren, I. P. L., & Mackintosh, N. J. (2002). Associative learning and elemental representation: II. Generalization and discrimination. Animal Learning & Behavior, 30, 177–200.
Millikan, R. G. (2000). On clear and confused ideas. Cambridge: Cambridge University Press.
Montague, P. R., Dayan, P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience, 16, 1936–1947.
Murphy, G. L. (2004). The big book of concepts. Cambridge, MA: MIT Press.
Newsome, W. T., Britten, K. H., & Movshon, J. A. (1989). Neuronal correlates of a perceptual decision. Nature, 341, 52–54.
O’Doherty, J., Dayan, P., Friston, K. J., Critchley, H., & Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38, 150–152.
O’Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452–454.
Ottoni, E. B., de Resende, B. D., & Izar, P. (2005). Watching the best nutcrackers: What capuchin monkeys (Cebus apella) know about others’ tool-using skills. Animal Cognition, 8, 215–219.
Packard, M. G., & Knowlton, B. J. (2002). Learning and memory functions of the basal ganglia. Annual Review of Neuroscience, 25, 563–593.
Padoa-Schioppa, C., & Assad, J. A. (2008). The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nature Neuroscience, 11, 95–102.
Pasupathy, A., & Miller, E. K. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature, 433, 873–876.
Peacocke, C. (1992). A study of concepts. Cambridge, MA: MIT Press.
Preuss, T. M. (1995). Do rats have prefrontal cortex? The Rose-Woolsey-Akert program reconsidered. Journal of Cognitive Neuroscience, 7, 1–24.
Price, J. L. (2007). Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. In G. Schoenbaum, J. A. Gottfried, E. A. Murray, & S. J. Ramus (Eds.), Linking affect to action: Critical contributions of the orbitofrontal cortex (Annals of the New York Academy of Sciences, Vol. 1121, pp. 54–71). New York: New York Academy of Sciences.
Ramirez, D. R., & Savage, L. M. (2007). Differential involvement of the basolateral amygdala, orbitofrontal cortex, and nucleus accumbens core in the acquisition and use of reward expectancies. Behavioral Neuroscience, 121, 896–906.
Rolls, E. T., Sienkiewicz, Z. J., & Yaxley, S. (1989). Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. European Journal of Neuroscience, 1, 53–60.
Rushworth, M. F., Behrens, T. E., Rudebeck, P. H., & Walton, M. E. (2007). Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behavior. Trends in Cognitive Sciences, 11, 168–176.
Rustichini, A. (2008). Dual or unitary system? Two alternative models of decision making. Cognitive, Affective, & Behavioral Neuroscience, 8, 355–362.
Saito, N., Mushiake, H., Sakamoto, K., Itoyama, Y., & Tanji, J. (2005). Representation of immediate and final behavioral goals in the monkey prefrontal cortex during an instructed delay period. Cereberal Cortex, 15, 1535–1546.
Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593–1599.
Seymour, B., O’Doherty, J., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., et al. (2004). Temporal difference models describe higher-order learning in humans. Nature, 429, 664–667.
Shima, K., Isoda, M., Mushiake, H., & Tanji, J. (2007). Categorization of behavioral sequences in the prefrontal cortex. Nature, 445, 315–318.
Shipley, B. E., & Colwill, R. M. (1996). Direct effects on instrumental performance of outcome revaluation by drive shifts. Animal Learning & Behavior, 24, 57–67.
Stich, S. P. (1978). Do animals have beliefs? Australasian Journal of Philosophy, 57, 15–28.
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science, 304, 1782–1787.
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005). Choosing the greater of two goods: Neural currencies for valuation and decision making. Nature Reviews Neuroscience, 6, 1–13.
Tanaka, S. C., Balleine, B. W., & O’Doherty, J. P. (2008). Calculating consequences: Brain systems that encode the causal effects of actions. Journal of Neuroscience, 28, 6750–6755.
Tanji, J., Shima, K., & Mushiake, H. (2007). Concept-based behavioral planning and the lateral preforontal cortex. Trends in Cognitive Sciences, 17, 528–534.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2007). Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. Journal of Neurophysiology, 97, 1621–1632.
Toro, J. M., Trobalon, J. B., & Sebastián-Gallés, N. (2005). Effects of backward speech and speaker variability in language discrimination by rats. Journal of Experimental Psychology: Animal Behavior Processes, 31, 95–100.
Tremblay, L., & Schultz, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature, 398, 704–708.
Valentin, V. V., Dickinson, A., & O’Doherty, J. P. (2007). Determining the neural substrates of goal-directed learning in the human brain. Journal of Neuroscience, 27, 4019–4026.
Walton, M., Rudebeck, P. H., Bannerman, D., & Rushworth, M. (2007). Calculating the cost of acting in prefrontal cortex. In B. W. Balleine, K. Doya, J. O’Doherty, & M. Sakagami (Eds.), Reward and decision making in corticobasal ganglia networks (Annals of the New York Academy of Sciences, Vol. 1104, pp. 340–356). New York: New York Academy of Sciences.
Whiten A., Spiteri A., Horner V., Bonnie K. E., Lambeth, S. P., Schapiro, S. J., & de Waal, F. B. (2007). Transmission of multiple traditions within and between chimpanzee groups. Current Biology, 17, 1038–1043.
Wright, A. A., & Katz, J. S. (2007). Generalization hypothesis of abstract-concept learning: Learning strategies and related issues in Macaca mulatta, Cebus apella, and Columba livia. Journal of Comparative Psychology, 121, 387–397.
Yang, T., & Shadlen, M. N. (2007). Probabilistic reasoning by neurons. Nature, 447, 1075–1080.
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. European Journal of Neuroscience, 19, 181–189.
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005). Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. European Journal of Neuroscience, 22, 505–512.
Author information
Authors and Affiliations
Corresponding author
Additional information
The collaboration between the authors was made possible by a grant from the Volkswagen foundation, and the article was written as part of the “European Platform for Life Sciences, Mind Sciences, and the Humanitiesc” initiative of the Volkswagen foundation.
Rights and permissions
About this article
Cite this article
Shea, N., Krug, K. & Tobler, P.N. Conceptual representations in goal-directed decision making. Cognitive, Affective, & Behavioral Neuroscience 8, 418–428 (2008). https://doi.org/10.3758/CABN.8.4.418
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/CABN.8.4.418