No CrossRef data available.
Article contents
Behavioral proxies compete by the time courses of their rewards, including endogenous rewards
Published online by Cambridge University Press: 13 May 2024
Abstract
Natural selection is slow, so behavioral goals must be based on patterns of reward. Addictions are rewarded in the same way as adaptive choice, so they can be distinguished only by their time course. In addition, the reward process is more plastic than is generally recognized, so abstract goals are shaped by the “legibility” of their proxies.
- Type
- Open Peer Commentary
- Information
- Copyright
- Copyright © The Author(s), 2024. Published by Cambridge University Press
References
Agarwal, D. P., & Goedde, H. W. (1989). Human aldehyde dehydrogenases: Their role in alcoholism. Alcohol, 6, 517–523.CrossRefGoogle ScholarPubMed
Ainslie, G. (2013). Grasping the impalpable: The role of endogenous reward in choices, including process addictions. Inquiry: A Journal of Medical Care Organization, Provision and Financing, 56, 446–469. doi:10.1080/0020174X.2013.806129, http://www.tandfonline.com/eprint/8fGTuFsnfFunYJKJ7aA7/fullCrossRefGoogle Scholar
Ainslie, G. (2017). De gustibus disputare: Hyperbolic delay discounting integrates five approaches to choice. Journal of Economic Methodology, 24(2), 166–189. http://dx.doi.org/10.1080/1350178X.2017.1309748CrossRefGoogle Scholar
Ainslie, G. (2023). Behavioral construction of the future. Psychology of Addictive Behaviors, 37(1), 13–24. doi.org/10.1037/adb0000853CrossRefGoogle ScholarPubMed
Ariely, D., & Loewenstein, G. (2006). The heat of the moment: The effect of sexual arousal on sexual decision making. Journal of Behavioral Decision Making, 19(2), 87–98.CrossRefGoogle Scholar
Badger, G. J., Bickel, W. K., Giordano, L. A., Jacobs, E. A., Loewenstein, G., & Marsch, L. (2007). Altered states: The impact of immediate craving on the valuation of current and future opioids. Journal of Health Economics, 26(5), 865–876.CrossRefGoogle ScholarPubMed
Becker, G., & Murphy, K. (1988). A theory of rational addiction. Journal of Political Economy, 96, 675–700.CrossRefGoogle Scholar
Bénabou, R., & Tirole, J. (2016). Mindful economics: The production, consumption, and value of beliefs. The Journal of Economic Perspectives, 30(3), 141–164.CrossRefGoogle Scholar
Coddington, L. T., & Dudman, J. T. (2019). Learning from action: Reconsidering movement signaling in midbrain dopamine neuron activity. Neuron, 104(1), 63–77. https://doi.org/10.1016/J.NEURON.2019.08.036CrossRefGoogle ScholarPubMed
Green, L., & Myerson, J. (2018). Preference reversals, delay discounting, rational choice, and the brain. In Bermúdez, J. L. (Ed.), Self-control, decision theory, and rationality: New essays (pp. 121–146). Cambridge University Press.CrossRefGoogle Scholar
Levy, D. J., & Glimcher, P. W. (2012). The root of all value: A neural common currency for choice. Current Opinion in Neurobiology, 22(6), 1027–1038. https://doi.org/10.1016/J.CONB.2012.06.001CrossRefGoogle ScholarPubMed
Loewenstein, G., & Molnar, A. (2018). The renaissance of belief-based utility in economics. Nature Human Behaviour, 2(3), 166–167.CrossRefGoogle Scholar
Loewenstein, G., O'Donoghue, T., & Bhatia, S. (2015). Modeling the interplay between affect and deliberation. Decision, 2(2), 55–62.CrossRefGoogle Scholar
Rachlin, H. (2012). Making IBM's computer, Watson, human. The Behavior Analyst, 35(1), 1–16.CrossRefGoogle ScholarPubMed
Rick, S., & Loewenstein, G. (2008). Intangibility in intertemporal choice. Philosophical Transactions of the Royal Society B, 363, 3813–3824.CrossRefGoogle ScholarPubMed
Silver, D., Singh, S., Precup, D., & Sutton, R. S. (2021). Reward is enough. Artificial Intelligence, 299, 103535.CrossRefGoogle Scholar
Volkow, N. D., Wise, R. A., & Baler, R. (2017). The dopamine motive system: Implications for drug and food addiction. Nature Reviews Neuroscience, 18(12), Article 12. https://doi.org/10.1038/nrn.2017.130CrossRefGoogle ScholarPubMed
Target article
Dead rats, dopamine, performance metrics, and peacock tails: Proxy failure is an inherent risk in goal-oriented systems
Related commentaries (20)
An updated perspective on teleonomy
Animal welfare science, performance metrics, and proxy failure
Behavioral proxies compete by the time courses of their rewards, including endogenous rewards
Changing the incentive structure of social media may reduce online proxy failure and proliferation of negativity
Dynamic diversity is the answer to proxy failure
Genies, lawyers, and smart-asses: Extending proxy failures to intentional misunderstandings
It's the biology, stupid! Proxy failures in economic decision making
Navigating proxy failures in education: Learning from human and animal play
On abstract goals’ perverse effects on proxies: The dynamics of unattainability
Proxies, heuristics, and goal alignment
Proxy failure and poor measurement practices in psychological science
Proxy failure as a feature of adaptive control systems
Proxy failure in academia: More than just another example
Proxy failure in social policies as one of the main causes of persistent sexism and racism
Proxy failures in practice: Examples from the sociology of science
Reductionism and proxy failure: From neuroscience to target-based drug discovery
Regulator and agent sophistication as an explanation-generating engine for proxy failure dynamics
Subjective and objective corruption of intuition and rational choice
The cost of success or failure for proxy signals in ecological problems
The determinants of proxy treadmilling in evolutionary models of reliable signals
Author response
Teleonomy, legibility, and diversity: Do we need more “proxynomics”?