1
|
Anlló H, Bavard S, Benmarrakchi F, Bonagura D, Cerrotti F, Cicue M, Gueguen M, Guzmán EJ, Kadieva D, Kobayashi M, Lukumon G, Sartorio M, Yang J, Zinchenko O, Bahrami B, Silva Concha J, Hertz U, Konova AB, Li J, O'Madagain C, Navajas J, Reyes G, Sarabi-Jamab A, Shestakova A, Sukumaran B, Watanabe K, Palminteri S. Comparing experience- and description-based economic preferences across 11 countries. Nat Hum Behav 2024:10.1038/s41562-024-01894-9. [PMID: 38877287 DOI: 10.1038/s41562-024-01894-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Accepted: 04/19/2024] [Indexed: 06/16/2024]
Abstract
Recent evidence indicates that reward value encoding in humans is highly context dependent, leading to suboptimal decisions in some cases, but whether this computational constraint on valuation is a shared feature of human cognition remains unknown. Here we studied the behaviour of n = 561 individuals from 11 countries of markedly different socioeconomic and cultural makeup. Our findings show that context sensitivity was present in all 11 countries. Suboptimal decisions generated by context manipulation were not explained by risk aversion, as estimated through a separate description-based choice task (that is, lotteries) consisting of matched decision offers. Conversely, risk aversion significantly differed across countries. Overall, our findings suggest that context-dependent reward value encoding is a feature of human cognition that remains consistently present across different countries, as opposed to description-based decision-making, which is more permeable to cultural factors.
Collapse
Affiliation(s)
- Hernán Anlló
- Human Reinforcement Learning Team, Laboratory of Cognitive and Computational Neuroscience, Paris, France.
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan.
- Intercultural Cognitive Network, Paris, France.
| | - Sophie Bavard
- Human Reinforcement Learning Team, Laboratory of Cognitive and Computational Neuroscience, Paris, France
- Intercultural Cognitive Network, Paris, France
- General Psychology Lab, Hamburg University, Hamburg, Germany
| | - FatimaEzzahra Benmarrakchi
- Intercultural Cognitive Network, Paris, France
- School of Collective Intelligence, Université Mohammed VI Polytechnique, Rabat, Morocco
| | - Darla Bonagura
- Intercultural Cognitive Network, Paris, France
- Department of Psychiatry, University Behavioral Health Care and Brain Health Institute, Rutgers University-New Brunswick, Piscataway, NJ, USA
| | - Fabien Cerrotti
- Human Reinforcement Learning Team, Laboratory of Cognitive and Computational Neuroscience, Paris, France
- Intercultural Cognitive Network, Paris, France
| | - Mirona Cicue
- Department of Cognitive Sciences, University of Haifa, Haifa, Israel
| | - Maelle Gueguen
- Intercultural Cognitive Network, Paris, France
- Department of Psychiatry, University Behavioral Health Care and Brain Health Institute, Rutgers University-New Brunswick, Piscataway, NJ, USA
| | - Eugenio José Guzmán
- Facultad de Psicología, Universidad del Desarrollo, Santiago de Chile, Chile
| | - Dzerassa Kadieva
- International Laboratory for Social Neurobiology, Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
| | - Maiko Kobayashi
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan
| | - Gafari Lukumon
- School of Collective Intelligence, Université Mohammed VI Polytechnique, Rabat, Morocco
| | - Marco Sartorio
- Laboratorio de Neurociencia, Universidad Torcuato Di Tella, Buenos Aires, Argentina
| | - Jiong Yang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| | - Oksana Zinchenko
- Intercultural Cognitive Network, Paris, France
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
| | - Bahador Bahrami
- Intercultural Cognitive Network, Paris, France
- Department of Psychology, Ludwig Maximilian University, Munich, Germany
| | - Jaime Silva Concha
- Intercultural Cognitive Network, Paris, France
- Facultad de Psicología, Universidad del Desarrollo, Santiago de Chile, Chile
| | - Uri Hertz
- Intercultural Cognitive Network, Paris, France
- Department of Cognitive Sciences, University of Haifa, Haifa, Israel
| | - Anna B Konova
- Intercultural Cognitive Network, Paris, France
- Department of Psychiatry, University Behavioral Health Care and Brain Health Institute, Rutgers University-New Brunswick, Piscataway, NJ, USA
| | - Jian Li
- Intercultural Cognitive Network, Paris, France
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, China
| | - Cathal O'Madagain
- Intercultural Cognitive Network, Paris, France
- School of Collective Intelligence, Université Mohammed VI Polytechnique, Rabat, Morocco
| | - Joaquin Navajas
- Intercultural Cognitive Network, Paris, France
- Laboratorio de Neurociencia, Universidad Torcuato Di Tella, Buenos Aires, Argentina
- Escuela de Negocios, Universidad Torcuato Di Tella, Buenos Aires, Argentina
- Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina
| | - Gabriel Reyes
- Intercultural Cognitive Network, Paris, France
- Facultad de Psicología, Universidad del Desarrollo, Santiago de Chile, Chile
| | - Atiye Sarabi-Jamab
- Intercultural Cognitive Network, Paris, France
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Tehran, Iran
| | - Anna Shestakova
- Intercultural Cognitive Network, Paris, France
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
| | - Bhasi Sukumaran
- Intercultural Cognitive Network, Paris, France
- Department of Clinical Psychology, SRM Medical College Hospital and Research Centre, Chennai, India
| | - Katsumi Watanabe
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan
- Intercultural Cognitive Network, Paris, France
| | - Stefano Palminteri
- Human Reinforcement Learning Team, Laboratory of Cognitive and Computational Neuroscience, Paris, France.
- Intercultural Cognitive Network, Paris, France.
- Departement d'études cognitives, Ecole normale supérieure, PSL Research University, Paris, France.
| |
Collapse
|
2
|
Houston AI, Rosenström TH. A critical review of risk-sensitive foraging. Biol Rev Camb Philos Soc 2024; 99:478-495. [PMID: 37987237 DOI: 10.1111/brv.13031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 10/31/2023] [Accepted: 11/01/2023] [Indexed: 11/22/2023]
Abstract
Foraging is risk sensitive if choices depend on the variability of returns from the options as well as their mean return. Risk-sensitive foraging is important in behavioural ecology, psychology and neurophysiology. It has been explained both in terms of mechanisms and in terms of evolutionary advantage. We provide a critical review, evaluating both mechanistic and evolutionary accounts. Some derivations of risk sensitivity from mechanistic models based on psychophysics are not convincing because they depend on an inappropriate use of Jensen's inequality. Attempts have been made to link risk sensitivity to the ecology of a species, but again these are not convincing. The field of risk-sensitive foraging has provided a focus for theoretical and empirical work and has yielded important insights, but we lack a simple and empirically defendable general account of it in either mechanistic or evolutionary terms. However, empirical analysis of choice sequences under theoretically motivated experimental designs and environmental settings appears a promising avenue for mapping the scope and relative merits of existing theories. Simply put, the devil is in the sequence.
Collapse
Affiliation(s)
- Alasdair I Houston
- School of Biological Sciences, University of Bristol, 24 Tyndall Avenue, Bristol, BS8 1TQ, UK
| | - Tom H Rosenström
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, PL 21 (Haartmaninkatu 3), 00014, Helsinki, Finland
| |
Collapse
|
3
|
Singletary NM, Gottlieb J, Horga G. The parieto-occipital cortex is a candidate neural substrate for the human ability to approximate Bayesian inference. Commun Biol 2024; 7:165. [PMID: 38337012 PMCID: PMC10858241 DOI: 10.1038/s42003-024-05821-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 01/15/2024] [Indexed: 02/12/2024] Open
Abstract
Adaptive decision-making often requires one to infer unobservable states based on incomplete information. Bayesian logic prescribes that individuals should do so by estimating the posterior probability by integrating the prior probability with new information, but the neural basis of this integration is incompletely understood. We record fMRI during a task in which participants infer the posterior probability of a hidden state while we independently modulate the prior probability and likelihood of evidence regarding the state; the task incentivizes participants to make accurate inferences and dissociates expected value from posterior probability. Here we show that activation in a region of left parieto-occipital cortex independently tracks the subjective posterior probability, combining its subcomponents of prior probability and evidence likelihood, and reflecting the individual participants' systematic deviations from objective probabilities. The parieto-occipital cortex is thus a candidate neural substrate for humans' ability to approximate Bayesian inference by integrating prior beliefs with new information.
Collapse
Affiliation(s)
- Nicholas M Singletary
- Doctoral Program in Neurobiology and Behavior, Columbia University, New York, NY, USA.
- Department of Neuroscience, Columbia University, New York, NY, USA.
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA.
- New York State Psychiatric Institute, New York, NY, USA.
| | - Jacqueline Gottlieb
- Department of Neuroscience, Columbia University, New York, NY, USA.
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA.
- Kavli Institute for Brain Science, Columbia University, New York, NY, USA.
| | - Guillermo Horga
- New York State Psychiatric Institute, New York, NY, USA.
- Department of Psychiatry, Columbia University, New York, NY, USA.
| |
Collapse
|
4
|
Singletary NM, Horga G, Gottlieb J. A Distinct Neural Code Supports Prospection of Future Probabilities During Instrumental Information-Seeking. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.27.568849. [PMID: 38076800 PMCID: PMC10705234 DOI: 10.1101/2023.11.27.568849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/24/2023]
Abstract
To make adaptive decisions, we must actively demand information, but relatively little is known about the mechanisms of active information gathering. An open question is how the brain estimates expected information gains (EIG) when comparing the current decision uncertainty with the uncertainty that is expected after gathering information. We examined this question using fMRI in a task in which people placed bids to obtain information in conditions that varied independently by prior decision uncertainty, information diagnosticity, and the penalty for an erroneous choice. Consistent with value of information theory, bids were sensitive to EIG and its components of prior certainty and expected posterior certainty. Expected posterior certainty was decoded above chance from multivoxel activation patterns in the posterior parietal and extrastriate cortices. This representation was independent of instrumental rewards and overlapped with distinct representations of EIG and prior certainty. Thus, posterior parietal and extrastriate cortices are candidates for mediating the prospection of posterior probabilities as a key step to estimate EIG during active information gathering.
Collapse
Affiliation(s)
- Nicholas M Singletary
- Doctoral Program in Neurobiology and Behavior, Columbia University, New York, NY, USA
- Department of Neuroscience, Columbia University, New York, NY, USA
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
- New York State Psychiatric Institute, New York, NY, USA
| | - Guillermo Horga
- New York State Psychiatric Institute, New York, NY, USA
- Department of Psychiatry, Columbia University, New York, NY, USA
- These authors contributed equally
| | - Jacqueline Gottlieb
- Department of Neuroscience, Columbia University, New York, NY, USA
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
- Kavli Institute for Brain Science, Columbia University, New York, NY, USA
- These authors contributed equally
| |
Collapse
|
5
|
Bao C, Zhu X, Mōller-Mara J, Li J, Dubroqua S, Erlich JC. The rat frontal orienting field dynamically encodes value for economic decisions under risk. Nat Neurosci 2023; 26:1942-1952. [PMID: 37857772 PMCID: PMC10620098 DOI: 10.1038/s41593-023-01461-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 09/11/2023] [Indexed: 10/21/2023]
Abstract
Frontal and parietal cortex are implicated in economic decision-making, but their causal roles are untested. Here we silenced the frontal orienting field (FOF) and posterior parietal cortex (PPC) while rats chose between a cued lottery and a small stable surebet. PPC inactivations produced minimal short-lived effects. FOF inactivations reliably reduced lottery choices. A mixed-agent model of choice indicated that silencing the FOF caused a change in the curvature of the rats' utility function (U = Vρ). Consistent with this finding, single-neuron and population analyses of neural activity confirmed that the FOF encodes the lottery value on each trial. A dynamical model, which accounts for electrophysiological and silencing results, suggests that the FOF represents the current lottery value to compare against the remembered surebet value. These results demonstrate that the FOF is a critical node in the neural circuit for the dynamic representation of action values for choice under risk.
Collapse
Affiliation(s)
- Chaofei Bao
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
- NYU Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), East China Normal University, Shanghai, China
- Sainsbury Wellcome Centre, University College London, London, UK
| | - Xiaoyue Zhu
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
- NYU Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), East China Normal University, Shanghai, China
| | - Joshua Mōller-Mara
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
- NYU Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), East China Normal University, Shanghai, China
| | - Jingjie Li
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
- NYU Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), East China Normal University, Shanghai, China
- Sainsbury Wellcome Centre, University College London, London, UK
| | - Sylvain Dubroqua
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
- NYU Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), East China Normal University, Shanghai, China
| | - Jeffrey C Erlich
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China.
- NYU Shanghai, Shanghai, China.
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), East China Normal University, Shanghai, China.
- Sainsbury Wellcome Centre, University College London, London, UK.
| |
Collapse
|
6
|
Zhu J, Yao Y, Jiang S. Vulnerability or resilience? Examining trust asymmetry from the perspective of risk sources under descriptive versus experiential decision. Front Psychol 2023; 14:1207453. [PMID: 37614493 PMCID: PMC10442566 DOI: 10.3389/fpsyg.2023.1207453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Accepted: 07/24/2023] [Indexed: 08/25/2023] Open
Abstract
Introduction The investigation of trust vulnerability is important to the understanding of the potential mechanisms of trust formation and erosion. However, more effective exploration of trust vulnerability has been hindered due to the lack of consideration of risk sources and types of information. Methods This study extended the investigation of asymmetry to both social and natural risk under experiential and descriptive decisions. Using the trust game as the decision-making paradigm and money as the subject matter, the research employed experimental methods to examine how people perceive and make decisions after being positively and negatively affected by natural and social risks. A total of 286 college students were participated in our study. Study 1 (n = 138) and Study 2 (n = 148) explored asymmetry in experiential and descriptive decision separately. Results The findings indicated that when considering experiential information, negative information had a greater effect in reducing trust compared to the enhancing effect of positive information (t = -1.95, p = 0.050). Moreover, the study revealed that negative information had a stronger negative impact in the context of social risks rather than natural risks (t = -3.26, p = 0.002), suggesting that trust is vulnerable both internally and externally. Conversely, when considering descriptive information, the effect of both positive and negative information on trust was symmetrical, and the impact of negative information was less significant compared to that of natural risks, indicating that trust has a certain level of resilience (t = 2.25, p = 0.028). Discussion The study emphasizes the importance of refining risk sources and information characteristics in complex scenarios in order to improve understanding of trust enhancement and repair.
Collapse
Affiliation(s)
| | - Yingying Yao
- Counseling and Education Center, Xiamen University, Xiamen, Fujian, China
| | | |
Collapse
|
7
|
Tymula A, Wang X, Imaizumi Y, Kawai T, Kunimatsu J, Matsumoto M, Yamada H. Dynamic prospect theory: Two core decision theories coexist in the gambling behavior of monkeys and humans. SCIENCE ADVANCES 2023; 9:eade7972. [PMID: 37205752 DOI: 10.1126/sciadv.ade7972] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Accepted: 04/14/2023] [Indexed: 05/21/2023]
Abstract
Research in the multidisciplinary field of neuroeconomics has mainly been driven by two influential theories regarding human economic choice: prospect theory, which describes decision-making under risk, and reinforcement learning theory, which describes learning for decision-making. We hypothesized that these two distinct theories guide decision-making in a comprehensive manner. Here, we propose and test a decision-making theory under uncertainty that combines these highly influential theories. Collecting many gambling decisions from laboratory monkeys allowed for reliable testing of our model and revealed a systematic violation of prospect theory's assumption that probability weighting is static. Using the same experimental paradigm in humans, substantial similarities between these species were uncovered by various econometric analyses of our dynamic prospect theory model, which incorporates decision-by-decision learning dynamics of prediction errors into static prospect theory. Our model provides a unified theoretical framework for exploring a neurobiological model of economic choice in human and nonhuman primates.
Collapse
Affiliation(s)
- Agnieszka Tymula
- School of Economics, University of Sydney, Sydney, NSW 2006, Australia
| | - Xueting Wang
- School of Economics, Finance and Marketing, College of Business and Law, RMIT University, Melbourne, VIC 2476, Australia
| | - Yuri Imaizumi
- Medical Sciences, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| | - Takashi Kawai
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| | - Jun Kunimatsu
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Transborder Medical Research Center, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| | - Masayuki Matsumoto
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Transborder Medical Research Center, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| | - Hiroshi Yamada
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Transborder Medical Research Center, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| |
Collapse
|
8
|
Experiential values are underweighted in decisions involving symbolic options. Nat Hum Behav 2023; 7:611-626. [PMID: 36604497 DOI: 10.1038/s41562-022-01496-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 11/04/2022] [Indexed: 01/07/2023]
Abstract
Standard models of decision-making assume each option is associated with subjective value, regardless of whether this value is inferred from experience (experiential) or explicitly instructed probabilistic outcomes (symbolic). In this study, we present results that challenge the assumption of unified representation of experiential and symbolic value. Across nine experiments, we presented participants with hybrid decisions between experiential and symbolic options. Participants' choices exhibited a pattern consistent with a systematic neglect of the experiential values. This normatively irrational decision strategy held after accounting for alternative explanations, and persisted even when it bore an economic cost. Overall, our results demonstrate that experiential and symbolic values are not symmetrically considered in hybrid decisions, suggesting they recruit different representational systems that may be assigned different priority levels in the decision process. These findings challenge the dominant models commonly used in value-based decision-making research.
Collapse
|
9
|
Chen C, Mochizuki Y, Hagiwara K, Hirotsu M, Matsubara T, Nakagawa S. Computational markers of experience- but not description-based decision-making are associated with future depressive symptoms in young adults. J Psychiatr Res 2022; 154:307-314. [PMID: 35973300 DOI: 10.1016/j.jpsychires.2022.08.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 07/07/2022] [Accepted: 08/03/2022] [Indexed: 11/29/2022]
Abstract
BACKGROUND Early prediction of high depressive symptoms is crucial for selective intervention and the minimization of functional impairment. Recent cross-sectional studies indicated decision-making deficits in depression, which may be an important contributor to the disorder. Our goal was to test whether description- and experience-based decision making, two major neuroeconomic paradigms of decision-making under uncertainty, predict future depressive symptoms in young adults. METHODS One hundred young adults performed two decision-making tasks, one description-based, in which subjects chose between two gambling options given explicitly stated rewards and their probabilities, and the other experience-based, in which subjects were shown rewards but had to learn the probability of those rewards (or cue-outcome contingencies) via trial-and-error experience. We evaluated subjects' depressive symptoms with BDI-II at baseline (T1) and half a year later (T2). RESULTS Comparing subjects with low versus high levels of depressive symptoms at T2 showed that the latter performed worse on the experience- but not description-based task at T1. Computational modeling of the decision-making process suggested that subjects with high levels of depressive symptoms had a more concave utility function, indicating enhanced risk aversion. Furthermore, a more concave utility function at T1 increased the odds of high depressive symptoms at T2, even after controlling depressive symptoms at T1, perceived stress at T2, and several covariates (OR = 0.251, 95% CI [0.085, 0.741]). CONCLUSIONS This is the first study to demonstrate a prospective link between experience-based decision-making and depressive symptoms. Our results suggest that enhanced risk aversion in experience-based decision-making may be an important contributor to the development of depressive symptoms.
Collapse
Affiliation(s)
- Chong Chen
- Division of Neuropsychiatry, Department of Neuroscience, Yamaguchi University Graduate School of Medicine, Ube, Yamaguchi, 755-8505, Japan.
| | - Yasuhiro Mochizuki
- Center for Data Science, Waseda University, 1-6-1 Nishiwaseda, Shinjuku-ku, Tokyo, 169-8050, Japan
| | - Kosuke Hagiwara
- Division of Neuropsychiatry, Department of Neuroscience, Yamaguchi University Graduate School of Medicine, Ube, Yamaguchi, 755-8505, Japan
| | - Masako Hirotsu
- Division of Neuropsychiatry, Department of Neuroscience, Yamaguchi University Graduate School of Medicine, Ube, Yamaguchi, 755-8505, Japan
| | - Toshio Matsubara
- Division of Neuropsychiatry, Department of Neuroscience, Yamaguchi University Graduate School of Medicine, Ube, Yamaguchi, 755-8505, Japan
| | - Shin Nakagawa
- Division of Neuropsychiatry, Department of Neuroscience, Yamaguchi University Graduate School of Medicine, Ube, Yamaguchi, 755-8505, Japan
| |
Collapse
|
10
|
Palminteri S, Lebreton M. The computational roots of positivity and confirmation biases in reinforcement learning. Trends Cogn Sci 2022; 26:607-621. [PMID: 35662490 DOI: 10.1016/j.tics.2022.04.005] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 04/13/2022] [Accepted: 04/18/2022] [Indexed: 12/16/2022]
Abstract
Humans do not integrate new information objectively: outcomes carrying a positive affective value and evidence confirming one's own prior belief are overweighed. Until recently, theoretical and empirical accounts of the positivity and confirmation biases assumed them to be specific to 'high-level' belief updates. We present evidence against this account. Learning rates in reinforcement learning (RL) tasks, estimated across different contexts and species, generally present the same characteristic asymmetry, suggesting that belief and value updating processes share key computational principles and distortions. This bias generates over-optimistic expectations about the probability of making the right choices and, consequently, generates over-optimistic reward expectations. We discuss the normative and neurobiological roots of these RL biases and their position within the greater picture of behavioral decision-making theories.
Collapse
Affiliation(s)
- Stefano Palminteri
- Laboratoire de Neurosciences Cognitives et Computationnelles, Institut National de la Santé et Recherche Médicale, Paris, France; Département d'Études Cognitives, Ecole Normale Supérieure, Paris, France; Université de Recherche Paris Sciences et Lettres, Paris, France.
| | - Maël Lebreton
- Paris School of Economics, Paris, France; LabNIC, Department of Fundamental Neurosciences, University of Geneva, Geneva, Switzerland; Swiss Center for Affective Science, Geneva, Switzerland.
| |
Collapse
|
11
|
Dennison JB, Sazhin D, Smith DV. Decision neuroscience and neuroeconomics: Recent progress and ongoing challenges. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2022; 13:e1589. [PMID: 35137549 PMCID: PMC9124684 DOI: 10.1002/wcs.1589] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2020] [Revised: 11/28/2021] [Accepted: 12/21/2021] [Indexed: 01/10/2023]
Abstract
In the past decade, decision neuroscience and neuroeconomics have developed many new insights in the study of decision making. This review provides an overarching update on how the field has advanced in this time period. Although our initial review a decade ago outlined several theoretical, conceptual, methodological, empirical, and practical challenges, there has only been limited progress in resolving these challenges. We summarize significant trends in decision neuroscience through the lens of the challenges outlined for the field and review examples where the field has had significant, direct, and applicable impacts across economics and psychology. First, we review progress on topics including reward learning, explore-exploit decisions, risk and ambiguity, intertemporal choice, and valuation. Next, we assess the impacts of emotion, social rewards, and social context on decision making. Then, we follow up with how individual differences impact choices and new exciting developments in the prediction and neuroforecasting of future decisions. Finally, we consider how trends in decision-neuroscience research reflect progress toward resolving past challenges, discuss new and exciting applications of recent research, and identify new challenges for the field. This article is categorized under: Psychology > Reasoning and Decision Making Psychology > Emotion and Motivation.
Collapse
Affiliation(s)
- Jeffrey B Dennison
- Department of Psychology, Temple University, Philadelphia, Pennsylvania, USA
| | - Daniel Sazhin
- Department of Psychology, Temple University, Philadelphia, Pennsylvania, USA
| | - David V Smith
- Department of Psychology, Temple University, Philadelphia, Pennsylvania, USA
| |
Collapse
|
12
|
Asymmetric valuation and belief updating over gain and loss in risky decision making: A behavioral and electrophysiological investigation. Behav Brain Res 2022; 429:113909. [DOI: 10.1016/j.bbr.2022.113909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Revised: 04/02/2022] [Accepted: 04/27/2022] [Indexed: 11/23/2022]
|
13
|
|
14
|
Hertz U, Bell V, Raihani N. Trusting and learning from others: immediate and long-term effects of learning from observation and advice. Proc Biol Sci 2021; 288:20211414. [PMID: 34666522 PMCID: PMC8527195 DOI: 10.1098/rspb.2021.1414] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Accepted: 09/29/2021] [Indexed: 11/16/2022] Open
Abstract
Social learning underpins our species's extraordinary success. Learning through observation has been investigated in several species, but learning from advice-where information is intentionally broadcast-is less understood. We used a pre-registered, online experiment (n = 1492) combined with computational modelling to examine learning through observation and advice. Participants were more likely to immediately follow advice than to copy an observed choice, but this was dependent upon trust in the adviser: highly paranoid participants were less likely to follow advice in the short term. Reinforcement learning modelling revealed two distinct patterns regarding the long-term effects of social information: some individuals relied fully on social information, whereas others reverted to trial-and-error learning. This variation may affect the prevalence and fidelity of socially transmitted information. Our results highlight the privileged status of advice relative to observation and how the assimilation of intentionally broadcast information is affected by trust in others.
Collapse
Affiliation(s)
- Uri Hertz
- Department of Cognitive Sciences, University of Haifa, Haifa, Israel
| | - Vaughan Bell
- Department of Clinical, Education and Health Psychology, University College London, London, UK
| | - Nichola Raihani
- Department of Experimental Psychology, University College London, WC1H 0AP, London, UK
| |
Collapse
|
15
|
Palminteri S, Lebreton M. Context-dependent outcome encoding in human reinforcement learning. Curr Opin Behav Sci 2021. [DOI: 10.1016/j.cobeha.2021.06.006] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
16
|
Nasseef OA, Baabdullah AM, Alalwan AA, Lal B, Dwivedi YK. Artificial intelligence-based public healthcare systems: G2G knowledge-based exchange to enhance the decision-making process. GOVERNMENT INFORMATION QUARTERLY 2021. [DOI: 10.1016/j.giq.2021.101618] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
17
|
Moeller M, Grohn J, Manohar S, Bogacz R. An association between prediction errors and risk-seeking: Theory and behavioral evidence. PLoS Comput Biol 2021; 17:e1009213. [PMID: 34270552 PMCID: PMC8318232 DOI: 10.1371/journal.pcbi.1009213] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2021] [Revised: 07/28/2021] [Accepted: 06/23/2021] [Indexed: 11/19/2022] Open
Abstract
Reward prediction errors (RPEs) and risk preferences have two things in common: both can shape decision making behavior, and both are commonly associated with dopamine. RPEs drive value learning and are thought to be represented in the phasic release of striatal dopamine. Risk preferences bias choices towards or away from uncertainty; they can be manipulated with drugs that target the dopaminergic system. Based on the common neural substrate, we hypothesize that RPEs and risk preferences are linked on the level of behavior as well. Here, we develop this hypothesis theoretically and test it empirically. First, we apply a recent theory of learning in the basal ganglia to predict how RPEs influence risk preferences. We find that positive RPEs should cause increased risk-seeking, while negative RPEs should cause risk-aversion. We then test our behavioral predictions using a novel bandit task in which value and risk vary independently across options. Critically, conditions are included where options vary in risk but are matched for value. We find that our prediction was correct: participants become more risk-seeking if choices are preceded by positive RPEs, and more risk-averse if choices are preceded by negative RPEs. These findings cannot be explained by other known effects, such as nonlinear utility curves or dynamic learning rates.
Collapse
Affiliation(s)
- Moritz Moeller
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Jan Grohn
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Sanjay Manohar
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Rafal Bogacz
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
18
|
Nioche A, Rougier NP, Deffains M, Bourgeois-Gironde S, Ballesta S, Boraud T. The adaptive value of probability distortion and risk-seeking in macaques' decision-making. Philos Trans R Soc Lond B Biol Sci 2021; 376:20190668. [PMID: 33423627 PMCID: PMC7815430 DOI: 10.1098/rstb.2019.0668] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/15/2020] [Indexed: 12/26/2022] Open
Abstract
In humans, the attitude toward risk is not neutral and is dissimilar between bets involving gains and bets involving losses. The existence and prevalence of these decision features in non-human primates are unclear. In addition, only a few studies have tried to simulate the evolution of agents based on their attitude toward risk. Therefore, we still ignore to what extent Prospect theory's claims are evolutionarily rooted. To shed light on this issue, we collected data from nine macaques that performed bets involving gains or losses. We confirmed that their overall behaviour is coherent with Prospect theory's claims. In parallel, we used a genetic algorithm to simulate the evolution of a population of agents across several generations. We showed that the algorithm selects progressively agents that exhibit risk-seeking, and has an inverted S-shape distorted perception of probability. We compared these two results and found that monkeys' attitude toward risk is only congruent with the simulation when they are facing losses. This result is consistent with the idea that gambling in the loss domain is analogous to deciding in a context of life-threatening challenges where a certain level of risk-seeking behaviour and probability distortion may be adaptive. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.
Collapse
Affiliation(s)
- A. Nioche
- Department of Communications and Networking, Aalto University, Espoo, Finland
| | - N. P. Rougier
- Inria Bordeaux Sud-Ouest, 33405 Talence, France
- Institut des Maladies Neurodégénératives, Université de Bordeaux, 33000 Bordeaux, France
- Institut des Maladies Neurodégénératives, CNRS, UMR, 5293, 33000 Bordeaux, France
- LaBRI, Université de Bordeaux, INP, CNRS, UMR, 5800, 33405 Talence, France
| | - M. Deffains
- Institut des Maladies Neurodégénératives, Université de Bordeaux, 33000 Bordeaux, France
- Institut des Maladies Neurodégénératives, CNRS, UMR, 5293, 33000 Bordeaux, France
| | - S. Bourgeois-Gironde
- Laboratoire d’Economie Mathématique et de Microéconomie Appliquée, Université Panthéon-Assas, 75006 Paris, France
- Institut Jean Nicod, Département d’Etudes Cognitives, ENS, EHESS, PSL Research University, 75005 Paris, France
- Institut Jean Nicod, CNRS, UMR 8129, 75005, Paris, France
| | - S. Ballesta
- Laboratoire de Neurosciences Cognitives et Adaptatives, UMR, 7364, 67000 Strasbourg, France
- Centre de Primatologie de l’Université de Strasbourg, 67207 Niederhausbergen, France
| | - T. Boraud
- Institut des Maladies Neurodégénératives, Université de Bordeaux, 33000 Bordeaux, France
- Institut des Maladies Neurodégénératives, CNRS, UMR, 5293, 33000 Bordeaux, France
- Centre Expert Parkinson, CHU Bordeaux, 33000 Bordeaux, France
| |
Collapse
|
19
|
Bourgeois-Gironde S, Addessi E, Boraud T. Economic behaviours among non-human primates. Philos Trans R Soc Lond B Biol Sci 2021; 376:20190676. [PMID: 33423625 PMCID: PMC7815433 DOI: 10.1098/rstb.2019.0676] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/12/2020] [Indexed: 12/24/2022] Open
Abstract
Do we have any valid reasons to affirm that non-human primates display economic behaviour in a sufficiently rich and precise sense of the phrase? To address this question, we have to develop a set of criteria to assess the vast array of experimental studies and field observations on individual cognitive and behavioural competences as well as the collective organization of non-human primates. We review a sample of these studies and assess how they answer to the following four main challenges. (i) Do we see any economic organization or institutions emerge among groups of non-human primates? (ii) Are the cognitive abilities, and often biases, that have been evidenced as underlying typical economic decision-making among humans, also present among non-human primates? (iii) Can we draw positive lessons from performance comparisons among primate species, humans and non-humans but also across non-human primate species, as elicited by canonical game-theoretical experimental paradigms, especially as far as economic cooperation and coordination are concerned? And (iv) in which way should we improve models and paradigms to obtain more ecological data and conclusions? Articles discussed in this paper most often bring about positive answers and promising perspectives to support the existence and prevalence of economic behaviours among non-human primates. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.
Collapse
Affiliation(s)
- Sacha Bourgeois-Gironde
- Institut Jean Nicod, Département d’études cognitives, ENS, EHESS, CNRS, PSLUniversity, France
| | - Elsa Addessi
- Unità di Primatologia Cognitiva e Centro Primati, Istituto di Scienze e Tecnologie della Cognizione, Consiglio Nazionale delle Ricerche, 00197 Rome, Italy
| | - Thomas Boraud
- CNRS, UMR 5293, IMN, 33000 Bordeaux, France
- University of Bordeaux, UMR 5293, IMN, 33000, Bordeaux, France
- CHU de Bordeaux, IMN Clinique, 33000 Bordeaux, France
| |
Collapse
|
20
|
Sallet J, Emberton A, Wood J, Rushworth M. Impact of internal and external factors on prosocial choices in rhesus macaques. Philos Trans R Soc Lond B Biol Sci 2021; 376:20190678. [PMID: 33423628 PMCID: PMC7815427 DOI: 10.1098/rstb.2019.0678] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
While traditional economic models assume that agents are self-interested, humans and most non-human primates are social species. Therefore, many of decisions they make require the integration of information about other social agents. This study asks to what extent information about social status and the social context in which decisions are taken impact on reward-guided decisions in rhesus macaques. We tested 12 monkeys of varying dominance status in several experimental versions of a two-choice task in which reward could be delivered to self only, only another monkey, both the self and another monkey, or neither. Results showed dominant animals were more prone to make prosocial choices than subordinates, but only when the decision was between a reward for self only and a reward for both self and other. If the choice was between a reward for self only and a reward for other only, no animal expressed altruistic behaviour. Finally, prosocial choices were true social decisions as they were strikingly reduced when the social partner was replaced by a non-social object. These results showed that as in humans, rhesus macaques' social decisions are adaptive and modulated by social status and the cost associated with being prosocial. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.
Collapse
Affiliation(s)
- Jérôme Sallet
- Wellcome Integrative Neuroimaging Centre, Department of Experimental Psychology, Oxford, OX1 3SR, UK.,Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
| | - Andrew Emberton
- Biomedical Sciences Services, University of Oxford, Oxford, OX1 3SR, UK
| | - Jessica Wood
- Biomedical Sciences Services, University of Oxford, Oxford, OX1 3SR, UK
| | - Matthew Rushworth
- Wellcome Integrative Neuroimaging Centre, Department of Experimental Psychology, Oxford, OX1 3SR, UK
| |
Collapse
|
21
|
Keupp S, Grueneisen S, Ludvig EA, Warneken F, Melis AP. Reduced risk-seeking in chimpanzees in a zero-outcome game. Philos Trans R Soc Lond B Biol Sci 2021; 376:20190673. [PMID: 33423631 PMCID: PMC7815432 DOI: 10.1098/rstb.2019.0673] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
A key component of economic decisions is the integration of information about reward outcomes and probabilities in selecting between competing options. In many species, risky choice is influenced by the magnitude of available outcomes, probability of success and the possibility of extreme outcomes. Chimpanzees are generally regarded to be risk-seeking. In this study, we examined two aspects of chimpanzees' risk preferences: first, whether setting the value of the non-preferred outcome of a risky option to zero changes chimpanzees’ risk preferences, and second, whether individual risk preferences are stable across two different measures. Across two experiments, we found chimpanzees (Pan troglodytes, n = 23) as a group to be risk-neutral to risk-avoidant with highly stable individual risk preferences. We discuss how the possibility of going empty-handed might reduce chimpanzees' risk-seeking relative to previous studies. This malleability in risk preferences as a function of experimental parameters and individual differences raises interesting questions about whether it is appropriate or helpful to categorize a species as a whole as risk-seeking or risk-avoidant. This article is part of the theme issue ‘Existence and prevalence of economic behaviours among non-human primates’.
Collapse
Affiliation(s)
- Stefanie Keupp
- Department of Psychology, University of Warwick, University Road, Coventry CV4 7AL, UK.,Experimental Psychology, University College London, 26 Bedford Way, London WC1H 0AP, UK
| | - Sebastian Grueneisen
- Department of Psychology, University of Michigan, 530 Church Street, Ann Arbor, MI 48109-1043, USA.,Center for Adaptive Rationality, Max Planck Institute for Human Development, Lentzeallee 94, 14195 Berlin, Germany
| | - Elliot A Ludvig
- Department of Psychology, University of Warwick, University Road, Coventry CV4 7AL, UK
| | - Felix Warneken
- Department of Psychology, University of Michigan, 530 Church Street, Ann Arbor, MI 48109-1043, USA
| | - Alicia P Melis
- Experimental Psychology, University College London, 26 Bedford Way, London WC1H 0AP, UK
| |
Collapse
|