1
|
Veselic S, Muller TH, Gutierrez E, Behrens TEJ, Hunt LT, Butler JL, Kennerley SW. A cognitive map for value-guided choice in ventromedial prefrontal cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.15.571895. [PMID: 38168410 PMCID: PMC10760117 DOI: 10.1101/2023.12.15.571895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2024]
Abstract
The prefrontal cortex is crucial for economic decision-making and representing the value of options. However, how such representations facilitate flexible decisions remains unknown. We reframe economic decision-making in prefrontal cortex in line with representations of structure within the medial temporal lobe because such cognitive map representations are known to facilitate flexible behaviour. Specifically, we framed choice between different options as a navigation process in value space. Here we show that choices in a 2D value space defined by reward magnitude and probability were represented with a grid-like code, analogous to that found in spatial navigation. The grid-like code was present in ventromedial prefrontal cortex (vmPFC) local field potential theta frequency and the result replicated in an independent dataset. Neurons in vmPFC similarly contained a grid-like code, in addition to encoding the linear value of the chosen option. Importantly, both signals were modulated by theta frequency - occurring at theta troughs but on separate theta cycles. Furthermore, we found sharp-wave ripples - a key neural signature of planning and flexible behaviour - in vmPFC, which were modulated by accuracy and reward. These results demonstrate that multiple cognitive map-like computations are deployed in vmPFC during economic decision-making, suggesting a new framework for the implementation of choice in prefrontal cortex.
Collapse
Affiliation(s)
- Sebastijan Veselic
- Department of Experimental Psychology, University of Oxford, UK
- Clinical and Movement Neurosciences, Department of Motor Neuroscience, University College London, London, UK
| | - Timothy H Muller
- Department of Experimental Psychology, University of Oxford, UK
- Clinical and Movement Neurosciences, Department of Motor Neuroscience, University College London, London, UK
| | - Elena Gutierrez
- Department of Experimental Psychology, University of Oxford, UK
- Clinical and Movement Neurosciences, Department of Motor Neuroscience, University College London, London, UK
| | - Timothy E J Behrens
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, FMRIB, John Radcliffe Hospital, Oxford, UK
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour College, University College London, London, UK
| | - Laurence T Hunt
- Department of Experimental Psychology, University of Oxford, UK
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - James L Butler
- Department of Experimental Psychology, University of Oxford, UK
| | - Steven W Kennerley
- Department of Experimental Psychology, University of Oxford, UK
- Clinical and Movement Neurosciences, Department of Motor Neuroscience, University College London, London, UK
| |
Collapse
|
2
|
Ferrari-Toniolo S, Schultz W. Reliable population code for subjective economic value from heterogeneous neuronal signals in primate orbitofrontal cortex. Neuron 2023; 111:3683-3696.e7. [PMID: 37678250 DOI: 10.1016/j.neuron.2023.08.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 03/31/2023] [Accepted: 08/08/2023] [Indexed: 09/09/2023]
Abstract
Behavior-related neuronal signals often vary between neurons, which might reflect the unreliability of individual neurons or a truly heterogeneous code. This notion may also apply to economic ("value-based") choices and the underlying reward signals. Reward value is subjective and can be described by a nonlinearly weighted magnitude (utility) and probability. Defining subjective values relies on the continuity axiom, whose testing involves structured variations of a wide range of reward magnitudes and probabilities. Axiom compliance demonstrates understanding of the stimuli and the meaningful character of choices. Using these tests, we investigated the encoding of subjective economic value by neurons in a key economic-decision structure of the monkey brain, the orbitofrontal cortex (OFC). We found that individual neurons carry heterogeneous neuronal value signals that largely fail to match the animal's choices. However, neuronal population signals matched the animal's choices well, suggesting accurate subjective economic value encoding by a heterogeneous population of unreliable neurons.
Collapse
Affiliation(s)
- Simone Ferrari-Toniolo
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, UK.
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, UK
| |
Collapse
|
3
|
Wang TY, Zhang H. Research on the game of manufacturing capacity sharing based on prospect theory. Sci Rep 2023; 13:18093. [PMID: 37872181 PMCID: PMC10593761 DOI: 10.1038/s41598-023-45189-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 10/17/2023] [Indexed: 10/25/2023] Open
Abstract
In order to investigate the strategy choice of each player in capacity sharing, the article constructs a tripartite game model based on capacity provider-capacity demander-government, introduces the prospect theory and conducts numerical simulation analysis using MATLAB. The results show that capacity sharing in the manufacturing industry is related to three parties: capacity providers, capacity demanders and the government, and their strategies in the game process influence each other; the sensitivity of capacity providers and capacity demanders is higher than that of the government; the increase of risk-return coefficient and loss-avoidance coefficient is conducive to the evolution of subjects to the ideal state.
Collapse
Affiliation(s)
- Tian-Yu Wang
- School of Economics and Management, Jiangsu University of Science and Technology, Zhenjiang, 212100, China
| | - Hao Zhang
- School of Economics and Management, Jiangsu University of Science and Technology, Zhenjiang, 212100, China.
| |
Collapse
|
4
|
Tymula A, Wang X, Imaizumi Y, Kawai T, Kunimatsu J, Matsumoto M, Yamada H. Dynamic prospect theory: Two core decision theories coexist in the gambling behavior of monkeys and humans. SCIENCE ADVANCES 2023; 9:eade7972. [PMID: 37205752 DOI: 10.1126/sciadv.ade7972] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Accepted: 04/14/2023] [Indexed: 05/21/2023]
Abstract
Research in the multidisciplinary field of neuroeconomics has mainly been driven by two influential theories regarding human economic choice: prospect theory, which describes decision-making under risk, and reinforcement learning theory, which describes learning for decision-making. We hypothesized that these two distinct theories guide decision-making in a comprehensive manner. Here, we propose and test a decision-making theory under uncertainty that combines these highly influential theories. Collecting many gambling decisions from laboratory monkeys allowed for reliable testing of our model and revealed a systematic violation of prospect theory's assumption that probability weighting is static. Using the same experimental paradigm in humans, substantial similarities between these species were uncovered by various econometric analyses of our dynamic prospect theory model, which incorporates decision-by-decision learning dynamics of prediction errors into static prospect theory. Our model provides a unified theoretical framework for exploring a neurobiological model of economic choice in human and nonhuman primates.
Collapse
Affiliation(s)
- Agnieszka Tymula
- School of Economics, University of Sydney, Sydney, NSW 2006, Australia
| | - Xueting Wang
- School of Economics, Finance and Marketing, College of Business and Law, RMIT University, Melbourne, VIC 2476, Australia
| | - Yuri Imaizumi
- Medical Sciences, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| | - Takashi Kawai
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| | - Jun Kunimatsu
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Transborder Medical Research Center, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| | - Masayuki Matsumoto
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Transborder Medical Research Center, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| | - Hiroshi Yamada
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
- Transborder Medical Research Center, University of Tsukuba, 1-1-1 Tenno-dai, Tsukuba, Ibaraki 305-8577, Japan
| |
Collapse
|