1
|
Stoll FM, Rudebeck PH. Dissociable Representations of Decision Variables within Subdivisions of the Macaque Orbital and Ventrolateral Frontal Cortex. J Neurosci 2024; 44:e0464242024. [PMID: 38991790 PMCID: PMC11358530 DOI: 10.1523/jneurosci.0464-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Revised: 06/07/2024] [Accepted: 07/03/2024] [Indexed: 07/13/2024] Open
Abstract
The ventral frontal cortex (VFC) in macaques is involved in many affective and cognitive processes and has a key role in flexibly guiding reward-based decision-making. VFC is composed of a set of anatomically distinct subdivisions that are within the orbitofrontal cortex, ventrolateral prefrontal cortex, and anterior insula. In part, because prior studies have lacked the resolution to test for differences, it is unclear if neural representations related to decision-making are dissociable across these subdivisions. Here we recorded the activity of thousands of neurons within eight anatomically defined subdivisions of VFC in male macaque monkeys performing a two-choice probabilistic task for different fruit juice outcomes. We found substantial variation in the encoding of decision variables across these eight subdivisions. Notably, ventrolateral Area 12l was unique relative to the other areas that we recorded from as the activity of single neurons integrated multiple attributes when monkeys evaluated the different choice options. Activity within Area 12o, in contrast, more closely represented reward probability and whether reward was received on a given trial. Orbitofrontal Area 11m/l contained more specific representations of the quality of the outcome that could be earned later on. We also found that reward delivery encoding was highly distributed across all VFC subdivisions, while the properties of the reward, such as its flavor, were more strongly represented in Areas 11m/l and 13m. Taken together, our work reveals the diversity of encoding within the various anatomically distinct subdivisions of VFC in primates.
Collapse
Affiliation(s)
- Frederic M Stoll
- Nash Family Department of Neuroscience, Lipschultz Center for Cognitive Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, New York 10029
| | - Peter H Rudebeck
- Nash Family Department of Neuroscience, Lipschultz Center for Cognitive Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, New York 10029
| |
Collapse
|
2
|
Liu C, Yu R. Neural mechanisms underpinning metacognitive shifts driven by non-informative predictions. Neuroimage 2024; 296:120670. [PMID: 38848980 DOI: 10.1016/j.neuroimage.2024.120670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Revised: 05/10/2024] [Accepted: 06/05/2024] [Indexed: 06/09/2024] Open
Abstract
Humans constantly make predictions and such predictions allow us to prepare for future events. Yet, such benefits may come with drawbacks as premature predictions may potentially bias subsequent judgments. Here we examined how prediction influences our perceptual decisions and subsequent confidence judgments, on scenarios where the predictions were arbitrary and independent of the identity of the upcoming stimuli. We defined them as invalid and non-informative predictions. Behavioral results showed that, such non-informative predictions biased perceptual decisions in favor of the predicted choice, and such prediction-induced perceptual bias further increased the metacognitive efficiency. The functional MRI results showed that activities in the medial prefrontal cortex (mPFC) and subgenual anterior cingulate cortex (sgACC) encoded the response consistency between predictions and perceptual decisions. Activity in mPFC predicted the strength of this congruency bias across individuals. Moreover, the parametric encoding of confidence in putamen was modulated by prediction-choice consistency, such that activity in putamen was negatively correlated with confidence rating after inconsistent responses. These findings suggest that predictions, while made arbitrarily, orchestrate the neural representations of choice and confidence judgment.
Collapse
Affiliation(s)
- Cuizhen Liu
- School of Psychology, Shaanxi Normal University, Xi'an 710062, PR China
| | - Rongjun Yu
- Department of Management, Marketing, and Information Systems, Hong Kong Baptist University, Hong Kong 999077, PR China.
| |
Collapse
|
3
|
Jurewicz K, Sleezer BJ, Mehta PS, Hayden BY, Ebitz RB. Irrational choices via a curvilinear representational geometry for value. Nat Commun 2024; 15:6424. [PMID: 39080250 PMCID: PMC11289086 DOI: 10.1038/s41467-024-49568-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 06/06/2024] [Indexed: 08/02/2024] Open
Abstract
We make decisions by comparing values, but it is not yet clear how value is represented in the brain. Many models assume, if only implicitly, that the representational geometry of value is linear. However, in part due to a historical focus on noisy single neurons, rather than neuronal populations, this hypothesis has not been rigorously tested. Here, we examine the representational geometry of value in the ventromedial prefrontal cortex (vmPFC), a part of the brain linked to economic decision-making, in two male rhesus macaques. We find that values are encoded along a curved manifold in vmPFC. This curvilinear geometry predicts a specific pattern of irrational decision-making: that decision-makers will make worse choices when an irrelevant, decoy option is worse in value, compared to when it is better. We observe this type of irrational choices in behavior. Together, these results not only suggest that the representational geometry of value is nonlinear, but that this nonlinearity could impose bounds on rational decision-making.
Collapse
Affiliation(s)
- Katarzyna Jurewicz
- Department of Neurosciences, Faculté de médecine, and Centre interdisciplinaire de recherche sur le cerveau et l'apprentissage, Université de Montréal, Montréal, QC, Canada
- Department of Physiology, Faculty of Medicine and Health Sciences, McGill University, Montréal, QC, Canada
| | - Brianna J Sleezer
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
| | - Priyanka S Mehta
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Psychology Program, Department of Human Behavior, Justice, and Diversity, University of Wisconsin, Superior, Superior, WI, USA
| | - Benjamin Y Hayden
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - R Becket Ebitz
- Department of Neurosciences, Faculté de médecine, and Centre interdisciplinaire de recherche sur le cerveau et l'apprentissage, Université de Montréal, Montréal, QC, Canada.
| |
Collapse
|
4
|
Ferro D, Cash-Padgett T, Wang MZ, Hayden BY, Moreno-Bote R. Gaze-centered gating, reactivation, and reevaluation of economic value in orbitofrontal cortex. Nat Commun 2024; 15:6163. [PMID: 39039055 PMCID: PMC11263430 DOI: 10.1038/s41467-024-50214-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Accepted: 07/03/2024] [Indexed: 07/24/2024] Open
Abstract
During economic choice, options are often considered in alternation, until commitment. Nonetheless, neuroeconomics typically ignores the dynamic aspects of deliberation. We trained two male macaques to perform a value-based decision-making task in which two risky offers were presented in sequence at the opposite sides of the visual field, each followed by a delay epoch where offers were invisible. Surprisingly, during the two delays, subjects tend to look at empty locations where the offers had previously appeared, with longer fixations increasing the probability of choosing the associated offer. Spiking activity in orbitofrontal cortex reflects the value of the gazed offer, or of the offer associated with the gazed empty spatial location, even if it is not the most recent. This reactivation reflects a reevaluation process, as fluctuations in neural spiking correlate with upcoming choice. Our results suggest that look-at-nothing gazing triggers the reactivation of a previously seen offer for further evaluation.
Collapse
Affiliation(s)
- Demetrio Ferro
- Center for Brain and Cognition, Universitat Pompeu Fabra, 08002, Barcelona, Spain.
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, 08002, Barcelona, Spain.
| | - Tyler Cash-Padgett
- Department of Neuroscience, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN55455, USA
| | - Maya Zhe Wang
- Department of Neuroscience, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN55455, USA
| | - Benjamin Y Hayden
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Rubén Moreno-Bote
- Center for Brain and Cognition, Universitat Pompeu Fabra, 08002, Barcelona, Spain
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, 08002, Barcelona, Spain
- Serra Húnter Fellow Programme, Universitat Pompeu Fabra, Barcelona, Spain
| |
Collapse
|
5
|
Hajnal MA, Tran D, Szabó Z, Albert A, Safaryan K, Einstein M, Vallejo Martelo M, Polack PO, Golshani P, Orbán G. Shifts in attention drive context-dependent subspace encoding in anterior cingulate cortex in mice during decision making. Nat Commun 2024; 15:5559. [PMID: 38956080 PMCID: PMC11220070 DOI: 10.1038/s41467-024-49845-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 06/19/2024] [Indexed: 07/04/2024] Open
Abstract
Attention supports decision making by selecting the features that are relevant for decisions. Selective enhancement of the relevant features and inhibition of distractors has been proposed as potential neural mechanisms driving this selection process. Yet, how attention operates when relevance cannot be directly determined, and the attention signal needs to be internally constructed is less understood. Here we recorded from populations of neurons in the anterior cingulate cortex (ACC) of mice in an attention-shifting task where relevance of stimulus modalities changed across blocks of trials. In contrast with V1 recordings, decoding of the irrelevant modality gradually declined in ACC after an initial transient. Our analytical proof and a recurrent neural network model of the task revealed mutually inhibiting connections that produced context-gated suppression as observed in mice. Using this RNN model we predicted a correlation between contextual modulation of individual neurons and their stimulus drive, which we confirmed in ACC but not in V1.
Collapse
Affiliation(s)
- Márton Albert Hajnal
- Department of Computational Sciences, HUN-REN Wigner Research Centre for Physics, Budapest, Hungary.
| | - Duy Tran
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
- Albert Einstein College of Medicine, New York, NY, USA
| | - Zsombor Szabó
- Department of Computational Sciences, HUN-REN Wigner Research Centre for Physics, Budapest, Hungary
| | - Andrea Albert
- Department of Computational Sciences, HUN-REN Wigner Research Centre for Physics, Budapest, Hungary
| | - Karen Safaryan
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Michael Einstein
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Mauricio Vallejo Martelo
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Pierre-Olivier Polack
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, NJ, USA
| | - Peyman Golshani
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA.
- Integrative Center for Learning and Memory, Brain Research Institute, University of California, Los Angeles, Los Angeles, CA, USA.
- West Los Angeles VA Medical Center, Los Angeles, CA, USA.
| | - Gergő Orbán
- Department of Computational Sciences, HUN-REN Wigner Research Centre for Physics, Budapest, Hungary.
| |
Collapse
|
6
|
Combrisson E, Basanisi R, Gueguen MCM, Rheims S, Kahane P, Bastin J, Brovelli A. Neural interactions in the human frontal cortex dissociate reward and punishment learning. eLife 2024; 12:RP92938. [PMID: 38941238 PMCID: PMC11213568 DOI: 10.7554/elife.92938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/30/2024] Open
Abstract
How human prefrontal and insular regions interact while maximizing rewards and minimizing punishments is unknown. Capitalizing on human intracranial recordings, we demonstrate that the functional specificity toward reward or punishment learning is better disentangled by interactions compared to local representations. Prefrontal and insular cortices display non-selective neural populations to rewards and punishments. Non-selective responses, however, give rise to context-specific interareal interactions. We identify a reward subsystem with redundant interactions between the orbitofrontal and ventromedial prefrontal cortices, with a driving role of the latter. In addition, we find a punishment subsystem with redundant interactions between the insular and dorsolateral cortices, with a driving role of the insula. Finally, switching between reward and punishment learning is mediated by synergistic interactions between the two subsystems. These results provide a unifying explanation of distributed cortical representations and interactions supporting reward and punishment learning.
Collapse
Affiliation(s)
- Etienne Combrisson
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| | - Ruggero Basanisi
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| | - Maelle CM Gueguen
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut NeurosciencesGrenobleFrance
| | - Sylvain Rheims
- Department of Functional Neurology and Epileptology, Hospices Civils de Lyon and University of LyonLyonFrance
| | - Philippe Kahane
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut NeurosciencesGrenobleFrance
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut NeurosciencesGrenobleFrance
| | - Andrea Brovelli
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| |
Collapse
|
7
|
Sharma D, Lupkin SM, McGinty VB. Orbitofrontal high-gamma reflects spike-dissociable value and decision mechanisms. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.02.587758. [PMID: 38617349 PMCID: PMC11014579 DOI: 10.1101/2024.04.02.587758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/16/2024]
Abstract
The orbitofrontal cortex (OFC) plays a crucial role in value-based decision-making. While previous research has focused on spiking activity in OFC neurons, the role of OFC local field potentials (LFPs) in decision-making remains unclear. LFPs are important because they can reflect synaptic and subthreshold activity not directly coupled to spiking, and because they are potential targets for less invasive forms of brain-machine interface (BMI). We recorded LFPs and spiking activity using multi-channel vertical probes while monkeys performed a two-option value-based decision-making task. We compared the value- and decision-coding properties of high-gamma range LFPs (HG, 50-150 Hz) to the coding properties of spiking multi-unit activity (MUA) recorded concurrently on the same electrodes. Results show that HG and MUA both represent the values of decision targets, and that their representations have similar temporal profiles in a trial. However, we also identified value-coding properties of HG that were dissociable from the concurrently-measured MUA. On average across channels, HG amplitude increased monotonically with value, whereas the average value encoding in MUA was net neutral. HG also encoded a signal consistent with a comparison between the values of the two targets, a signal which was much weaker in MUA. In individual channels, HG was better able to predict choice outcomes than MUA; however, when simultaneously recorded channels were combined in population-based decoder, MUA provided more accurate predictions than HG. Interestingly, HG value representations were accentuated in channels in or near shallow cortical layers, suggesting a dissociation between neuronal sources of HG and MUA. In summary, we find that HG signals are dissociable from MUA with respect to cognitive variables encoded in prefrontal cortex, evident in the monotonic encoding of value, stronger encoding of value comparisons, and more accurate predictions about behavior. High-frequency LFPs may therefore be a viable - or even preferable - target for BMIs to assist cognitive function, opening the possibility for less invasive access to mental contents that would otherwise be observable only with spike-based measures.
Collapse
Affiliation(s)
- Dixit Sharma
- Center for Molecular and Behavioral Neuroscience, Rutgers University – Newark
- Graduate Program in Neuroscience, Rutgers University – Newark
| | - Shira M. Lupkin
- Center for Molecular and Behavioral Neuroscience, Rutgers University – Newark
- Graduate Program in Neuroscience, Rutgers University – Newark
| | - Vincent B. McGinty
- Center for Molecular and Behavioral Neuroscience, Rutgers University – Newark
| |
Collapse
|
8
|
Veselic S, Muller TH, Gutierrez E, Behrens TEJ, Hunt LT, Butler JL, Kennerley SW. A cognitive map for value-guided choice in ventromedial prefrontal cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.15.571895. [PMID: 38168410 PMCID: PMC10760117 DOI: 10.1101/2023.12.15.571895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2024]
Abstract
The prefrontal cortex is crucial for economic decision-making and representing the value of options. However, how such representations facilitate flexible decisions remains unknown. We reframe economic decision-making in prefrontal cortex in line with representations of structure within the medial temporal lobe because such cognitive map representations are known to facilitate flexible behaviour. Specifically, we framed choice between different options as a navigation process in value space. Here we show that choices in a 2D value space defined by reward magnitude and probability were represented with a grid-like code, analogous to that found in spatial navigation. The grid-like code was present in ventromedial prefrontal cortex (vmPFC) local field potential theta frequency and the result replicated in an independent dataset. Neurons in vmPFC similarly contained a grid-like code, in addition to encoding the linear value of the chosen option. Importantly, both signals were modulated by theta frequency - occurring at theta troughs but on separate theta cycles. Furthermore, we found sharp-wave ripples - a key neural signature of planning and flexible behaviour - in vmPFC, which were modulated by accuracy and reward. These results demonstrate that multiple cognitive map-like computations are deployed in vmPFC during economic decision-making, suggesting a new framework for the implementation of choice in prefrontal cortex.
Collapse
Affiliation(s)
- Sebastijan Veselic
- Department of Experimental Psychology, University of Oxford, UK
- Clinical and Movement Neurosciences, Department of Motor Neuroscience, University College London, London, UK
| | - Timothy H Muller
- Department of Experimental Psychology, University of Oxford, UK
- Clinical and Movement Neurosciences, Department of Motor Neuroscience, University College London, London, UK
| | - Elena Gutierrez
- Department of Experimental Psychology, University of Oxford, UK
- Clinical and Movement Neurosciences, Department of Motor Neuroscience, University College London, London, UK
| | - Timothy E J Behrens
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, FMRIB, John Radcliffe Hospital, Oxford, UK
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour College, University College London, London, UK
| | - Laurence T Hunt
- Department of Experimental Psychology, University of Oxford, UK
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - James L Butler
- Department of Experimental Psychology, University of Oxford, UK
| | - Steven W Kennerley
- Department of Experimental Psychology, University of Oxford, UK
- Clinical and Movement Neurosciences, Department of Motor Neuroscience, University College London, London, UK
| |
Collapse
|
9
|
Xiang S, Jia T, Xie C, Zhu Z, Cheng W, Schumann G, Robbins TW, Feng J. Fractionation of neural reward processing into independent components by novel decoding principle. Neuroimage 2023; 284:120463. [PMID: 37989457 DOI: 10.1016/j.neuroimage.2023.120463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Revised: 11/12/2023] [Accepted: 11/17/2023] [Indexed: 11/23/2023] Open
Abstract
How to retrieve latent neurobehavioural processes from complex neurobiological signals is an important yet unresolved challenge. Here, we develop a novel approach, orthogonal-Decoding multi-Cognitive Processes (DeCoP), to reveal underlying latent neurobehavioural processing and show that its performance is superior to traditional non-orthogonal decoding in terms of both false inference and robustness. Processing value and salience information are two fundamental but mutually confounded pathways of reward reinforcement essential for decision making. During reward/punishment anticipation, we applied DeCoP to decode brain-wide responses into spatially overlapping, yet functionally independent, evaluation and readiness processes, which are modulated differentially by meso‑limbic vs nigro-striatal dopamine systems. Using DeCoP, we further demonstrated that most brain regions only encoded abstract information but not the exact input, except for dorsal anterior cingulate cortex and insula. Furthermore, we anticipate our novel analytical principle to be applied generally in decoding multiple latent neurobehavioral processes and thus advance both the design and hypothesis testing for cognitive tasks.
Collapse
Affiliation(s)
- Shitong Xiang
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China; Ministry of Education, Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), China
| | - Tianye Jia
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China; Ministry of Education, Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), China; Centre for Population Neuroscience and Precision Medicine (PONS), Institute of Psychiatry, Psychology & Neuroscience, SGDP Centre, King's College London, SE5 8AF, United Kingdom; Centre for Population Neuroscience and Precision Medicine (PONS), Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
| | - Chao Xie
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China; Ministry of Education, Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), China
| | - Zhichao Zhu
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China; Ministry of Education, Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), China
| | - Wei Cheng
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China; Ministry of Education, Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), China
| | - Gunter Schumann
- Centre for Population Neuroscience and Precision Medicine (PONS), Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China; Department of Psychiatry and Psychotherapy, Centre for Population Neuroscience and Precision Medicine (PONS), CCM, Charite Universitaetsmedizin, Berlin, Germany
| | - Trevor W Robbins
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China; Ministry of Education, Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), China; Department of Psychology and Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge, United Kingdom
| | - Jianfeng Feng
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China; Ministry of Education, Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), China; Department of Computer Science, University of Warwick, Coventry, United Kingdom; School of Mathematical Sciences and Centre for Computational Systems Biology, Fudan University, Shanghai, China.
| |
Collapse
|
10
|
Grabenhorst F, Ponce-Alvarez A, Battaglia-Mayer A, Deco G, Schultz W. A view-based decision mechanism for rewards in the primate amygdala. Neuron 2023; 111:3871-3884.e14. [PMID: 37725980 PMCID: PMC10914681 DOI: 10.1016/j.neuron.2023.08.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Revised: 07/12/2023] [Accepted: 08/23/2023] [Indexed: 09/21/2023]
Abstract
Primates make decisions visually by shifting their view from one object to the next, comparing values between objects, and choosing the best reward, even before acting. Here, we show that when monkeys make value-guided choices, amygdala neurons encode their decisions in an abstract, purely internal representation defined by the monkey's current view but not by specific object or reward properties. Across amygdala subdivisions, recorded activity patterns evolved gradually from an object-specific value code to a transient, object-independent code in which currently viewed and last-viewed objects competed to reflect the emerging view-based choice. Using neural-network modeling, we identified a sequence of computations by which amygdala neurons implemented view-based decision making and eventually recovered the chosen object's identity when the monkeys acted on their choice. These findings reveal a neural mechanism in the amygdala that derives object choices from abstract, view-based computations, suggesting an efficient solution for decision problems with many objects.
Collapse
Affiliation(s)
- Fabian Grabenhorst
- Department of Experimental Psychology, University of Oxford, Mansfield Road, Oxford OX1 3TA, UK; Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, UK.
| | - Adrián Ponce-Alvarez
- Center for Brain and Cognition, Department of Technology and Information, Universitat Pompeu Fabra, Carrer Ramón Trias Fargas, 25-27, 08005 Barcelona, Spain; Departament de Matemàtiques, EPSEB, Universitat Politècnica de Catalunya, Barcelona, 08028 Barcelona, Spain
| | | | - Gustavo Deco
- Center for Brain and Cognition, Department of Technology and Information, Universitat Pompeu Fabra, Carrer Ramón Trias Fargas, 25-27, 08005 Barcelona, Spain; Institució Catalana de la Recerca i Estudis Avançats, Universitat Barcelona, Passeig Lluís Companys 23, 08010 Barcelona, Spain
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, UK
| |
Collapse
|
11
|
Moreno-Bote R, Grytskyy D. Generative models of complex behavior: A behavioral Turing test. Comment on "beyond simple laboratory studies: Developing sophisticated models to study rich behavior" by Maselli, Gordon, Eluchans, Lancia, Thiery, Moretti, Cisek, and Pezzulo. Phys Life Rev 2023; 47:174-176. [PMID: 37924671 DOI: 10.1016/j.plrev.2023.10.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 10/18/2023] [Indexed: 11/06/2023]
Affiliation(s)
- Rubén Moreno-Bote
- Center for Brain and Cognition, Universitat Pompeu Fabra, Barcelona 08002, Spain; Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona 08002, Spain; Serra Húnter Fellow Programme, Universitat Pompeu Fabra, Barcelona, Spain.
| | - Dmytro Grytskyy
- Center for Brain and Cognition, Universitat Pompeu Fabra, Barcelona 08002, Spain; Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona 08002, Spain
| |
Collapse
|
12
|
McGinty VB, Lupkin SM. Behavioral read-out from population value signals in primate orbitofrontal cortex. Nat Neurosci 2023; 26:2203-2212. [PMID: 37932464 PMCID: PMC11006434 DOI: 10.1038/s41593-023-01473-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Accepted: 09/26/2023] [Indexed: 11/08/2023]
Abstract
The primate orbitofrontal cortex (OFC) has long been recognized for its role in value-based decisions; however, the exact mechanism linking value representations in the OFC to decision outcomes has remained elusive. Here, to address this question, we show, in non-human primates, that trial-wise variability in choices can be explained by variability in value signals decoded from many simultaneously recorded OFC neurons. Mechanistically, this relationship is consistent with the projection of activity within a low-dimensional value-encoding subspace onto a potentially higher-dimensional, behaviorally potent output subspace. Identifying this neural-behavioral link answers longstanding questions about the role of the OFC in economic decision-making and suggests population-level read-out mechanisms for the OFC similar to those recently identified in sensory and motor cortex.
Collapse
Affiliation(s)
- Vincent B McGinty
- Center for Molecular and Behavioral Neuroscience, Rutgers University-Newark, Newark, NJ, USA.
| | - Shira M Lupkin
- Center for Molecular and Behavioral Neuroscience, Rutgers University-Newark, Newark, NJ, USA
- Behavioral and Neural Sciences Graduate Program, Rutgers University-Newark, Newark, NJ, USA
| |
Collapse
|
13
|
Hajnal MA, Tran D, Szabó Z, Albert A, Safaryan K, Einstein M, Martelo MV, Polack PO, Golshani P, Orbán G. Shifts in attention drive context-dependent subspace encoding in anterior cingulate cortex during decision making. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.10.561737. [PMID: 37873364 PMCID: PMC10592791 DOI: 10.1101/2023.10.10.561737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
Attention is a cognitive faculty that selects part of a larger set of percepts, driven by cues such as stimulus saliency, internal goals or priors. The enhancement of the attended representation and inhibition of distractors have been proposed as potential neural mechanisms driving this selection process. Yet, how attention operates when the cue has to be internally constructed from conflicting stimuli, decision rules, and reward contingencies, is less understood. Here we recorded from populations of neurons in the anterior cingulate cortex (ACC), an area implicated in ongoing error monitoring and correction during decision conflicts, in a challenging attention-shifting task. In this task, mice had to attend to the rewarded modality when presented identical auditory and visual stimuli in two contexts without direct external cues. In the ACC, the irrelevant stimulus continuously became less decodable than the relevant stimulus as the trial progressed to the decision point. This contrasted strongly with our previous findings in V1 where both relevant and irrelevant stimuli were equally decodable throughout the trial. Using analytical tools and a recurrent neural network (RNN) model, we found that the linearly independent representation of stimulus modalities in ACC was well suited to context-gated suppression of a stimulus modality. We demonstrated that the feedback structure of lateral connections in the RNN consisted of excitatory interactions between cell ensembles representing the same modality and mutual inhibition between cell ensembles representing distinct stimulus modalities. Using this RNN model showing signatures of context-gated suppression, we predicted that the level of contextual modulation of individual neurons should be correlated with their relative responsiveness to the two stimulus modalities used in the task. We verified this prediction in recordings from ACC neurons but not from recordings from V1 neurons. Therefore, ACC effectively operates on low-dimensional neuronal subspaces to combine stimulus related information with internal cues to drive actions under conflict.
Collapse
Affiliation(s)
- Márton Albert Hajnal
- Department of Computational Sciences, Wigner Research Center for Physics, Budapest, 1121, Hungary
| | - Duy Tran
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095, United States
- Albert Einstein College of Medicine, New York, NY 10461, United States
| | - Zsombor Szabó
- Department of Computational Sciences, Wigner Research Center for Physics, Budapest, 1121, Hungary
| | - Andrea Albert
- Department of Computational Sciences, Wigner Research Center for Physics, Budapest, 1121, Hungary
| | - Karen Safaryan
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095, United States
| | - Michael Einstein
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095, United States
| | - Mauricio Vallejo Martelo
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095, United States
| | - Pierre-Olivier Polack
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, NJ 07102, United States
| | - Peyman Golshani
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095, United States
- Integrative Center for Learning and Memory, Brain Research Institute, University of California, Los Angeles, Los Angeles, CA 90095, United States
- West Los Angeles VA Medical Center, CA 90073 Los Angeles, United States
| | - Gergő Orbán
- Department of Computational Sciences, Wigner Research Center for Physics, Budapest, 1121, Hungary
| |
Collapse
|
14
|
Johnston WJ, Fine JM, Yoo SBM, Ebitz RB, Hayden BY. Semi-orthogonal subspaces for value mediate a tradeoff between binding and generalization. ARXIV 2023:arXiv:2309.07766v1. [PMID: 37744462 PMCID: PMC10516109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
When choosing between options, we must associate their values with the action needed to select them. We hypothesize that the brain solves this binding problem through neural population subspaces. To test this hypothesis, we examined neuronal responses in five reward-sensitive regions in macaques performing a risky choice task with sequential offers. Surprisingly, in all areas, the neural population encoded the values of offers presented on the left and right in distinct subspaces. We show that the encoding we observe is sufficient to bind the values of the offers to their respective positions in space while preserving abstract value information, which may be important for rapid learning and generalization to novel contexts. Moreover, after both offers have been presented, all areas encode the value of the first and second offers in orthogonal subspaces. In this case as well, the orthogonalization provides binding. Our binding-by-subspace hypothesis makes two novel predictions borne out by the data. First, behavioral errors should correlate with putative spatial (but not temporal) misbinding in the neural representation. Second, the specific representational geometry that we observe across animals also indicates that behavioral errors should increase when offers have low or high values, compared to when they have medium values, even when controlling for value difference. Together, these results support the idea that the brain makes use of semi-orthogonal subspaces to bind features together.
Collapse
Affiliation(s)
- W. Jeffrey Johnston
- Center for Theoretical Neuroscience and Mortimer B. Zuckerman Mind, Brain, and Behavior Institute, Columbia University, New York, New York, United States of America
| | - Justin M. Fine
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas, United States of America
| | - Seng Bum Michael Yoo
- Department of Biomedical Engineering, Sunkyunkwan University, and Center for Neuroscience Imaging Research, Institute of Basic Sciences, Suwon, South Korea, Republic of Korea, 16419
| | - R. Becket Ebitz
- Department of Neuroscience, Université de Montréal, Montréal, Quebec, Canada
| | - Benjamin Y. Hayden
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas, United States of America
| |
Collapse
|
15
|
Balewski ZZ, Elston TW, Knudsen EB, Wallis JD. Value dynamics affect choice preparation during decision-making. Nat Neurosci 2023; 26:1575-1583. [PMID: 37563295 PMCID: PMC10576429 DOI: 10.1038/s41593-023-01407-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 07/17/2023] [Indexed: 08/12/2023]
Abstract
During decision-making, neurons in the orbitofrontal cortex (OFC) sequentially represent the value of each option in turn, but it is unclear how these dynamics are translated into a choice response. One brain region that may be implicated in this process is the anterior cingulate cortex (ACC), which strongly connects with OFC and contains many neurons that encode the choice response. We investigated how OFC value signals interacted with ACC neurons encoding the choice response by performing simultaneous high-channel count recordings from the two areas in nonhuman primates. ACC neurons encoding the choice response steadily increased their firing rate throughout the decision-making process, peaking shortly before the time of the choice response. Furthermore, the value dynamics in OFC affected ACC ramping-when OFC represented the more valuable option, ACC ramping accelerated. Because OFC tended to represent the more valuable option more frequently and for a longer duration, this interaction could explain how ACC selects the more valuable response.
Collapse
Affiliation(s)
- Zuzanna Z Balewski
- Helen Wills Neuroscience Institute, University of California at Berkeley, Berkeley, CA, USA
| | - Thomas W Elston
- Helen Wills Neuroscience Institute, University of California at Berkeley, Berkeley, CA, USA
| | - Eric B Knudsen
- Helen Wills Neuroscience Institute, University of California at Berkeley, Berkeley, CA, USA
| | - Joni D Wallis
- Helen Wills Neuroscience Institute, University of California at Berkeley, Berkeley, CA, USA.
- Department of Psychology, University of California at Berkeley, Berkeley, CA, USA.
| |
Collapse
|
16
|
Marciano D, Staveland BR, Lin JJ, Saez I, Hsu M, Knight RT. Electrophysiological signatures of inequity-dependent reward encoding in the human OFC. Cell Rep 2023; 42:112865. [PMID: 37494185 DOI: 10.1016/j.celrep.2023.112865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 06/12/2023] [Accepted: 07/10/2023] [Indexed: 07/28/2023] Open
Abstract
Social decision making requires the integration of reward valuation and social cognition systems, both dependent on the orbitofrontal cortex (OFC). How these two OFC functions interact is largely unknown. We recorded intracranial activity from the OFC of ten patients making choices in a social context where reward inequity with a social counterpart varied and could be either advantageous or disadvantageous. We find that OFC high-frequency activity (HFA; 70-150 Hz) encodes self-reward, consistent with previous reports. We also observe encoding of the social counterpart's reward, as well as the type of inequity being experienced. Additionally, we find evidence of inequity-dependent reward encoding: depending on the type of inequity, electrodes rapidly and reversibly switch between different reward-encoding profiles. These results provide direct evidence for encoding of self- and other rewards in the human OFC and highlight the dynamic nature of encoding in the OFC as a function of social context.
Collapse
Affiliation(s)
- Deborah Marciano
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Haas School of Business, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Brooke R Staveland
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Jack J Lin
- Department of Neurology, University of California, Davis, Davis, CA 95616, USA; Center for Mind and Brain, University of California, Davis, Davis, CA 95616, USA
| | - Ignacio Saez
- Departments of Neuroscience, Neurosurgery and Neurology, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA.
| | - Ming Hsu
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Haas School of Business, University of California, Berkeley, Berkeley, CA 94720, USA.
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA.
| |
Collapse
|
17
|
Yun M, Nejime M, Kawai T, Kunimatsu J, Yamada H, Kim HR, Matsumoto M. Distinct roles of the orbitofrontal cortex, ventral striatum, and dopamine neurons in counterfactual thinking of decision outcomes. SCIENCE ADVANCES 2023; 9:eadh2831. [PMID: 37556536 PMCID: PMC10411892 DOI: 10.1126/sciadv.adh2831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Accepted: 07/07/2023] [Indexed: 08/11/2023]
Abstract
Individuals often assess past decisions by comparing what was gained with what would have been gained had they acted differently. Thoughts of past alternatives that counter what actually happened are called "counterfactuals." Recent theories emphasize the role of the prefrontal cortex in processing counterfactual outcomes in decision-making, although how subcortical regions contribute to this process remains to be elucidated. Here we report a clear distinction among the roles of the orbitofrontal cortex, ventral striatum and midbrain dopamine neurons in processing counterfactual outcomes in monkeys. Our findings suggest that actually gained and counterfactual outcome signals are both processed in the cortico-subcortical network constituted by these regions but in distinct manners and integrated only in the orbitofrontal cortex in a way to compare these outcomes. This study extends the prefrontal theory of counterfactual thinking and provides key insights regarding how the prefrontal cortex cooperates with subcortical regions to make decisions using counterfactual information.
Collapse
Affiliation(s)
- Mengxi Yun
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Graduate School of Comprehensive Human Science, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard University, Cambridge, MA, USA
- Transborder Medical Research Center, University of Tsukuba, Tsukuba, Ibaraki 305-8577, Japan
| | - Masafumi Nejime
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
| | - Takashi Kawai
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
| | - Jun Kunimatsu
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Transborder Medical Research Center, University of Tsukuba, Tsukuba, Ibaraki 305-8577, Japan
| | - Hiroshi Yamada
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Transborder Medical Research Center, University of Tsukuba, Tsukuba, Ibaraki 305-8577, Japan
| | - HyungGoo R. Kim
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Biomedical Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon 16419, Republic of Korea
| | - Masayuki Matsumoto
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Transborder Medical Research Center, University of Tsukuba, Tsukuba, Ibaraki 305-8577, Japan
| |
Collapse
|
18
|
Newton-Fenner A, Hewitt D, Henderson J, Roberts H, Mari T, Gu Y, Gorelkina O, Giesbrecht T, Fallon N, Roberts C, Stancak A. Economic value in the Brain: A meta-analysis of willingness-to-pay using the Becker-DeGroot-Marschak auction. PLoS One 2023; 18:e0286969. [PMID: 37428744 DOI: 10.1371/journal.pone.0286969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 05/29/2023] [Indexed: 07/12/2023] Open
Abstract
Forming and comparing subjective values (SVs) of choice options is a critical stage of decision-making. Previous studies have highlighted a complex network of brain regions involved in this process by utilising a diverse range of tasks and stimuli, varying in economic, hedonic and sensory qualities. However, the heterogeneity of tasks and sensory modalities may systematically confound the set of regions mediating the SVs of goods. To identify and delineate the core brain valuation system involved in processing SV, we utilised the Becker-DeGroot-Marschak (BDM) auction, an incentivised demand-revealing mechanism which quantifies SV through the economic metric of willingness-to-pay (WTP). A coordinate-based activation likelihood estimation meta-analysis analysed twenty-four fMRI studies employing a BDM task (731 participants; 190 foci). Using an additional contrast analysis, we also investigated whether this encoding of SV would be invariant to the concurrency of auction task and fMRI recordings. A fail-safe number analysis was conducted to explore potential publication bias. WTP positively correlated with fMRI-BOLD activations in the left ventromedial prefrontal cortex with a sub-cluster extending into anterior cingulate cortex, bilateral ventral striatum, right dorsolateral prefrontal cortex, right inferior frontal gyrus, and right anterior insula. Contrast analysis identified preferential engagement of the mentalizing-related structures in response to concurrent scanning. Together, our findings offer succinct empirical support for the core structures participating in the formation of SV, separate from the hedonic aspects of reward and evaluated in terms of WTP using BDM, and show the selective involvement of inhibition-related brain structures during active valuation.
Collapse
Affiliation(s)
- Alice Newton-Fenner
- Department of Psychology, University of Liverpool, Liverpool, United Kingdom
- Institute of Risk and Uncertainty, University of Liverpool, Liverpool, United Kingdom
| | - Danielle Hewitt
- Department of Psychology, University of Liverpool, Liverpool, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, United Kingdom
| | - Jessica Henderson
- Department of Psychology, University of Liverpool, Liverpool, United Kingdom
| | - Hannah Roberts
- Department of Psychology, University of Liverpool, Liverpool, United Kingdom
| | - Tyler Mari
- Department of Psychology, University of Liverpool, Liverpool, United Kingdom
| | - Yiquan Gu
- Henley Business School, University of Reading, Reading, United Kingdom
| | - Olga Gorelkina
- Management School, University of Liverpool, Liverpool, United Kingdom
| | - Timo Giesbrecht
- Unilever, Research and Development, Port Sunlight, United Kingdom
| | - Nicolas Fallon
- Department of Psychology, University of Liverpool, Liverpool, United Kingdom
| | - Carl Roberts
- Department of Psychology, University of Liverpool, Liverpool, United Kingdom
| | - Andrej Stancak
- Department of Psychology, University of Liverpool, Liverpool, United Kingdom
- Institute of Risk and Uncertainty, University of Liverpool, Liverpool, United Kingdom
| |
Collapse
|
19
|
Fine JM, Maisson DJN, Yoo SBM, Cash-Padgett TV, Wang MZ, Zimmermann J, Hayden BY. Abstract Value Encoding in Neural Populations But Not Single Neurons. J Neurosci 2023; 43:4650-4663. [PMID: 37208178 PMCID: PMC10286943 DOI: 10.1523/jneurosci.1954-22.2023] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 05/07/2023] [Accepted: 05/11/2023] [Indexed: 05/21/2023] Open
Abstract
An important open question in neuroeconomics is how the brain represents the value of offers in a way that is both abstract (allowing for comparison) and concrete (preserving the details of the factors that influence value). Here, we examine neuronal responses to risky and safe options in five brain regions that putatively encode value in male macaques. Surprisingly, we find no detectable overlap in the neural codes used for risky and safe options, even when the options have identical subjective values (as revealed by preference) in any of the regions. Indeed, responses are weakly correlated and occupy distinct (semi-orthogonal) encoding subspaces. Notably, however, these subspaces are linked through a linear transform of their constituent encodings, a property that allows for comparison of dissimilar option types. This encoding scheme allows these regions to multiplex decision related processes: they can encode the detailed factors that influence offer value (here, risky and safety) but also directly compare dissimilar offer types. Together these results suggest a neuronal basis for the qualitatively different psychological properties of risky and safe options and highlight the power of population geometry to resolve outstanding problems in neural coding.SIGNIFICANCE STATEMENT To make economic choices, we must have some mechanism for comparing dissimilar offers. We propose that the brain uses distinct neural codes for risky and safe offers, but that these codes are linearly transformable. This encoding scheme has the dual advantage of allowing for comparison across offer types while preserving information about offer type, which in turn allows for flexibility in changing circumstances. We show that responses to risky and safe offers exhibit these predicted properties in five different reward-sensitive regions. Together, these results highlight the power of population coding principles for solving representation problems in economic choice.
Collapse
Affiliation(s)
- Justin M Fine
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455
| | - David J-N Maisson
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455
| | - Seng Bum Michael Yoo
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455
| | - Tyler V Cash-Padgett
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455
| | - Maya Zhe Wang
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455
| | - Jan Zimmermann
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455
| | - Benjamin Y Hayden
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455
| |
Collapse
|
20
|
Aquino TG, Cockburn J, Mamelak AN, Rutishauser U, O'Doherty JP. Neurons in human pre-supplementary motor area encode key computations for value-based choice. Nat Hum Behav 2023; 7:970-985. [PMID: 36959327 PMCID: PMC10330469 DOI: 10.1038/s41562-023-01548-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Accepted: 02/02/2023] [Indexed: 03/25/2023]
Abstract
Adaptive behaviour in real-world environments requires that choices integrate several variables, including the novelty of the options under consideration, their expected value and uncertainty in value estimation. Here, to probe how integration over decision variables occurs during decision-making, we recorded neurons from the human pre-supplementary motor area (preSMA), ventromedial prefrontal cortex and dorsal anterior cingulate. Unlike the other areas, preSMA neurons not only represented separate pre-decision variables for each choice option but also encoded an integrated utility signal for each choice option and, subsequently, the decision itself. Post-decision encoding of variables for the chosen option was more widely distributed and especially prominent in the ventromedial prefrontal cortex. Our findings position the human preSMA as central to the implementation of value-based decisions.
Collapse
Affiliation(s)
- Tomas G Aquino
- Computation and Neural Systems, Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA.
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
| | - Jeffrey Cockburn
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| | - Adam N Mamelak
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Ueli Rutishauser
- Computation and Neural Systems, Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - John P O'Doherty
- Computation and Neural Systems, Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| |
Collapse
|
21
|
Rolls ET. Emotion, motivation, decision-making, the orbitofrontal cortex, anterior cingulate cortex, and the amygdala. Brain Struct Funct 2023:10.1007/s00429-023-02644-9. [PMID: 37178232 DOI: 10.1007/s00429-023-02644-9] [Citation(s) in RCA: 28] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 04/12/2023] [Indexed: 05/15/2023]
Abstract
The orbitofrontal cortex and amygdala are involved in emotion and in motivation, but the relationship between these functions performed by these brain structures is not clear. To address this, a unified theory of emotion and motivation is described in which motivational states are states in which instrumental goal-directed actions are performed to obtain rewards or avoid punishers, and emotional states are states that are elicited when the reward or punisher is or is not received. This greatly simplifies our understanding of emotion and motivation, for the same set of genes and associated brain systems can define the primary or unlearned rewards and punishers such as sweet taste or pain. Recent evidence on the connectivity of human brain systems involved in emotion and motivation indicates that the orbitofrontal cortex is involved in reward value and experienced emotion with outputs to cortical regions including those involved in language, and is a key brain region involved in depression and the associated changes in motivation. The amygdala has weak effective connectivity back to the cortex in humans, and is implicated in brainstem-mediated responses to stimuli such as freezing and autonomic activity, rather than in declarative emotion. The anterior cingulate cortex is involved in learning actions to obtain rewards, and with the orbitofrontal cortex and ventromedial prefrontal cortex in providing the goals for navigation and in reward-related effects on memory consolidation mediated partly via the cholinergic system.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK.
- Department of Computer Science, University of Warwick, Coventry, UK.
| |
Collapse
|
22
|
Johnston WJ, Fine JM, Yoo SBM, Ebitz RB, Hayden BY. Subspace orthogonalization as a mechanism for binding values to space. ARXIV 2023:arXiv:2205.06769v2. [PMID: 36776821 PMCID: PMC9915762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/14/2023]
Abstract
When choosing between options, we must solve an important binding problem. The values of the options must be associated with information about the action needed to select them. We hypothesize that the brain solves this binding problem through use of distinct population subspaces. To test this hypothesis, we examined the responses of single neurons in five reward-sensitive regions in rhesus macaques performing a risky choice task. In all areas, neurons encoded the value of the offers presented on both the left and the right side of the display in semi-orthogonal subspaces, which served to bind the values of the two offers to their positions in space. Supporting the idea that this orthogonalization is functionally meaningful, we observed a session-to-session covariation between choice behavior and the orthogonalization of the two value subspaces: trials with less orthogonalized subspaces were associated with greater likelihood of choosing the less valued option. Further inspection revealed that these semi-orthogonal subspaces arose from a combination of linear and nonlinear mixed selectivity in the neural population. We show this combination of selectivity balances reliable binding with an ability to generalize value across different spatial locations. These results support the hypothesis that semi-orthogonal subspaces support reliable binding, which is essential to flexible behavior in the face of multiple options.
Collapse
Affiliation(s)
- W. Jeffrey Johnston
- Center for Theoretical Neuroscience and Mortimer B. Zuckerman Mind, Brain, and Behavior Institute, Columbia University, New York, New York
| | - Justin M. Fine
- Department of Neuroscience, Center for Magnetic Resonance Research, and Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455
| | - Seng Bum Michael Yoo
- Department of Biomedical Engineering, Sunkyunkwan University, and Center for Neuroscience Imaging Research, Institute of Basic Sciences, Suwon, South Korea, Republic of Korea, 16419
- Current address: Department of Brain and Cognitive Sciences, Massachusetts Institution of Technology, Cambridge, Massachusetts, MA, 02139
| | - R. Becket Ebitz
- Department of Neuroscience, Université de Montréal, Montréal, Quebec, Canada
| | - Benjamin Y. Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455
| |
Collapse
|
23
|
Chen Y, Chaudhary S, Li CSR. Shared and distinct neural activity during anticipation and outcome of win and loss: A meta-analysis of the monetary incentive delay task. Neuroimage 2022; 264:119764. [PMID: 36427755 PMCID: PMC9837714 DOI: 10.1016/j.neuroimage.2022.119764] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 10/19/2022] [Accepted: 11/21/2022] [Indexed: 11/27/2022] Open
Abstract
Reward and punishment motivate decision making and behavioral changes. Numerous studies have examined regional activities during anticipation and outcome of win and loss in the monetary incentive delay task (MIDT). However, the great majority of studies reported findings of anticipation or outcome and of win or loss alone. It remains unclear how the neural correlates share and differentiate amongst these processes. We conducted an Activation Likelihood Estimation meta-analysis of 81 studies of the MIDT (5,864 subjects), including 24 published since the most recent meta-analysis, to identify and, with conjunction and subtraction, contrast regional responses to win anticipation, loss anticipation, win outcome, and loss outcome. Win and loss anticipation engaged a shared network of bilateral anterior insula (AI), striatum, thalamus, supplementary motor area (SMA), and precentral gyrus. Win and loss outcomes did not share regional activities. Win and loss outcome each engaged higher activity in medial orbitofrontal cortex (mOFC) and dorsal anterior cingulate cortex. Bilateral striatum and right occipital cortex responded to both anticipation and outcome of win, and right AI to both phases of loss. Win anticipation vs. outcome engaged higher activity in bilateral AI, striatum, SMA and precentral gyrus and right thalamus, and lower activity in bilateral mOFC and posterior cingulate cortex as well as right inferior frontal and angular gyri. Loss anticipation relative to outcome involved higher activity in bilateral striatum and left AI. These findings collectively suggest shared and distinct regional responses during monetary wins and losses. Delineating the neural correlates of these component processes may facilitate empirical research of motivated behaviors and dysfunctional approach and avoidance in psychopathology.
Collapse
Affiliation(s)
- Yu Chen
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT 06520, USA.
| | - Shefali Chaudhary
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT 06520, USA
| | - Chiang-Shan R Li
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT 06520, USA; Department of Neuroscience, Yale University School of Medicine, New Haven, CT 06520, USA; Inter-department Neuroscience Program, Yale University, New Haven, CT 06520, USA; Wu Tsai Institute, Yale University, New Haven, CT 06520, USA
| |
Collapse
|
24
|
Ogawa A, Osada T, Tanaka M, Suda A, Nakajima K, Oka S, Kamagata K, Aoki S, Oshima Y, Tanaka S, Hattori N, Konishi S. Hypothalamic interaction with reward-related regions during subjective evaluation of foods. Neuroimage 2022; 264:119744. [PMID: 36368500 DOI: 10.1016/j.neuroimage.2022.119744] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 10/14/2022] [Accepted: 11/08/2022] [Indexed: 11/11/2022] Open
Abstract
The reward system implemented in the midbrain, ventral striatum, orbitofrontal cortex, and ventromedial prefrontal cortex evaluates and compares various types of rewards given to the organisms. It has been suggested that autonomic factors influence reward-related processing via the hypothalamus, but how the hypothalamus modulates the reward system remains elusive. In this functional magnetic resonance imaging study, the hypothalamus was parcellated into individual hypothalamic nuclei performing different autonomic functions using boundary mapping parcellation analyses. The effective interaction during subjective evaluation of foods in a reward task was then investigated between the human hypothalamic nuclei and the reward-related regions. We found significant brain activity decrease in the paraventricular nucleus (PVH) and lateral nucleus in the hypothalamus in food evaluation compared with monetary evaluation. A psychophysiological interaction analysis revealed dual interactions between the PVH and (1) midbrain region and (2) ventromedial prefrontal cortex, with the former correlated with the stronger tendency of participants toward food-seeking. A dynamic causal modeling analysis further revealed unidirectional interactions from the PVH to the midbrain and ventromedial prefrontal cortex. These results suggest that the PVH in the human hypothalamus interacts with the reward-related regions in the cerebral cortex via multiple pathways (i.e., the midbrain pathway and ventromedial prefrontal pathway) to evaluate rewards for subsequent decision-making.
Collapse
Affiliation(s)
- Akitoshi Ogawa
- Department of Neurophysiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Takahiro Osada
- Department of Neurophysiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Masaki Tanaka
- Department of Neurophysiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Akimitsu Suda
- Department of Neurophysiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan; Department of Neurology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Koji Nakajima
- Department of Neurophysiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan; Department of Orthopaedic Surgery, The University of Tokyo School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Satoshi Oka
- Department of Neurophysiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Koji Kamagata
- Department of Radiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Shigeki Aoki
- Department of Radiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Yasushi Oshima
- Department of Orthopaedic Surgery, The University of Tokyo School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Sakae Tanaka
- Department of Orthopaedic Surgery, The University of Tokyo School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Nobutaka Hattori
- Department of Neurology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Seiki Konishi
- Department of Neurophysiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan; Research Institute for Diseases of Old Age, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan; Sportology Center, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan; Advanced Research Institute for Health Science, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan.
| |
Collapse
|
25
|
Woo JH, Azab H, Jahn A, Hayden B, Brown JW. The PRO model accounts for the anterior cingulate cortex role in risky decision-making and monitoring. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2022; 22:952-968. [PMID: 35332510 PMCID: PMC11059203 DOI: 10.3758/s13415-022-00992-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 02/17/2022] [Indexed: 11/08/2022]
Abstract
The anterior cingulate cortex (ACC) has been implicated in a number of functions, including performance monitoring and decision-making involving effort. The prediction of responses and outcomes (PRO) model has provided a unified account of much human and monkey ACC data involving anatomy, neurophysiology, EEG, fMRI, and behavior. We explored the computational nature of ACC with the PRO model, extending it to account specifically for both human and macaque monkey decision-making under risk, including both behavioral and neural data. We show that the PRO model can account for a number of additional effects related to outcome prediction, decision-making under risk, gambling behavior. In particular, we show that the ACC represents the variance of uncertain outcomes, suggesting a link between ACC function and mean-variance theories of decision making. The PRO model provides a unified account of a large set of data regarding the ACC.
Collapse
Affiliation(s)
- Jae Hyung Woo
- Department of Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Habiba Azab
- Baylor College of Medicine, Houston, TX, USA
| | - Andrew Jahn
- Department of Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA
- fMRI Laboratory, University of Michigan, Ann Arbor, MI, USA
| | - Benjamin Hayden
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
| | - Joshua W Brown
- Department of Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA.
| |
Collapse
|
26
|
Knaebe B, Weiss CC, Zimmermann J, Hayden BY. The Promise of Behavioral Tracking Systems for Advancing Primate Animal Welfare. Animals (Basel) 2022; 12:1648. [PMID: 35804547 PMCID: PMC9265027 DOI: 10.3390/ani12131648] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Revised: 06/17/2022] [Accepted: 06/21/2022] [Indexed: 11/16/2022] Open
Abstract
Recent years have witnessed major advances in the ability of computerized systems to track the positions of animals as they move through large and unconstrained environments. These systems have so far been a great boon in the fields of primatology, psychology, neuroscience, and biomedicine. Here, we discuss the promise of these technologies for animal welfare. Their potential benefits include identifying and reducing pain, suffering, and distress in captive populations, improving laboratory animal welfare within the context of the three Rs of animal research (reduction, refinement, and replacement), and applying our understanding of animal behavior to increase the "natural" behaviors in captive and wild populations facing human impact challenges. We note that these benefits are often incidental to the designed purpose of these tracking systems, a reflection of the fact that animal welfare is not inimical to research progress, but instead, that the aligned interests between basic research and welfare hold great promise for improvements to animal well-being.
Collapse
Affiliation(s)
- Brenna Knaebe
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455, USA; (C.C.W.); (J.Z.); (B.Y.H.)
| | | | | | | |
Collapse
|
27
|
Wang MZ, Hayden BY, Heilbronner SR. A structural and functional subdivision in central orbitofrontal cortex. Nat Commun 2022; 13:3623. [PMID: 35750659 PMCID: PMC9232485 DOI: 10.1038/s41467-022-31273-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 06/07/2022] [Indexed: 11/09/2022] Open
Abstract
Economic choice requires many cognitive subprocesses, including stimulus detection, valuation, motor output, and outcome monitoring; many of these subprocesses are associated with the central orbitofrontal cortex (cOFC). Prior work has largely assumed that the cOFC is a single region with a single function. Here, we challenge that unified view with convergent anatomical and physiological results from rhesus macaques. Anatomically, we show that the cOFC can be subdivided according to its much stronger (medial) or weaker (lateral) bidirectional anatomical connectivity with the posterior cingulate cortex (PCC). We call these subregions cOFCm and cOFCl, respectively. These two subregions have notable functional differences. Specifically, cOFCm shows enhanced functional connectivity with PCC, as indicated by both spike-field coherence and mutual information. The cOFCm-PCC circuit, but not the cOFCl-PCC circuit, shows signatures of relaying choice signals from a non-spatial comparison framework to a spatially framed organization and shows a putative bidirectional mutually excitatory pattern.
Collapse
Affiliation(s)
- Maya Zhe Wang
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA.
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA.
| | - Benjamin Y Hayden
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA
| | - Sarah R Heilbronner
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA
| |
Collapse
|
28
|
Klein-Flügge MC, Bongioanni A, Rushworth MFS. Medial and orbital frontal cortex in decision-making and flexible behavior. Neuron 2022; 110:2743-2770. [PMID: 35705077 DOI: 10.1016/j.neuron.2022.05.022] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Revised: 05/17/2022] [Accepted: 05/19/2022] [Indexed: 11/15/2022]
Abstract
The medial frontal cortex and adjacent orbitofrontal cortex have been the focus of investigations of decision-making, behavioral flexibility, and social behavior. We review studies conducted in humans, macaques, and rodents and argue that several regions with different functional roles can be identified in the dorsal anterior cingulate cortex, perigenual anterior cingulate cortex, anterior medial frontal cortex, ventromedial prefrontal cortex, and medial and lateral parts of the orbitofrontal cortex. There is increasing evidence that the manner in which these areas represent the value of the environment and specific choices is different from subcortical brain regions and more complex than previously thought. Although activity in some regions reflects distributions of reward and opportunities across the environment, in other cases, activity reflects the structural relationships between features of the environment that animals can use to infer what decision to take even if they have not encountered identical opportunities in the past.
Collapse
Affiliation(s)
- Miriam C Klein-Flügge
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Tinsley Building, Mansfield Road, Oxford OX1 3TA, UK; Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB), University of Oxford, Nuffield Department of Clinical Neurosciences, Level 6, West Wing, John Radcliffe Hospital, Oxford OX3 9DU, UK; Department of Psychiatry, University of Oxford, Warneford Lane, Headington, Oxford OX3 7JX, UK.
| | - Alessandro Bongioanni
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Tinsley Building, Mansfield Road, Oxford OX1 3TA, UK
| | - Matthew F S Rushworth
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Tinsley Building, Mansfield Road, Oxford OX1 3TA, UK; Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB), University of Oxford, Nuffield Department of Clinical Neurosciences, Level 6, West Wing, John Radcliffe Hospital, Oxford OX3 9DU, UK
| |
Collapse
|
29
|
GRAN3SAT: Creating Flexible Higher-Order Logic Satisfiability in the Discrete Hopfield Neural Network. MATHEMATICS 2022. [DOI: 10.3390/math10111899] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
One of the main problems in representing information in the form of nonsystematic logic is the lack of flexibility, which leads to potential overfitting. Although nonsystematic logic improves the representation of the conventional k Satisfiability, the formulations of the first, second, and third-order logical structures are very predictable. This paper proposed a novel higher-order logical structure, named G-Type Random k Satisfiability, by capitalizing the new random feature of the first, second, and third-order clauses. The proposed logic was implemented into the Discrete Hopfield Neural Network as a symbolic logical rule. The proposed logic in Discrete Hopfield Neural Networks was evaluated using different parameter settings, such as different orders of clauses, different proportions between positive and negative literals, relaxation, and differing numbers of learning trials. Each evaluation utilized various performance metrics, such as learning error, testing error, weight error, energy analysis, and similarity analysis. In addition, the flexibility of the proposed logic was compared with current state-of-the-art logic rules. Based on the simulation, the proposed logic was reported to be more flexible, and produced higher solution diversity.
Collapse
|
30
|
Padoa-Schioppa C. Logistic analysis of choice data: A primer. Neuron 2022; 110:1615-1630. [PMID: 35334232 PMCID: PMC9119943 DOI: 10.1016/j.neuron.2022.03.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Revised: 02/25/2022] [Accepted: 02/28/2022] [Indexed: 11/21/2022]
Abstract
Logistic regressions were developed in economics to model individual choice behavior. In recent years, they have become an important tool in decision neuroscience. Here, I describe and discuss different logistic models, emphasizing the underlying assumptions and possible interpretations. Logistic models may be used to quantify a variety of behavioral traits, including the relative subjective value of different goods, the choice accuracy, risk attitudes, and choice biases. More complex logistic models can be used for choices between good bundles, in cases of nonlinear value functions, and for choices between multiple options. Finally, logistic models can quantify the explanatory power of neuronal activity on choices, thus providing a valid alternative to receiver operating characteristic (ROC) analyses.
Collapse
Affiliation(s)
- Camillo Padoa-Schioppa
- Department of Neuroscience, Department of Economics, and Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO 63110, USA.
| |
Collapse
|
31
|
Frömer R, Shenhav A. Filling the gaps: Cognitive control as a critical lens for understanding mechanisms of value-based decision-making. Neurosci Biobehav Rev 2022; 134:104483. [PMID: 34902441 PMCID: PMC8844247 DOI: 10.1016/j.neubiorev.2021.12.006] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Revised: 12/01/2021] [Accepted: 12/04/2021] [Indexed: 12/26/2022]
Abstract
While often seeming to investigate rather different problems, research into value-based decision making and cognitive control have historically offered parallel insights into how people select thoughts and actions. While the former studies how people weigh costs and benefits to make a decision, the latter studies how they adjust information processing to achieve their goals. Recent work has highlighted ways in which decision-making research can inform our understanding of cognitive control. Here, we provide the complementary perspective: how cognitive control research has informed understanding of decision-making. We highlight three particular areas of research where this critical interchange has occurred: (1) how different types of goals shape the evaluation of choice options, (2) how people use control to adjust the ways they make their decisions, and (3) how people monitor decisions to inform adjustments to control at multiple levels and timescales. We show how adopting this alternate viewpoint offers new insight into the determinants of both decisions and control; provides alternative interpretations for common neuroeconomic findings; and generates fruitful directions for future research.
Collapse
Affiliation(s)
- R Frömer
- Cognitive, Linguistic, and Psychological Sciences, Carney Institute for Brain Science, Brown University, Providence, RI, United States.
| | - A Shenhav
- Cognitive, Linguistic, and Psychological Sciences, Carney Institute for Brain Science, Brown University, Providence, RI, United States.
| |
Collapse
|
32
|
Yoshimoto T, Okazaki S, Sumiya M, Takahashi HK, Nakagawa E, Koike T, Kitada R, Okamoto S, Nakata M, Yada T, Kosaka H, Sadato N, Chikazoe J. Coexistence of sensory qualities and value representations in human orbitofrontal cortex. Neurosci Res 2022; 180:48-57. [PMID: 35218859 DOI: 10.1016/j.neures.2022.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 02/07/2022] [Accepted: 02/20/2022] [Indexed: 10/19/2022]
Abstract
Despite the multiple regions and neural networks associated with value-based decision-making, the orbitofrontal cortex (OFC) is possible a particularly important one. Although the role of the OFC in reinforcer devaluation tasks, which assess the ability to represent identity, sensory qualities, and subjective values of the expected outcomes, has been established, the specific aspect represented in this area remains unclear. In this study, using functional magnetic resonance imaging, wherein participants rated the palatability of 128 food items using photographs, we investigated whether the human OFC represents object identity, sensory qualities, or value. Employing many items helped us dissociate object identity from sensory qualities and values; the inferred sensory qualities of identical items were manipulated by a change in metabolic state. Moreover, value differences between items were analytically controlled by employing a technique similar to age adjustment. The palatability ratings for food items significantly decreased after a meal. Using representational similarity analysis, we confirmed that the OFC represents value. Moreover, identical items were represented similarly in the lateral OFC in a given metabolic state; however, these representations were altered post-feeding. Importantly, this change was not explained by subjective value, suggesting that the OFC represents sensory quality and value, but not object identity.
Collapse
Affiliation(s)
- Takaaki Yoshimoto
- Division of Cerebral Integration, National Institute for Physiological Sciences, Okazaki, 444-8585, Japan
| | - Shuntaro Okazaki
- Division of Cerebral Integration, National Institute for Physiological Sciences, Okazaki, 444-8585, Japan
| | - Motofumi Sumiya
- Division of Cerebral Integration, National Institute for Physiological Sciences, Okazaki, 444-8585, Japan; Department of Physiological Sciences, SOKENDAI (The Graduate University for Advanced Studies), Hayama, 240-0193, Japan
| | | | - Eri Nakagawa
- Division of Cerebral Integration, National Institute for Physiological Sciences, Okazaki, 444-8585, Japan
| | - Takahiko Koike
- Division of Cerebral Integration, National Institute for Physiological Sciences, Okazaki, 444-8585, Japan; Department of Physiological Sciences, SOKENDAI (The Graduate University for Advanced Studies), Hayama, 240-0193, Japan
| | - Ryo Kitada
- Division of Psychology, School of Social Sciences, Nanyang Technological University, Singapore, 637332, Singapore
| | - Shiki Okamoto
- Second Department of Internal Medicine (Endocrinology, Diabetes and Metabolism, Hematology, Rheumatology), Graduate School of Medicine, University of the Ryukyus, Okinawa, 903-0215, Japan
| | - Masanori Nakata
- Department of Physiology, Faculty of Medicine, Wakayama Medical University School of Medicine, Wakayama, 641-8509, Japan
| | - Toshihiko Yada
- Division of Integrative Physiology, Kansai Electric Power Medical Research Institute, Kobe, 650-0047, Japan; Division of System Neuroscience, Kobe University Graduate School of Medicine Kobe, 650-0017, Japan
| | - Hirotaka Kosaka
- Department of Neuropsychiatry, University of Fukui, Fukui, 910-1193, Japan
| | - Norihiro Sadato
- Division of Cerebral Integration, National Institute for Physiological Sciences, Okazaki, 444-8585, Japan; Department of Physiological Sciences, SOKENDAI (The Graduate University for Advanced Studies), Hayama, 240-0193, Japan.
| | - Junichi Chikazoe
- Department of Physiological Sciences, SOKENDAI (The Graduate University for Advanced Studies), Hayama, 240-0193, Japan; Section of Brain Function Information, Supportive Center for Brain Research, National Institute for Physiological Sciences, Okazaki, 444-8585, Japan; ARAYA Inc., Tokyo, 107-6024, Japan.
| |
Collapse
|
33
|
Goh AXA, Bennett D, Bode S, Chong TTJ. Neurocomputational mechanisms underlying the subjective value of information. Commun Biol 2021; 4:1346. [PMID: 34903804 PMCID: PMC8669024 DOI: 10.1038/s42003-021-02850-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2021] [Accepted: 11/04/2021] [Indexed: 11/09/2022] Open
Abstract
Humans have a striking desire to actively seek new information, even when it is devoid of any instrumental utility. However, the mechanisms that drive individuals' subjective preference for information remain unclear. Here, we used fMRI to examine the processing of subjective information value, by having participants decide how much effort they were willing to trade-off for non-instrumental information. We showed that choices were best described by a model that accounted for: (1) the variability in individuals' estimates of uncertainty, (2) their desire to reduce that uncertainty, and (3) their subjective preference for positively valenced information. Model-based analyses revealed the anterior cingulate as a key node that encodes the subjective value of information across multiple stages of decision-making - including when information was prospectively valued, and when the outcome was definitively delivered. These findings emphasise the multidimensionality of information value, and reveal the neurocomputational mechanisms underlying the variability in individuals' desire to physically pursue informative outcomes.
Collapse
Affiliation(s)
- Ariel X-A Goh
- Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, 3800, Australia
- School of Psychological Sciences, Monash University, Melbourne, VIC, 3800, Australia
| | - Daniel Bennett
- Department of Psychiatry, Monash University, Melbourne, VIC, 3800, Australia
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, 08540, USA
| | - Stefan Bode
- Melbourne School of Psychological Sciences, University of Melbourne, Melbourne, VIC, 3010, Australia
| | - Trevor T-J Chong
- Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, 3800, Australia.
- School of Psychological Sciences, Monash University, Melbourne, VIC, 3800, Australia.
- Department of Neurology, Alfred Health, Melbourne, VIC, 3004, Australia.
- Department of Clinical Neurosciences, St Vincent's Hospital, Melbourne, VIC, 3065, Australia.
| |
Collapse
|
34
|
Pirrone A, Reina A, Stafford T, Marshall JAR, Gobet F. Magnitude-sensitivity: rethinking decision-making. Trends Cogn Sci 2021; 26:66-80. [PMID: 34750080 DOI: 10.1016/j.tics.2021.10.006] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Revised: 10/05/2021] [Accepted: 10/05/2021] [Indexed: 11/25/2022]
Abstract
Magnitude-sensitivity refers to the result that performance in decision-making, across domains and organisms, is affected by the total value of the possible alternatives. This simple result offers a window into fundamental issues in decision-making and has led to a reconsideration of ecological decision-making, prominent computational models of decision-making, and optimal decision-making. Moreover, magnitude-sensitivity has inspired the design of new robotic systems that exploit natural solutions and apply optimal decision-making policies. In this article, we review the key theoretical and empirical results about magnitude-sensitivity and highlight the importance that this phenomenon has for the understanding of decision-making. Furthermore, we discuss open questions and ideas for future research.
Collapse
Affiliation(s)
- Angelo Pirrone
- Centre for Philosophy of Natural and Social Science, London School of Economics and Political Science, London, UK.
| | - Andreagiovanni Reina
- Institute for Interdisciplinary Studies on Artificial Intelligence (IRIDIA), Université Libre de Bruxelles, Brussels, Belgium
| | - Tom Stafford
- Department of Psychology, University of Sheffield, Sheffield, UK
| | | | - Fernand Gobet
- Centre for Philosophy of Natural and Social Science, London School of Economics and Political Science, London, UK
| |
Collapse
|
35
|
Christensen EL, Harding IH, Voigt K, Chong TTJ, Verdejo-Garcia A. Neural underpinnings of food choice and consumption in obesity. Int J Obes (Lond) 2021; 46:194-201. [PMID: 34611286 DOI: 10.1038/s41366-021-00974-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Revised: 09/09/2021] [Accepted: 09/22/2021] [Indexed: 11/09/2022]
Abstract
BACKGROUND/OBJECTIVES Obesity is associated with unhealthy food choices. Food selection is driven by the subjective valuation of available options, and the perceived and actual rewards accompanying consumption. These cognitive operations are mediated by brain regions including the ventromedial prefrontal cortex (vmPFC), dorsal anterior cingulate cortex (dACC), and ventral striatum (vStr). This study investigated the relationship between body mass index (BMI) and functional activations in the vmPFC, dACC, and vStr during food selection and consumption. SUBJECTS/METHODS After overnight fasting, 26 individuals (BMI: 18-40 kg/m2) performed a food choice task while being scanned with functional magnetic resonance imaging (fMRI). Each trial involved selecting one beverage from a pair of presented options, followed by delivery of a 3 mL aliquot of the selected option using an MR-compatible gustometer. We also tracked subjective preference for each beverage throughout the experiment. RESULTS During food choice, individuals with greater BMI had less activation in the dorsolateral prefrontal cortex when selecting a high-value option and less vmPFC activation upon its consumption. Independent of BMI, during food choice the dACC and anterior insula elicited higher activation when a less preferred beverage was selected. Activation of the dACC and a broader frontoparietal network was also observed when deciding between options more similar in value. During consumption, receipt of a more preferred beverage was associated with greater vmPFC response, and attenuation of the dACC. CONCLUSIONS An individual's preference for a food option modulates the brain activity associated with choosing and consuming it. The relationship between food preference and underlying brain activity is altered in obesity, with reduced engagement of cognition-related regions when presented with a highly valued option, but a blunted response in reward-related regions upon consumption.
Collapse
Affiliation(s)
- Erynn L Christensen
- School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, Australia
| | - Ian H Harding
- Department of Neuroscience, Central Clinical School, Monash University, Melbourne, VIC, Australia.,Monash Biomedical Imaging, Monash University, Melbourne, VIC, Australia
| | - Katharina Voigt
- School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, Australia.,Department of Neuroscience, Central Clinical School, Monash University, Melbourne, VIC, Australia
| | - Trevor T-J Chong
- School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, Australia
| | - Antonio Verdejo-Garcia
- School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, Australia.
| |
Collapse
|
36
|
Amarante LM, Laubach M. Coherent theta activity in the medial and orbital frontal cortices encodes reward value. eLife 2021; 10:e63372. [PMID: 34505830 PMCID: PMC8457826 DOI: 10.7554/elife.63372] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Accepted: 09/09/2021] [Indexed: 01/03/2023] Open
Abstract
This study examined how the medial frontal (MFC) and orbital frontal (OFC) cortices process reward information. We simultaneously recorded local field potentials in the two areas as rats consumed liquid sucrose rewards. Both areas exhibited a 4-8 Hz 'theta' rhythm that was phase-locked to the lick cycle. The rhythm tracked shifts in sucrose concentrations and fluid volumes, demonstrating that it is sensitive to differences in reward magnitude. The coupling between the rhythm and licking was stronger in MFC than OFC and varied with response vigor and absolute reward value in the MFC. Spectral analysis revealed zero-lag coherence between the cortical areas, and found evidence for a directionality of the rhythm, with MFC leading OFC. Our findings suggest that consummatory behavior generates simultaneous theta range activity in the MFC and OFC that encodes the value of consumed fluids, with the MFC having a top-down role in the control of consumption.
Collapse
Affiliation(s)
- Linda M Amarante
- Department of Neuroscience, American UniversityWashington DCUnited States
| | - Mark Laubach
- Department of Neuroscience, American UniversityWashington DCUnited States
| |
Collapse
|
37
|
Lee S, Yu LQ, Lerman C, Kable JW. Subjective value, not a gridlike code, describes neural activity in ventromedial prefrontal cortex during value-based decision-making. Neuroimage 2021; 237:118159. [PMID: 33991700 PMCID: PMC8298105 DOI: 10.1016/j.neuroimage.2021.118159] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2020] [Revised: 05/06/2021] [Accepted: 05/08/2021] [Indexed: 12/20/2022] Open
Abstract
Across many studies, ventromedial prefrontal cortex (vmPFC) activity has been found to correlate with subjective value during value-based decision-making. Recently, however, vmPFC has also been shown to reflect a hexagonal gridlike code during navigation through physical and conceptual space, and such gridlike codes have been proposed to enable value-based choices between novel options. Here, we first show that, in theory, a hexagonal gridlike code can in some cases mimic vmPFC activity previously attributed to subjective value, raising the possibility that the subjective value correlates previously observed in vmPFC may have actually been a misconstrued gridlike signal. We then compare the two accounts empirically, using fMRI data from a large number of subjects performing an intertemporal choice task. We find clear and unambiguous evidence that subjective value is a better description of vmPFC activity in this task than a hexagonal gridlike code. In fact, we find no significant evidence at all for a hexagonal gridlike code in vmPFC activity during intertemporal choice. This result limits the generality of gridlike modulation as description of vmPFC activity. We suggest that vmPFC may flexibly switch representational schemes so as to encode the most relevant information for the current task.
Collapse
Affiliation(s)
- Sangil Lee
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA.
| | - Linda Q Yu
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA; Carney Institute for Brain Science, Brown University, Providence, RI 02912, USA
| | - Caryn Lerman
- Norris Comprehensive Cancer Center, University of Southern California, Los Angeles, CA 90033, USA
| | - Joseph W Kable
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
38
|
Abstract
Emotions can be defined as states elicited by rewards or punishments, and indeed the neurology of emotional disorders can be understood in terms of this foundation. The orbitofrontal cortex in humans and other primates is a critical area in emotion processing, determining the value of stimuli and whether they are rewarding or nonrewarding. The cortical processing that occurs before the orbitofrontal cortex primarily involves defining the identity of stimuli, i.e., "what" is present and not reward value. There is evidence that this holds true for taste, visual, somatosensory, and olfactory stimuli. The human medial orbitofrontal cortex is important in processing many different types of reward, and the lateral orbitofrontal cortex in processing nonreward and punishment. Humans with damage to the orbitofrontal cortex have an impaired ability to identify facial and voice expressions of emotions, and impaired subjective experience of emotion. They can have an altered personality and be impulsive because they are impaired at processing failures to receive expected rewards and at processing punishments. In humans, the role of the amygdala in the processing of emotions is reduced because of the great evolutionary development of the orbitofrontal cortex: amygdala damage has much less effect on emotion than does orbitofrontal cortex damage. The orbitofrontal cortex projects reward value information to the anterior cingulate cortex, which is involved in learning those actions required to obtain rewards and avoid punishments. The cingulate cortex thus provides an output route for emotional behavior. In depression, the medial orbitofrontal cortex has decreased connectivity and sensitivity to reward, and the lateral orbitofrontal cortex has increased connectivity and sensitivity to nonreward. The orbitofrontal cortex has major projections to the anterior cingulate cortex, including its subcommissural region, and the anterior cingulate cortex is also implicated in depression.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, United Kingdom; Department of Computer Science, University of Warwick, Coventry, United Kingdom.
| |
Collapse
|
39
|
Maisson DJN, Cash-Padgett TV, Wang MZ, Hayden BY, Heilbronner SR, Zimmermann J. Choice-relevant information transformation along a ventrodorsal axis in the medial prefrontal cortex. Nat Commun 2021; 12:4830. [PMID: 34376663 PMCID: PMC8355277 DOI: 10.1038/s41467-021-25219-w] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Accepted: 07/27/2021] [Indexed: 11/17/2022] Open
Abstract
Choice-relevant brain regions in prefrontal cortex may progressively transform information about options into choices. Here, we examine responses of neurons in four regions of the medial prefrontal cortex as macaques performed two-option risky choices. All four regions encode economic variables in similar proportions and show similar putative signatures of key choice-related computations. We provide evidence to support a gradient of function that proceeds from areas 14 to 25 to 32 to 24. Specifically, we show that decodability of twelve distinct task variables increases along that path, consistent with the idea that regions that are higher in the anatomical hierarchy make choice-relevant variables more separable. We also show progressively longer intrinsic timescales in the same series. Together these results highlight the importance of the medial wall in choice, endorse a specific gradient-based organization, and argue against a modular functional neuroanatomy of choice.
Collapse
Affiliation(s)
- David J-N Maisson
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA.
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA.
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA.
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA.
| | - Tyler V Cash-Padgett
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Maya Z Wang
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Benjamin Y Hayden
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Sarah R Heilbronner
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Jan Zimmermann
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
40
|
Azzalini D, Buot A, Palminteri S, Tallon-Baudry C. Responses to Heartbeats in Ventromedial Prefrontal Cortex Contribute to Subjective Preference-Based Decisions. J Neurosci 2021; 41:5102-5114. [PMID: 33926998 PMCID: PMC8197644 DOI: 10.1523/jneurosci.1932-20.2021] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Revised: 01/14/2021] [Accepted: 01/25/2021] [Indexed: 11/21/2022] Open
Abstract
Forrest Gump or The Matrix? Preference-based decisions are subjective and entail self-reflection. However, these self-related features are unaccounted for by known neural mechanisms of valuation and choice. Self-related processes have been linked to a basic interoceptive biological mechanism, the neural monitoring of heartbeats, in particular in ventromedial prefrontal cortex (vmPFC), a region also involved in value encoding. We thus hypothesized a functional coupling between the neural monitoring of heartbeats and the precision of value encoding in vmPFC. Human participants of both sexes were presented with pairs of movie titles. They indicated either which movie they preferred or performed a control objective visual discrimination that did not require self-reflection. Using magnetoencephalography, we measured heartbeat-evoked responses (HERs) before option presentation and confirmed that HERs in vmPFC were larger when preparing for the subjective, self-related task. We retrieved the expected cortical value network during choice with time-resolved statistical modeling. Crucially, we show that larger HERs before option presentation are followed by stronger value encoding during choice in vmPFC. This effect is independent of overall vmPFC baseline activity. The neural interaction between HERs and value encoding predicted preference-based choice consistency over time, accounting for both interindividual differences and trial-to-trial fluctuations within individuals. Neither cardiac activity nor arousal fluctuations could account for any of the effects. HERs did not interact with the encoding of perceptual evidence in the discrimination task. Our results show that the self-reflection underlying preference-based decisions involves HERs, and that HER integration to subjective value encoding in vmPFC contributes to preference stability.SIGNIFICANCE STATEMENT Deciding whether you prefer Forrest Gump or The Matrix is based on subjective values, which only you, the decision-maker, can estimate and compare, by asking yourself. Yet, how self-reflection is biologically implemented and its contribution to subjective valuation are not known. We show that in ventromedial prefrontal cortex, the neural response to heartbeats, an interoceptive self-related process, influences the cortical representation of subjective value. The neural interaction between the cortical monitoring of heartbeats and value encoding predicts choice consistency (i.e., whether you consistently prefer Forrest Gump over Matrix over time. Our results pave the way for the quantification of self-related processes in decision-making and may shed new light on the relationship between maladaptive decisions and impaired interoception.
Collapse
Affiliation(s)
- Damiano Azzalini
- Laboratoire de Neurosciences Cognitives et Computationnelles, Ecole Normale Supérieure, PSL University, 75005 Paris, France
- Institut National de la Santé et de la Recherche Médicale, 75005 Paris, France
| | - Anne Buot
- Laboratoire de Neurosciences Cognitives et Computationnelles, Ecole Normale Supérieure, PSL University, 75005 Paris, France
- Institut National de la Santé et de la Recherche Médicale, 75005 Paris, France
| | - Stefano Palminteri
- Laboratoire de Neurosciences Cognitives et Computationnelles, Ecole Normale Supérieure, PSL University, 75005 Paris, France
- Institut National de la Santé et de la Recherche Médicale, 75005 Paris, France
| | - Catherine Tallon-Baudry
- Laboratoire de Neurosciences Cognitives et Computationnelles, Ecole Normale Supérieure, PSL University, 75005 Paris, France
- Institut National de la Santé et de la Recherche Médicale, 75005 Paris, France
| |
Collapse
|
41
|
Hunt LT. Frontal circuit specialisations for decision making. Eur J Neurosci 2021; 53:3654-3671. [PMID: 33864305 DOI: 10.1111/ejn.15236] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Revised: 03/15/2021] [Accepted: 04/04/2021] [Indexed: 11/29/2022]
Abstract
There is widespread consensus that distributed circuits across prefrontal and anterior cingulate cortex (PFC/ACC) are critical for reward-based decision making. The circuit specialisations of these areas in primates were likely shaped by their foraging niche, in which decision making is typically sequential, attention-guided and temporally extended. Here, I argue that in humans and other primates, PFC/ACC circuits are functionally specialised in two ways. First, microcircuits found across PFC/ACC are highly recurrent in nature and have synaptic properties that support persistent activity across temporally extended cognitive tasks. These properties provide the basis of a computational account of time-varying neural activity within PFC/ACC as a decision is being made. Second, the macrocircuit connections (to other brain areas) differ between distinct PFC/ACC cytoarchitectonic subregions. This variation in macrocircuit connections explains why PFC/ACC subregions make unique contributions to reward-based decision tasks and how these contributions are shaped by attention. They predict dissociable neural representations to emerge in orbitofrontal, anterior cingulate and dorsolateral prefrontal cortex during sequential attention-guided choice, as recently confirmed in neurophysiological recordings.
Collapse
Affiliation(s)
- Laurence T Hunt
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
42
|
Cooper JA, Nuutinen MR, Lawlor VM, DeVries BAM, Barrick EM, Hossein S, Cole DJ, Leonard CV, Hahn EC, Teer AP, Shields GS, Slavich GM, Ongur D, Jensen JE, Du F, Pizzagalli DA, Treadway MT. Reduced adaptation of glutamatergic stress response is associated with pessimistic expectations in depression. Nat Commun 2021; 12:3166. [PMID: 34039978 PMCID: PMC8155144 DOI: 10.1038/s41467-021-23284-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2020] [Accepted: 04/19/2021] [Indexed: 01/20/2023] Open
Abstract
Stress is a significant risk factor for the development of major depressive disorder (MDD), yet the underlying mechanisms remain unclear. Preclinically, adaptive and maladaptive stress-induced changes in glutamatergic function have been observed in the medial prefrontal cortex (mPFC). Here, we examine stress-induced changes in human mPFC glutamate using magnetic resonance spectroscopy (MRS) in two healthy control samples and a third sample of unmedicated participants with MDD who completed the Maastricht acute stress task, and one sample of healthy control participants who completed a no-stress control manipulation. In healthy controls, we find that the magnitude of mPFC glutamate response to the acute stressor decreases as individual levels of perceived stress increase. This adaptative glutamate response is absent in individuals with MDD and is associated with pessimistic expectations during a 1-month follow-up period. Together, this work shows evidence for glutamatergic adaptation to stress that is significantly disrupted in MDD.
Collapse
Affiliation(s)
| | | | | | | | - Elyssa M Barrick
- Center for Depression, Anxiety and Stress Research, McLean Hospital/Harvard Medical School, Belmont, MA, USA
| | - Shabnam Hossein
- Department of Psychology, Emory University, Atlanta, GA, USA
| | - Daniel J Cole
- Department of Psychology, Emory University, Atlanta, GA, USA
| | | | - Evan C Hahn
- Department of Psychology, Emory University, Atlanta, GA, USA
| | - Andrew P Teer
- Department of Psychiatry and Behavioral Sciences, Emory University, Atlanta, GA, USA
| | - Grant S Shields
- Department of Psychological Science, University of Arkansas, Fayetteville, AR, USA
| | - George M Slavich
- Cousins Center for Psychoneuroimmunology and Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, CA, USA
| | - Dost Ongur
- Department of Psychiatry, McLean Hospital/Harvard Medical School, Belmont, MA, USA
| | - J Eric Jensen
- McLean Imaging Center, McLean Hospital/Harvard Medical School, Belmont, MA, USA
| | - Fei Du
- McLean Imaging Center, McLean Hospital/Harvard Medical School, Belmont, MA, USA
| | - Diego A Pizzagalli
- Center for Depression, Anxiety and Stress Research, McLean Hospital/Harvard Medical School, Belmont, MA, USA
- Department of Psychiatry, McLean Hospital/Harvard Medical School, Belmont, MA, USA
- McLean Imaging Center, McLean Hospital/Harvard Medical School, Belmont, MA, USA
| | - Michael T Treadway
- Department of Psychology, Emory University, Atlanta, GA, USA.
- Department of Psychiatry and Behavioral Sciences, Emory University, Atlanta, GA, USA.
| |
Collapse
|
43
|
Azab H, Hayden BY. Partial integration of the components of value in anterior cingulate cortex. Behav Neurosci 2021; 134:296-308. [PMID: 32658523 DOI: 10.1037/bne0000382] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Evaluation often involves integrating multiple determinants of value, such as the different possible outcomes in risky choice. A brain region can be placed either before or after a presumed evaluation stage by measuring how responses of its neurons depend on multiple determinants of value. A brain region could also, in principle, show partial integration, which would indicate that it occupies a middle position between (preevaluative) nonintegration and (postevaluative) full integration. Existing mathematical techniques cannot distinguish full from partial integration and therefore risk misidentifying regional function. Here we use a new Bayesian regression-based approach to analyze responses of neurons in dorsal anterior cingulate cortex (dACC) to risky offers. We find that dACC neurons only partially integrate across outcome dimensions, indicating that dACC cannot be assigned to either a pre- or postevaluative position. Neurons in dACC also show putative signatures of value comparison, thereby demonstrating that comparison does not require complete evaluation before proceeding. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
Affiliation(s)
- Habiba Azab
- Department of Neuroscience, Center for Magnetic Resonance Research (CMRR), University of Minnesota, Twin Cities
| | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research (CMRR), University of Minnesota, Twin Cities
| |
Collapse
|
44
|
Is value-based choice repetition susceptible to medial frontal transcranial direct current stimulation (tDCS)? A preregistered study. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2021; 21:747-762. [PMID: 33796986 PMCID: PMC8354960 DOI: 10.3758/s13415-021-00889-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 03/08/2021] [Indexed: 11/23/2022]
Abstract
In value-based decision making, people have to weigh different options based on their subjective value. This process, however, also is influenced by choice biases, such as choice repetition: in a series of choices, people are more likely to repeat their decision than to switch to a different choice. Previously, it was shown that transcranial direct current stimulation (tDCS) can affect such choice biases. We applied tDCS over the medial prefrontal cortex to investigate whether tDCS can alter choice repetition in value-based decision making. In a preregistered study, we applied anodal, cathodal, and sham tDCS stimulation to 52 participants. While we found robust choice repetition effects, we did not find support for an effect of tDCS stimulation. We discuss these findings within the larger scope of the tDCS literature and highlight the potential roles of interindividual variability and current density strength.
Collapse
|
45
|
Diao L, Li W, Zhang W, Ma Q, Jin J. Electroencephalographic Theta-Band Oscillatory Dynamics Represent Attentional Bias to Subjective Preferences in Value-Based Decisions. Psychol Res Behav Manag 2021; 14:149-158. [PMID: 33623446 PMCID: PMC7894809 DOI: 10.2147/prbm.s292172] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Accepted: 01/14/2021] [Indexed: 11/23/2022] Open
Abstract
Background Previous studies have shown that people always pay more attention to highly preferred items of choice, which is well defined by behavioral measurements and eye-tracking. However, less is known about the neural dynamics underlying the role that visual attention plays in value-based decisions, especially in those characterized by the “relative value” (ie, value difference) between two items displayed simultaneously in a binary choice. Purpose This study examined the neural temporal and neural oscillatory features underlying selective attention to subjective preferences in value-based decision making. Methods In this study, we recorded electroencephalography (EEG) measurements while participants performed a binary choice task in which they were instructed to respond to their preferred snack in high value difference (HVD) or low value difference (LVD) conditions. Results Behaviorally, participants showed faster responses and lower error rates in the HVD condition than in the LVD condition. In parallel, participants exerted a reduced prefrontal N2 component and attenuated frontal theta-band synchronization in the HVD condition as opposed to the LVD condition. Crucially, participants showed greater N2pc component and theta-band synchronization over the human posterior cortex in the HVD condition than in the LVD condition. Moreover, there was a direct correlation between frontal and posterior theta-band synchronization. Conclusion The results show that theta-band oscillatory dynamics may represent attentional bias to subjective preferences, and this effect can be modulated by the level attentional bias to subjective preferences, and this effect can be modulated by the level of value difference. Our research provides insights into a new avenue via which the processing of selective attention and value representation in the value-based decisions can be implicated in an integrative neural oscillatory mechanism.
Collapse
Affiliation(s)
- Liuting Diao
- Business School, Ningbo University, Ningbo, People's Republic of China.,Academy of Neuroeconomics and Neuromanagement, Ningbo University, Ningbo, People's Republic of China
| | - Wenping Li
- Prudence College, Zhejiang Business Technology Institute, Ningbo, People's Republic of China
| | - Wuke Zhang
- Business School, Ningbo University, Ningbo, People's Republic of China.,Academy of Neuroeconomics and Neuromanagement, Ningbo University, Ningbo, People's Republic of China
| | - Qingguo Ma
- Business School, Ningbo University, Ningbo, People's Republic of China.,Academy of Neuroeconomics and Neuromanagement, Ningbo University, Ningbo, People's Republic of China.,School of Management, Zhejiang University, Hangzhou, People's Republic of China
| | - Jia Jin
- School of Business and Management, Shanghai International Studies University, Shanghai, People's Republic of China
| |
Collapse
|
46
|
Kaiser LF, Gruendler TOJ, Speck O, Luettgau L, Jocham G. Dissociable roles of cortical excitation-inhibition balance during patch-leaving versus value-guided decisions. Nat Commun 2021; 12:904. [PMID: 33568654 PMCID: PMC7875994 DOI: 10.1038/s41467-020-20875-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2019] [Accepted: 12/11/2020] [Indexed: 01/30/2023] Open
Abstract
In a dynamic world, it is essential to decide when to leave an exploited resource. Such patch-leaving decisions involve balancing the cost of moving against the gain expected from the alternative patch. This contrasts with value-guided decisions that typically involve maximizing reward by selecting the current best option. Patterns of neuronal activity pertaining to patch-leaving decisions have been reported in dorsal anterior cingulate cortex (dACC), whereas competition via mutual inhibition in ventromedial prefrontal cortex (vmPFC) is thought to underlie value-guided choice. Here, we show that the balance between cortical excitation and inhibition (E/I balance), measured by the ratio of GABA and glutamate concentrations, plays a dissociable role for the two kinds of decisions. Patch-leaving decision behaviour relates to E/I balance in dACC. In contrast, value-guided decision-making relates to E/I balance in vmPFC. These results support mechanistic accounts of value-guided choice and provide evidence for a role of dACC E/I balance in patch-leaving decisions.
Collapse
Affiliation(s)
- Luca F. Kaiser
- grid.411327.20000 0001 2176 9917Biological Psychology of Decision Making, Institute of Experimental Psychology, Heinrich Heine University, Düsseldorf, Germany ,grid.5807.a0000 0001 1018 4307Center for Behavioral Brain Sciences, Otto von Guericke University, Magdeburg, Germany
| | - Theo O. J. Gruendler
- grid.5807.a0000 0001 1018 4307Center for Behavioral Brain Sciences, Otto von Guericke University, Magdeburg, Germany ,Center for Military Mental Health, Military Hospital Berlin, Berlin, Germany
| | - Oliver Speck
- grid.5807.a0000 0001 1018 4307Center for Behavioral Brain Sciences, Otto von Guericke University, Magdeburg, Germany ,grid.418723.b0000 0001 2109 6265Leibniz Institute for Neurobiology, Magdeburg, Germany ,grid.424247.30000 0004 0438 0426German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany ,grid.5807.a0000 0001 1018 4307Department of Biomedical Magnetic Resonance, Institute for Physics, Otto von Guericke University, Magdeburg, Germany
| | - Lennart Luettgau
- grid.411327.20000 0001 2176 9917Biological Psychology of Decision Making, Institute of Experimental Psychology, Heinrich Heine University, Düsseldorf, Germany ,grid.5807.a0000 0001 1018 4307Center for Behavioral Brain Sciences, Otto von Guericke University, Magdeburg, Germany
| | - Gerhard Jocham
- grid.411327.20000 0001 2176 9917Biological Psychology of Decision Making, Institute of Experimental Psychology, Heinrich Heine University, Düsseldorf, Germany ,grid.5807.a0000 0001 1018 4307Center for Behavioral Brain Sciences, Otto von Guericke University, Magdeburg, Germany
| |
Collapse
|
47
|
Levy I, Schiller D. Neural Computations of Threat. Trends Cogn Sci 2021; 25:151-171. [PMID: 33384214 PMCID: PMC8084636 DOI: 10.1016/j.tics.2020.11.007] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Revised: 11/16/2020] [Accepted: 11/18/2020] [Indexed: 12/26/2022]
Abstract
A host of learning, memory, and decision-making processes form the individual's response to threat and may be disrupted in anxiety and post-trauma psychopathology. Here we review the neural computations of threat, from the first encounter with a dangerous situation, through learning, storing, and updating cues that predict it, to making decisions about the optimal course of action. The overview highlights the interconnected nature of these processes and their reliance on shared neural and computational mechanisms. We propose an integrative approach to the study of threat-related processes, in which specific computations are studied across the various stages of threat experience rather than in isolation. This approach can generate new insights about the evolution, diagnosis, and treatment of threat-related psychopathology.
Collapse
Affiliation(s)
- Ifat Levy
- Departments of Comparative Medicine, Neuroscience, and Psychology, Yale University, New Haven, CT, USA.
| | - Daniela Schiller
- Department of Psychiatry, Department of Neuroscience, and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
| |
Collapse
|
48
|
Simon J, Rudebeck PH, Rich EL. From affective to cognitive processing: Functional organization of the medial frontal cortex. INTERNATIONAL REVIEW OF NEUROBIOLOGY 2021; 158:1-28. [PMID: 33785142 DOI: 10.1016/bs.irn.2020.11.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
The medial wall of the primate frontal lobe encompasses multiple anatomical subregions. Based on distinct neurophysiological correlates and effects of lesions, individual areas are thought to play unique roles in behavior. Further, evidence suggests that dysfunction localized to specific subregions is commonly found in different neuropsychiatric disorders. The neurobiological underpinnings of these disorders, however, remain far from clear. Here, to better understand the functions of medial frontal cortex (MFC) and its role in psychiatric disease, we focus on its functional organization. We describe the emerging pattern in which more dorsal regions subserve temporally extended cognitive functions and more ventral regions predominantly subserve affective functions. We focus on two specific domains, decision-making and social cognition, that require integration across emotion and cognition. In each case, we discuss the current understanding of the functions believed to depend on subregions of MFC as a stepping-stone to speculate on how they might work in unison. We conclude with an overview of how symptoms of certain psychiatric disorders relate to our understanding of MFC functional organization and how further discovery could fuel advances in circuit-based therapies.
Collapse
Affiliation(s)
- Joseph Simon
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Peter H Rudebeck
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Erin L Rich
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY, United States.
| |
Collapse
|
49
|
Oscillations as a window into neuronal mechanisms underlying dorsal anterior cingulate cortex function. INTERNATIONAL REVIEW OF NEUROBIOLOGY 2020; 158:311-335. [PMID: 33785150 DOI: 10.1016/bs.irn.2020.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
The function of dorsal Anterior Cingulate Cortex (dACC) remains poorly understood. While many methods, spanning bottom-up and top-down approaches, have been deployed, the view they offer is often conflicting. Integrating bottom-up and top-down approaches requires an intermediary with sufficient explanatory power, theoretical development, and empirical support. Oscillations in the local field potential (LFP) provide such a link. LFP oscillations arise from empirically well-characterized neuronal circuit motifs. Synchronizing the firing of individual units has appealing properties to bind disparate brain regions and propagate information, including gating, routing, and coding. Moreover, the LFP, rather than single unit activity, more closely relates to macro-scale recordings, such as the electroencephalogram and functional magnetic resonance imaging. Thus, LFP oscillations are a critical link that allow for the inference of neuronal micro-circuitry underlying macroscopic brain recordings.
Collapse
|
50
|
Rolls ET, Cheng W, Feng J. The orbitofrontal cortex: reward, emotion and depression. Brain Commun 2020; 2:fcaa196. [PMID: 33364600 PMCID: PMC7749795 DOI: 10.1093/braincomms/fcaa196] [Citation(s) in RCA: 161] [Impact Index Per Article: 40.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 08/13/2020] [Accepted: 10/13/2020] [Indexed: 12/11/2022] Open
Abstract
The orbitofrontal cortex in primates including humans is the key brain area in emotion, and in the representation of reward value and in non-reward, that is not obtaining an expected reward. Cortical processing before the orbitofrontal cortex is about the identity of stimuli, i.e. 'what' is present, and not about reward value. There is evidence that this holds for taste, visual, somatosensory and olfactory stimuli. The human medial orbitofrontal cortex represents many different types of reward, and the lateral orbitofrontal cortex represents non-reward and punishment. Not obtaining an expected reward can lead to sadness, and feeling depressed. The concept is advanced that an important brain region in depression is the orbitofrontal cortex, with depression related to over-responsiveness and over-connectedness of the non-reward-related lateral orbitofrontal cortex, and to under-responsiveness and under-connectivity of the reward-related medial orbitofrontal cortex. Evidence from large-scale voxel-level studies and supported by an activation study is described that provides support for this hypothesis. Increased functional connectivity of the lateral orbitofrontal cortex with brain areas that include the precuneus, posterior cingulate cortex and angular gyrus is found in patients with depression and is reduced towards the levels in controls when treated with medication. Decreased functional connectivity of the medial orbitofrontal cortex with medial temporal lobe areas involved in memory is found in patients with depression. Some treatments for depression may act by reducing activity or connectivity of the lateral orbitofrontal cortex. New treatments that increase the activity or connectivity of the medial orbitofrontal cortex may be useful for depression. These concepts, and that of increased activity in non-reward attractor networks, have potential for advancing our understanding and treatment of depression. The focus is on the orbitofrontal cortex in primates including humans, because of differences of operation of the orbitofrontal cortex, and indeed of reward systems, in rodents. Finally, the hypothesis is developed that the orbitofrontal cortex has a special role in emotion and decision-making in part because as a cortical area it can implement attractor networks useful in maintaining reward and emotional states online, and in decision-making.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK
- Institute of Science and Technology for Brain-inspired Intelligence, Fudan University, Shanghai 200433, China
| | - Wei Cheng
- Institute of Science and Technology for Brain-inspired Intelligence, Fudan University, Shanghai 200433, China
- Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education, Shanghai 200433, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK
- Institute of Science and Technology for Brain-inspired Intelligence, Fudan University, Shanghai 200433, China
- School of Mathematical Sciences, School of Life Science and the Collaborative Innovation Center for Brain Science, Fudan University, Shanghai 200433, China
- Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education, Shanghai 200433, China
| |
Collapse
|