1
|
Shimbo A, Takahashi YK, Langdon AJ, Stalnaker TA, Schoenbaum G. Cracking and Packing Information about the Features of Expected Rewards in the Orbitofrontal Cortex. J Neurosci 2024; 44:e0714242024. [PMID: 39122558 PMCID: PMC11376335 DOI: 10.1523/jneurosci.0714-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 07/29/2024] [Accepted: 08/02/2024] [Indexed: 08/12/2024] Open
Abstract
The orbitofrontal cortex (OFC) is crucial for tracking various aspects of expected outcomes, thereby helping to guide choices and support learning. Our previous study showed that the effects of reward timing and size on the activity of single units in OFC were dissociable when these attributes were manipulated independently ( Roesch et al., 2006). However, in real-life decision-making scenarios, outcome features often change simultaneously, so here we investigated how OFC neurons in male rats integrate information about the timing and identity (flavor) of reward and respond to changes in these features, according to whether they were changed simultaneously or separately. We found that a substantial number of OFC neurons fired differentially to immediate versus delayed reward and to the different reward flavors. However, contrary to the previous study, selectivity for timing was strongly correlated with selectivity for identity. Taken together with the previous research, these results suggest that when reward features are correlated, OFC tends to "pack" them into unitary constructs, whereas when they are independent, OFC tends to "crack" them into separate constructs. Furthermore, we found that when both reward timing and flavor were changed, reward-responsive OFC neurons showed unique activity patterns preceding and during the omission of an expected reward. Interestingly, this OFC activity is similar and slightly preceded the ventral tegmental area dopamine (VTA DA) activity observed in a previous study ( Takahashi et al., 2023), consistent with the role of OFC in providing predictive information to VTA DA neurons.
Collapse
Affiliation(s)
- Akihiro Shimbo
- National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, Baltimore, Maryland 21224
| | - Yuji K Takahashi
- National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, Baltimore, Maryland 21224
| | - Angela J Langdon
- National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, Baltimore, Maryland 21224
| | - Thomas A Stalnaker
- National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, Baltimore, Maryland 21224
| | - Geoffrey Schoenbaum
- National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, Baltimore, Maryland 21224
| |
Collapse
|
2
|
Oyama K, Majima K, Nagai Y, Hori Y, Hirabayashi T, Eldridge MAG, Mimura K, Miyakawa N, Fujimoto A, Hori Y, Iwaoki H, Inoue KI, Saunders RC, Takada M, Yahata N, Higuchi M, Richmond BJ, Minamimoto T. Distinct roles of monkey OFC-subcortical pathways in adaptive behavior. Nat Commun 2024; 15:6487. [PMID: 39198415 PMCID: PMC11358305 DOI: 10.1038/s41467-024-50505-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 07/10/2024] [Indexed: 09/01/2024] Open
Abstract
Primates must adapt to changing environments by optimizing their behavior to make beneficial choices. At the core of adaptive behavior is the orbitofrontal cortex (OFC) of the brain, which updates choice value through direct experience or knowledge-based inference. Here, we identify distinct neural circuitry underlying these two separate abilities. We designed two behavioral tasks in which two male macaque monkeys updated the values of certain items, either by directly experiencing changes in stimulus-reward associations, or by inferring the value of unexperienced items based on the task's rules. Chemogenetic silencing of bilateral OFC combined with mathematical model-fitting analysis revealed that monkey OFC is involved in updating item value based on both experience and inference. In vivo imaging of chemogenetic receptors by positron emission tomography allowed us to map projections from the OFC to the rostromedial caudate nucleus (rmCD) and the medial part of the mediodorsal thalamus (MDm). Chemogenetic silencing of the OFC-rmCD pathway impaired experience-based value updating, while silencing the OFC-MDm pathway impaired inference-based value updating. Our results thus demonstrate dissociable contributions of distinct OFC projections to different behavioral strategies, and provide new insights into the neural basis of value-based adaptive decision-making in primates.
Collapse
Affiliation(s)
- Kei Oyama
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
- PRESTO, Japan Science and Technology Agency, Kawaguchi, Japan
| | - Kei Majima
- PRESTO, Japan Science and Technology Agency, Kawaguchi, Japan
- Institute for Quantum Life Science, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Yuji Nagai
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Yukiko Hori
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Toshiyuki Hirabayashi
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Mark A G Eldridge
- Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Koki Mimura
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
- Research Center for Medical and Health Data Science, The Institute of Statistical Mathematics, Tachikawa, Japan
| | - Naohisa Miyakawa
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Atsushi Fujimoto
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Yuki Hori
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Haruhiko Iwaoki
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Ken-Ichi Inoue
- Systems Neuroscience Section, Center for the Evolutionary Origins of Human Behavior, Kyoto University, Inuyama, Japan
| | - Richard C Saunders
- Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Masahiko Takada
- Systems Neuroscience Section, Center for the Evolutionary Origins of Human Behavior, Kyoto University, Inuyama, Japan
| | - Noriaki Yahata
- Institute for Quantum Life Science, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Makoto Higuchi
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan
| | - Barry J Richmond
- Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Takafumi Minamimoto
- Advanced Neuroimaging Center, National Institutes for Quantum Science and Technology, Chiba, Japan.
| |
Collapse
|
3
|
Eppinger B, Ruel A, Bolenz F. Diminished State Space Theory of Human Aging. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2023:17456916231204811. [PMID: 37931229 DOI: 10.1177/17456916231204811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2023]
Abstract
Many new technologies, such as smartphones, computers, or public-access systems (like ticket-vending machines), are a challenge for older adults. One feature that these technologies have in common is that they involve underlying, partially observable, structures (state spaces) that determine the actions that are necessary to reach a certain goal (e.g., to move from one menu to another, to change a function, or to activate a new service). In this work we provide a theoretical, neurocomputational account to explain these behavioral difficulties in older adults. Based on recent findings from age-comparative computational- and cognitive-neuroscience studies, we propose that age-related impairments in complex goal-directed behavior result from an underlying deficit in the representation of state spaces of cognitive tasks. Furthermore, we suggest that these age-related deficits in adaptive decision-making are due to impoverished neural representations in the orbitofrontal cortex and hippocampus.
Collapse
Affiliation(s)
- Ben Eppinger
- Institute of Psychology, University of Greifswald
- Department of Psychology, Concordia University
- PERFORM Centre, Concordia University
- Faculty of Psychology, Technische Universität Dresden
| | - Alexa Ruel
- Department of Psychology, Concordia University
- PERFORM Centre, Concordia University
- Institute of Psychology, University of Hamburg
| | - Florian Bolenz
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
- Science of Intelligence/Cluster of Excellence, Technical University of Berlin
| |
Collapse
|
4
|
Mann LG, Servant M, Hay KR, Song AK, Trujillo P, Yan B, Kang H, Zald D, Donahue MJ, Logan GD, Claassen DO. The Role of a Dopamine-Dependent Limbic-Motor Network in Sensory Motor Processing in Parkinson Disease. J Cogn Neurosci 2023; 35:1806-1822. [PMID: 37677065 PMCID: PMC10594953 DOI: 10.1162/jocn_a_02048] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
Limbic and motor integration is enabled by a mesial temporal to motor cortex network. Parkinson disease (PD) is characterized by a loss of dorsal striatal dopamine but relative preservation of mesolimbic dopamine early in disease, along with changes to motor action control. Here, we studied 47 patients with PD using the Simon conflict task and [18F]fallypride PET imaging. Additionally, a cohort of 16 patients participated in a single-blinded dextroamphetamine (dAMPH) study. Task performance was evaluated using the diffusion model for conflict tasks, which allows for an assessment of interpretable action control processes. First, a voxel-wise examination disclosed a negative relationship, such that longer non-decision time is associated with reduced D2-like binding potential (BPND) in the bilateral putamen, left globus pallidus, and right insula. Second, an ROI analysis revealed a positive relationship, such that shorter non-decision time is associated with reduced D2-like BPND in the amygdala and ventromedial OFC. The difference in non-decision time between off-dAMPH and on-dAMPH trials was positively associated with D2-like BPND in the globus pallidus. These findings support the idea that dysfunction of the traditional striatal-motor loop underlies action control deficits but also suggest that a compensatory parallel limbic-motor loop regulates motor output.
Collapse
Affiliation(s)
- Leah G. Mann
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN 37232, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| | - Mathieu Servant
- Laboratoire de Recherches Intégratives en Neurosciences et Psychologie Cognitive, Université de Franche-Comté, 25000 Besançon, France
| | - Kaitlyn R. Hay
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| | - Alexander K. Song
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN 37232, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| | - Paula Trujillo
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| | - Bailu Yan
- Deparment of Biostatistics, Vanderbilt University Medical Center, Nashville, TN 37203, USA
| | - Hakmook Kang
- Deparment of Biostatistics, Vanderbilt University Medical Center, Nashville, TN 37203, USA
| | - David Zald
- Department of Psychiatry, Rutgers University, Piscataway, NJ 08854, USA
| | - Manus J. Donahue
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| | - Gordon D. Logan
- Department of Psychology, Vanderbilt University, Nashville, TN 37240, USA
| | - Daniel O. Claassen
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| |
Collapse
|
5
|
Abstract
People with damage to the orbitofrontal cortex (OFC) have specific problems making decisions, whereas their other cognitive functions are spared. Neurophysiological studies have shown that OFC neurons fire in proportion to the value of anticipated outcomes. Thus, a central role of the OFC is to guide optimal decision-making by signalling values associated with different choices. Until recently, this view of OFC function dominated the field. New data, however, suggest that the OFC may have a much broader role in cognition by representing cognitive maps that can be used to guide behaviour and that value is just one of many variables that are important for behavioural control. In this Review, we critically evaluate these two alternative accounts of OFC function and examine how they might be reconciled.
Collapse
Affiliation(s)
- Eric B Knudsen
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, USA
| | - Joni D Wallis
- Department of Psychology and Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, USA.
| |
Collapse
|
6
|
Abstract
SignificancePeople's decisions about how to treat others are known to be influenced by societally shared expectations about the typical traits of people from particular social groups (stereotypes). We combined a social psychological framework, an economic game, and multivariate functional MRI analysis to investigate whether and how trait inferences are instantiated neurally in the service of behavior toward members of different social groups. Multidimensional representations of trait content were found in brain regions associated with social cognition and in a region associated with inference-based decision-making: the lateral orbitofrontal cortex (OFC). Only OFC representations predicted individual participants' behavior, suggesting that although stereotypes are also represented in social cognition regions, they exert influence on behavior via decision-making mechanisms centered in the OFC.
Collapse
|
7
|
Groman SM, Thompson SL, Lee D, Taylor JR. Reinforcement learning detuned in addiction: integrative and translational approaches. Trends Neurosci 2022; 45:96-105. [PMID: 34920884 PMCID: PMC8770604 DOI: 10.1016/j.tins.2021.11.007] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Revised: 11/04/2021] [Accepted: 11/19/2021] [Indexed: 02/03/2023]
Abstract
Suboptimal decision-making strategies have been proposed to contribute to the pathophysiology of addiction. Decision-making, however, arises from a collection of computational components that can independently influence behavior. Disruptions in these different components can lead to decision-making deficits that appear similar behaviorally, but differ at the computational, and likely the neurobiological, level. Here, we discuss recent studies that have used computational approaches to investigate the decision-making processes underlying addiction. Studies in animal models have found that value updating following positive, but not negative, outcomes is predictive of drug use, whereas value updating following negative, but not positive, outcomes is disrupted following drug self-administration. We contextualize these findings with studies on the circuit and biological mechanisms of decision-making to develop a framework for revealing the biobehavioral mechanisms of addiction.
Collapse
Affiliation(s)
- Stephanie M. Groman
- Department of Neuroscience, University of Minnesota,Department of Psychiatry, Yale University,Correspondence to be directed to: Stephanie Groman, 321 Church Street SE, 4-125 Jackson Hall Minneapolis MN 55455,
| | | | - Daeyeol Lee
- The Zanvyl Krieger Mind/Brain Institute, The Solomon H Snyder Department of Neuroscience, Department of Psychological and Brain Sciences, Kavli Neuroscience Discovery Institute, Johns Hopkins University
| | - Jane R. Taylor
- Department of Psychiatry, Yale University,Department of Neuroscience, Yale University,Department of Psychology, Yale University
| |
Collapse
|
8
|
Differential coding of goals and actions in ventral and dorsal corticostriatal circuits during goal-directed behavior. Cell Rep 2022; 38:110198. [PMID: 34986350 PMCID: PMC9608360 DOI: 10.1016/j.celrep.2021.110198] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 07/08/2021] [Accepted: 12/10/2021] [Indexed: 02/04/2023] Open
Abstract
Goal-directed behavior requires identifying objects in the environment that can satisfy internal needs and executing actions to obtain those objects. The current study examines ventral and dorsal corticostriatal circuits that support complementary aspects of goal-directed behavior. We analyze activity from the amygdala, ventral striatum, orbitofrontal cortex, and lateral prefrontal cortex (LPFC) while monkeys perform a three-armed bandit task. Information about chosen stimuli and their value is primarily encoded in the amygdala, ventral striatum, and orbitofrontal cortex, while the spatial information is primarily encoded in the LPFC. Before the options are presented, information about the to-be-chosen stimulus is represented in the amygdala, ventral striatum, and orbitofrontal cortex; at the time of choice, the information is passed to the LPFC to direct a saccade. Thus, learned value information specifying behavioral goals is maintained throughout the ventral corticostriatal circuit, and it is routed through the dorsal circuit at the time actions are selected.
Collapse
|