1
|
Leung BK, Chieng B, Becchi S, Balleine BW. A ventral pallidal-thalamocortical circuit mediates the cognitive control of instrumental action. Curr Biol 2024:S0960-9822(24)00763-2. [PMID: 38936365 DOI: 10.1016/j.cub.2024.06.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 05/14/2024] [Accepted: 06/05/2024] [Indexed: 06/29/2024]
Abstract
Predictive learning can engage a selective form of cognitive control that biases choice between actions based on information about future outcomes that the learning provides. This influence has been hypothesized to depend on a feedback circuit in the brain through which the basal ganglia modulate activity in the prefrontal cortex; however, direct evidence for this functional circuit has proven elusive. Here, using an animal model of cognitive control, we found that the influence of predictive learning on decision making is mediated by an inhibitory feedback circuit linking the medial ventral pallidum and the mediodorsal thalamus, the activation of which causes disinhibition of the orbitofrontal cortex via reduced activation of inhibitory parvalbumin interneurons during choice. Thus, we found that, for this function, the mediodorsal thalamus serves as a pallidal-cortical relay through which predictive learning controls action selection, which has important implications for understanding cognitive control and its vicissitudes in various psychiatric disorders and addiction.
Collapse
Affiliation(s)
- Beatrice K Leung
- Decision Neuroscience Lab, School of Psychology, UNSW Sydney, Sydney, NSW 2052, Australia.
| | - Billy Chieng
- Decision Neuroscience Lab, School of Psychology, UNSW Sydney, Sydney, NSW 2052, Australia
| | - Serena Becchi
- Decision Neuroscience Lab, School of Psychology, UNSW Sydney, Sydney, NSW 2052, Australia
| | - Bernard W Balleine
- Decision Neuroscience Lab, School of Psychology, UNSW Sydney, Sydney, NSW 2052, Australia.
| |
Collapse
|
2
|
Krikova K, Klein S, Kampa M, Walter B, Stark R, Klucken T. Appetitive conditioning with pornographic stimuli elicits stronger activation in reward regions than monetary and gaming-related stimuli. Hum Brain Mapp 2024; 45:e26711. [PMID: 38798103 PMCID: PMC11128778 DOI: 10.1002/hbm.26711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 04/24/2024] [Accepted: 05/02/2024] [Indexed: 05/29/2024] Open
Abstract
Appetitive conditioning plays an important role in the development and maintenance of pornography-use and gaming disorders. It is assumed that primary and secondary reinforcers are involved in these processes. Despite the common use of pornography and gaming in the general population appetitive conditioning processes in this context are still not well studied. This study aims to compare appetitive conditioning processes using primary (pornographic) and secondary (monetary and gaming-related) rewards as unconditioned stimuli (UCS) in the general population. Additionally, it investigates the conditioning processes with gaming-related stimuli as this type of UCS was not used in previous studies. Thirty-one subjects participated in a differential conditioning procedure in which four geometric symbols were paired with either pornographic, monetary, or gaming-related rewards or with nothing to become conditioned stimuli (CS + porn, CS + game, CS + money, and CS-) in an functional magnetic resonance imaging study. We observed elevated arousal and valence ratings as well as skin conductance responses for each CS+ condition compared to the CS-. On the neural level, we found activations during the presentation of the CS + porn in the bilateral nucleus accumbens, right medial orbitofrontal cortex, and the right ventral anterior cingulate cortex compared to the CS-, but no significant activations during CS + money and CS + game compared to the CS-. These results indicate that different processes emerge depending on whether primary and secondary rewards are presented separately or together in the same experimental paradigm. Additionally, monetary and gaming-related stimuli seem to have a lower appetitive value than pornographic rewards.
Collapse
Affiliation(s)
- Kseniya Krikova
- Clinical Psychology and PsychotherapyUniversity of SiegenSiegenGermany
- Department of Psychotherapy and Systems NeuroscienceJustus Liebig University GiessenGiessenGermany
- Bender Institute for Neuroimaging (BION)Justus Liebig University GiessenGiessenGermany
| | - Sanja Klein
- Department of Psychotherapy and Systems NeuroscienceJustus Liebig University GiessenGiessenGermany
- Bender Institute for Neuroimaging (BION)Justus Liebig University GiessenGiessenGermany
| | - Miriam Kampa
- Department of Psychotherapy and Systems NeuroscienceJustus Liebig University GiessenGiessenGermany
- Bender Institute for Neuroimaging (BION)Justus Liebig University GiessenGiessenGermany
| | - Bertram Walter
- Department of Psychotherapy and Systems NeuroscienceJustus Liebig University GiessenGiessenGermany
- Bender Institute for Neuroimaging (BION)Justus Liebig University GiessenGiessenGermany
| | - Rudolf Stark
- Department of Psychotherapy and Systems NeuroscienceJustus Liebig University GiessenGiessenGermany
- Bender Institute for Neuroimaging (BION)Justus Liebig University GiessenGiessenGermany
- Center for Mind, Brain and BehaviorUniversities of Marburg and GießenMarburgGermany
| | - Tim Klucken
- Clinical Psychology and PsychotherapyUniversity of SiegenSiegenGermany
| |
Collapse
|
3
|
Zhang Y, Zhang W, Wang L, Liu D, Xie T, Le Z, Li X, Gong H, Xu XH, Xu M, Yao H. Whole-brain Mapping of Inputs and Outputs of Specific Orbitofrontal Cortical Neurons in Mice. Neurosci Bull 2024:10.1007/s12264-024-01229-8. [PMID: 38801564 DOI: 10.1007/s12264-024-01229-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 12/16/2023] [Indexed: 05/29/2024] Open
Abstract
The orbitofrontal cortex (ORB), a region crucial for stimulus-reward association, decision-making, and flexible behaviors, extensively connects with other brain areas. However, brain-wide inputs to projection-defined ORB neurons and the distribution of inhibitory neurons postsynaptic to neurons in specific ORB subregions remain poorly characterized. Here we mapped the inputs of five types of projection-specific ORB neurons and ORB outputs to two types of inhibitory neurons. We found that different projection-defined ORB neurons received inputs from similar cortical and thalamic regions, albeit with quantitative variations, particularly in somatomotor areas and medial groups of the dorsal thalamus. By counting parvalbumin (PV) or somatostatin (SST) interneurons innervated by neurons in specific ORB subregions, we found a higher fraction of PV neurons in sensory cortices and a higher fraction of SST neurons in subcortical regions targeted by medial ORB neurons. These results provide insights into understanding and investigating the function of specific ORB neurons.
Collapse
Affiliation(s)
- Yijie Zhang
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Wen Zhang
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
| | - Lizhao Wang
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
| | - Dechen Liu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
| | - Taorong Xie
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
| | - Ziwei Le
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Xiangning Li
- HUST-Suzhou Institute for Brainsmatics, JITRI, Suzhou, 215123, China
| | - Hui Gong
- HUST-Suzhou Institute for Brainsmatics, JITRI, Suzhou, 215123, China
- CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
| | - Xiao-Hong Xu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai, 201210, China
| | - Min Xu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai, 201210, China
| | - Haishan Yao
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China.
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai, 201210, China.
- Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Shanghai, 200031, China.
| |
Collapse
|
4
|
Sias AC, Jafar Y, Goodpaster CM, Ramírez-Armenta K, Wrenn TM, Griffin NK, Patel K, Lamparelli AC, Sharpe MJ, Wassum KM. Dopamine projections to the basolateral amygdala drive the encoding of identity-specific reward memories. Nat Neurosci 2024; 27:728-736. [PMID: 38396258 PMCID: PMC11110430 DOI: 10.1038/s41593-024-01586-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 01/24/2024] [Indexed: 02/25/2024]
Abstract
To make adaptive decisions, we build an internal model of the associative relationships in an environment and use it to make predictions and inferences about specific available outcomes. Detailed, identity-specific cue-reward memories are a core feature of such cognitive maps. Here we used fiber photometry, cell-type and pathway-specific optogenetic manipulation, Pavlovian cue-reward conditioning and decision-making tests in male and female rats, to reveal that ventral tegmental area dopamine (VTADA) projections to the basolateral amygdala (BLA) drive the encoding of identity-specific cue-reward memories. Dopamine is released in the BLA during cue-reward pairing; VTADA→BLA activity is necessary and sufficient to link the identifying features of a reward to a predictive cue but does not assign general incentive properties to the cue or mediate reinforcement. These data reveal a dopaminergic pathway for the learning that supports adaptive decision-making and help explain how VTADA neurons achieve their emerging multifaceted role in learning.
Collapse
Affiliation(s)
- Ana C Sias
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | - Yousif Jafar
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | - Caitlin M Goodpaster
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | | | - Tyler M Wrenn
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | - Nicholas K Griffin
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | - Keshav Patel
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | | | - Melissa J Sharpe
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
- Brain Research Institute, University of California, Los Angeles, Los Angeles, CA, USA
- Integrative Center for Learning and Memory, University of California, Los Angeles, Los Angeles, CA, USA
- Integrative Center for Addictive Disorders, University of California, Los Angeles, Los Angeles, CA, USA
- Department of Psychology, University of Sydney, Sydney, New South Wales, Australia
| | - Kate M Wassum
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA.
- Brain Research Institute, University of California, Los Angeles, Los Angeles, CA, USA.
- Integrative Center for Learning and Memory, University of California, Los Angeles, Los Angeles, CA, USA.
- Integrative Center for Addictive Disorders, University of California, Los Angeles, Los Angeles, CA, USA.
| |
Collapse
|
5
|
Ortiz-Guzman J, Swanson JL, Tantry EK, Kochukov M, Ung K, Addison AP, Srivastava S, Belfort BD, Ji E, Dooling SW, Chen SA, Tong Q, Arenkiel BR. Cholinergic Basal Forebrain Connectivity to the Basolateral Amygdala Modulates Food Intake. eNeuro 2024; 11:ENEURO.0369-23.2024. [PMID: 38383587 PMCID: PMC10915460 DOI: 10.1523/eneuro.0369-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 02/08/2024] [Accepted: 02/09/2024] [Indexed: 02/23/2024] Open
Abstract
Obesity results from excessive caloric input associated with overeating and presents a major public health challenge. The hypothalamus has received significant attention for its role in governing feeding behavior and body weight homeostasis. However, extrahypothalamic brain circuits also regulate appetite and consumption by altering sensory perception, motivation, and reward. We recently discovered a population of basal forebrain cholinergic (BFc) neurons that regulate appetite suppression. Through viral tracing methods in the mouse model, we found that BFc neurons densely innervate the basolateral amygdala (BLA), a limbic structure involved in motivated behaviors. Using channelrhodopsin-assisted circuit mapping, we identified cholinergic responses in BLA neurons following BFc circuit manipulations. Furthermore, in vivo acetylcholine sensor and genetically encoded calcium indicator imaging within the BLA (using GACh3 and GCaMP, respectively) revealed selective response patterns of activity during feeding. Finally, through optogenetic manipulations in vivo, we found that increased cholinergic signaling from the BFc to the BLA suppresses appetite and food intake. Together, these data support a model in which cholinergic signaling from the BFc to the BLA directly influences appetite and feeding behavior.
Collapse
Affiliation(s)
- Joshua Ortiz-Guzman
- Program in Developmental Biology, Baylor College of Medicine, Houston, Texas 77030
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Jessica L Swanson
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Evelyne K Tantry
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Mikhail Kochukov
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Kevin Ung
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Angela P Addison
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Snigdha Srivastava
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Benjamin D Belfort
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Emily Ji
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
| | - Sean W Dooling
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
| | - Sarah A Chen
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
| | - Qingchun Tong
- Department of Neurobiology and Anatomy of McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Brown Foundation of Molecular Medicine for the Prevention of Human Diseases of McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Benjamin R Arenkiel
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas 77030
- Jan and Dan Duncan Neurological Research Institute at Texas Children's Hospital, Houston, Texas 77030
- Department of Neuroscience, Baylor College of Medicine, Houston, Texas 77030
| |
Collapse
|
6
|
Aguirre CG, Woo JH, Romero-Sosa JL, Rivera ZM, Tejada AN, Munier JJ, Perez J, Goldfarb M, Das K, Gomez M, Ye T, Pannu J, Evans K, O'Neill PR, Spigelman I, Soltani A, Izquierdo A. Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty. J Neurosci 2024; 44:e0622232023. [PMID: 37968116 PMCID: PMC10860573 DOI: 10.1523/jneurosci.0622-23.2023] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Revised: 10/16/2023] [Accepted: 10/17/2023] [Indexed: 11/17/2023] Open
Abstract
Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including the highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, the unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory designer receptors exclusively activated by designer drugs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-/post-reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of the ventrolateral orbitofrontal cortex (vlOFC), but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.
Collapse
Affiliation(s)
- C G Aguirre
- Department of Psychology, University of California, Los Angeles, California 90095
| | - J H Woo
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755
| | - J L Romero-Sosa
- Department of Psychology, University of California, Los Angeles, California 90095
| | - Z M Rivera
- Department of Psychology, University of California, Los Angeles, California 90095
| | - A N Tejada
- Department of Psychology, University of California, Los Angeles, California 90095
| | - J J Munier
- Section of Biosystems and Function, School of Dentistry, University of California, Los Angeles, California 90095
| | - J Perez
- Department of Psychology, University of California, Los Angeles, California 90095
| | - M Goldfarb
- Department of Psychology, University of California, Los Angeles, California 90095
| | - K Das
- Department of Psychology, University of California, Los Angeles, California 90095
| | - M Gomez
- Department of Psychology, University of California, Los Angeles, California 90095
| | - T Ye
- Department of Psychology, University of California, Los Angeles, California 90095
| | - J Pannu
- Section of Biosystems and Function, School of Dentistry, University of California, Los Angeles, California 90095
| | - K Evans
- Department of Psychology, University of California, Los Angeles, California 90095
| | - P R O'Neill
- Shirley and Stefan Hatos Center for Neuropharmacology, Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, California 90095
| | - I Spigelman
- Section of Biosystems and Function, School of Dentistry, University of California, Los Angeles, California 90095
| | - A Soltani
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755
| | - A Izquierdo
- Department of Psychology, University of California, Los Angeles, California 90095
| |
Collapse
|
7
|
Sherman BE, Turk-Browne NB, Goldfarb EV. Multiple Memory Subsystems: Reconsidering Memory in the Mind and Brain. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2024; 19:103-125. [PMID: 37390333 PMCID: PMC10756937 DOI: 10.1177/17456916231179146] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/02/2023]
Abstract
The multiple-memory-systems framework-that distinct types of memory are supported by distinct brain systems-has guided learning and memory research for decades. However, recent work challenges the one-to-one mapping between brain structures and memory types central to this taxonomy, with key memory-related structures supporting multiple functions across substructures. Here we integrate cross-species findings in the hippocampus, striatum, and amygdala to propose an updated framework of multiple memory subsystems (MMSS). We provide evidence for two organizational principles of the MMSS theory: First, opposing memory representations are colocated in the same brain structures; second, parallel memory representations are supported by distinct structures. We discuss why this burgeoning framework has the potential to provide a useful revision of classic theories of long-term memory, what evidence is needed to further validate the framework, and how this novel perspective on memory organization may guide future research.
Collapse
Affiliation(s)
| | | | - Elizabeth V Goldfarb
- Department of Psychology, Yale University
- Wu Tsai Institute, Yale University
- Department of Psychiatry, Yale University
- National Center for PTSD, West Haven, USA
| |
Collapse
|
8
|
Aguirre CG, Woo JH, Romero-Sosa JL, Rivera ZM, Tejada AN, Munier JJ, Perez J, Goldfarb M, Das K, Gomez M, Ye T, Pannu J, Evans K, O'Neill PR, Spigelman I, Soltani A, Izquierdo A. Dissociable contributions of basolateral amygdala and ventrolateral orbitofrontal cortex to flexible learning under uncertainty. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.03.535471. [PMID: 37066321 PMCID: PMC10104064 DOI: 10.1101/2023.04.03.535471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach and particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory DREADDs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-post reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of vlOFC, but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.
Collapse
|
9
|
Giovanniello JR, Paredes N, Wiener A, Ramírez-Armenta K, Oragwam C, Uwadia HO, Lim K, Nnamdi G, Wang A, Sehgal M, Reis FM, Sias AC, Silva AJ, Adhikari A, Malvaez M, Wassum KM. A dual-pathway architecture enables chronic stress to promote habit formation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.03.560731. [PMID: 37873076 PMCID: PMC10592885 DOI: 10.1101/2023.10.03.560731] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
Chronic stress can change how we learn and, thus, how we make decisions by promoting the formation of inflexible, potentially maladaptive, habits. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted approach in male and female mice, we reveal a dual pathway, amygdala-striatal, neuronal circuit architecture by which a recent history of chronic stress shapes learning to disrupt flexible goal-directed behavior in favor of inflexible habits. Chronic stress inhibits activity of basolateral amygdala projections to the dorsomedial striatum to impede the action-outcome learning that supports flexible, goal-directed decisions. Stress also increases activity in direct central amygdala projections to the dorsomedial striatum to promote the formation of rigid, inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to promote premature habit formation. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and other psychiatric conditions.
Collapse
Affiliation(s)
| | | | - Anna Wiener
- Dept. of Psychology, UCLA, Los Angeles, CA 90095
| | | | | | | | - Kayla Lim
- Dept. of Biological Chemistry, UCLA, Los Angeles, CA 90095
| | - Gift Nnamdi
- Dept. of Psychology, UCLA, Los Angeles, CA 90095
| | - Alicia Wang
- Dept. of Psychology, UCLA, Los Angeles, CA 90095
| | - Megha Sehgal
- Dept. of Psychology, UCLA, Los Angeles, CA 90095
| | | | - Ana C Sias
- Dept. of Psychology, UCLA, Los Angeles, CA 90095
| | - Alcino J Silva
- Dept. of Psychology, UCLA, Los Angeles, CA 90095
- Brain Research Institute, UCLA, Los Angeles, CA 90095, USA
- Integrative Center for Learning and Memory, University of California Los Angeles, Los Angeles, CA, USA
| | - Avishek Adhikari
- Dept. of Psychology, UCLA, Los Angeles, CA 90095
- Brain Research Institute, UCLA, Los Angeles, CA 90095, USA
- Integrative Center for Learning and Memory, University of California Los Angeles, Los Angeles, CA, USA
| | | | - Kate M Wassum
- Dept. of Psychology, UCLA, Los Angeles, CA 90095
- Brain Research Institute, UCLA, Los Angeles, CA 90095, USA
- Integrative Center for Learning and Memory, University of California Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
10
|
Gyawali U, Martin DA, Sun F, Li Y, Calu D. Dopamine in the dorsal bed nucleus of stria terminalis signals Pavlovian sign-tracking and reward violations. eLife 2023; 12:e81980. [PMID: 37232554 PMCID: PMC10219648 DOI: 10.7554/elife.81980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Accepted: 05/05/2023] [Indexed: 05/27/2023] Open
Abstract
Midbrain and striatal dopamine signals have been extremely well characterized over the past several decades, yet novel dopamine signals and functions in reward learning and motivation continue to emerge. A similar characterization of real-time sub-second dopamine signals in areas outside of the striatum has been limited. Recent advances in fluorescent sensor technology and fiber photometry permit the measurement of dopamine binding correlates, which can divulge basic functions of dopamine signaling in non-striatal dopamine terminal regions, like the dorsal bed nucleus of the stria terminalis (dBNST). Here, we record GRABDA signals in the dBNST during a Pavlovian lever autoshaping task. We observe greater Pavlovian cue-evoked dBNST GRABDA signals in sign-tracking (ST) compared to goal-tracking/intermediate (GT/INT) rats and the magnitude of cue-evoked dBNST GRABDA signals decreases immediately following reinforcer-specific satiety. When we deliver unexpected rewards or omit expected rewards, we find that dBNST dopamine signals encode bidirectional reward prediction errors in GT/INT rats, but only positive prediction errors in ST rats. Since sign- and goal-tracking approach strategies are associated with distinct drug relapse vulnerabilities, we examined the effects of experimenter-administered fentanyl on dBNST dopamine associative encoding. Systemic fentanyl injections do not disrupt cue discrimination but generally potentiate dBNST dopamine signals. These results reveal multiple dBNST dopamine correlates of learning and motivation that depend on the Pavlovian approach strategy employed.
Collapse
Affiliation(s)
- Utsav Gyawali
- Program in Neuroscience, University of Maryland School of MedicineBaltimoreUnited States
- Department of Anatomy and Neurobiology, University of Maryland School of MedicineBaltimoreUnited States
| | - David A Martin
- Department of Anatomy and Neurobiology, University of Maryland School of MedicineBaltimoreUnited States
| | - Fangmiao Sun
- State Key Laboratory of Membrane Biology, Peking University School of Life Sciences; PKU-IDG/McGovern Institute for Brain Research; Peking-Tsinghua Center for Life SciencesBeijingChina
| | - Yulong Li
- State Key Laboratory of Membrane Biology, Peking University School of Life Sciences; PKU-IDG/McGovern Institute for Brain Research; Peking-Tsinghua Center for Life SciencesBeijingChina
| | - Donna Calu
- Program in Neuroscience, University of Maryland School of MedicineBaltimoreUnited States
- Department of Anatomy and Neurobiology, University of Maryland School of MedicineBaltimoreUnited States
| |
Collapse
|
11
|
Tavares GEB, Bianchi PC, Yokoyama TS, Palombo P, Cruz FC. INVOLVEMENT OF CORTICAL PROJECTIONS TO BASOLATERAL AMYGDALA IN CONTEXT-INDUCED REINSTATEMENT OF ETHANOL-SEEKING IN RATS. Behav Brain Res 2023; 448:114435. [PMID: 37044222 DOI: 10.1016/j.bbr.2023.114435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 03/30/2023] [Accepted: 04/09/2023] [Indexed: 04/14/2023]
Abstract
Ethanol is the most consumed substance of abuse in the world, and its misuse may lead to the development of alcohol use disorder (AUD). High relapse rates remain a relevant problem in the treatment of AUD. Exposure to environmental cues previously associated with ethanol intake could trigger ethanol-seeking behavior. However, the neural mechanisms involved in this phenomenon are not entirely clear. In this context, cortical projections to the basolateral amygdala (BLA) play a role in appetitive and aversive learned behaviors. Therefore, we aimed to evaluate the activation of the cortical projections from the prelimbic (PL), orbitofrontal (OFC), and infralimbic (IL), to the BLA in the context-induced reinstatement of ethanol-seeking. Male Long-Evans rats were trained to self-administer 10% ethanol in Context A. Subsequently, lever pressing in the presence of the discrete cue was extinguished in Context B. After nine extinction sessions, rats underwent intracranial surgery for the unilateral injection of red fluorescent retrograde tracer into the BLA. The context-induced reinstatement of ethanol-seeking was assessed by re-exposing the rats to Context A or B under extinction conditions. Finally, we combined retrograde neuronal tracing with Fos to identify activated cortical inputs to BLA during the reinstatement of ethanol-seeking behavior. We found that PL, but not OFC or IL, retrogradely-labeled neurons from BLA presented increased Fos expression during the re-exposure to the ethanol-associated context, suggesting that PL projection to BLA is involved in the context-induced reinstatement of ethanol-seeking behavior.
Collapse
Affiliation(s)
| | - Paula Cristina Bianchi
- Molecular and Behavioral Neuroscience Laboratory, Department of Pharmacology, Federal University of São Paulo, São Paulo, SP, Brazil.
| | - Thais Suemi Yokoyama
- Molecular and Behavioral Neuroscience Laboratory, Department of Pharmacology, Federal University of São Paulo, São Paulo, SP, Brazil.
| | - Paola Palombo
- Molecular and Behavioral Neuroscience Laboratory, Department of Pharmacology, Federal University of São Paulo, São Paulo, SP, Brazil.
| | - Fábio Cardoso Cruz
- Molecular and Behavioral Neuroscience Laboratory, Department of Pharmacology, Federal University of São Paulo, São Paulo, SP, Brazil.
| |
Collapse
|
12
|
Cerpa JC, Piccin A, Dehove M, Lavigne M, Kremer EJ, Wolff M, Parkes SL, Coutureau E. Inhibition of noradrenergic signalling in rodent orbitofrontal cortex impairs the updating of goal-directed actions. eLife 2023; 12:81623. [PMID: 36804007 PMCID: PMC9988255 DOI: 10.7554/elife.81623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Accepted: 02/17/2023] [Indexed: 02/22/2023] Open
Abstract
In a constantly changing environment, organisms must track the current relationship between actions and their specific consequences and use this information to guide decision-making. Such goal-directed behaviour relies on circuits involving cortical and subcortical structures. Notably, a functional heterogeneity exists within the medial prefrontal, insular, and orbitofrontal cortices (OFC) in rodents. The role of the latter in goal-directed behaviour has been debated, but recent data indicate that the ventral and lateral subregions of the OFC are needed to integrate changes in the relationships between actions and their outcomes. Neuromodulatory agents are also crucial components of prefrontal functions and behavioural flexibility might depend upon the noradrenergic modulation of the prefrontal cortex. Therefore, we assessed whether noradrenergic innervation of the OFC plays a role in updating action-outcome relationships in male rats. We used an identity-based reversal task and found that depletion or chemogenetic silencing of noradrenergic inputs within the OFC rendered rats unable to associate new outcomes with previously acquired actions. Silencing of noradrenergic inputs in the prelimbic cortex or depletion of dopaminergic inputs in the OFC did not reproduce this deficit. Together, our results suggest that noradrenergic projections to the OFC are required to update goal-directed actions.
Collapse
Affiliation(s)
| | | | | | - Marina Lavigne
- Institut de Génétique Moléculaire de Montpellier, CNRS, University of MontpellierMontpellierFrance
| | - Eric J Kremer
- Institut de Génétique Moléculaire de Montpellier, CNRS, University of MontpellierMontpellierFrance
| | | | | | | |
Collapse
|
13
|
Age-Related Changes in Risky Decision Making and Associated Neural Circuitry in a Rat Model. eNeuro 2023; 10:ENEURO.0385-22.2022. [PMID: 36596593 PMCID: PMC9840382 DOI: 10.1523/eneuro.0385-22.2022] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Revised: 12/07/2022] [Accepted: 12/13/2022] [Indexed: 01/05/2023] Open
Abstract
Altered decision making at advanced ages can have a significant impact on an individual's quality of life and the ability to maintain personal independence. Relative to young adults, older adults make less impulsive and less risky choices; although these changes in decision making could be considered beneficial, they can also lead to choices with potentially negative consequences (e.g., avoidance of medical procedures). Rodent models of decision making have been invaluable for dissecting cognitive and neurobiological mechanisms that contribute to age-related changes in decision making, but they have predominantly used costs related to timing or probability of reward delivery and have not considered other equally important costs, such as the risk of adverse consequences. The current study therefore used a rat model of decision making involving risk of explicit punishment to examine age-related changes in this form of choice behavior in male rats, and to identify potential cognitive and neurobiological mechanisms that contribute to these changes. Relative to young rats, aged rats displayed greater risk aversion, which was not attributable to reduced motivation for food, changes in shock sensitivity, or impaired cognitive flexibility. Functional MRI analyses revealed that, overall, functional connectivity was greater in aged rats compared with young rats, particularly among brain regions implicated in risky decision making such as basolateral amygdala, orbitofrontal cortex, and ventral tegmental area. Collectively, these findings are consistent with greater risk aversion found in older humans, and reveal age-related changes in brain connectivity.
Collapse
|
14
|
Costa KM, Scholz R, Lloyd K, Moreno-Castilla P, Gardner MPH, Dayan P, Schoenbaum G. The role of the lateral orbitofrontal cortex in creating cognitive maps. Nat Neurosci 2023; 26:107-115. [PMID: 36550290 PMCID: PMC9839657 DOI: 10.1038/s41593-022-01216-0] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2022] [Accepted: 10/26/2022] [Indexed: 12/24/2022]
Abstract
We use mental models of the world-cognitive maps-to guide behavior. The lateral orbitofrontal cortex (lOFC) is typically thought to support behavior by deploying these maps to simulate outcomes, but recent evidence suggests that it may instead support behavior by underlying map creation. We tested between these two alternatives using outcome-specific devaluation and a high-potency chemogenetic approach. Selectively inactivating lOFC principal neurons when male rats learned distinct cue-outcome associations, but before outcome devaluation, disrupted subsequent inference, confirming a role for the lOFC in creating new maps. However, lOFC inactivation surprisingly led to generalized devaluation, a result that is inconsistent with a complete mapping failure. Using a reinforcement learning framework, we show that this effect is best explained by a circumscribed deficit in credit assignment precision during map construction, suggesting that the lOFC has a selective role in defining the specificity of associations that comprise cognitive maps.
Collapse
Affiliation(s)
- Kauê Machado Costa
- National Institute on Drug Abuse Intramural Research Program, National Institutes of Health, Baltimore, MD, USA.
| | - Robert Scholz
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- Max Planck School of Cognition, Leipzig, Germany
| | - Kevin Lloyd
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Perla Moreno-Castilla
- National Institute on Aging Intramural Research Program, National Institutes of Health, Baltimore, MD, USA
| | | | - Peter Dayan
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- University of Tübingen, Tübingen, Germany
| | - Geoffrey Schoenbaum
- National Institute on Drug Abuse Intramural Research Program, National Institutes of Health, Baltimore, MD, USA.
| |
Collapse
|
15
|
Panayi MC, Killcross S. Outcome devaluation by specific satiety disrupts sensory-specific Pavlovian-to-instrumental transfer. Front Behav Neurosci 2022; 16:983480. [PMID: 36439968 PMCID: PMC9682038 DOI: 10.3389/fnbeh.2022.983480] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 10/13/2022] [Indexed: 07/21/2023] Open
Abstract
Reward predictive cues can selectively motivate instrumental behaviors that predict the same rewarding outcomes, an effect known as specific Pavlovian-to-instrumental transfer (PIT). This selective effect is thought to be mediated by a representation of the sensory specific properties of an outcome, that has become associated with both the Pavlovian cue and the instrumental response during initial learning. Specific satiety is a common method of outcome devaluation that reduces an outcome's value but might also lead to the habituation of the outcome's sensory properties. Previous research has demonstrated that specific PIT is insensitive to changes in specific outcome value following taste aversion devaluation, as well as general satiety manipulations, and therefore specific satiety should not disrupt specific PIT by reducing outcome value. The present rodent experiments used a specific satiety devaluation procedure immediately prior to a specific PIT test to show that habituation of these outcome specific sensory representations can disrupt its efficacy as a stimulus and abolish the specific PIT effect. Experiment 1 employed a two-lever choice test to show that a non-devalued stimulus supports specific PIT, whereas a devalued stimulus abolished the specific PIT effect. Experiment 2 replicated this procedure while controlling for response competition by using a single-lever test to confirm that a devalued stimulus abolishes the specific PIT effect. These findings demonstrate that specific satiety can disrupt the ability of an outcome specific representation to support specific PIT. Given previous findings that specific PIT is insensitive to changes in outcome value by general satiety and taste aversion devaluation, this suggests that specific satiety devaluation might disrupt the use of sensory specific outcome representations to guide behavior via a mechanism that is independent of the outcome's current value.
Collapse
Affiliation(s)
- Marios C. Panayi
- School of Psychology, University of New South Wales, Sydney, NSW, Australia
- National Institute on Drug Abuse Intramural Research Program, Baltimore, MD, United States
| | - Simon Killcross
- School of Psychology, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
16
|
Cazares C, Schreiner DC, Valencia ML, Gremel CM. Orbitofrontal cortex populations are differentially recruited to support actions. Curr Biol 2022; 32:4675-4687.e5. [PMID: 36195096 PMCID: PMC9643660 DOI: 10.1016/j.cub.2022.09.022] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Revised: 08/03/2022] [Accepted: 09/09/2022] [Indexed: 11/09/2022]
Abstract
The ability to use information from one's prior actions is necessary for decision-making. While orbitofrontal cortex (OFC) has been hypothesized as key for inferences made using cue and value-related information, whether OFC populations contribute to the use of information from volitional actions to guide behavior is not clear. Here, we used a self-paced lever-press hold-down task in which mice infer prior lever-press durations to guide subsequent action performance. We show that the activity of genetically identified lateral OFC (lOFC) subpopulations differentially instantiate current and prior action information during ongoing action execution. Transient state-dependent lOFC circuit disruptions of specified subpopulations reduced the encoding of ongoing press durations but did not disrupt the use of prior action information to guide future action performance. In contrast, a chronic functional loss of lOFC circuit activity resulted in increased reliance on recently executed lever-press durations and impaired contingency reversal, suggesting the recruitment of compensatory mechanisms that resulted in repetitive action control. Our results identify a novel role for lOFC in the integration of action information to guide adaptive behavior.
Collapse
Affiliation(s)
- Christian Cazares
- The Neurosciences Graduate Program, University of California, San Diego, 9500 Gilman Dr., La Jolla, CA 92093, USA
| | - Drew C Schreiner
- Department of Psychology, University of California, San Diego, 9500 Gilman Dr., La Jolla, CA 92093, USA
| | - Mariela Lopez Valencia
- Department of Psychology, University of California, San Diego, 9500 Gilman Dr., La Jolla, CA 92093, USA
| | - Christina M Gremel
- The Neurosciences Graduate Program, University of California, San Diego, 9500 Gilman Dr., La Jolla, CA 92093, USA; Department of Psychology, University of California, San Diego, 9500 Gilman Dr., La Jolla, CA 92093, USA.
| |
Collapse
|
17
|
Inactivation of the Basolateral Amygdala to Insular Cortex Pathway Makes Sign-Tracking Sensitive to Outcome Devaluation. eNeuro 2022; 9:ENEURO.0156-22.2022. [PMID: 36127135 PMCID: PMC9522321 DOI: 10.1523/eneuro.0156-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 08/26/2022] [Accepted: 09/11/2022] [Indexed: 12/15/2022] Open
Abstract
Goal-tracking (GT) rats are sensitive to Pavlovian outcome devaluation while sign-tracking (ST) rats are devaluation insensitive. During outcome devaluation, GT rats flexibly modify responding to cues based on the current value of the associated outcome. However, ST rats rigidly respond to cues regardless of the current outcome value. Prior work demonstrated disconnection of the basolateral amygdala (BLA) and anterior insular cortex (aIC) decreased both GT and ST behaviors. Given the role of these regions in appetitive motivation and behavioral flexibility, we predicted that disrupting BLA to aIC pathway during outcome devaluation would reduce flexibility in GT rats and reduce rigid appetitive motivation in ST rats. We inhibited the BLA to aIC pathway by infusing inhibitory DREADDs (hM4Di-mcherry) or control (mCherry) virus into the BLA and implanted cannulae into the aIC to inhibit BLA terminals using intracranial injections of clozapine N-oxide (CNO). After training, we used a within-subject satiety-induced outcome devaluation procedure in which we sated rats on training pellets (devalued condition) or homecage chow (valued condition). All rats received bilateral CNO infusions into the aIC before brief nonreinforced test sessions. Contrary to our hypothesis, BLA-IC inhibition did not interfere with devaluation sensitivity in GT rats but did make ST behaviors sensitive to devaluation. Intermediate rats showed the opposite effect, showing rigid responding to cues with BLA-aIC pathway inactivation. Together, these results demonstrate BLA-IC projections mediate tracking-specific Pavlovian devaluation sensitivity and highlights the importance of considering individual differences in Pavlovian approach when evaluating circuitry contributions to behavioral flexibility.
Collapse
|
18
|
Wassum KM. Amygdala-cortical collaboration in reward learning and decision making. eLife 2022; 11:80926. [PMID: 36062909 PMCID: PMC9444241 DOI: 10.7554/elife.80926] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Accepted: 08/22/2022] [Indexed: 12/16/2022] Open
Abstract
Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.
Collapse
Affiliation(s)
- Kate M Wassum
- Department of Psychology, University of California, Los Angeles, Los Angeles, United States.,Brain Research Institute, University of California, Los Angeles, Los Angeles, United States.,Integrative Center for Learning and Memory, University of California, Los Angeles, Los Angeles, United States.,Integrative Center for Addictive Disorders, University of California, Los Angeles, Los Angeles, United States
| |
Collapse
|
19
|
Liley AE, Gabriel DBK, Simon NW. Lateral Orbitofrontal Cortex and Basolateral Amygdala Regulate Sensitivity to Delayed Punishment during Decision-making. eNeuro 2022; 9:ENEURO.0170-22.2022. [PMID: 36038251 PMCID: PMC9463980 DOI: 10.1523/eneuro.0170-22.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 07/08/2022] [Accepted: 07/21/2022] [Indexed: 11/29/2022] Open
Abstract
In real-world decision-making scenarios, negative consequences do not always occur immediately after a choice. This delay between action and outcome drives the underestimation, or "delay discounting", of punishment. While the neural substrates underlying sensitivity to immediate punishment have been well-studied, there has been minimal investigation of delayed consequences. Here, we assessed the role of lateral orbitofrontal cortex (LOFC) and basolateral amygdala (BLA), two regions implicated in cost/benefit decision-making, in sensitivity to delayed vs immediate punishment. The delayed punishment decision-making task (DPDT) was used to measure delay discounting of punishment in rodents. During DPDT, rats choose between a small, single pellet reward and a large, three pellet reward accompanied by a mild foot shock. As the task progresses, the shock is preceded by a delay that systematically increases or decreases throughout the session. We observed that rats avoid choices associated with immediate punishment, then shift preference toward these options when punishment is delayed. LOFC inactivation did not influence choice of rewards with immediate punishment, but decreased choice of delayed punishment. We also observed that BLA inactivation reduced choice of delayed punishment for ascending but not descending delays. Inactivation of either brain region produced comparable effects on decision-making in males and females, but there were sex differences observed in omissions and latency to make a choice. In summary, both LOFC and BLA contribute to the delay discounting of punishment and may serve as promising therapeutic targets to improve sensitivity to delayed punishment during decision-making.Significance StatementNegative consequences occurring after a delay are often underestimated, which can lead to maladaptive decision-making. While sensitivity to immediate punishment during reward-seeking has been well-studied, the neural substrates underlying sensitivity to delayed punishment remain unclear. Here, we used the Delayed Punishment Decision-making Task to determine that lateral orbitofrontal cortex and basolateral amygdala both regulate the discounting of delayed punishment, suggesting that these regions may be potential targets to improve decision-making in psychopathology.
Collapse
Affiliation(s)
- Anna E Liley
- Department of Psychology, University of Memphis, Memphis, Tennessee 38152
| | - Daniel B K Gabriel
- Department of Psychology, University of Memphis, Memphis, Tennessee 38152
| | - Nicholas W Simon
- Department of Psychology, University of Memphis, Memphis, Tennessee 38152
| |
Collapse
|
20
|
Klein-Flügge MC, Bongioanni A, Rushworth MFS. Medial and orbital frontal cortex in decision-making and flexible behavior. Neuron 2022; 110:2743-2770. [PMID: 35705077 DOI: 10.1016/j.neuron.2022.05.022] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Revised: 05/17/2022] [Accepted: 05/19/2022] [Indexed: 11/15/2022]
Abstract
The medial frontal cortex and adjacent orbitofrontal cortex have been the focus of investigations of decision-making, behavioral flexibility, and social behavior. We review studies conducted in humans, macaques, and rodents and argue that several regions with different functional roles can be identified in the dorsal anterior cingulate cortex, perigenual anterior cingulate cortex, anterior medial frontal cortex, ventromedial prefrontal cortex, and medial and lateral parts of the orbitofrontal cortex. There is increasing evidence that the manner in which these areas represent the value of the environment and specific choices is different from subcortical brain regions and more complex than previously thought. Although activity in some regions reflects distributions of reward and opportunities across the environment, in other cases, activity reflects the structural relationships between features of the environment that animals can use to infer what decision to take even if they have not encountered identical opportunities in the past.
Collapse
Affiliation(s)
- Miriam C Klein-Flügge
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Tinsley Building, Mansfield Road, Oxford OX1 3TA, UK; Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB), University of Oxford, Nuffield Department of Clinical Neurosciences, Level 6, West Wing, John Radcliffe Hospital, Oxford OX3 9DU, UK; Department of Psychiatry, University of Oxford, Warneford Lane, Headington, Oxford OX3 7JX, UK.
| | - Alessandro Bongioanni
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Tinsley Building, Mansfield Road, Oxford OX1 3TA, UK
| | - Matthew F S Rushworth
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Tinsley Building, Mansfield Road, Oxford OX1 3TA, UK; Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB), University of Oxford, Nuffield Department of Clinical Neurosciences, Level 6, West Wing, John Radcliffe Hospital, Oxford OX3 9DU, UK
| |
Collapse
|
21
|
Differential and long-lasting changes in neurotransmission in the amygdala of male Wistar rats during extended amphetamine abstinence. Neuropharmacology 2022; 210:109041. [DOI: 10.1016/j.neuropharm.2022.109041] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2021] [Revised: 03/09/2022] [Accepted: 03/14/2022] [Indexed: 01/12/2023]
|
22
|
Desrochers SS, Spring MG, Nautiyal KM. A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity. Front Behav Neurosci 2022; 16:791749. [PMID: 35250501 PMCID: PMC8892181 DOI: 10.3389/fnbeh.2022.791749] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 01/11/2022] [Indexed: 12/15/2022] Open
Abstract
Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the “brake” on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory “drive.” For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the “drive” and “brake” circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.
Collapse
|
23
|
Sias AC, Morse AK, Wang S, Greenfield VY, Goodpaster CM, Wrenn TM, Wikenheiser AM, Holley SM, Cepeda C, Levine MS, Wassum KM. A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories. eLife 2021; 10:e68617. [PMID: 34142660 PMCID: PMC8266390 DOI: 10.7554/elife.68617] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2021] [Accepted: 06/16/2021] [Indexed: 12/18/2022] Open
Abstract
Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the rewards they predict. Here, we interrogated the function of the basolateral amygdala (BLA) and its interaction with the lateral orbitofrontal cortex (lOFC) in the ability to learn such stimulus-outcome associations and use these memories to guide decision making. Using optical recording and inhibition approaches, Pavlovian cue-reward conditioning, and the outcome-selective Pavlovian-to-instrumental transfer (PIT) test in male rats, we found that the BLA is robustly activated at the time of stimulus-outcome learning and that this activity is necessary for sensory-specific stimulus-outcome memories to be encoded, so they can subsequently influence reward choices. Direct input from the lOFC was found to support the BLA in this function. Based on prior work, activity in BLA projections back to the lOFC was known to support the use of stimulus-outcome memories to influence decision making. By multiplexing optogenetic and chemogenetic inhibition we performed a serial circuit disconnection and found that the lOFC→BLA and BLA→lOFC pathways form a functional circuit regulating the encoding (lOFC→BLA) and subsequent use (BLA→lOFC) of the stimulus-dependent, sensory-specific reward memories that are critical for adaptive, appetitive decision making.
Collapse
Affiliation(s)
- Ana C Sias
- Department of Psychology, University of California, Los AngelesLos AngelesUnited States
| | - Ashleigh K Morse
- Department of Psychology, University of California, Los AngelesLos AngelesUnited States
| | - Sherry Wang
- Department of Psychology, University of California, Los AngelesLos AngelesUnited States
| | - Venuz Y Greenfield
- Department of Psychology, University of California, Los AngelesLos AngelesUnited States
| | - Caitlin M Goodpaster
- Department of Psychology, University of California, Los AngelesLos AngelesUnited States
| | - Tyler M Wrenn
- Department of Psychology, University of California, Los AngelesLos AngelesUnited States
| | - Andrew M Wikenheiser
- Department of Psychology, University of California, Los AngelesLos AngelesUnited States
- Brain Research Institute, University of California, Los AngelesLos AngelesUnited States
- Integrative Center for Learning and Memory, University of California, Los AngelesLos AngelesUnited States
| | - Sandra M Holley
- Intellectual and Developmental Disabilities Research Center, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California, Los AngelesLos AngelesUnited States
| | - Carlos Cepeda
- Intellectual and Developmental Disabilities Research Center, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California, Los AngelesLos AngelesUnited States
| | - Michael S Levine
- Brain Research Institute, University of California, Los AngelesLos AngelesUnited States
- Intellectual and Developmental Disabilities Research Center, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California, Los AngelesLos AngelesUnited States
| | - Kate M Wassum
- Department of Psychology, University of California, Los AngelesLos AngelesUnited States
- Brain Research Institute, University of California, Los AngelesLos AngelesUnited States
- Integrative Center for Learning and Memory, University of California, Los AngelesLos AngelesUnited States
- Integrative Center for Addictive Disorders, University of California, Los AngelesLos AngelesUnited States
| |
Collapse
|