1
|
Jung K, Krüssel S, Yoo S, An M, Burke B, Schappaugh N, Choi Y, Gu Z, Blackshaw S, Costa RM, Kwon HB. Dopamine-mediated formation of a memory module in the nucleus accumbens for goal-directed navigation. Nat Neurosci 2024:10.1038/s41593-024-01770-9. [PMID: 39333785 DOI: 10.1038/s41593-024-01770-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Accepted: 08/23/2024] [Indexed: 09/30/2024]
Abstract
Spatial memories guide navigation efficiently toward desired destinations. However, the neuronal and circuit mechanisms underlying the encoding of goal locations and its translation into goal-directed navigation remain unclear. Here we demonstrate that mice rapidly form a spatial memory of a shelter during shelter experiences, guiding escape behavior toward the goal location-a shelter-when under threat. Dopaminergic neurons in the ventral tegmental area and their projection to the nucleus accumbens (NAc) encode safety signals associated with the shelter. Optogenetically induced phasic dopamine signals are sufficient to create a place memory that directs escape navigation. Converging dopaminergic and hippocampal glutamatergic inputs to the NAc mediate the formation of a goal-related memory within a subpopulation of NAc neurons during shelter experiences. Artificial co-activation of this goal-related NAc ensemble with neurons in the dorsal periaqueductal gray was sufficient to trigger memory-guided, rather than random, escape behavior. These findings provide causal evidence of cognitive circuit modules linking memory with goal-directed action.
Collapse
Affiliation(s)
- Kanghoon Jung
- Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, USA.
- Max Planck Florida Institute for Neuroscience, Jupiter, FL, USA.
- Allen Institute for Neural Dynamics, Seattle, WA, USA.
- Allen Institute, Seattle, WA, USA.
| | - Sarah Krüssel
- Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, USA
- Max Planck Florida Institute for Neuroscience, Jupiter, FL, USA
| | - Sooyeon Yoo
- Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Myungmo An
- Max Planck Florida Institute for Neuroscience, Jupiter, FL, USA
| | - Benjamin Burke
- Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Nicholas Schappaugh
- Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, USA
- Max Planck Florida Institute for Neuroscience, Jupiter, FL, USA
| | - Youngjin Choi
- Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Zirong Gu
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
- Department of Neuroscience, The University of Texas at Dallas, Richardson, Texas, USA
| | - Seth Blackshaw
- Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Rui M Costa
- Allen Institute, Seattle, WA, USA
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
| | - Hyung-Bae Kwon
- Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, USA.
- Max Planck Florida Institute for Neuroscience, Jupiter, FL, USA.
| |
Collapse
|
2
|
Kocharian A, Redish AD, Rothwell PE. Individual differences in decision-making shape how mesolimbic dopamine regulates choice confidence and change-of-mind. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.09.16.613237. [PMID: 39345599 PMCID: PMC11429702 DOI: 10.1101/2024.09.16.613237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 10/01/2024]
Abstract
Nucleus accumbens dopamine signaling is an important neural substrate for decision-making. Dominant theories generally discretize and homogenize decision-making, when it is in fact a continuous process, with evaluation and re-evaluation components that extend beyond simple outcome prediction into consideration of past and future value. Extensive work has examined mesolimbic dopamine in the context of reward prediction error, but major gaps persist in our understanding of how dopamine regulates volitional and self-guided decision-making. Moreover, there is little consideration of individual differences in value processing that may shape how dopamine regulates decision-making. Here, using an economic foraging task in mice, we found that dopamine dynamics in the nucleus accumbens core reflected decision confidence during evaluation of decisions, as well as both past and future value during re-evaluation and change-of-mind. Optogenetic manipulations of mesolimbic dopamine release selectively altered evaluation and re-evaluation of decisions in mice whose dopamine dynamics and behavior reflected future value.
Collapse
Affiliation(s)
- Adrina Kocharian
- Graduate Program in Neuroscience, University of Minnesota Medical School, Minneapolis, MN
- Medical Scientist Training Program, University of Minnesota Medical School, Minneapolis, MN
| | - A David Redish
- Department of Neuroscience, University of Minnesota Medical School, Minneapolis, MN
| | - Patrick E Rothwell
- Department of Neuroscience, University of Minnesota Medical School, Minneapolis, MN
| |
Collapse
|
3
|
Su H, Ye T, Cao S, Hu C. Understanding the shift to compulsion in addiction: insights from personality traits, social factors, and neurobiology. Front Psychol 2024; 15:1416222. [PMID: 39315036 PMCID: PMC11416939 DOI: 10.3389/fpsyg.2024.1416222] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Accepted: 08/26/2024] [Indexed: 09/25/2024] Open
Abstract
Compulsion stands as a central symptom of drug addiction; however, only a small fraction of individuals who use drugs exhibit compulsive characteristics. Differences observed in Sign-trackers (ST) and Goal-trackers (GT) during Pavlovian conditioning may shed light on individual variances in drug addiction. Here, we focus on the behavioral attributes, formation processes, and neural mechanisms underlying ST and how they drive addiction toward compulsivity in humans. We will explore addiction from three interconnected levels: individual personality traits, social factors, and neurobiology. Furthermore, we distinguish between the processes of sensitization and habituation within ST. These nuanced distinctions across various aspects of addiction will contribute to our understanding of the addiction development process and the formulation of targeted preventive strategies.
Collapse
Affiliation(s)
- Haodong Su
- College of Humanities, Anhui Science and Technology University, Chuzhou, China
- Psychological Education Research Department, Anhui Science and Technology University, Chuzhou, China
| | - Tongtong Ye
- College of Humanities, Anhui Science and Technology University, Chuzhou, China
- Psychological Education Research Department, Anhui Science and Technology University, Chuzhou, China
| | - Songyan Cao
- College of Humanities, Anhui Science and Technology University, Chuzhou, China
| | - Chunyan Hu
- College of Humanities, Anhui Science and Technology University, Chuzhou, China
| |
Collapse
|
4
|
Burke DA, Taylor A, Jeong H, Lee S, Wu B, Floeder JR, K Namboodiri VM. Reward timescale controls the rate of behavioural and dopaminergic learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.03.31.535173. [PMID: 37034619 PMCID: PMC10081323 DOI: 10.1101/2023.03.31.535173] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Learning the causes of rewards is necessary for survival. Thus, it is critical to understand the mechanisms of such a vital biological process. Cue-reward learning is controlled by mesolimbic dopamine and improves with spacing of cue-reward pairings. However, whether a mathematical rule governs such improvements in learning rate, and if so, whether a unifying mechanism captures this rule and dopamine dynamics during learning remain unknown. Here, we investigate the behavioral, algorithmic, and dopaminergic mechanisms governing cue-reward learning rate. Across a range of conditions in mice, we show a strong, mathematically proportional relationship between both behavioral and dopaminergic learning rates and the duration between rewards. Due to this relationship, removing up to 19 out of 20 cue-reward pairings over a fixed duration has no influence on overall learning. These findings are explained by a dopamine-based model of retrospective learning, thereby providing a unified account of the biological mechanisms of learning.
Collapse
Affiliation(s)
- Dennis A Burke
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Annie Taylor
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | - Huijeong Jeong
- Department of Neurology, University of California, San Francisco, CA, USA
| | - SeulAh Lee
- Department of Neurology, University of California, San Francisco, CA, USA
- University of California, Berkeley, CA, USA
| | - Brenda Wu
- Department of Neurology, University of California, San Francisco, CA, USA
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | - Joseph R Floeder
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | - Vijay Mohan K Namboodiri
- Department of Neurology, University of California, San Francisco, CA, USA
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
- Weill Institute for Neurosciences, Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience, University of California, San Francisco, CA, USA
| |
Collapse
|
5
|
Abstract
Neuroscience has convinced people that much of their behavior is determined by causes unknown to them and beyond their control. However, are advances in neuroscience truly a prerequisite for such beliefs? Robert Kane's theory of ultimate responsibility is libertarian theory. Its innovative nature makes it possible to discuss the neurophysiological basis of its postulates. Using the functions of the midbrain dopaminergic system as an example, this article provides an overview of this neurophysiological basis. According to Kane, if we are to be ultimately responsible for our wills as well as for our actions, some actions in our lives must lack sufficient motives and causes. These are self-forming actions. Dopamine is hypothesized to mediate self-forming action execution. Dopamine not only mediates action but also ensures synaptic plasticity in the brain, that is, learning from action; hence, dopamine changes the acting individual and provides the formation of our own wills. The basal ganglia, which are the main target of dopamine in the brain, act through parallel pathways and are involved in decision-making processes. Dopamine is also involved in the regulation of the neurodynamical properties of prefrontal cortex networks with random spiking noise. It can be assumed that the activity of the dopaminergic system is closely related to the physiological basis of free will.
Collapse
Affiliation(s)
- Natalia Ivlieva
- Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of Sciences, Butlerova Str., 5a, Moscow, 117485, Russia.
| |
Collapse
|
6
|
Runyon K, Bui T, Mazanek S, Hartle A, Marschalko K, Howe WM. Distinct cholinergic circuits underlie discrete effects of reward on attention. Front Mol Neurosci 2024; 17:1429316. [PMID: 39268248 PMCID: PMC11390659 DOI: 10.3389/fnmol.2024.1429316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Accepted: 08/01/2024] [Indexed: 09/15/2024] Open
Abstract
Attention and reward are functions that are critical for the control of behavior, and massive multi-region neural systems have evolved to support the discrete computations associated with each. Previous research has also identified that attention and reward interact, though our understanding of the neural mechanisms that mediate this interplay is incomplete. Here, we review the basic neuroanatomy of attention, reward, and cholinergic systems. We then examine specific contexts in which attention and reward computations interact. Building on this work, we propose two discrete neural circuits whereby acetylcholine, released from cell groups located in different parts of the brain, mediates the impact of stimulus-reward associations as well as motivation on attentional control. We conclude by examining these circuits as a potential shared loci of dysfunction across diseases states associated with deficits in attention and reward.
Collapse
Affiliation(s)
- Kelly Runyon
- School of Neuroscience at Virginia Tech, Blacksburg, VA, United States
| | - Tung Bui
- School of Neuroscience at Virginia Tech, Blacksburg, VA, United States
| | - Sarah Mazanek
- School of Neuroscience at Virginia Tech, Blacksburg, VA, United States
| | - Alec Hartle
- School of Neuroscience at Virginia Tech, Blacksburg, VA, United States
| | - Katie Marschalko
- School of Neuroscience at Virginia Tech, Blacksburg, VA, United States
| | | |
Collapse
|
7
|
Taira M, Millard SJ, Verghese A, DiFazio LE, Hoang IB, Jia R, Sias A, Wikenheiser A, Sharpe MJ. Dopamine Release in the Nucleus Accumbens Core Encodes the General Excitatory Components of Learning. J Neurosci 2024; 44:e0120242024. [PMID: 38969504 PMCID: PMC11358529 DOI: 10.1523/jneurosci.0120-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Revised: 06/18/2024] [Accepted: 06/20/2024] [Indexed: 07/07/2024] Open
Abstract
Dopamine release in the nucleus accumbens core (NAcC) is generally considered to be a proxy for phasic firing of the ventral tegmental area dopamine (VTADA) neurons. Thus, dopamine release in NAcC is hypothesized to reflect a unitary role in reward prediction error signaling. However, recent studies reveal more diverse roles of dopamine neurons, which support an emerging idea that dopamine regulates learning differently in distinct circuits. To understand whether the NAcC might regulate a unique component of learning, we recorded dopamine release in NAcC while male rats performed a backward conditioning task where a reward is followed by a neutral cue. We used this task because we can delineate different components of learning, which include sensory-specific inhibitory and general excitatory components. Furthermore, we have shown that VTADA neurons are necessary for both the specific and general components of backward associations. Here, we found that dopamine release in NAcC increased to the reward across learning while reducing to the cue that followed as it became more expected. This mirrors the dopamine prediction error signal seen during forward conditioning and cannot be accounted for temporal-difference reinforcement learning. Subsequent tests allowed us to dissociate these learning components and revealed that dopamine release in NAcC reflects the general excitatory component of backward associations, but not their sensory-specific component. These results emphasize the importance of examining distinct functions of different dopamine projections in reinforcement learning.
Collapse
Affiliation(s)
- Masakazu Taira
- Department of Psychology, University of Sydney, Camperdown, New South Wales 2006, Australia
- Department of Psychology, University of California, Los Angeles 90095, California
| | - Samuel J Millard
- Department of Psychology, University of California, Los Angeles 90095, California
| | - Anna Verghese
- Department of Psychology, University of California, Los Angeles 90095, California
| | - Lauren E DiFazio
- Department of Psychology, University of California, Los Angeles 90095, California
| | - Ivy B Hoang
- Department of Psychology, University of California, Los Angeles 90095, California
| | - Ruiting Jia
- Department of Psychology, University of California, Los Angeles 90095, California
| | - Ana Sias
- Department of Psychology, University of California, Los Angeles 90095, California
| | - Andrew Wikenheiser
- Department of Psychology, University of California, Los Angeles 90095, California
| | - Melissa J Sharpe
- Department of Psychology, University of Sydney, Camperdown, New South Wales 2006, Australia
- Department of Psychology, University of California, Los Angeles 90095, California
| |
Collapse
|
8
|
Peart DR, Nolan CJ, Stone AP, Williams MA, Karlovcec JM, Murray JE. Disruption of positive- and negative-feature morphine interoceptive occasion setters by dopamine receptor agonism and antagonism in male and female rats. Psychopharmacology (Berl) 2024; 241:1597-1615. [PMID: 38580732 DOI: 10.1007/s00213-024-06584-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/16/2023] [Accepted: 03/29/2024] [Indexed: 04/07/2024]
Abstract
RATIONALE Internally perceived stimuli evoked by morphine administration can form Pavlovian associations such that they can function as occasion setters (OSs) for externally perceived reward cues in rats, coming to modulate reward-seeking behaviour. Though much research has investigated mechanisms underlying opioid-related reinforcement and analgesia, neurotransmitter systems involved in the functioning of opioids as Pavlovian interoceptive discriminative stimuli remain to be disentangled despite documented differences in the development of tolerance to analgesic versus discriminative stimulus effects. OBJECTIVES Dopamine has been implicated in many opioid-related behaviours, so we aimed to investigate the role of this neurotransmitter in expression of morphine occasion setting. METHODS Male and female rats were assigned to positive- (FP) or negative-feature (FN) groups and received an injection of morphine or saline before each training session. A 15-s white noise conditioned stimulus (CS) was presented 8 times during every training session; offset of this stimulus was followed by 4-s access to liquid sucrose on morphine, but not saline, sessions for FP rats. FN rats learned the reverse contingency. Following stable discrimination, rats began generalization testing for expression of morphine-guided sucrose seeking after systemic pretreatment with different doses of the non-selective dopamine receptor antagonist, flupenthixol, and the non-selective dopamine receptor agonist, apomorphine, combined with training doses of morphine or saline in a Latin-square design. RESULTS The morphine discrimination was acquired under both FP and FN contingencies by males and females. Neither flupenthixol nor apomorphine at any dose substituted for morphine, but both apomorphine and flupenthixol disrupted expression of the morphine OS. This inhibition was specific to sucrose seeking during CS presentations rather than during the period before CS onset and, in the case of apomorphine more so than flupenthixol, to trials on which access to sucrose was anticipated. CONCLUSIONS Our findings lend support to a mechanism of occasion setting involving gating of CS-induced dopamine release rather than by direct dopaminergic modulation by the morphine stimulus.
Collapse
Affiliation(s)
- Davin R Peart
- Department of Psychology, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada
- Collaborative Neurosciences Graduate Program, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada
| | - Caitlin J Nolan
- Collaborative Neurosciences Graduate Program, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada
- Department of Biomedical Sciences, University of Guelph, Guelph, ON, Canada
| | - Adiia P Stone
- Department of Psychology, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada
- Collaborative Neurosciences Graduate Program, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada
| | - Mckenna A Williams
- Department of Molecular and Cellular Biology, University of Guelph, Guelph, ON, Canada
| | - Jessica M Karlovcec
- Department of Psychology, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada
- Collaborative Neurosciences Graduate Program, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada
| | - Jennifer E Murray
- Department of Psychology, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada.
- Collaborative Neurosciences Graduate Program, University of Guelph, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada.
| |
Collapse
|
9
|
Turfe A, Westbrook SR, Lopez SA, Chang SE, Flagel SB. The effect of corticosterone on the acquisition of Pavlovian conditioned approach behavior in rats is dependent on sex and vendor. Horm Behav 2024; 164:105609. [PMID: 39083878 DOI: 10.1016/j.yhbeh.2024.105609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Revised: 07/02/2024] [Accepted: 07/19/2024] [Indexed: 08/02/2024]
Abstract
Cues in the environment become predictors of biologically relevant stimuli, such as food, through associative learning. These cues can not only act as predictors but can also be attributed with incentive motivational value and gain control over behavior. When a cue is imbued with incentive salience, it attains the ability to elicit maladaptive behaviors characteristic of psychopathology. We can capture the propensity to attribute incentive salience to a reward cue in rats using a Pavlovian conditioned approach paradigm, in which the presentation of a discrete lever-cue is followed by the delivery of a food reward. Upon learning the cue-reward relationship, some rats, termed sign-trackers, develop a conditioned response directed towards the lever-cue; whereas others, termed goal-trackers, approach the food cup upon lever-cue presentation. Here, we assessed the effects of systemic corticosterone (CORT) on the acquisition and expression of sign- and goal-tracking behaviors in male and female rats, while examining the role of the vendor (Charles River or Taconic) from which the rats originated in these effects. Treatment naïve male and female rats from Charles River had a greater tendency to sign-track than those from Taconic. Administration of CORT enhanced the acquisition of sign-tracking behavior in males from Charles River and females from both vendors. Conversely, administration of CORT had no effect on the expression of the conditioned response. These findings demonstrate a role for CORT in cue-reward learning and suggest that inherent tendencies towards sign- or goal-tracking may interact with this physiological mediator of motivated behavior.
Collapse
Affiliation(s)
- Alexandra Turfe
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor 48109, United States of America
| | - Sara R Westbrook
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor 48109, United States of America
| | - Sofia A Lopez
- Neuroscience Graduate Program, University of Michigan, Ann Arbor 48109, United States of America
| | - Stephen E Chang
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor 48109, United States of America
| | - Shelly B Flagel
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor 48109, United States of America; Department of Psychiatry, University of Michigan, Ann Arbor 48109, United States of America.
| |
Collapse
|
10
|
Engel L, Wolff AR, Blake M, Collins VL, Sinha S, Saunders BT. Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning. Curr Biol 2024; 34:3086-3101.e4. [PMID: 38925117 PMCID: PMC11279555 DOI: 10.1016/j.cub.2024.05.069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 04/25/2024] [Accepted: 05/29/2024] [Indexed: 06/28/2024]
Abstract
Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward rewards. Dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SNc) are crucial for this process, via engagement of a reciprocally connected network with their striatal targets. Critically, it remains unknown how dopamine neuron activity itself engages dopamine signals throughout the striatum, across learning. Here, we investigated how optogenetic Pavlovian cue conditioning of VTA or SNc dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. Although VTA stimulation-evoked robust dopamine release in NAc core, shell, and DMS, predictive cues preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS. Despite the development of vigorous movement late in training, conditioned dopamine signals did not emerge in the DLS, even during Pavlovian conditioning with SNc dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show a broad dissociation in the fundamental prediction and reward-related information generated by VTA and SNc dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale adaptations across the striatal network emerge during learning to coordinate behavior.
Collapse
Affiliation(s)
- Liv Engel
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA; Medical Discovery Team on Addiction, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA
| | - Amy R Wolff
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA; Medical Discovery Team on Addiction, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA
| | - Madelyn Blake
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA
| | - Val L Collins
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA; Medical Discovery Team on Addiction, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA
| | - Sonal Sinha
- Krieger School of Arts & Sciences, Johns Hopkins University, 3400 N. Charles St, Baltimore, MD 21218, USA
| | - Benjamin T Saunders
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA; Medical Discovery Team on Addiction, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA.
| |
Collapse
|
11
|
Crombag HS, Duka T, Stephens DN. The Continuing Challenges of Studying Parallel Behaviours in Humans and Animal Models. Curr Top Behav Neurosci 2024. [PMID: 38976140 DOI: 10.1007/7854_2024_485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/09/2024]
Abstract
The use of animal models continues to be essential for carrying out research into clinical phenomena, including addiction. However, the complexity of the clinical condition inevitably means that even the best animal models are inadequate, and this may go some way to account for the apparent failures of discoveries from animal models, including the identification of potential novel therapies, to translate to the clinic. We argue here that it is overambitious and misguided in the first place to attempt to model complex, multifacetted human disorders such as addiction in animals, and especially in rodents, and that all too frequently "validity" of such models is limited to superficial similarities, referred to as "face validity", that reflect quite different underlying phenomena and biological processes from the clinical situation. Instead, a more profitable approach is to identify (a) well-defined intermediate human behavioural phenotypes that reflect defined, limited aspects of, or contributors to, the human clinical disorder, and (b) to develop animal models that are homologous with those discrete human behavioural phenotypes in terms of psychological processes, and underlying neurobiological mechanisms. Examples of past and continuing weaknesses and suggestions for more limited approaches that may allow better homology between the test animal and human condition are made.
Collapse
Affiliation(s)
- Hans S Crombag
- School of Psychology and Sussex Neuroscience, The University of Sussex, Brighton, UK.
| | - Theodora Duka
- School of Psychology and Sussex Neuroscience, The University of Sussex, Brighton, UK
| | - David N Stephens
- School of Psychology and Sussex Neuroscience, The University of Sussex, Brighton, UK
| |
Collapse
|
12
|
Schettino M, Tarmati V, Castellano P, Gigli V, Carnevali L, Cabib S, Ottaviani C, Orsini C. Effects of acute stress on reward processing: A comprehensive meta-analysis of rodent and human studies. Neurobiol Stress 2024; 31:100647. [PMID: 38962695 PMCID: PMC11219954 DOI: 10.1016/j.ynstr.2024.100647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Revised: 05/02/2024] [Accepted: 05/22/2024] [Indexed: 07/05/2024] Open
Abstract
Stressors can initiate a cascade of central and peripheral changes that modulate mesocorticolimbic dopaminergic circuits and, ultimately, behavioral response to rewards. Driven by the absence of conclusive evidence on this topic and the Research Domain Criteria framework, random-effects meta-analyses were adopted to quantify the effects of acute stressors on reward responsiveness, valuation, and learning in rodent and human subjects. In rodents, acute stress reduced reward responsiveness (g = -1.43) and valuation (g = -0.32), while amplifying reward learning (g = 1.17). In humans, acute stress had marginal effects on valuation (g = 0.25), without affecting responsiveness and learning. Moderation analyses suggest that acute stress neither has unitary effects on reward processing in rodents nor in humans and that the duration of the stressor and specificity of reward experience (i.e., food vs drugs) may produce qualitatively and quantitatively different behavioral endpoints. Subgroup analyses failed to reduce heterogeneity, which, together with the presence of publication bias, pose caution on the conclusions that can be drawn and point to the need of guidelines for the conduction of future studies in the field.
Collapse
Affiliation(s)
- Martino Schettino
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- IRCCS Istituto delle Scienze Neurologiche di Bologna, Bologna, Italy
| | - Valeria Tarmati
- Department of Psychology, Sapienza University of Rome, Rome, Italy
| | - Paola Castellano
- Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy
| | - Valeria Gigli
- Department of Psychology, Sapienza University of Rome, Rome, Italy
| | - Luca Carnevali
- Department of Chemistry, Life Sciences and Environmental Sustainability, University of Parma, Parma, Italy
| | - Simona Cabib
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- IRCCS Santa Lucia Foundation, Rome, Italy
| | - Cristina Ottaviani
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- IRCCS Santa Lucia Foundation, Rome, Italy
| | - Cristina Orsini
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- IRCCS Santa Lucia Foundation, Rome, Italy
| |
Collapse
|
13
|
Song MR, Lee SW. Rethinking dopamine-guided action sequence learning. Eur J Neurosci 2024; 60:3447-3465. [PMID: 38798086 DOI: 10.1111/ejn.16426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 04/21/2024] [Accepted: 05/08/2024] [Indexed: 05/29/2024]
Abstract
As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.
Collapse
Affiliation(s)
- Minryung R Song
- Department of Brain and Cognitive Sciences, KAIST, Daejeon, South Korea
| | - Sang Wan Lee
- Department of Brain and Cognitive Sciences, KAIST, Daejeon, South Korea
- Kim Jaechul Graduate School of AI, KAIST, Daejeon, South Korea
- KI for Health Science and Technology, KAIST, Daejeon, South Korea
- Center for Neuroscience-inspired AI, KAIST, Daejeon, South Korea
| |
Collapse
|
14
|
Avila C, Sarter M. Cortico-striatal action control inherent of opponent cognitive-motivational styles. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.12.584623. [PMID: 38559086 PMCID: PMC10979997 DOI: 10.1101/2024.03.12.584623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Turning on cue or stopping at a red light requires the detection of such cues to select action sequences, or suppress action, in accordance with cue-associated action rules. Cortico-striatal projections are an essential part of the brain's attention-motor interface. Glutamate-sensing microelectrode arrays were used to measure glutamate transients in the dorsomedial striatum (DMS) of male and female rats walking a treadmill and executing cued turns and stops. Prelimbic-DMS projections were chemogenetically inhibited to determine their behavioral necessity and the cortico-striatal origin of cue-evoked glutamate transients. Furthermore, we investigated rats exhibiting preferably goal-directed (goal trackers, GTs) versus cue-driven attention (sign trackers, STs), to determine the impact of such cognitive-motivational biases on cortico-striatal control. GTs executed more cued turns and initiated such turns more slowly than STs. During turns, but not missed turns or cued stops, cue-evoked glutamate concentrations were higher in GTs than in STs. In conjunction with turn cue-evoked glutamate spike levels, the presence of a single spike rendered GTs to be almost twice as likely to turn than STs. In contrast, multiple glutamate spikes predicted GTs to be less likely to turn than STs. In GTs, but not STs, inhibition of prelimbic-DMS projections attenuated turn rates, turn cue-evoked glutamate peaks, and increased the number of spikes. These findings suggest that turn cue-evoked glutamate release in GTs is tightly controlled by cortico-striatal neuronal activity. In contrast, in STs, glutamate release from DMS glutamatergic terminals may be regulated by other striatal circuitry, preferably mediating cued suppression of action and reward tracking.
Collapse
Affiliation(s)
- Cassandra Avila
- Department of Psychology, University of Michigan, Ann Arbor, MI, USA
| | - Martin Sarter
- Department of Psychology, University of Michigan, Ann Arbor, MI, USA
- Department of Psychology & Neuroscience Program, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
15
|
Thibeault KC, Leonard MZ, Kondev V, Emerson SD, Bethi R, Lopez AJ, Sens JP, Nabit BP, Elam HB, Winder DG, Patel S, Kiraly DD, Grueter BA, Calipari ES. A Cocaine-Activated Ensemble Exerts Increased Control Over Behavior While Decreasing in Size. Biol Psychiatry 2024:S0006-3223(24)01388-X. [PMID: 38901723 DOI: 10.1016/j.biopsych.2024.06.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 06/06/2024] [Accepted: 06/11/2024] [Indexed: 06/22/2024]
Abstract
BACKGROUND Substance use disorder is characterized by long-lasting changes in reward-related brain regions, such as the nucleus accumbens. Previous work has shown that cocaine exposure induces plasticity in broad, genetically defined cell types in the nucleus accumbens; however, in response to a stimulus, only a small percentage of neurons are transcriptionally active-termed an ensemble. Here, we identify an Arc-expressing neuronal ensemble that has a unique trajectory of recruitment and causally controls drug self-administration after repeated, but not acute, cocaine exposure. METHODS Using Arc-CreERT2 transgenic mice, we expressed transgenes in Arc+ ensembles activated by cocaine exposure (either acute [1 × 10 mg/kg intraperitoneally] or repeated [10 × 10 mg/kg intraperitoneally]). Using genetic, optical, and physiological recording and manipulation strategies, we assessed the contribution of these ensembles to behaviors associated with substance use disorder. RESULTS Repeated cocaine exposure reduced the size of the ensemble while simultaneously increasing its control over behavior. Neurons within the repeated cocaine ensemble were hyperexcitable, and their optogenetic excitation was sufficient for reinforcement. Finally, lesioning the repeated cocaine, but not the acute cocaine, ensemble blunted cocaine self-administration. Thus, repeated cocaine exposure reduced the size of the ensemble while simultaneously increasing its contributions to drug reinforcement. CONCLUSIONS We showed that repeated, but not acute, cocaine exposure induced a physiologically distinct ensemble characterized by the expression of the immediate early gene Arc, which was uniquely capable of modulating reinforcement behavior.
Collapse
Affiliation(s)
- Kimberly C Thibeault
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee; Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee
| | - Michael Z Leonard
- Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee; Department of Pharmacology, Vanderbilt University, Nashville, Tennessee
| | - Veronika Kondev
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee; Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee
| | - Soren D Emerson
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee; Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee
| | - Rishik Bethi
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee; Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee
| | - Alberto J Lopez
- Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee; Department of Pharmacology, Vanderbilt University, Nashville, Tennessee
| | - Jonathon P Sens
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, North Carolina
| | - Brett P Nabit
- Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee; Department of Pharmacology, Vanderbilt University, Nashville, Tennessee
| | - Hannah B Elam
- Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee; Department of Pharmacology, Vanderbilt University, Nashville, Tennessee
| | - Danny G Winder
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee; Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee; Department of Pharmacology, Vanderbilt University, Nashville, Tennessee; Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee; Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee; Vanderbilt JF Kennedy Center, Vanderbilt University School of Medicine, Nashville, Tennessee
| | - Sachin Patel
- Department of Psychiatry, Northwestern University, Chicago, Illinois
| | - Drew D Kiraly
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, North Carolina
| | - Brad A Grueter
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee; Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee; Department of Pharmacology, Vanderbilt University, Nashville, Tennessee; Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee; Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee; Department of Anesthesiology, Vanderbilt University School of Medicine, Nashville, Tennessee
| | - Erin S Calipari
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee; Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, Tennessee; Department of Pharmacology, Vanderbilt University, Nashville, Tennessee; Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee; Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee; Vanderbilt JF Kennedy Center, Vanderbilt University School of Medicine, Nashville, Tennessee.
| |
Collapse
|
16
|
Cofresí RU, Upton S, Brown AA, Piasecki TM, Bartholow BD, Froeliger B. Mesocorticolimbic system reactivity to alcohol use-related visual cues as a function of alcohol sensitivity phenotype: A pilot fMRI study. ADDICTION NEUROSCIENCE 2024; 11:100156. [PMID: 38938269 PMCID: PMC11209874 DOI: 10.1016/j.addicn.2024.100156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/29/2024]
Abstract
Low sensitivity (LS) to alcohol is a risk factor for alcohol use disorder (AUD). Compared to peers with high sensitivity (HS), LS individuals drink more, report more problems, and exhibit potentiated alcohol cue reactivity (ACR). Heightened ACR suggests LS confers AUD risk via incentive sensitization, which is thought to take place in the mesocorticolimbic system. This study examined neural ACR in LS and HS individuals. Young adults (N = 32, M age=20.3) were recruited based on the Alcohol Sensitivity Questionnaire (HS: n = 16; LS: n = 16; 9 females/group). Participants completed an event-related fMRI ACR task. Group LS had higher ACR in left ventrolateral prefrontal cortex than group HS. In group LS, ACR in left caudomedial orbitofrontal cortex or left putamen was low at low alcohol use levels and high at heavier or more problematic alcohol use levels, whereas the opposite was true in group HS. Alcohol use level also was associated with the level of ACR in left substantia nigra among males in group LS. Taken together, results suggest elevated mesocorticolimbic ACR among LS individuals, especially those using alcohol at hazardous levels. Future studies with larger samples are warranted to determine the neurobiological loci underlying LS-based amplified ACR and AUD risk.
Collapse
Affiliation(s)
- Roberto U. Cofresí
- Department of Psychological Sciences, University of Missouri - Columbia, USA
| | - Spencer Upton
- Department of Psychological Sciences, University of Missouri - Columbia, USA
| | - Alexander A. Brown
- Department of Psychological Sciences, University of Missouri - Columbia, USA
| | - Thomas M. Piasecki
- Center for Tobacco Research and Intervention and Department of Medicine, University of Wisconsin - Madison, USA
| | | | - Brett Froeliger
- Department of Psychological Sciences, University of Missouri - Columbia, USA
- Department of Psychiatry, University of Missouri - Columbia, USA
| |
Collapse
|
17
|
Bender BN, Stringfield SJ, Torregrossa MM. Changes in dorsomedial striatum activity during expression of goal-directed vs. habit-like cue-induced cocaine seeking. ADDICTION NEUROSCIENCE 2024; 11:100149. [PMID: 38957402 PMCID: PMC11218864 DOI: 10.1016/j.addicn.2024.100149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/04/2024]
Abstract
A preclinical model of cue exposure therapy, cue extinction, reduces cue-induced cocaine seeking that is goal-directed but not habit-like. Goal-directed and habitual behaviors differentially rely on the dorsomedial striatum (DMS) and dorsolateral striatum (DLS), but the effects of cue extinction on dorsal striatal responses to cue-induced drug seeking are unknown. We used fiber photometry in rats trained to self-administer cocaine paired with an audiovisual cue to examine how dorsal striatal intracellular calcium and extracellular dopamine activity differs between goal-directed and habit-like cue-induced cocaine seeking and how it is impacted by cue extinction. After minimal fixed-ratio training, rats showed enhanced DMS and DLS calcium responses to cue-reinforced compared to unreinforced lever presses. After rats were trained on goal-promoting fixed ratio schedules or habit-promoting second-order schedules of reinforcement, different patterns of dorsal striatal calcium and dopamine responses to cue-reinforced lever presses emerged. Rats trained on habit-promoting second-order schedules showed reduced DMS calcium responses and enhanced DLS dopamine responses to cue-reinforced lever presses. Cue extinction reduced calcium responses during subsequent drug seeking in the DMS, but not in the DLS. Therefore, cue extinction may reduce goal-directed behavior through its effects on the DMS, whereas habit-like behavior and the DLS are unaffected.
Collapse
Affiliation(s)
- Brooke N. Bender
- Department of Psychiatry, University of Pittsburgh, 450 Technology Drive, Pittsburgh, PA 15219, United States
- Center for Neuroscience, University of Pittsburgh, 4200 Fifth Ave, Pittsburgh, PA 15213, United States
| | - Sierra J. Stringfield
- Department of Psychiatry, University of Pittsburgh, 450 Technology Drive, Pittsburgh, PA 15219, United States
| | - Mary M. Torregrossa
- Department of Psychiatry, University of Pittsburgh, 450 Technology Drive, Pittsburgh, PA 15219, United States
- Center for Neuroscience, University of Pittsburgh, 4200 Fifth Ave, Pittsburgh, PA 15213, United States
| |
Collapse
|
18
|
Forderhase AG, Ligons LA, Norwood E, McCarty GS, Sombers LA. Optimized Fabrication of Carbon-Fiber Microbiosensors for Codetection of Glucose and Dopamine in Brain Tissue. ACS Sens 2024; 9:2662-2672. [PMID: 38689483 DOI: 10.1021/acssensors.4c00527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2024]
Abstract
Dopamine (DA) signaling is critically important in striatal function, and this metabolically demanding process is fueled largely by glucose. However, DA and glucose are typically studied independently and, as such, the precise relationship between DA release and glucose availability remains unclear. Fast-scan cyclic voltammetry (FSCV) is commonly coupled with carbon-fiber microelectrodes to study DA transients. These microelectrodes can be modified with glucose oxidase (GOx) to generate microbiosensors capable of simultaneously quantifying real-time and physiologically relevant fluctuations of glucose, a nonelectrochemically active substrate, and DA, which is readily oxidized and reduced at the electrode surface. A chitosan hydrogel can be electrodeposited to entrap the oxidase enzyme on the sensor surface for stable, sensitive, and selective codetection of glucose and DA using FSCV. This strategy can also be used to entrap lactate oxidase on the carbon-fiber surface for codetection of lactate and DA. However, these custom probes are individually fabricated by hand, and performance is variable. This study characterizes the physical nature of the hydrogel and its effects on the acquired electrochemical data in the detection of glucose (2.6 mM) and DA (1 μM). The results demonstrate that the electrodeposition of the hydrogel membrane is improved using a linear potential sweep rather than a direct step to the target potential. Electrochemical impedance spectroscopy data relate information on the physical nature of the electrode/solution interface to the electrochemical performance of bare and enzyme-modified carbon-fiber microelectrodes. The electrodeposition waveform and scan rate were characterized for optimal membrane formation and performance. Finally, codetection of both DA/glucose and DA/lactate was demonstrated in intact rat striatum using probes fabricated according to the optimized protocol. Overall, this work improves the reliable fabrication of carbon-fiber microbiosensors for codetection of DA and important energetic substrates that are locally delivered to the recording site to meet metabolic demand.
Collapse
Affiliation(s)
- Alexandra G Forderhase
- Department of Chemistry, North Carolina State University, Raleigh, North Carolina 27695, United States
| | - Lailah A Ligons
- Department of Chemistry, North Carolina State University, Raleigh, North Carolina 27695, United States
- Joint Department of Biomedical Engineering, North Carolina State University and University of North Carolina at Chapel Hill, Raleigh, North Carolina 27695, United States
| | - Emilie Norwood
- Department of Chemistry, North Carolina State University, Raleigh, North Carolina 27695, United States
- Joint Department of Biomedical Engineering, North Carolina State University and University of North Carolina at Chapel Hill, Raleigh, North Carolina 27695, United States
| | - Gregory S McCarty
- Department of Chemistry, North Carolina State University, Raleigh, North Carolina 27695, United States
| | - Leslie A Sombers
- Department of Chemistry, North Carolina State University, Raleigh, North Carolina 27695, United States
- Joint Department of Biomedical Engineering, North Carolina State University and University of North Carolina at Chapel Hill, Raleigh, North Carolina 27695, United States
- Comparative Medicine Institute, North Carolina State University, Raleigh, North Carolina 27695, United States
| |
Collapse
|
19
|
Fleury S, Kolaric R, Espera J, Ha Q, Tomaio J, Gether U, Sørensen AT, Mingote S. Role of dopamine neurons in familiarity. Eur J Neurosci 2024; 59:2522-2534. [PMID: 38650479 DOI: 10.1111/ejn.16326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 02/15/2024] [Accepted: 03/09/2024] [Indexed: 04/25/2024]
Abstract
Dopamine neurons signal the salience of environmental stimuli and influence learning, although it is less clear if these neurons also determine the salience of memories. Ventral tegmental area (VTA) dopamine neurons increase their firing in the presence of new objects and reduce it upon repeated, inconsequential exposures, marking the shift from novelty to familiarity. This study investigates how dopamine neuron activity during repeated familiar object exposure affects an animal's preference for new objects in a subsequent novel object recognition (NOR) test. We hypothesize that a single familiarization session will not sufficiently lower dopamine activity, such that the memory of a familiar object remains salient, leading to equal exploration of familiar and novel objects and weaker NOR discrimination. In contrast, multiple familiarization sessions likely suppress dopamine activity more effectively, reducing the salience of the familiar object and enhancing subsequent novelty discrimination. Our experiments in mice indicated that multiple familiarization sessions reduce VTA dopamine neuron activation, as measured by c-Fos expression, and enhance novelty discrimination compared with a single familiarization session. Dopamine neurons that show responsiveness to novelty were primarily located in the paranigral nucleus of the VTA and expressed vesicular glutamate transporter 2 transcripts, marking them as dopamine-glutamate neurons. Chemogenetic inhibition of dopamine neurons during a single session paralleled the effects of multiple sessions, improving NOR. These findings suggest that a critical role of dopamine neurons during the transition from novelty to familiarity is to modulate the salience of an object's memory.
Collapse
Affiliation(s)
- Sixtine Fleury
- The Advanced Science Research Center, Graduate Center, City University of New York, New York, New York, USA
| | - Rhonda Kolaric
- The Advanced Science Research Center, Graduate Center, City University of New York, New York, New York, USA
| | - Justin Espera
- The Advanced Science Research Center, Graduate Center, City University of New York, New York, New York, USA
| | - Quan Ha
- The Advanced Science Research Center, Graduate Center, City University of New York, New York, New York, USA
| | - Jacquelyn Tomaio
- The Advanced Science Research Center, Graduate Center, City University of New York, New York, New York, USA
| | - Ulrik Gether
- Molecular Neuropharmacology and Genetics Laboratory, Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Andreas Toft Sørensen
- Molecular Neuropharmacology and Genetics Laboratory, Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Susana Mingote
- The Advanced Science Research Center, Graduate Center, City University of New York, New York, New York, USA
| |
Collapse
|
20
|
Senol E, Mohammad H. Current perspectives on brain circuits involved in food addiction-like behaviors. J Neural Transm (Vienna) 2024; 131:475-485. [PMID: 38216705 DOI: 10.1007/s00702-023-02732-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 12/17/2023] [Indexed: 01/14/2024]
Abstract
There is an emerging view that the increased availability of energy-dense foods in our society is contributing to excessive food consumption which could lead to food addiction-like behavior. Particularly, compulsive eating patterns are predominant in people suffering from eating disorders (binge-eating disorder, bulimia and anorexia nervosa) and obesity. Phenotypically, the behavioral pattern exhibits a close resemblance to individuals suffering from other forms of addiction (drug, sex, gambling). Growing body of evidence in neuroscience research is showing that excessive consumption of energy-dense foods alters the brain circuits implicated in reward, decision-making, control, habit formation, and emotions that are central to drug addiction. Here, we review the current understanding of the circuits of food addiction-like behaviors and highlight the future possibility of exploring those circuits to combat obesity and eating disorders.
Collapse
Affiliation(s)
- Esra Senol
- Institute of Molecular and Cell Biology, Agency for Science, Technology and Research (A*STAR), Singapore, Singapore
| | - Hasan Mohammad
- Centre de Recherche en Biomédicine de Strasbourg (CRBS), L'Institut National de La Santé Et de La Recherche Médicale (Inserm) U1114, University of Strasbourg, Strasbourg, France.
- Department of Biological Sciences, Indian Institute of Science Education and Research, Mohali, Punjab, 140306, India.
| |
Collapse
|
21
|
Avvisati R, Kaufmann AK, Young CJ, Portlock GE, Cancemi S, Costa RP, Magill PJ, Dodson PD. Distributional coding of associative learning in discrete populations of midbrain dopamine neurons. Cell Rep 2024; 43:114080. [PMID: 38581677 PMCID: PMC7616095 DOI: 10.1016/j.celrep.2024.114080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 02/12/2024] [Accepted: 03/24/2024] [Indexed: 04/08/2024] Open
Abstract
Midbrain dopamine neurons are thought to play key roles in learning by conveying the difference between expected and actual outcomes. Recent evidence suggests diversity in dopamine signaling, yet it remains poorly understood how heterogeneous signals might be organized to facilitate the role of downstream circuits mediating distinct aspects of behavior. Here, we investigated the organizational logic of dopaminergic signaling by recording and labeling individual midbrain dopamine neurons during associative behavior. Our findings show that reward information and behavioral parameters are not only heterogeneously encoded but also differentially distributed across populations of dopamine neurons. Retrograde tracing and fiber photometry suggest that populations of dopamine neurons projecting to different striatal regions convey distinct signals. These data, supported by computational modeling, indicate that such distributional coding can maximize dynamic range and tailor dopamine signals to facilitate specialized roles of different striatal regions.
Collapse
Affiliation(s)
- Riccardo Avvisati
- School of Physiology, Pharmacology, and Neuroscience, University of Bristol, Bristol BS8 1TD, UK; Medical Research Council Brain Network Dynamics Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX1 3TH, UK
| | - Anna-Kristin Kaufmann
- Medical Research Council Brain Network Dynamics Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX1 3TH, UK
| | - Callum J Young
- School of Physiology, Pharmacology, and Neuroscience, University of Bristol, Bristol BS8 1TD, UK; Computational Neuroscience Unit, Department of Computer Science, SCEEM, Faculty of Engineering, University of Bristol, Bristol BS8 1UB, UK
| | - Gabriella E Portlock
- School of Physiology, Pharmacology, and Neuroscience, University of Bristol, Bristol BS8 1TD, UK
| | - Sophie Cancemi
- School of Physiology, Pharmacology, and Neuroscience, University of Bristol, Bristol BS8 1TD, UK
| | - Rui Ponte Costa
- Computational Neuroscience Unit, Department of Computer Science, SCEEM, Faculty of Engineering, University of Bristol, Bristol BS8 1UB, UK
| | - Peter J Magill
- Medical Research Council Brain Network Dynamics Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX1 3TH, UK
| | - Paul D Dodson
- School of Physiology, Pharmacology, and Neuroscience, University of Bristol, Bristol BS8 1TD, UK; Medical Research Council Brain Network Dynamics Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX1 3TH, UK.
| |
Collapse
|
22
|
Li YT, Huang YL, Chen JJJ, Hyland BI, Wickens JR. Phasic dopamine signals are reduced in the spontaneously hypertensive rat and increased by methylphenidate. Eur J Neurosci 2024; 59:1567-1584. [PMID: 38314648 DOI: 10.1111/ejn.16269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Revised: 12/27/2023] [Accepted: 01/17/2024] [Indexed: 02/06/2024]
Abstract
The spontaneously hypertensive rat (SHR) is a selectively bred animal strain that is frequently used to model attention-deficit hyperactivity disorder (ADHD) because of certain genetically determined behavioural characteristics. To test the hypothesis that the characteristically altered response to positive reinforcement in SHRs may be due to altered phasic dopamine response to reward, we measured phasic dopamine signals in the SHRs and Sprague Dawley (SD) rats using in vivo fast-scan cyclic voltammetry. The effects of the dopamine reuptake inhibitor, methylphenidate, on these signals were also studied. Phasic dopamine signals during the pairing of a sensory cue with electrical stimulation of midbrain dopamine neurons were significantly smaller in the SHRs than in the SD rats. Over repeated pairings, the dopamine response to the sensory cue increased, whereas the response to the electrical stimulation of dopamine neurons decreased, similarly in both strains. However, the final amplitude of the response to the sensory cue after pairing was significantly smaller in SHRs than in the SD rats. Methylphenidate increased responses to sensory cues to a significantly greater extent in the SHRs than in the SD rats, due largely to differences in the low dose effect. At a higher dose, methylphenidate increased responses to sensory cues and electrical stimulation similarly in SHRs and SD rats. The smaller dopamine responses may explain the reduced salience of reward-predicting cues previously reported in the SHR, whereas the action of methylphenidate on the cue response suggests a potential mechanism for the therapeutic effects of low-dose methylphenidate in ADHD.
Collapse
Affiliation(s)
- Yu-Ting Li
- Neurobiology Research Unit, Okinawa Institute of Science and Technology, Okinawa, Japan
- Taiwan Instrument Research Institute, National Applied Research Laboratories, Hsinchu, Taiwan
| | - Yi-Ling Huang
- Neurobiology Research Unit, Okinawa Institute of Science and Technology, Okinawa, Japan
| | - Jia-Jin Jason Chen
- Department of Biomedical Engineering, National Cheng Kung University, Tainan, Taiwan
| | - Brian Ian Hyland
- Department of Physiology, Brain Health Research Centre, University of Otago, Dunedin, New Zealand
| | - Jeffery R Wickens
- Neurobiology Research Unit, Okinawa Institute of Science and Technology, Okinawa, Japan
| |
Collapse
|
23
|
Bernklau TW, Righetti B, Mehrke LS, Jacob SN. Striatal dopamine signals reflect perceived cue-action-outcome associations in mice. Nat Neurosci 2024; 27:747-757. [PMID: 38291283 PMCID: PMC11001585 DOI: 10.1038/s41593-023-01567-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 12/21/2023] [Indexed: 02/01/2024]
Abstract
Striatal dopamine drives associative learning by acting as a teaching signal. Much work has focused on simple learning paradigms, including Pavlovian and instrumental learning. However, higher cognition requires that animals generate internal concepts of their environment, where sensory stimuli, actions and outcomes become flexibly associated. Here, we performed fiber photometry dopamine measurements across the striatum of male mice as they learned cue-action-outcome associations based on implicit and changing task rules. Reinforcement learning models of the behavioral and dopamine data showed that rule changes lead to adjustments of learned cue-action-outcome associations. After rule changes, mice discarded learned associations and reset outcome expectations. Cue- and outcome-triggered dopamine signals became uncoupled and dependent on the adopted behavioral strategy. As mice learned the new association, coupling between cue- and outcome-triggered dopamine signals and task performance re-emerged. Our results suggest that dopaminergic reward prediction errors reflect an agent's perceived locus of control.
Collapse
Affiliation(s)
- Tobias W Bernklau
- Translational Neurotechnology Laboratory, Department of Neurosurgery, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-University Munich, Munich, Germany
| | - Beatrice Righetti
- Translational Neurotechnology Laboratory, Department of Neurosurgery, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
| | - Leonie S Mehrke
- Translational Neurotechnology Laboratory, Department of Neurosurgery, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
| | - Simon N Jacob
- Translational Neurotechnology Laboratory, Department of Neurosurgery, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany.
| |
Collapse
|
24
|
Engel L, Wolff AR, Blake M, Collins VL, Sinha S, Saunders BT. Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.07.01.547331. [PMID: 38585717 PMCID: PMC10996462 DOI: 10.1101/2023.07.01.547331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.
Collapse
Affiliation(s)
- Liv Engel
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
- Current Address: Department of Psychology, University of Toronto
| | - Amy R Wolff
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| | - Madelyn Blake
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| | - Val L Collins
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| | | | - Benjamin T Saunders
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| |
Collapse
|
25
|
Turfe A, Westbrook SR, Lopez SA, Chang SE, Flagel SB. The effect of corticosterone on the acquisition of Pavlovian conditioned approach behavior is dependent on sex and vendor. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.20.586009. [PMID: 38562896 PMCID: PMC10983933 DOI: 10.1101/2024.03.20.586009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Cues in the environment become predictors of biologically relevant stimuli, such as food, through associative learning. These cues can not only act as predictors but can also be attributed with incentive motivational value and gain control over behavior. When a cue is imbued with incentive salience, it attains the ability to elicit maladaptive behaviors characteristic of psychopathology. We can capture the propensity to attribute incentive salience to a reward cue in rats using a Pavlovian conditioned approach paradigm, in which the presentation of a discrete lever-cue is followed by the delivery of a food reward. Upon learning the cue-reward relationship, some rats, termed sign-trackers, develop a conditioned response directed towards the lever-cue; whereas others, termed goal-trackers, approach the food cup upon lever-cue presentation. Here, we assessed the effects of systemic corticosterone (CORT) on the acquisition and expression of sign- and goal-tracking behaviors in male and female rats, while examining the role of the vendor (Charles River or Taconic) from which the rats originated in these effects. Male and female rats from Charles River had a greater tendency to sign-track than those from Taconic. Administration of CORT enhanced the acquisition of sign-tracking behavior in males from Charles River and females from both vendors. Conversely, administration of CORT had no effect on the expression of the conditioned response. These findings demonstrate a role for CORT in cue-reward learning and suggest that inherent tendencies towards sign- or goal-tracking may interact with this physiological mediator of motivated behavior. Highlights Male and female rats from Charles River exhibit more sign-tracking relative to those from Taconic.Corticosterone increases the acquisition of sign-tracking in male rats from Charles River.Corticosterone increases the acquisition of sign-tracking in female rats, regardless of vendor.There is no effect of corticosterone on the expression of sign-tracking behavior in either male or female rats.
Collapse
|
26
|
Zhao J, Zhang G, Xu D. The effect of reward on motor learning: different stage, different effect. Front Hum Neurosci 2024; 18:1381935. [PMID: 38532789 PMCID: PMC10963647 DOI: 10.3389/fnhum.2024.1381935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 02/29/2024] [Indexed: 03/28/2024] Open
Abstract
Motor learning is a prominent and extensively studied subject in rehabilitation following various types of neurological disorders. Motor repair and rehabilitation often extend over months and years post-injury with a slow pace of recovery, particularly affecting the fine movements of the distal extremities. This extended period can diminish the motivation and persistence of patients, a facet that has historically been overlooked in motor learning until recent years. Reward, including monetary compensation, social praise, video gaming, music, and virtual reality, is currently garnering heightened attention for its potential to enhance motor motivation and improve function. Numerous studies have examined the effects and attempted to explore potential mechanisms in various motor paradigms, yet they have yielded inconsistent or even contradictory results and conclusions. A comprehensive review is necessary to summarize studies on the effects of rewards on motor learning and to deduce a central pattern from these existing studies. Therefore, in this review, we initially outline a framework of motor learning considering two major types, two major components, and three stages. Subsequently, we summarize the effects of rewards on different stages of motor learning within the mentioned framework and analyze the underlying mechanisms at the level of behavior or neural circuit. Reward accelerates learning speed and enhances the extent of learning during the acquisition and consolidation stages, possibly by regulating the balance between the direct and indirect pathways (activating more D1-MSN than D2-MSN) of the ventral striatum and by increasing motor dynamics and kinematics. However, the effect varies depending on several experimental conditions. During the retention stage, there is a consensus that reward enhances both short-term and long-term memory retention in both types of motor learning, attributed to the LTP learning mechanism mediated by the VTA-M1 dopaminergic projection. Reward is a promising enhancer to bolster waning confidence and motivation, thereby increasing the efficiency of motor learning and rehabilitation. Further exploration of the circuit and functional connections between reward and the motor loop may provide a novel target for neural modulation to promote motor behavior.
Collapse
Affiliation(s)
- Jingwang Zhao
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Institute of Rehabilitation Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Guanghu Zhang
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Institute of Rehabilitation Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Dongsheng Xu
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Institute of Rehabilitation Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China
- Department of Rehabilitation Medicine, Shuguang Hospital, Shanghai, China
| |
Collapse
|
27
|
Melugin PR, Nolan SO, Kandov E, Ferrara CF, Farahbakhsh ZZ, Siciliano CA. Medial prefrontal dopamine dynamics reflect allocation of selective attention. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.04.583245. [PMID: 38496533 PMCID: PMC10942305 DOI: 10.1101/2024.03.04.583245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Abstract
The mesocortical dopamine system is comprised of midbrain dopamine neurons that predominantly innervate the medial prefrontal cortex (mPFC) and exert a powerful neuromodulatory influence over this region 1,2 . mPFC dopamine activity is thought to be critical for fundamental neurobiological processes including valence coding and decision-making 3,4 . Despite enduring interest in this pathway, the stimuli and conditions that engage mPFC dopamine release have remained enigmatic due to inherent limitations in conventional methods for dopamine monitoring which have prevented real-time in vivo observation 5 . Here, using a fluorescent dopamine sensor enabling time-resolved recordings of cortical dopamine activity in freely behaving mice, we reveal the coding properties of this system and demonstrate that mPFC dopamine dynamics conform to a selective attention signal. Contrary to the long-standing theory that mPFC dopamine release preferentially encodes aversive and stressful events 6-8 , we observed robust dopamine responses to both appetitive and aversive stimuli which dissipated with increasing familiarity irrespective of stimulus intensity. We found that mPFC dopamine does not evolve as a function of learning but displays striking temporal precedence with second-to-second changes in behavioral engagement, suggesting a role in allocation of attentional resources. Systematic manipulation of attentional demand revealed that quieting of mPFC dopamine signals the allocation of attentional resources towards an expected event which, upon detection triggers a sharp dopamine transient marking the transition from decision-making to action. The proposed role of mPFC dopamine as a selective attention signal is the first model based on direct observation of time-resolved dopamine dynamics and reconciles decades of competing theories.
Collapse
|
28
|
Derman RC, Bryda EC, Ferrario CR. Role of nucleus accumbens D1-type medium spiny neurons in the expression and extinction of sign-tracking. Behav Brain Res 2024; 459:114768. [PMID: 37984521 PMCID: PMC10842774 DOI: 10.1016/j.bbr.2023.114768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 10/31/2023] [Accepted: 11/16/2023] [Indexed: 11/22/2023]
Abstract
While sign-tracking, also known as autoshaping, has been studied for many decades, only recently has the tendency to show sign-tracking behavior been linked to the development and persistence of addiction. Sign-tracking is dependent upon dopamine activity in the nucleus accumbens (NAc). The NAc is comprised predominantly of medium spiny projection neurons (MSN) that can be differentiated by their D1-like or D2-like dopamine receptor expression. Here we determined how reducing activity of D1-type MSNs in the NAc affects the expression and extinction of sign-tracking. To address this, we transfected the NAc of transgenic male and female rats that selectively express Cre recombinase in D1-type MSNs with a DIO viral vector expressing hM4Di. Cre- rats were given the same viral infusion but did not express the hM4Di receptor and therefore served as controls. Rats were then conditioned to associate lever presentations with pellet delivery. After sign-tracking was established, all rats were administered clozapine-n-oxide (CNO) prior to three additional conditioning sessions to assess the effects of NAc D1-MSNs inhibition on sign-tracking in the presence of reward. CNO treatment did not alter the expression of sign-tracking in Cre+ or Cre- rats. Next rats underwent extinction training where lever presentations occurred without pellet delivery and all rats received a CNO injection prior to each extinction session. In these extinction conditions, Cre+ rats exhibited robust extinction of sign-tracking across sessions, whereas Cre- rats did not. To determine if D1-MSN inhibition merely produced a temporary cessation of sign-tracking or instead had facilitated a persistent loss of sign-tracking, we evaluated the reemergence of sign-tracking in a test for reconditioning. During testing, reintroduction of the CS-US pairing did not promote the reemergence of sign-tracking in Cre+ rats, but restored sign-tracking in Cre- rats. Thus, chemogenetic inhibition of NAc D1-MSNs promoted extinction of sign-tracking. Collectively, these data suggest that D1-MSNs play an important role in resistance to extinction that typifies sign-tracking behavior.
Collapse
Affiliation(s)
- Rifka C Derman
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI 48109, USA; Department of Behavioral Neuroscience, Oregon Health and Science University, Portland, OR 97239, USA.
| | - Elizabeth C Bryda
- Rat Resource and Research Center, Animal Modeling Core, Veterinary Pathobiology, University of Missouri, Columbia, MO 65201, USA
| | - Carrie R Ferrario
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI 48109, USA; Department of Pharmacology, Psychology Department, University of Michigan, Ann Arbor, MI 48109, USA
| |
Collapse
|
29
|
Jordan R. The locus coeruleus as a global model failure system. Trends Neurosci 2024; 47:92-105. [PMID: 38102059 DOI: 10.1016/j.tins.2023.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 09/27/2023] [Accepted: 11/20/2023] [Indexed: 12/17/2023]
Abstract
Predictive processing models posit that brains constantly attempt to predict their sensory inputs. Prediction errors signal when these predictions are incorrect and are thought to be instructive signals that drive corrective plasticity. Recent findings support the idea that the locus coeruleus (LC) - a brain-wide neuromodulatory system - signals several types of prediction error. I discuss how these findings support models proposing that the LC signals global model failures: instances where predictions about the world are strongly violated. Focusing on the cortex, I explore the utility of this signal in learning rate control, how the LC circuit may compute the signal, and how this view may aid our understanding of neurodivergence.
Collapse
Affiliation(s)
- Rebecca Jordan
- Simons Initiative for the Developing Brain, University of Edinburgh, 1 George Square, EH8 9JZ, Edinburgh, UK.
| |
Collapse
|
30
|
Amo R. Prediction error in dopamine neurons during associative learning. Neurosci Res 2024; 199:12-20. [PMID: 37451506 DOI: 10.1016/j.neures.2023.07.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 06/18/2023] [Accepted: 07/07/2023] [Indexed: 07/18/2023]
Abstract
Dopamine neurons have long been thought to facilitate learning by broadcasting reward prediction error (RPE), a teaching signal used in machine learning, but more recent work has advanced alternative models of dopamine's computational role. Here, I revisit this critical issue and review new experimental evidences that tighten the link between dopamine activity and RPE. First, I introduce the recent observation of a gradual backward shift of dopamine activity that had eluded researchers for over a decade. I also discuss several other findings, such as dopamine ramping, that were initially interpreted to conflict but later found to be consistent with RPE. These findings improve our understanding of neural computation in dopamine neurons.
Collapse
Affiliation(s)
- Ryunosuke Amo
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard University, Cambridge, MA 02138, USA.
| |
Collapse
|
31
|
Tripp G, Wickens J. Using rodent data to elucidate dopaminergic mechanisms of ADHD: Implications for human personality. PERSONALITY NEUROSCIENCE 2024; 7:e2. [PMID: 38384667 PMCID: PMC10877278 DOI: 10.1017/pen.2023.12] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 10/11/2023] [Accepted: 10/22/2023] [Indexed: 02/23/2024]
Abstract
An altered behavioral response to positive reinforcement has been proposed to be a core deficit in attention deficit hyperactivity disorder (ADHD). The spontaneously hypertensive rat (SHR), a congenic animal strain, displays a similarly altered response to reinforcement. The presence of this genetically determined phenotype in a rodent model allows experimental investigation of underlying neural mechanisms. Behaviorally, the SHR displays increased preference for immediate reinforcement, increased sensitivity to individual instances of reinforcement relative to integrated reinforcement history, and a steeper delay of reinforcement gradient compared to other rat strains. The SHR also shows less development of incentive to approach sensory stimuli, or cues, that predict reward after repeated cue-reward pairing. We consider the underlying neural mechanisms for these characteristics. It is well known that midbrain dopamine neurons are initially activated by unexpected reward and gradually transfer their responses to reward-predicting cues. This finding has inspired the dopamine transfer deficit (DTD) hypothesis, which predicts certain behavioral effects that would arise from a deficient transfer of dopamine responses from actual rewards to reward-predicting cues. We argue that the DTD predicts the altered responses to reinforcement seen in the SHR and individuals with ADHD. These altered responses to reinforcement in turn predict core symptoms of ADHD. We also suggest that variations in the degree of dopamine transfer may underlie variations in personality dimensions related to altered reinforcement sensitivity. In doing so, we highlight the value of rodent models to the study of human personality.
Collapse
Affiliation(s)
- Gail Tripp
- Human Developmental Neurobiology Unit, Okinawa Institute of Science and Technology Graduate University, Okinawa, Japan
| | - Jeff Wickens
- Neurobiology Research Unit, Okinawa Institute of Science and Technology Graduate University, Okinawa, Japan
| |
Collapse
|
32
|
Beas S, Khan I, Gao C, Loewinger G, Macdonald E, Bashford A, Rodriguez-Gonzalez S, Pereira F, Penzo MA. Dissociable encoding of motivated behavior by parallel thalamo-striatal projections. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.07.07.548113. [PMID: 37781624 PMCID: PMC10541145 DOI: 10.1101/2023.07.07.548113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/03/2023]
Abstract
The successful pursuit of goals requires the coordinated execution and termination of actions that lead to positive outcomes. This process is thought to rely on motivational states that are guided by internal drivers, such as hunger or fear. However, the mechanisms by which the brain tracks motivational states to shape instrumental actions are not fully understood. The paraventricular nucleus of the thalamus (PVT) is a midline thalamic nucleus that shapes motivated behaviors via its projections to the nucleus accumbens (NAc)1-8 and monitors internal state via interoceptive inputs from the hypothalamus and brainstem3,9-14. Recent studies indicate that the PVT can be subdivided into two major neuronal subpopulations, namely PVTD2(+) and PVTD2(-), which differ in genetic identity, functionality, and anatomical connectivity to other brain regions, including the NAc4,15,16. In this study, we used fiber photometry to investigate the in vivo dynamics of these two distinct PVT neuronal types in mice performing a reward foraging-like behavioral task. We discovered that PVTD2(+) and PVTD2(-) neurons encode the execution and termination of goal-oriented actions, respectively. Furthermore, activity in the PVTD2(+) neuronal population mirrored motivation parameters such as vigor and satiety. Similarly, PVTD2(-) neurons, also mirrored some of these parameters but to a much lesser extent. Importantly, these features were largely preserved when activity in PVT projections to the NAc was selectively assessed. Collectively, our results highlight the existence of two parallel thalamo-striatal projections that participate in the dynamic regulation of goal pursuits and provide insight into the mechanisms by which the brain tracks motivational states to shape instrumental actions.
Collapse
Affiliation(s)
- Sofia Beas
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, Bethesda, MD, USA
- Department of Neurobiology, University of Alabama at Birmingham, Birmingham, AL, USA
| | - Isbah Khan
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, Bethesda, MD, USA
| | - Claire Gao
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, Bethesda, MD, USA
| | - Gabriel Loewinger
- Machine Learning Team, National Institute of Mental Health, Bethesda, MD, USA
| | - Emma Macdonald
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, Bethesda, MD, USA
| | - Alison Bashford
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, Bethesda, MD, USA
| | | | - Francisco Pereira
- Machine Learning Team, National Institute of Mental Health, Bethesda, MD, USA
| | - Mario A. Penzo
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, Bethesda, MD, USA
| |
Collapse
|
33
|
Sandberg SG, Sanford CA, Phillips PEM. Substantial decline of phasic dopamine signaling in senescent male rats does not impact dopamine-dependent Pavlovian conditioning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.21.572806. [PMID: 38187581 PMCID: PMC10769384 DOI: 10.1101/2023.12.21.572806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2024]
Abstract
Normal aging is associated with cognitive decline which impacts financial decision making. One of the underlying features of decision making is probability estimation, in which nucleus accumbens dopamine signaling has been implicated. Here we used fast-scan cyclic voltammetry to probe for age differences in dopamine signaling, and pharmacological manipulation to test for age differences in the dopamine dependence of Pavlovian conditioning. We found differences in phasic dopamine signaling to reward delivery, and unconditioned and conditioned stimuli, but no difference in conditioned approach between adult and senescent groups. In addition, we found that dopamine receptor antagonism with flupenthixol (225 μg/kg, i.p.) partially inhibited conditioned approach in the adult group, whereas it completely blocked conditioned approach in the senescent group. Further increase in concentration to 300 μg/kg, i.p. resulted in complete inhibition of conditioned approach behavior in both age groups. Therefore, while phasic dopamine signaling in the nucleus accumbens of senescent animals is greatly diminished in concentration, these animals maintain dopamine dependent Pavlovian conditioning.
Collapse
Affiliation(s)
- Stefan G. Sandberg
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA 98195, USA
- Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA 98195, USA
| | - Christina A. Sanford
- Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA 98195, USA
| | - Paul E. M. Phillips
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA 98195, USA
- Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA 98195, USA
- Department of Pharmacology, University of Washington, Seattle, WA 98195, USA
| |
Collapse
|
34
|
Farero RD, Holtz NA, Lee SJ, Kruse LC, Clark JJ, Phillips PEM. Levodopa reduces consumption of multiple classes of addictive substances in rats. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.14.570833. [PMID: 38168240 PMCID: PMC10760127 DOI: 10.1101/2023.12.14.570833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2024]
Abstract
Dopamine transmission is implicated in aberrant behaviors associated with substance use disorders. Previous research revealed a causal link between excessive drug consumption and the loss of dopamine signaling to stimuli associated with psychostimulant use. The emerging change in dopamine signaling is specific to stimuli associated with the substance rather than the pharmacological properties of the drug itself. Because the change in dopamine signaling was specific to the associated stimuli and not the pharmacological properties of the substance, we examined if treatment with the dopamine precursor, l-DOPA, alters alcohol and opioid self-administration. Therefore, we trained rats to orally self-administer ethanol or the synthetic opioid fentanyl and found that treating animals with l-DOPA significantly reduced consumption of both alcohol and fentanyl. These data suggest dopamine signaling has a vital role in mediating the amount of drug animals will voluntarily take, across multiple classes of drugs. Importantly, these data are preclinical demonstrations of l-DOPA being utilized as a harm reducing treatment in substance use disorders.
Collapse
Affiliation(s)
- Ryan D. Farero
- Graduate Program in Neuroscience, University of Washington, Seattle, WA 98195
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA 98195
- Department of Psychiatry & Behavioral Science, University of Washington, Seattle, WA 98195
| | - Nathan A. Holtz
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA 98195
- Department of Psychiatry & Behavioral Science, University of Washington, Seattle, WA 98195
| | - Suhjung J. Lee
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA 98195
- Department of Psychiatry & Behavioral Science, University of Washington, Seattle, WA 98195
| | - Lauren C. Kruse
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA 98195
- Department of Psychiatry & Behavioral Science, University of Washington, Seattle, WA 98195
| | - Jeremy J. Clark
- Graduate Program in Neuroscience, University of Washington, Seattle, WA 98195
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA 98195
- Department of Psychiatry & Behavioral Science, University of Washington, Seattle, WA 98195
| | - Paul E. M. Phillips
- Graduate Program in Neuroscience, University of Washington, Seattle, WA 98195
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA 98195
- Department of Psychiatry & Behavioral Science, University of Washington, Seattle, WA 98195
- Department of Pharmacology, University of Washington, Seattle, WA 98195
| |
Collapse
|
35
|
Fraser KM, Collins VL, Wolff AR, Ottenheimer DJ, Bornhoft KN, Pat F, Chen BJ, Janak PH, Saunders BT. Contexts facilitate dynamic value encoding in the mesolimbic dopamine system. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.05.565687. [PMID: 37961363 PMCID: PMC10635154 DOI: 10.1101/2023.11.05.565687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Adaptive behavior in a dynamic environment often requires rapid revaluation of stimuli that deviates from well-learned associations. The divergence between stable value-encoding and appropriate behavioral output remains a critical test to theories of dopamine's function in learning, motivation, and motor control. Yet how dopamine neurons are involved in the revaluation of cues when the world changes to alter our behavior remains unclear. Here we make use of pharmacology, in vivo electrophysiology, fiber photometry, and optogenetics to resolve the contributions of the mesolimbic dopamine system to the dynamic reorganization of reward-seeking. Male and female rats were trained to discriminate when a conditioned stimulus would be followed by sucrose reward by exploiting the prior, non-overlapping presentation of a separate discrete cue - an occasion setter. Only when the occasion setter's presentation preceded the conditioned stimulus did the conditioned stimulus predict sucrose delivery. As a result, in this task we were able to dissociate the average value of the conditioned stimulus from its immediate expected value on a trial-to-trial basis. Both the activity of ventral tegmental area dopamine neurons and dopamine signaling in the nucleus accumbens were essential for rats to successfully update behavioral responding in response to the occasion setter. Moreover, dopamine release in the nucleus accumbens following the conditioned stimulus only occurred when the occasion setter indicated it would predict reward. Downstream of dopamine release, we found that single neurons in the nucleus accumbens dynamically tracked the value of the conditioned stimulus. Together these results reveal a novel mechanism within the mesolimbic dopamine system for the rapid revaluation of motivation.
Collapse
Affiliation(s)
- Kurt M Fraser
- Department of Psychological and Brain Sciences, Johns Hopkins University
| | | | - Amy R Wolff
- Department of Neuroscience, University of Minnesota
| | | | | | - Fiona Pat
- Department of Psychological and Brain Sciences, Johns Hopkins University
| | - Bridget J Chen
- Department of Psychological and Brain Sciences, Johns Hopkins University
| | - Patricia H Janak
- Department of Psychological and Brain Sciences, Johns Hopkins University
- The Solomon H. Snyder Department of Neuroscience, Johns Hopkins University
| | - Benjamin T Saunders
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| |
Collapse
|
36
|
Iglesias AG, Chiu AS, Wong J, Campus P, Li F, Liu ZN, Bhatti JK, Patel SA, Deisseroth K, Akil H, Burgess CR, Flagel SB. Inhibition of Dopamine Neurons Prevents Incentive Value Encoding of a Reward Cue: With Revelations from Deep Phenotyping. J Neurosci 2023; 43:7376-7392. [PMID: 37709540 PMCID: PMC10621773 DOI: 10.1523/jneurosci.0848-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 08/08/2023] [Accepted: 09/08/2023] [Indexed: 09/16/2023] Open
Abstract
The survival of an organism is dependent on its ability to respond to cues in the environment. Such cues can attain control over behavior as a function of the value ascribed to them. Some individuals have an inherent tendency to attribute reward-paired cues with incentive motivational value, or incentive salience. For these individuals, termed sign-trackers, a discrete cue that precedes reward delivery becomes attractive and desirable in its own right. Prior work suggests that the behavior of sign-trackers is dopamine-dependent, and cue-elicited dopamine in the NAc is believed to encode the incentive value of reward cues. Here we exploited the temporal resolution of optogenetics to determine whether selective inhibition of ventral tegmental area (VTA) dopamine neurons during cue presentation attenuates the propensity to sign-track. Using male tyrosine hydroxylase (TH)-Cre Long Evans rats, it was found that, under baseline conditions, ∼84% of TH-Cre rats tend to sign-track. Laser-induced inhibition of VTA dopamine neurons during cue presentation prevented the development of sign-tracking behavior, without affecting goal-tracking behavior. When laser inhibition was terminated, these same rats developed a sign-tracking response. Video analysis using DeepLabCutTM revealed that, relative to rats that received laser inhibition, rats in the control group spent more time near the location of the reward cue even when it was not present and were more likely to orient toward and approach the cue during its presentation. These findings demonstrate that cue-elicited dopamine release is critical for the attribution of incentive salience to reward cues.SIGNIFICANCE STATEMENT Activity of dopamine neurons in the ventral tegmental area (VTA) during cue presentation is necessary for the development of a sign-tracking, but not a goal-tracking, conditioned response in a Pavlovian task. We capitalized on the temporal precision of optogenetics to pair cue presentation with inhibition of VTA dopamine neurons. A detailed behavioral analysis with DeepLabCutTM revealed that cue-directed behaviors do not emerge without dopamine neuron activity in the VTA. Importantly, however, when optogenetic inhibition is lifted, cue-directed behaviors increase, and a sign-tracking response develops. These findings confirm the necessity of dopamine neuron activity in the VTA during cue presentation to encode the incentive value of reward cues.
Collapse
Affiliation(s)
- Amanda G Iglesias
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, Michigan 48104
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
| | - Alvin S Chiu
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, Michigan 48104
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
| | - Jason Wong
- College of Literature, Science, and the Arts, University of Michigan, Ann Arbor, Michigan 48104
| | - Paolo Campus
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
| | - Fei Li
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
| | - Zitong Nemo Liu
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
| | - Jasmine K Bhatti
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
| | - Shiv A Patel
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
| | - Karl Deisseroth
- Department of Bioengineering, Stanford University, Stanford, California 94305
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California 94305
- Howard Hughes Medical Institute, Stanford University, Stanford, California 94305
| | - Huda Akil
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
- Department of Psychiatry, University of Michigan, Ann Arbor, Michigan 48104
| | - Christian R Burgess
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
| | - Shelly B Flagel
- Michigan Neuroscience Institute, University of Michigan, Ann Arbor, Michigan 48104
- Department of Psychiatry, University of Michigan, Ann Arbor, Michigan 48104
| |
Collapse
|
37
|
Grizzell JA, Vanbaelinghem M, Westerman J, Saddoris MP. Voluntary alcohol consumption during distinct phases of adolescence differentially alters adult fear acquisition, extinction and renewal in male and female rats. Stress 2023; 26:2278315. [PMID: 37916300 PMCID: PMC11042498 DOI: 10.1080/10253890.2023.2278315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 10/25/2023] [Indexed: 11/03/2023] Open
Abstract
Alcohol use during adolescence coincides with elevated risks of stress-related impairment in adults, particularly via disrupted developmental trajectories of vulnerable corticolimbic and mesolimbic systems involved in fear processing. Prior work has investigated the impact of binge-like alcohol consumption on adult fear and stress, but less is known about whether voluntarily consumed alcohol imparts differential effects based on adolescence phases and biological sex. Here, adolescent male and female Long Evans rats were granted daily access to alcohol (15%) during either early (Early-EtOH; P25-45) or late adolescence (Late-EtOH; P45-55) using a modified drinking-in-the-dark design. Upon adulthood (P75-80), rats were exposed to a three-context (ABC) fear renewal procedure. We found that male and female Early-EtOH rats showed faster acquisition of fear but less freezing during early phases of extinction and throughout fear renewal. In the extinction period specifically, Early-EtOH rats showed normal levels of freezing in the presence of fear-associated cues, but abnormally low freezing immediately after cue offset, suggesting a key disruption in contextual processing and/or novelty seeking brought by early adolescent binge consumption. While the effects of alcohol were most pronounced in the Early-EtOH rats (particularly in females), Late-EtOH rats displayed some changes in fear behavior including slower fear acquisition, faster extinction, and reduced renewal compared with controls, but primarily in males. Our results suggest that early adolescence in males and females and, to a lesser extent, late adolescence in males is a particularly vulnerable period wherein alcohol use can promote stress-related dysfunction in adulthood. Furthermore, our results provide multiple bases for future research focused on developmental correlates of alcohol mediated disruption in the brain.
Collapse
Affiliation(s)
- J Alex Grizzell
- Dept Psychology & Neuroscience, University of Colorado Boulder, Boulder CO, 80301
- Dept of Neuroscience and Behavioral Biology, Emory University, Atlanta GA 30322
| | - Maryam Vanbaelinghem
- Dept Psychology & Neuroscience, University of Colorado Boulder, Boulder CO, 80301
| | - Jessica Westerman
- Dept Psychology & Neuroscience, University of Colorado Boulder, Boulder CO, 80301
| | - Michael P Saddoris
- Dept Psychology & Neuroscience, University of Colorado Boulder, Boulder CO, 80301
| |
Collapse
|
38
|
Fleury S, Kolaric R, Espera J, Ha Q, Tomaio J, Gether U, Sørensen AT, Mingote S. Role of Dopamine Neurons in Familiarity. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.25.564006. [PMID: 37961265 PMCID: PMC10634822 DOI: 10.1101/2023.10.25.564006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Dopamine neurons signal the salience of environmental stimuli, influencing learning and motivation. However, research has not yet identified whether dopamine neurons also modulate the salience of memory content. Dopamine neuron activity in the ventral tegmental area (VTA) increases in response to novel objects and diminishes as objects become familiar through repeated presentations. We proposed that the declined rate of dopamine neuron activity during familiarization affects the salience of a familiar object's memory. This, in turn, influences the degree to which an animal distinguishes between familiar and novel objects in a subsequent novel object recognition (NOR) test. As such, a single familiarization session may not sufficiently reduce dopamine activity, allowing the memory of a familiar object to maintain its salience and potentially attenuating NOR. In contrast, multiple familiarization sessions could lead to more pronounced dopamine activity suppression, strengthening NOR. Our data in mice reveals that, compared to a single session, multiple sessions result in decreased VTA dopamine neuron activation, as indicated by c-Fos measurements, and enhanced novelty discrimination. Critically, when VTA dopamine neurons are chemogenetically inhibited during a single familiarization session, NOR improves, mirroring the effects of multiple familiarization sessions. In summary, our findings highlight the pivotal function of dopamine neurons in familiarity and suggest a role in modulating the salience of memory content.
Collapse
Affiliation(s)
- Sixtine Fleury
- The Advanced Science Research Center, City University of New York, New York, NY 10031, USA
| | - Rhonda Kolaric
- The Advanced Science Research Center, City University of New York, New York, NY 10031, USA
| | - Justin Espera
- The Advanced Science Research Center, City University of New York, New York, NY 10031, USA
| | - Quan Ha
- The Advanced Science Research Center, City University of New York, New York, NY 10031, USA
| | - Jacquelyn Tomaio
- The Advanced Science Research Center, City University of New York, New York, NY 10031, USA
| | - Ulrik Gether
- Molecular Neuropharmacology and Genetics Laboratory, Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, DK-2200 Copenhagen, Denmark
| | - Andreas Toft Sørensen
- Molecular Neuropharmacology and Genetics Laboratory, Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, DK-2200 Copenhagen, Denmark
| | - Susana Mingote
- The Advanced Science Research Center, City University of New York, New York, NY 10031, USA
| |
Collapse
|
39
|
Navarro VM, Dwyer DM, Honey RC. Prediction error in models of adaptive behavior. Curr Biol 2023; 33:4238-4243.e3. [PMID: 37708886 DOI: 10.1016/j.cub.2023.08.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 07/19/2023] [Accepted: 08/15/2023] [Indexed: 09/16/2023]
Abstract
Pavlovian conditioning is evident in every species in which it has been assessed, and there is a consensus about its interpretation across behavioral,1,2 brain,3,4,5,6 and computational analyses7,8,9,10,11: conditioned behavior reflects the formation of a directional associative link from the memory of one stimulus (e.g., a visual stimulus) to another (e.g., food), with learning stopping when there is no error between the prediction generated by the visual stimulus and what happens next (e.g., food). This consensus fails to anticipate the results that we report here. In our experiments with rats, we find that arranging predictive (visual stimulus→food) and nonpredictive (food→visual stimulus) relationships produces marked and sustained changes in conditioned behaviors when the visual stimulus is presented alone. Moreover, the type of relationship affects (1) the distribution of conditioned behaviors related to the properties of both food (called goal-tracking) and the visual stimulus (called sign-tracking) and (2) when in the visual stimulus, these two behaviors are evident. These results represent an impetus for a fundamental shift in how Pavlovian conditioning is interpreted: animals learn about the relationship between two stimuli irrespective of the order in which they are presented, but they exhibit this knowledge in different ways. This interpretation and our new results are captured by a recent model of Pavlovian conditioning,12,13 HeiDI, and both are consistent with the need for animals to represent the fact that the impact of a cause (e.g., the ingestion of nutrients or the bite of a predator) can be felt before or after the cause has been perceived.
Collapse
Affiliation(s)
- Victor M Navarro
- School of Psychology, Cardiff University, 70 Park Place, CF10 3AT Cardiff, UK
| | - Dominic M Dwyer
- School of Psychology, Cardiff University, 70 Park Place, CF10 3AT Cardiff, UK
| | - Robert C Honey
- School of Psychology, Cardiff University, 70 Park Place, CF10 3AT Cardiff, UK.
| |
Collapse
|
40
|
Alex Grizzell J, Vanbaelinghem M, Westerman J, Saddoris MP. Voluntary alcohol consumption during distinct phases of adolescence differentially alters adult fear acquisition, extinction and renewal in male and female rats. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.03.560757. [PMID: 37873067 PMCID: PMC10592894 DOI: 10.1101/2023.10.03.560757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
Alcohol use during adolescence coincides with elevated risks of stress-related impairment in adults, particularly via disrupted developmental trajectories of vulnerable corticolimbic and mesolimbic systems involved in fear processing. Prior work has investigated the impact of binge-like alcohol consumption on adult fear and stress, but less is known about whether voluntarily consumed alcohol imparts differential effects based on adolescence phases and biological sex. Here, adolescent male and female Long Evans rats were granted daily access to alcohol (15%) during either early (Early-EtOH; P25-45) or late adolescence (Late-EtOH; P45-55) using a modified drinking-in-the-dark design. Upon adulthood (P75-80), rats were exposed to a three-context (ABC) fear renewal procedure. We found that male and female Early-EtOH rats showed faster acquisition of fear but less freezing during early phases of extinction and throughout fear renewal. In the extinction period specifically, Early-EtOH rats showed normal levels of freezing in the presence of fear-associated cues, but abnormally low freezing immediately after cue offset, suggesting a key disruption in contextual processing and/or novelty seeking brought by early adolescent binge consumption. While the effects of alcohol were most pronounced in the Early-EtOH rats (particularly in females), Late-EtOH rats displayed some changes in fear behavior including slower fear acquisition, faster extinction, and reduced renewal compared with controls, but primarily in males. Our results suggest that early adolescence in males and females and, to a lesser extent, late adolescence in males is a particularly vulnerable period wherein alcohol use can promote stress-related dysfunction in adulthood. Furthermore, our results provide multiple bases for future research focused on developmental correlates of alcohol mediated disruption in the brain.
Collapse
Affiliation(s)
- J Alex Grizzell
- Dept Psychology & Neuroscience, University of Colorado Boulder, Boulder CO, 80301
- Dept of Neuroscience and Behavioral Biology, Emory University, Atlanta GA 30322
| | - Maryam Vanbaelinghem
- Dept Psychology & Neuroscience, University of Colorado Boulder, Boulder CO, 80301
| | - Jessica Westerman
- Dept Psychology & Neuroscience, University of Colorado Boulder, Boulder CO, 80301
| | - Michael P Saddoris
- Dept Psychology & Neuroscience, University of Colorado Boulder, Boulder CO, 80301
| |
Collapse
|
41
|
Berridge KC. Separating desire from prediction of outcome value. Trends Cogn Sci 2023; 27:932-946. [PMID: 37543439 PMCID: PMC10527990 DOI: 10.1016/j.tics.2023.07.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 07/10/2023] [Accepted: 07/14/2023] [Indexed: 08/07/2023]
Abstract
Individuals typically want what they expect to like, often based on memories of previous positive experiences. However, in some situations desire can decouple completely from memories and from learned predictions of outcome value. The potential for desire to separate from prediction arises from independent operating rules that control motivational incentive salience. Incentive salience, or 'wanting', is a type of mesolimbic desire that evolved for adaptive goals, but can also generate maladaptive addictions. Two proof-of-principle examples are presented here to show how motivational 'wanting' can soar above memory-based predictions of outcome value: (i) 'wanting what is remembered to be disgusting', and (ii) 'wanting what is predicted to hurt'. Consequently, even outcomes remembered and predicted to be negatively aversive can become positively 'wanted'. Similarly, in human addictions, people may experience powerful cue-triggered cravings for outcomes that are not predicted to be enjoyable.
Collapse
Affiliation(s)
- Kent C Berridge
- Department of Psychology, University of Michigan, Ann Arbor, MI 48109, USA.
| |
Collapse
|
42
|
Lloyd K, Dayan P. Reframing dopamine: A controlled controller at the limbic-motor interface. PLoS Comput Biol 2023; 19:e1011569. [PMID: 37847681 PMCID: PMC10610519 DOI: 10.1371/journal.pcbi.1011569] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 10/27/2023] [Accepted: 10/03/2023] [Indexed: 10/19/2023] Open
Abstract
Pavlovian influences notoriously interfere with operant behaviour. Evidence suggests this interference sometimes coincides with the release of the neuromodulator dopamine in the nucleus accumbens. Suppressing such interference is one of the targets of cognitive control. Here, using the examples of active avoidance and omission behaviour, we examine the possibility that direct manipulation of the dopamine signal is an instrument of control itself. In particular, when instrumental and Pavlovian influences come into conflict, dopamine levels might be affected by the controlled deployment of a reframing mechanism that recasts the prospect of possible punishment as an opportunity to approach safety, and the prospect of future reward in terms of a possible loss of that reward. We operationalize this reframing mechanism and fit the resulting model to rodent behaviour from two paradigmatic experiments in which accumbens dopamine release was also measured. We show that in addition to matching animals' behaviour, the model predicts dopamine transients that capture some key features of observed dopamine release at the time of discriminative cues, supporting the idea that modulation of this neuromodulator is amongst the repertoire of cognitive control strategies.
Collapse
Affiliation(s)
- Kevin Lloyd
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Peter Dayan
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- University of Tübingen, Tübingen, Germany
| |
Collapse
|
43
|
Duffer K, Gillis ZS, Morrison SE. Excitatory and Inhibitory Signaling in the Nucleus Accumbens Encode Different Aspects of a Pavlovian Cue in Sign Tracking and Goal Tracking Rats. eNeuro 2023; 10:ENEURO.0196-23.2023. [PMID: 37643864 PMCID: PMC10488220 DOI: 10.1523/eneuro.0196-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 07/26/2023] [Accepted: 08/08/2023] [Indexed: 08/31/2023] Open
Abstract
When a Pavlovian cue is presented separately from its associated reward, some animals will acquire a sign tracking (ST) response - approach and/or interaction with the cue - while others will acquire a goal tracking response - approach to the site of reward. We have previously shown that cue-evoked excitations in the nucleus accumbens (NAc) encode the vigor of both behaviors; in contrast, reward-related responses diverge over the course of training, possibly reflecting neurochemical differences between sign tracker and goal tracker individuals. However, a substantial subset of neurons in the NAc exhibit inhibitory, rather than excitatory, cue-evoked responses, and the evolution of their signaling during Pavlovian conditioning remains unknown. Using single-neuron recordings in behaving rats, we show that NAc neurons with cue-evoked inhibitions have distinct coding properties from neurons with cue-evoked excitations. Cue-evoked inhibitions become more numerous over the course of training and, like excitations, may encode the vigor of sign tracking and goal tracking behavior. However, the responses of cue-inhibited neurons do not evolve differently between sign tracker and goal tracker individuals. Moreover, cue-evoked inhibitions, unlike excitations, are insensitive to extinction of the cue-reward relationship. Finally, we show that cue-evoked excitations are greatly diminished by reward devaluation, while inhibitory cue responses are virtually unaffected. Overall, these findings converge with existing evidence that cue-excited neurons in NAc, but not cue-inhibited neurons, are profoundly sensitive to the same behavior variations that are often associated with changes in dopamine release.
Collapse
Affiliation(s)
- Kyle Duffer
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA 15260
| | - Zachary S Gillis
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA 15260
| | - Sara E Morrison
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA 15260
| |
Collapse
|
44
|
Singh G, Campbell EM, Hogeveen J, Witkiewitz K, Claus ED, Cavanagh JF. Affective imagery boosts the reward related delta power in hazardous drinkers. Psychiatry Res Neuroimaging 2023; 334:111685. [PMID: 37506424 PMCID: PMC10574688 DOI: 10.1016/j.pscychresns.2023.111685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 06/09/2023] [Accepted: 07/10/2023] [Indexed: 07/30/2023]
Abstract
The Reward Positivity (RewP) is an event-related potential component with a delta band spectral representation that is elicited by reward receipt. Evidence suggests that RewP is modulated by both reward probability as well as affective valuation ("liking"). Here we determined whether RewP is a marker of enhanced hedonic salience of alcohol images in hazardous drinkers. We recruited 54 participants (Hazardous Drinkers = 28, Control = 26) who completed a reinforcement learning task with affective versus alcohol imagery during feedback. The learning task used images of puppies vs. alcohol paired with reinforcing feedback. Both groups rated categories of affective images (puppies, scenery, babies, neutral) similarly, but the hazardous drinking group rated alcohol significantly higher. There were no group differences in performance or in RewP amplitudes, even as a function of alcohol imagery. Contrary to prior findings, we did not observe a significant correlation between alcohol image rating and alcohol-specific RewP amplitude, although we did observe this relationship with the alcohol-specific delta band spectral representation of RewP. Within hazardous drinking group, there was significant correlation between hazardous drinking (AUDIT score) and alcohol-specific RewP indicating an inter-individual influence of drinking habits on affect specific RewP. These findings suggest a domain-specific enhancement of reward responsiveness in hazardous drinkers.
Collapse
Affiliation(s)
- Garima Singh
- The University of New Mexico, Albuquerque, NM, United States of America.
| | - Ethan M Campbell
- The University of New Mexico, Albuquerque, NM, United States of America
| | - Jeremy Hogeveen
- The University of New Mexico, Albuquerque, NM, United States of America
| | - Katie Witkiewitz
- The University of New Mexico, Albuquerque, NM, United States of America
| | - Eric D Claus
- Mind Research Network, Albuquerque, New Mexico and The Pennsylvania State University, University Park, Pennsylvania, United States of America
| | - James F Cavanagh
- The University of New Mexico, Albuquerque, NM, United States of America
| |
Collapse
|
45
|
Gibney KD, Kypriotakis G, Versace F. Individual differences in late positive potential amplitude and theta power predict cue-induced eating. ADDICTION NEUROSCIENCE 2023; 7:100106. [PMID: 37711965 PMCID: PMC10501046 DOI: 10.1016/j.addicn.2023.100106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 09/16/2023]
Abstract
Cue-induced reward-seeking behaviors are regulated by both the affective and cognitive control systems of the brain. This study aimed at investigating how individual differences in affective and cognitive responses to cues predicting food rewards contribute to the regulation of cue-induced eating. We recorded electroencephalogram (EEG) from 59 adults while they viewed emotional and food-related images that preceded the delivery of food rewards (candies) or non-food objects (beads). We measured the amplitude of the late positive potential (LPP) in response to a variety of motivationally relevant images and power in the theta (4-8 Hz) frequency band after candies or beads were dispensed to the participants. We found that individuals with larger LPP responses to food images than to pleasant images (C>P group) ate significantly more during the experiment than those with the opposite response pattern (P>C group, p < 0.001). Furthermore, we found that individuals with higher theta power after dispensation of the candy than of the bead (θCA>θBE) ate significantly more than those with the opposite response pattern (θBE>θCA, p < 0.001). Finally, we found that the crossed P>C and θBE>θCA group ate less (p < 0.001) than did the other three groups formed by crossing the LPP and theta group assignments, who exhibited similar eating behavior on average (p = 0.662). These findings demonstrate that individual differences in both affective and cognitive responses to reward-related cues underlie vulnerability to cue-induced behaviors, underscoring the need for individualized treatments to mitigate maladaptive behaviors.
Collapse
Affiliation(s)
- Kyla D. Gibney
- Neuroscience Graduate Program MD Anderson UTHealth Graduate School of Biomedical Sciences, Houston, TX, United States
- Department of Behavioral Science, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - George Kypriotakis
- Department of Behavioral Science, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Francesco Versace
- Neuroscience Graduate Program MD Anderson UTHealth Graduate School of Biomedical Sciences, Houston, TX, United States
- Department of Behavioral Science, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| |
Collapse
|
46
|
Zhang T, Cheng X, Jia S, Li CT, Poo MM, Xu B. A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost. SCIENCE ADVANCES 2023; 9:eadi2947. [PMID: 37624895 PMCID: PMC10456855 DOI: 10.1126/sciadv.adi2947] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Accepted: 07/27/2023] [Indexed: 08/27/2023]
Abstract
Neuromodulators in the brain act globally at many forms of synaptic plasticity, represented as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking artificial neural networks (ANNs). Here, we report an efficient brain-inspired computing algorithm for SNNs and ANNs, referred to here as neuromodulation-assisted credit assignment (NACA), which uses expectation signals to induce defined levels of neuromodulators to selective synapses, whereby the long-term synaptic potentiation and depression are modified in a nonlinear manner depending on the neuromodulator level. The NACA algorithm achieved high recognition accuracy with substantially reduced computational cost in learning spatial and temporal classification tasks. Notably, NACA was also verified as efficient for learning five different class continuous learning tasks with varying degrees of complexity, exhibiting a markedly mitigated catastrophic forgetting at low computational cost. Mapping synaptic weight changes showed that these benefits could be explained by the sparse and targeted synaptic modifications attributed to expectation-based global neuromodulation.
Collapse
Affiliation(s)
- Tielin Zhang
- Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
- Shanghai Center for Brain Science and Brain-inspired Technology, Lingang Laboratory, Shanghai 200031, China
| | - Xiang Cheng
- Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Shuncheng Jia
- Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Chengyu T Li
- Shanghai Center for Brain Science and Brain-inspired Technology, Lingang Laboratory, Shanghai 200031, China
- Center for Excellence in Brain Science and Intelligence Technology, Institute of Neuroscience, Chinese Academy of Sciences, Shanghai 200031, China
| | - Mu-ming Poo
- Shanghai Center for Brain Science and Brain-inspired Technology, Lingang Laboratory, Shanghai 200031, China
- Center for Excellence in Brain Science and Intelligence Technology, Institute of Neuroscience, Chinese Academy of Sciences, Shanghai 200031, China
| | - Bo Xu
- Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
47
|
Townsend ES, Amaya KA, Smedley EB, Smith KS. Nucleus accumbens core acetylcholine receptors modulate the balance of flexible and inflexible cue-directed motivation. Sci Rep 2023; 13:13375. [PMID: 37591961 PMCID: PMC10435540 DOI: 10.1038/s41598-023-40439-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 08/10/2023] [Indexed: 08/19/2023] Open
Abstract
Sign-tracking is a conditioned response where animals interact with reward-predictive cues due to the cues having motivational value, or incentive salience. The nucleus accumbens core (NAc) has been implicated in mediating the sign-tracking response. Additionally, acetylcholine (ACh) transmission throughout the striatum has been attributed to both incentive motivation and behavioral flexibility. Here, we demonstrate a role for NAc ACh receptors in the flexibility of sign-tracking. Sign-tracking animals were exposed to an omission contingency, in which vigorous sign-tracking was punished by reward omission. Animals rapidly adjusted their behavior, but they maintained sign-tracking in a less vigorous manner that did not cancel reward. Within this context of sign-tracking being persistent yet flexible in structure, blockade of NAc nicotinic receptors (nAChRs) led to a persistence in the initial sign-tracking response during omission followed by a period of change in the makeup of sign-tracking, whereas blockade of muscarinic receptors (mAChRs) oppositely enhanced the omission-related development of the new sign-tracking behaviors. Later, once omission learning had occurred, nAChR blockade uniquely led to reduced sign-tracking and elevated reward-directed behaviors instead. These results indicate that NAc ACh receptors have opposing roles in maintaining learned patterns of sign-tracking, with nAChRs having a special involvement in regulating the structure of the sign-tracking response.
Collapse
Affiliation(s)
- Erica S Townsend
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH, 03755, USA.
| | - Kenneth A Amaya
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH, 03755, USA
- Department of Neuroscience, Tufts University School of Medicine, Boston, MA, USA
| | - Elizabeth B Smedley
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH, 03755, USA
- Department of Psychology, Temple University, Philadelphia, PA, USA
| | - Kyle S Smith
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH, 03755, USA
| |
Collapse
|
48
|
Hanssen R, Rigoux L, Kuzmanovic B, Iglesias S, Kretschmer AC, Schlamann M, Albus K, Edwin Thanarajah S, Sitnikow T, Melzer C, Cornely OA, Brüning JC, Tittgemeyer M. Liraglutide restores impaired associative learning in individuals with obesity. Nat Metab 2023; 5:1352-1363. [PMID: 37592007 PMCID: PMC10447249 DOI: 10.1038/s42255-023-00859-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 07/07/2023] [Indexed: 08/19/2023]
Abstract
Survival under selective pressure is driven by the ability of our brain to use sensory information to our advantage to control physiological needs. To that end, neural circuits receive and integrate external environmental cues and internal metabolic signals to form learned sensory associations, consequently motivating and adapting our behaviour. The dopaminergic midbrain plays a crucial role in learning adaptive behaviour and is particularly sensitive to peripheral metabolic signals, including intestinal peptides, such as glucagon-like peptide 1 (GLP-1). In a single-blinded, randomized, controlled, crossover basic human functional magnetic resonance imaging study relying on a computational model of the adaptive learning process underlying behavioural responses, we show that adaptive learning is reduced when metabolic sensing is impaired in obesity, as indexed by reduced insulin sensitivity (participants: N = 30 with normal insulin sensitivity; N = 24 with impaired insulin sensitivity). Treatment with the GLP-1 receptor agonist liraglutide normalizes impaired learning of sensory associations in men and women with obesity. Collectively, our findings reveal that GLP-1 receptor activation modulates associative learning in people with obesity via its central effects within the mesoaccumbens pathway. These findings provide evidence for how metabolic signals can act as neuromodulators to adapt our behaviour to our body's internal state and how GLP-1 receptor agonists work in clinics.
Collapse
Affiliation(s)
- Ruth Hanssen
- Max Planck Institute for Metabolism Research, Cologne, Germany
- Faculty of Medicine and University Hospital Cologne, Policlinic for Endocrinology, Diabetology and Preventive Medicine (PEPD), University of Cologne, Cologne, Germany
| | - Lionel Rigoux
- Max Planck Institute for Metabolism Research, Cologne, Germany
| | | | - Sandra Iglesias
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich and Swiss Federal Institute of Technology, Zurich, Switzerland
| | - Alina C Kretschmer
- Faculty of Medicine and University Hospital Cologne, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf (CIO ABCD) and Excellence Center for Medical Mycology (ECMM), University of Cologne, Cologne, Germany
| | - Marc Schlamann
- Faculty of Medicine and University Hospital Cologne, Institute for Diagnostic and Interventional Radiology, University of Cologne, Cologne, Germany
| | - Kerstin Albus
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany
| | - Sharmili Edwin Thanarajah
- Max Planck Institute for Metabolism Research, Cologne, Germany
- Department of Psychiatry, Psychosomatic Medicine and Psychotherapy, University Hospital Frankfurt, Frankfurt am Main, Germany
| | - Tamara Sitnikow
- Faculty of Medicine and University Hospital Cologne, Policlinic for Endocrinology, Diabetology and Preventive Medicine (PEPD), University of Cologne, Cologne, Germany
| | - Corina Melzer
- Max Planck Institute for Metabolism Research, Cologne, Germany
| | - Oliver A Cornely
- Faculty of Medicine and University Hospital Cologne, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf (CIO ABCD) and Excellence Center for Medical Mycology (ECMM), University of Cologne, Cologne, Germany
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany
- German Centre for Infection Research (DZIF), Partner Site Bonn-Cologne, Cologne, Germany
- Faculty of Medicine and University Hospital Cologne, Clinical Trials Centre Cologne (ZKS Köln), University of Cologne, Cologne, Germany
| | - Jens C Brüning
- Max Planck Institute for Metabolism Research, Cologne, Germany
- Faculty of Medicine and University Hospital Cologne, Policlinic for Endocrinology, Diabetology and Preventive Medicine (PEPD), University of Cologne, Cologne, Germany
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany
| | - Marc Tittgemeyer
- Max Planck Institute for Metabolism Research, Cologne, Germany.
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany.
| |
Collapse
|
49
|
Suri D, Zanni G, Mahadevia D, Chuhma N, Saha R, Spivack S, Pini N, Stevens GS, Ziolkowski-Blake A, Simpson EH, Balsam P, Rayport S, Ansorge MS. Dopamine transporter blockade during adolescence increases adult dopamine function, impulsivity, and aggression. Mol Psychiatry 2023; 28:3512-3523. [PMID: 37532798 PMCID: PMC10618097 DOI: 10.1038/s41380-023-02194-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Revised: 07/11/2023] [Accepted: 07/17/2023] [Indexed: 08/04/2023]
Abstract
Sensitive developmental periods shape neural circuits and enable adaptation. However, they also engender vulnerability to factors that can perturb developmental trajectories. An understanding of sensitive period phenomena and mechanisms separate from sensory system development is still lacking, yet critical to understanding disease etiology and risk. The dopamine system is pivotal in controlling and shaping adolescent behaviors, and it undergoes heightened plasticity during that time, such that interference with dopamine signaling can have long-lasting behavioral consequences. Here we sought to gain mechanistic insight into this dopamine-sensitive period and its impact on behavior. In mice, dopamine transporter (DAT) blockade from postnatal (P) day 22 to 41 increases aggression and sensitivity to amphetamine (AMPH) behavioral stimulation in adulthood. Here, we refined this sensitive window to P32-41 and identified increased firing of dopaminergic neurons in vitro and in vivo as a neural correlate to altered adult behavior. Aggression can result from enhanced impulsivity and cognitive dysfunction, and dopamine regulates working memory and motivated behavior. Hence, we assessed these behavioral domains and found that P32-41 DAT blockade increases impulsivity but has no effect on cognition, working memory, or motivation in adulthood. Lastly, using optogenetics to drive dopamine neurons, we find that increased VTA but not SNc dopaminergic activity mimics the increase in impulsive behavior in the Go/NoGo task observed after adolescent DAT blockade. Together our data provide insight into the developmental origins of aggression and impulsivity that may ultimately improve diagnosis, prevention, and treatment strategies for related neuropsychiatric disorders.
Collapse
Affiliation(s)
- Deepika Suri
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Giulia Zanni
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Darshini Mahadevia
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Nao Chuhma
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Molecular Therapeutics, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Rinki Saha
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Stephen Spivack
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Nicolò Pini
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Gregory S Stevens
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Annette Ziolkowski-Blake
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Eleanor H Simpson
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Peter Balsam
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA
- Department of Neuroscience and Behavior, Barnard College, Columbia University, New York, NY, 10032, USA
| | - Stephen Rayport
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA
- Department of Molecular Therapeutics, New York State Psychiatric Institute, New York, NY, 10032, USA
| | - Mark S Ansorge
- Department of Psychiatry, Columbia University, New York, NY, 10032, USA.
- Department of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, 10032, USA.
| |
Collapse
|
50
|
Mahmoudi S, Peck S, Madden GJ. Effects of inter-trial interval on sign-tracking and conditioned reinforcer efficacy in female rats. Behav Processes 2023; 210:104911. [PMID: 37406869 PMCID: PMC10528028 DOI: 10.1016/j.beproc.2023.104911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Revised: 06/19/2023] [Accepted: 07/01/2023] [Indexed: 07/07/2023]
Abstract
Previous nonhuman studies have reported that sign-tracking to a conditioned stimulus (CS) is increased when the intertrial interval (ITI) duration is increased. Separate studies indicate that individual differences in sign-tracking (vs. goal-tracking) at a fixed ITI (and CS duration) is predictive of the conditioned reinforcer efficacy of the CS. The present study evaluates, for the first time, if increasing the ITI increases rats' sign-tracking and the conditioned reinforcing efficacy of the CS. Forty-five female rats were randomly assigned to one of three groups that completed appetitive Pavlovian training with ITIs of 14, 24, or 96 s. Subsequently, they completed tests of conditioned reinforcement. Replicating previous findings, longer ITIs increased sign-tracking to a lever-CS and, extending the literature, conditioned reinforcer efficacy of that CS was highest at the longest ITI used during Pavlovian training. Implications for behavioral interventions using conditioned reinforcement are discussed.
Collapse
Affiliation(s)
- Saba Mahmoudi
- Department of Psychology, Utah State University, USA.
| | - Sara Peck
- College of Arts & Sciences, Western New England University, USA
| | | |
Collapse
|