1
|
Lenoir M, Engeln M, Navailles S, Girardeau P, Ahmed SH. A large-scale c-Fos brain mapping study on extinction of cocaine-primed reinstatement. Neuropsychopharmacology 2024; 49:1459-1467. [PMID: 38664549 PMCID: PMC11251268 DOI: 10.1038/s41386-024-01867-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Revised: 03/29/2024] [Accepted: 04/11/2024] [Indexed: 07/17/2024]
Abstract
Individuals with cocaine addiction can experience many craving episodes and subsequent relapses, which represents the main obstacle to recovery. Craving is often favored when abstinent individuals ingest a small dose of cocaine, encounter cues associated with drug use or are exposed to stressors. Using a cocaine-primed reinstatement model in rat, we recently showed that cocaine-conditioned interoceptive cues can be extinguished with repeated cocaine priming in the absence of drug reinforcement, a phenomenon we called extinction of cocaine priming. Here, we applied a large-scale c-Fos brain mapping approach following extinction of cocaine priming in male rats to identify brain regions implicated in processing the conditioned interoceptive stimuli of cocaine priming. We found that cocaine-primed reinstatement is associated with increased c-Fos expression in key brain regions (e.g., dorsal and ventral striatum, several prefrontal areas and insular cortex), while its extinction mostly disengages them. Moreover, while reinstatement behavior was correlated with insular and accumbal activation, extinction of cocaine priming implicated parts of the ventral pallidum, the mediodorsal thalamus and the median raphe. These brain patterns of activation and inhibition suggest that after repeated priming, interoceptive signals lose their conditioned discriminative properties and that action-outcome associations systems are mobilized in search for new contingencies, a brain state that may predispose to rapid relapse.
Collapse
Affiliation(s)
- Magalie Lenoir
- Univ. Bordeaux, CNRS, INCIA, UMR 5287, F-33000, Bordeaux, France.
| | - Michel Engeln
- Univ. Bordeaux, CNRS, INCIA, UMR 5287, F-33000, Bordeaux, France.
| | | | - Paul Girardeau
- Univ. Bordeaux, UFR des Sciences Odontologiques, Bordeaux, France
| | - Serge H Ahmed
- Univ. Bordeaux, CNRS, INCIA, UMR 5287, F-33000, Bordeaux, France
| |
Collapse
|
2
|
Engel L, Wolff AR, Blake M, Collins VL, Sinha S, Saunders BT. Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning. Curr Biol 2024; 34:3086-3101.e4. [PMID: 38925117 PMCID: PMC11279555 DOI: 10.1016/j.cub.2024.05.069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 04/25/2024] [Accepted: 05/29/2024] [Indexed: 06/28/2024]
Abstract
Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward rewards. Dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SNc) are crucial for this process, via engagement of a reciprocally connected network with their striatal targets. Critically, it remains unknown how dopamine neuron activity itself engages dopamine signals throughout the striatum, across learning. Here, we investigated how optogenetic Pavlovian cue conditioning of VTA or SNc dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. Although VTA stimulation-evoked robust dopamine release in NAc core, shell, and DMS, predictive cues preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS. Despite the development of vigorous movement late in training, conditioned dopamine signals did not emerge in the DLS, even during Pavlovian conditioning with SNc dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show a broad dissociation in the fundamental prediction and reward-related information generated by VTA and SNc dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale adaptations across the striatal network emerge during learning to coordinate behavior.
Collapse
Affiliation(s)
- Liv Engel
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA; Medical Discovery Team on Addiction, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA
| | - Amy R Wolff
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA; Medical Discovery Team on Addiction, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA
| | - Madelyn Blake
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA
| | - Val L Collins
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA; Medical Discovery Team on Addiction, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA
| | - Sonal Sinha
- Krieger School of Arts & Sciences, Johns Hopkins University, 3400 N. Charles St, Baltimore, MD 21218, USA
| | - Benjamin T Saunders
- Department of Neuroscience, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA; Medical Discovery Team on Addiction, University of Minnesota, 2001 6th St SE, Minneapolis, MN 55455, USA.
| |
Collapse
|
3
|
Muñoz-Redondo C, Parras GG, Andreu-Sánchez C, Martín-Pascual MÁ, Delgado-García JM, Gruart A. Functional states of prelimbic and related circuits during the acquisition of a GO/noGO task in rats. Cereb Cortex 2024; 34:bhae271. [PMID: 38997210 DOI: 10.1093/cercor/bhae271] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Revised: 06/11/2024] [Accepted: 06/15/2024] [Indexed: 07/14/2024] Open
Abstract
GO/noGO tasks enable assessing decision-making processes and the ability to suppress a specific action according to the context. Here, rats had to discriminate between 2 visual stimuli (GO or noGO) shown on an iPad screen. The execution (for GO) or nonexecution (for noGO) of the selected action (to touch or not the visual display) were reinforced with food. The main goal was to record and to analyze local field potentials collected from cortical and subcortical structures when the visual stimuli were shown on the touch screen and during the subsequent activities. Rats were implanted with recording electrodes in the prelimbic cortex, primary motor cortex, nucleus accumbens septi, basolateral amygdala, dorsolateral and dorsomedial striatum, hippocampal CA1, and mediodorsal thalamic nucleus. Spectral analyses of the collected data demonstrate that the prelimbic cortex was selectively involved in the cognitive and motivational processing of the learning task but not in the execution of reward-directed behaviors. In addition, the other recorded structures presented specific tendencies to be involved in these 2 types of brain activity in response to the presentation of GO or noGO stimuli. Spectral analyses, spectrograms, and coherence between the recorded brain areas indicate their specific involvement in GO vs. noGO tasks.
Collapse
Affiliation(s)
| | - Gloria G Parras
- Division of Neurosciences, Pablo de Olavide University, Seville 41013, Spain
| | - Celia Andreu-Sánchez
- Neuro-Com Research Group, Department of Audiovisual Communication and Advertising, Universitat Autònoma de Barcelona, Barcelona 08190, Spain
- Cerdanyola del Vallès, Institut de Neurociènces, Universitat Autònoma de Barcelona, Barcelona 08190, Spain
| | - Miguel Ángel Martín-Pascual
- Neuro-Com Research Group, Department of Audiovisual Communication and Advertising, Universitat Autònoma de Barcelona, Barcelona 08190, Spain
- Research and Development, Institute of Spanish Public Television (RTVE), Corporación Radio Televisión Española, Barcelona 08190, Spain
| | | | - Agnès Gruart
- Division of Neurosciences, Pablo de Olavide University, Seville 41013, Spain
| |
Collapse
|
4
|
Conn K, Huang K, Gorrell S, Foldi CJ. A transdiagnostic and translational framework for delineating the neuronal mechanisms of compulsive exercise in anorexia nervosa. Int J Eat Disord 2024; 57:1406-1417. [PMID: 38174745 PMCID: PMC11222308 DOI: 10.1002/eat.24130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 12/21/2023] [Accepted: 12/21/2023] [Indexed: 01/05/2024]
Abstract
OBJECTIVE The development of novel treatments for anorexia nervosa (AN) requires a detailed understanding of the biological underpinnings of specific, commonly occurring symptoms, including compulsive exercise. There is considerable bio-behavioral overlap between AN and obsessive-compulsive disorder (OCD), therefore it is plausible that similar mechanisms underlie compulsive behavior in both populations. While the association between these conditions is widely acknowledged, defining the shared mechanisms for compulsive behavior in AN and OCD requires a novel approach. METHODS We present an argument that a better understanding of the neurobiological mechanisms that underpin compulsive exercise in AN can be achieved in two critical ways. First, by applying a framework of the neuronal control of OCD to exercise behavior in AN, and second, by taking better advantage of the activity-based anorexia (ABA) rodent model to directly test this framework in the context of feeding pathology. RESULTS A cross-disciplinary approach that spans preclinical, neuroimaging, and clinical research as well as compulsive neurocircuitry and behavior can advance our understanding of when, why, and how compulsive exercise develops in the context of AN and provide targets for novel treatment strategies. DISCUSSION In this article, we (i) link the expression of compulsive behavior in AN and OCD via a transition between goal-directed and habitual behavior, (ii) present disrupted cortico-striatal circuitry as a key substrate for the development of compulsive behavior in both conditions, and (iii) highlight the utility of the ABA rodent model to better understand the mechanisms of compulsive behavior relevant to AN. PUBLIC SIGNIFICANCE Individuals with AN who exercise compulsively are at risk of worse health outcomes and have poorer responses to standard treatments. However, when, why, and how compulsive exercise develops in AN remains inadequately understood. Identifying whether the neural circuitry underlying compulsive behavior in OCD also controls hyperactivity in the activity-based anorexia model will aid in the development of novel eating disorder treatment strategies for this high-risk population.
Collapse
Affiliation(s)
- K Conn
- Monash University, Department of Physiology, 26 Innovation Walk, 3800, Clayton, Australia
- Monash Biomedicine Discovery Institute, 23 Innovation Walk, 3800, Clayton, Australia
| | - K Huang
- Monash University, Department of Physiology, 26 Innovation Walk, 3800, Clayton, Australia
- Monash Biomedicine Discovery Institute, 23 Innovation Walk, 3800, Clayton, Australia
| | - S Gorrell
- Department of Psychiatry and Behavioral Sciences, University of California, San Francisco, 675 18th street, San Francisco, CA 94143, USA
| | - CJ Foldi
- Monash University, Department of Physiology, 26 Innovation Walk, 3800, Clayton, Australia
- Monash Biomedicine Discovery Institute, 23 Innovation Walk, 3800, Clayton, Australia
| |
Collapse
|
5
|
Song MR, Lee SW. Rethinking dopamine-guided action sequence learning. Eur J Neurosci 2024; 60:3447-3465. [PMID: 38798086 DOI: 10.1111/ejn.16426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 04/21/2024] [Accepted: 05/08/2024] [Indexed: 05/29/2024]
Abstract
As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.
Collapse
Affiliation(s)
- Minryung R Song
- Department of Brain and Cognitive Sciences, KAIST, Daejeon, South Korea
| | - Sang Wan Lee
- Department of Brain and Cognitive Sciences, KAIST, Daejeon, South Korea
- Kim Jaechul Graduate School of AI, KAIST, Daejeon, South Korea
- KI for Health Science and Technology, KAIST, Daejeon, South Korea
- Center for Neuroscience-inspired AI, KAIST, Daejeon, South Korea
| |
Collapse
|
6
|
Avila C, Sarter M. Cortico-striatal action control inherent of opponent cognitive-motivational styles. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.12.584623. [PMID: 38559086 PMCID: PMC10979997 DOI: 10.1101/2024.03.12.584623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Turning on cue or stopping at a red light requires the detection of such cues to select action sequences, or suppress action, in accordance with cue-associated action rules. Cortico-striatal projections are an essential part of the brain's attention-motor interface. Glutamate-sensing microelectrode arrays were used to measure glutamate transients in the dorsomedial striatum (DMS) of male and female rats walking a treadmill and executing cued turns and stops. Prelimbic-DMS projections were chemogenetically inhibited to determine their behavioral necessity and the cortico-striatal origin of cue-evoked glutamate transients. Furthermore, we investigated rats exhibiting preferably goal-directed (goal trackers, GTs) versus cue-driven attention (sign trackers, STs), to determine the impact of such cognitive-motivational biases on cortico-striatal control. GTs executed more cued turns and initiated such turns more slowly than STs. During turns, but not missed turns or cued stops, cue-evoked glutamate concentrations were higher in GTs than in STs. In conjunction with turn cue-evoked glutamate spike levels, the presence of a single spike rendered GTs to be almost twice as likely to turn than STs. In contrast, multiple glutamate spikes predicted GTs to be less likely to turn than STs. In GTs, but not STs, inhibition of prelimbic-DMS projections attenuated turn rates, turn cue-evoked glutamate peaks, and increased the number of spikes. These findings suggest that turn cue-evoked glutamate release in GTs is tightly controlled by cortico-striatal neuronal activity. In contrast, in STs, glutamate release from DMS glutamatergic terminals may be regulated by other striatal circuitry, preferably mediating cued suppression of action and reward tracking.
Collapse
Affiliation(s)
- Cassandra Avila
- Department of Psychology, University of Michigan, Ann Arbor, MI, USA
| | - Martin Sarter
- Department of Psychology, University of Michigan, Ann Arbor, MI, USA
- Department of Psychology & Neuroscience Program, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
7
|
Bender BN, Stringfield SJ, Torregrossa MM. Changes in dorsomedial striatum activity during expression of goal-directed vs. habit-like cue-induced cocaine seeking. ADDICTION NEUROSCIENCE 2024; 11:100149. [PMID: 38957402 PMCID: PMC11218864 DOI: 10.1016/j.addicn.2024.100149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/04/2024]
Abstract
A preclinical model of cue exposure therapy, cue extinction, reduces cue-induced cocaine seeking that is goal-directed but not habit-like. Goal-directed and habitual behaviors differentially rely on the dorsomedial striatum (DMS) and dorsolateral striatum (DLS), but the effects of cue extinction on dorsal striatal responses to cue-induced drug seeking are unknown. We used fiber photometry in rats trained to self-administer cocaine paired with an audiovisual cue to examine how dorsal striatal intracellular calcium and extracellular dopamine activity differs between goal-directed and habit-like cue-induced cocaine seeking and how it is impacted by cue extinction. After minimal fixed-ratio training, rats showed enhanced DMS and DLS calcium responses to cue-reinforced compared to unreinforced lever presses. After rats were trained on goal-promoting fixed ratio schedules or habit-promoting second-order schedules of reinforcement, different patterns of dorsal striatal calcium and dopamine responses to cue-reinforced lever presses emerged. Rats trained on habit-promoting second-order schedules showed reduced DMS calcium responses and enhanced DLS dopamine responses to cue-reinforced lever presses. Cue extinction reduced calcium responses during subsequent drug seeking in the DMS, but not in the DLS. Therefore, cue extinction may reduce goal-directed behavior through its effects on the DMS, whereas habit-like behavior and the DLS are unaffected.
Collapse
Affiliation(s)
- Brooke N. Bender
- Department of Psychiatry, University of Pittsburgh, 450 Technology Drive, Pittsburgh, PA 15219, United States
- Center for Neuroscience, University of Pittsburgh, 4200 Fifth Ave, Pittsburgh, PA 15213, United States
| | - Sierra J. Stringfield
- Department of Psychiatry, University of Pittsburgh, 450 Technology Drive, Pittsburgh, PA 15219, United States
| | - Mary M. Torregrossa
- Department of Psychiatry, University of Pittsburgh, 450 Technology Drive, Pittsburgh, PA 15219, United States
- Center for Neuroscience, University of Pittsburgh, 4200 Fifth Ave, Pittsburgh, PA 15213, United States
| |
Collapse
|
8
|
Engel L, Wolff AR, Blake M, Collins VL, Sinha S, Saunders BT. Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.07.01.547331. [PMID: 38585717 PMCID: PMC10996462 DOI: 10.1101/2023.07.01.547331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.
Collapse
Affiliation(s)
- Liv Engel
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
- Current Address: Department of Psychology, University of Toronto
| | - Amy R Wolff
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| | - Madelyn Blake
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| | - Val L Collins
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| | | | - Benjamin T Saunders
- Department of Neuroscience, University of Minnesota
- Medical Discovery Team on Addiction, University of Minnesota
| |
Collapse
|
9
|
Cheng Y, Magnard R, Langdon AJ, Lee D, Janak PH. Chronic Ethanol Exposure Produces Persistent Impairment in Cognitive Flexibility and Decision Signals in the Striatum. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.10.584332. [PMID: 38585868 PMCID: PMC10996555 DOI: 10.1101/2024.03.10.584332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
Lack of cognitive flexibility is a hallmark of substance use disorders and has been associated with drug-induced synaptic plasticity in the dorsomedial striatum (DMS). Yet the possible impact of altered plasticity on real-time striatal neural dynamics during decision-making is unclear. Here, we identified persistent impairments induced by chronic ethanol (EtOH) exposure on cognitive flexibility and striatal decision signals. After a substantial withdrawal period from prior EtOH vapor exposure, male, but not female, rats exhibited reduced adaptability and exploratory behavior during a dynamic decision-making task. Reinforcement learning models showed that prior EtOH exposure enhanced learning from rewards over omissions. Notably, neural signals in the DMS related to the decision outcome were enhanced, while those related to choice and choice-outcome conjunction were reduced, in EtOH-treated rats compared to the controls. These findings highlight the profound impact of chronic EtOH exposure on adaptive decision-making, pinpointing specific changes in striatal representations of actions and outcomes as underlying mechanisms for cognitive deficits.
Collapse
Affiliation(s)
- Yifeng Cheng
- Department Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
| | - Robin Magnard
- Department Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
| | - Angela J. Langdon
- Intramural Research Program, National Institute of Mental Health, National Institutes of Health, Bethesda, MD
| | - Daeyeol Lee
- Department Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
- Zanvyl Krieger Mind/Brain Institute, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
- Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD
- Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD
| | - Patricia H. Janak
- Department Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
- Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD
- Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD
| |
Collapse
|
10
|
Cashen NA, Kloc ML, Pressman D, Liebman SA, Holmes GL. CBD treatment following early life seizures alters orbitofrontal-striatal signaling during adulthood. Epilepsy Behav 2024; 152:109638. [PMID: 38325075 DOI: 10.1016/j.yebeh.2024.109638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/03/2023] [Revised: 01/06/2024] [Accepted: 01/08/2024] [Indexed: 02/09/2024]
Abstract
Obsessive compulsive disorder (OCD) is a comorbid condition of epilepsy and often adds to the burden of epilepsy. Both OCD and epilepsy are disorders of hyperexcitable circuits. Fronto-striatal circuit dysfunction is implicated in OCD. Prior work in our laboratory has shown that in rat pups following a series of flurothyl-induced early life seizures (ELS) exhibit frontal-lobe dysfunction along with alterations in electrographic temporal coordination between the orbitofrontal cortex (OFC) and dorsomedial striatum (DMS), circuits implicated in OCD. Here, we studied the effects of ELS in male and female rat pups on OCD-like behaviors as adults using the marble burying test (MBT). Because cannabidiol (CBD) is an effective antiseizure medication and has shown efficacy in the treatment of individuals with OCD, we also randomized rats to CBD or vehicle treatment following ELS to determine if CBD had any effect on OCD-like behaviors. While the flurothyl model of ELS did not induce OCD-like behaviors, as measured in the MBT, ELS did alter neural signaling in structures implicated in OCD and CBD had sex-dependent effects of temporal coordination in a way which suggests it may have a beneficial effect on epilepsy-related OCD.
Collapse
Affiliation(s)
- Natalie A Cashen
- Department of Neurological Sciences, University of Vermont, Larner College of Medicine, Burlington, VT, United States
| | - Michelle L Kloc
- Department of Neurological Sciences, University of Vermont, Larner College of Medicine, Burlington, VT, United States
| | - Davi Pressman
- Department of Neurological Sciences, University of Vermont, Larner College of Medicine, Burlington, VT, United States
| | - Samuel A Liebman
- Department of Neurological Sciences, University of Vermont, Larner College of Medicine, Burlington, VT, United States
| | - Gregory L Holmes
- Department of Neurological Sciences, University of Vermont, Larner College of Medicine, Burlington, VT, United States.
| |
Collapse
|
11
|
Chauvin RJ, Newbold DJ, Nielsen AN, Miller RL, Krimmel SR, Metoki A, Wang A, Van AN, Montez DF, Marek S, Suljic V, Baden NJ, Ramirez-Perez N, Scheidter KM, Monk JS, Whiting FI, Adeyemo B, Snyder AZ, Kay BP, Raichle ME, Laumann TO, Gordon EM, Dosenbach NU. Disuse-driven plasticity in the human thalamus and putamen. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.11.07.566031. [PMID: 37987000 PMCID: PMC10659348 DOI: 10.1101/2023.11.07.566031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
Motor adaptation in cortico-striato-thalamo-cortical loops has been studied mainly in animals using invasive electrophysiology. Here, we leverage functional neuroimaging in humans to study motor circuit plasticity in the human subcortex. We employed an experimental paradigm that combined two weeks of upper-extremity immobilization with daily resting-state and motor task fMRI before, during, and after the casting period. We previously showed that limb disuse leads to decreased functional connectivity (FC) of the contralateral somatomotor cortex (SM1) with the ipsilateral somatomotor cortex, increased FC with the cingulo-opercular network (CON) as well as the emergence of high amplitude, fMRI signal pulses localized in the contralateral SM1, supplementary motor area and the cerebellum. From our prior observations, it remains unclear whether the disuse plasticity affects the thalamus and striatum. We extended our analysis to include these subcortical regions and found that both exhibit strengthened cortical FC and spontaneous fMRI signal pulses induced by limb disuse. The dorsal posterior putamen and the central thalamus, mainly CM, VLP and VIM nuclei, showed disuse pulses and FC changes that lined up with fmri task activations from the Human connectome project motor system localizer, acquired before casting for each participant. Our findings provide a novel understanding of the role of the cortico-striato-thalamo-cortical loops in human motor plasticity and a potential link with the physiology of sleep regulation. Additionally, similarities with FC observation from Parkinson Disease (PD) questions a pathophysiological link with limb disuse.
Collapse
Affiliation(s)
- Roselyne J. Chauvin
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Dillan J. Newbold
- Department of Neurology, New York University Grossman School of Medicine, New York, New York 10016, USA
| | - Ashley N. Nielsen
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Ryland L. Miller
- Basque Center on Cognition, Brain and Language, Donostia, Gipuzkoa, Spain
| | - Samuel R. Krimmel
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Athanasia Metoki
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Anxu Wang
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
- Department of Biomedical Engineering, Washington University in St. Louis, MO 63130
| | - Andrew N. Van
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
- Division of Computation and Data Science, Washington University School of Medicine, St. Louis, MO 63110
| | - David F. Montez
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
- Department of Psychiatry, Washington University School of Medicine, St. Louis, MO 63110
| | - Scott Marek
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO 63110
| | - Vahdeta Suljic
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Noah J. Baden
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | | | - Kristen M. Scheidter
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Julia S. Monk
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Forrest I. Whiting
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Babatunde Adeyemo
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Abraham Z. Snyder
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO 63110
| | - Benjamin P. Kay
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
| | - Marcus E. Raichle
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO 63110
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St Louis, MO, USA
- Department of Neuroscience, Washington University School of Medicine, St Louis, MO, USA
| | - Timothy O. Laumann
- Department of Psychiatry, Washington University School of Medicine, St. Louis, MO 63110
| | - Evan M. Gordon
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO 63110
| | - Nico U.F. Dosenbach
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63110
- Department of Biomedical Engineering, Washington University in St. Louis, MO 63130
- Department of Psychiatry, Washington University School of Medicine, St. Louis, MO 63110
- Department of Pediatrics, Washington University School of Medicine, St. Louis, MO 63110
| |
Collapse
|
12
|
Handel SN, Smith RJ. Making and breaking habits: Revisiting the definitions and behavioral factors that influence habits in animals. J Exp Anal Behav 2024; 121:8-26. [PMID: 38010353 PMCID: PMC10842199 DOI: 10.1002/jeab.889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Accepted: 10/26/2023] [Indexed: 11/29/2023]
Abstract
Habits have garnered significant interest in studies of associative learning and maladaptive behavior. However, habit research has faced scrutiny and challenges related to the definitions and methods. Differences in the conceptualizations of habits between animal and human studies create difficulties for translational research. Here, we review the definitions and commonly used methods for studying habits in animals and humans and discuss potential alternative ways to assess habits, such as automaticity. To better understand habits, we then focus on the behavioral factors that have been shown to make or break habits in animals, as well as potential mechanisms underlying the influence of these factors. We discuss the evidence that habitual and goal-directed systems learn in parallel and that they seem to interact in competitive and cooperative manners. Finally, we draw parallels between habitual responding and compulsive drug seeking in animals to delineate the similarities and differences in these behaviors.
Collapse
Affiliation(s)
- Sophia N Handel
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, Texas, USA
| | - Rachel J Smith
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, Texas, USA
- Institute for Neuroscience, Texas A&M University, College Station, Texas, USA
| |
Collapse
|
13
|
Fraser KM, Chen BJ, Janak PH. Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance. Eur J Neurosci 2024; 59:220-237. [PMID: 38093522 PMCID: PMC10841748 DOI: 10.1111/ejn.16210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Revised: 11/09/2023] [Accepted: 11/15/2023] [Indexed: 01/23/2024]
Abstract
Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.
Collapse
Affiliation(s)
- Kurt M. Fraser
- Department of Psychological & Brain Sciences, Krieger School of Arts & Sciences, Johns Hopkins University, Baltimore, MD, 21218
| | - Bridget J. Chen
- Department of Psychological & Brain Sciences, Krieger School of Arts & Sciences, Johns Hopkins University, Baltimore, MD, 21218
| | - Patricia H. Janak
- Department of Psychological & Brain Sciences, Krieger School of Arts & Sciences, Johns Hopkins University, Baltimore, MD, 21218
- Solomon H. Snyder Department of Neuroscience, School of Medicine, Johns Hopkins University, Baltimore, MD, 21205
- Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD 21218
| |
Collapse
|
14
|
Bender BN, Stringfield SJ, Torregrossa MM. Changes in dorsomedial striatum activity mediate expression of goal-directed vs. habit-like cue-induced cocaine seeking. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.24.550364. [PMID: 37546826 PMCID: PMC10402009 DOI: 10.1101/2023.07.24.550364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/08/2023]
Abstract
A preclinical model of cue exposure therapy, cue extinction, reduces cue-induced cocaine seeking when drug seeking is goal-directed but not habitual. Goal-directed and habitual behaviors differentially rely on the dorsomedial striatum (DMS) and dorsolateral striatum (DLS), but the effects of cue extinction on dorsal striatal responses to cue-induced drug seeking are unknown. We used fiber photometry to examine how dorsal striatal intracellular calcium and extracellular dopamine activity differs between goal-directed and habitual cue-induced cocaine seeking and how it is impacted by cue extinction. Rats trained to self-administer cocaine paired with an audiovisual cue on schedules of reinforcement that promote goal-directed or habitual cocaine seeking had different patterns of dorsal striatal calcium and dopamine responses to cue-reinforced lever presses. Cue extinction reduced calcium and dopamine responses during subsequent drug seeking in the DMS, but not in the DLS. Therefore, cue extinction may reduce goal-directed behavior through its effects on the DMS, whereas habitual behavior and the DLS are unaffected.
Collapse
|
15
|
Moore S, Wang Z, Zhu Z, Sun R, Lee A, Charles A, Kuchibhotla KV. Revealing abrupt transitions from goal-directed to habitual behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.05.547783. [PMID: 37461576 PMCID: PMC10349993 DOI: 10.1101/2023.07.05.547783] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/23/2023]
Abstract
A fundamental tenet of animal behavior is that decision-making involves multiple 'controllers.' Initially, behavior is goal-directed, driven by desired outcomes, shifting later to habitual control, where cues trigger actions independent of motivational state. Clark Hull's question from 1943 still resonates today: "Is this transition abrupt, or is it gradual and progressive?"1 Despite a century-long belief in gradual transitions, this question remains unanswered2,3 as current methods cannot disambiguate goal-directed versus habitual control in real-time. Here, we introduce a novel 'volitional engagement' approach, motivating animals by palatability rather than biological need. Offering less palatable water in the home cage4,5 reduced motivation to 'work' for plain water in an auditory discrimination task when compared to water-restricted animals. Using quantitative behavior and computational modeling6, we found that palatability-driven animals learned to discriminate as quickly as water-restricted animals but exhibited state-like fluctuations when responding to the reward-predicting cue-reflecting goal-directed behavior. These fluctuations spontaneously and abruptly ceased after thousands of trials, with animals now always responding to the reward-predicting cue. In line with habitual control, post-transition behavior displayed motor automaticity, decreased error sensitivity (assessed via pupillary responses), and insensitivity to outcome devaluation. Bilateral lesions of the habit-related dorsolateral striatum7 blocked transitions to habitual behavior. Thus, 'volitional engagement' reveals spontaneous and abrupt transitions from goal-directed to habitual behavior, suggesting the involvement of a higher-level process that arbitrates between the two.
Collapse
Affiliation(s)
- Sharlen Moore
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Zyan Wang
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Ziyi Zhu
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD, USA
- The Solomon H. Snyder Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
- Johns Hopkins Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD, USA
| | - Ruolan Sun
- Department of Biomedical Engineering, Whiting School of Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Angel Lee
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Adam Charles
- Johns Hopkins Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD, USA
- Department of Biomedical Engineering, Whiting School of Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Kishore V. Kuchibhotla
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD, USA
- The Solomon H. Snyder Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
- Johns Hopkins Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD, USA
- Department of Biomedical Engineering, Whiting School of Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| |
Collapse
|
16
|
Domi A, Domi E, Lagstrom O, Gobbo F, Jerlhag E, Adermark L. Abstinence-Induced Nicotine Seeking Relays on a Persistent Hypoglutamatergic State within the Amygdalo-Striatal Neurocircuitry. eNeuro 2023; 10:ENEURO.0468-22.2023. [PMID: 36754627 PMCID: PMC9946069 DOI: 10.1523/eneuro.0468-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 12/21/2022] [Accepted: 01/06/2023] [Indexed: 02/10/2023] Open
Abstract
Nicotine robustly sustains smoking behavior by acting as a primary reinforcer and by enhancing the incentive salience of the nicotine-associated stimuli. The motivational effects produced by environmental cues associated with nicotine delivery can progressively manifest during abstinence resulting in reinstatement of nicotine seeking. However, how the activity in reward neuronal circuits is transformed during abstinence-induced nicotine seeking is not yet fully understood. In here we used a contingent nicotine and saline control self-administration model to disentangle the contribution of cue-elicited seeking responding for nicotine after drug abstinence in male Wistar rats. Using ex vivo electrophysiological recordings and a network analysis approach, we defined temporal and brain-region specific amygdalo-striatal glutamatergic alterations that occur during nicotine abstinence. The results from this study provide critical evidence indicating a persistent hypoglutamatergic state within the amygdalo-striatal neurocircuitry over protracted nicotine abstinence. During abstinence-induced nicotine seeking, electrophysiological recordings showed progressive neuroadaptations in dorsal and ventral striatum already at 14-d abstinence while neuroadaptations in subregions of the amygdala emerged only after 28-d abstinence. The observed neuroadaptations pointed to a brain network involving the amygdala and the dorsolateral striatum (DLS) to be implied in cue-induced reinstatement of nicotine seeking. Together these data suggest long-lasting neuroadaptations that might reflect neuroplastic changes responsible to abstinence-induced nicotine craving. Neurophysiological transformations were detected within a time window that allows therapeutic intervention advancing clinical development of preventive strategies in nicotine addiction.
Collapse
Affiliation(s)
- Ana Domi
- Institute of Neuroscience and Physiology, Department of Pharmacology, The Sahlgrenska Academy, University of Gothenburg, Gothenburg 413 90, Sweden
- Addiction Biology Unit, Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, The Sahlgrenska Academy, University of Gothenburg, Gothenburg 413 45, Sweden
| | - Esi Domi
- School of Pharmacy, Pharmacology Unit, Center for Neuroscience, University of Camerino, Camerino 62032, Italy
| | - Oona Lagstrom
- Institute of Neuroscience and Physiology, Department of Pharmacology, The Sahlgrenska Academy, University of Gothenburg, Gothenburg 413 90, Sweden
- Addiction Biology Unit, Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, The Sahlgrenska Academy, University of Gothenburg, Gothenburg 413 45, Sweden
| | - Francesco Gobbo
- Centre for Discovery Brain Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| | - Elisabet Jerlhag
- Institute of Neuroscience and Physiology, Department of Pharmacology, The Sahlgrenska Academy, University of Gothenburg, Gothenburg 413 90, Sweden
| | - Louise Adermark
- Institute of Neuroscience and Physiology, Department of Pharmacology, The Sahlgrenska Academy, University of Gothenburg, Gothenburg 413 90, Sweden
- Addiction Biology Unit, Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, The Sahlgrenska Academy, University of Gothenburg, Gothenburg 413 45, Sweden
| |
Collapse
|
17
|
Lack of action monitoring as a prerequisite for habitual and chunked behavior: Behavioral and neural correlates. iScience 2022; 26:105818. [PMID: 36636348 PMCID: PMC9830217 DOI: 10.1016/j.isci.2022.105818] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 11/01/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022] Open
Abstract
We previously reported the rapid development of habitual behavior in a discrete-trials instrumental task in which lever insertion and retraction act as reward-predictive cues delineating sequence execution. Here we asked whether lever cues or performance variables reflective of skill and automaticity might account for habitual behavior in male rats. Behavior in the discrete-trials habit-promoting task was compared with two task variants lacking the sequence-delineating cues of lever extension and retraction. We find that behavior is under goal-directed control in absence of sequence-delineating cues but not in their presence, and that skilled performance does not predict goal-directed vs. habitual behavior. Neural activity recordings revealed an engagement of dorsolateral striatum and a disengagement of dorsomedial striatum during the sequence execution of the habit-promoting task, specifically. Together, these results indicate that sequence delineation cues promote habit and differential engagement of striatal subregions during instrumental responding, a pattern that may reflect cue-elicited behavioral chunking.
Collapse
|
18
|
Male DAT Val559 Mice Exhibit Compulsive Behavior under Devalued Reward Conditions Accompanied by Cellular and Pharmacological Changes. Cells 2022; 11:cells11244059. [PMID: 36552823 PMCID: PMC9777203 DOI: 10.3390/cells11244059] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 12/05/2022] [Accepted: 12/12/2022] [Indexed: 12/23/2022] Open
Abstract
Identified across multiple psychiatric disorders, the dopamine (DA) transporter (DAT) Ala559Val substitution triggers non-vesicular, anomalous DA efflux (ADE), perturbing DA neurotransmission and behavior. We have shown that DAT Val559 mice display a waiting impulsivity and changes in cognitive performance associated with enhanced reward motivation. Here, utilizing a within-subject, lever-pressing paradigm designed to bias the formation of goal-directed or habitual behavior, we demonstrate that DAT Val559 mice modulate their nose poke behavior appropriately to match context, but demonstrate a perseverative checking behavior. Although DAT Val559 mice display no issues with the cognitive flexibility required to acquire and re-learn a visual pairwise discrimination task, devaluation of reward evoked habitual reward seeking in DAT Val559 mutants in operant tasks regardless of reinforcement schedule. The direct DA agonist apomorphine also elicits locomotor stereotypies in DAT Val559, but not WT mice. Our observation that dendritic spine density is increased in the dorsal medial striatum (DMS) of DAT Val559 mice speaks to an imbalance in striatal circuitry that might underlie the propensity of DAT Val559 mutants to exhibit compulsive behaviors when reward is devalued. Thus, DAT Val559 mice represent a model for dissection of how altered DA signaling perturbs circuits that normally balance habitual and goal-directed behaviors.
Collapse
|
19
|
Cataldi S, Lacefield C, Shashaank N, Kumar G, Boumhaouad S, Sulzer D. Decreased Dorsomedial Striatum Direct Pathway Neuronal Activity Is Required for Learned Motor Coordination. eNeuro 2022; 9:ENEURO.0169-22.2022. [PMID: 36171055 PMCID: PMC9557335 DOI: 10.1523/eneuro.0169-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Revised: 09/08/2022] [Accepted: 09/13/2022] [Indexed: 12/15/2022] Open
Abstract
It has been suggested that the dorsomedial striatum (DMS) is engaged in the early stages of motor learning for goal-directed actions, whereas at later stages, control is transferred to the dorsolateral striatum (DLS), a process that enables learned motor actions to become a skill or habit. It is not known whether these striatal regions are simultaneously active while the expertise is acquired. To address this question, we developed a mouse "Treadmill Training Task" that tracks changes in mouse locomotor coordination during running practice and simultaneously provides a means to measure local neuronal activity using photometry. To measure change in motor coordination over treadmill practice sessions, we used DeepLabCut (DLC) and custom-built code to analyze body position and paw movements. By evaluating improvements in motor coordination during training with simultaneous neuronal calcium activity in the striatum, we found that DMS direct pathway neurons exhibited decreased activity as the mouse gained proficiency at running. In contrast, direct pathway activity in the DLS was similar throughout training. Pharmacological blockade of D1 dopamine receptors in these subregions during task performance demonstrated that dopamine neurotransmission in the direct pathway activity is necessary for efficient motor coordination learning. These results provide new tools to measure changes in fine motor skills with simultaneous recordings of brain activity and reveal fundamental features of the neuronal substrates of motor learning.
Collapse
Affiliation(s)
- Stefano Cataldi
- Departments of Psychiatry, Columbia University Division of Molecular Therapeutics, New York State Psychiatric Institute, New York, NY 10032
| | - Clay Lacefield
- Departments of Psychiatry, Columbia University Division of Molecular Therapeutics, New York State Psychiatric Institute, New York, NY 10032
- Division of Systems Neuroscience, New York State Psychiatric Institute, New York, NY 10032
| | - N Shashaank
- Department of Computer Science, Columbia University, Schapiro Center for Engineering and Physical Science Research, New York, NY 10027
- New York Genome Center, New York, NY 10013
| | - Gautam Kumar
- Neuroscience Program, University of Maryland School of Medicine, Baltimore, MD 21201
| | - Siham Boumhaouad
- Departments of Psychiatry, Columbia University Division of Molecular Therapeutics, New York State Psychiatric Institute, New York, NY 10032
- Physiology and Physiopathology, Faculty of Sciences, Mohammed V University, Rabat 1014, Morocco
| | - David Sulzer
- Departments of Psychiatry, Columbia University Division of Molecular Therapeutics, New York State Psychiatric Institute, New York, NY 10032
- Departments of Neurology, Columbia University, New York, NY 10032
- Department of Pharmacology, Columbia University, New York, NY 10032
| |
Collapse
|
20
|
Sohn J, Suzuki M, Youssef M, Hatada S, Larkum ME, Kawaguchi Y, Kubota Y. Presynaptic supervision of cortical spine dynamics in motor learning. SCIENCE ADVANCES 2022; 8:eabm0531. [PMID: 35895812 PMCID: PMC9328689 DOI: 10.1126/sciadv.abm0531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 06/09/2022] [Indexed: 06/15/2023]
Abstract
In mammalian neocortex, learning triggers the formation and turnover of new postsynaptic spines on pyramidal cell dendrites. However, the biological principles of spine reorganization during learning remain elusive because the identity of their presynaptic neuronal partners is unknown. Here, we show that two presynaptic neural circuits supervise distinct programs of spine dynamics to execute learning. We imaged spine dynamics in motor cortex during learning and performed post hoc identification of their afferent presynaptic neurons. New spines that appeared during learning formed small transient contacts with corticocortical neurons that were eliminated on skill acquisition. In contrast, persistent spines with axons from thalamic neurons were formed and enlarged. These results suggest that pyramidal cell dendrites in motor cortex use a neural circuit division of labor during skill learning, with dynamic teaching contacts from top-down intracortical axons followed by synaptic memory formation driven by thalamic axons. Dual spine supervision may govern diverse skill learning in the neocortex.
Collapse
Affiliation(s)
- Jaerin Sohn
- Division of Cerebral Circuitry, National Institute for Physiological Sciences (NIPS), Okazaki 444-8787, Japan
- Section of Electron Microscopy, Supportive Center for Brain Research, National Institute for Physiological Sciences (NIPS), Okazaki 444-8787, Japan
| | - Mototaka Suzuki
- Neurocure Center for Excellence, Charité Universitätsmedizin Berlin, 10117 Berlin, Germany
| | - Mohammed Youssef
- Division of Cerebral Circuitry, National Institute for Physiological Sciences (NIPS), Okazaki 444-8787, Japan
- Department of Animal Physiology, Faculty of Veterinary Medicine, South Valley University, Qena 83523, Egypt
| | - Sayuri Hatada
- Division of Cerebral Circuitry, National Institute for Physiological Sciences (NIPS), Okazaki 444-8787, Japan
| | - Matthew E. Larkum
- Neurocure Center for Excellence, Charité Universitätsmedizin Berlin, 10117 Berlin, Germany
- Institute of Biology, Humboldt University of Berlin, 10117 Berlin, Germany
| | - Yasuo Kawaguchi
- Division of Cerebral Circuitry, National Institute for Physiological Sciences (NIPS), Okazaki 444-8787, Japan
- Department of Physiological Sciences, The Graduate University for Advanced Studies (SOKENDAI), Okazaki 444-8787, Japan
- Brain Science Institute, Tamagawa University, Machida, Tokyo 194-8610, Japan
| | - Yoshiyuki Kubota
- Division of Cerebral Circuitry, National Institute for Physiological Sciences (NIPS), Okazaki 444-8787, Japan
- Section of Electron Microscopy, Supportive Center for Brain Research, National Institute for Physiological Sciences (NIPS), Okazaki 444-8787, Japan
- Department of Physiological Sciences, The Graduate University for Advanced Studies (SOKENDAI), Okazaki 444-8787, Japan
- Support Unit for Electron Microscopy Techniques, Research Resources Division, RIKEN Center for Brain Science, Wako 351-0198, Japan
| |
Collapse
|
21
|
Badreddine N, Zalcman G, Appaix F, Becq G, Tremblay N, Saudou F, Achard S, Fino E. Spatiotemporal reorganization of corticostriatal networks encodes motor skill learning. Cell Rep 2022; 39:110623. [PMID: 35385722 DOI: 10.1016/j.celrep.2022.110623] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Revised: 01/21/2022] [Accepted: 03/15/2022] [Indexed: 11/28/2022] Open
Abstract
Motor skill learning requires the activity of the dorsal striatum, with a differential global implication of the dorsomedial and dorsolateral territories. We investigate here whether and how specific striatal neurons encode the acquisition and consolidation of a motor skill. Using ex vivo two-photon calcium imaging after rotarod training, we report that highly active (HA) striatal populations arise from distinct spatiotemporal reorganization in the dorsomedial (DMS) and dorsolateral (DLS) striatum networks and are correlated with learning performance. The DMS overall activity decreases in early training, with few and sparsely distributed HA cells, while the DLS shows a progressive and long-lasting formation of HA cell clusters. These reorganizations result from reinforcement of synaptic connections to the DMS and anatomical rearrangements to the DLS. Targeted silencing of DMS or DLS HA cells with the cFos-TRAP strategy strongly impairs individual performance. Our data reveal that discrete domains of striatal populations encode acquisition and long-lasting retention of a motor skill.
Collapse
Affiliation(s)
- Nagham Badreddine
- Université Grenoble Alpes, INSERM, U1216, CHU Grenoble Alpes, CNRS, Grenoble Institut Neurosciences, 38000 Grenoble, France
| | - Gisela Zalcman
- Université Grenoble Alpes, INSERM, U1216, CHU Grenoble Alpes, CNRS, Grenoble Institut Neurosciences, 38000 Grenoble, France
| | - Florence Appaix
- Université Grenoble Alpes, INSERM, U1216, CHU Grenoble Alpes, CNRS, Grenoble Institut Neurosciences, 38000 Grenoble, France
| | - Guillaume Becq
- Université Grenoble Alpes, CNRS, Grenoble INP, GIPSA-Lab, 38000 Grenoble, France
| | - Nicolas Tremblay
- Université Grenoble Alpes, CNRS, Grenoble INP, GIPSA-Lab, 38000 Grenoble, France
| | - Frédéric Saudou
- Université Grenoble Alpes, INSERM, U1216, CHU Grenoble Alpes, CNRS, Grenoble Institut Neurosciences, 38000 Grenoble, France
| | - Sophie Achard
- Université Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK, 38000 Grenoble, France
| | - Elodie Fino
- Université Grenoble Alpes, INSERM, U1216, CHU Grenoble Alpes, CNRS, Grenoble Institut Neurosciences, 38000 Grenoble, France.
| |
Collapse
|
22
|
Walia P, Ghosh A, Singh S, Dutta A. Portable Neuroimaging-Guided Noninvasive Brain Stimulation of the Cortico-Cerebello-Thalamo-Cortical Loop—Hypothesis and Theory in Cannabis Use Disorder. Brain Sci 2022; 12:brainsci12040445. [PMID: 35447977 PMCID: PMC9027826 DOI: 10.3390/brainsci12040445] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 03/06/2022] [Accepted: 03/22/2022] [Indexed: 12/22/2022] Open
Abstract
Background: Maladaptive neuroplasticity-related learned response in substance use disorder (SUD) can be ameliorated using noninvasive brain stimulation (NIBS); however, inter-individual variability needs to be addressed for clinical translation. Objective: Our first objective was to develop a hypothesis for NIBS for learned response in SUD based on a competing neurobehavioral decision systems model. The next objective was to develop the theory by conducting a computational simulation of NIBS of the cortico-cerebello-thalamo-cortical (CCTC) loop in cannabis use disorder (CUD)-related dysfunctional “cue-reactivity”—a construct closely related to “craving”—that is a core symptom. Our third objective was to test the feasibility of a neuroimaging-guided rational NIBS approach in healthy humans. Methods: “Cue-reactivity” can be measured using behavioral paradigms and portable neuroimaging, including functional near-infrared spectroscopy (fNIRS) and electroencephalogram (EEG) metrics of sensorimotor gating. Therefore, we conducted a computational simulation of NIBS, including transcranial direct current stimulation (tDCS) and transcranial alternating current stimulation (tACS) of the cerebellar cortex and deep cerebellar nuclei (DCN) of the CCTC loop for its postulated effects on fNIRS and EEG metrics. We also developed a rational neuroimaging-guided NIBS approach for the cerebellar lobule (VII) and prefrontal cortex based on a healthy human study. Results: Simulation of cerebellar tDCS induced gamma oscillations in the cerebral cortex, while transcranial temporal interference stimulation induced a gamma-to-beta frequency shift. A preliminary healthy human study (N = 10) found that 2 mA cerebellar tDCS evoked similar oxyhemoglobin (HbO) response in the range of 5 × 10−6 M across the cerebellum and PFC brain regions (α = 0.01); however, infra-slow (0.01–0.10 Hz) prefrontal cortex HbO-driven phase–amplitude-coupled (PAC; 4 Hz, ±2 mA (max)) cerebellar tACS evoked HbO levels in the range of 10−7 M that were statistically different (α = 0.01) across these brain regions. Conclusion: Our healthy human study showed the feasibility of fNIRS of cerebellum and PFC and closed-loop fNIRS-driven ctACS at 4 Hz, which may facilitate cerebellar cognitive function via the frontoparietal network. Future work needs to combine fNIRS with EEG for multi-modal imaging for closed-loop NIBS during operant conditioning.
Collapse
Affiliation(s)
- Pushpinder Walia
- Neuroengineering and Informatics for Rehabilitation Laboratory, University at Buffalo, Buffalo, NY 14228, USA;
| | - Abhishek Ghosh
- Postgraduate Institute of Medical Education & Research, Chandigarh 700020, India; (A.G.); (S.S.)
| | - Shubhmohan Singh
- Postgraduate Institute of Medical Education & Research, Chandigarh 700020, India; (A.G.); (S.S.)
| | - Anirban Dutta
- Neuroengineering and Informatics for Rehabilitation Laboratory, University at Buffalo, Buffalo, NY 14228, USA;
- Correspondence:
| |
Collapse
|
23
|
Perez S, Cui Y, Vignoud G, Perrin E, Mendes A, Zheng Z, Touboul J, Venance L. Striatum expresses region-specific plasticity consistent with distinct memory abilities. Cell Rep 2022; 38:110521. [PMID: 35294877 DOI: 10.1016/j.celrep.2022.110521] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Revised: 12/23/2021] [Accepted: 02/21/2022] [Indexed: 11/24/2022] Open
Abstract
The striatum mediates two learning modalities: goal-directed behavior in dorsomedial (DMS) and habits in dorsolateral (DLS) striata. The synaptic bases of these learnings are still elusive. Indeed, while ample research has described DLS plasticity, little remains known about DMS plasticity and its involvement in procedural learning. Here, we find symmetric and asymmetric anti-Hebbian spike-timing-dependent plasticity (STDP) in DMS and DLS, respectively, with opposite plasticity dominance upon increasing corticostriatal activity. During motor-skill learning, plasticity is engaged in DMS and striatonigral DLS neurons only during early learning stages, whereas striatopallidal DLS neurons are mobilized only during late phases. With a mathematical modeling approach, we find that symmetric anti-Hebbian STDP favors memory flexibility, while asymmetric anti-Hebbian STDP favors memory maintenance, consistent with memory processes at play in procedural learning.
Collapse
Affiliation(s)
- Sylvie Perez
- Center for Interdisciplinary Research in Biology (CIRB), College de France, CNRS, INSERM, Université PSL, Paris, France
| | - Yihui Cui
- Center for Interdisciplinary Research in Biology (CIRB), College de France, CNRS, INSERM, Université PSL, Paris, France; Department of Neurobiology, Department of Neurology of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310058, China
| | - Gaëtan Vignoud
- Center for Interdisciplinary Research in Biology (CIRB), College de France, CNRS, INSERM, Université PSL, Paris, France; MAMBA-Modelling and Analysis for Medical and Biological Applications, Inria Paris, LJLL (UMR-7598) -Laboratory Jacques-Louis Lions, Paris, France
| | - Elodie Perrin
- Center for Interdisciplinary Research in Biology (CIRB), College de France, CNRS, INSERM, Université PSL, Paris, France
| | - Alexandre Mendes
- Center for Interdisciplinary Research in Biology (CIRB), College de France, CNRS, INSERM, Université PSL, Paris, France
| | - Zhiwei Zheng
- Department of Neurobiology, Department of Neurology of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310058, China
| | - Jonathan Touboul
- Department of Mathematics and Volen National Center for Complex Systems, Brandeis University, Waltham, MA, USA
| | - Laurent Venance
- Center for Interdisciplinary Research in Biology (CIRB), College de France, CNRS, INSERM, Université PSL, Paris, France.
| |
Collapse
|
24
|
Turner KM, Svegborn A, Langguth M, McKenzie C, Robbins TW. Opposing Roles of the Dorsolateral and Dorsomedial Striatum in the Acquisition of Skilled Action Sequencing in Rats. J Neurosci 2022; 42:2039-2051. [PMID: 35086903 PMCID: PMC8916752 DOI: 10.1523/jneurosci.1907-21.2022] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 12/29/2021] [Accepted: 01/03/2022] [Indexed: 11/21/2022] Open
Abstract
The shift in control from dorsomedial to dorsolateral striatum during skill and habit formation has been well established, but whether striatal subregions orchestrate this shift cooperatively or competitively remains unclear. Cortical inputs have also been implicated in the shift toward automaticity, but it is unknown whether they mirror their downstream striatal targets across this transition. We addressed these questions using a five step heterogeneous action sequencing task in male rats that is optimally performed by automated chains of actions. By optimizing automatic habitual responding, we discovered that loss of function in the dorsomedial striatum accelerated sequence acquisition. In contrast, loss of function in the dorsolateral striatum impeded acquisition of sequencing, demonstrating functional opposition within the striatum. Unexpectedly, the mPFC was not involved; however, the lateral orbitofrontal cortex was critical. These results shift current theories about striatal control of behavior to a model of competitive opposition, where the dorsomedial striatum interferes with the development of dorsolateral-striatum dependent behavior.SIGNIFICANCE STATEMENT We provide the most direct evidence to date that the dorsomedial and dorsolateral striatum compete for control in the acquisition of habitual action sequences. The dorsolateral striatum was critical for sequencing behavior, but loss of dorsomedial striatum function enhanced acquisition. In addition, we found that the mPFC was not required for the formation of automated actions. Using a task that optimizes habitual responding, we demonstrate that the arbitration of dorsomedial and dorsolateral control is not modulated by medial prefrontal cortical activity. However, we find evidence for the role of the lateral orbitofrontal cortex in action sequencing. These results have implications for our understanding of how habits and skills form.
Collapse
Affiliation(s)
- Karly M Turner
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
- Behavioural and Cognitive Neuroscience Institute, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
- School of Psychology, University of New South Wales, Sydney, New South Wales 2052, Australia
| | - Anna Svegborn
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
- Behavioural and Cognitive Neuroscience Institute, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
| | - Mia Langguth
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
- Behavioural and Cognitive Neuroscience Institute, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
| | - Colin McKenzie
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
- Behavioural and Cognitive Neuroscience Institute, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
| | - Trevor W Robbins
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
- Behavioural and Cognitive Neuroscience Institute, University of Cambridge, Cambridge, CB2 3EB, United Kingdom
| |
Collapse
|
25
|
Wolff SBE, Ko R, Ölveczky BP. Distinct roles for motor cortical and thalamic inputs to striatum during motor skill learning and execution. SCIENCE ADVANCES 2022; 8:eabk0231. [PMID: 35213216 PMCID: PMC8880788 DOI: 10.1126/sciadv.abk0231] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 01/03/2022] [Indexed: 05/11/2023]
Abstract
The acquisition and execution of motor skills are mediated by a distributed motor network, spanning cortical and subcortical brain areas. The sensorimotor striatum is an important cog in this network, yet the roles of its two main inputs, from motor cortex and thalamus, remain largely unknown. To address this, we silenced the inputs in rats trained on a task that results in highly stereotyped and idiosyncratic movement patterns. While striatal-projecting motor cortex neurons were critical for learning these skills, silencing this pathway after learning had no effect on performance. In contrast, silencing striatal-projecting thalamus neurons disrupted the execution of the learned skills, causing rats to revert to species-typical pressing behaviors and preventing them from relearning the task. These results show distinct roles for motor cortex and thalamus in the learning and execution of motor skills and suggest that their interaction in the striatum underlies experience-dependent changes in subcortical motor circuits.
Collapse
Affiliation(s)
| | - Raymond Ko
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA 02138, USA
| | | |
Collapse
|
26
|
Martinez MC, Zold CL, Coletti MA, Murer MG, Belluscio MA. Dorsal striatum coding for the timely execution of action sequences. eLife 2022; 11:74929. [PMID: 36426715 PMCID: PMC9699698 DOI: 10.7554/elife.74929] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Accepted: 10/27/2022] [Indexed: 11/27/2022] Open
Abstract
The automatic initiation of actions can be highly functional. But occasionally these actions cannot be withheld and are released at inappropriate times, impulsively. Striatal activity has been shown to participate in the timing of action sequence initiation and it has been linked to impulsivity. Using a self-initiated task, we trained adult male rats to withhold a rewarded action sequence until a waiting time interval has elapsed. By analyzing neuronal activity we show that the striatal response preceding the initiation of the learned sequence is strongly modulated by the time subjects wait before eliciting the sequence. Interestingly, the modulation is steeper in adolescent rats, which show a strong prevalence of impulsive responses compared to adults. We hypothesize this anticipatory striatal activity reflects the animals’ subjective reward expectation, based on the elapsed waiting time, while the steeper waiting modulation in adolescence reflects age-related differences in temporal discounting, internal urgency states, or explore–exploit balance.
Collapse
Affiliation(s)
- Maria Cecilia Martinez
- Universidad de Buenos Aires, Facultad de Ciencias Exactas y Naturales, Departamento de Fisiología, Biología Molecular y Celular “Dr. Héctor Maldonado”Buenos AiresArgentina,Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina
| | - Camila Lidia Zold
- Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina,Universidad de Buenos Aires, Facultad de Ciencias Médicas, Departamento de FisiologíaBuenos AiresArgentina
| | - Marcos Antonio Coletti
- Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina,Universidad de Buenos Aires, Facultad de Ciencias Médicas, Departamento de FisiologíaBuenos AiresArgentina
| | - Mario Gustavo Murer
- Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina,Universidad de Buenos Aires, Facultad de Ciencias Médicas, Departamento de FisiologíaBuenos AiresArgentina
| | - Mariano Andrés Belluscio
- Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina,Universidad de Buenos Aires, Facultad de Ciencias Médicas, Departamento de FisiologíaBuenos AiresArgentina
| |
Collapse
|
27
|
Rutherford LG, Milton AL. Deconstructing and reconstructing behaviour relevant to mental health disorders: The benefits of a psychological approach, with a focus on addiction. Neurosci Biobehav Rev 2021; 133:104514. [PMID: 34958822 DOI: 10.1016/j.neubiorev.2021.104514] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Revised: 09/30/2021] [Accepted: 11/16/2021] [Indexed: 12/14/2022]
Abstract
RUTHERFORD, L.G. and Milton, A.L. Deconstructing and reconstructing behaviour relevant to mental health disorders: what can psychology offer? NEUROSCI BIOBEHAV REV XX(X)XXX-XXX, 2021. - Current treatments for mental health disorders are successful only for some patients, and there is an unmet clinical need for new treatment development. One challenge for treatment development has been how best to model complex human conditions in animals, where mechanism can be more readily studied with a range of neuroscientific techniques. We suggest that an approach to modelling based on associative animal learning theory provides a good framework for deconstructing complex mental health disorders such that they can be studied in animals. These individual simple models can subsequently be used in combination to 'reconstruct' a more complex model of the mental health disorder of interest. Using examples primarily from the field of drug addiction, we explore the 'psychological approach' and suggest that in addition to facilitating translation and backtranslation of tasks between animal models and patients, it is also highly concordant with the concept of triangulation.
Collapse
Affiliation(s)
| | - Amy L Milton
- Department of Psychology, University of Cambridge, United Kingdom.
| |
Collapse
|
28
|
Pribut HJ, Vázquez D, Wei AD, Tennyson SS, Davis IR, Roesch MR, Li X. Overexpressing Histone Deacetylase 5 in Rat Dorsal Striatum Alters Reward-Guided Decision-Making and Associated Neural Encoding. J Neurosci 2021; 41:10080-10090. [PMID: 34716230 PMCID: PMC8660049 DOI: 10.1523/jneurosci.0916-21.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 10/14/2021] [Accepted: 10/21/2021] [Indexed: 11/21/2022] Open
Abstract
Accumulating evidence in the past decade implicates histone-modifying enzymes, such as class I histone deacetylases (HDACs), in learning and memory and, recently, habit formation. However, it is unclear whether HDACs play roles in complex cognitive function. To address this issue, we examined the role of dorsal striatal HDAC5, a class II HDAC, in reward-guided decision-making and associated neural encoding in rats. We first injected adeno-associated virus to overexpress a nuclear-localized HDAC5 in dorsal striatum (DS). We then recorded neural correlates from dorsolateral striatum (DLS) as rats performed two reward-guided choice tasks, in which we manipulated either the size of or delay to reward. During these tasks, rats first learned which of two options led to the better reward and then reversed those contingencies in a second block of trials. We found that rats with HDAC5 overexpression in DS responded faster and chose higher value reward more often during the first block of trials but were less able to reverse those contingencies in the second block of trials. At the neural level, HDAC5 overexpression in DS elevated and reduced the number of cells in DLS that increased firing to stimuli and reward, respectively, and shifted encoding toward cues that predicted more immediate reward. These results suggest that the HDAC5 overexpression in DS contributes to inflexible decision-making, demonstrating a role of histone-modifying enzymes in complex cognitive function.SIGNIFICANCE STATEMENT HDACs are important for learning and habit formation. Here, we expanded on these functions and found that overexpression of HDAC5 produced faster and more automatic behavior, and related changes in dorsolateral striatal neural firing in rats performing a value-based decision-making task. These results implicate HDAC5 as a potential therapeutic target for psychiatric conditions that impair decision-making and executive function.
Collapse
Affiliation(s)
- Heather J Pribut
- Department of Psychology, University of Maryland, College Park, Maryland 20742
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, Maryland 20742
| | - Daniela Vázquez
- Department of Psychology, University of Maryland, College Park, Maryland 20742
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, Maryland 20742
| | - Alice D Wei
- Department of Psychology, University of Maryland, College Park, Maryland 20742
| | - Stephen S Tennyson
- Department of Psychology, University of Maryland, College Park, Maryland 20742
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, Maryland 20742
| | - Ian R Davis
- Department of Psychology, University of Maryland, College Park, Maryland 20742
| | - Matthew R Roesch
- Department of Psychology, University of Maryland, College Park, Maryland 20742
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, Maryland 20742
| | - Xuan Li
- Department of Psychology, University of Maryland, College Park, Maryland 20742
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, Maryland 20742
| |
Collapse
|
29
|
K Namboodiri VM, Stuber GD. The learning of prospective and retrospective cognitive maps within neural circuits. Neuron 2021; 109:3552-3575. [PMID: 34678148 PMCID: PMC8809184 DOI: 10.1016/j.neuron.2021.09.034] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2021] [Revised: 08/26/2021] [Accepted: 09/16/2021] [Indexed: 11/18/2022]
Abstract
Brain circuits are thought to form a "cognitive map" to process and store statistical relationships in the environment. A cognitive map is commonly defined as a mental representation that describes environmental states (i.e., variables or events) and the relationship between these states. This process is commonly conceptualized as a prospective process, as it is based on the relationships between states in chronological order (e.g., does reward follow a given state?). In this perspective, we expand this concept on the basis of recent findings to postulate that in addition to a prospective map, the brain forms and uses a retrospective cognitive map (e.g., does a given state precede reward?). In doing so, we demonstrate that many neural signals and behaviors (e.g., habits) that seem inflexible and non-cognitive can result from retrospective cognitive maps. Together, we present a significant conceptual reframing of the neurobiological study of associative learning, memory, and decision making.
Collapse
Affiliation(s)
- Vijay Mohan K Namboodiri
- Department of Neurology, Center for Integrative Neuroscience, Kavli Institute for Fundamental Neuroscience, Neuroscience Graduate Program, University of California, San Francisco, San Francisco, CA 94158, USA.
| | - Garret D Stuber
- Center for the Neurobiology of Addiction, Pain, and Emotion, Department of Anesthesiology and Pain Medicine, Department of Pharmacology, Neuroscience Graduate Program, University of Washington, Seattle, WA 98195, USA.
| |
Collapse
|
30
|
Vandaele Y, Ottenheimer DJ, Janak PH. Dorsomedial Striatal Activity Tracks Completion of Behavioral Sequences in Rats. eNeuro 2021; 8:ENEURO.0279-21.2021. [PMID: 34725103 PMCID: PMC8607909 DOI: 10.1523/eneuro.0279-21.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Revised: 09/24/2021] [Accepted: 10/13/2021] [Indexed: 11/21/2022] Open
Abstract
For proper execution of goal-directed behaviors, individuals require both a general representation of the goal and an ability to monitor their own progress toward that goal. Here, we examine how dorsomedial striatum (DMS), a region pivotal for forming associations among stimuli, actions, and outcomes, encodes the execution of goal-directed action sequences that require self-monitoring of behavior. We trained rats to complete a sequence of at least five consecutive lever presses (without visiting the reward port) to obtain a reward and recorded the activity of individual cells in DMS while rats performed the task. We found that the pattern of DMS activity gradually changed during the execution of the sequence, permitting accurate decoding of sequence progress from neural activity at a population level. Moreover, this sequence-related activity was blunted on trials where rats did not complete a sufficient number of presses. Overall, these data suggest a link between DMS activity and the execution of behavioral sequences that require monitoring of ongoing behavior.
Collapse
Affiliation(s)
- Youna Vandaele
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD 21218
| | - David J Ottenheimer
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD 21218
- The Solomon H. Snyder Department of Neuroscience, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, MD 21205
| | - Patricia H Janak
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD 21218
- The Solomon H. Snyder Department of Neuroscience, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, MD 21205
| |
Collapse
|
31
|
Chen Z, Zhang ZY, Zhang W, Xie T, Li Y, Xu XH, Yao H. Direct and indirect pathway neurons in ventrolateral striatum differentially regulate licking movement and nigral responses. Cell Rep 2021; 37:109847. [PMID: 34686331 DOI: 10.1016/j.celrep.2021.109847] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2021] [Revised: 08/04/2021] [Accepted: 09/28/2021] [Indexed: 11/17/2022] Open
Abstract
Drinking behavior in rodents is characterized by stereotyped, rhythmic licking movement, which is regulated by the basal ganglia. It is unclear how direct and indirect pathways control the lick bout and individual spout contact. We find that inactivating D1 and D2 receptor-expressing medium spiny neurons (MSNs) in the ventrolateral striatum (VLS) oppositely alters the number of licks in a bout. D1- and D2-MSNs exhibit different patterns of lick-sequence-related activity and different phases of oscillation time-locked to the lick cycle. On the timescale of a lick cycle, transient inactivation of D1-MSNs during tongue protrusion reduces spout contact probability, whereas transiently inactivating D2-MSNs has no effect. On the timescale of a lick bout, inactivation of D1-MSNs (D2-MSNs) causes rate increase (decrease) in a subset of basal ganglia output neurons that decrease firing during licking. Our results reveal the distinct roles of D1- and D2-MSNs in regulating licking at both coarse and fine timescales.
Collapse
Affiliation(s)
- Zhaorong Chen
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhi-Yu Zhang
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Wen Zhang
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Taorong Xie
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Yaping Li
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Xiao-Hong Xu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 201210, China
| | - Haishan Yao
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 201210, China.
| |
Collapse
|
32
|
Macpherson T, Matsumoto M, Gomi H, Morimoto J, Uchibe E, Hikida T. Parallel and hierarchical neural mechanisms for adaptive and predictive behavioral control. Neural Netw 2021; 144:507-521. [PMID: 34601363 DOI: 10.1016/j.neunet.2021.09.009] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 07/21/2021] [Accepted: 09/06/2021] [Indexed: 12/21/2022]
Abstract
Our brain can be recognized as a network of largely hierarchically organized neural circuits that operate to control specific functions, but when acting in parallel, enable the performance of complex and simultaneous behaviors. Indeed, many of our daily actions require concurrent information processing in sensorimotor, associative, and limbic circuits that are dynamically and hierarchically modulated by sensory information and previous learning. This organization of information processing in biological organisms has served as a major inspiration for artificial intelligence and has helped to create in silico systems capable of matching or even outperforming humans in several specific tasks, including visual recognition and strategy-based games. However, the development of human-like robots that are able to move as quickly as humans and respond flexibly in various situations remains a major challenge and indicates an area where further use of parallel and hierarchical architectures may hold promise. In this article we review several important neural and behavioral mechanisms organizing hierarchical and predictive processing for the acquisition and realization of flexible behavioral control. Then, inspired by the organizational features of brain circuits, we introduce a multi-timescale parallel and hierarchical learning framework for the realization of versatile and agile movement in humanoid robots.
Collapse
Affiliation(s)
- Tom Macpherson
- Laboratory for Advanced Brain Functions, Institute for Protein Research, Osaka University, Osaka, Japan
| | - Masayuki Matsumoto
- Division of Biomedical Science, Faculty of Medicine, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Hiroaki Gomi
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Co., Kanagawa, Japan
| | - Jun Morimoto
- Department of Brain Robot Interface, ATR Computational Neuroscience Laboratories, Kyoto, Japan; Graduate School of Informatics, Kyoto University, Kyoto, Japan
| | - Eiji Uchibe
- Department of Brain Robot Interface, ATR Computational Neuroscience Laboratories, Kyoto, Japan
| | - Takatoshi Hikida
- Laboratory for Advanced Brain Functions, Institute for Protein Research, Osaka University, Osaka, Japan.
| |
Collapse
|
33
|
Cunningham PJ, Regier PS, Redish AD. Dorsolateral Striatal Task-initiation Bursts Represent Past Experiences More than Future Action Plans. J Neurosci 2021; 41:8051-8064. [PMID: 34376584 PMCID: PMC8460149 DOI: 10.1523/jneurosci.3080-20.2021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 07/08/2021] [Accepted: 08/04/2021] [Indexed: 11/21/2022] Open
Abstract
The dorsolateral striatum (DLS) is involved in learning and executing procedural actions. Cell ensembles in the DLS, but not the dorsomedial striatum (DMS), exhibit a burst of firing at the start of a well-learned action sequence ("task-bracketing"). However, it is currently unclear what information is contained in these bursts. Some theories suggest that these bursts should represent the procedural action sequence itself (that they should be about future action chains), whereas others suggest that they should contain representations of the current state of the world, taking into account primarily past information. In addition, the DLS local field potential shows transient bursts of power in the 50 Hz range (γ50) around the time a learned action sequence is initiated. However, it is currently unknown how bursts of activity in DLS cell ensembles and bursts of γ50 power in the DLS local field potential are related to each other. We found that DLS bursts at lap initiation in rats represented recently experienced reward locations more than future procedural actions, indicating that task-initiation DLS bursts contain primarily retrospective, rather than prospective, information to guide procedural actions. Furthermore, representations of past reward locations increased during periods of increased γ50 power in the DLS. There was no evidence of task-initiation bursts, increased γ50 power, or retrospective reward location information in the neighboring dorsomedial striatum. These data support a role for the DLS in model-free theories of procedural decision-making over planned action-chain theories, suggesting that procedural actions derive from representations of the current and recent past.SIGNIFICANCE STATEMENT While it is well-established that the dorsolateral striatum (DLS) plays a critical role in procedural decision-making, open questions remain about the kinds of representations contained in DLS ensemble activity that guide procedural actions. We found that DLS, but not DMS, cell ensembles contained nonlocal representations of past reward locations that appear moments before task-initiation DLS bursts. These retrospective representations were temporally linked to a rise in γ50 power that also preceded the characteristic DLS burst at task-initiation. These results support models of procedural decision-making based on associations between available actions and the current state of the world over models based on planning over action-chains.
Collapse
Affiliation(s)
- Paul J Cunningham
- Department of Neuroscience, University of Minnesota, Minneapolis MN 55455
| | - Paul S Regier
- Department of Psychiatry, University of Pennsylvania Philadelphia PA 19104
| | - A David Redish
- Department of Neuroscience, University of Minnesota, Minneapolis MN 55455
| |
Collapse
|
34
|
A Translation from Goal-Directed to Habitual Control: the Striatum in Drug Addiction. CURRENT ADDICTION REPORTS 2021. [DOI: 10.1007/s40429-021-00392-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
35
|
Dhawale AK, Wolff SBE, Ko R, Ölveczky BP. The basal ganglia control the detailed kinematics of learned motor skills. Nat Neurosci 2021; 24:1256-1269. [PMID: 34267392 PMCID: PMC11152194 DOI: 10.1038/s41593-021-00889-3] [Citation(s) in RCA: 55] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Accepted: 06/08/2021] [Indexed: 02/06/2023]
Abstract
The basal ganglia are known to influence action selection and modulation of movement vigor, but whether and how they contribute to specifying the kinematics of learned motor skills is not understood. Here, we probe this question by recording and manipulating basal ganglia activity in rats trained to generate complex task-specific movement patterns with rich kinematic structure. We find that the sensorimotor arm of the basal ganglia circuit is crucial for generating the detailed movement patterns underlying the acquired motor skills. Furthermore, the neural representations in the striatum, and the control function they subserve, do not depend on inputs from the motor cortex. Taken together, these results extend our understanding of the basal ganglia by showing that they can specify and control the fine-grained details of learned motor skills through their interactions with lower-level motor circuits.
Collapse
Affiliation(s)
- Ashesh K Dhawale
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India
| | - Steffen B E Wolff
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Pharmacology, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Raymond Ko
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA
| | - Bence P Ölveczky
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA.
| |
Collapse
|
36
|
Cataldi S, Stanley AT, Miniaci MC, Sulzer D. Interpreting the role of the striatum during multiple phases of motor learning. FEBS J 2021; 289:2263-2281. [PMID: 33977645 DOI: 10.1111/febs.15908] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Revised: 03/28/2021] [Accepted: 04/30/2021] [Indexed: 01/11/2023]
Abstract
The synaptic pathways in the striatum are central to basal ganglia functions including motor control, learning and organization, action selection, acquisition of motor skills, cognitive function, and emotion. Here, we review the role of the striatum and its connections in motor learning and performance. The development of new techniques to record neuronal activity and animal models of motor disorders using neurotoxin, pharmacological, and genetic manipulations are revealing pathways that underlie motor performance and motor learning, as well as how they are altered by pathophysiological mechanisms. We discuss approaches that can be used to analyze complex motor skills, particularly in rodents, and identify specific questions central to understanding how striatal circuits mediate motor learning.
Collapse
Affiliation(s)
- Stefano Cataldi
- Departments of Psychiatry, Neurology, Pharmacology, Biology, Columbia University, New York, NY, USA.,Division of Molecular Therapeutics, New York State Psychiatric Institute, NY, USA
| | - Adrien T Stanley
- Departments of Psychiatry, Neurology, Pharmacology, Biology, Columbia University, New York, NY, USA.,Division of Molecular Therapeutics, New York State Psychiatric Institute, NY, USA
| | | | - David Sulzer
- Departments of Psychiatry, Neurology, Pharmacology, Biology, Columbia University, New York, NY, USA.,Division of Molecular Therapeutics, New York State Psychiatric Institute, NY, USA
| |
Collapse
|
37
|
Vandaele Y, Lenoir M, Vouillac-Mendoza C, Guillem K, Ahmed SH. Probing the decision-making mechanisms underlying choice between drug and nondrug rewards in rats. eLife 2021; 10:e64993. [PMID: 33900196 PMCID: PMC8075577 DOI: 10.7554/elife.64993] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Accepted: 04/17/2021] [Indexed: 12/02/2022] Open
Abstract
Delineating the decision-making mechanisms underlying choice between drug and nondrug rewards remains a challenge. This study adopts an original approach to probe these mechanisms by comparing response latencies during sampling versus choice trials. While lengthening of latencies during choice is predicted in a deliberative choice model (DCM), the race-like response competition mechanism postulated by the Sequential choice model (SCM) predicts a shortening of latencies during choice compared to sampling. Here, we tested these predictions by conducting a retrospective analysis of cocaine-versus-saccharin choice experiments conducted in our laboratory. We found that rats engage deliberative decision-making mechanisms after limited training, but adopt a SCM-like response selection mechanism after more extended training, while their behavior is presumably habitual. Thus, the DCM and SCM may not be general models of choice, as initially formulated, but could be dynamically engaged to control choice behavior across early and extended training.
Collapse
Affiliation(s)
- Youna Vandaele
- Lausanne University Hospital, Department of PsychiatryPrillySwitzerland
| | - Magalie Lenoir
- Université de Bordeaux, Institut des Maladies NeurodégénérativesBordeauxFrance
- CNRS, Institut des Maladies NeurodégénérativesBordeauxFrance
| | - Caroline Vouillac-Mendoza
- Université de Bordeaux, Institut des Maladies NeurodégénérativesBordeauxFrance
- CNRS, Institut des Maladies NeurodégénérativesBordeauxFrance
| | - Karine Guillem
- Université de Bordeaux, Institut des Maladies NeurodégénérativesBordeauxFrance
- CNRS, Institut des Maladies NeurodégénérativesBordeauxFrance
| | - Serge H Ahmed
- Université de Bordeaux, Institut des Maladies NeurodégénérativesBordeauxFrance
- CNRS, Institut des Maladies NeurodégénérativesBordeauxFrance
| |
Collapse
|
38
|
Feasibility of combining functional near-infrared spectroscopy with electroencephalography to identify chronic stroke responders to cerebellar transcranial direct current stimulation-a computational modeling and portable neuroimaging methodological study. THE CEREBELLUM 2021; 20:853-871. [PMID: 33675516 DOI: 10.1007/s12311-021-01249-4] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 02/21/2021] [Indexed: 10/22/2022]
Abstract
Feasibility of portable neuroimaging of cerebellar transcranial direct current stimulation (ctDCS) effects on the cerebral cortex has not been investigated vis-à-vis cerebellar lobular electric field strength. We studied functional near-infrared spectroscopy (fNIRS) in conjunction with electroencephalography (EEG) to measure changes in the brain activation at the prefrontal cortex (PFC) and the sensorimotor cortex (SMC) following ctDCS as well as virtual reality-based balance training (VBaT) before and after ctDCS treatment in 12 hemiparetic chronic stroke survivors. We performed general linear modeling (GLM) that putatively associated the lobular electric field strength with the changes in the fNIRS-EEG measures at the ipsilesional and contra-lesional PFC and SMC. Here, fNIRS-EEG measures were found in the latent space from canonical correlation analysis (CCA) between the changes in total hemoglobin (tHb) concentrations (0.01-0.07Hz and 0.07-0.13Hz bands) and log10-transformed EEG bandpower within 1-45 Hz where significant (Wilks' lambda>0.95) canonical correlations were found only for the 0.07-0.13-Hz band. Also, the first principal component (97.5% variance accounted for) of the mean lobular electric field strength was a good predictor of the latent variables of oxy-hemoglobin (O2Hb) concentrations and log10-transformed EEG bandpower. GLM also provided insights into non-responders to ctDCS who also performed poorly in the VBaT due to ideomotor apraxia. Future studies should investigate fNIRS-EEG joint-imaging in a larger cohort to identify non-responders based on GLM fitting to the fNIRS-EEG data.
Collapse
|
39
|
Vandaele Y, Ahmed SH. Habit, choice, and addiction. Neuropsychopharmacology 2021; 46:689-698. [PMID: 33168946 PMCID: PMC8027414 DOI: 10.1038/s41386-020-00899-y] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Revised: 10/07/2020] [Accepted: 10/19/2020] [Indexed: 12/17/2022]
Abstract
Addiction was suggested to emerge from the progressive dominance of habits over goal-directed behaviors. However, it is generally assumed that habits do not persist in choice settings. Therefore, it is unclear how drug habits may persist in real-world scenarios where this factor predominates. Here, we discuss the poor translational validity of the habit construct, which impedes our ability to determine its role in addiction. New evidence of habitual behavior in a drug choice setting are then described and discussed. Interestingly, habitual preference did not promote drug choice but instead favored abstinence. Here, we propose several clues to reconcile these unexpected results with the habit theory of addiction, and we highlight the need in experimental research to face the complexity of drug addicts' decision-making environments by investigating drug habits in the context of choice and in the presence of cues. On a theoretical level, we need to consider more complex frameworks, taking into account continuous interactions between goal-directed and habitual systems, and alternative decision-making models more representative of real-world conditions.
Collapse
Affiliation(s)
- Y Vandaele
- Department of Psychiatry, Lausanne University Hospital, Lausanne, Switzerland.
| | - S H Ahmed
- Institut des Maladies Neurodégénératives, Université de Bordeaux, Bordeaux, France
- Institut des Maladies Neurodégénératives, CNRS, Bordeaux, France
| |
Collapse
|
40
|
Moretti J, Poh EZ, Bolland SJ, Harvey AR, Albrecht MA, Rodger J. Concurrent LI-rTMS induces changes in c-Fos expression but not behavior during a progressive ratio task with adult ephrin-A2A5 -/- mice. Behav Brain Res 2020; 400:113011. [PMID: 33181182 DOI: 10.1016/j.bbr.2020.113011] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Revised: 10/04/2020] [Accepted: 11/05/2020] [Indexed: 12/28/2022]
Abstract
Changes within the dopaminergic system induced by repetitive transcranial magnetic stimulation (rTMS) may contribute to its therapeutic effects; however, dopamine-related behavioral effects of rTMS have not been widely investigated. We recently showed that ephrin-A2A5-/- mice completed significantly fewer trials in a visual task than wildtype mice, and that concurrent low-intensity (LI-) rTMS during the task could partially rescue the abnormal behavior [Poh et al. 2018, eNeuro, vol. 5]. Here, we investigated whether the behavioral differences in ephrin-A2A5-/- mice are due to abnormal motivation, primarily a dopamine-modulated behavior, and whether LI-rTMS would increase motivation. Ephrin-A2A5-/- and wildtype mice underwent 14 daily sessions of progressive ratio (PR) tasks and received either sham or LI-rTMS during the first 10 min. Ephrin-A2A5-/- mice responded more than wildtype comparisons, and LI-rTMS did not influence task performance for either strain. Therefore concurrent stimulation does not influence motivation in a PR task. However, ephrin-A2A5-/- mice did have abnormal performance in the PR tasks after a change in the PR schedule which suggests perseverative behavior. We stained for c-Fos in the prelimbic area (PrL), ventral tegmental area and nucleus accumbens (NAc) core and shell to examine neuronal activity from the final PR session. Sham ephrin-A2A5-/- mice had lower c-Fos expression in the PrL and NAc vs. wildtype mice. Ephrin-A2A5-/- mice that received LI-rTMS showed c-Fos expression closer to wildtype levels in the NAc. Combined with high PR performance, ephrin-A2A5-/- mice show an abnormal shift to habitual responding and LI-rTMS may attenuate this shift.
Collapse
Affiliation(s)
- Jessica Moretti
- School of Biological Sciences, The University of Western Australia, Perth, WA, Australia; School of Human Sciences, The University of Western Australia, Perth, WA, Australia; Perron Institute for Neurological and Translational Science, Perth, WA, Australia
| | - Eugenia Z Poh
- School of Biological Sciences, The University of Western Australia, Perth, WA, Australia; School of Human Sciences, The University of Western Australia, Perth, WA, Australia; Perron Institute for Neurological and Translational Science, Perth, WA, Australia
| | - Samuel J Bolland
- School of Biological Sciences, The University of Western Australia, Perth, WA, Australia; Perron Institute for Neurological and Translational Science, Perth, WA, Australia
| | - Alan R Harvey
- School of Human Sciences, The University of Western Australia, Perth, WA, Australia; Perron Institute for Neurological and Translational Science, Perth, WA, Australia
| | | | - Jennifer Rodger
- School of Biological Sciences, The University of Western Australia, Perth, WA, Australia; Perron Institute for Neurological and Translational Science, Perth, WA, Australia.
| |
Collapse
|
41
|
The Dorsal Striatum Energizes Motor Routines. Curr Biol 2020; 30:4362-4372.e6. [PMID: 32946750 DOI: 10.1016/j.cub.2020.08.049] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2020] [Revised: 07/22/2020] [Accepted: 08/13/2020] [Indexed: 12/15/2022]
Abstract
The dorsal striatum (dS) has been implicated in storing procedural memories and controlling movement kinematics. Since procedural memories are expressed through movements, the exact nature of the dS function has proven difficult to delineate. Here, we challenged rats in complementary locomotion-based tasks designed to alleviate this confound. Surprisingly, dS lesions did not impair the rats' ability to remember the procedure for the successful completion of motor routines. However, the speed and initiation of the reward-oriented phase of the routines were irreversibly altered by the dS lesion. Further behavioral analyses, combined with modeling in the optimal control framework, indicated that these kinematic alterations were well explained by an increased sensitivity to effort. Our work provides evidence supporting a primary role of the dS in modulating the kinematics of reward-oriented actions, a function that may be related to the optimization of the energetic costs of moving.
Collapse
|
42
|
Bergstrom HC, Lieberman AG, Graybeal C, Lipkin AM, Holmes A. Dorsolateral striatum engagement during reversal learning. ACTA ACUST UNITED AC 2020; 27:418-422. [PMID: 32934094 PMCID: PMC7497112 DOI: 10.1101/lm.051714.120] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2020] [Accepted: 06/19/2020] [Indexed: 01/05/2023]
Abstract
Most experimental preparations demonstrate a role for dorsolateral striatum (DLS) in stimulus-response, but not outcome-based, learning. Here, we assessed DLS involvement in a touchscreen-based reversal task requiring mice to update choice following a change in stimulus-reward contingencies. In vivo single-unit recordings in the DLS showed reversal produced a population-level shift from excited to inhibited neuronal activity prior to choices being made. The larger the shift, the faster mice reversed. Furthermore, optogenetic photosilencing DLS neurons during choice increased early reversal errors. These findings suggest dynamic DLS engagement may facilitate reversal, possibly by signaling a change in contingencies to other striatal and cortical regions.
Collapse
Affiliation(s)
- Hadley C Bergstrom
- Laboratory of Behavioral and Genomic Neuroscience, National Institute on Alcoholism and Alcohol Abuse (NIAAA), National Institutes of Health (NIH), Bethesda, Maryland 20852, USA
| | - Abby G Lieberman
- Laboratory of Behavioral and Genomic Neuroscience, National Institute on Alcoholism and Alcohol Abuse (NIAAA), National Institutes of Health (NIH), Bethesda, Maryland 20852, USA
| | - Carolyn Graybeal
- Laboratory of Behavioral and Genomic Neuroscience, National Institute on Alcoholism and Alcohol Abuse (NIAAA), National Institutes of Health (NIH), Bethesda, Maryland 20852, USA
| | - Anna M Lipkin
- Laboratory of Behavioral and Genomic Neuroscience, National Institute on Alcoholism and Alcohol Abuse (NIAAA), National Institutes of Health (NIH), Bethesda, Maryland 20852, USA
| | - Andrew Holmes
- Laboratory of Behavioral and Genomic Neuroscience, National Institute on Alcoholism and Alcohol Abuse (NIAAA), National Institutes of Health (NIH), Bethesda, Maryland 20852, USA
| |
Collapse
|
43
|
Florio TM. Stereotyped, automatized and habitual behaviours: are they similar constructs under the control of the same cerebral areas? AIMS Neurosci 2020; 7:136-152. [PMID: 32607417 PMCID: PMC7321770 DOI: 10.3934/neuroscience.2020010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Accepted: 05/18/2020] [Indexed: 11/19/2022] Open
Abstract
Comprehensive knowledge about higher executive functions of motor control has been covered in the last decades. Critical goals have been targeted through many different technological approaches. An abundant flow of new results greatly progressed our ability to respond at better-posited answers to look more than ever at the challenging neural system functioning. Behaviour is the observable result of the invisible, as complex cerebral functioning. Many pathological states are approached after symptomatology categorisation of behavioural impairments is achieved. Motor, non-motor and psychiatric signs are greatly shared by many neurological/psychiatric disorders. Together with the cerebral cortex, the basal ganglia contribute to the expression of behaviour promoting the correct action schemas and the selection of appropriate sub-goals based on the evaluation of action outcomes. The present review focus on the basic classification of higher motor control functioning, taking into account the recent advances in basal ganglia structural knowledge and the computational model of basal ganglia functioning. We discuss about the basal ganglia capability in executing ordered motor patterns in which any single movement is linked to each other into an action, and many actions are ordered into each other, giving them a syntactic value to the final behaviour. The stereotypic, automatized and habitual behaviour's constructs and controls are the expression of successive stages of rule internalization and categorisation aimed in producing the perfect spatial-temporal control of motor command.
Collapse
Affiliation(s)
- Tiziana M Florio
- Department of Life, Health and Environmental Sciences, University of L'Aquila, Italy
| |
Collapse
|
44
|
Collins AL, Saunders BT. Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking. J Neurosci Res 2020; 98:1046-1069. [PMID: 32056298 PMCID: PMC7183907 DOI: 10.1002/jnr.24587] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2019] [Revised: 01/08/2020] [Accepted: 01/16/2020] [Indexed: 01/03/2023]
Abstract
The striatal dopamine system has long been studied in the context of reward learning, motivation, and movement. Given the prominent role dopamine plays in a variety of adaptive behavioral states, as well as diseases like addiction, it is essential to understand the full complexity of dopamine neurons and the striatal systems they target. A growing number of studies are uncovering details of the heterogeneity in dopamine neuron subpopulations. Here, we review that work to synthesize current understanding of dopamine system heterogeneity across three levels, anatomical organization, functions in behavior, and modes of action, wherein we focus on signaling profiles and local mechanisms for modulation of dopamine release. Together, these studies reveal new and emerging dimensions of the striatal dopamine system, informing its contribution to dynamic motivational and decision-making processes.
Collapse
Affiliation(s)
- Anne L. Collins
- University of Minnesota, Department of Neuroscience, Medical Discovery Team on Addiction, Minneapolis, MN 55455
| | - Benjamin T. Saunders
- University of Minnesota, Department of Neuroscience, Medical Discovery Team on Addiction, Minneapolis, MN 55455
| |
Collapse
|
45
|
Vandaele Y, Guillem K, Ahmed SH. Habitual Preference for the Nondrug Reward in a Drug Choice Setting. Front Behav Neurosci 2020; 14:78. [PMID: 32523517 PMCID: PMC7261826 DOI: 10.3389/fnbeh.2020.00078] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2020] [Accepted: 04/28/2020] [Indexed: 11/28/2022] Open
Abstract
For adaptive and efficient decision making, it must be possible to select between habitual alternative courses of action. However, research in rodents suggests that, even in the context of simple decision-making, choice behavior remains goal-directed. In contrast, we recently found that during discrete trial choice between cocaine and water, water-restricted rats preferred water and this preference was habitual and inflexible (i.e., resistant to water devaluation by satiation). Here we sought to test the reproducibility and generality of this surprising finding by assessing habitual control of preference for saccharin over cocaine in non-restricted rats. Specifically, after the acquisition of preference for saccharin, saccharin was devalued and concurrent responding for both options was measured under extinction. As expected, rats responded more for saccharin than for cocaine during extinction, but this difference was unaffected by saccharin devaluation. Together with our previous research, this result indicates that preference for nondrug alternatives over cocaine is under habitual control, even under conditions that normally support goal-directed control of choice between nondrug options. The possible reasons for this difference are discussed.
Collapse
Affiliation(s)
- Youna Vandaele
- Department of Psychiatry, Center for Psychiatric Neuroscience, Lausanne University Hospital, Lausanne, Switzerland
| | - Karine Guillem
- Institut des Maladies Neurodégénératives, UMR 5293, Université de Bordeaux, Bordeaux, France
- CNRS, Institut des Maladies Neurodégénératives, UMR 5293, Bordeaux, France
| | - Serge H. Ahmed
- Institut des Maladies Neurodégénératives, UMR 5293, Université de Bordeaux, Bordeaux, France
- CNRS, Institut des Maladies Neurodégénératives, UMR 5293, Bordeaux, France
| |
Collapse
|
46
|
Lerner TN. Interfacing behavioral and neural circuit models for habit formation. J Neurosci Res 2020; 98:1031-1045. [PMID: 31916623 DOI: 10.1002/jnr.24581] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2019] [Revised: 12/15/2019] [Accepted: 12/18/2019] [Indexed: 12/26/2022]
Abstract
Habits are an important mechanism by which organisms can automate the control of behavior to alleviate cognitive demand. However, transitions to habitual control are risky because they lead to inflexible responding in the face of change. The question of how the brain controls transitions into habit is thus an intriguing one. How do we regulate when our repeated actions become automated? When is it advantageous or disadvantageous to release actions from cognitive control? Decades of research have identified a variety of methods for eliciting habitual responding in animal models. Progress has also been made to understand which brain areas and neural circuits control transitions into habit. Here, I discuss existing research on behavioral and neural circuit models for habit formation (with an emphasis on striatal circuits), and discuss strategies for combining information from different paradigms and levels of analysis to prompt further progress in the field.
Collapse
Affiliation(s)
- Talia N Lerner
- Department of Physiology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
47
|
Vandaele Y, Mahajan NR, Ottenheimer DJ, Richard JM, Mysore SP, Janak PH. Distinct recruitment of dorsomedial and dorsolateral striatum erodes with extended training. eLife 2019; 8:49536. [PMID: 31621583 PMCID: PMC6822989 DOI: 10.7554/elife.49536] [Citation(s) in RCA: 43] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Accepted: 10/16/2019] [Indexed: 12/20/2022] Open
Abstract
Hypotheses of striatal orchestration of behavior ascribe distinct functions to striatal subregions, with the dorsolateral striatum (DLS) especially implicated in habitual and skilled performance. Thus neural activity patterns recorded from the DLS, but not the dorsomedial striatum (DMS), should be correlated with habitual and automatized performance. Here, we recorded DMS and DLS neural activity in rats during training in a task promoting habitual lever pressing. Despite improving performance across sessions, clear changes in corresponding neural activity patterns were not evident in DMS or DLS during early training. Although DMS and DLS activity patterns were distinct during early training, their activity was similar following extended training. Finally, performance after extended training was not associated with DMS disengagement, as would be predicted from prior work. These results suggest that behavioral sequences may continue to engage both striatal regions long after initial acquisition, when skilled performance is consolidated.
Collapse
Affiliation(s)
- Youna Vandaele
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, United States
| | - Nagaraj R Mahajan
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, United States
| | - David J Ottenheimer
- The Solomon H. Snyder Department of Neuroscience, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, United States
| | - Jocelyn M Richard
- Department of Neuroscience, University of Minnesota, Minneapolis, United States
| | - Shreesh P Mysore
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, United States.,The Solomon H. Snyder Department of Neuroscience, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, United States
| | - Patricia H Janak
- Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, United States.,The Solomon H. Snyder Department of Neuroscience, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, United States.,Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, United States
| |
Collapse
|