The role of the dorsomedial striatum in instrumental conditioning

Shared and distinct aberrations in frontal-striatal system functional patterns among patients with irritable bowel syndrome and major depressive disorder

BACKGROUND

Considering the high comorbidity, shared risk factors, and genetic pathways between irritable bowel syndrome (IBS) and major depressive disorder (MDD), we hypothesized that there would be both shared and disorder-specific alterations in brain function.

METHODS

A total of 39 IBS patients, 39 MDD patients, and 40 healthy controls (HCs) were enrolled and matched for sex, age, and educational level. All subjects underwent resting-state functional MRI. The clinical variables of anxiety, depression, gastrointestinal symptoms and alexithymia were recorded. The 12 subregions of the striatum were employed as seeds to assess their functional connectivity (FC) with every voxel throughout the whole brain.

RESULTS

Compared to HC, IBS and MDD patients exhibited aberrant frontal-striatal circuitry. We observed a common decrease in FC between the dorsal striatum and regions of the hippocampus, sensorimotor cortex, and prefrontal cortex (PFC) in both IBS and MDD patients. Patients with IBS exhibited disorder-specific decreases in FC within the striatum, along with reduced connectivity between the ventral striatum and sensorimotor cortex. In contrast, MDD patients showed disorder-specific hyperconnectivity in the medial PFC-limbic system. Receiver operating characteristic curve analysis showed that frontal-striatal FC values could serve as transdiagnostic markers of IBS and MDD. Within the IBS group, striatal connectivity was not only negatively associated with weekly abdominal pain days but also negatively correlated with the levels of anxiety and alexithymia.

CONCLUSIONS

This exploratory analysis indicated that patients with IBS and MDD exhibited both shared and disorder-specific frontal-striatal circuit impairments, potentially explaining both comorbidity and distinct phenotypes.

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine

The catecholamine neuromodulators dopamine and norepinephrine are implicated in motor function, motivation, and cognition. Although roles for striatal dopamine in these aspects of behavior are well established, the specific roles for cortical catecholamines in regulating striatal dopamine dynamics and behavior are less clear. We recently showed that elevating cortical dopamine but not norepinephrine suppresses hyperactivity in dopamine transporter knockout (DAT-KO) mice, which have elevated striatal dopamine levels. In contrast, norepinephrine transporter knockout (NET-KO) mice have a phenotype distinct from DAT-KO mice, as they show elevated extracellular cortical catecholamines but reduced baseline striatal dopamine levels. Here we evaluated the consequences of altered catecholamine levels in NET-KO mice on cognitive flexibility and striatal dopamine dynamics. In a probabilistic reversal learning task, NET-KO mice showed enhanced reversal learning, which was consistent with larger phasic dopamine transients (dLight) in the dorsomedial striatum (DMS) during reward delivery and reward omission, compared to WT controls. Selective depletion of dorsal medial prefrontal cortex (mPFC) norepinephrine in WT mice did not alter performance on the reversal learning task but reduced nestlet shredding. Surprisingly, NET-KO mice did not show altered breakpoints in a progressive ratio task, suggesting intact food motivation. Collectively, these studies show novel roles of cortical catecholamines in the regulation of tonic and phasic striatal dopamine dynamics and cognitive flexibility, updating our current views on dopamine regulation and informing future therapeutic strategies to counter multiple psychiatric disorders.

Random interval schedule of reinforcement influences punishment resistance for cocaine in rats

In an animal model of compulsive drug use, a subset of rats continues to self-administer cocaine despite footshock consequences and is considered punishment resistant. We recently found that punishment resistance is associated with habits that persist under conditions that typically encourage a transition to goal-directed control. Given that random ratio (RR) and random interval (RI) schedules of reinforcement influence whether responding is goal-directed or habitual, we investigated the influence of these schedules on punishment resistance for cocaine or food. Male and female Sprague Dawley rats were trained to self-administer either intravenous cocaine or food pellets on a seeking-taking chained schedule of reinforcement, with the seeking lever requiring completion of either an RR20 or RI60 schedule. Rats were then given four days of punishment testing with footshock administered at the completion of seeking on a random one-third of trials. For cocaine-trained rats, the RI60 schedule led to greater punishment resistance (i.e., more trials completed) than the RR20 schedule in males and females. For food-trained rats, the RI60 schedule led to greater punishment resistance (i.e., higher reward rates) than the RR20 schedule in female rats, although male rats showed punishment resistance on both RR20 and RI60 schedules. For both cocaine and food, we found that seeking responses were suppressed to a greater degree than reward rate with the RI60 schedule, whereas response rate and reward rate were equally suppressed with the RR20 schedule. This dissociation between punishment effects on reward rate and response rate with the RI60 schedule can be explained by the nonlinear relation between these variables on RI schedules, but it does not account for the enhanced resistance to punishment. Overall, the results show greater punishment resistance with the RI60 schedule as compared to the RR20 schedule, indicating that schedules of reinforcement are an influencing factor on resistance to negative consequences.

Dorsomedial Striatum CB1R signaling is required for Pavlovian outcome devaluation in male Long Evans rats and reduces inhibitory synaptic transmission in both sexes

Cannabinoid-1 receptor (CB1R) signaling in the dorsal striatum regulates the shift from flexible to habitual behavior in instrumental outcome devaluation. Based on prior work establishing individual, sex, and experience-dependent differences in Pavlovian behaviors, we predicted a role for dorsomedial striatum CB1R signaling in driving rigid responding in Pavlovian autoshaping and outcome devaluation. We trained male and female Long Evans rats in Pavlovian Lever Autoshaping (PLA). We gave intra-dorsomedial striatum (DMS) infusions of the CB1R inverse agonist, rimonabant, before satiety-induced outcome devaluation test sessions, where we sated rats on training pellets or home cage chow and tested them in brief nonreinforced Pavlovian Lever Autoshaping sessions. Overall, inhibition of DMS CB1R signaling prevented Pavlovian outcome devaluation but did not affect behavior in reinforced PLA sessions. Males were sensitive to devaluation while females were not and DMS CB1R inhibition impaired devaluation sensitivity in males. We then investigated how DMS CB1R signaling impacts local inhibitory synaptic transmission in male and female Long Evans rats. We recorded spontaneous inhibitory postsynaptic currents (sIPSC) from DMS neurons at baseline and before and after application of a CB1R agonist, WIN 55,212-2. We found that male rats showed decreased sIPSC frequency compared to females, and that CB1R activation reduced DMS inhibitory transmission independent of sex. Altogether our results demonstrate that DMS CB1Rs regulate Pavlovian devaluation sensitivity and inhibitory synaptic transmission and suggest that basal sex differences in inhibitory synaptic transmission may underly sex differences in DMS function and behavioral flexibility.

Manipulations of the context-response relationship reduce the expression of response habits

Habitual instrumental behaviour is believed to rely on stimulus-response (S-R) associations. However, the method most commonly used to identify habitual behaviour, outcome devaluation, provides only indirect evidence of S-R control. Therefore, it is important to have a better understanding of the S-R association believed to underlie habitual responding. Under free-operant conditions, the context itself likely serves as at least part of the relevant stimuli in the association, and so modifications to the predictive power of the context should alter the expression of habits. The following experiments investigated how changes to the relationship between the training context and performance of the response, either by changing the context during testing or by exposing animals to the context alone, without the response lever present, impacted behavioural control during a devaluation test. We found evidence that the training context is important for the expression of habits; testing animals in a different context than where they were trained resulted in increased goal-directed control (Experiment 1). Furthermore, context alone exposure also increased goal-directed control with animals that received context alone exposure showing stronger devaluation effects, whether the context alone exposure happened on the last day of training (Experiment 2) or throughout training (Experiment 3). These findings are consistent with prior reports that the training context is important for the expression of habits and extends these findings by using sensory-specific satiety as a means for devaluation and by using context alone exposure to alter behavioural control.

Bad habits-good goals? Meta-analysis and translation of the habit construct to alcoholism

Excessive alcohol consumption remains a global public health crisis, with millions suffering from alcohol use disorder (AUD, or simply "alcoholism"), leading to significantly reduced life expectancy. This review examines the interplay between habitual and goal-directed behaviors and the associated neurobiological changes induced by chronic alcohol exposure. Contrary to a strict habit-goal dichotomy, our meta-analysis of the published animal experiments combined with a review of human studies reveals a nuanced transition between these behavioral control systems, emphasizing the need for refined terminology to capture the probabilistic nature of decision biases in individuals with a history of chronic alcohol exposure. Furthermore, we distinguish habitual responding from compulsivity, viewing them as separate entities with diverse roles throughout the stages of the addiction cycle. By addressing species-specific differences and translational challenges in habit research, we provide insights to enhance future investigations and inform strategies for combatting AUD.

The Small G-Protein Rac1 in the Dorsomedial Striatum Promotes Alcohol-Dependent Structural Plasticity and Goal-Directed Learning in Mice

The small G-protein Ras-related C3 botulinum toxin substrate 1 (Rac1) promotes the formation of filamentous actin (F-actin). Actin is a major component of dendritic spines, and we previously found that alcohol alters actin composition and dendritic spine structure in the nucleus accumbens (NAc) and the dorsomedial striatum (DMS). To examine if Rac1 contributes to these alcohol-mediated adaptations, we measured the level of GTP-bound active Rac1 in the striatum of mice following 7 weeks of intermittent access to 20% alcohol. We found that chronic alcohol intake activates Rac1 in the DMS of male mice. In contrast, Rac1 is not activated by alcohol in the NAc and DLS of male mice or in the DMS of female mice. Similarly, closely related small G-proteins are not activated by alcohol in the DMS, and Rac1 activity is not increased in the DMS by moderate alcohol or natural reward. To determine the consequences of alcohol-dependent Rac1 activation in the DMS of male mice, we inhibited endogenous Rac1 by infecting the DMS of mice with an adeno-associated virus (AAV) expressing a dominant negative form of the small G-protein (Rac1-DN). We found that overexpression of AAV-Rac1-DN in the DMS inhibits alcohol-mediated Rac1 signaling and attenuates alcohol-mediated F-actin polymerization, which corresponded with a decrease in dendritic arborization and spine maturation. Finally, we provide evidence to suggest that Rac1 in the DMS plays a role in alcohol-associated goal-directed learning. Together, our data suggest that Rac1 in the DMS plays an important role in alcohol-dependent structural plasticity and aberrant learning.

Impact and Interrelationships of Striatal Proteins, EPHB2, OPRM1, and PER2 on Mild Cognitive Impairment

With the global increase in life expectancy, there has been a rise in the incidence of cognitive impairments attributed to diverse etiologies. Notably, approximately 50% of individuals diagnosed with mild cognitive impairment (MCI) progress to dementia within 3 years. However, the precise mechanisms underlying MCI remain elusive. Therefore, this study aimed to elucidate potential mechanisms implicated in MCI utilizing Per2 knockout (KO) mice, which have previously been shown to have cognitive deficits. Behavioral (Y-maze, Barnes maze) and molecular (electrophysiology, RNA sequencing, western blot, and immunofluorescence) experiments were conducted in Per2 KO and wild-type (WT) mice. Per2 KO mice exhibited impaired spatial working memory in the Y-maze and Barnes maze. However, there were no significant group differences in hippocampal long-term potentiation (LTP) between Per2 KO and WT mice, whereas striatal LTP in Per2 KO mice was lower compared to WT mice. In RNA sequencing analysis, 58 genes were downregulated and 64 genes were upregulated in the striatum of Per2 KO mice compared to WT mice. Among the differentially expressed genes, four genes (Chrm2, EphB2, Htr1b, Oprm1) were identified. Optimal expression levels of EPHB2 and OPRM1 were found to significantly enhance cognitive performance in mice. Additionally, Per2 KO mice exhibited reduced EPHB2-NMDAR-LTP and OPRM-mTOR signaling, along with elevated amyloid beta (Aβ) levels, when compared to WT mice. However, these alterations were reversed upon administration of morphine treatment. Striatal OPRM1-mTOR signaling, EPHB2-NMDAR-LTP signaling, and Aβ expression levels may exert a combined effect on MCI under the control of Per2 expression.

Control of goal-directed and inflexible actions by dorsal striatal melanocortin systems, in coordination with the central nucleus of the amygdala

The dorsomedial striatum (DMS) is associated with flexible goal seeking, as opposed to routinized habits. Whether local mechanisms brake this function, for instance when habits may be adaptive, is incompletely understood. We find that a sub-population of dopamine D1 receptor-containing striatal neurons express the melanocortin-4 receptor (MC4R) for α-melanocyte stimulating hormone. These neurons within the DMS are necessary and sufficient for controlling the capacity of mice to flexibly adjust actions based on the likelihood that they will be rewarded. In investigating MC4R function, we found that it suppresses immediate-early gene levels in the DMS and concurrently, flexible goal seeking. MC4R+ neurons receive input from the central nucleus of the amygdala, and behavioral experiments indicate that they are functionally integrated into an amygdalo-striatal circuit that suppresses action flexibility in favor of routine. Publicly available spatial transcriptomics datasets were analyzed for gene transcript correlates of Mc4r expression across the striatal subregions, revealing considerable co-variation in dorsal structures. This insight led to the discovery that the function of MC4R in the dorsolateral striatum complements that in the DMS, in this case suppressing habit-like behavior. Altogether, our findings suggest that striatal MC4R controls the capacity for goal-directed and inflexible actions alike.

Stochastic characterization of navigation strategies in an automated variant of the Barnes maze

Animals can use a repertoire of strategies to navigate in an environment, and it remains an intriguing question how these strategies are selected based on the nature and familiarity of environments. To investigate this question, we developed a fully automated variant of the Barnes maze, characterized by 24 vestibules distributed along the periphery of a circular arena, and monitored the trajectories of mice over 15 days as they learned to navigate towards a goal vestibule from a random start vestibule. We show that the patterns of vestibule visits can be reproduced by the combination of three stochastic processes reminiscent of random, serial, and spatial strategies. The processes randomly selected vestibules based on either uniform (random) or biased (serial and spatial) probability distributions. They closely matched experimental data across a range of statistical distributions characterizing the length, distribution, step size, direction, and stereotypy of vestibule sequences, revealing a shift from random to spatial and serial strategies over time, with a strategy switch occurring approximately every six vestibule visits. Our study provides a novel apparatus and analysis toolset for tracking the repertoire of navigation strategies and demonstrates that a set of stochastic processes can largely account for exploration patterns in the Barnes maze.

Ceftriaxone reverses diet-induced deficits in goal-directed control

RATIONALE

Obesity is associated with numerous health risks and ever-increasing rates are a significant global concern. However, despite weight loss attempts many people have difficulty maintaining weight loss. Previous studies in animals have shown that chronic access to an obesogenic diet can disrupt goal-directed behavior, impairing the ability of animals to flexibly adjust food-seeking behavior following changes in the value of earned outcomes. Changes in behavioral control have been linked to disruption of glutamate transmission in the dorsal medial striatum (DMS), a region critical for the acquisition and expression of goal-directed behavior.

OBJECTIVES

The goal of this study was to test whether ceftriaxone, a beta-lactam antibiotic shown elsewhere to upregulate the expression of the glutamate transporter GLT-1, would improve goal-directed control following long-term exposure to an obesogenic diet.

METHODS

Male and female rats were given access to either standard chow or chow plus sweetened condensed milk (SCM) for 6 weeks. Access to SCM was ended and rats received daily injections of either ceftriaxone or saline for 6 days. Rats were then trained to press a lever to earn a novel food reward and, finally, were assessed for sensitivity to outcome devaluation. Histological analyses examined changes to GLT-1 protein levels and morphological changes to astrocytes, within the DMS.

RESULTS

We found that ceftriaxone robustly restored goal-directed behavior in animals following long-term exposure to SCM. While we did not observe changes in protein levels of GLT-1 in the DMS, we observed that SCM induced changes in the morphology of astrocytes in the DMS, and that ceftriaxone mitigated these changes.

CONCLUSIONS

These results demonstrate that long-term access to a SCM diet impairs goal-directed behavior while also altering the morphology of astrocytes in the DMS. Furthermore, these results suggest that ceftriaxone administration can reverse the impairment of goal-directed behavior potentially through its actions on astrocytes in decision-making circuitry.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration. We then exposed them to four days of punishment testing in which footshock was delivered randomly on one-third of trials. Before and after punishment testing (four days pre-punishment and ≥ four days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance for cocaine was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment in males, although it was associated with habitual responding both pre- and post-punishment in females, indicating that punishment resistance was predicted by habitual responding in food-seeking females. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Changes in dorsomedial striatum activity during expression of goal-directed vs. habit-like cue-induced cocaine seeking

A preclinical model of cue exposure therapy, cue extinction, reduces cue-induced cocaine seeking that is goal-directed but not habit-like. Goal-directed and habitual behaviors differentially rely on the dorsomedial striatum (DMS) and dorsolateral striatum (DLS), but the effects of cue extinction on dorsal striatal responses to cue-induced drug seeking are unknown. We used fiber photometry in rats trained to self-administer cocaine paired with an audiovisual cue to examine how dorsal striatal intracellular calcium and extracellular dopamine activity differs between goal-directed and habit-like cue-induced cocaine seeking and how it is impacted by cue extinction. After minimal fixed-ratio training, rats showed enhanced DMS and DLS calcium responses to cue-reinforced compared to unreinforced lever presses. After rats were trained on goal-promoting fixed ratio schedules or habit-promoting second-order schedules of reinforcement, different patterns of dorsal striatal calcium and dopamine responses to cue-reinforced lever presses emerged. Rats trained on habit-promoting second-order schedules showed reduced DMS calcium responses and enhanced DLS dopamine responses to cue-reinforced lever presses. Cue extinction reduced calcium responses during subsequent drug seeking in the DMS, but not in the DLS. Therefore, cue extinction may reduce goal-directed behavior through its effects on the DMS, whereas habit-like behavior and the DLS are unaffected.

What Role Does Striatal Dopamine Play in Goal-directed Action?

Evidence suggests that dopamine activity provides a US-related prediction error for Pavlovian conditioning and the reinforcement signal supporting the acquisition of habits. However, its role in goal-directed action is less clear. There are currently few studies that have assessed dopamine release as animals acquire and perform self-paced instrumental actions. Here we briefly review the literature documenting the psychological, behavioral and neural bases of goal-directed actions in rats and mice, before turning to describe recent studies investigating the role of dopamine in instrumental learning and performance. Plasticity in dorsomedial striatum, a central node in the network supporting goal-directed action, clearly requires dopamine release, the timing of which, relative to cortical and thalamic inputs, determines the degree and form of that plasticity. Beyond this, bilateral release appears to reflect reward prediction errors as animals experience the consequences of an action. Such signals feedforward to update the value of the specific action associated with that outcome during subsequent performance, with dopamine release at the time of action reflecting the updated predicted action value. More recently, evidence has also emerged for a hemispherically lateralised signal associated with the action; dopamine release is greater in the hemisphere contralateral to the spatial target of the action. This effect emerges over the course of acquisition and appears to reflect the strength of the action-outcome association. Thus, during goal-directed action, dopamine release signals the action, the outcome and their association to shape the learning and performance processes necessary to support this form of behavioral control.

Conditional deletion of neurexin-2 impaired behavioral flexibility to alterations in action-outcome contingency

Neurexins (Nrxns) are critical for synapse organization and their mutations have been documented in autism spectrum disorder, schizophrenia, and epilepsy. We recently reported that conditional deletion of Nrxn2, under the control of Emx1Cre promoter, predominately expressed in the neocortex and hippocampus (Emx1-Nrxn2 cKO mice) induced stereotyped patterns of behavior in mice, suggesting behavioral inflexibility. In this study, we investigated the effects of Nrxn2 deletion through two different conditional approaches targeting presynaptic cortical neurons projecting to dorsomedial striatum on the flexibility between goal-directed and habitual actions in response to devaluation of action-outcome (A-O) contingencies in an instrumental learning paradigm or upon reversal of A-O contingencies in a water T-maze paradigm. Nrxn2 deletion through both the conditional approaches induced an inability of mice to discriminate between goal-directed and habitual action strategies in their response to devaluation of A-O contingency. Emx1-Nrxn2 cKO mice exhibited reversal learning deficits, indicating their inability to adopt new action strategies. Overall, our studies showed that Nrxn2 deletion through two distinct conditional deletion approaches impaired flexibility in response to alterations in A-O contingencies. These investigations can lay the foundation for identification of novel genetic factors underlying behavioral inflexibility.

The small G-protein Rac1 in the dorsomedial striatum promotes alcohol-dependent structural plasticity and goal-directed learning in mice

The small G-protein Rac1 promotes the formation of filamentous actin (F-Actin). Actin is a major component of dendritic spines, and we previously found that alcohol alters actin composition and dendritic spine structure in the nucleus accumbens (NAc) and the dorsomedial striatum (DMS). To examine if Rac1 contributes to these alcohol-mediated adaptations, we measured the level of GTP-bound active Rac1 in the striatum of mice following 7 weeks of intermittent access to 20% alcohol. We found that chronic alcohol intake activates Rac1 in the DMS of male mice. In contrast, Rac1 is not activated by alcohol in the NAc and DLS of male mice, or in the DMS of female mice. Similarly, closely related small G-proteins are not activated by alcohol in the DMS, and Rac1 activity is not increased in the DMS by moderate alcohol or natural reward. To determine the consequences of alcohol-dependent Rac1 activation in the DMS of male mice, we inhibited endogenous Rac1 by infecting the DMS of mice with an AAV expressing a dominant negative form of the small G-protein (Rac1-DN). We found that overexpression of AAV-Rac1-DN in the DMS inhibits alcohol-mediated Rac1 signaling and attenuates alcohol-mediated F-actin polymerization, which corresponded with a decrease in dendritic arborization and spine maturation. Finally, we provide evidence to suggest that Rac1 in the DMS plays a role in alcohol-associated goal-directed learning. Together, our data suggest that Rac1 in the DMS plays an important role in alcohol-dependent structural plasticity and aberrant learning.

Significance Statement

Addiction, including alcohol use disorder, is characterized by molecular and cellular adaptations that promote maladaptive behaviors. We found that Rac1 was activated by alcohol in the dorsomedial striatum (DMS) of male mice. We show that alcohol-mediated Rac1 signaling is responsible for alterations in actin dynamics and neuronal morphology. We also present data to suggest that Rac1 is important for alcohol-associated learning processes. These results suggest that Rac1 in the DMS is an important contributor to adaptations that promote alcohol use disorder.

Adolescents rats engage the orbitofrontal-striatal pathway differently than adults during impulsive actions

Adolescence is characterized by increased impulsive and risk-taking behaviors. To better understand the neural networks that subserves impulsivity in adolescents, we used a reward-guided behavioral model that quantifies age differences in impulsive actions in adult and adolescent rats of both sexes. Using chemogenetics, we identified orbitofrontal cortex (OFC) projections to the dorsomedial striatum (DMS) as a critical pathway for age-related execution of impulsive actions. Simultaneous recording of single units and local field potentials in the OFC and DMS during task performance revealed an overall muted response in adolescents during impulsive actions as well as age-specific differences in theta power and OFC-DMS functional connectivity. Collectively, these data reveal that the OFC-DMS pathway is critical for age-differences in reward-guided impulsive actions and provide a network mechanism to enhance our understanding of how adolescent and adult brains coordinate behavioral inhibition.

Characterizing the dynamic learning process: Implications of a quantitative analysis

Understanding the neural mechanisms involved in learning processes is crucial for unraveling the complexities of behavior and cognition. Sudden change from the untrained level to the fully-learned level is a pivotal feature of instrumental learning. However, the concept of change point and suitable methods to conveniently analyze the characteristics of sudden change in groups remain elusive, which might hinder a fuller understanding of the neural mechanism underlying dynamic leaning process. In the current study, we investigated the learning processes of mice that were trained in an aversive instrumental learning task, and introduced a novel strategy to analyze behavioral variations in instrumental learning, leading to improved clarity on the concept of sudden change and enabling comprehensive group analysis. By applying this novel strategy, we examined the effects of cocaine and a cannabinoid receptor agonist on instrumental learning. Intriguingly, our analysis revealed significant differences in timing and occurrence of sudden changes that were previously overlooked using traditional analysis. Overall, our research advances understanding of behavioral variation during instrumental learning and the interplay between learning behaviors and neurotransmitter systems, contributing to a deeper comprehension of learning processes and informing future investigations and therapeutic interventions.

Basolateral amygdala parvalbumin interneurons coordinate oscillations to drive reward behaviors

The basolateral amygdala (BLA) mediates both fear and reward learning.1,2 Previous work has shown that parvalbumin (PV) interneurons in the BLA contribute to BLA oscillatory states integral to fear expression.3,4,5,6,7 However, despite it being critical to our understanding of reward behaviors, it is unknown whether BLA oscillatory states and PV interneurons similarly contribute to reward processing. Local field potentials in the BLA were collected as male and female mice consumed sucrose reward, where prominent changes in the beta band (15-30 Hz) emerged with reward experience. During consumption of one water bottle during a two-water-bottle choice test, rhythmic optogenetic stimulation of BLA PVs produced a robust bottle preference, showing that PVs can sufficiently drive reward seeking. Finally, to demonstrate that PV activity is necessary for reward value use, PVs were chemogenetically inhibited following outcome devaluation, rendering mice incapable of using updated reward representations to guide their behavior. Taken together, these experiments provide novel information about the physiological signatures of reward while highlighting BLA PV interneuron contributions to behaviors that are BLA dependent. This work builds upon established knowledge of PV involvement in fear expression and provides evidence that PV orchestration of unique BLA network states is involved in both learning types.

Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats

Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.

Dopamine across timescales and cell types: Relevance for phenotypes in Parkinson's disease progression

Dopamine neurons in the substantia nigra pars compacta (SNc) synthesize and release dopamine, a critical neurotransmitter for movement and learning. SNc dopamine neurons degenerate in Parkinson's Disease (PD), causing a host of motor and non-motor symptoms. Here, we review recent conceptual advances in our basic understanding of the dopamine system - including our rapidly advancing knowledge of dopamine neuron heterogeneity - with special attention to their importance for understanding PD. In PD patients, dopamine neuron degeneration progresses from lateral SNc to medial SNc, suggesting clinically relevant heterogeneity in dopamine neurons. With technical advances in dopamine system interrogation, we can understand the relevance of this heterogeneity for PD progression and harness it to develop new treatments.

The mediodorsal thalamus in executive control

Executive control, the ability to organize thoughts and action plans in real time, is a defining feature of higher cognition. Classical theories have emphasized cortical contributions to this process, but recent studies have reinvigorated interest in the role of the thalamus. Although it is well established that local thalamic damage diminishes cognitive capacity, such observations have been difficult to inform functional models. Recent progress in experimental techniques is beginning to enrich our understanding of the anatomical, physiological, and computational substrates underlying thalamic engagement in executive control. In this review, we discuss this progress and particularly focus on the mediodorsal thalamus, which regulates the activity within and across frontal cortical areas. We end with a synthesis that highlights frontal thalamocortical interactions in cognitive computations and discusses its functional implications in normal and pathological conditions.

Devaluation of response-produced safety signals reveals circuits for goal-directed versus habitual avoidance in dorsal striatum

Active avoidance responses (ARs) are instrumental behaviors that prevent harm. Adaptive ARs may contribute to active coping, whereas maladaptive avoidance habits are implicated in anxiety and obsessive-compulsive disorders. The AR learning mechanism has remained elusive, as successful avoidance trials produce no obvious reinforcer. We used a novel outcome-devaluation procedure in rats to show that ARs are positively reinforced by response-produced feedback (FB) cues that develop into safety signals during training. Males were sensitive to FB-devaluation after moderate training, but not overtraining, consistent with a transition from goal-directed to habitual avoidance. Using chemogenetics and FB-devaluation, we also show that goal-directed vs. habitual ARs depend on dorsomedial vs. dorsolateral striatum, suggesting a significant overlap between the mechanisms of avoidance and rewarded instrumental behavior. Females were insensitive to FB-devaluation due to a remarkable context-dependence of counterconditioning. However, degrading the AR-FB contingency suggests that both sexes rely on safety signals to perform goal-directed ARs.

Enhancement of low gamma oscillations by volitional conditioning of local field potential in the primary motor and visual cortex of mice

Volitional control of local field potential oscillations in low gamma band via brain machine interface can not only uncover the relationship between low gamma oscillation and neural synchrony but also suggest a therapeutic potential to reverse abnormal local field potential oscillation in neurocognitive disorders. In nonhuman primates, the volitional control of low gamma oscillations has been demonstrated by brain machine interface techniques in the primary motor and visual cortex. However, it is not clear whether this holds in other brain regions and other species, for which gamma rhythms might involve in highly different neural processes. Here, we established a closed-loop brain-machine interface and succeeded in training mice to volitionally elevate low gamma power of local field potential in the primary motor and visual cortex. We found that the mice accomplished the task in a goal-directed manner and spiking activity exhibited phase-locking to the oscillation in local field potential in both areas. Moreover, long-term training made the power enhancement specific to direct and adjacent channel, and increased the transcriptional levels of NMDA receptors as well as that of hypoxia-inducible factor relevant to metabolism. Our results suggest that volitionally generated low gamma rhythms in different brain regions share similar mechanisms and pave the way for employing brain machine interface in therapy of neurocognitive disorders.

Targeting the Actions of Muscarinic Receptors on Dopamine Systems: New Strategies for Treating Neuropsychiatric Disorders

Cholinergic regulation of dopamine (DA) signaling has significant implications for numerous disorders, including schizophrenia, substance use disorders, and mood-related disorders. The activity of midbrain DA neurons and DA release patterns in terminal regions are tightly regulated by cholinergic neurons found in both the striatum and the hindbrain. These cholinergic neurons can modulate DA circuitry by activating numerous receptors, including muscarinic acetylcholine receptor (mAChR) subtypes. This review specifically focuses on the complex role of M2, M4, and M5 mAChR subtypes in regulating DA neuron activity and DA release and the potential clinical implications of targeting these mAChR subtypes.

Making and breaking habits: Revisiting the definitions and behavioral factors that influence habits in animals

Habits have garnered significant interest in studies of associative learning and maladaptive behavior. However, habit research has faced scrutiny and challenges related to the definitions and methods. Differences in the conceptualizations of habits between animal and human studies create difficulties for translational research. Here, we review the definitions and commonly used methods for studying habits in animals and humans and discuss potential alternative ways to assess habits, such as automaticity. To better understand habits, we then focus on the behavioral factors that have been shown to make or break habits in animals, as well as potential mechanisms underlying the influence of these factors. We discuss the evidence that habitual and goal-directed systems learn in parallel and that they seem to interact in competitive and cooperative manners. Finally, we draw parallels between habitual responding and compulsive drug seeking in animals to delineate the similarities and differences in these behaviors.

Neurobehavioral Precursors of Compulsive Cocaine Seeking in Dual Frontostriatal Circuits

Background

Only some individuals who use drugs recreationally eventually develop a substance use disorder, characterized in part by the rigid engagement in drug foraging behavior (drug seeking), which is often maintained in the face of adverse consequences (i.e., is compulsive). The neurobehavioral determinants of this individual vulnerability have not been fully elucidated.

Methods

Using a prospective longitudinal study involving 39 male rats, we combined multidimensional characterization of behavioral traits of vulnerability to stimulant use disorder (impulsivity and stickiness) and resilience (sign tracking and sensation seeking/locomotor reactivity to novelty) with magnetic resonance imaging to identify the structural and functional brain correlates of the later emergence of compulsive drug seeking in drug-naïve subjects. We developed a novel behavioral procedure to investigate the individual tendency to persist in drug-seeking behavior in the face of punishment in a drug-free state in subjects with a prolonged history of cocaine seeking under the control of the conditioned reinforcing properties of a drug-paired Pavlovian conditioned stimulus.

Results

In drug-naïve rats, the tendency to develop compulsive cocaine seeking was characterized by behavioral stickiness-related functional hypoconnectivity between the prefrontal cortex and posterior dorsomedial striatum in combination with impulsivity-related structural alterations in the infralimbic cortex, anterior insula, and nucleus accumbens.

Conclusions

These findings show that the vulnerability to developing compulsive cocaine-seeking behavior stems from preexisting structural or functional changes in two distinct corticostriatal systems that underlie deficits in impulse control and goal-directed behavior.

Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance

Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.

Striatal Acetylcholine and Dopamine Interactions Produce Situationappropriate Action Selection

Individuals often learn how to perform new actions for particular outcomes against a complex background of existing action-outcome associations. As such, this new knowledge can interfere or even compete with existing knowledge, such that individuals must use internal and external cues to determine which action is appropriate to the current situation. The question thus remains as to how this problem is solved at a neural level. Research over the last decade or so has begun to determine how the brain achieves situation-appropriate action selection. Several converging lines of evidence suggest that it is achieved through the complex interactions of acetylcholine and dopamine within the striatum in a manner that relies on glutamatergic inputs from the cortex and thalamus. Here we briefly review this evidence, then relate it to several very recent findings to provide new, speculative insights regarding the precise nature of striatal acetylcholine/dopamine interaction dynamics and their relation to situation- appropriate action selection.

Brain structural alterations in internet gaming disorder: Focus on the mesocorticolimbic dopaminergic system

AIMS

This study aimed to identify gray/white matter volume (GMV/WMV) alterations in Internet Gaming Disorder (IGD), with a special focus on the subregions of the mesocorticolimbic dopaminergic system and their clinical association.

RESULTS

Compared with healthy controls, IGDs showed bigger GMV in the bilateral caudate and the left nucleus accumbens (NAc), and bigger WMV in the inferior parietal lobule. The comparison of regions of interest (ROI) confirmed increased GMV in the bilateral caudate (including the dorsal anterior, body, and tail) and the left core of NAc in IGD, but no significant WMV alterations in the mesocorticolimbic dopaminergic system. GMVs in the left lateral orbital gyrus of orbitofrontal cortex (OFC) were associated with craving for games, while GMVs in the left anterior insula, right NAc, right caudate, and right OFC were associated with self-control in IGD.

CONCLUSIONS

IGD was accompanied by changed GMV, but not WMV, in the mesocorticolimbic dopaminergic system. GMV in the mesocorticolimbic dopaminergic system may contribute to impaired self-control and craving in IGD.

Characterization of striatal dopamine projections across striatal subregions in behavioral flexibility

Behavioural flexibility is key to survival in a dynamic environmentWhile flexible, goal-directed behaviours are initially dependent on dorsomedial striatum, they become dependent on lateral striatum as behaviours become inflexible. Similarly, lesions of dopamine terminals in lateral striatum disrupt the development of inflexible habits. This work suggests that dopamine release in lateral striatum may drive inflexible behaviours, though few studies have investigated a causative role of subpopulations of striatal dopamine terminals in reversal learning, a measure of flexibility. Here, we performed two optogenetic experiments to activate dopamine terminals in dorsomedial (DMS), dorsolateral (DLS) or ventral (nucleus accumbens [NAc]) striatum in DAT-Cre mice that expressed channelrhodopsin-2 via viral injection (Experiment I) or through transgenic breeding with an Ai32 reporter line (Experiment II) to determine how specific dopamine subpopulations impact reversal learning. Mice performed a reversal task in which they self-stimulated DMS, DLS, or NAc dopamine terminals by pressing one of two levers before action-outcome lever contingencies were reversed. Largely consistent with presumed ventromedial/lateral striatal function, we found that mice self-stimulating medial dopamine terminals reversed lever preference following contingency reversal, while mice self-stimulating NAc showed parial flexibility, and DLS self-stimulation resulted in impaired reversal. Impairments in DLS mice were characterized by more regressive errors and reliance on lose-stay strategies following reversal, as well as reduced within-session learning, suggesting reward insensitivity and overreliance on previously learned actions. This study supports a model of striatal function in which DMS and ventral dopamine facilitate goal-directed responding, and DLS dopamine supports more inflexible responding.

Spiny projection neurons exhibit transcriptional signatures within subregions of the dorsal striatum

The dorsal striatum is organized into functional territories defined by corticostriatal inputs onto both direct and indirect spiny projection neurons (SPNs), the major cell types within the striatum. In addition to circuit connectivity, striatal domains are likely defined by the spatially determined transcriptomes of SPNs themselves. To identify cell-type-specific spatiomolecular signatures of direct and indirect SPNs within dorsomedial, dorsolateral, and ventrolateral dorsal striatum, we used RNA profiling in situ hybridization with probes to >98% of protein coding genes. We demonstrate that the molecular identity of SPNs is mediated by hundreds of differentially expressed genes across territories of the striatum, revealing extraordinary heterogeneity in the expression of genes that mediate synaptic function in both direct and indirect SPNs. This deep insight into the complex spatiomolecular organization of the striatum provides a foundation for understanding both normal striatal function and for dissecting region-specific dysfunction in disorders of the striatum.

Development and cadherin-mediated control of prefrontal corticostriatal projections in mice

Action-outcome associations depend on prefrontal cortex (PFC) projections to the dorsal striatum. To assess how these projections form, we measured PFC axon patterning, synapse formation, and functional maturation in the postnatally developing mouse striatum. Using Hotspot analysis, we show that PFC axons form an adult-like pattern of clustered terminations in the first postnatal week that remains largely stable thereafter. PFC-striatal synaptic strength is adult-like by P21, while excitatory synapse density increases until adulthood. We then tested how the targeted deletion of a candidate adhesion/guidance protein, Cadherin-8 (Cdh8), from corticostriatal neurons regulates pathway development. Mutant mice showed diminished PFC axon targeting and reduced spontaneous glutamatergic synaptic activity in the dorsal striatum. They also exhibited impaired behavioral performance in action-outcome learning. The data show that PFC-striatal axons form striatal territories through an early, directed growth model and they highlight essential contributions of Cdh8 to the anatomical and functional features critical for the formation of action-outcome associations.

Goal-directed and habitual control: from circuits and functions to exercise-induced neuroplasticity targets for the treatment of Parkinson's disease

Parkinson's disease (PD) is a neurodegenerative disease characterized by motor and cognitive impairments. The progressive depletion of dopamine (DA) is the pathological basis of dysfunctional goal-directed and habitual control circuits in the basal ganglia. Exercise-induced neuroplasticity could delay disease progression by improving motor and cognitive performance in patients with PD. This paper reviews the research progress on the motor-cognitive basal ganglia circuit and summarizes the current hypotheses for explaining exercise intervention on rehabilitation in PD. Studies on exercise mediated mechanisms will contribute to the understanding of networks that regulate goal-directed and habitual behaviors and deficits in PD, facilitating the development of strategies for treatment of PD.

A dual-pathway architecture enables chronic stress to promote habit formation

Chronic stress can change how we learn and, thus, how we make decisions by promoting the formation of inflexible, potentially maladaptive, habits. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted approach in male and female mice, we reveal a dual pathway, amygdala-striatal, neuronal circuit architecture by which a recent history of chronic stress shapes learning to disrupt flexible goal-directed behavior in favor of inflexible habits. Chronic stress inhibits activity of basolateral amygdala projections to the dorsomedial striatum to impede the action-outcome learning that supports flexible, goal-directed decisions. Stress also increases activity in direct central amygdala projections to the dorsomedial striatum to promote the formation of rigid, inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to promote premature habit formation. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and other psychiatric conditions.

Antagonism of D2 receptors via raclopride ameliorates amphetamine-induced associative learning deficits in male mice

Dopamine levels in the dorsomedial striatum (DMS) are highly dynamic and are thought to underly the encoding of action-outcome associations. Although it is known that amphetamine disrupts the learning that is required for goal-directed action, the role of D1 and D2 receptors in this process has not been established. In this study, we examined the role of D1 and D2 receptor antagonists on learning in response to amphetamine. We used the outcome-specific devaluation task to examine goal-directed action in male C57BL6/J mice treated systemically with either a D1 antagonist (SCH-23990; 0.01 mg/kg) or a D2 antagonist (raclopride; 0.5 mg/kg) and then administered amphetamine (1 mg/kg). The mice were injected repeatedly throughout the instrumental training phase of the task to assess the impact on the learning of action-outcomes, and the subsequent choice test assessing performance of goal-directed action was conducted drug free. Effects of chronic drug administration on locomotor behaviour was assessed before and after the choice test. Treatment during learning with either amphetamine, or the D1 or D2 antagonists, impaired the subsequent performance of goal-directed action. The amphetamine-induced impairment in goal-directed action was reversed in mice treated with raclopride, but not when treated with SCH-23990. By contrast, amphetamine-induced hyperactivity was reversed in mice treated with SCH-23990, but not in mice treated with raclopride. Taken together, these data support the role of a balance of dopamine receptor signalling after amphetamine treatment. While overall D1 receptor availability is necessary to promote learning, in a state of elevated dopamine, modifying D2 receptor function can ameliorate learning deficits.

Differential effects of acute and prolonged morphine withdrawal on motivational and goal-directed control over reward-seeking behavior

Opioid addiction is a relapsing disorder marked by uncontrolled drug use and reduced interest in normally rewarding activities. The current study investigated the impact of spontaneous withdrawal from chronic morphine exposure on emotional, motivational, and cognitive processes involved in regulating the pursuit and consumption of natural food rewards in male rats. In Experiment 1, rats experiencing acute morphine withdrawal lost weight and displayed somatic signs of drug dependence. However, hedonically-driven sucrose consumption was significantly elevated, suggesting intact and potentially heightened emotional reward processing. In Experiment 2, rats undergoing acute morphine withdrawal displayed reduced motivation when performing an effortful response for palatable food reward. Subsequent reward devaluation testing revealed that acute withdrawal also disrupted their ability to exert flexible goal-directed control over their reward-seeking behavior. Specifically, morphine-withdrawn rats displayed insensitivity to reward devaluation both when relying on prior action-outcome learning and when given direct feedback about the consequences of their actions. In Experiment 3, rats tested after prolonged morphine withdrawal displayed heightened rather than diminished motivation for food rewards and retained their ability to engage in flexible goal-directed action selection. However, brief re-exposure to morphine was sufficient to impair motivation and disrupt goal-directed action selection, though in this case insensitivity to reward devaluation was only observed in the presence of morphine-paired context cues and in the absence of response-contingent feedback. We suggest that these opioid-withdrawal induced deficits in motivation and goal-directed control may contribute to addiction by interfering with the pursuit of adaptive alternatives to drug use.

Training-induced circuit-specific excitatory synaptogenesis in mice is required for effort control

Synaptogenesis is essential for circuit development; however, it is unknown whether it is critical for the establishment and performance of goal-directed voluntary behaviors. Here, we show that operant conditioning via lever-press for food reward training in mice induces excitatory synapse formation onto a subset of anterior cingulate cortex neurons projecting to the dorsomedial striatum (ACC→DMS). Training-induced synaptogenesis is controlled by the Gabapentin/Thrombospondin receptor α2δ-1, which is an essential neuronal protein for proper intracortical excitatory synaptogenesis. Using germline and conditional knockout mice, we found that deletion of α2δ-1 in the adult ACC→DMS circuit diminishes training-induced excitatory synaptogenesis. Surprisingly, this manipulation does not impact learning but results in a significant increase in effort exertion without affecting sensitivity to reward value or changing contingencies. Bidirectional optogenetic manipulation of ACC→DMS neurons rescues or phenocopies the behaviors of the α2δ-1 cKO mice, highlighting the importance of synaptogenesis within this cortico-striatal circuit in regulating effort exertion.

Reward expectation enhances action-related activity of nigral dopaminergic and two striatal output pathways

Neurons comprising nigrostriatal system play important roles in action selection. However, it remains unclear how this system integrates recent outcome information with current action (movement) and outcome (reward or no reward) information to achieve appropriate subsequent action. We examined how neuronal activity of substantia nigra pars compacta (SNc) and dorsal striatum reflects the level of reward expectation from recent outcomes in rats performing a reward-based choice task. Movement-related activity of direct and indirect pathway striatal projection neurons (dSPNs and iSPNs, respectively) were enhanced by reward expectation, similarly to the SNc dopaminergic neurons, in both medial and lateral nigrostriatal projections. Given the classical basal ganglia model wherein dopamine stimulates dSPNs and suppresses iSPNs through distinct dopamine receptors, dopamine might not be the primary driver of iSPN activity increasing following higher reward expectation. In contrast, outcome-related activity was affected by reward expectation in line with the classical model and reinforcement learning theory, suggesting purposive effects of reward expectation.

Orbitofrontal cortex control of striatum leads economic decision-making

Animals must continually evaluate stimuli in their environment to decide which opportunities to pursue, and in many cases these decisions can be understood in fundamentally economic terms. Although several brain regions have been individually implicated in these processes, the brain-wide mechanisms relating these regions in decision-making are unclear. Using an economic decision-making task adapted for rats, we find that neural activity in both of two connected brain regions, the ventrolateral orbitofrontal cortex (OFC) and the dorsomedial striatum (DMS), was required for economic decision-making. Relevant neural activity in both brain regions was strikingly similar, dominated by the spatial features of the decision-making process. However, the neural encoding of choice direction in OFC preceded that of DMS, and this temporal relationship was strongly correlated with choice accuracy. Furthermore, activity specifically in the OFC projection to the DMS was required for appropriate economic decision-making. These results demonstrate that choice information in the OFC is relayed to the DMS to lead accurate economic decision-making.

Anatomical and Functional Comparison of the Caudate Tail in Primates and the Tail of the Striatum in Rodents: Implications for Sensory Information Processing and Habitual Behavior

The tail of the striatum (TS) is located at the caudal end in the striatum. Recent studies have advanced our knowledge of the anatomy and function of the TS but also raised questions about the differences between rodent and primate TS. In this review, we compare the anatomy and function of the TS in rodent and primate brains. The primate TS is expanded more caudally during brain development in comparison with the rodent TS. Additionally, five sensory inputs from the cortex and thalamus converge in the rodent TS, but this convergence is not observed in the primate TS. The primate TS, including the caudate tail and putamen tail, primarily receives inputs from the visual areas, implying a specialized function in processing visual inputs for action generation. This anatomical difference leads to further discussion of cellular circuit models to comprehend how the primate brain processes a wider range of complex visual stimuli to produce habitual behavior as compared with the rodent brain. Examining these differences and considering possible neural models may provide better understanding of the anatomy and function of the primate TS.

Identification of the Neural Correlates Underlying Conflict Resolution Performance Using a Rodent Analogue of the Stroop Tests

The Stroop test is a widely used neuropsychological test measuring attention and conflict resolution, which shows sensitivity across a range of diseases, including Alzheimer's, Parkinson's and Huntington's diseases. A rodent analogue of the Stroop test, the Response-Conflict task (rRCT), allows for systematic investigation of the neural systems underpinning performance in this test. Little is known about the involvement of the basal ganglia in this neural process. The aim of this study was to use the rRCT to determine whether striatal subregions are recruited during conflict resolution processing. To achieve this, rats were exposed to Congruent or Incongruent stimuli in the rRCT and the expression patterns of the immediate early gene Zif268 were analysed throughout cortical, hippocampal and basal ganglia subregions. The results confirmed the previously reported involvement of prefrontal cortical and hippocampal regions, as well as identifying a specific role for the dysgranular (but not granular) retrosplenial cortex in conflict resolution. Finally, performance accuracy correlated significantly with reduced neural activation in the dorsomedial striatum. Involvement of the basal ganglia in this neural process has not previously been reported. These data demonstrate that the cognitive process of conflict resolution requires not only prefrontal cortical regions, but also recruits the dysgranular retrosplenial cortex and the medial region of the neostriatum. These data have implications for understanding the neuroanatomical changes that underpin impaired Stroop performance in people with neurological disorders.

Estradiol Receptors Inhibit Long-Term Potentiation in the Dorsomedial Striatum

Estradiol, a female sex hormone and the predominant form of estrogen, has diverse effects throughout the brain including in learning and memory. Estradiol modulates several types of learning that depend on the dorsomedial striatum (DMS), a subregion of the basal ganglia involved in goal-directed learning, cued action-selection, and motor skills. A cellular basis of learning is synaptic plasticity, and the presence of extranuclear estradiol receptors ERα, ERβ, and G-protein-coupled estrogen receptor (GPER) throughout the DMS suggests that estradiol may influence rapid cellular actions including those involved in plasticity. To test whether estradiol affects synaptic plasticity in the DMS, corticostriatal long-term potentiation (LTP) was induced using theta-burst stimulation (TBS) in ex vivo brain slices from intact male and female C57BL/6 mice. Extracellular field recordings showed that female mice in the diestrous stage of the estrous cycle exhibited LTP similar to male mice, while female mice in estrus did not exhibit LTP. Furthermore, antagonists of ERα or GPER rescued LTP in estrous females and agonists of ERα or GPER reduced LTP in diestrous females. In males, activating ERα but not GPER reduced LTP. These results uncover an inhibitory action of estradiol receptors on cellular learning in the DMS and suggest a cellular mechanism underlying the impairment in certain types of DMS-based learning observed in the presence of high estradiol. Because of the dorsal striatum's role in substance use disorders, these findings may provide a mechanism underlying an estradiol-mediated progression from goal-directed to habitual drug use.

Changes in dorsomedial striatum activity mediate expression of goal-directed vs. habit-like cue-induced cocaine seeking

A preclinical model of cue exposure therapy, cue extinction, reduces cue-induced cocaine seeking when drug seeking is goal-directed but not habitual. Goal-directed and habitual behaviors differentially rely on the dorsomedial striatum (DMS) and dorsolateral striatum (DLS), but the effects of cue extinction on dorsal striatal responses to cue-induced drug seeking are unknown. We used fiber photometry to examine how dorsal striatal intracellular calcium and extracellular dopamine activity differs between goal-directed and habitual cue-induced cocaine seeking and how it is impacted by cue extinction. Rats trained to self-administer cocaine paired with an audiovisual cue on schedules of reinforcement that promote goal-directed or habitual cocaine seeking had different patterns of dorsal striatal calcium and dopamine responses to cue-reinforced lever presses. Cue extinction reduced calcium and dopamine responses during subsequent drug seeking in the DMS, but not in the DLS. Therefore, cue extinction may reduce goal-directed behavior through its effects on the DMS, whereas habitual behavior and the DLS are unaffected.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration (2 h/day). We then exposed them to 4 days of punishment testing, in which footshock (0.4 mA, 0.3 s) was delivered randomly on one-third of trials, immediately following completion of seeking and prior to extension of the taking lever. Before and after punishment testing (4 days pre-punishment and ≥4 days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Glutamate dynamics in the dorsolateral striatum of rats with goal-directed and habitual cocaine-seeking behavior

The shift from drug abuse to addiction is considered to arise from the transition between goal-directed and habitual control over drug behavior. Habitual responding for appetitive and skill-based behaviors is mediated by potentiated glutamate signaling in the dorsolateral striatum (DLS), but the state of the DLS glutamate system in the context of habitual drug-behavior remains undefined. Evidence from the nucleus accumbens of cocaine-experienced rats suggests that decreased transporter-mediated glutamate clearance and enhanced synaptic glutamate release contribute to the potentiated glutamate signaling that underlies the enduring vulnerability to relapse. Preliminary evidence from the dorsal striatum of cocaine-experienced rats suggests that this region exhibits similar alterations to glutamate clearance and release, but it is not known whether these glutamate dynamics are associated with goal-directed or habitual control over cocaine-seeking behavior. Therefore, we trained rats to self-administer cocaine in a chained cocaine-seeking and -taking paradigm, which yielded goal-directed, intermediate, and habitual cocaine-seeking rats. We then assessed glutamate clearance and release dynamics in the DLS of these rats using two different methods: synaptic transporter current (STC) recordings of patch-clamped astrocytes and the intensity-based glutamate sensing fluorescent reporter (iGluSnFr). While we observed a decreased rate of glutamate clearance in STCs evoked with single-pulse stimulation in cocaine-experienced rats, we did not observe any cocaine-induced differences in glutamate clearance rates from STCs evoked with high frequency stimulation (HFS) or iGluSnFr responses evoked with either double-pulse stimulation or HFS. Furthermore, GLT-1 protein expression in the DLS was unchanged in cocaine-experienced rats, regardless of their mode of control over cocaine-seeking behavior. Lastly, there were no differences in metrics of glutamate release between cocaine-experienced rats and yoked-saline controls in either assay. Together, these results suggest that glutamate clearance and release dynamics in the DLS are largely unaltered by a history of cocaine self-administration on this established cocaine seeking-taking paradigm, regardless of whether the control over the cocaine seeking behavior was habitual or goal directed.

The differential neural substrates for reward choice under gain-loss contexts and risk in alcohol use disorder: Evidence from a voxel-based meta-analysis

BACKGROUND

Making a risky decision is a complex process that involves the evaluation of both the values of the options and the associated risk level; this process is distinct from reward processing in gain versus loss contexts. Although disrupted reward processing in mesolimbic dopamine circuitry is suggested to underlie pathological incentive processing in patients with alcohol use disorder (AUD), the differential neural processes subserving these motivational tendencies for risk situations or gain/loss choices in decision-making have not been identified.

METHODS

To examine the common or distinct neural mechanisms in the evaluation of risk versus outcomes for AUD, we conducted two separate coordinate-based meta-analyses of functional neuroimaging studies by using Seed-Based d Mapping software to evaluate 13 studies investigating gain and loss processing and 10 studies investigating risky decision-making.

RESULTS

During gain and loss processing, relative to healthy controls, AUD patients showed reduced activation in the mesocortical-limbic circuit, including the orbital prefrontal cortex (OFC), dorsal striatum, insula, hippocampus, cerebellum, cuneus cortex and superior temporal gyrus, but hyperactivation in the inferior temporal gyrus and paracentral lobule (extending to the middle cingulate cortex (MCC) and precuneus). During decision-making under risk, AUD patients exhibited hypoactivity of the prefrontal and cingulate cortices, including the posterior cingulate cortex (extending to the MCC), middle frontal gyrus, medial prefrontal cortex, dorsolateral prefrontal cortex, OFC and anterior cingulate cortex.

CONCLUSIONS

Our results extend existing neurological evidence by showing that a reduced response in the mesocortical-limbic circuit is found in gain versus loss processing, with decreased responsivity in cortical regions in risk decision-making. Our results implicate dissociable neural circuit responses for gain-loss processing and risk decision-making, which contribute to a better understanding of the pathophysiological mechanism underlying nondrug incentive and risk processing in individuals with AUD.

Striatal Subregion-selective Dysregulated Dopamine Receptor-mediated Intracellular Signaling in a Model of DOPA-responsive Dystonia

Although the mechanisms underlying dystonia are largely unknown, dystonia is often associated with abnormal dopamine neurotransmission. DOPA-responsive dystonia (DRD) is a prototype disorder for understanding dopamine dysfunction in dystonia because it is caused by mutations in genes necessary for the synthesis of dopamine and alleviated by the indirect-acting dopamine agonist l-DOPA. Although adaptations in striatal dopamine receptor-mediated intracellular signaling have been studied extensively in models of Parkinson's disease, another movement disorders associated with dopamine deficiency, little is known about dopaminergic adaptations in dystonia. To identify the dopamine receptor-mediated intracellular signaling associated with dystonia, we used immunohistochemistry to quantify striatal protein kinase A activity and extracellular signal-related kinase (ERK) phosphorylation after dopaminergic challenges in a knockin mouse model of DRD. l-DOPA treatment induced the phosphorylation of both protein kinase A substrates and ERK largely in D1 dopamine receptor-expressing striatal neurons. As expected, this response was blocked by pretreatment with the D1 dopamine receptor antagonist SCH23390. The D2 dopamine receptor antagonist raclopride also significantly reduced the phosphorylation of ERK; this contrasts with models of parkinsonism in which l-DOPA-induced ERK phosphorylation is not mediated by D2 dopamine receptors. Further, the dysregulated signaling was dependent on striatal subdomains whereby ERK phosphorylation was largely confined to dorsomedial (associative) striatum while the dorsolateral (sensorimotor) striatum was unresponsive. This complex interaction between striatal functional domains and dysregulated dopamine-receptor mediated responses has not been observed in other models of dopamine deficiency, such as parkinsonism, suggesting that regional variation in dopamine-mediated neurotransmission may be a hallmark of dystonia.

Restoring the youthful state of striatal plasticity in aged mice re-enables cognitive control of action

Multidisciplinary evidence suggests that the control of voluntary action arbitrates between two major forms of behavioral processing: cognitively guided (or goal directed) and autonomously guided (or habitual). Brain-state irregularities affecting the striatum-such as aging-commonly shift control toward the latter, although the responsible neural mechanisms remain unknown. Combining instrumental conditioning with cell-specific mapping and chemogenetics in striatal neurons, we explored strategies that invigorate goal-directed capacity in aged mice. We found that, under conditions favoring goal-directed control, aged animals resiliently expressed autonomously guided behavior, a response that was underpinned by a characteristic one-to-one functional engagement of the two main neuronal populations in the striatum-D1- and D2-dopamine receptor-expressing spiny projection neurons (SPNs). Chemogenetically induced desensitization of D2-SPN signaling in aged transgenic mice recapitulated the striatal plasticity state observed in young mice, an effect that shifted behavior toward vigorous, goal-directed action. Our findings contribute to the understanding of the neural bases of behavioral control and propose neural system interventions that enhance cognitive functioning in habit-prone brains.