Recent Insights into Corticostriatal Circuit Mechanisms underlying Habits: Invited review for Current Opinions in Behavioral Sciences

Striatal cell-type specific stability and reorganization underlying agency and habit

Adaptive decision making requires agency, knowledge that actions produce particular outcomes. For well- practiced routines, agency is relinquished in favor of habit. Here, we asked how dorsomedial striatum D1 + and D2/A2A + neurons contribute to agency and habit. We imaged calcium activity of these neurons as mice learned to lever press with agency and formed habits with overtraining. Whereas many D1 + neurons stably encoded actions throughout learning and developed encoding of reward outcomes, A2A + neurons reorganized their encoding of actions from initial action-outcome learning to habit formation. Chemogenetic manipulations indicated that both D1 + and A2A + neurons support action-outcome learning, but only D1 + neurons enable the use of such agency for adaptive, goal-directed decision making. These data reveal coordinated dorsomedial striatum D1 + and A2A + function for the development of agency, cell-type specific stability and reorganization underlying agency and habit, and important insights into the neuronal circuits of how we learn and decide.

A dual-pathway architecture enables chronic stress to disrupt agency and promote habit formation

Chronic stress can change how we learn and, thus, how we make decisions. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted systems neuroscience approach in male and female mice, we reveal a dual pathway, amygdala-striatal neuronal circuit architecture by which a recent history of chronic stress disrupts the action-outcome learning underlying adaptive agency and promotes the formation of inflexible habits. We found that the basolateral amygdala projection to the dorsomedial striatum is activated by rewarding events to support the action-outcome learning needed for flexible, goal-directed decision making. Chronic stress attenuates this to disrupt action-outcome learning and, therefore, agency. Conversely, the central amygdala projection to the dorsomedial striatum mediates habit formation. Following stress this pathway is progressively recruited to learning to promote the premature formation of inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to disrupt agency and promote habit. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and mental health conditions.

Corticostriatal dynamics underlying components of binge-like consumption of palatable food in mice

Binge eating (BE) is a maladaptive repetitive feeding behavior present across nearly all eating disorder diagnoses. Despite the substantial negative impact of BE on psychological and physiological health, its underlying neural mechanisms are largely unknown. Other repetitive behavior disorders (e.g., obsessive compulsive disorder) show dysfunction within corticostriatal circuitry. However, to date, no work has investigated the in vivo neural dynamics underlying corticostriatal activity during BE episodes. The aim of the current study was to longitudinally examine in vivo neural activity within corticostriatal regions - the infralimbic cortex (IL) and dorsolateral striatum (DLS)- in a robust pre-clinical model for BE. Female C57BL6/J mice (N = 32) were randomized to receive: 1) intermittent (daily, 2-h) binge-like access to palatable food (sweetened condensed milk) (BE), or 2) continuous, non-intermittent (24-h) access to palatable food (control). In vivo calcium imaging was performed via fiber photometry at baseline and after chronic (4 weeks) engagement in the model for BE. Specific consummatory behaviors (feeding bout onset/offset) during recordings were captured using lickometers which generated TTL outputs for precise alignment of behavior to neural data. IL showed no specific changes in neural activity related to BE. However, BE animals showed decreased DLS activity at feeding onset and offset at the chronic timepoint when compared to activity at the baseline timepoint. Additionally, BE mice had significantly lower DLS activity at feeding onset and offset at the chronic timepoint compared to control mice. These results point to a role for DLS hypofunction in chronic BE, highlighting a potential target for future treatment intervention.

Adolescent social isolation shifts the balance of decision-making strategy from goal-directed action to habitual response in adulthood via suppressing the excitatory neurotransmission onto the direct pathway of the dorsomedial striatum

Adverse experience, such as social isolation, during adolescence is one of the major causes of neuropsychiatric disorders that extend from adolescence into adulthood, such as substance addiction, obsessive-compulsive disorder, and eating disorders leading to obesity. A common behavioral feature of these neuropsychiatric disorders is a shift in the balance of decision-making strategy from goal-directed action to habitual response. This study has verified that adolescent social isolation directly shifts the balance of decision-making strategy from goal-directed action to habitual response, and that it cannot be reversed by simple regrouping. This study has further revealed that adolescent social isolation induces a suppression in the excitatory neurotransmission onto the direct-pathway medium spiny neurons of the dorsomedial striatum (DMS), and that chemogenetically compensating this suppression effect shifts the balance of decision-making strategy from habitual response back to goal-directed action. These findings suggest that the plasticity in the DMS causes the shift in the balance of decision-making strategy, which would potentially help to develop a general therapy to treat the various neuropsychiatric disorders caused by adolescent social isolation. Such a study is especially necessary under the circumstances that social distancing and lockdown have caused during times of world-wide, society-wide pandemic.

Post-Stroke Hemiplegic Rodent Evaluation: A Framework for Assessing Forelimb Movement Quality Using Kinematics

Kinematics is the gold-standard method for measuring detailed joint motions. Recent research demonstrates that post-stroke kinematic analysis in rats reveals reaching abnormalities similar to those seen in humans after stroke. Nonetheless, behavioral neuroscientists have failed to incorporate kinematic methods for assessing movement quality in stroke models. The availability of a user-friendly method to assess multi-segment forelimb kinematics models should greatly increase uptake of this approach. Here, we present a framework for multi-segment forelimb analysis in rodents after stroke. This method greatly enhances the understanding of post-stroke forelimb motor recovery by including several movement quality metrics often used in human clinical work, such as upper-limb linear and angular kinematics, movement smoothness and kinetics, abnormal synergies, and compensations. These metrics may constitute a preclinical surrogate for the Fugl-Meyer assessment of hemiplegic patients. The data obtained using this method are 83 outputs of linear and angular kinematics and kinetics. The outputs also include 24 time series of continuous data, which afford a graphical representation of the kinematics and kinetics of the reaching cycle. We show that post-stroke rodents displayed many features resembling those seen in humans after stroke that are evident only when multi-segment kinematics models are considered. This method expands the knowledge derived from methods constrained to paw movements to a multi-segment forelimb movement quality framework. Moreover, it highlights the need for preclinical work to consider more sensitive measures of sensorimotor impairment and recovery as a means to enhance the interpretation of true recovery and compensation. © 2022 Wiley Periodicals LLC. Basic Protocol: Recording and data analysis of rodents performing the Montoya staircase task.

Habits and Goals in Human Behavior: Separate but Interacting Systems

People automatically repeat behaviors that were frequently rewarded in the past in a given context. Such repetition is commonly attributed to habit, or associations in memory between a context and a response. Once habits form, contexts directly activate the response in mind. An opposing view is that habitual behaviors depend on goals. However, we show that this view is challenged by the goal independence of habits across the fields of social and health psychology, behavioral neuroscience, animal learning, and computational modeling. It also is challenged by direct tests revealing that habits do not depend on implicit goals. Furthermore, we show that two features of habit memory-rapid activation of specific responses and resistance to change-explain the different conditions under which people act on habit versus persuing goals. Finally, we tested these features with a novel secondary analysis of action-slip data. We found that habitual responses are activated regardless of goals, but they can be performed in concert with goal pursuit.

Cannabinoid Modulation of Dopamine Release During Motivation, Periodic Reinforcement, Exploratory Behavior, Habit Formation, and Attention

Motivational and attentional processes energize action sequences to facilitate evolutionary competition and promote behavioral fitness. Decades of neuropharmacology, electrophysiology and electrochemistry research indicate that the mesocorticolimbic DA pathway modulates both motivation and attention. More recently, it was realized that mesocorticolimbic DA function is tightly regulated by the brain's endocannabinoid system and greatly influenced by exogenous cannabinoids-which have been harnessed by humanity for medicinal, ritualistic, and recreational uses for 12,000 years. Exogenous cannabinoids, like the primary psychoactive component of cannabis, delta-9-tetrahydrocannabinol, produce their effects by acting at binding sites for naturally occurring endocannabinoids. The brain's endocannabinoid system consists of two G-protein coupled receptors, endogenous lipid ligands for these receptor targets, and several synthetic and metabolic enzymes involved in their production and degradation. Emerging evidence indicates that the endocannabinoid 2-arachidonoylglycerol is necessary to observe concurrent increases in DA release and motivated behavior. And the historical pharmacology literature indicates a role for cannabinoid signaling in both motivational and attentional processes. While both types of behaviors have been scrutinized under manipulation by either DA or cannabinoid agents, there is considerably less insight into prospective interactions between these two important signaling systems. This review attempts to summate the relevance of cannabinoid modulation of DA release during operant tasks designed to investigate either motivational or attentional control of behavior. We first describe how cannabinoids influence DA release and goal-directed action under a variety of reinforcement contingencies. Then we consider the role that endocannabinoids might play in switching an animal's motivation from a goal-directed action to the search for an alternative outcome, in addition to the formation of long-term habits. Finally, dissociable features of attentional behavior using both the 5-choice serial reaction time task and the attentional set-shifting task are discussed along with their distinct influences by DA and cannabinoids. We end with discussing potential targets for further research regarding DA-cannabinoid interactions within key substrates involved in motivation and attention.

Depression in the Direct Pathway of the Dorsomedial Striatum Permits the Formation of Habitual Action

In order to achieve optimal outcomes in an ever-changing environment, humans and animals generally manage their action control via either goal-directed action or habitual action. These two action strategies are thought to be encoded in distinct parallel circuits in the dorsal striatum, specifically, the posterior dorsomedial striatum (DMS) and the dorsolateral striatum (DLS), respectively. The striatum is primarily composed of two subtypes of medium spiny neurons (MSNs): the direct-pathway striatonigral and the indirect-pathway striatopallidal MSNs. MSN-subtype-specific synaptic plasticity in the DMS and the DLS has been revealed to underlie goal-directed action and habitual action, respectively. However, whether any MSN-subtype-specific synaptic plasticity in the DMS is associated with habitual action, and if so, whether the synaptic plasticity affects the formation of habitual action, are not known. This study demonstrates that postsynaptic depression in the excitatory synapses of the direct-pathway striatonigral MSNs in the DMS is formed after habit learning. Moreover, chemogenetically rescuing this depression compromises the acquisition, but not the expression, of habitual action. These findings reveal that an MSN-subtype-specific synaptic plasticity in the DMS affects habitual action and suggest that plasticity in the DMS as well as in the DLS contributes to the formation of habitual action.

Alteration of the cholinergic system and motor deficits in cholinergic neuron-specific Dyt1 knockout mice

Dystonia is a neurological movement disorder characterized by sustained or intermittent muscle contractions, repetitive movement, and sometimes abnormal postures. DYT1 dystonia is one of the most common genetic dystonias, and most patients carry heterozygous DYT1 ∆GAG mutations causing a loss of a glutamic acid of the protein torsinA. Patients can be treated with anticholinergics, such as trihexyphenidyl, suggesting an abnormal cholinergic state. Early work on the cell-autonomous effects of Dyt1 deletion with ChI-specific Dyt1 conditional knockout mice (Dyt1 Ch1KO) revealed abnormal electrophysiological responses of striatal ChIs to muscarine and quinpirole, motor deficits, and no changes in the number or size of the ChIs. However, the Chat-cre line that was used to derive Dyt1 Ch1KO mice contained a neomycin cassette and was reported to have ectopic cre-mediated recombination. In this study, we generated a Dyt1 Ch2KO mouse line by removing the neomycin cassette in Dyt1 Ch1KO mice. The Dyt1 Ch2KO mice showed abnormal paw clenching behavior, motor coordination and balance deficits, impaired motor learning, reduced striatal choline acetyltransferase protein level, and a reduced number of striatal ChIs. Furthermore, the mutant striatal ChIs had a normal muscarinic inhibitory function, impaired quinpirole-mediated inhibition, and altered current density. Our findings demonstrate a cell-autonomous effect of Dyt1 deletion on the striatal ChIs and a critical role for the striatal ChIs and corticostriatal pathway in the pathogenesis of DYT1 dystonia.

Dorsolateral striatum dopamine-dependent cocaine seeking is resistant to pavlovian cue extinction in male and female rats

Cue exposure therapy (CET) reduces craving induced by drug-associated cues in individuals with substance use disorders. A preclinical model of CET, cue extinction, similarly reduces cue-induced cocaine seeking in rodent self-administration models; however, those models may not capture the habitual or compulsive aspects of drug use. Thus, the effectiveness of cue extinction was tested in male and female rats trained to self-administer cocaine using second-order (SO) or fixed-ratio (FR) schedules of reinforcement to facilitate dorsolateral striatum (DLS) dopamine-dependent or -independent response strategies, respectively. Cue extinction significantly reduced drug seeking in FR-trained rats, replicating prior results, but was ineffective in SO-trained rats. SO-trained rats also showed increased indices of glutamate signaling in the DLS relative to FR-trained rats, despite comparable levels of cocaine intake. Furthermore, in SO-trained rats, antagonism of AMPA receptors in the DLS rescued the efficacy of cue extinction to reduce drug seeking. Finally, the effectiveness of cue extinction was also revealed in SO-trained rats when they were taught to perform a new, non-habitual response for cocaine cue presentation. Overall, our findings indicate that habit-like drug seeking leads to plasticity in the DLS and behavior that is resistant to cue extinction, but that the effects of cue extinction are restored when DLS glutamatergic signaling is blocked. These results have implications for the effectiveness of clinical cue exposure therapy.

Molecular and circuit mechanisms regulating cocaine memory

Risk of relapse is a major challenge in the treatment of substance use disorders. Several types of learning and memory mechanisms are involved in substance use and have implications for relapse. Associative memories form between the effects of drugs and the surrounding environmental stimuli, and exposure to these stimuli during abstinence causes stress and triggers drug craving, which can lead to relapse. Understanding the neural underpinnings of how these associations are formed and maintained will inform future advances in treatment practices. A large body of research has expanded our knowledge of how associative memories are acquired and consolidated, how they are updated through reactivation and reconsolidation, and how competing extinction memories are formed. This review will focus on the vast literature examining the mechanisms of cocaine Pavlovian associative memories with an emphasis on the molecular memory mechanisms and circuits involved in the consolidation, reconsolidation, and extinction of these memories. Additional research elucidating the specific signaling pathways, mechanisms of synaptic plasticity, and epigenetic regulation of gene expression in the circuits involved in associative learning will reveal more distinctions between consolidation, reconsolidation, and extinction learning that can be applied to the treatment of substance use disorders.

Complementary Control over Habits and Behavioral Vigor by Phasic Activity in the Dorsolateral Striatum

Despite clear evidence linking the basal ganglia to the control of outcome insensitivity (i.e., habit) and behavioral vigor (i.e., its behavioral speed/fluidity), it remains unclear whether or how these functions relate to one another. Here, using male Long-Evans rats in response-based and cue-based maze-running tasks, we demonstrate that phasic dorsolateral striatum (DLS) activity occurring at the onset of a learned behavior regulates how vigorous and habitual it is. In a response-based task, brief optogenetic excitation at the onset of runs decreased run duration and the occurrence of deliberative behaviors, whereas midrun stimulation carried little effect. Outcome devaluation showed these runs to be habitual. DLS inhibition at run start did not produce robust effects on behavior until after outcome devaluation. At that time, when the DLS was plausibly most critically required for performance (i.e., habitual), inhibition reduced performance vigor measures and caused a dramatic loss of habitual responding (i.e., animals quit the task). In a second cue-based "beacon" task requiring behavior initiation at the start of the run and again in the middle of the run, DLS excitation at both time points could improve the vigor of runs. Postdevaluation testing showed behavior on the beacon task to be habitual as well. This pattern of results suggests that one role for phasic DLS activity at behavior initiation is to promote the execution of the behavior in a vigorous and habitual fashion by a diverse set of measures.SIGNIFICANCE STATEMENT Our research expands the literature twofold. First, we find that features of a habitual behavior that are typically studied separately (i.e., maze response performance, deliberation movements, running vigor, and outcome insensitivity) are quite closely linked together. Second, efforts have been made to understand "what" the dorsolateral striatum (DLS) does for habitual behavior, and our research provides a key set of results showing "when" it is important (i.e., at behavior initiation). By showing such dramatic control over habits by DLS activity in a phasic time window, plausible real-world applications could involve more informed DLS perturbations to curb intractably problematic habits.

Dorsal Striatal Circuits for Habits, Compulsions and Addictions

Here, we review the neural circuit bases of habits, compulsions, and addictions, behaviors which are all characterized by relatively automatic action performance. We discuss relevant studies, primarily from the rodent literature, and describe how major headway has been made in identifying the brain regions and neural cell types whose activity is modulated during the acquisition and performance of these automated behaviors. The dorsal striatum and cortical inputs to this structure have emerged as key players in the wider basal ganglia circuitry encoding behavioral automaticity, and changes in the activity of different neuronal cell-types in these brain regions have been shown to co-occur with the formation of automatic behaviors. We highlight how disordered functioning of these neural circuits can result in neuropsychiatric disorders, such as obsessive-compulsive disorder (OCD) and drug addiction. Finally, we discuss how the next phase of research in the field may benefit from integration of approaches for access to cells based on their genetic makeup, activity, connectivity and precise anatomical location.

Deep brain stimulation of the internal capsule enhances human cognitive control and prefrontal cortex function

Deep brain stimulation (DBS) is a circuit-oriented treatment for mental disorders. Unfortunately, even well-conducted psychiatric DBS clinical trials have yielded inconsistent symptom relief, in part because DBS’ mechanism(s) of action are unclear. One clue to those mechanisms may lie in the efficacy of ventral internal capsule/ventral striatum (VCVS) DBS in both major depression (MDD) and obsessive-compulsive disorder (OCD). MDD and OCD both involve deficits in cognitive control. Cognitive control depends on prefrontal cortex (PFC) regions that project into the VCVS. Here, we show that VCVS DBS’ effect is explained in part by enhancement of PFC-driven cognitive control. DBS improves human subjects’ performance on a cognitive control task and increases theta (5–8Hz) oscillations in both medial and lateral PFC. The theta increase predicts subjects’ clinical outcomes. Our results suggest a possible mechanistic approach to DBS therapy, based on tuning stimulation to optimize these neurophysiologic phenomena.

Deep brain stimulation (DBS) is a promising treatment for psychiatric disorders, but its mechanism in relieving symptoms is unclear. Here, the authors show that DBS of ventral internal capsule/ventral striatum (VCVS) may act by enhancing prefrontal cortex oscillations that in turn enhance cognitive control.

Compensatory Relearning Following Stroke: Cellular and Plasticity Mechanisms in Rodents

von Monakow’s theory of diaschisis states the functional ‘standstill’ of intact brain regions that are remote from a damaged area, often implied in recovery of function. Accordingly, neural plasticity and activity patterns related to recovery are also occurring at the same regions. Recovery relies on plasticity in the periinfarct and homotopic contralesional regions and involves relearning to perform movements. Seeking evidence for a relearning mechanism following stroke, we found that rodents display many features that resemble classical learning and memory mechanisms. Compensatory relearning is likely to be accompanied by gradual shaping of these regions and pathways, with participating neurons progressively adapting cortico-striato-thalamic activity and synaptic strengths at different cortico-thalamic loops – adapting function relayed by the striatum. Motor cortex functional maps are progressively reinforced and shaped by these loops as the striatum searches for different functional actions. Several cortical and striatal cellular mechanisms that influence motor learning may also influence post-stroke compensatory relearning. Future research should focus on how different neuromodulatory systems could act before, during or after rehabilitation to improve stroke recovery.