Inversely Active Striatal Projection Neurons and Interneurons Selectively Delimit Useful Behavioral Sequences

Striosomes control dopamine via dual pathways paralleling canonical basal ganglia circuits

Balanced activity of canonical direct D1 and indirect D2 basal ganglia pathways is considered a core requirement for normal movement, and their imbalance is an etiologic factor in movement and neuropsychiatric disorders. We present evidence for a conceptually equivalent pair of direct D1 and indirect D2 pathways that arise from striatal projection neurons (SPNs) of the striosome compartment rather than from SPNs of the matrix, as do the canonical pathways. These striosomal D1 (S-D1) and D2 (S-D2) pathways target substantia nigra dopamine-containing neurons instead of basal ganglia motor output nuclei. They modulate movement with net effects opposite to those exerted by the canonical pathways: S-D1 is net inhibitory and S-D2 is net excitatory. The S-D1 and S-D2 circuits likely influence motivation for learning and action, complementing and reorienting canonical pathway modulation. A major conceptual reformulation of the classic direct-indirect pathway model of basal ganglia function is needed, as well as reconsideration of the effects of D2-targeting therapeutic drugs.

Dissociable roles of thalamic nuclei in the refinement of reaches to spatial targets

Reaches are complex movements that are critical for survival, and encompass the control of different aspects such as direction, speed, and endpoint precision. Complex movements have been postulated to be learned and controlled through distributed motor networks, of which the thalamus is a highly connected node. Still, the role of different thalamic circuits in learning and controlling specific aspects of reaches has not been investigated. We report dissociable roles of two distinct thalamic nuclei - the parafascicular (Pf) and ventroanterior/ventrolateral (VAL) nuclei - in the refinement of spatial target reaches in mice. Using 2-photon calcium imaging in a head-fixed joystick task where mice learned to reach to a target in space, we found that glutamatergic neurons in both areas were most active during reaches early in learning. Reach-related activity in both areas decreased late in learning, as movement direction was refined and reaches increased in accuracy. Furthermore, the population dynamics of Pf, but not VAL, covaried in different subspaces in early and late learning, but eventually stabilized in late learning. The neural activity in Pf, but not VAL, encoded the direction of reaches in early but not late learning. Accordingly, bilateral lesions of Pf before, but not after learning, strongly and specifically impaired the refinement of reach direction. VAL lesions did not impact direction refinement, but instead resulted in increased speed and target overshoot. Our findings provide new evidence that the thalamus is a critical motor node in the learning and control of reaching movements, with specific subnuclei controlling distinct aspects of the reach early in learning.

Striosomes Target Nigral Dopamine-Containing Neurons via Direct-D1 and Indirect-D2 Pathways Paralleling Classic Direct-Indirect Basal Ganglia Systems

Balanced activity of canonical direct D1 and indirect D2 basal ganglia pathways is considered a core requirement for normal movement, and their imbalance is an etiologic factor in movement and neuropsychiatric disorders. We present evidence for a conceptually equivalent pair of direct-D1 and indirect-D2 pathways that arise from striatal projection neurons (SPNs) of the striosome compartment rather than from SPNs of the matrix, as do the canonical pathways. These S-D1 and S-D2 striosomal pathways target substantia nigra dopamine-containing neurons instead of basal ganglia motor output nuclei. They modulate movement oppositely to the modulation by the canonical pathways: S-D1 is inhibitory and S-D2 is excitatory. The S-D1 and S-D2 circuits likely influence motivation for learning and action, complementing and reorienting canonical pathway modulation. A major conceptual reformulation of the classic direct-indirect pathway model of basal ganglia function is needed, as well as reconsideration of the effects of D2-targeting therapeutic drugs.

Contributions of Basal Ganglia Circuits to Perception, Attention, and Consciousness

Research into ascending sensory pathways and cortical networks has generated detailed models of perception. These same cortical regions are strongly connected to subcortical structures, such as the basal ganglia (BG), which have been conceptualized as playing key roles in reinforcement learning and action selection. However, because the BG amasses experiential evidence from higher and lower levels of cortical hierarchies, as well as higher-order thalamus, it is well positioned to dynamically influence perception. Here, we review anatomical, functional, and clinical evidence to demonstrate how the BG can influence perceptual processing and conscious states. This depends on the integrative relationship between cortex, BG, and thalamus, which allows contributions to sensory gating, predictive processing, selective attention, and representation of the temporal structure of events.

Rethinking dopamine-guided action sequence learning

As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.

Closed-loop recruitment of striatal interneurons prevents compulsive-like grooming behaviors

Compulsive behaviors have been associated with striatal hyperactivity. Parvalbumin-positive striatal interneurons (PVIs) in the striatum play a crucial role in regulating striatal activity and suppressing prepotent inappropriate actions. To investigate the potential role of striatal PVIs in regulating compulsive behaviors, we assessed excessive self-grooming-a behavioral metric of compulsive-like behavior-in male Sapap3 knockout mice (Sapap3-KO). Continuous optogenetic activation of PVIs in striatal areas receiving input from the lateral orbitofrontal cortex reduced self-grooming events in Sapap3-KO mice to wild-type levels. Aiming to shorten the critical time window for PVI recruitment, we then provided real-time closed-loop optogenetic stimulation of striatal PVIs, using a transient power increase in the 1-4 Hz frequency band in the orbitofrontal cortex as a predictive biomarker of grooming onsets. Targeted closed-loop stimulation at grooming onsets was as effective as continuous stimulation in reducing grooming events but required 87% less stimulation time, paving the way for adaptive stimulation therapeutic protocols.

Striatal insights: a cellular and molecular perspective on repetitive behaviors in pathology

Animals often behave repetitively and predictably. These repetitive behaviors can have a component that is learned and ingrained as habits, which can be evolutionarily advantageous as they reduce cognitive load and the expenditure of attentional resources. Repetitive behaviors can also be conscious and deliberate, and may occur in the absence of habit formation, typically when they are a feature of normal development in children, or neuropsychiatric disorders. They can be considered pathological when they interfere with social relationships and daily activities. For instance, people affected by obsessive-compulsive disorder, autism spectrum disorder, Huntington's disease and Gilles de la Tourette syndrome can display a wide range of symptoms like compulsive, stereotyped and ritualistic behaviors. The striatum nucleus of the basal ganglia is proposed to act as a master regulator of these repetitive behaviors through its circuit connections with sensorimotor, associative, and limbic areas of the cortex. However, the precise mechanisms within the striatum, detailing its compartmental organization, cellular specificity, and the intricacies of its downstream connections, remain an area of active research. In this review, we summarize evidence across multiple scales, including circuit-level, cellular, and molecular dimensions, to elucidate the striatal mechanisms underpinning repetitive behaviors and offer perspectives on the implicated disorders. We consider the close relationship between behavioral output and transcriptional changes, and thereby structural and circuit alterations, including those occurring through epigenetic processes.

Role of the basal ganglia in innate and learned behavioural sequences

Integrating individual actions into coherent, organised behavioural units, a process called chunking, is a fundamental, evolutionarily conserved process that renders actions automatic. In vertebrates, evidence points to the basal ganglia - a complex network believed to be involved in action selection - as a key component of action sequence encoding, although the underlying mechanisms are only just beginning to be understood. Central pattern generators control many innate automatic behavioural sequences that form some of the most basic behaviours in an animal's repertoire, and in vertebrates, brainstem and spinal pattern generators are under the control of higher order structures such as the basal ganglia. Evidence suggests that the basal ganglia play a crucial role in the concatenation of simpler behaviours into more complex chunks, in the context of innate behavioural sequences such as chain grooming in rats, as well as sequences in which innate capabilities and learning interact such as birdsong, and sequences that are learned from scratch, such as lever press sequences in operant behaviour. It has been proposed that the role of the striatum, the largest input structure of the basal ganglia, might lie in selecting and allowing the relevant central pattern generators to gain access to the motor system in the correct order, while inhibiting other behaviours. As behaviours become more complex and flexible, the pattern generators seem to become more dependent on descending signals. Indeed, during learning, the striatum itself may adopt the functional characteristics of a higher order pattern generator, facilitated at the microcircuit level by striatal neuropeptides.

Cell-Type Specific Connectivity of Whisker-Related Sensory and Motor Cortical Input to Dorsal Striatum

The anterior dorsolateral striatum (DLS) is heavily innervated by convergent excitatory projections from the primary motor (M1) and sensory cortex (S1) and considered an important site of sensorimotor integration. M1 and S1 corticostriatal synapses have functional differences in their connection strength with striatal spiny projection neurons (SPNs) and fast-spiking interneurons (FSIs) in the DLS and, as a result, exert distinct influences on sensory-guided behaviors. In the present study, we tested whether M1 and S1 inputs exhibit differences in the subcellular anatomical distribution of striatal neurons. We injected adeno-associated viral vectors encoding spaghetti monster fluorescent proteins (sm.FPs) into M1 and S1 in male and female mice and used confocal microscopy to generate 3D reconstructions of corticostriatal inputs to single identified SPNs and FSIs obtained through ex vivo patch clamp electrophysiology. We found that M1 and S1 dually innervate SPNs and FSIs; however, there is a consistent bias towards the M1 input in SPNs that is not found in FSIs. In addition, M1 and S1 inputs were distributed similarly across the proximal, medial, and distal regions of SPN and FSI dendrites. Notably, closely localized M1 and S1 clusters of inputs were more prevalent in SPNs than FSIs, suggesting that cortical inputs are integrated through cell-type specific mechanisms. Our results suggest that the stronger functional connectivity from M1 to SPNs compared to S1, as previously observed, is due to a higher quantity of synaptic inputs. Our results have implications for how sensorimotor integration is performed in the striatum through cell-specific differences in corticostriatal connections.

Striatal Neurons Are Recruited Dynamically into Collective Representations of Self-Initiated and Learned Actions in Freely Moving Mice

Striatal spiny projection neurons are hyperpolarized-at-rest (HaR) and driven to action potential threshold by a small number of powerful inputs-an input-output configuration that is detrimental to response reliability. Because the striatum is important for habitual behaviors and goal-directed learning, we conducted a microendoscopic imaging in freely moving mice that express a genetically encoded Ca2+ indicator sparsely in striatal HaR neurons to evaluate their response reliability during self-initiated movements and operant conditioning. The sparse expression was critical for longitudinal studies of response reliability, and for studying correlations among HaR neurons while minimizing spurious correlations arising from contamination by the background signal. We found that HaR neurons are recruited dynamically into action representation, with distinct neuronal subsets being engaged in a moment-by-moment fashion. While individual neurons respond with little reliability, the population response remained stable across days. Moreover, we found evidence for the temporal coupling between neuronal subsets during conditioned (but not innate) behaviors.

Sensory Reinforced Corticostriatal Plasticity

BACKGROUND

Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions.

OBJECTIVE

While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity.

METHODS

We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation.

RESULTS

We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission.

CONCLUSION

This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Dissociating the contributions of sensorimotor striatum to automatic and visually guided motor sequences

The ability to sequence movements in response to new task demands enables rich and adaptive behavior. However, such flexibility is computationally costly and can result in halting performances. Practicing the same motor sequence repeatedly can render its execution precise, fast and effortless, that is, 'automatic'. The basal ganglia are thought to underlie both types of sequence execution, yet whether and how their contributions differ is unclear. We parse this in rats trained to perform the same motor sequence instructed by cues and in a self-initiated overtrained, or 'automatic,' condition. Neural recordings in the sensorimotor striatum revealed a kinematic code independent of the execution mode. Although lesions reduced the movement speed and affected detailed kinematics similarly, they disrupted high-level sequence structure for automatic, but not visually guided, behaviors. These results suggest that the basal ganglia are essential for 'automatic' motor skills that are defined in terms of continuous kinematics, but can be dispensable for discrete motor sequences guided by sensory cues.

Reversible inhibition of the basal ganglia prolongs repetitive vocalization but only weakly affects sequencing at branch points in songbirds

Although vocal signals, including languages and songbird syllables, are composed of a finite number of acoustic elements, diverse vocal sequences are composed of a combination of these elements, which are linked together by syntactic rules. However, the neural basis of syntactic vocalization generation remains poorly understood. Here, we report that inhibition using tetrodotoxin (TTX) and manipulations of gamma-aminobutyric acid (GABA) receptors within the basal ganglia Area X or lateral magnocellular nucleus of the anterior neostriatum (LMAN) alter and prolong repetitive vocalization in Bengalese finches (Lonchura striata var. domestica). These results suggest that repetitive vocalizations are modulated by the basal ganglia and not solely by higher motor cortical neurons. These data highlight the importance of neural circuits, including the basal ganglia, in the production of stereotyped repetitive vocalizations and demonstrate that dynamic disturbances within the basal ganglia circuitry can differentially affect the repetitive temporal features of songs.

Alcohol potentiates multiple GABAergic inputs to dorsal striatum fast-spiking interneurons

Parvalbumin-expressing dorsal striatal fast-spiking interneurons, comprising ∼1% of the total dorsal striatal neuronal population, are necessary for the expression of compulsive-like ethanol consumption mice. Fast-spiking interneurons are driven to fire by glutamatergic inputs derived primarily from the cortex. However, these neurons also receive substantial GABAergic input from two sources: the globus pallidus and the reticular nucleus of the thalamus. How ethanol modulates inhibitory input onto fast-spiking neurons is unclear and, more broadly, alcohol effects on GABAergic synaptic transmission onto GABAergic interneurons are understudied. Examining this, we found that acute bath application of ethanol (50 mM) potentiated GABAergic transmission from both the globus pallidus and the reticular nucleus of the thalamus onto fast-spiking interneurons in mouse of both sexes. This ethanol-induced potentiation required postsynaptic calcium and was not accompanied by a sustained change in presynaptic GABA release probability. Examining whether this ethanol effect persisted following chronic intermittent ethanol exposure, we found attenuated acute-ethanol potentiation of GABAergic transmission from both the globus pallidus and the reticular nucleus of the thalamus onto striatal fast-spiking interneurons. These data underscore the impact of ethanol on GABAergic signaling in the dorsal striatum and support the notion that ethanol may disinhibit the dorsolateral striatum.

Spinophilin Limits Metabotropic Glutamate Receptor 5 Scaffolding to the Postsynaptic Density and Cell Type Specifically Mediates Excessive Grooming

BACKGROUND

Grooming dysfunction is a hallmark of the obsessive-compulsive spectrum disorder trichotillomania. Numerous preclinical studies have utilized SAPAP3-deficient mice for understanding the neurobiology of repetitive grooming, suggesting that excessive grooming is caused by increased metabotropic glutamate receptor 5 (mGluR5) activity in striatal direct- and indirect-pathway medium spiny neurons (MSNs). However, the MSN subtype-specific signaling mechanisms that mediate mGluR5-dependent adaptations underlying excessive grooming are not fully understood. Here, we investigated the MSN subtype-specific roles of the striatal signaling hub protein spinophilin in mediating repetitive motor dysfunction associated with mGluR5 function.

METHODS

Quantitative proteomics and immunoblotting were utilized to identify how spinophilin impacts mGluR5 phosphorylation and protein interaction changes. Plasticity and repetitive motor dysfunction associated with mGluR5 action were measured using our novel conditional spinophilin mouse model in which spinophilin was knocked out from striatal direct-pathway MSNs and/or indirect-pathway MSNs.

RESULTS

Loss of spinophilin only in indirect-pathway MSNs decreased performance of a novel motor repertoire, but loss of spinophilin in either MSN subtype abrogated striatal plasticity associated with mGluR5 function and prevented excessive grooming caused by SAPAP3 knockout mice or treatment with the mGluR5-specific positive allosteric modulator VU0360172 without impacting locomotion-relevant behavior. Biochemically, we determined that the spinophilin-mGluR5 interaction correlates with grooming behavior and that loss of spinophilin shifts mGluR5 interactions from lipid raft-associated proteins toward postsynaptic density proteins implicated in psychiatric disorders.

CONCLUSIONS

These results identify spinophilin as a novel striatal signaling hub molecule in MSNs that cell subtype specifically mediates behavioral, functional, and molecular adaptations associated with repetitive motor dysfunction in psychiatric disorders.

Cell-Type Specific Connectivity of Whisker-Related Sensory and Motor Cortical Input to Dorsal Striatum

The anterior dorsolateral striatum (DLS) is heavily innervated by convergent excitatory projections from the primary motor (M1) and sensory cortex (S1) and is considered an important site of sensorimotor integration. M1 and S1 corticostriatal synapses have functional differences in the strength of their connections with striatal spiny projection neurons (SPNs) and fast-spiking interneurons (FSIs) in the DLS, and as a result exert an opposing influence on sensory-guided behaviors. In the present study, we tested whether M1 and S1 inputs exhibit differences in the subcellular anatomical distribution onto striatal neurons. We injected adeno-associated viral vectors encoding spaghetti monster fluorescent proteins (sm.FPs) into M1 and S1, and used confocal microscopy to generate 3D reconstructions of corticostriatal inputs to single identified SPNs and FSIs obtained through ex-vivo patch-clamp electrophysiology. We found that SPNs are less innervated by S1 compared to M1, but FSIs receive a similar number of inputs from both M1 and S1. In addition, M1 and S1 inputs were distributed similarly across the proximal, medial, and distal regions of SPNs and FSIs. Notably, clusters of inputs were prevalent in SPNs but not FSIs. Our results suggest that SPNs have stronger functional connectivity to M1 compared to S1 due to a higher density of synaptic inputs. The clustering of M1 and S1 inputs onto SPNs but not FSIs suggest that cortical inputs are integrated through cell-type specific mechanisms and more generally have implications for how sensorimotor integration is performed in the striatum.

Significance Statement

The dorsolateral striatum (DLS) is a key brain area involved in sensorimotor integration due to its dense innervation by the primary motor (M1) and sensory cortex (S1). However, the quantity and anatomical distribution of these inputs to the striatal cell population has not been well characterized. In this study we demonstrate that corticostriatal projections from M1 and S1 differentially innervate spiny projection neurons (SPNs) and fast-spiking interneurons (FSIs) in the DLS. S1 inputs innervate SPNs less than M1 and are likely to form synaptic clusters in SPNs but not in FSIs. These findings suggest that sensorimotor integration is partly achieved by differences in the synaptic organization of corticostriatal inputs to local striatal microcircuits.

Knowledge generalization and the costs of multitasking

Humans are able to rapidly perform novel tasks, but show pervasive performance costs when attempting to do two things at once. Traditionally, empirical and theoretical investigations into the sources of such multitasking interference have largely focused on multitasking in isolation to other cognitive functions, characterizing the conditions that give rise to performance decrements. Here we instead ask whether multitasking costs are linked to the system's capacity for knowledge generalization, as is required to perform novel tasks. We show how interrogation of the neurophysiological circuitry underlying these two facets of cognition yields further insights for both. Specifically, we demonstrate how a system that rapidly generalizes knowledge may induce multitasking costs owing to sharing of task contingencies between contexts in neural representations encoded in frontoparietal and striatal brain regions. We discuss neurophysiological insights suggesting that prolonged learning segregates such representations by refining the brain's model of task-relevant contingencies, thereby reducing information sharing between contexts and improving multitasking performance while reducing flexibility and generalization. These proposed neural mechanisms explain why the brain shows rapid task understanding, multitasking limitations and practice effects. In short, multitasking limits are the price we pay for behavioural flexibility.

iPSC-Derived Striatal Medium Spiny Neurons from Patients with Multiple System Atrophy Show Hypoexcitability and Elevated α-Synuclein Release

Multiple system atrophy of the parkinsonian type (MSA-P) is a rare, fatal neurodegenerative disease with sporadic onset. It is still unknown if MSA-P is a primary oligodendropathy or caused by neuronal pathophysiology leading to severe, α-synuclein-associated neurodegeneration, mainly in the striatum. In this study, we generated and differentiated induced pluripotent stem cells (iPSCs) from patients with the clinical diagnosis of probable MSA-P (n = 3) and from three matched healthy controls into GABAergic striatal medium spiny neurons (MSNs). We found a significantly elevated release and neuronal distribution for α-synuclein, as well as hypoexcitability in the MSNs derived from the MSA-P patients compared to the healthy controls. These data suggest that the striatal hypoexcitable neurons of MSA-P patients contribute to a pathological α-synuclein burden which is likely to spread to neighboring cells and projection targets, facilitating disease progression.

Neuronal structures controlling locomotor behavior during active and inactive motor states

Animal behaviors can be divided into two states according to their motor activity: the active motor state, which involves significant body movements, and the inactive motor state, which refers to when the animal is stationary. The timing and duration of these states are determined by the activity of the neuronal circuits involved in motor control. Among these motor circuits, those that generate locomotion are some of the most studied neuronal networks and are widely distributed from the spinal cord to the cerebral cortex. In this review, we discuss recent discoveries, mainly in rodents using state-of-the-art experimental approaches, of the neuronal mechanisms underlying the initiation and termination of locomotion in the brainstem, basal ganglia, and prefrontal cortex. These findings is discussed with reference to studies on the neuronal mechanism of motor control during sleep and the modulation of cortical states in these structures. Accumulating evidence has unraveled the complex yet highly structured network that controls the transition between motor states.

Lack of action monitoring as a prerequisite for habitual and chunked behavior: Behavioral and neural correlates

We previously reported the rapid development of habitual behavior in a discrete-trials instrumental task in which lever insertion and retraction act as reward-predictive cues delineating sequence execution. Here we asked whether lever cues or performance variables reflective of skill and automaticity might account for habitual behavior in male rats. Behavior in the discrete-trials habit-promoting task was compared with two task variants lacking the sequence-delineating cues of lever extension and retraction. We find that behavior is under goal-directed control in absence of sequence-delineating cues but not in their presence, and that skilled performance does not predict goal-directed vs. habitual behavior. Neural activity recordings revealed an engagement of dorsolateral striatum and a disengagement of dorsomedial striatum during the sequence execution of the habit-promoting task, specifically. Together, these results indicate that sequence delineation cues promote habit and differential engagement of striatal subregions during instrumental responding, a pattern that may reflect cue-elicited behavioral chunking.

Learning-induced changes in the neural circuits underlying motor sequence execution

As the old adage goes: practice makes perfect. Yet, the neural mechanisms by which rote repetition transforms a halting behavior into a fluid, effortless, and "automatic" action are not well understood. Here we consider the possibility that well-practiced motor sequences, which initially rely on higher-level decision-making circuits, become wholly specified in lower-level control circuits. We review studies informing this idea, discuss the constraints on such shift in control, and suggest approaches to pinpoint circuit-level changes associated with motor sequence learning.

Oscillation/Coincidence-Detection Models of Reward-Related Timing in Corticostriatal Circuits

The major tenets of beat-frequency/coincidence-detection models of reward-related timing are reviewed in light of recent behavioral and neurobiological findings. This includes the emphasis on a core timing network embedded in the motor system that is comprised of a corticothalamic-basal ganglia circuit. Therein, a central hub provides timing pulses (i.e., predictive signals) to the entire brain, including a set of distributed satellite regions in the cerebellum, cortex, amygdala, and hippocampus that are selectively engaged in timing in a manner that is more dependent upon the specific sensory, behavioral, and contextual requirements of the task. Oscillation/coincidence-detection models also emphasize the importance of a tuned ‘perception’ learning and memory system whereby target durations are detected by striatal networks of medium spiny neurons (MSNs) through the coincidental activation of different neural populations, typically utilizing patterns of oscillatory input from the cortex and thalamus or derivations thereof (e.g., population coding) as a time base. The measure of success of beat-frequency/coincidence-detection accounts, such as the Striatal Beat-Frequency model of reward-related timing (SBF), is their ability to accommodate new experimental findings while maintaining their original framework, thereby making testable experimental predictions concerning diagnosis and treatment of issues related to a variety of dopamine-dependent basal ganglia disorders, including Huntington’s and Parkinson’s disease.

Hierarchical Reinforcement Learning, Sequential Behavior, and the Dorsal Frontostriatal System

To effectively behave within ever-changing environments, biological agents must learn and act at varying hierarchical levels such that a complex task may be broken down into more tractable subtasks. Hierarchical reinforcement learning (HRL) is a computational framework that provides an understanding of this process by combining sequential actions into one temporally extended unit called an option. However, there are still open questions within the HRL framework, including how options are formed and how HRL mechanisms might be realized within the brain. In this review, we propose that the existing human motor sequence literature can aid in understanding both of these questions. We give specific emphasis to visuomotor sequence learning tasks such as the discrete sequence production task and the M × N (M steps × N sets) task to understand how hierarchical learning and behavior manifest across sequential action tasks as well as how the dorsal cortical-subcortical circuitry could support this kind of behavior. This review highlights how motor chunks within a motor sequence can function as HRL options. Furthermore, we aim to merge findings from motor sequence literature with reinforcement learning perspectives to inform experimental design in each respective subfield.

Striatal direct pathway neurons play leading roles in accelerating rotarod motor skill learning

Dorsal striatum is important for movement control and motor skill learning. However, it remains unclear how the spatially and temporally distributed striatal medium spiny neuron (MSN) activity in the direct and indirect pathways (D1 and D2 MSNs, respectively) encodes motor skill learning. Combining miniature fluorescence microscopy with an accelerating rotarod procedure, we identified two distinct MSN subpopulations involved in accelerating rotarod learning. In both D1 and D2 MSNs, we observed neurons that displayed activity tuned to acceleration during early stages of trials, as well as movement speed during late stages of trials. We found a distinct evolution trajectory for early-stage neurons during motor skill learning, with the evolution of D1 MSNs correlating strongly with performance improvement. Importantly, optogenetic inhibition of the early-stage neural activity in D1 MSNs, but not D2 MSNs, impaired accelerating rotarod learning. Together, this study provides insight into striatal D1 and D2 MSNs encoding motor skill learning.

Spatiotemporal reorganization of corticostriatal networks encodes motor skill learning

Motor skill learning requires the activity of the dorsal striatum, with a differential global implication of the dorsomedial and dorsolateral territories. We investigate here whether and how specific striatal neurons encode the acquisition and consolidation of a motor skill. Using ex vivo two-photon calcium imaging after rotarod training, we report that highly active (HA) striatal populations arise from distinct spatiotemporal reorganization in the dorsomedial (DMS) and dorsolateral (DLS) striatum networks and are correlated with learning performance. The DMS overall activity decreases in early training, with few and sparsely distributed HA cells, while the DLS shows a progressive and long-lasting formation of HA cell clusters. These reorganizations result from reinforcement of synaptic connections to the DMS and anatomical rearrangements to the DLS. Targeted silencing of DMS or DLS HA cells with the cFos-TRAP strategy strongly impairs individual performance. Our data reveal that discrete domains of striatal populations encode acquisition and long-lasting retention of a motor skill.

Cortico-striatal circuits for bilaterally coordinated movements

Movement initiation and control require the orchestrated activity of sensorimotor cortical and subcortical regions. However, the exact contribution of specific pathways and interactions to the final behavioral outcome are still under debate. Here, by combining structural lesions, pathway-specific optogenetic manipulations and freely moving electrophysiological recordings in rats, we studied cortico-striatal interactions in the context of forelimb bilaterally coordinated movements. We provide evidence indicating that bilateral actions are initiated by motor cortical regions where intratelencephalic bilateral cortico-striatal (bcs-IT) projections recruit the sensorimotor striatum to provide stability and duration to already commanded bilateral movements. Furthermore, striatal spiking activity was correlated with movement duration and kinematic parameters of the execution. bcs-IT stimulation affected only the representation of movement duration but spared that of kinematics. Our findings confirm the modular organization of information processing in the striatum and its involvement in moment-to-moment movement control but not initiation or selection.

Reinforcement-learning in fronto-striatal circuits

We review the current state of knowledge on the computational and neural mechanisms of reinforcement-learning with a particular focus on fronto-striatal circuits. We divide the literature in this area into five broad research themes: the target of the learning-whether it be learning about the value of stimuli or about the value of actions; the nature and complexity of the algorithm used to drive the learning and inference process; how learned values get converted into choices and associated actions; the nature of state representations, and of other cognitive machinery that support the implementation of various reinforcement-learning operations. An emerging fifth area focuses on how the brain allocates or arbitrates control over different reinforcement-learning sub-systems or "experts". We will outline what is known about the role of the prefrontal cortex and striatum in implementing each of these functions. We then conclude by arguing that it will be necessary to build bridges from algorithmic level descriptions of computational reinforcement-learning to implementational level models to better understand how reinforcement-learning emerges from multiple distributed neural networks in the brain.

Dorsal striatum coding for the timely execution of action sequences

The automatic initiation of actions can be highly functional. But occasionally these actions cannot be withheld and are released at inappropriate times, impulsively. Striatal activity has been shown to participate in the timing of action sequence initiation and it has been linked to impulsivity. Using a self-initiated task, we trained adult male rats to withhold a rewarded action sequence until a waiting time interval has elapsed. By analyzing neuronal activity we show that the striatal response preceding the initiation of the learned sequence is strongly modulated by the time subjects wait before eliciting the sequence. Interestingly, the modulation is steeper in adolescent rats, which show a strong prevalence of impulsive responses compared to adults. We hypothesize this anticipatory striatal activity reflects the animals’ subjective reward expectation, based on the elapsed waiting time, while the steeper waiting modulation in adolescence reflects age-related differences in temporal discounting, internal urgency states, or explore–exploit balance.

Striatonigrostriatal Spirals in Addiction

A biological reward system is integral to all animal life and humans are no exception. For millennia individuals have investigated this system and its influences on human behavior. In the modern day, with the US facing an ongoing epidemic of substance use without an effective treatment, these investigations are of paramount importance. It is well known that basal ganglia contribute to rewards and are involved in learning, approach behavior, economic choices, and positive emotions. This review aims to elucidate the physiological role of striatonigrostriatal (SNS) spirals, as part of basal ganglia circuits, in this reward system and their pathophysiological role in perpetuating addiction. Additionally, the main functions of neurotransmitters such as dopamine and glutamate and their receptors in SNS circuits will be summarized. With this information, the claim that SNS spirals are crucial intermediaries in the shift from goal-directed behavior to habitual behavior will be supported, making this circuit a viable target for potential therapeutic intervention in those with substance use disorders.

Dorsomedial Striatal Activity Tracks Completion of Behavioral Sequences in Rats

For proper execution of goal-directed behaviors, individuals require both a general representation of the goal and an ability to monitor their own progress toward that goal. Here, we examine how dorsomedial striatum (DMS), a region pivotal for forming associations among stimuli, actions, and outcomes, encodes the execution of goal-directed action sequences that require self-monitoring of behavior. We trained rats to complete a sequence of at least five consecutive lever presses (without visiting the reward port) to obtain a reward and recorded the activity of individual cells in DMS while rats performed the task. We found that the pattern of DMS activity gradually changed during the execution of the sequence, permitting accurate decoding of sequence progress from neural activity at a population level. Moreover, this sequence-related activity was blunted on trials where rats did not complete a sufficient number of presses. Overall, these data suggest a link between DMS activity and the execution of behavioral sequences that require monitoring of ongoing behavior.

Direct and indirect pathway neurons in ventrolateral striatum differentially regulate licking movement and nigral responses

Drinking behavior in rodents is characterized by stereotyped, rhythmic licking movement, which is regulated by the basal ganglia. It is unclear how direct and indirect pathways control the lick bout and individual spout contact. We find that inactivating D1 and D2 receptor-expressing medium spiny neurons (MSNs) in the ventrolateral striatum (VLS) oppositely alters the number of licks in a bout. D1- and D2-MSNs exhibit different patterns of lick-sequence-related activity and different phases of oscillation time-locked to the lick cycle. On the timescale of a lick cycle, transient inactivation of D1-MSNs during tongue protrusion reduces spout contact probability, whereas transiently inactivating D2-MSNs has no effect. On the timescale of a lick bout, inactivation of D1-MSNs (D2-MSNs) causes rate increase (decrease) in a subset of basal ganglia output neurons that decrease firing during licking. Our results reveal the distinct roles of D1- and D2-MSNs in regulating licking at both coarse and fine timescales.

The Contribution of Premotor Cortico-Striatal Projections to the Execution of Serial Order Sequences

Striatal activity is necessary to initiate and execute sequences of actions. The main excitatory input to the striatum comes from the cortex. While it is hypothesized that motor and premotor cortico-striatal projections are important to guide striatal activity during the execution of sequences of actions, technical limitations have made this challenging to address. Here, we implemented a task in mice that allows for the study of different moments to execute a serial order sequence consisting of two subsequences of actions. Using this task, we performed electrophysiological recordings in the premotor (M2) and primary motor (M1) cortices, and state-dependent optogenetic inhibitions of their cortico-striatal projections. We show that while both M2 and M1 contain activity modulations related to the execution of self-paced sequences, mainly, the premotor cortico-striatal projections contribute to the proper execution/structuring of these sequences.

The basal ganglia control the detailed kinematics of learned motor skills

The basal ganglia are known to influence action selection and modulation of movement vigor, but whether and how they contribute to specifying the kinematics of learned motor skills is not understood. Here, we probe this question by recording and manipulating basal ganglia activity in rats trained to generate complex task-specific movement patterns with rich kinematic structure. We find that the sensorimotor arm of the basal ganglia circuit is crucial for generating the detailed movement patterns underlying the acquired motor skills. Furthermore, the neural representations in the striatum, and the control function they subserve, do not depend on inputs from the motor cortex. Taken together, these results extend our understanding of the basal ganglia by showing that they can specify and control the fine-grained details of learned motor skills through their interactions with lower-level motor circuits.

CalDAG-GEFI mediates striatal cholinergic modulation of dendritic excitability, synaptic plasticity and psychomotor behaviors

CalDAG-GEFI (CDGI) is a protein highly enriched in the striatum, particularly in the principal spiny projection neurons (SPNs). CDGI is strongly down-regulated in two hyperkinetic conditions related to striatal dysfunction: Huntington’s disease and levodopa-induced dyskinesia in Parkinson’s disease. We demonstrate that genetic deletion of CDGI in mice disrupts dendritic, but not somatic, M1 muscarinic receptors (M1Rs) signaling in indirect pathway SPNs. Loss of CDGI reduced temporal integration of excitatory postsynaptic potentials at dendritic glutamatergic synapses and impaired the induction of activity-dependent long-term potentiation. CDGI deletion selectively increased psychostimulant-induced repetitive behaviors, disrupted sequence learning, and eliminated M1R blockade of cocaine self-administration. These findings place CDGI as a major, but previously unrecognized, mediator of cholinergic signaling in the striatum. The effects of CDGI deletion on the self-administration of drugs of abuse and its marked alterations in hyperkinetic extrapyramidal disorders highlight CDGI’s therapeutic potential.

Dorsal striatum and the temporal expectancy of an aversive event in Pavlovian odor fear learning

Interval timing, the ability to encode and retrieve the memory of intervals from seconds to minutes, guides fundamental animal behaviors across the phylogenetic tree. In Pavlovian fear conditioning, an initially neutral stimulus (conditioned stimulus, CS) predicts the arrival of an aversive unconditioned stimulus (US, generally a mild foot-shock) at a fixed time interval. Although some studies showed that temporal relations between CS and US events are learned from the outset of conditioning, the question of the memory of time and its underlying neural network in fear conditioning is still poorly understood. The aim of the present study was to investigate the role of the dorsal striatum in timing intervals in odor fear conditioning in male rats. To assess the animal's interval timing ability in this paradigm, we used the respiratory frequency. This enabled us to detect the emergence of temporal patterns related to the odor-shock time interval from the early stage of learning, confirming that rats are able to encode the odor-shock time interval after few training trials. We carried out reversible inactivation of the dorsal striatum before the acquisition session and before a shift in the learned time interval, and measured the effects of this treatment on the temporal pattern of the respiratory rate. In addition, using intracerebral microdialysis, we monitored extracellular dopamine level in the dorsal striatum throughout odor-shock conditioning and in response to a shift of the odor-shock time interval. Contrary to our initial predictions based on the existing literature on interval timing, we found evidence suggesting that transient inactivation of the dorsal striatum may favor a more precocious buildup of the respiratory frequency's temporal pattern during the odor-shock interval in a manner that reflected the duration of the interval. Our data further suggest that the conditioning and the learning of a novel time interval were associated with a decrease in dopamine level in the dorsal striatum, but not in the nucleus accumbens. These findings prompt a reassessment of the role of the striatum and striatal dopamine in interval timing, at least when considering Pavlovian aversive conditioning.

Striatal activity topographically reflects cortical activity

The cortex projects to the dorsal striatum topographically^1,2 to regulate behaviour^3-5, but spiking activity in the two structures has previously been reported to have markedly different relations to sensorimotor events^6-9. Here we show that the relationship between activity in the cortex and striatum is spatiotemporally precise, topographic, causal and invariant to behaviour. We simultaneously recorded activity across large regions of the cortex and across the width of the dorsal striatum in mice that performed a visually guided task. Striatal activity followed a mediolateral gradient in which behavioural correlates progressed from visual cue to response movement to reward licking. The summed activity in each part of the striatum closely and specifically mirrored activity in topographically associated cortical regions, regardless of task engagement. This relationship held for medium spiny neurons and fast-spiking interneurons, whereas the activity of tonically active neurons differed from cortical activity with stereotypical responses to sensory or reward events. Inactivation of the visual cortex abolished striatal responses to visual stimuli, supporting a causal role of cortical inputs in driving the striatum. Striatal visual responses were larger in trained mice than untrained mice, with no corresponding change in overall activity in the visual cortex. Striatal activity therefore reflects a consistent, causal and scalable topographical mapping of cortical activity.

Compulsive alcohol consumption is regulated by dorsal striatum fast-spiking interneurons

Compulsive alcohol consumption is a core, treatment-resistant feature of alcohol use disorder. The dorsomedial and dorsolateral striatum support goal-directed and habitual action strategies, respectively. How ethanol targets dorsolateral striatum to drive compulsive consumption is poorly understood. Parvalbumin-expressing striatal fast-spiking interneurons comprise ~1% of the total neuronal striatal population, are enriched dorsolaterally and are functionally modulated by ethanol. To test whether fast-spiking interneurons are necessary for the development of compulsive ethanol consumption, we selectively ablated these neurons in adult male and female C57BL/6 J mice undergoing a voluntary chronic intermittent ethanol consumption paradigm followed by a compulsive ethanol drinking assay. Fast-spiking interneuron ablation curtailed the development of organized ethanol lick sequence behavior, reduced ethanol consumption, and abrogated compulsive consumption of ethanol with the added bitterant quinine. In contrast, fast-spiking interneuron ablation did not affect any index of water or sucrose consumption. These data causally implicate the minority striatal fast-spiking interneuron population as a key component of compulsive ethanol consumption.

Dopamine D2 receptor signaling on iMSNs is required for initiation and vigor of learned actions

Striatal dopamine D2 receptors (D2Rs) are important for motor output. Selective deletion of D2Rs from indirect pathway-projecting medium spiny neurons (iMSNs) impairs locomotor activities in a task-specific manner. However, the role of D2Rs in the initiation of motor actions in reward seeking and taking is not fully understood, and there is little information about how receptors contribute under different task demands and with different outcome types. The iMSN-D2Rs modulate neuronal activity and synaptic transmission, exerting control on circuit functions that may play distinct roles in action learning and performance. Selective deletion of D2Rs on iMSNs resulted in slower action initiation and response rate in an instrumental conditioning task, but only when performance demand was increased. The iMSN-Drd2KO mice were also slower to initiate swimming in a T-maze procedural learning task but were unimpaired in cognitive function and behavioral flexibility. In contrast, in a Pavlovian discrimination learning task, iMSN-Drd2KO mice exhibited normal acquisition and extinction of rewarded responding. The iMSN-Drd2KO mice showed performance deficits at all phases of rotarod skill learning. These findings reveal that dopamine modulation through iMSN-D2Rs influences the ability to self-initiate actions, as well as the willingness and/or vigor with which these responses are performed. However, these receptors seem to have little influence on simple associative learning or on stimulus-driven responding. The loss of normal D2R roles may contribute to disorders in which impaired dopamine signaling leads to hypokinesia or impaired initiation of specific voluntary actions.

Striosomes Mediate Value-Based Learning Vulnerable in Age and a Huntington's Disease Model

Learning valence-based responses to favorable and unfavorable options requires judgments of the relative value of the options, a process necessary for species survival. We found, using engineered mice, that circuit connectivity and function of the striosome compartment of the striatum are critical for this type of learning. Calcium imaging during valence-based learning exhibited a selective correlation between learning and striosomal but not matrix signals. This striosomal activity encoded discrimination learning and was correlated with task engagement, which, in turn, could be regulated by chemogenetic excitation and inhibition. Striosomal function during discrimination learning was disturbed with aging and severely so in a mouse model of Huntington's disease. Anatomical and functional connectivity of parvalbumin-positive, putative fast-spiking interneurons (FSIs) to striatal projection neurons was enhanced in striosomes compared with matrix in mice that learned. Computational modeling of these findings suggests that FSIs can modulate the striosomal signal-to-noise ratio, crucial for discrimination and learning.

Cortical and striatal circuits together encode transitions in natural behavior

In natural behavior, we fluidly change from one type of activity to another in a sequence of motor actions. Corticostriatal circuits are thought to have a particularly important role in the construction of action sequences, but neuronal coding of a sequential behavior consisting of different motor programs has not been investigated at the circuit level in corticostriatal networks, making the exact nature of this involvement elusive. Here, we show, by analyzing spontaneous self-grooming in rats, that neuronal modulation in motor cortex and dorsal striatum is strongly related to transitions between behaviors. Our data suggest that longer action sequences in rodent grooming behavior emerge from stepwise control of individual behavioral transitions, where future actions are encoded differently depending on current motor state. This state-dependent motor coding was found to differentiate between rare behavioral transitions and as opposed to more habitual sequencing of actions.

Discrete finger sequences are widely represented in human striatum

Research in primates and rodents ascribes the striatum a critical role in integrating elementary movements into unitary action sequences through reinforcement-based learning. Yet it remains to be shown whether the human striatum represents action sequence-specific information. Young right-handed volunteers underwent functional magnetic resonance imaging while they performed four discrete finger sequences with their right hand, consisting of five button presses. Specific finger sequences could be discriminated based on the distributed activity patterns in left and right striatum, but not by average differences in single-voxel activity. Multiple bilateral clusters in putamen and caudate nucleus belonging to motor, associative, parietal and limbic territories contributed to classification sensitivity. The results show that individual finger movement sequences are widely represented in human striatum, supporting functional integration rather than segregation. The findings are compatible with the idea that the basal ganglia simultaneously integrate motor, associative and limbic aspects in the control of complex overlearned behaviour.

Continuous Representations of Speed by Striatal Medium Spiny Neurons

The striatum is critical for controlling motor output. However, it remains unclear how striatal output neurons encode and facilitate movement. A prominent theory suggests that striatal units encode movements in bursts of activity near specific events, such as the start or end of actions. These bursts are theorized to gate or permit specific motor actions, thereby encoding and facilitating complex sequences of actions. An alternative theory has suggested that striatal neurons encode continuous changes in sensory or motor information with graded changes in firing rate. Supporting this theory, many striatal neurons exhibit such graded changes without bursting near specific actions. Here, we evaluated these two theories in the same recordings of mice (both male and female). We recorded single-unit and multiunit activity from the dorsomedial striatum of mice as they spontaneously explored an arena. We observed both types of encoding, although continuous encoding was more prevalent than bursting near movement initiation or termination. The majority of recorded units did not exhibit positive linear relationships with speed but instead exhibited nonlinear relationships that peaked at a range of locomotor speeds. Bulk calcium recordings of identified direct and indirect pathway neurons revealed similar speed tuning profiles, indicating that the heterogeneity in response profiles was not due to this genetic distinction. We conclude that continuous encoding of speed is a central component of movement encoding in the striatum.SIGNIFICANCE STATEMENT The striatum is a structure that is linked to volitional movements and is a primary site of pathology in movement disorders. It remains unclear how striatal neurons encode motor parameters and use them to facilitate movement. Here, we evaluated two models for this: a "discrete encoding model" in which striatal neurons facilitate movements with brief burst of activity near the start and end of movements, and a "continuous encoding model," in which striatal neurons encode the sensory or motor state of the animal with continuous changes in firing. We found evidence primarily in support of the continuous encoding model. This may have implications for understanding the striatal control of movement, as well as informing therapeutic approaches for treating movement disorders.

Cortical and thalamic inputs exert cell type-specific feedforward inhibition on striatal GABAergic interneurons

The classical view of striatal GABAergic interneuron function has been that they operate as largely independent, parallel, feedforward inhibitory elements providing inhibitory inputs to spiny projection neurons (SPNs). Much recent evidence has shown that the extrinsic innervation of striatal interneurons is not indiscriminate but rather very specific, and that striatal interneurons are themselves interconnected in a cell type-specific manner. This suggests that the ultimate effect of extrinsic inputs on striatal neuronal activity depends critically on synaptic interactions within interneuronal circuitry. Here, we compared the cortical and thalamic input to two recently described subtypes of striatal GABAergic interneurons, tyrosine hydroxylase-expressing interneurons (THINs), and spontaneously active bursty interneurons (SABIs) using transgenic TH-Cre and Htr3a-Cre mice of both sexes. Our results show that both THINs and SABIs receive strong excitatory input from the motor cortex and the thalamic parafascicular nucleus. Cortical optogenetic stimulation also evokes disynaptic inhibitory GABAergic responses in THINs but not in SABIs. In contrast, optogenetic stimulation of the parafascicular nucleus induces disynaptic inhibitory responses in both interneuron populations. However, the short-term plasticity of these disynaptic inhibitory responses is different suggesting the involvement of different intrastriatal microcircuits. Altogether, our results point to highly specific interneuronal circuits that are selectively engaged by different excitatory inputs.

Distinct recruitment of dorsomedial and dorsolateral striatum erodes with extended training

Hypotheses of striatal orchestration of behavior ascribe distinct functions to striatal subregions, with the dorsolateral striatum (DLS) especially implicated in habitual and skilled performance. Thus neural activity patterns recorded from the DLS, but not the dorsomedial striatum (DMS), should be correlated with habitual and automatized performance. Here, we recorded DMS and DLS neural activity in rats during training in a task promoting habitual lever pressing. Despite improving performance across sessions, clear changes in corresponding neural activity patterns were not evident in DMS or DLS during early training. Although DMS and DLS activity patterns were distinct during early training, their activity was similar following extended training. Finally, performance after extended training was not associated with DMS disengagement, as would be predicted from prior work. These results suggest that behavioral sequences may continue to engage both striatal regions long after initial acquisition, when skilled performance is consolidated.

Contributions of the basal ganglia to action sequence learning and performance

Animals engage in intricately woven and choreographed action sequences that are constructed from trial-and-error learning. The mechanisms by which the brain links together individual actions which are later recalled as fluid chains of behavior are not fully understood, but there is broad consensus that the basal ganglia play a crucial role in this process. This paper presents a comprehensive review of the role of the basal ganglia in action sequencing, with a focus on whether the computational framework of reinforcement learning can capture key behavioral features of sequencing and the neural mechanisms that underlie them. While a simple neurocomputational model of reinforcement learning can capture key features of action sequence learning, this model is not sufficient to capture goal-directed control of sequences or their hierarchical representation. The hierarchical structure of action sequences, in particular, poses a challenge for building better models of action sequencing, and it is in this regard that further investigations into basal ganglia information processing may be informative.

Sensory representations in the striatum provide a temporal reference for learning and executing motor habits

Previous studies indicate that the dorsolateral striatum (DLS) integrates sensorimotor information from cortical and thalamic regions to learn and execute motor habits. However, the exact contribution of sensory representations to this process is still unknown. Here we explore the role of the forelimb somatosensory flow in the DLS during the learning and execution of motor habits. First, we compare rhythmic somesthetic representations in the DLS and primary somatosensory cortex in anesthetized rats, and find that sequential and temporal stimuli contents are more strongly represented in the DLS. Then, using a behavioral protocol in which rats developed a stereotyped motor sequence, functional disconnection experiments, and pharmacologic and optogenetic manipulations in apprentice and expert animals, we reveal that somatosensory thalamic- and cortical-striatal pathways are indispensable for the temporal component of execution. Our results indicate that the somatosensory flow in the DLS provides the temporal reference for the development and execution of motor habits.

The authors combine anatomical mapping, electrophysiological recordings, lesions, and pharmacological and optogenetic manipulations in rats to examine the role of forelimb somatosensory flow in the dorsolateral striatum in the learning and execution of motor habits.

Loss of striatal tyrosine-hydroxylase interneurons impairs instrumental goal-directed behavior

The striatum mediates a broad range of cognitive and motor functions. Within the striatum, recently discovered tyrosine hydroxylase expressing interneurons (THINs) provide a source of intrastriatal synaptic connectivity that is critical for regulating striatal activity, yet the role of THIN's in behavior remains unknown. Given the important role of the striatum in reward-based behaviors, we investigated whether loss of striatal THINs would impact instrumental behavior in mice. We selectively ablated striatal THINs in TH-Cre mice using chemogenetic techniques, and then tested THIN-lesioned or control mice on three reward-based striatal-dependent instrumental tests: (a) progressive ratio test; (b) choice test following selective-satiety induced outcome devaluation; (c) outcome reinstatement test. Both striatal-THIN-lesioned and control mice acquired an instrumental response for flavored food pellets, and their behavior did not differ in the progressive ratio test, suggesting intact effort to obtain rewards. However, striatal THIN lesions markedly impaired choice performance following selective-satiety induced outcome devaluation. Unlike control mice, THIN-lesioned mice did not adjust their choice of actions following a change in outcome value. In the outcome reinstatement test THIN-lesioned and control mice showed response invigoration by outcome presentation, suggesting the incentive properties of outcomes were not disrupted by THIN lesions. Overall, we found that striatal THIN lesions selectively impaired goal-directed behavior, while preserving motoric and appetitive behaviors. These findings are the first to describe a function of striatal THINs in reward-based behavior, and further illustrate the important role for intrastriatal interneuronal connectivity in behavioral functions ascribed to the striatum more generally.

Dorsal Striatal Circuits for Habits, Compulsions and Addictions

Here, we review the neural circuit bases of habits, compulsions, and addictions, behaviors which are all characterized by relatively automatic action performance. We discuss relevant studies, primarily from the rodent literature, and describe how major headway has been made in identifying the brain regions and neural cell types whose activity is modulated during the acquisition and performance of these automated behaviors. The dorsal striatum and cortical inputs to this structure have emerged as key players in the wider basal ganglia circuitry encoding behavioral automaticity, and changes in the activity of different neuronal cell-types in these brain regions have been shown to co-occur with the formation of automatic behaviors. We highlight how disordered functioning of these neural circuits can result in neuropsychiatric disorders, such as obsessive-compulsive disorder (OCD) and drug addiction. Finally, we discuss how the next phase of research in the field may benefit from integration of approaches for access to cells based on their genetic makeup, activity, connectivity and precise anatomical location.