Differential entrainment and learning-related dynamics of spike and local field potential activity in the sensorimotor and associative striatum

Multimodal convergence in the pedunculopontine tegmental nucleus: Motor, sensory and theta-frequency inputs influence activity of single neurons

The pedunculopontine tegmental nucleus of the brainstem (PPTg) has extensive interconnections and neuronal-behavioural correlates. It is implicated in movement control and sensorimotor integration. We investigated whether single neuron activity in freely moving rats is correlated with components of skilled forelimb movement, and whether individual neurons respond to both motor and sensory events. We found that individual PPTg neurons showed changes in firing rate at different times during the reach. This type of temporally specific modulation is like activity seen elsewhere in voluntary movement control circuits, such as the motor cortex, and suggests that PPTg neural activity is related to different specific events occurring during the reach. In particular, many neuronal modulations were time-locked to the end of the extension phase of the reach, when fine distal movements related to food grasping occur, indicating strong engagement of PPTg in this phase of skilled individual forelimb movements. In addition, some neurons showed brief periods of apparent oscillatory firing in the theta range at specific phases of the reach-to-grasp movement. When movement-related neurons were tested with tone stimuli, many also responded to this auditory input, allowing for sensorimotor integration at the cellular level. Together, these data extend the concept of the PPTg as an integrative structure in generation of complex movements, by showing that this function extends to the highly coordinated control of the forelimb during skilled reach to grasp movement, and that sensory and motor-related information converges on single neurons, allowing for direct integration at the cellular level.

Devaluation of response-produced safety signals reveals circuits for goal-directed versus habitual avoidance in dorsal striatum

Active avoidance responses (ARs) are instrumental behaviors that prevent harm. Adaptive ARs may contribute to active coping, whereas maladaptive avoidance habits are implicated in anxiety and obsessive-compulsive disorders. The AR learning mechanism has remained elusive, as successful avoidance trials produce no obvious reinforcer. We used a novel outcome-devaluation procedure in rats to show that ARs are positively reinforced by response-produced feedback (FB) cues that develop into safety signals during training. Males were sensitive to FB-devaluation after moderate training, but not overtraining, consistent with a transition from goal-directed to habitual avoidance. Using chemogenetics and FB-devaluation, we also show that goal-directed vs. habitual ARs depend on dorsomedial vs. dorsolateral striatum, suggesting a significant overlap between the mechanisms of avoidance and rewarded instrumental behavior. Females were insensitive to FB-devaluation due to a remarkable context-dependence of counterconditioning. However, degrading the AR-FB contingency suggests that both sexes rely on safety signals to perform goal-directed ARs.

Goal-directed and habitual control: from circuits and functions to exercise-induced neuroplasticity targets for the treatment of Parkinson's disease

Parkinson's disease (PD) is a neurodegenerative disease characterized by motor and cognitive impairments. The progressive depletion of dopamine (DA) is the pathological basis of dysfunctional goal-directed and habitual control circuits in the basal ganglia. Exercise-induced neuroplasticity could delay disease progression by improving motor and cognitive performance in patients with PD. This paper reviews the research progress on the motor-cognitive basal ganglia circuit and summarizes the current hypotheses for explaining exercise intervention on rehabilitation in PD. Studies on exercise mediated mechanisms will contribute to the understanding of networks that regulate goal-directed and habitual behaviors and deficits in PD, facilitating the development of strategies for treatment of PD.

Dopamine Release Plateau and Outcome Signals in Dorsal Striatum Contrast with Classic Reinforcement Learning Formulations

We recorded dopamine release signals in medial and lateral sectors of the striatum as mice learned consecutive visual cue-outcome conditioning tasks including cue association, cue discrimination, reversal, and probabilistic discrimination task versions. Dopamine release responses in medial and lateral sites exhibited learning-related changes within and across phases of acquisition. These were different for the medial and lateral sites. In neither sector could these be accounted for by classic reinforcement learning as applied to dopamine-containing neuron activity. Cue responses ranged from initial sharp peaks to modulated plateau responses. In the medial sector, outcome (reward) responses during cue conditioning were minimal or, initially, negative. By contrast, in lateral sites, strong, transient dopamine release responses occurred at both cue and outcome. Prolonged, plateau release responses to cues emerged in both regions when discriminative behavioral responses became required. In most sites, we found no evidence for a transition from outcome to cue signaling, a hallmark of temporal difference reinforcement learning as applied to midbrain dopamine activity. These findings delineate reshaping of dopamine release activity during learning and suggest that current views of reward prediction error encoding need review to accommodate distinct learning-related spatial and temporal patterns of striatal dopamine release in the dorsal striatum.

Rhythmic oscillations in the midbrain dopaminergic nuclei in mice

Introduction

Dopamine release in the forebrain by midbrain ventral tegmental nucleus (VTA) and substantia nigra pars compacta (SNc) neurons is implicated in reward processing, goal-directed learning, and decision-making. Rhythmic oscillations of neural excitability underlie coordination of network processing, and have been reported in these dopaminergic nuclei at several frequency bands. This paper provides a comparative characterization of several frequencies of oscillations of local field potential and single unit activity, highlighting some behavioral correlates.

Methods

We recorded from optogenetically identified dopaminergic sites in four mice training in operant olfactory and visual discrimination tasks.

Results

Rayleigh and Pairwise Phase Consistency (PPC) analyses revealed some VTA/SNc neurons phase-locked to each frequency range, with fast spiking interneurons (FSIs) prevalent at 1-2.5 Hz (slow) and 4 Hz bands, and dopaminergic neurons predominant in the theta band. More FSIs than dopaminergic neurons were phase-locked in the slow and 4 Hz bands during many task events. The highest incidence of phase-locking in neurons was in the slow and 4 Hz bands, and occurred during the delay between the operant choice and trial outcome (reward or punishment) signals.

Discussion

These data provide a basis for further examination of rhythmic coordination of activity of dopaminergic nuclei with other brain structures, and its impact for adaptive behavior.

Perineuronal Nets in the Dorsomedial Striatum Contribute to Behavioral Dysfunction in Mouse Models of Excessive Repetitive Behavior

Background

Excessive repetitive behavior is a debilitating symptom of several neuropsychiatric disorders. Parvalbumin-positive inhibitory interneurons in the dorsal striatum have been linked to repetitive behavior, and a sizable portion of these cells are surrounded by perineuronal nets (PNNs), specialized extracellular matrix structures. Although PNNs have been associated with plasticity and neuropsychiatric disease, no previous studies have investigated their involvement in excessive repetitive behavior.

Methods

We used histochemistry and confocal imaging to investigate PNNs surrounding parvalbumin-positive cells in the dorsal striatum of 4 mouse models of excessive repetitive behavior (BTBR, Cntnap2, Shank3, prenatal valproate treatment). We then investigated one of these models, the BTBR mouse, in detail, with DiI labeling, in vivo and in vitro recordings, and behavioral analyses. We next degraded PNNs in the dorsomedial striatum (DMS) using the enzyme chondroitinase ABC and assessed dendritic spine density, electrophysiology, and repetitive behavior.

Results

We found a greater percentage of parvalbumin-positive interneurons with PNNs in the DMS of all 4 mouse models of excessive repetitive behavior compared with control mice. In BTBR mice, we found fewer dendritic spines on medium spiny neurons (targets of parvalbumin-positive interneurons) and differences in neuronal oscillations as well as inhibitory postsynaptic potentials compared with control mice. Reduction of DMS PNNs in BTBR mice altered dendritic spine density and inhibitory responses and normalized repetitive behavior.

Conclusions

These findings suggest that cellular abnormalities in the DMS are associated with maladaptive repetitive behaviors and that manipulating PNNs can restore normal levels of repetitive behavior while altering DMS dendritic spines and inhibitory signaling.

Beyond language: The unspoken sensory-motor representation of the tongue in non-primates, non-human and human primates

The English idiom "on the tip of my tongue" commonly acknowledges that something is known, but it cannot be immediately brought to mind. This phrase accurately describes sensorimotor functions of the tongue, which are fundamental for many tongue-related behaviors (e.g., speech), but often neglected by scientific research. Here, we review a wide range of studies conducted on non-primates, non-human and human primates with the aim of providing a comprehensive description of the cortical representation of the tongue's somatosensory inputs and motor outputs across different phylogenetic domains. First, we summarize how the properties of passive non-noxious mechanical stimuli are encoded in the putative somatosensory tongue area, which has a conserved location in the ventral portion of the somatosensory cortex across mammals. Second, we review how complex self-generated actions involving the tongue are represented in more anterior regions of the putative somato-motor tongue area. Finally, we describe multisensory response properties of the primate and non-primate tongue area by also defining how the cytoarchitecture of this area is affected by experience and deafferentation.

Transition from predictable to variable motor cortex and striatal ensemble patterning during behavioral exploration

Animals can capitalize on invariance in the environment by learning and automating highly consistent actions; however, they must also remain flexible and adapt to environmental changes. It remains unclear how primary motor cortex (M1) can drive precise movements, yet also support behavioral exploration when faced with consistent errors. Using a reach-to-grasp task in rats, along with simultaneous electrophysiological monitoring in M1 and dorsolateral striatum (DLS), we find that behavioral exploration to overcome consistent task errors is closely associated with tandem increases in M1 and DLS neural variability; subsequently, consistent ensemble patterning returns with convergence to a new successful strategy. We also show that compared to reliably patterned intracranial microstimulation in M1, variable stimulation patterns result in significantly greater movement variability. Our results thus indicate that motor and striatal areas can flexibly transition between two modes, reliable neural pattern generation for automatic and precise movements versus variable neural patterning for behavioral exploration.

It is not fully understood how behavioral flexibility is established in the context of automatic performance of a complex motor skill. Here the authors show that corticostriatal activity can flexibly transition between two modes during a reach to-grasp task in rats: reliable neural pattern generation for precise, automatic movements versus variable neural patterning for behavioral exploration.

Striatum expresses region-specific plasticity consistent with distinct memory abilities

The striatum mediates two learning modalities: goal-directed behavior in dorsomedial (DMS) and habits in dorsolateral (DLS) striata. The synaptic bases of these learnings are still elusive. Indeed, while ample research has described DLS plasticity, little remains known about DMS plasticity and its involvement in procedural learning. Here, we find symmetric and asymmetric anti-Hebbian spike-timing-dependent plasticity (STDP) in DMS and DLS, respectively, with opposite plasticity dominance upon increasing corticostriatal activity. During motor-skill learning, plasticity is engaged in DMS and striatonigral DLS neurons only during early learning stages, whereas striatopallidal DLS neurons are mobilized only during late phases. With a mathematical modeling approach, we find that symmetric anti-Hebbian STDP favors memory flexibility, while asymmetric anti-Hebbian STDP favors memory maintenance, consistent with memory processes at play in procedural learning.

Distributed cell assemblies spanning prefrontal cortex and striatum

Highly synchronous neuronal assembly activity is deemed essential for cognitive brain function. In theory, such synchrony could coordinate multiple brain areas performing complementary processes. However, cell assemblies have been observed only in single structures, typically cortical areas, and little is known about their synchrony with downstream subcortical structures, such as the striatum. Here, we demonstrate distributed cell assemblies activated at high synchrony (∼10 ms) spanning prefrontal cortex and striatum. In addition to including neurons at different brain hierarchical levels, surprisingly, they synchronized functionally distinct limbic and associative sub-regions. These assembly activations occurred when members shifted their firing phase relative to ongoing 4 Hz and theta rhythms, in association with high gamma oscillations. This suggests that these rhythms could mediate the emergence of cross-structural assemblies. To test for the role of assemblies in behavior, we trained the rats to perform a task requiring cognitive flexibility, alternating between two different rules in a T-maze. Overall, assembly activations were correlated with task-relevant parameters, including impending choice, reward, rule, or rule order. Moreover, these behavioral correlates were more robustly expressed by assemblies than by their individual member neurons. Finally, to verify whether assemblies can be endogenously generated, we found that they were indeed spontaneously reactivated during sleep and quiet immobility. Thus, cell assemblies are a more general coding mechanism than previously envisioned, linking distributed neocortical and subcortical areas at high synchrony.

Dorsolateral Striatal Task-initiation Bursts Represent Past Experiences More than Future Action Plans

The dorsolateral striatum (DLS) is involved in learning and executing procedural actions. Cell ensembles in the DLS, but not the dorsomedial striatum (DMS), exhibit a burst of firing at the start of a well-learned action sequence ("task-bracketing"). However, it is currently unclear what information is contained in these bursts. Some theories suggest that these bursts should represent the procedural action sequence itself (that they should be about future action chains), whereas others suggest that they should contain representations of the current state of the world, taking into account primarily past information. In addition, the DLS local field potential shows transient bursts of power in the 50 Hz range (γ50) around the time a learned action sequence is initiated. However, it is currently unknown how bursts of activity in DLS cell ensembles and bursts of γ50 power in the DLS local field potential are related to each other. We found that DLS bursts at lap initiation in rats represented recently experienced reward locations more than future procedural actions, indicating that task-initiation DLS bursts contain primarily retrospective, rather than prospective, information to guide procedural actions. Furthermore, representations of past reward locations increased during periods of increased γ50 power in the DLS. There was no evidence of task-initiation bursts, increased γ50 power, or retrospective reward location information in the neighboring dorsomedial striatum. These data support a role for the DLS in model-free theories of procedural decision-making over planned action-chain theories, suggesting that procedural actions derive from representations of the current and recent past.SIGNIFICANCE STATEMENT While it is well-established that the dorsolateral striatum (DLS) plays a critical role in procedural decision-making, open questions remain about the kinds of representations contained in DLS ensemble activity that guide procedural actions. We found that DLS, but not DMS, cell ensembles contained nonlocal representations of past reward locations that appear moments before task-initiation DLS bursts. These retrospective representations were temporally linked to a rise in γ50 power that also preceded the characteristic DLS burst at task-initiation. These results support models of procedural decision-making based on associations between available actions and the current state of the world over models based on planning over action-chains.

Coupling between motor cortex and striatum increases during sleep over long-term skill learning

The strength of cortical connectivity to the striatum influences the balance between behavioral variability and stability. Learning to consistently produce a skilled action requires plasticity in corticostriatal connectivity associated with repeated training of the action. However, it remains unknown whether such corticostriatal plasticity occurs during training itself or 'offline' during time away from training, such as sleep. Here, we monitor the corticostriatal network throughout long-term skill learning in rats and find that non-rapid-eye-movement (NREM) sleep is a relevant period for corticostriatal plasticity. We first show that the offline activation of striatal NMDA receptors is required for skill learning. We then show that corticostriatal functional connectivity increases offline, coupled to emerging consistent skilled movements, and coupled cross-area neural dynamics. We then identify NREM sleep spindles as uniquely poised to mediate corticostriatal plasticity, through interactions with slow oscillations. Our results provide evidence that sleep shapes cross-area coupling required for skill learning.

Interpreting the role of the striatum during multiple phases of motor learning

The synaptic pathways in the striatum are central to basal ganglia functions including motor control, learning and organization, action selection, acquisition of motor skills, cognitive function, and emotion. Here, we review the role of the striatum and its connections in motor learning and performance. The development of new techniques to record neuronal activity and animal models of motor disorders using neurotoxin, pharmacological, and genetic manipulations are revealing pathways that underlie motor performance and motor learning, as well as how they are altered by pathophysiological mechanisms. We discuss approaches that can be used to analyze complex motor skills, particularly in rodents, and identify specific questions central to understanding how striatal circuits mediate motor learning.

Chronic nicotine impairs sparse motor learning via striatal fast-spiking parvalbumin interneurons

Nicotine can diversely affect neural activity and motor learning in animals. However, the impact of chronic nicotine on striatal activity in vivo and motor learning at long-term sparse timescale remains unknown. Here, we demonstrate that chronic nicotine persistently suppresses the activity of striatal fast-spiking parvalbumin interneurons, which mediate nicotine-induced deficit in sparse motor learning. Six weeks of longitudinal in vivo single-unit recording revealed that mice show reduced activity of fast-spiking interneurons in the dorsal striatum during chronic nicotine exposure and withdrawal. The reduced firing of fast-spiking interneurons was accompanied by spike broadening, diminished striatal delta oscillation power, and reduced sample entropy in local field potential. In addition, chronic nicotine withdrawal impaired motor learning with a weekly sparse training regimen but did not affect general locomotion and anxiety-like behavior. Lastly, the excitatory DREADD hM3Dq-mediated activation of striatal fast-spiking parvalbumin interneurons reversed the chronic nicotine withdrawal-induced deficit in sparse motor learning. Taken together, we identified that chronic nicotine withdrawal impairs sparse motor learning via disruption of activity in striatal fast-spiking parvalbumin interneurons. These findings suggest that sparse motor learning paradigm can reveal the subtle effect of nicotine withdrawal on motor function and that striatal fast-spiking parvalbumin interneurons are a neural substrate of nicotine's effect on motor learning.

Neuro-Immune Cross-Talk in the Striatum: From Basal Ganglia Physiology to Circuit Dysfunction

The basal ganglia network is represented by an interconnected group of subcortical nuclei traditionally thought to play a crucial role in motor learning and movement execution. During the last decades, knowledge about basal ganglia physiology significantly evolved and this network is now considered as a key regulator of important cognitive and emotional processes. Accordingly, the disruption of basal ganglia network dynamics represents a crucial pathogenic factor in many neurological and psychiatric disorders. The striatum is the input station of the circuit. Thanks to the synaptic properties of striatal medium spiny neurons (MSNs) and their ability to express synaptic plasticity, the striatum exerts a fundamental integrative and filtering role in the basal ganglia network, influencing the functional output of the whole circuit. Although it is currently established that the immune system is able to regulate neuronal transmission and plasticity in specific cortical areas, the role played by immune molecules and immune/glial cells in the modulation of intra-striatal connections and basal ganglia activity still needs to be clarified. In this manuscript, we review the available evidence of immune-based regulation of synaptic activity in the striatum, also discussing how an abnormal immune activation in this region could be involved in the pathogenesis of inflammatory and degenerative central nervous system (CNS) diseases.

Er81 Transcription Factor Fine-Tunes Striatal Cholinergic Interneuron Activity and Drives Habit Formation

The molecular mechanisms tuning cholinergic interneuron (CIN) activity, although crucial for striatal function and behavior, remain largely unexplored. Previous studies report that the Etv1/Er81 transcription factor is vital for regulating neuronal maturation and activity. While Er81 is known to be expressed in the striatum during development, its specific role in defining CIN properties and the resulting consequences on striatal function is unknown. We report here that Er81 is expressed in CINs and its specific ablation leads to prominent changes in their molecular, morphologic, and electrophysiological features. In particular, the lack of Er81 amplifies intrinsic delayed-rectifier and hyperpolarization-activated currents, which subsequently alters the tonic and phasic activity of CINs. We further reveal that Er81 expression is required for normal CIN pause and time-locked responses to sensorimotor inputs in awake mice. Overall, this study uncovers a new cell type-specific control of CIN function in the striatum which drives habit formation in adult male mice.SIGNIFICANCE STATEMENT Although previous studies have shown that cholinergic interneurons drive striatal activity and habit formation, the underlying molecular mechanisms controlling their function are unknown. Here we reveal that key cholinergic interneuron physiological properties are controlled by Er81, a transcription factor regulating neuronal activity and development in a cell-specific manner. Moreover, our findings uncover a link between the Er81-dependent molecular control of cholinergic interneuron function and habit formation in mice. These insights will contribute to the future enhancement of our understanding of disorders that involve behavioral inflexibility, such as autism and addiction.

A biophysical model of striatal microcircuits suggests gamma and beta oscillations interleaved at delta/theta frequencies mediate periodicity in motor control

Striatal oscillatory activity is associated with movement, reward, and decision-making, and observed in several interacting frequency bands. Local field potential recordings in rodent striatum show dopamine- and reward-dependent transitions between two states: a "spontaneous" state involving β (∼15-30 Hz) and low γ (∼40-60 Hz), and a state involving θ (∼4-8 Hz) and high γ (∼60-100 Hz) in response to dopaminergic agonism and reward. The mechanisms underlying these rhythmic dynamics, their interactions, and their functional consequences are not well understood. In this paper, we propose a biophysical model of striatal microcircuits that comprehensively describes the generation and interaction of these rhythms, as well as their modulation by dopamine. Building on previous modeling and experimental work suggesting that striatal projection neurons (SPNs) are capable of generating β oscillations, we show that networks of striatal fast-spiking interneurons (FSIs) are capable of generating δ/θ (ie, 2 to 6 Hz) and γ rhythms. Under simulated low dopaminergic tone our model FSI network produces low γ band oscillations, while under high dopaminergic tone the FSI network produces high γ band activity nested within a δ/θ oscillation. SPN networks produce β rhythms in both conditions, but under high dopaminergic tone, this β oscillation is interrupted by δ/θ-periodic bursts of γ-frequency FSI inhibition. Thus, in the high dopamine state, packets of FSI γ and SPN β alternate at a δ/θ timescale. In addition to a mechanistic explanation for previously observed rhythmic interactions and transitions, our model suggests a hypothesis as to how the relationship between dopamine and rhythmicity impacts motor function. We hypothesize that high dopamine-induced periodic FSI γ-rhythmic inhibition enables switching between β-rhythmic SPN cell assemblies representing the currently active motor program, and thus that dopamine facilitates movement in part by allowing for rapid, periodic shifts in motor program execution.

A Brain to Spine Interface for Transferring Artificial Sensory Information

Lack of sensory feedback is a major obstacle in the rapid absorption of prosthetic devices by the brain. While electrical stimulation of cortical and subcortical structures provides unique means to deliver sensory information to higher brain structures, these approaches require highly invasive surgery and are dependent on accurate targeting of brain structures. Here, we propose a semi-invasive method, Dorsal Column Stimulation (DCS) as a tool for transferring sensory information to the brain. Using this new approach, we show that rats can learn to discriminate artificial sensations generated by DCS and that DCS-induced learning results in corticostriatal plasticity. We also demonstrate a proof of concept brain-to-spine interface (BTSI), whereby tactile and artificial sensory information are decoded from the brain of an “encoder” rat, transformed into DCS pulses, and delivered to the spinal cord of a second “decoder” rat while the latter performs an analog-to-digital conversion during a sensory discrimination task. These results suggest that DCS can be used as an effective sensory channel to transmit prosthetic information to the brain or between brains, and could be developed as a novel platform for delivering tactile and proprioceptive feedback in clinical applications of brain-machine interfaces.

Parkin deficiency perturbs striatal circuit dynamics

Loss-of-function mutations in the parkin-encoding PARK2 gene are a frequent cause of young-onset, autosomal recessive Parkinson's disease (PD). Parkin knockout mice have no nigro-striatal neuronal loss but exhibit abnormalities of striatal dopamine transmission and cortico-striatal synaptic function. How these predegenerative changes observed in vitro affect neural dynamics at the intact circuit level, however, remains hitherto elusive. Here, we recorded from motor cortex, striatum and globus pallidus (GP) of anesthetized parkin-deficient mice to assess cortex-basal ganglia circuit dynamics and to dissect cell type-specific functional connectivity in the presymptomatic phase of genetic PD. While ongoing activity of presumed striatal spiny projection neurons and their downstream counterparts in the GP was not different from controls, parkin deficiency had a differential impact on striatal interneurons: In parkin-mutant mice, tonically active neurons displayed elevated activity levels. Baseline firing rates of transgenic striatal fast spiking interneurons (FSI), on the contrary, were reduced and the correlational structure of the FSI microcircuitry was disrupted. The entire transgenic striatal microcircuit showed enhanced and phase-shifted phase coupling to slow (1-3 Hz) cortical population oscillations. Unexpectedly, local field potentials recorded from striatum and GP of parkin-mutant mice robustly displayed amplified beta oscillations (~22 Hz), phase-coupled to cortex. Parkin deficiency selectively increased spike-field coupling of FSIs to beta oscillations. Our findings suggest that loss of parkin function leads to amplifications of synchronized cortico-striatal oscillations and an intrastriatal reconfiguration of interneuronal circuits. This presymptomatic disarrangement of dynamic functional connectivity may precede nigro-striatal neurodegeneration and predispose to imbalance of striatal outflow accompanying symptomatic PD.

Sex differences in the ability of corticostriatal oscillations to predict rodent alcohol consumption

Background

Although male and female rats differ in their patterns of alcohol use, little is known regarding the neural circuit activity that underlies these differences in behavior. The current study used a machine learning approach to characterize sex differences in local field potential (LFP) oscillations that may relate to sex differences in alcohol-drinking behavior.

Methods

LFP oscillations were recorded from the nucleus accumbens shell and the rodent medial prefrontal cortex of adult male and female Sprague-Dawley rats. Recordings occurred before rats were exposed to alcohol (n = 10/sex × 2 recordings/rat) and during sessions of limited access to alcohol (n = 5/sex × 5 recordings/rat). Oscillations were also recorded from each female rat in each phase of estrous prior to alcohol exposure. Using machine learning, we built predictive models with oscillation data to classify rats based on: (1) biological sex, (2) phase of estrous, and (3) alcohol intake levels. We evaluated model performance from real data by comparing it to the performance of models built and tested on permutations of the data.

Results

Our data demonstrate that corticostriatal oscillations were able to predict alcohol intake levels in males (p < 0.01), but not in females (p = 0.45). The accuracies of models predicting biological sex and phase of estrous were related to fluctuations observed in alcohol drinking levels; females in diestrus drank more alcohol than males (p = 0.052), and the male vs. diestrus female model had the highest accuracy (71.01%) compared to chance estimates. Conversely, females in estrus drank very similar amounts of alcohol to males (p = 0.702), and the male vs. estrus female model had the lowest accuracy (56.14%) compared to chance estimates.

Conclusions

The current data demonstrate that oscillations recorded from corticostriatal circuits contain significant information regarding alcohol drinking in males, but not alcohol drinking in females. Future work will focus on identifying where to record LFP oscillations in order to predict alcohol drinking in females, which may help elucidate sex-specific neural targets for future therapeutic development.

Dorsal Striatal Circuits for Habits, Compulsions and Addictions

Here, we review the neural circuit bases of habits, compulsions, and addictions, behaviors which are all characterized by relatively automatic action performance. We discuss relevant studies, primarily from the rodent literature, and describe how major headway has been made in identifying the brain regions and neural cell types whose activity is modulated during the acquisition and performance of these automated behaviors. The dorsal striatum and cortical inputs to this structure have emerged as key players in the wider basal ganglia circuitry encoding behavioral automaticity, and changes in the activity of different neuronal cell-types in these brain regions have been shown to co-occur with the formation of automatic behaviors. We highlight how disordered functioning of these neural circuits can result in neuropsychiatric disorders, such as obsessive-compulsive disorder (OCD) and drug addiction. Finally, we discuss how the next phase of research in the field may benefit from integration of approaches for access to cells based on their genetic makeup, activity, connectivity and precise anatomical location.

Impaired cortico-striatal excitatory transmission triggers epilepsy

STXBP1 and SCN2A gene mutations are observed in patients with epilepsies, although the circuit basis remains elusive. Here, we show that mice with haplodeficiency for these genes exhibit absence seizures with spike-and-wave discharges (SWDs) initiated by reduced cortical excitatory transmission into the striatum. Mice deficient for Stxbp1 or Scn2a in cortico-striatal but not cortico-thalamic neurons reproduce SWDs. In Stxbp1 haplodeficient mice, there is a reduction in excitatory transmission from the neocortex to striatal fast-spiking interneurons (FSIs). FSI activity transiently decreases at SWD onset, and pharmacological potentiation of AMPA receptors in the striatum but not in the thalamus suppresses SWDs. Furthermore, in wild-type mice, pharmacological inhibition of cortico-striatal FSI excitatory transmission triggers absence and convulsive seizures in a dose-dependent manner. These findings suggest that impaired cortico-striatal excitatory transmission is a plausible mechanism that triggers epilepsy in Stxbp1 and Scn2a haplodeficient mice.

Spike and wave discharge (SWD) activity is seen during absence seizures and is thought to be thalamocortical in origin. Here, the authors show that SWDs are initiated through the impaired corticostriatal excitatory transmissions onto striatal fast spiking interneurons.

Bridging the gap between striatal plasticity and learning

The striatum, the main input nucleus of the basal ganglia, controls goal-directed behavior and procedural learning. Striatal projection neurons integrate glutamatergic inputs from cortex and thalamus together with neuromodulatory systems, and are subjected to plasticity. Striatal projection neurons exhibit bidirectional plasticity (LTP and LTD) when exposed to Hebbian paradigms. Importantly, correlative and even causal links between procedural learning and striatal plasticity have recently been shown. This short review summarizes the current view on striatal plasticity (with a focus on spike-timing-dependent plasticity), recent studies aiming at bridging in vivo skill acquisition and striatal plasticity, the temporal credit-assignment problem, and the gaps that remain to be filled.

Primary sensorimotor cortex exhibits complex dependencies of spike-field coherence on neuronal firing rates, field power, and behavior

Spike-field coherence (SFC) is widely used to assess cortico-cortical interactions during sensorimotor behavioral tasks by measuring the consistency of the relative phases between the spike train of a neuron and the concurrent local field potentials (LFPs). Interpretations of SFC as a measure of functional connectivity are complicated by theoretical work suggesting that estimates of SFC depend on overall neuronal activity. We evaluated the dependence of SFC on neuronal firing rates, LFP power, and behavior in the primary motor (MIo) and primary somatosensory (SIo) areas of the orofacial sensorimotor cortex of monkeys ( Macaca mulatta) during performance of a tongue-protrusion task. Although we occasionally observed monotonically increasing linear relationships between coherence and firing rate, we most often found highly complex, nonmonotonic relationships in both SIo and MIo and sometimes even found that coherence decreased with increasing firing rate. The lack of linear relationships was also true for both LFP power and tongue-protrusive force. Moreover, the ratio between maximal firing rate and the firing rate at peak coherence deviated significantly from unity, indicating that MIo and SIo neurons achieved maximal SFC at a submaximal level of spiking. Overall, these results point to complex relationships of SFC to firing rates, LFP power, and behavior during sensorimotor cortico-cortical interactions: coherence is a measure of functional connectivity whose magnitude is not a mere monotonic reflection of changes in firing rate, LFP power, or the relevantly controlled behavioral parameter. NEW & NOTEWORTHY The concern that estimates of spike-field coherence depend on the firing rates of single neurons has influenced analytical methods employed by experimental studies investigating the functional interactions between cortical areas. Our study shows that the overwhelming majority of the estimated spike-field coherence exhibited complex relations with firing rates of neurons in the orofacial sensorimotor cortex. The lack of monotonic relations was also evident after testing the influence of local field potential power and force on spike-field coherence.

Coding of self-motion-induced and self-independent visual motion in the rat dorsomedial striatum

Evolutionary development of vision has provided us with the capacity to detect moving objects. Concordant shifts of visual features suggest movements of the observer, whereas discordant changes are more likely to be indicating independently moving objects, such as predators or prey. Such distinction helps us to focus attention, adapt our behavior, and adjust our motor patterns to meet behavioral challenges. However, the neural basis of distinguishing self-induced and self-independent visual motions is not clarified in unrestrained animals yet. In this study, we investigated the presence and origin of motion-related visual information in the striatum of rats, a hub of action selection and procedural memory. We found that while almost half of the neurons in the dorsomedial striatum are sensitive to visual motion congruent with locomotion (and that many of them also code for spatial location), only a small subset of them are composed of fast-firing interneurons that could also perceive self-independent visual stimuli. These latter cells receive their visual input at least partially from the secondary visual cortex (V2). This differential visual sensitivity may be an important support in adjusting behavior to salient environmental events. It emphasizes the importance of investigating visual motion perception in unrestrained animals.

Inversely Active Striatal Projection Neurons and Interneurons Selectively Delimit Useful Behavioral Sequences

Understanding neural representations of behavioral routines is critical for understanding complex behavior in health and disease. We demonstrate here that accentuated activity of striatal projection neurons (SPNs) at the beginning and end of such behavioral repertoires is a supraordinate representation specifically marking previously rewarded behavioral sequences independent of the individual movements making up the behavior. We recorded spike activity in the striatum and primary motor cortex as individual rats learned specific rewarded lever-press sequences, each one unique to a given rat. Motor cortical neurons mainly responded in relation to specific movements regardless of their sequence of occurrence. By contrast, striatal SPN populations in each rat fired preferentially at the initiation and termination of its acquired sequence. Critically, the SPNs did not exhibit this bracketing signal when the same rats performed unreinforced sequences containing the same sub-movements that were present in their acquired sequence. Thus, the SPN activity was specifically related to a given repetitively reinforced movement sequence. This striatal beginning-and-end activity did not appear to be dependent on motor cortical inputs. However, strikingly, simultaneously recorded fast-spiking striatal interneurons (FSIs) showed equally selective but inverse firing patterns: they fired in between the initiation and termination of the acquired sequences. These findings suggest that the striatum contains networks of neurons representing acquired sequences of behavior at a level of abstraction higher than that of the individual movements making up the sequence. We propose that such SPN-FSI networks of the striatum could underlie the acquisition of chunked behavioral units.

Neural activity in cortico-basal ganglia circuits of juvenile songbirds encodes performance during goal-directed learning

Cortico-basal ganglia circuits are thought to mediate goal-directed learning by a process of outcome evaluation to gradually select appropriate motor actions. We investigated spiking activity in core and shell subregions of the cortical nucleus LMAN during development as juvenile zebra finches are actively engaged in evaluating feedback of self-generated behavior in relation to their memorized tutor song (the goal). Spiking patterns of single neurons in both core and shell subregions during singing correlated with acoustic similarity to tutor syllables, suggesting a process of outcome evaluation. Both core and shell neurons encoded tutor similarity via either increases or decreases in firing rate, although only shell neurons showed a significant association at the population level. Tutor similarity predicted firing rates most strongly during early stages of learning, and shell but not core neurons showed decreases in response variability across development, suggesting that the activity of shell neurons reflects the progression of learning.

The Fast Spiking Subpopulation of Striatal Neurons Coding for Temporal Cognition of Movements

Background: Timing dysfunctions occur in a number of neurological and psychiatric disorders such as Parkinson's disease, obsessive-compulsive disorder, autism and attention-deficit-hyperactivity disorder. Several lines of evidence show that disrupted timing processing is involved in specific fronto-striatal abnormalities. The striatum encodes reinforcement learning and procedural motion, and consequently is required to represent temporal information precisely, which then guides actions in proper sequence. Previous studies highlighted the temporal scaling property of timing-relevant striatal neurons; however, it is still unknown how this is accomplished over short temporal latencies, such as the sub-seconds to seconds range. Methods: We designed a task with a series of timing behaviors that required rats to reproduce a fixed duration with robust action. Using chronic multichannel electrode arrays, we recorded neural activity from dorso-medial striatum in 4 rats performing the task and identified modulation response of each neuron to different events. Cell type classification was performed according to a multi-criteria clustering analysis. Results: Dorso-medial striatal neurons (n = 557) were recorded, of which 113 single units were considered as timing-relevant neurons, especially the fast-spiking subpopulation that had trial-to-trial ramping up or ramping down firing modulation during the time estimation period. Furthermore, these timing-relevant striatal neurons had to calibrate the spread of their firing pattern by rewarded experience to express the timing behavior accurately. Conclusion: Our data suggests that the dynamic activities of timing-relevant units encode information about the current duration and recent outcomes, which is needed to predict and drive the following action. These results reveal the potential mechanism of time calibration in a short temporal resolution, which may help to explain the neural basis of motor coordination affected by certain physiological or pathological conditions.

Parallel, but Dissociable, Processing in Discrete Corticostriatal Inputs Encodes Skill Learning

Changes in cortical and striatal function underlie the transition from novel actions to refined motor skills. How discrete, anatomically defined corticostriatal projections function in vivo to encode skill learning remains unclear. Using novel fiber photometry approaches to assess real-time activity of associative inputs from medial prefrontal cortex to dorsomedial striatum and sensorimotor inputs from motor cortex to dorsolateral striatum, we show that associative and sensorimotor inputs co-engage early in action learning and disengage in a dissociable manner as actions are refined. Disengagement of associative, but not sensorimotor, inputs predicts individual differences in subsequent skill learning. Divergent somatic and presynaptic engagement in both projections during early action learning suggests potential learning-related in vivo modulation of presynaptic corticostriatal function. These findings reveal parallel processing within associative and sensorimotor circuits that challenges and refines existing views of corticostriatal function and expose neuronal projection- and compartment-specific activity dynamics that encode and predict action learning.

Local or Not Local: Investigating the Nature of Striatal Theta Oscillations in Behaving Rats

In the cortex and hippocampus, neuronal oscillations of different frequencies can be observed in local field potentials (LFPs). LFPs oscillations in the theta band (6–10 Hz) have also been observed in the dorsolateral striatum (DLS) of rodents, mostly during locomotion, and have been proposed to mediate behaviorally-relevant interactions between striatum and cortex (or between striatum and hippocampus). However, it is unclear if these theta oscillations are generated in the striatum. To address this issue, we recorded LFPs and spiking activity in the DLS of rats performing a running sequence on a motorized treadmill. We observed an increase in rhythmical activity of the LFP in the theta-band during run compared to rest periods. However, several observations suggest that these oscillations are mainly generated outside of the striatum. First, theta oscillations disappeared when LFPs were rereferenced against a striatal recording electrode and the imaginary coherence between LFPs recorded at different locations within the striatum was null. Second, 8% of the recorded neurons had their spiking activity phase-locked to the theta rhythm. Third, Granger causality analyses between LFPs simultaneously recorded in the cortex and the striatum revealed that the interdependence between these two signals in the theta range was mostly accounted for by a common external source. The most parsimonious interpretation of these results is that theta oscillations observed in striatal LFPs are largely contaminated by volume-conducted signals. We propose that striatal LFPs are not optimal proxies of network dynamics in the striatum and should be interpreted with caution.

Differential Encoding of Time by Prefrontal and Striatal Network Dynamics

Telling time is fundamental to many forms of learning and behavior, including the anticipation of rewarding events. Although the neural mechanisms underlying timing remain unknown, computational models have proposed that the brain represents time in the dynamics of neural networks. Consistent with this hypothesis, changing patterns of neural activity dynamically in a number of brain areas-including the striatum and cortex-has been shown to encode elapsed time. To date, however, no studies have explicitly quantified and contrasted how well different areas encode time by recording large numbers of units simultaneously from more than one area. Here, we performed large-scale extracellular recordings in the striatum and orbitofrontal cortex of mice that learned the temporal relationship between a stimulus and a reward and reported their response with anticipatory licking. We used a machine-learning algorithm to quantify how well populations of neurons encoded elapsed time from stimulus onset. Both the striatal and cortical networks encoded time, but the striatal network outperformed the orbitofrontal cortex, a finding replicated both in simultaneously and nonsimultaneously recorded corticostriatal datasets. The striatal network was also more reliable in predicting when the animals would lick up to ∼1 s before the actual lick occurred. Our results are consistent with the hypothesis that temporal information is encoded in a widely distributed manner throughout multiple brain areas, but that the striatum may have a privileged role in timing because it has a more accurate "clock" as it integrates information across multiple cortical areas.

SIGNIFICANCE STATEMENT

The neural representation of time is thought to be distributed across multiple functionally specialized brain structures, including the striatum and cortex. However, until now, the neural code for time has not been compared quantitatively between these areas. Here, we performed large-scale recordings in the striatum and orbitofrontal cortex of mice trained on a stimulus-reward association task involving a delay period and used a machine-learning algorithm to quantify how well populations of simultaneously recorded neurons encoded elapsed time from stimulus onset. We found that, although both areas encoded time, the striatum consistently outperformed the orbitofrontal cortex. These results suggest that the striatum may refine the code for time by integrating information from multiple inputs.

The role of the intrinsic cholinergic system of the striatum: What have we learned from TAN recordings in behaving animals?

Cholinergic interneurons provide rich local innervation of the striatum and play an important role in controlling behavior, as evidenced by the variety of movement and psychiatric disorders linked to disrupted striatal cholinergic transmission. Much progress has been made in recent years regarding our understanding of how these interneurons contribute to the processing of information in the striatum. In particular, investigation of the activity of presumed striatal cholinergic interneurons, identified as tonically active neurons or TANs in behaving animals, has pointed to their role in the signaling and learning of the motivational relevance of environmental stimuli. Although the bulk of this work has been conducted in monkeys, several studies have also been carried out in behaving rats, but information remains rather disparate across studies and it is still questionable whether rodent TANs correspond to TANs described in monkeys. Consequently, our current understanding of the function of cholinergic transmission in the striatum is challenged by the rapidly growing, but often confusing literature on the relationship between TAN activity and specific behaviors. As regards the precise nature of the information conveyed by the cholinergic TANs, a recent influential view emphasized that these local circuit neurons may play a special role in the processing of contextual information that is important for reinforcement learning and selection of appropriate actions. This review provides a summary of recent progress in TAN physiology from which it is proposed that striatal cholinergic interneurons are crucial elements for flexible switching of behaviors under changing environmental conditions.

Differences between Dorsal and Ventral Striatum in the Sensitivity of Tonically Active Neurons to Rewarding Events

Within the striatum, cholinergic interneurons, electrophysiologically identified as tonically active neurons (TANs), represent a relatively homogeneous group in terms of their functional properties. They display typical pause in tonic firing in response to rewarding events which are of crucial importance for reinforcement learning. These responses are uniformly distributed throughout the dorsal striatum (i.e., motor and associative striatum), but it is unknown, at least in monkeys, whether differences in the modulation of TAN activity exist in the ventral striatum (i.e., limbic striatum), a region specialized for processing of motivational information. To address this issue, we examined the activity of dorsal and ventral TANs in two monkeys trained on a Pavlovian conditioning task in which a visual stimulus preceded the delivery of liquid reward by a fixed time interval. We found that the proportion of TANs responding to the stimulus predictive of reward did not vary significantly across regions (58%–80%), whereas the fraction of TANs responding to reward was higher in the limbic striatum (100%) compared to the motor (65%) and associative striatum (52%). By examining TAN modulation at the level of both the population and the individual neurons, we showed that the duration of pause responses to the stimulus and reward was longer in the ventral than in the dorsal striatal regions. Also, the magnitude of the pause was greater in ventral than dorsal striatum for the stimulus predictive of reward but not for the reward itself. We found similar region-specific differences in pause response duration to the stimulus when the timing of reward was less predictable (fixed replaced by variable time interval). Regional variations in the duration and magnitude of the pause response were transferred from the stimulus to reward when reward was delivered in the absence of any predictive stimulus. It therefore appears that ventral TANs exhibit stronger responses to rewarding stimuli, compared to dorsal TANs. The high proportion of responsive neurons, combined with particular response features, support the notion that the ventral TAN system can be driven by specific synaptic inputs arising from afferent sources distinct from those targeting the dorsal TAN system.

Cholinergic Interneurons Use Orbitofrontal Input to Track Beliefs about Current State

When conditions change, organisms need to learn about the changed conditions without interfering with what they already know. To do so, they can assign the new learning to a new "state" and the old learning to a previous state. This state assignment is fundamental to behavioral flexibility. Cholinergic interneurons (CINs) in the dorsomedial striatum (DMS) are necessary for associative information to be compartmentalized in this way, but the mechanism by which they do so is unknown. Here we addressed this question by recording putative CINs from the DMS in rats performing a task consisting of a series of trial blocks, or states, that required the recall and application of contradictory associative information. We found that individual CINs in the DMS represented the current state throughout each trial. These state correlates were not observed in dorsolateral striatal CINs recorded in the same rats. Notably, DMS CIN ensembles tracked rats' beliefs about the current state such that, when states were miscoded, rats tended to make suboptimal choices reflecting the miscoding. State information held by the DMS CINs also depended completely on the orbitofrontal cortex, an area that has been proposed to signal environmental states. These results suggest that CINs set the stage for recalling associative information relevant to the current environment by maintaining a real-time representation of the current state. Such a role has novel implications for understanding the neural basis of a variety of psychiatric diseases, such as addiction or anxiety disorders, in which patients generalize inappropriately (or fail to generalize) between different environments.

SIGNIFICANCE STATEMENT

Striatal cholinergic interneurons (CINs) are thought to be identical to tonically active neurons. These neurons have long been thought to have an important influence on striatal processing during reward-related learning. Recently, a more specific function for striatal CINs has been suggested, which is that they are necessary for striatal learning to be compartmentalized into different states as the state of the environment changes. Here we report that putative CINs appear to track rats' beliefs about which environmental state is current. We further show that this property of CINs depends on orbitofrontal cortex input and is correlated with choices made by rats. These findings could provide new insight into neuropsychiatric diseases that involve improper generalization between different contexts.

Violations of Expectations As Matter for the Believing Process

For the purpose of this communication it is postulated that violation of expectation means a disturbing event or conflict interfering with a previously established mental state that affords a firm belief or confident feeling. According to this hypothesis a violation of an expectation contradicts predictions and intentions that have been attained on stored experiences, valuations, and actual mood. We will argue that the notion of belief as static or stable which is usually described by expressions such as "my belief" or "our general belief" has to be extended to accommodate the process of belief formation. The credition model emphasizes the procedural aspect of belief by which the "process of believing" becomes similar to other psychological processes. We will describe that the "violation of expectation" can be decoded from the credition perspective and has brain functional correlates.

Parsing Heterogeneous Striatal Activity

The striatum is an input channel of the basal ganglia and is well known to be involved in reward-based decision making and learning. At the macroscopic level, the striatum has been postulated to contain parallel functional modules, each of which includes neurons that perform similar computations to support selection of appropriate actions for different task contexts. At the single-neuron level, however, recent studies in monkeys and rodents have revealed heterogeneity in neuronal activity even within restricted modules of the striatum. Looking for generality in the complex striatal activity patterns, here we briefly survey several types of striatal activity, focusing on their usefulness for mediating behaviors. In particular, we focus on two types of behavioral tasks: reward-based tasks that use salient sensory cues and manipulate outcomes associated with the cues; and perceptual decision tasks that manipulate the quality of noisy sensory cues and associate all correct decisions with the same outcome. Guided by previous insights on the modular organization and general selection-related functions of the basal ganglia, we relate striatal activity patterns on these tasks to two types of computations: implementation of selection and evaluation. We suggest that a parsing with the selection/evaluation categories encourages a focus on the functional commonalities revealed by studies with different animal models and behavioral tasks, instead of a focus on aspects of striatal activity that may be specific to a particular task setting. We then highlight several questions in the selection-evaluation framework for future explorations.

Parvalbumin Interneurons Modulate Striatal Output and Enhance Performance during Associative Learning

The prevailing view is that striatal parvalbumin (PV)-positive interneurons primarily function to downregulate medium spiny projection neuron (MSN) activity via monosynaptic inhibitory signaling. Here, by combining in vivo neural recordings and optogenetics, we unexpectedly find that both suppressing and over-activating PV cells attenuates spontaneous MSN activity. To account for this, we find that, in addition to monosynaptic coupling, PV-MSN interactions are mediated by a competing disynaptic inhibitory circuit involving a variety of neuropeptide Y-expressing interneurons. Next we use optogenetic and chemogenetic approaches to show that dorsolateral striatal PV interneurons influence the initial expression of reward-conditioned responses but that their contribution to performance declines with experience. Consistent with this, we observe with large-scale recordings in behaving animals that the relative contribution of PV cells on MSN activity diminishes with training. Together, this work provides a possible mechanism by which PV interneurons modulate striatal output and selectively enhance performance early in learning.

Striatal Cholinergic Interneurons Modulate Spike-Timing in Striosomes and Matrix by an Amphetamine-Sensitive Mechanism

The striatum is key for action-selection and the motivation to move. Dopamine and acetylcholine release sites are enriched in the striatum and are cross-regulated, possibly to achieve optimal behavior. Drugs of abuse, which promote abnormally high dopamine release, disrupt normal action-selection and drive restricted, repetitive behaviors (stereotypies). Stereotypies occur in a variety of disorders including obsessive-compulsive disorder, autism, schizophrenia and Huntington's disease, as well as in addictive states. The severity of drug-induced stereotypy is correlated with induction of c-Fos expression in striosomes, a striatal compartment that is related to the limbic system and that directly projects to dopamine-producing neurons of the substantia nigra. These characteristics of striosomes contrast with the properties of the extra-striosomal matrix, which has strong sensorimotor and associative circuit inputs and outputs. Disruption of acetylcholine signaling in the striatum blocks the striosome-predominant c-Fos expression pattern induced by drugs of abuse and alters drug-induced stereotypy. The activity of striatal cholinergic interneurons is associated with behaviors related to sensory cues, and cortical inputs to striosomes can bias action-selection in the face of conflicting cues. The neurons and neuropil of striosomes and matrix neurons have observably separate distributions, both at the input level in the striatum and at the output level in the substantia nigra. Notably, cholinergic axons readily cross compartment borders, providing a potential route for local cross-compartment communication to maintain a balance between striosomal and matrix activity. We show here, by slice electrophysiology in transgenic mice, that repetitive evoked firing patterns in striosomal and matrix striatal projection neurons (SPNs) are interrupted by optogenetic activation of cholinergic interneurons either by the addition or the deletion of spikes. We demonstrate that this cholinergic modulation of projection neurons is blocked in brain slices taken from mice exposed to amphetamine and engaged in amphetamine-induced stereotypy, and lacking responsiveness to salient cues. Our findings support a model whereby activity in striosomes is normally under strong regulation by cholinergic interneurons, favoring behavioral flexibility, but that in animals with drug-induced stereotypy, this cholinergic signaling breaks down, resulting in differential modulation of striosomal activity and an inability to bias action-selection according to relevant sensory cues.

Sensory processing in Huntington's disease

OBJECTIVE

An intriguing electrophysiological feature of patients with Huntington's disease (HD) is the delayed latency and decreased amplitude of somatosensory long-latency evoked potentials (LLeps). We investigated whether such dysfunction was associated with delayed conscious perception of the sensory stimulus.

METHODS

Sixteen HD patients and 16 control subjects faced a computer screen showing the Libet's clock (Libet et al., 1983). In Rest trials, subjects had to memorize the position of the clock handle at perception of either electrical or thermal stimuli (AW). In React, additionally, they were asked to make a fist with their right hand, in a simple reaction time task (SRT). LLseps were recorded from Cz in both conditions.

RESULTS

LLeps negative peak latency (N2) and SRT were abnormally delayed in patients in all conditions. AW was only abnormally prolonged in the React condition but the time difference between AW and the negative peak of the LLeps was not different in the two groups. There was a significant negative correlation between SRT and AW or LLeps amplitude in patients but not in healthy subjects.

CONCLUSION

Our HD patients did not show abnormalities in conscious perception of sensory stimuli but their LLeps abnormalities were more marked when they had to react. This is compatible with failure to detect stimulus salience rather than with a cognitive defect.

SIGNIFICANCE

HD patients at early stages of the disease have preserved subjective perception of sensation but faulty sensorimotor integration.

Common oscillatory mechanisms across multiple memory systems

The cortex, hippocampus, and striatum support dissociable forms of memory. While each of these regions contains specialized circuitry supporting their respective functions, all structure their activities across time with delta, theta, and gamma rhythms. We review how these oscillations are generated and how they coordinate distinct memory systems during encoding, consolidation, and retrieval. First, gamma oscillations occur in all regions and coordinate local spiking, compressing it into short population bursts. Second, gamma oscillations are modulated by delta and theta oscillations. Third, oscillatory dynamics in these memory systems can operate in either a 'slow' or 'fast' mode. The slow mode happens during slow-wave sleep (SWS) and is characterized by large irregular activity in the hippocampus and delta oscillations in cortical and striatal circuits. The fast mode occurs during active waking and REM and is characterized by theta oscillations in the hippocampus and its targets, along with gamma oscillations in the rest of cortex. In waking, the fast mode is associated with the efficacious encoding and retrieval of declarative and procedural memories. Theta and gamma oscillations have the similar relationships with encoding and retrieval across multiple forms of memory and brain regions, despite regional differences in microcircuitry and information content. Differences in the oscillatory coordination of memory systems during sleep might explain why the consolidation of some forms of memory is sensitive to SWS, while others depend on REM. In particular, theta oscillations appear to support the consolidation of certain types of procedural memories during REM, while delta oscillations during SWS seem to promote declarative and procedural memories.

Primary motor and sensory cortical areas communicate via spatiotemporally coordinated networks at multiple frequencies

Skilled movements rely on sensory information to shape optimal motor responses, for which the sensory and motor cortical areas are critical. How these areas interact to mediate sensorimotor integration is largely unknown. Here, we measure intercortical coherence between the orofacial motor (MIo) and somatosensory (SIo) areas of cortex as monkeys learn to generate tongue-protrusive force. We report that coherence between MIo and SIo is reciprocal and that neuroplastic changes in coherence gradually emerge over a few days. These functional networks of coherent spiking and local field potentials exhibit frequency-specific spatiotemporal properties. During force generation, theta coherence (2-6 Hz) is prominent and exhibited by numerous paired signals; before or after force generation, coherence is evident in alpha (6-13 Hz), beta (15-30 Hz), and gamma (30-50 Hz) bands, but the functional networks are smaller and weaker. Unlike coherence in the higher frequency bands, the distribution of the phase at peak theta coherence is bimodal with peaks near 0° and ±180°, suggesting that communication between somatosensory and motor areas is coordinated temporally by the phase of theta coherence. Time-sensitive sensorimotor integration and plasticity may rely on coherence of local and large-scale functional networks for cortical processes to operate at multiple temporal and spatial scales.

Low- and high-gamma oscillations deviate in opposite directions from zero-phase synchrony in the limbic corticostriatal loop

The loop structure of cortico-striatal anatomy in principle enables both descending (cortico-striatal) and ascending (striato-cortical) influences, but the factors that regulate the flow of information in these loops are not known. We report that low- and high-gamma oscillations (∼50 and ∼80 Hz, respectively) in the local field potential of freely moving rats are highly synchronous between the infralimbic region of the medial prefrontal cortex (mPFC) and the ventral striatum (vStr). Strikingly, high-gamma oscillations in mPFC preceded those in vStr, whereas low-gamma oscillations in mPFC lagged those in vStr, with short (∼1 ms) time lags. These systematic deviations from zero-phase synchrony were consistent across measures based on amplitude cross-correlation and phase slopes and were robustly maintained between behavioral states and different individual subjects. Furthermore, low- and high-gamma oscillations were associated with distinct ensemble spiking patterns in vStr, even when controlling for overt behavioral differences and slow changes in neural activity. These results imply that neural activity in vStr and mPFC is tightly coupled at the gamma timescale and raise the intriguing possibility that frequency-specific deviations from this coupling may signal transient leader-follower switches.

Central Thalamic Deep-Brain Stimulation Alters Striatal-Thalamic Connectivity in Cognitive Neural Behavior

Central thalamic deep brain stimulation (CT-DBS) has been proposed as an experimental therapeutic approach to produce consistent sustained regulation of forebrain arousal for several neurological diseases. We investigated local field potentials (LFPs) induced by CT-DBS from the thalamic central lateral nuclei (CL) and the striatum as potential biomarkers for the enhancement of lever-pressing skill learning. LFPs were simultaneously recorded from multiple sites in the CL, ventral striatum (Vstr), and dorsal striatum (Dstr). LFP oscillation power and functional connectivity were assessed and compared between the CT-DBS and sham control groups. The theta and alpha LFP oscillations were significantly increased in the CL and striatum in the CT-DBS group. Furthermore, interhemispheric coherences between bilateral CL and striatum were increased in the theta band. Additionally, enhancement of c-Fos activity, dopamine D2 receptor (Drd2), and α4-nicotinic acetylcholine receptor (α4-nAChR) occurred after CT-DBS treatment in the striatum and hippocampus. CT-DBS strengthened thalamic-striatal functional connectivity, which demonstrates that the inter-regional connectivity enhancement might contribute to synaptic plasticity in the striatum. Altered dopaminergic and cholinergic receptors resulted in modulation of striatal synaptic plasticity's ability to regulate downstream signaling cascades for higher brain functions of lever-pressing skill learning.

Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum

Evaluating outcomes of behavior is a central function of the striatum. In circuits engaging the dorsomedial striatum, sensitivity to goal value is accentuated during learning, whereas outcome sensitivity is thought to be minimal in the dorsolateral striatum and its habit-related corticostriatal circuits. However, a distinct population of projection neurons in the dorsolateral striatum exhibits selective sensitivity to rewards. Here, we evaluated the outcome-related signaling in such neurons as rats performed an instructional T-maze task for two rewards. As the rats formed maze-running habits and then changed behavior after reward devaluation, we detected outcome-related spike activity in 116 units out of 1,479 recorded units. During initial training, nearly equal numbers of these units fired preferentially either after rewarded runs or after unrewarded runs, and the majority were responsive at only one of two reward locations. With overtraining, as habits formed, firing in nonrewarded trials almost disappeared, and reward-specific firing declined. Thus error-related signaling was lost, and reward signaling became generalized. Following reward devaluation, in an extinction test, postgoal activity was nearly undetectable, despite accurate running. Strikingly, when rewards were then returned, postgoal activity reappeared and recapitulated the original early response pattern, with nearly equal numbers responding to rewarded and unrewarded runs and to single rewards. These findings demonstrate that outcome evaluation in the dorsolateral striatum is highly plastic and tracks stages of behavioral exploration and exploitation. These signals could be a new target for understanding compulsive behaviors that involve changes to dorsal striatum function.

Habit Learning by Naive Macaques Is Marked by Response Sharpening of Striatal Neurons Representing the Cost and Outcome of Acquired Action Sequences

Over a century of scientific work has focused on defining the factors motivating behavioral learning. Observations in animals and humans trained on a wide range of tasks support reinforcement learning (RL) algorithms as accounting for the learning. Still unknown, however, are the signals that drive learning in naive, untrained subjects. Here, we capitalized on a sequential saccade task in which macaque monkeys acquired repetitive scanning sequences without instruction. We found that spike activity in the caudate nucleus after each trial corresponded to an integrated cost-benefit signal that was highly correlated with the degree of naturalistic untutored learning by the monkeys. Across learning, neurons encoding both cost and outcome gradually acquired increasingly sharp phasic trial-end responses that paralleled the development of the habit-like, repetitive saccade sequences. Our findings demonstrate an integrated cost-benefit signal by which RL and its neural correlates could drive naturalistic behaviors in freely behaving primates.

Transcranial alternating current stimulation affects the BOLD signal in a frequency and task-dependent manner

Transcranial alternating current stimulation (tACS) has emerged as a promising tool for manipulating ongoing brain oscillations. While previous studies demonstrated frequency‐specific effects of tACS on diverse cognitive functions, its effect on neural activity remains poorly understood. Here we asked how tACS modulates regional fMRI blood oxygenation level dependent (BOLD) signal as a function of frequency, current strength, and task condition. TACS was applied over the posterior cortex of healthy human subjects while the BOLD signal was measured during rest or task conditions (visual perception, passive video viewing and motor task). TACS was applied in a blockwise manner at different frequencies (10, 16, 60 and 80 Hz). The strongest tACS effects on BOLD activity were observed with stimulation at alpha (10 Hz) and beta (16 Hz) frequency bands, while effects of tACS at the gamma range were rather modest. Specifically, we found that tACS at 16 Hz induced BOLD activity increase in fronto‐parietal areas. Overall, tACS effects varied as a function of frequency and task, and were predominantly seen in regions that were not activated by the task. Also, the modulated regions were poorly predicted by current density modeling studies. Taken together, our results suggest that tACS does not necessarily exert its strongest effects in regions below the electrodes and that region specificity might be achieved with tACS due to varying susceptibility of brain regions to entrain to a given frequency. Hum Brain Mapp 37:94–121, 2016. © 2015 The Authors. Human Brain Mapping Published by Wiley Periodicals, Inc

Multimodal Plasticity in Dorsal Striatum While Learning a Lateralized Navigation Task

Growing evidence supports a critical role for the dorsal striatum in cognitive as well as motor control. Both lesions and in vivo recordings demonstrate a transition in the engaged dorsal striatal subregion, from dorsomedial to dorsolateral, as skill performance shifts from an attentive phase to a more automatic or habitual phase. What are the neural mechanisms supporting the cognitive and behavioral transitions in skill learning? To pursue this question, we used T-maze training during which rats transition from early, attentive (dorsomedial) to late habitual (dorsolateral) performance. Following early or late training, we performed the first direct comparison of bidirectional synaptic plasticity in striatal brain slices, and the first evaluation of striatal synaptic plasticity by hemisphere relative to a learned turn. Consequently, we find that long-term potentiation and long-term depression are independently modulated with learning rather than reciprocally linked as previously suggested. Our results establish that modulation of evoked synaptic plasticity with learning depends on striatal subregion, training stage, and hemisphere relative to the learned turn direction. Exclusive to the contralateral hemisphere, intrinsic excitability is enhanced in dorsomedial relative to dorsolateral medium spiny neurons early in training and population responses are dampened late in training. Neuronal reconstructions indicate dendritic remodeling after training, which may represent a novel form of pruning. In conclusion, we describe region- and hemisphere-specific changes in striatal synaptic, intrinsic, and morphological plasticity which correspond to T-maze learning stages, and which may play a role in the cognitive transition between attentive and habitual strategies. Significance statement: We investigated neural plasticity in dorsal striatum from rats that were briefly or extensively trained on a directional T-maze task. Our results demonstrate that both the extent of training and the direction a rat learns to turn control the location and type of change in synaptic plasticity. In addition, brief training produces changes in neuron excitability only within one striatal subregion, whereas all training produces widespread changes in dendritic morphology. Our results suggest that activity in dorsomedial striatum strengthens the rewarded turn after brief training, whereas activity in dorsolateral striatum suppresses unrewarded turns after extensive training. This study illuminates how plasticity mediates learning using a task recognized for transitioning subjects from attentive to automatic performance.

Arcuate hypothalamic AgRP and putative POMC neurons show opposite changes in spiking across multiple timescales

Agouti-related-peptide (AgRP) neurons—interoceptive neurons in the arcuate nucleus of the hypothalamus (ARC)—are both necessary and sufficient for driving feeding behavior. To better understand the functional roles of AgRP neurons, we performed optetrode electrophysiological recordings from AgRP neurons in awake, behaving AgRP-IRES-Cre mice. In free-feeding mice, we observed a fivefold increase in AgRP neuron firing with mounting caloric deficit in afternoon vs morning recordings. In food-restricted mice, as food became available, AgRP neuron firing dropped, yet remained elevated as compared to firing in sated mice. The rapid drop in spiking activity of AgRP neurons at meal onset may reflect a termination of the drive to find food, while residual, persistent spiking may reflect a sustained drive to consume food. Moreover, nearby neurons inhibited by AgRP neuron photostimulation, likely including satiety-promoting pro-opiomelanocortin (POMC) neurons, demonstrated opposite changes in spiking. Finally, firing of ARC neurons was also rapidly modulated within seconds of individual licks for liquid food. These findings suggest novel roles for antagonistic AgRP and POMC neurons in the regulation of feeding behaviors across multiple timescales.

DOI:http://dx.doi.org/10.7554/eLife.07122.001

Appetite is controlled in part by the opposing actions of the ‘hunger hormone’ (called ghrelin) and the ‘satiety hormone’ (called leptin). Ghrelin is released by the stomach when empty and stimulates appetite, whereas leptin is released by fat stores and induces feelings of fullness. Both hormones travel via the bloodstream and are detected by a region of the brain called the hypothalamus.

Ghrelin and leptin act specifically on a group of cells in the hypothalamus that contains at least two major cell types: AgRP neurons and POMC neurons. Electrode recordings from slices of mouse brain show that AgRP neurons fire more rapidly at night—when mice normally feed—than during the day, whereas POMC neurons do the opposite. This suggests that the activity of AgRP neurons drives food-seeking behavior, whereas POMC firing inhibits it. However, the absence of circulating hormones such as leptin and ghrelin in brain slices makes it difficult to draw firm conclusions about the role of these cells in controlling appetite.

Mandelblat-Cerf, Ramesh, Burgess et al. have addressed this issue by performing the first recordings of spiking activity in individual AgRP neurons and other cells that are likely to be POMC neurons in awake mice. Consistent with the results of slice experiments, the firing rate of AgRP neurons increased steadily over the course of the day, suggesting that their activity signals an increasing need for food. Furthermore, as soon as food became available, the firing rate of the AgRP neurons suddenly dropped—even though the animals' energy reserves would still have been low. These results are consistent with the findings of two recent studies reported earlier this year that used different methods to indirectly measure neuronal activity in awake mice. Notably, even after the drop in activity, the firing rates of AgRP neurons remained above those recorded in fully sated mice—which possibly reflects the fact that the animals' energy reserves were still low. The putative POMC neurons generally showed opposite effects to the AgRP neurons.

The results of these electrode recordings in awake mice thus suggest that AgRP and POMC neurons together maintain a drive to seek out food sources as energy reserves fall, and to refrain from doing so when energy reserves are plentiful. Moreover, the seemingly paradoxical drop in AgRP firing and increase in POMC firing upon receiving food may act as a signal to temporarily stop searching for food, so that feeding itself can begin. Alternatively, since the release of satiety hormones after eating a meal is slow, these rapid changes in firing may provide more immediate feedback to the neuronal circuits that regulate the drives to seek and consume food.

DOI:http://dx.doi.org/10.7554/eLife.07122.002