Stable encoding of task structure coexists with flexible coding of task events in sensorimotor striatum

Striosomes Target Nigral Dopamine-Containing Neurons via Direct-D1 and Indirect-D2 Pathways Paralleling Classic Direct-Indirect Basal Ganglia Systems

The classic output pathways of the basal ganglia are known as the direct-D1 and indirect-D2, or Go/No-Go, pathways. Balance of the activity in these canonical direct-indirect pathways is considered a core requirement for normal movement control, and their imbalance is a major etiologic factor in movement disorders including Parkinsons disease. We present evidence for a conceptually equivalent parallel system of direct-D1 and indirect-D2 pathways that arise from striatal projection neurons (SPNs) of the striosome compartment rather than from the matrix. These striosomal direct (S-D1) and indirect (S-D2) pathways, as a pair, target dopamine-containing neurons of the substantia nigra (SNpc) instead of the motor output nuclei of the basal ganglia. The novel anatomically and functionally distinct indirect-D2 striosomal pathway targets dopaminergic SNpc cells indirectly via a core region of the external pallidum (GPe). We demonstrate that these S-D1 and S-D2 pathways oppositely modulate striatal dopamine release in freely behaving mice under open-field conditions and oppositely modulate locomotor and other movements. These S-D1 and S-D2 pathways further exhibit different, time-dependent responses during performance of a probabilistic decision-making maze task and respond differently to rewarding and aversive stimuli. These contrasts depend on mediolateral and anteroposterior striatal locations of the SPNs as are the classic direct and indirect pathways. The effects of S-D1 and S-D2 stimulation on striatal dopamine release and voluntary locomotion are nearly opposite. The parallelism of the direct-indirect circuit design motifs of the striosomal S-D and S-D2 circuits and canonical matrix M-D1 and M-D2, and their contrasting behavioral effects, call for a major reformulation of the classic direct-indirect pathway model of basal ganglia function. Given that some striosomes receive limbic and association cortical inputs, the S-D1 and S-D2 circuits likely influence motivation for action and behavioral learning, complementing and possibly reorienting the motoric activities of the canonical matrix pathways. At a fundamental level, these findings suggest a unifying framework for aligning two sets of circuits that share the organizational motif of opponent D1 and D2 regulation, but that have different outputs and can even have opposite polarities in their targets and effects, albeit conditioned by striatal topography. Our findings further delineate a potentially therapeutically important set of pathways influencing dopamine, including a D2 receptor-linked S-D2 pathway likely unknowingly targeted by administration of many therapeutic drugs including those for Parkinsons disease. The novel parallel pathway model that we propose here could help to account for the normally integrated modulatory influence of the basal ganglia on motivation for actions as well as the actions themselves.

Representation of rhythmic chunking in striatum of mice executing complex continuous movement sequences

We used a step-wheel system to examine the activity of striatal projection neurons as mice practiced stepping on complexly arranged foothold pegs in this Ferris-wheel-like device to receive reward. Sets of dorsolateral striatal projection neurons were sensitive to specific parameters of repetitive motor coordination during the runs. They responded to combinations of the parameters of continuous movements (interval, phase, and repetition), forming "chunking responses"-some for combinations of these parameters across multiple body parts. Recordings in sensorimotor cortical areas exhibited notably fewer such responses but were documented for smaller neuron sets whose heterogeneity was significant. Striatal movement encoding via chunking responsivity could provide insight into neural strategies governing effective motor control by the striatum. It is possible that the striking need for external rhythmic cuing to allow movement sequences by Parkinson's patients could, at least in part, reflect dysfunction in such striatal coding.

Comparative Roles of the Caudate and Putamen in the Serial Order of Behavior: Effects of Striatal Glutamate Receptor Blockade on Variable versus Fixed Spatial Self-Ordered Sequencing in Marmosets

Self-ordered sequencing is an important executive function involving planning and executing a series of steps to achieve goal-directed outcomes. The lateral frontal cortex is implicated in this behavior, but downstream striatal outputs remain relatively unexplored. We trained marmosets on a three-stimulus self-ordered spatial sequencing task using a touch-sensitive screen to explore the role of the caudate nucleus and putamen in random and fixed response arrays. By transiently blocking glutamatergic inputs to these regions, using intrastriatal CNQX microinfusions, we demonstrate that the caudate and putamen are both required for, but contribute differently to, flexible and fixed sequencing. CNQX into either the caudate or putamen impaired variable array accuracy, and infusions into both simultaneously elicited greater impairment. We demonstrated that continuous perseverative errors in variable array were caused by putamen infusions, likely due to interference with the putamen's established role in monitoring motor feedback. Caudate infusions, however, did not affect continuous errors, but did cause an upward trend in recurrent perseveration, possibly reflecting interference with the caudate's established role in spatial working memory and goal-directed planning. In contrast to variable array performance, while both caudate and putamen infusions impaired fixed array responding, the combined effects were not additive, suggesting possible competing roles. Infusions into either region individually, but not simultaneously, led to continuous perseveration. Recurrent perseveration in fixed arrays was caused by putamen, but not caudate, infusions. These results are consistent overall with a role of caudate in planning and flexible responding and the putamen in more rigid habitual or automatic responding.

Striatal Neurons Are Recruited Dynamically into Collective Representations of Self-Initiated and Learned Actions in Freely Moving Mice

Striatal spiny projection neurons are hyperpolarized-at-rest (HaR) and driven to action potential threshold by a small number of powerful inputs-an input-output configuration that is detrimental to response reliability. Because the striatum is important for habitual behaviors and goal-directed learning, we conducted a microendoscopic imaging in freely moving mice that express a genetically encoded Ca2+ indicator sparsely in striatal HaR neurons to evaluate their response reliability during self-initiated movements and operant conditioning. The sparse expression was critical for longitudinal studies of response reliability, and for studying correlations among HaR neurons while minimizing spurious correlations arising from contamination by the background signal. We found that HaR neurons are recruited dynamically into action representation, with distinct neuronal subsets being engaged in a moment-by-moment fashion. While individual neurons respond with little reliability, the population response remained stable across days. Moreover, we found evidence for the temporal coupling between neuronal subsets during conditioned (but not innate) behaviors.

Rhythm Receptive Fields in Striatum of Mice Executing Complex Continuous Movement Sequences

By the use of a novel experimental system, the step-wheel, we investigated the neural underpinnings of complex and continuous movements. We recorded neural activities from the dorsolateral striatum and found neurons sensitive to movement rhythm parameters. These neurons responded to specific combinations of interval, phase, and repetition of movement, effectively forming what we term "rhythm receptive fields." Some neurons even responsive to the combination of movement phases of multiple body parts. In parallel, cortical recordings in sensorimotor areas highlighted a paucity of neurons responsive to multiple parameter combinations, relative to those in the striatum. These findings have implications for comprehending motor coordination deficits seen in brain disorders including Parkinson's disease. Movement encoding by rhythm receptive fields should streamline the brain's capacity to encode temporal patterns, help to resolve the degrees of freedom problem. Such rhythm fields hint at the neural mechanisms governing effective motor control and processing of rhythmic information.

Selective activation of striatal indirect pathway suppresses levodopa induced-dyskinesias

Levodopa (L-DOPA) administration remains the gold standard therapy for Parkinson's disease (PD). Despite several pharmacological advances in the use of L-DOPA, a high proportion of chronically treated patients continues to suffer disabling involuntary movements, namely, L-DOPA-induced dyskinesias (LIDs). As part of the effort to stop these unwanted side effects, the present study used a rodent model to identify and manipulate the striatal outflow circuitry responsible for LIDs. To do so, optogenetic technology was used to activate separately the striatal direct (D1R- expressing) and indirect (D2R- expressing) pathways in a mouse model of PD. Firstly, D1-cre or A2a-cre animals received unilateral injections of neurotoxin 6-hydroxydopamine (6-OHDA) to simulate the loss of dopamine observed in PD patients. The effects of independently stimulating each pathway were tested to see if experimental dyskinesias could be induced. Secondly, dopamine depleted A2a-cre animals received systemic L-DOPA to evoke dyskinetic movements. The ability of indirect pathway optogenetic stimulation to suppress pre-established LIDs was then tested. Selective manipulation of direct pathway evoked optodyskinesias both in dopamine depleted and intact animals, but optical inhibition of these neurons failed to suppress LIDs. On the other hand, selective activation of indirect striatal projection neurons produced an immediate and reliable suppression of LIDs. Thus, a functional dissociation has been found here whereby activation of D1R- and D2R-expressing projection neurons evokes and inhibits LIDs respectively, supporting the notion of tight interaction between the two striatal efferent systems in both normal and pathological conditions. This points to the importance of maintaining an equilibrium in the activity of both striatal pathways to produce normal movement. Finally, the ability of selective indirect pathway optogenetic activation to block the expression of LIDs in an animal model of PD sheds light on intrinsic mechanisms responsible for striatal-based dyskinesias and identifies a potential therapeutic target for suppressing LIDs in PD patients.

Long-term stability of single neuron activity in the motor system

How an established behavior is retained and consistently produced by a nervous system in constant flux remains a mystery. One possible solution to ensure long-term stability in motor output is to fix the activity patterns of single neurons in the relevant circuits. Alternatively, activity in single cells could drift over time provided that the population dynamics are constrained to produce the same behavior. To arbitrate between these possibilities, we recorded single-unit activity in motor cortex and striatum continuously for several weeks as rats performed stereotyped motor behaviors-both learned and innate. We found long-term stability in single neuron activity patterns across both brain regions. A small amount of drift in neural activity, observed over weeks of recording, could be explained by concomitant changes in task-irrelevant aspects of the behavior. These results suggest that long-term stable behaviors are generated by single neuron activity patterns that are themselves highly stable.

Basal ganglia: From the bench to the bed

The basal ganglia (BG) encompass a set of archaic structures of the vertebrate brain that have evolved relatively little during the phylogenetic process. From an anatomic point of view, they are widely distributed throughout brain from the telencephalon to the mesencephalon. The fact that they have been preserved through evolution suggests that they may play a critical role in behavioral monitoring. Indeed, a line of evidence suggests that they are involved in the building of behavioral routines and habits that drive most of our activities in everyday life. In this article, we first examine the organization and physiology of the basal ganglia to explain their function in the control of behavior. Then, we show how disruption of the putamen, and to a lesser extent of the cerebellum, might lead to various dystonic syndromes that frequently arise during childhood.

Dorsal striatum coding for the timely execution of action sequences

The automatic initiation of actions can be highly functional. But occasionally these actions cannot be withheld and are released at inappropriate times, impulsively. Striatal activity has been shown to participate in the timing of action sequence initiation and it has been linked to impulsivity. Using a self-initiated task, we trained adult male rats to withhold a rewarded action sequence until a waiting time interval has elapsed. By analyzing neuronal activity we show that the striatal response preceding the initiation of the learned sequence is strongly modulated by the time subjects wait before eliciting the sequence. Interestingly, the modulation is steeper in adolescent rats, which show a strong prevalence of impulsive responses compared to adults. We hypothesize this anticipatory striatal activity reflects the animals’ subjective reward expectation, based on the elapsed waiting time, while the steeper waiting modulation in adolescence reflects age-related differences in temporal discounting, internal urgency states, or explore–exploit balance.

Parallel and hierarchical neural mechanisms for adaptive and predictive behavioral control

Our brain can be recognized as a network of largely hierarchically organized neural circuits that operate to control specific functions, but when acting in parallel, enable the performance of complex and simultaneous behaviors. Indeed, many of our daily actions require concurrent information processing in sensorimotor, associative, and limbic circuits that are dynamically and hierarchically modulated by sensory information and previous learning. This organization of information processing in biological organisms has served as a major inspiration for artificial intelligence and has helped to create in silico systems capable of matching or even outperforming humans in several specific tasks, including visual recognition and strategy-based games. However, the development of human-like robots that are able to move as quickly as humans and respond flexibly in various situations remains a major challenge and indicates an area where further use of parallel and hierarchical architectures may hold promise. In this article we review several important neural and behavioral mechanisms organizing hierarchical and predictive processing for the acquisition and realization of flexible behavioral control. Then, inspired by the organizational features of brain circuits, we introduce a multi-timescale parallel and hierarchical learning framework for the realization of versatile and agile movement in humanoid robots.

Spatially restricted inhibition of cholinergic interneurons in the dorsolateral striatum encourages behavioral exploration

When pursuing desirable outcomes, one must make the decision between exploring possible actions to obtain those outcomes and exploiting known strategies to maximize efficiency. The dorsolateral striatum (DLS) has been extensively studied with respect to how actions can develop into habits and has also been implicated as an area involved in governing exploitative behavior. Surprisingly, prior work has shown that DLS cholinergic interneurons (ChIs) are not involved in the canonical habit formation function ascribed to the DLS but are instead modulators of behavioral flexibility after initial learning. To further probe this, we evaluated the role of DLS ChIs in behavioral exploration during a brief instrumental training experiment. Through designer receptors exclusively activated by designer drugs (DREADDs) in ChAT-Cre rats, ChIs in the DLS were inhibited during specific phases of the experiment: instrumental training, free-reward delivery, at both times, or never. Without ChI activity during instrumental training, animals biased their responding toward an "optimal" strategy while continuing to work efficiently. This effect was observed again when contingencies were removed as animals with ChIs offline during that phase, regardless of ChI inhibition previously, decreased responding more than animals with ChIs intact. These findings build upon a growing body of literature implicating ChIs in the striatum as gate-keepers of behavioral flexibility and exploration.

Complementary Control over Habits and Behavioral Vigor by Phasic Activity in the Dorsolateral Striatum

Despite clear evidence linking the basal ganglia to the control of outcome insensitivity (i.e., habit) and behavioral vigor (i.e., its behavioral speed/fluidity), it remains unclear whether or how these functions relate to one another. Here, using male Long-Evans rats in response-based and cue-based maze-running tasks, we demonstrate that phasic dorsolateral striatum (DLS) activity occurring at the onset of a learned behavior regulates how vigorous and habitual it is. In a response-based task, brief optogenetic excitation at the onset of runs decreased run duration and the occurrence of deliberative behaviors, whereas midrun stimulation carried little effect. Outcome devaluation showed these runs to be habitual. DLS inhibition at run start did not produce robust effects on behavior until after outcome devaluation. At that time, when the DLS was plausibly most critically required for performance (i.e., habitual), inhibition reduced performance vigor measures and caused a dramatic loss of habitual responding (i.e., animals quit the task). In a second cue-based "beacon" task requiring behavior initiation at the start of the run and again in the middle of the run, DLS excitation at both time points could improve the vigor of runs. Postdevaluation testing showed behavior on the beacon task to be habitual as well. This pattern of results suggests that one role for phasic DLS activity at behavior initiation is to promote the execution of the behavior in a vigorous and habitual fashion by a diverse set of measures.SIGNIFICANCE STATEMENT Our research expands the literature twofold. First, we find that features of a habitual behavior that are typically studied separately (i.e., maze response performance, deliberation movements, running vigor, and outcome insensitivity) are quite closely linked together. Second, efforts have been made to understand "what" the dorsolateral striatum (DLS) does for habitual behavior, and our research provides a key set of results showing "when" it is important (i.e., at behavior initiation). By showing such dramatic control over habits by DLS activity in a phasic time window, plausible real-world applications could involve more informed DLS perturbations to curb intractably problematic habits.

Interfacing behavioral and neural circuit models for habit formation

Habits are an important mechanism by which organisms can automate the control of behavior to alleviate cognitive demand. However, transitions to habitual control are risky because they lead to inflexible responding in the face of change. The question of how the brain controls transitions into habit is thus an intriguing one. How do we regulate when our repeated actions become automated? When is it advantageous or disadvantageous to release actions from cognitive control? Decades of research have identified a variety of methods for eliciting habitual responding in animal models. Progress has also been made to understand which brain areas and neural circuits control transitions into habit. Here, I discuss existing research on behavioral and neural circuit models for habit formation (with an emphasis on striatal circuits), and discuss strategies for combining information from different paradigms and levels of analysis to prompt further progress in the field.

Dystonia and dopamine: From phenomenology to pathophysiology

A line of evidence suggests that the pathophysiology of dystonia involves the striatum, whose activity is modulated among other neurotransmitters, by the dopaminergic system. However, the link between dystonia and dopamine appears complex and remains unclear. Here, we propose a physiological approach to investigate the clinical and experimental data supporting a role of the dopaminergic system in the pathophysiology of dystonic syndromes. Because dystonia is a disorder of motor routines, we first focus on the role of dopamine and striatum in procedural learning. Second, we consider the phenomenology of dystonia from every angle in order to search for features giving food for thought regarding the pathophysiology of the disorder. Then, for each dystonic phenotype, we review, when available, the experimental and imaging data supporting a connection with the dopaminergic system. Finally, we propose a putative model in which the different phenotypes could be explained by changes in the balance between the direct and indirect striato-pallidal pathways, a process critically controlled by the level of dopamine within the striatum. Search strategy and selection criteria References for this article were identified through searches in PubMed with the search terms « dystonia », « dopamine", « striatum », « basal ganglia », « imaging data », « animal model », « procedural learning », « pathophysiology », and « plasticity » from 1998 until 2018. Articles were also identified through searches of the authors' own files. Only selected papers published in English were reviewed. The final reference list was generated on the basis of originality and relevance to the broad scope of this review.

Hyperactive Response of Direct Pathway Striatal Projection Neurons to L-dopa and D1 Agonism in Freely Moving Parkinsonian Mice

Dopamine (DA) profoundly stimulates motor function as demonstrated by the hypokinetic motor symptoms in Parkinson's disease (PD) and by the hyperkinetic motor side effects during dopaminergic treatment of PD. Dopamine (DA) receptor-bypassing, optogenetics- and chemogenetics-induced spike firing of striatal DA D1 receptor (D1R)-expressing, direct pathway medium spiny neurons (dSPNs or dMSNs) promotes movements. However, the endogenous D1R-mediated effects, let alone those of DA replacement, on dSPN spike activity in freely-moving animals is not established. Here we show that using transcription factor Pitx3 null mutant (Pitx3Null) mice as a model for severe and consistent DA denervation in the dorsal striatum in Parkinson's disease, antidromically identified striatonigral neurons (D1R-expressing dSPNs) had a lower baseline spike firing rate than that in DA-intact normal mice, and these neurons increased their spike firing more strongly in Pitx3Null mice than in WT mice in response to injection of L-dopa or the D1R agonist, SKF81297; the increase in spike firing temporally coincided with the motor-stimulating effects of L-dopa and SKF81297. Taken together, these results provide the first evidence from freely moving animals that in parkinsonian striatum, identified behavior-promoting dSPNs become hyperactive upon the administration of L-dopa or a D1 agonist, likely contributing to the profound dopaminergic motor stimulation in parkinsonian animals and PD patients.

HOPE: Hybrid-Drive Combining Optogenetics, Pharmacology and Electrophysiology

Understanding the neural mechanisms underlying human cognition and determining the causal factors for the development of brain pathologies are among the greatest challenges for society. Electrophysiological recordings offer remarkable observations of brain activity as they provide highly precise representations of information coding in both temporal and spatial domains. With the development of genetic tools over the last decades, mice have been a key model organism in neuroscience. However, conducting chronic in vivo electrophysiology in awake, behaving mice remains technically challenging, and this difficulty prevents many research teams from acquiring critical recordings in their mouse models. Behavioral training, implant fabrication, brain surgery, data acquisition and data analysis are all required steps that must be mastered in order to perform cutting-edge experiments in systems neuroscience. Here, we present a new method that simplifies the construction of a drivable and multi-task electrophysiological recording implant without loss of flexibility and recording power. The hybrid-drive combining optogenetics, pharmacology and electrophysiology (HOPE) can support up to 16 tetrodes, attached to a single drive mechanism, organized in two bundles of eight tetrodes, allowing recordings in two different mouse brain regions simultaneously with two optical fibers for optogenetic manipulation or two injection cannulas for drug-delivery experiments. Because it can be printed with a latest-generation desktop 3D printer, the production cost is low compared to classical electrophysiology implants, and it can be built within a few hours. The HOPE implant is also reconfigurable to specific needs as it has been created in a computer-aided design (CAD) software and all the files used for its construction are open-source¹.

Cyclic AMP-producing chemogenetic activation of indirect pathway striatal projection neurons and the downstream effects on the globus pallidus and subthalamic nucleus in freely moving mice

The indirect pathway striatal medium spiny projection neurons (iMSNs) are critical to motor and cognitive brain functions. These neurons express a high level of cAMP-increasing adenosine A2a receptors. However, the potential effects of cAMP production on iMSN spiking activity have not been established, and recording identified iMSNs in freely moving animals is challenging. Here, we show that in the transgenic mice expressing cAMP-producing G protein G_s -coupled designer receptor exclusively activated by designer drug (Gs-DREADD) in iMSNs, the baseline spike firing in MSNs is normal, indicating DREADD expression does not affect the normal physiology of these neurons. Intraperitoneal injection of the DREADD agonist clozapine-N-oxide (CNO; 2.5 mg/kg) increased the spike firing in 50% of the recorded MSNs. However, CNO did not affect MSN firing in Gs-DREADD-negative mice. We also found that CNO injection inhibited the spike firing of globus pallidus external segment (GPe) neurons in Gs-DREADD-positive mice, further indicating CNO excitation of iMSNs. Temporally coincident with these effects on spiking firing in the indirect pathway, CNO injection selectively inhibited locomotion in D2 Gs-DREADD mice. Taken together, our results strongly suggest that cAMP production in iMSNs can increase iMSN spiking activity and cause motor inhibition, thus addressing a long-standing question about the cellular functions of the cAMP-producing adenosine A2a receptors in iMSNs. Cover Image for this issue: doi: 10.1111/jnc.14181.

Inversely Active Striatal Projection Neurons and Interneurons Selectively Delimit Useful Behavioral Sequences

Understanding neural representations of behavioral routines is critical for understanding complex behavior in health and disease. We demonstrate here that accentuated activity of striatal projection neurons (SPNs) at the beginning and end of such behavioral repertoires is a supraordinate representation specifically marking previously rewarded behavioral sequences independent of the individual movements making up the behavior. We recorded spike activity in the striatum and primary motor cortex as individual rats learned specific rewarded lever-press sequences, each one unique to a given rat. Motor cortical neurons mainly responded in relation to specific movements regardless of their sequence of occurrence. By contrast, striatal SPN populations in each rat fired preferentially at the initiation and termination of its acquired sequence. Critically, the SPNs did not exhibit this bracketing signal when the same rats performed unreinforced sequences containing the same sub-movements that were present in their acquired sequence. Thus, the SPN activity was specifically related to a given repetitively reinforced movement sequence. This striatal beginning-and-end activity did not appear to be dependent on motor cortical inputs. However, strikingly, simultaneously recorded fast-spiking striatal interneurons (FSIs) showed equally selective but inverse firing patterns: they fired in between the initiation and termination of the acquired sequences. These findings suggest that the striatum contains networks of neurons representing acquired sequences of behavior at a level of abstraction higher than that of the individual movements making up the sequence. We propose that such SPN-FSI networks of the striatum could underlie the acquisition of chunked behavioral units.

Caudate Microstimulation Increases Value of Specific Choices

Value-based decision-making involves an assessment of the value of items available and the actions required to obtain them. The basal ganglia are highly implicated in action selection and goal-directed behavior [1-4], and the striatum in particular plays a critical role in arbitrating between competing choices [5-9]. Previous work has demonstrated that neural activity in the caudate nucleus is modulated by task-relevant action values [6, 8]. Nonetheless, how value is represented and maintained in the striatum remains unclear since decision-making in these tasks relied on spatially lateralized responses, confounding the ability to generalize to a more abstract choice task [6, 8, 9]. Here, we investigate striatal value representations by applying caudate electrical stimulation in macaque monkeys (n = 3) to bias decision-making in a task that divorces the value of a stimulus from motor action. Electrical microstimulation is known to induce neural plasticity [10, 11], and caudate microstimulation in primates has been shown to accelerate associative learning [12, 13]. Our results indicate that stimulation paired with a particular stimulus increases selection of that stimulus, and this effect was stimulus dependent and action independent. The modulation of choice behavior using microstimulation was best modeled as resulting from changes in stimulus value. Caudate neural recordings (n = 1) show that changes in value-coding neuron activity are stimulus value dependent. We argue that caudate microstimulation can differentially increase stimulus values independent of action, and unilateral manipulations of value are sufficient to mediate choice behavior. These results support potential future applications of microstimulation to correct maladaptive plasticity underlying dysfunctional decision-making related to neuropsychiatric conditions.

Background activity and visual responsiveness of caudate nucleus neurons in halothane anesthetized and in awake, behaving cats

This study focuses on the important question whether brain activity recorded from anesthetized, paralyzed animals is comparable to that recorded from awake, behaving ones. We compared neuronal activity recorded from the caudate nucleus (CN) of two halothane-anesthetized, paralyzed and two awake, behaving cats. In both models, extracellular recordings were made from the CN during static and dynamic visual stimulation. The anesthesia was maintained during the recordings by a gaseous mixture of air and halothane (1.0%). The behaving animals were trained to perform a visual fixation task. Based on their electrophysiological properties, the recorded CN neurons were separated into three different classes: phasically active (PANs), high firing (HFNs), and tonically active (TANs) neurons. Halothane anesthesia significantly decreased the background activity of the CN neurons in all three classes. The anesthesia had the most remarkable suppressive effect on PANs, where the background activity was consistently under 1 spike/s. The analysis of these responses was almost impossible due to the extremely low activity. The evoked responses during both static and dynamic visual stimulation were obvious in the behaving cats. On the other hand, only weak visual responses were found in some neurons of halothane anesthetized cats. These results show that halothane gas anesthesia has a marked suppressive effect on the feline CN. We suggest that for the purposes of the visual and related multisensory/sensorimotor electrophysiological exploration of the CN, behaving animal models are preferable over anesthetized ones.

Learning new sequential stepping patterns requires striatal plasticity during the earliest phase of acquisition

Animals including humans execute motor behavior to reach their goals. For this purpose, they must choose correct strategies according to environmental conditions and shape many parameters of their movements, including their serial order and timing. To investigate the neurobiology underlying such skills, we used a multi-sensor equipped, motor-driven running wheel with adjustable sequences of foothold pegs on which mice ran to obtain water reward. When the peg patterns changed from a familiar pattern to a new pattern, the mice had to learn and implement new locomotor strategies in order to receive reward. We found that the accuracy of stepping and the achievement of water reward improved with the new learning after changes in the peg-pattern, and c-Fos expression levels assayed after the first post-switch session were high in both dorsolateral striatum and motor cortex, relative to post-switch plateau levels. Combined in situ hybridization and immunohistochemistry of striatal sections demonstrated that both enkephalin-positive (indirect pathway) neurons and substance P-positive (direct pathway) neurons were recruited specifically after the pattern switches, as were interneurons expressing neuronal nitric oxide synthase. When we blocked N-methyl-D-aspartate (NMDA) receptors in the dorsolateral striatum by injecting the NMDA receptor antagonist, D-2-amino-5-phosphonopentanoic acid (AP5), we found delays in early post-switch improvement in performance. These findings suggest that the dorsolateral striatum is activated on detecting shifts in environment to adapt motor behavior to the new context via NMDA-dependent plasticity, and that this plasticity may underlie forming and breaking skills and habits as well as to behavioral difficulties in clinical disorders.

Habit formation

Habits, both good ones and bad ones, are pervasive in animal behavior. Important frameworks have been developed to understand habits through psychological and neurobiological studies. This work has given us a rich understanding of brain networks that promote habits, and has also helped us to understand what constitutes a habitual behavior as opposed to a behavior that is more flexible and prospective. Mounting evidence from studies using neural recording methods suggests that habit formation is not a simple process. We review this evidence and take the position that habits could be sculpted from multiple dissociable changes in neural activity. These changes occur across multiple brain regions and even within single brain regions. This strategy of classifying components of a habit based on different brain signals provides a potentially useful new way to conceive of disorders that involve overly fixed behaviors as arising from different potential dysfunctions within the brain's habit network.

Vicarious trial and error

When rats come to a decision point, they sometimes pause and look back and forth as if deliberating over the choice; at other times, they proceed as if they have already made their decision. In the 1930s, this pause-and-look behaviour was termed 'vicarious trial and error' (VTE), with the implication that the rat was 'thinking about the future'. The discovery in 2007 that the firing of hippocampal place cells gives rise to alternating representations of each of the potential path options in a serial manner during VTE suggested a possible neural mechanism that could underlie the representations of future outcomes. More-recent experiments examining VTE in rats suggest that there are direct parallels to human processes of deliberative decision making, working memory and mental time travel.

Deep Brain Stimulation for Movement Disorders of Basal Ganglia Origin: Restoring Function or Functionality?

Deep brain stimulation (DBS) is highly effective for both hypo- and hyperkinetic movement disorders of basal ganglia origin. The clinical use of DBS is, in part, empiric, based on the experience with prior surgical ablative therapies for these disorders, and, in part, driven by scientific discoveries made decades ago. In this review, we consider anatomical and functional concepts of the basal ganglia relevant to our understanding of DBS mechanisms, as well as our current understanding of the pathophysiology of two of the most commonly DBS-treated conditions, Parkinson's disease and dystonia. Finally, we discuss the proposed mechanism(s) of action of DBS in restoring function in patients with movement disorders. The signs and symptoms of the various disorders appear to result from signature disordered activity in the basal ganglia output, which disrupts the activity in thalamocortical and brainstem networks. The available evidence suggests that the effects of DBS are strongly dependent on targeting sensorimotor portions of specific nodes of the basal ganglia-thalamocortical motor circuit, that is, the subthalamic nucleus and the internal segment of the globus pallidus. There is little evidence to suggest that DBS in patients with movement disorders restores normal basal ganglia functions (e.g., their role in movement or reinforcement learning). Instead, it appears that high-frequency DBS replaces the abnormal basal ganglia output with a more tolerable pattern, which helps to restore the functionality of downstream networks.

Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum

Evaluating outcomes of behavior is a central function of the striatum. In circuits engaging the dorsomedial striatum, sensitivity to goal value is accentuated during learning, whereas outcome sensitivity is thought to be minimal in the dorsolateral striatum and its habit-related corticostriatal circuits. However, a distinct population of projection neurons in the dorsolateral striatum exhibits selective sensitivity to rewards. Here, we evaluated the outcome-related signaling in such neurons as rats performed an instructional T-maze task for two rewards. As the rats formed maze-running habits and then changed behavior after reward devaluation, we detected outcome-related spike activity in 116 units out of 1,479 recorded units. During initial training, nearly equal numbers of these units fired preferentially either after rewarded runs or after unrewarded runs, and the majority were responsive at only one of two reward locations. With overtraining, as habits formed, firing in nonrewarded trials almost disappeared, and reward-specific firing declined. Thus error-related signaling was lost, and reward signaling became generalized. Following reward devaluation, in an extinction test, postgoal activity was nearly undetectable, despite accurate running. Strikingly, when rewards were then returned, postgoal activity reappeared and recapitulated the original early response pattern, with nearly equal numbers responding to rewarded and unrewarded runs and to single rewards. These findings demonstrate that outcome evaluation in the dorsolateral striatum is highly plastic and tracks stages of behavioral exploration and exploitation. These signals could be a new target for understanding compulsive behaviors that involve changes to dorsal striatum function.

Activity of Caudate Nucleus Neurons in a Visual Fixation Paradigm in Behaving Cats

Beside its motor functions, the caudate nucleus (CN), the main input structure of the basal ganglia, is also sensitive to various sensory modalities. The goal of the present study was to investigate the effects of visual stimulation on the CN by using a behaving, head-restrained, eye movement-controlled feline model developed recently for this purpose. Extracellular multielectrode recordings were made from the CN of two cats in a visual fixation paradigm applying static and dynamic stimuli. The recorded neurons were classified in three groups according to their electrophysiological properties: phasically active (PAN), tonically active (TAN) and high-firing (HFN) neurons. The response characteristics were investigated according to this classification. The PAN and TAN neurons were sensitive primarily to static stimuli, while the HFN neurons responded primarily to changes in the visual environment i.e. to optic flow and the offset of the stimuli. The HFNs were the most sensitive to visual stimulation; their responses were stronger than those of the PANs and TANs. The majority of the recorded units were insensitive to the direction of the optic flow, regardless of group, but a small number of direction-sensitive neurons were also found. Our results demonstrate that both the static and the dynamic components of the visual information are represented in the CN. Furthermore, these results provide the first piece of evidence on optic flow processing in the CN, which, in more general terms, indicates the possible role of this structure in dynamic visual information processing.

The striatum: where skills and habits meet

After more than a century of work concentrating on the motor functions of the basal ganglia, new ideas have emerged, suggesting that the basal ganglia also have major functions in relation to learning habits and acquiring motor skills. We review the evidence supporting the role of the striatum in optimizing behavior by refining action selection and in shaping habits and skills as a modulator of motor repertoires. These findings challenge the notion that striatal learning processes are limited to the motor domain. The learning mechanisms supported by striatal circuitry generalize to other domains, including cognitive skills and emotion-related patterns of action.

Posttetanic enhancement of striato-pallidal synaptic transmission

The striato (Str)-globus pallidus external segment (GPe) projection plays major roles in the control of neuronal activity in the basal ganglia under both normal and pathological conditions. The present study used rat brain slice preparations to characterize the enhancement of Str-GPe synapses observed after repetitive conditioning stimuli (CS) of Str with the whole cell patch-clamp recording technique. The results show that 1) the Str-GPe synapses have a posttetanic enhancement (PTE) mechanism, which is considered to be a combination of an augmentation and a posttetanic potentiation; 2) the degree of PTE observed in GPe neurons had a wide range and was positively correlated with a wide range of paired-pulse ratios assessed before application of CS; 3) a wide range of CS, from frequencies as low as 2 Hz with as few as 5 pulses to as high as 100 Hz with 100 pulses, could induce PTE; 4) the decay time constant of PTE was dependent on the strength of CS and was prolonged greatly, up to 120 s, when strong CS were applied; and 5) the level of postsynaptic Cl(-) became a limiting factor for the degree of PTE when strong CS were applied. These results imply that Str-GPe synapses transmit inhibitions in a nonlinear activity-weighted manner, which may be suited for scaling timing and force of repeated or sequential body movements. Other possible factors controlling the induction of PTE and functional implications are also discussed.

Neurons in the ventral striatum exhibit cell-type-specific representations of outcome during learning

The ventromedial striatum (VMS) is a node in circuits underpinning both affect and reinforcement learning. The cellular bases of these functions and especially their potential linkages have been unclear. VMS cholinergic interneurons, however, have been singled out as being related both to affect and to reinforcement-based conditioning, raising the possibility that unique aspects of their signaling could account for these functions. Here we show that VMS tonically active neurons (TANs), including putative cholinergic interneurons, generate unique bidirectional outcome responses during reward-based learning, reporting both positive (reward) and negative (reward omission) outcomes when behavioral change is prompted by switches in reinforcement contingencies. VMS output neurons (SPNs), by contrast, are nearly insensitive to switches in reinforcement contingencies, gradually losing outcome signaling while maintaining responses at trial initiation and goal approach. Thus, TANs and SPNs in the VMS provide distinct signals optimized for different aspects of the learning process.

Investigating habits: strategies, technologies and models

Understanding habits at a biological level requires a combination of behavioral observations and measures of ongoing neural activity. Theoretical frameworks as well as definitions of habitual behaviors emerging from classic behavioral research have been enriched by new approaches taking account of the identification of brain regions and circuits related to habitual behavior. Together, this combination of experimental and theoretical work has provided key insights into how brain circuits underlying action-learning and action-selection are organized, and how a balance between behavioral flexibility and fixity is achieved. New methods to monitor and manipulate neural activity in real time are allowing us to have a first look “under the hood” of a habit as it is formed and expressed. Here we discuss ideas emerging from such approaches. We pay special attention to the unexpected findings that have arisen from our own experiments suggesting that habitual behaviors likely require the simultaneous activity of multiple distinct components, or operators, seen as responsible for the contrasting dynamics of neural activity in both cortico-limbic and sensorimotor circuits recorded concurrently during different stages of habit learning. The neural dynamics identified thus far do not fully meet expectations derived from traditional models of the structure of habits, and the behavioral measures of habits that we have made also are not fully aligned with these models. We explore these new clues as opportunities to refine an understanding of habits.

A dual operator view of habitual behavior reflecting cortical and striatal dynamics

Habits are notoriously difficult to break and, if broken, are usually replaced by new routines. To examine the neural basis of these characteristics, we recorded spike activity in cortical and striatal habit sites as rats learned maze tasks. Overtraining induced a shift from purposeful to habitual behavior. This shift coincided with the activation of neuronal ensembles in the infralimbic neocortex and the sensorimotor striatum, which became engaged simultaneously but developed changes in spike activity with distinct time courses and stability. The striatum rapidly acquired an action-bracketing activity pattern insensitive to reward devaluation but sensitive to running automaticity. A similar pattern developed in the upper layers of the infralimbic cortex, but it formed only late during overtraining and closely tracked habit states. Selective optogenetic disruption of infralimbic activity during overtraining prevented habit formation. We suggest that learning-related spiking dynamics of both striatum and neocortex are necessary, as dual operators, for habit crystallization.

Optogenetic stimulation of lateral orbitofronto-striatal pathway suppresses compulsive behaviors

Dysfunctions in frontostriatal brain circuits have been implicated in neuropsychiatric disorders, including those characterized by the presence of repetitive behaviors. We developed an optogenetic approach to block repetitive, compulsive behavior in a mouse model in which deletion of the synaptic scaffolding gene, Sapap3, results in excessive grooming. With a delay-conditioning task, we identified in the mutants a selective deficit in behavioral response inhibition and found this to be associated with defective down-regulation of striatal projection neuron activity. Focused optogenetic stimulation of the lateral orbitofrontal cortex and its terminals in the striatum restored the behavioral response inhibition, restored the defective down-regulation, and compensated for impaired fast-spiking neuron striatal microcircuits. These findings raise promising potential for the design of targeted therapy for disorders involving excessive repetitive behavior.

Many hats: intratrial and reward level-dependent BOLD activity in the striatum and premotor cortex

Human functional magnetic resonance imaging (fMRI) studies, as well as lesion, drug, and single-cell recording studies in animals, suggest that the striatum plays a key role in associating sensory events with rewarding actions, both by facilitating reward processing and prediction (i.e., reinforcement learning) and by biasing and later updating action selection. Previous human neuroimaging research has failed to dissociate striatal activity associated with reward, stimulus, and response processing, and previous electrophysiological research in nonhuman animals has typically only examined single striatal subregions. Overcoming both these limitations, we isolated blood oxygen level-dependent (BOLD) signal associated with four intratrial processes (stimulus, preparation of response, response, and feedback) in a visuomotor learning task and examined activity associated with each within four striatal subregions (ventral striatum, putamen, head of the caudate nucleus, and body of the caudate) and the lateral premotor cortex. Overall, the striatum and lateral premotor cortex were recruited during all trial components, confirming their importance in all aspects of visuomotor learning. However, the caudate was most active at stimulus and feedback, whereas the putamen peaked in activity at response. Activation in the lateral premotor cortex was, surprisingly, strongest during stimulus and following response as feedback approached. Activity was additionally examined at three reward magnitudes. Reward magnitude affected neural activity only during stimulus in the caudate, putamen, and premotor cortex, whereas the ventral striatum showed reward sensitivity during both stimulus and feedback. Collectively, these results indicate that each striatal region makes a unique contribution to visuomotor learning through functions performed at different points within single trials.

Using optogenetics to study habits

It is now well documented that optogenetics brings to neuroscience a long sought-after foothold to study the causal role of millisecond-scale activity of genetically or anatomically defined populations of neurons. Progress is rapid, and, as evidenced by the work collected in this Special Issue, the possibilities of what can now be done are almost dizzying. Even for those concerned with complex phenomena, such as behavioral habits and flexibility, signs are that we could be on the threshold of a leap in scientific understanding. Here. we note this special time in neuroscience by the example of our use of optogenetics to study habitual behavior. We present a basic sketch of the neural circuitry of habitual behavior built mainly on findings from experiments in which lesion and drug microinjection techniques were employed in combination with sophisticated behavioral analysis. We then outline the types of questions that now can be approached through the use of optogenetic approaches, and, as an example, we summarize the results of a recent study of ours in which we took this approach to probe the neural basis of habit formation. With optogenetic methods, we were able to demonstrate that a small site in the medial prefrontal cortex can control habits on-line during their execution, and we were able to control new habits when they competed with prior ones. The nearly immediate effect of disabling this site optogenetically suggests the existence of a mechanism for moment-to-moment monitoring of behaviors that long have been thought to be almost automatic and reflexive. This example highlights the kind of new knowledge that can be gained by the carefully timed use of optogenetic tools. This article is part of a Special Issue entitled Optogenetics (7th BRES).

Selective effects of dopamine depletion and L-DOPA therapy on learning-related firing dynamics of striatal neurons

Despite evidence that dopamine neurotransmission in the striatum is critical for learning as well as for movement control, little is yet known about how the learning-related dynamics of striatal activity are affected by dopamine depletion, a condition faced in Parkinson's disease. We made localized intrastriatal 6-hydroxydopamine lesions in rats and recorded within the dopamine-depleted sensorimotor striatal zone and its contralateral correspondent as the animals learned a conditional maze task. Rather than producing global, nonspecific elevations in firing rate across the task, the dopamine depletion altered striatal projection neuron activity and fast-spiking interneuron activity selectively, with sharply task-specific and cell type-specific effects, and often, with learning-stage selective effects as well. Striatal projection neurons with strong responses during the maze runs had especially elevated responsiveness during the maze runs. Projection neurons that, instead, fired most strongly before maze running showed elevated pre-start firing rates, but not during maze running, as learning progressed. The intrastriatal dopamine depletion severely affected the learning-related patterning of fast-spiking interneuron ensembles, especially during maze running and after extended training. Remarkably, L-DOPA treatment almost entirely reversed the depletion-induced elevations in pre-run firing of the projection neurons, and elevated their responses around start and end of maze runs. By contrast, L-DOPA failed to normalize fast-spiking interneuron activity. Thus the effects of striatal dopamine depletion and restoration on striatal activity are highly dependent not only on cell type, as previously shown, but also on the behavioral activity called for and the state of behavioral learning achieved.

Optimal balance of the striatal medium spiny neuron network

Slowly varying activity in the striatum, the main Basal Ganglia input structure, is important for the learning and execution of movement sequences. Striatal medium spiny neurons (MSNs) form cell assemblies whose population firing rates vary coherently on slow behaviourally relevant timescales. It has been shown that such activity emerges in a model of a local MSN network but only at realistic connectivities of 10 ~ 20% and only when MSN generated inhibitory post-synaptic potentials (IPSPs) are realistically sized. Here we suggest a reason for this. We investigate how MSN network generated population activity interacts with temporally varying cortical driving activity, as would occur in a behavioural task. We find that at unrealistically high connectivity a stable winners-take-all type regime is found where network activity separates into fixed stimulus dependent regularly firing and quiescent components. In this regime only a small number of population firing rate components interact with cortical stimulus variations. Around 15% connectivity a transition to a more dynamically active regime occurs where all cells constantly switch between activity and quiescence. In this low connectivity regime, MSN population components wander randomly and here too are independent of variations in cortical driving. Only in the transition regime do weak changes in cortical driving interact with many population components so that sequential cell assemblies are reproducibly activated for many hundreds of milliseconds after stimulus onset and peri-stimulus time histograms display strong stimulus and temporal specificity. We show that, remarkably, this activity is maximized at striatally realistic connectivities and IPSP sizes. Thus, we suggest the local MSN network has optimal characteristics - it is neither too stable to respond in a dynamically complex temporally extended way to cortical variations, nor is it too unstable to respond in a consistent repeatable way. Rather, it is optimized to generate stimulus dependent activity patterns for long periods after variations in cortical excitation.

Distributed representations of rule identity and rule order in human frontal cortex and striatum

Humans are able to flexibly devise and implement rules to reach their desired goals. For simple situations, we can use single rules, such as "if traffic light is green then cross the street." In most cases, however, more complex rule sets are required, involving the integration of multiple layers of control. Although it has been shown that prefrontal cortex is important for rule representation, it has remained unclear how the brain encodes more complex rule sets. Here, we investigate how the brain represents the order in which different parts of a rule set are evaluated. Participants had to follow compound rule sets that involved the concurrent application of two single rules in a specific order, where one of the rules always had to be evaluated first. The rules and their assigned order were independently manipulated. By applying multivariate decoding to fMRI data, we found that the identity of the current rule was encoded in a frontostriatal network involving right ventrolateral prefrontal cortex, right superior frontal gyrus, and dorsal striatum. In contrast, rule order could be decoded in the dorsal striatum and in the right premotor cortex. The nonhomogeneous distribution of information across brain areas was confirmed by follow-up analyses focused on relevant regions of interest. We argue that the brain encodes complex rule sets by "decomposing" them in their constituent features, which are represented in different brain areas, according to the aspect of information to be maintained.

Habits, action sequences and reinforcement learning

It is now widely accepted that instrumental actions can be either goal-directed or habitual; whereas the former are rapidly acquired and regulated by their outcome, the latter are reflexive, elicited by antecedent stimuli rather than their consequences. Model-based reinforcement learning (RL) provides an elegant description of goal-directed action. Through exposure to states, actions and rewards, the agent rapidly constructs a model of the world and can choose an appropriate action based on quite abstract changes in environmental and evaluative demands. This model is powerful but has a problem explaining the development of habitual actions. To account for habits, theorists have argued that another action controller is required, called model-free RL, that does not form a model of the world but rather caches action values within states allowing a state to select an action based on its reward history rather than its consequences. Nevertheless, there are persistent problems with important predictions from the model; most notably the failure of model-free RL correctly to predict the insensitivity of habitual actions to changes in the action-reward contingency. Here, we suggest that introducing model-free RL in instrumental conditioning is unnecessary, and demonstrate that reconceptualizing habits as action sequences allows model-based RL to be applied to both goal-directed and habitual actions in a manner consistent with what real animals do. This approach has significant implications for the way habits are currently investigated and generates new experimental predictions.

Striatum-dependent habits are insensitive to both increases and decreases in reinforcer value in mice

The mouse has emerged as an advantageous species for studying the brain circuitry that underlies complex behavior and for modeling neuropsychiatric disease. The transition from flexible, goal-directed actions to inflexible, habitual responses is argued to be a valid and reliable behavioral model for studying a core aspect of corticostriatal systems that is implicated in certain forms of psychopathology. This transition is thought to correspond to a progression of behavioral control from associative to sensorimotor corticobasal ganglia networks. Habits form following extensive training and are characterized by reduced sensitivity of instrumental responding to reinforcer revaluation; few studies have examined this form of behavioral control in mice. Here we examined the involvement of the dorsolateral and dorsomedial striatum in this transition in the C57BL/6 inbred mouse strain. We provided evidence that damage to the dorsolateral striatum disrupted habitual responding, i.e. it preserved sensitivity to changes in outcome value following either outcome devaluation or, shown for the first time in mice, outcome inflation. Together, these data show that instrumental responding in lesioned mice tracks the current value of a reinforcer and provide evidence that neuroanatomical mechanisms underlying habit learning in rats are preserved in the mouse. This will allow for the genetic and molecular dissection of neural factors involved in decision-making and mechanisms of aberrant habit formation.

Short-term plasticity shapes activity pattern-dependent striato-pallidal synaptic transmission

The cortico-striato (Str)-globus pallidus external segment (GPe) projection plays major roles in the control of neuronal activity in the basal ganglia under both normal and pathological conditions. The present study used rat brain-slice preparations to address our hypothesis that the gain of this disynaptic projection is dynamically controlled by activations of short-term plasticity mechanisms of Str-GPe synapses. The Str-GPe projection neurons fire with very different frequency and firing patterns in vivo depending on the condition of the animal. The results show that the Str-GPe synapses have very strong short-term enhancement mechanisms and that repetitive burst activation of the Str-GPe synapses, which mimic oscillatory burst firing of Str neurons, can sustain enhanced states of synaptic transmission for tens of seconds. The results reveal that the short-term enhancement of Str-GPe synapses contributes to the generation of pauses in the firing of GPe neurons and that signal transfer function in the Str-GPe projection is highly dependent on the firing pattern of Str neurons.

Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value

In changing environments, animals must adaptively select actions to achieve their goals. In tasks involving goal-directed action selection, striatal neural activity has been shown to represent the value of competing actions. Striatal representations of action value could potentially bias responses toward actions of higher value. However, no study to date has demonstrated the direct effect of distinct striatal pathways in goal-directed action selection. We found that transient optogenetic stimulation of dorsal striatal dopamine D1 and D2 receptor-expressing neurons during decision-making in mice introduced opposing biases in the distribution of choices. The effect of stimulation on choice was dependent on recent reward history and mimicked an additive change in the action value. Although stimulation before and during movement initiation produced a robust bias in choice behavior, this bias was substantially diminished when stimulation was delayed after response initiation. Together, our data suggest that striatal activity is involved in goal-directed action selection.

Input dependent cell assembly dynamics in a model of the striatal medium spiny neuron network

The striatal medium spiny neuron (MSN) network is sparsely connected with fairly weak GABAergic collaterals receiving an excitatory glutamatergic cortical projection. Peri-stimulus time histograms (PSTH) of MSN population response investigated in various experimental studies display strong firing rate modulations distributed throughout behavioral task epochs. In previous work we have shown by numerical simulation that sparse random networks of inhibitory spiking neurons with characteristics appropriate for UP state MSNs form cell assemblies which fire together coherently in sequences on long behaviorally relevant timescales when the network receives a fixed pattern of constant input excitation. Here we first extend that model to the case where cortical excitation is composed of many independent noisy Poisson processes and demonstrate that cell assembly dynamics is still observed when the input is sufficiently weak. However if cortical excitation strength is increased more regularly firing and completely quiescent cells are found, which depend on the cortical stimulation. Subsequently we further extend previous work to consider what happens when the excitatory input varies as it would when the animal is engaged in behavior. We investigate how sudden switches in excitation interact with network generated patterned activity. We show that sequences of cell assembly activations can be locked to the excitatory input sequence and outline the range of parameters where this behavior is shown. Model cell population PSTH display both stimulus and temporal specificity, with large population firing rate modulations locked to elapsed time from task events. Thus the random network can generate a large diversity of temporally evolving stimulus dependent responses even though the input is fixed between switches. We suggest the MSN network is well suited to the generation of such slow coherent task dependent response which could be utilized by the animal in behavior.

Cell type–specific channelrhodopsin-2 transgenic mice for optogenetic dissection of neural circuitry function

Optogenetic methods have emerged as powerful tools for dissecting neural circuit connectivity, function and dysfunction. We used a bacterial artificial chromosome (BAC) transgenic strategy to express the H134R variant of channelrhodopsin-2, ChR2(H134R), under the control of cell type–specific promoter elements. We performed an extensive functional characterization of the newly established VGAT-ChR2(H134R)-EYFP, ChAT-ChR2(H134R)-EYFP, Tph2-ChR2(H134R)-EYFP and Pvalb(H134R)-ChR2-EYFP BAC transgenic mouse lines and demonstrate the utility of these lines for precisely controlling action-potential firing of GABAergic, cholinergic, serotonergic and parvalbumin-expressing neuron subsets using blue light. This resource of cell type–specific ChR2(H134R) mouse lines will facilitate the precise mapping of neuronal connectivity and the dissection of the neural basis of behavior.

Neural systems analysis of decision making during goal-directed navigation

The ability to make adaptive decisions during goal-directed navigation is a fundamental and highly evolved behavior that requires continual coordination of perceptions, learning and memory processes, and the planning of behaviors. Here, a neurobiological account for such coordination is provided by integrating current literatures on spatial context analysis and decision-making. This integration includes discussions of our current understanding of the role of the hippocampal system in experience-dependent navigation, how hippocampal information comes to impact midbrain and striatal decision making systems, and finally the role of the striatum in the implementation of behaviors based on recent decisions. These discussions extend across cellular to neural systems levels of analysis. Not only are key findings described, but also fundamental organizing principles within and across neural systems, as well as between neural systems functions and behavior, are emphasized. It is suggested that studying decision making during goal-directed navigation is a powerful model for studying interactive brain systems and their mediation of complex behaviors.

Robust transient dynamics and brain functions

In the last few decades several concepts of dynamical systems theory (DST) have guided psychologists, cognitive scientists, and neuroscientists to rethink about sensory motor behavior and embodied cognition. A critical step in the progress of DST application to the brain (supported by modern methods of brain imaging and multi-electrode recording techniques) has been the transfer of its initial success in motor behavior to mental function, i.e., perception, emotion, and cognition. Open questions from research in genetics, ecology, brain sciences, etc., have changed DST itself and lead to the discovery of a new dynamical phenomenon, i.e., reproducible and robust transients that are at the same time sensitive to informational signals. The goal of this review is to describe a new mathematical framework - heteroclinic sequential dynamics - to understand self-organized activity in the brain that can explain certain aspects of robust itinerant behavior. Specifically, we discuss a hierarchy of coarse-grain models of mental dynamics in the form of kinetic equations of modes. These modes compete for resources at three levels: (i) within the same modality, (ii) among different modalities from the same family (like perception), and (iii) among modalities from different families (like emotion and cognition). The analysis of the conditions for robustness, i.e., the structural stability of transient (sequential) dynamics, give us the possibility to explain phenomena like the finite capacity of our sequential working memory - a vital cognitive function -, and to find specific dynamical signatures - different kinds of instabilities - of several brain functions and mental diseases.

A novel instrumented multipeg running wheel system, Step-Wheel, for monitoring and controlling complex sequential stepping in mice

Motor control is critical in daily life as well as in artistic and athletic performance and thus is the subject of intense interest in neuroscience. Mouse models of movement disorders have proven valuable for many aspects of investigation, but adequate methods for analyzing complex motor control in mouse models have not been fully established. Here, we report the development of a novel running-wheel system that can be used to evoke simple and complex stepping patterns in mice. The stepping patterns are controlled by spatially organized pegs, which serve as footholds that can be arranged in adjustable, ladder-like configurations. The mice run as they drink water from a spout, providing reward, while the wheel turns at a constant speed. The stepping patterns of the mice can thus be controlled not only spatially, but also temporally. A voltage sensor to detect paw touches is attached to each peg, allowing precise registration of footfalls. We show that this device can be used to analyze patterns of complex motor coordination in mice. We further demonstrate that it is possible to measure patterns of neural activity with chronically implanted tetrodes as the mice engage in vigorous running bouts. We suggest that this instrumented multipeg running wheel (which we name the Step-Wheel System) can serve as an important tool in analyzing motor control and motor learning in mice.

Corticostriatal dynamics during learning and performance of a neuroprosthetic task

Corticostriatal dynamics exhibit gross alterations over the course of natural motor learning, yet little is known about the role they play in neuroprosthetic tasks. We therefore investigated interactions between the striatum and primary motor cortex while rats learned to control a brain-machine interface. Striatal firing rates increased greatly from early to late in learning, suggesting that the striatum underlies similar functions in both natural and neuroprosthetic motor learning. In addition, spike-field coherence between neurons in primary motor cortex and local field potentials in the striatum increased greatly in the alpha band in late learning relative to early learning, suggesting the development of functional interactions in corticostriatal networks over the course of learning.

Advance cueing produces enhanced action-boundary patterns of spike activity in the sensorimotor striatum

One of the most characteristic features of habitual behaviors is that they can be evoked by a single cue. In the experiments reported here, we tested for the effects of such advance cueing on the firing patterns of striatal neurons in the sensorimotor striatum. Rats ran in a T-maze with instruction cues about the location of reward given at the start of the runs. This advance cueing about reward produced a highly augmented task-bracketing pattern of activity at the beginning and end of procedural task performance relative to the patterns found previously with midtask cueing. Remarkably, the largest increase in activity early during the T-maze runs was not associated with the instruction cues themselves, the earliest predictors of reward; instead, the highest peak of early activity was associated with the beginning of the motor period of the task. We suggest that the advance cueing, reducing midrun demands for decision making but adding a working-memory load, facilitated chunking of the maze runs as executable scripts anchored to sensorimotor aspects of the task and unencumbered by midtask decision-making demands. Our findings suggest that the acquisition of stronger task-bracketing patterns of striatal activity in the sensorimotor striatum could reflect this enhancement of behavioral chunking. Deficits in such representations of learned sequential behaviors could contribute to motor and cognitive problems in a range of neurological disorders affecting the basal ganglia, including Parkinson's disease.

Neuroanatomical and neurochemical substrates of timing

We all have a sense of time. Yet, there are no sensory receptors specifically dedicated for perceiving time. It is an almost uniquely intangible sensation: we cannot see time in the way that we see color, shape, or even location. So how is time represented in the brain? We explore the neural substrates of metrical representations of time such as duration estimation (explicit timing) or temporal expectation (implicit timing). Basal ganglia (BG), supplementary motor area, cerebellum, and prefrontal cortex have all been linked to the explicit estimation of duration. However, each region may have a functionally discrete role and will be differentially implicated depending upon task context. Among these, the dorsal striatum of the BG and, more specifically, its ascending nigrostriatal dopaminergic pathway seems to be the most crucial of these regions, as shown by converging functional neuroimaging, neuropsychological, and psychopharmacological investigations in humans, as well as lesion and pharmacological studies in animals. Moreover, neuronal firing rates in both striatal and interconnected frontal areas vary as a function of duration, suggesting a neurophysiological mechanism for the representation of time in the brain, with the excitatory-inhibitory balance of interactions among distinct subtypes of striatal neuron serving to fine-tune temporal accuracy and precision.