Mechanisms of action selection and timing in substantia nigra neurons

Unique functional responses differentially map onto genetic subtypes of dopamine neurons

Dopamine neurons are characterized by their response to unexpected rewards, but they also fire during movement and aversive stimuli. Dopamine neuron diversity has been observed based on molecular expression profiles; however, whether different functions map onto such genetic subtypes remains unclear. In this study, we established that three genetic dopamine neuron subtypes within the substantia nigra pars compacta, characterized by the expression of Slc17a6 (Vglut2), Calb1 and Anxa1, each have a unique set of responses to rewards, aversive stimuli and accelerations and decelerations, and these signaling patterns are highly correlated between somas and axons within subtypes. Remarkably, reward responses were almost entirely absent in the Anxa1+ subtype, which instead displayed acceleration-correlated signaling. Our findings establish a connection between functional and genetic dopamine neuron subtypes and demonstrate that molecular expression patterns can serve as a common framework to dissect dopaminergic functions.

Feasibility of dopamine as a vector-valued feedback signal in the basal ganglia

It is well established that midbrain dopaminergic neurons support reinforcement learning (RL) in the basal ganglia by transmitting a reward prediction error (RPE) to the striatum. In particular, different computational models and experiments have shown that a striatum-wide RPE signal can support RL over a small discrete set of actions (e.g., no/no-go, choose left/right). However, there is accumulating evidence that the basal ganglia functions not as a selector between predefined actions but rather as a dynamical system with graded, continuous outputs. To reconcile this view with RL, there is a need to explain how dopamine could support learning of continuous outputs, rather than discrete action values. Inspired by the recent observations that besides RPE, the firing rates of midbrain dopaminergic neurons correlate with motor and cognitive variables, we propose a model in which dopamine signal in the striatum carries a vector-valued error feedback signal (a loss gradient) instead of a homogeneous scalar error (a loss). We implement a local, "three-factor" corticostriatal plasticity rule involving the presynaptic firing rate, a postsynaptic factor, and the unique dopamine concentration perceived by each striatal neuron. With this learning rule, we show that such a vector-valued feedback signal results in an increased capacity to learn a multidimensional series of real-valued outputs. Crucially, we demonstrate that this plasticity rule does not require precise nigrostriatal synapses but remains compatible with experimental observations of random placement of varicosities and diffuse volume transmission of dopamine.

Chronic alcohol exposure alters action control via hyperactive premotor corticostriatal activity

Alcohol use disorder (AUD) alters decision-making control over actions, but disruptions to the responsible neural circuit mechanisms are unclear. Premotor corticostriatal circuits are implicated in balancing goal-directed and habitual control over actions and show disruption in disorders with compulsive, inflexible behaviors, including AUD. However, whether there is a causal link between disrupted premotor activity and altered action control is unknown. Here, we find that mice chronically exposed to alcohol (chronic intermittent ethanol [CIE]) showed impaired ability to use recent action information to guide subsequent actions. Prior CIE exposure resulted in aberrant increases in the calcium activity of premotor cortex (M2) neurons that project to the dorsal medial striatum (M2-DMS) during action control. Chemogenetic reduction of this CIE-induced hyperactivity in M2-DMS neurons rescued goal-directed action control. This suggests a direct, causal relationship between chronic alcohol disruption to premotor circuits and decision-making strategy and provides mechanistic support for targeting activity of human premotor regions as a potential treatment in AUD.

The role of the parafascicular thalamic nucleus in action initiation and steering

The parafascicular (Pf) nucleus of the thalamus has been implicated in arousal and attention, but its contributions to behavior remain poorly characterized. Here, using in vivo and in vitro electrophysiology, optogenetics, and 3D motion capture, we studied the role of the Pf nucleus in behavior using a continuous reward-tracking task in freely moving mice. We found that many Pf neurons precisely represent vector components of velocity, with a strong preference for ipsiversive movements. Their activity usually leads velocity, suggesting that Pf output is critical for self-initiated orienting behavior. To test this hypothesis, we expressed excitatory or inhibitory opsins in VGlut2+ Pf neurons to manipulate neural activity bidirectionally. We found that selective optogenetic stimulation of these neurons consistently produced ipsiversive head turning, whereas inhibition stopped turning and produced downward movements. Taken together, our results suggest that the Pf nucleus can send continuous top-down commands that specify detailed action parameters (e.g., direction and speed of the head), thus providing guidance for orienting and steering during behavior.

Restoring the firing activity of ventral tegmental area neurons by lateral hypothalamic deep brain stimulation following morphine administration in rats: LH DBS and the spiking activity of VTA neurons

We have previously shown that high-frequency deep brain stimulation (DBS) of the lateral hypothalamus (LH) compromises morphine-induced addiction-like behavior in rats. The exact mechanism underlying this effect is not known. Here, we investigated the assumption that DBS in the LH influences the firing activity of neurons in the ventral tegmental area (VTA). To that end, male Wistar rats received morphine (5 mg/kg; s.c.) for three days and underwent extracellular single unit recording under general anesthesia one day later. During the recording, the rats received an intraoperative injection of morphine (5 mg/kg; s.c.) plus DBS in the LH (130 Hz pulse frequency, 150 μA amplitude, and 100 μs pulse width). One group of animals also received preoperative DBS after each morphine injection before the recording. The spiking frequency of VTA neurons was measured at three successive phases: (1) baseline (5-15 min); (2) DBS-on (morphine + DBS for 30 min); and (3) After-DBS (over 30 min after termination of DBS). Results showed that morphine suppressed the firing activity of a large population of non-DA neurons, whereas it activated most DA neurons. Intraoperative DBS reversed morphine suppression of non-DA firing, but did not alter the excitatory effect of morphine on DA neurons firing. With repeated preoperative application of DBS, non-DA neurons returned to the morphine-induced suppressive state, but DA neurons released from the excitatory effect of morphine. It is concluded that the development of morphine reward is associated with a hypoactivity of VTA non-DA neurons and a hyperactivity of DA neurons, and that DBS modulation of the spiking activity may contribute to the blockade of morphine addiction-like behavior.

Orbitofrontal cortex populations are differentially recruited to support actions

The ability to use information from one's prior actions is necessary for decision-making. While orbitofrontal cortex (OFC) has been hypothesized as key for inferences made using cue and value-related information, whether OFC populations contribute to the use of information from volitional actions to guide behavior is not clear. Here, we used a self-paced lever-press hold-down task in which mice infer prior lever-press durations to guide subsequent action performance. We show that the activity of genetically identified lateral OFC (lOFC) subpopulations differentially instantiate current and prior action information during ongoing action execution. Transient state-dependent lOFC circuit disruptions of specified subpopulations reduced the encoding of ongoing press durations but did not disrupt the use of prior action information to guide future action performance. In contrast, a chronic functional loss of lOFC circuit activity resulted in increased reliance on recently executed lever-press durations and impaired contingency reversal, suggesting the recruitment of compensatory mechanisms that resulted in repetitive action control. Our results identify a novel role for lOFC in the integration of action information to guide adaptive behavior.

The Arousal-motor Hypothesis of Dopamine Function: Evidence that Dopamine Facilitates Reward Seeking in Part by Maintaining Arousal

Dopamine facilitates approach to reward via its actions on dopamine receptors in the nucleus accumbens. For example, blocking either D1 or D2 dopamine receptors in the accumbens reduces the proportion of reward-predictive cues to which rats respond with cued approach. Recent evidence indicates that accumbens dopamine also promotes wakefulness and arousal, but the relationship between dopamine's roles in arousal and reward seeking remains unexplored. Here, we show that the ability of systemic or intra-accumbens injections of the D1 antagonist SCH23390 to reduce cued approach to reward depends on the animal's state of arousal. Handling the animal, a manipulation known to increase arousal, was sufficient to reverse the behavioral effects of the antagonist. In addition, SCH23390 reduced spontaneous locomotion and increased time spent in sleep postures, both consistent with reduced arousal, but also increased time spent immobile in postures inconsistent with sleep. In contrast, the ability of the D2 antagonist haloperidol to reduce cued approach was not reversible by handling. Haloperidol reduced spontaneous locomotion but did not increase sleep postures, instead increasing immobility in non-sleep postures. We place these results in the context of the extensive literature on dopamine's contributions to behavior, and propose the arousal-motor hypothesis. This novel synthesis, which proposes that two main functions of dopamine are to promote arousal and facilitate motor behavior, accounts both for our findings and many previous behavioral observations that have led to disparate and conflicting conclusions.

Striatal mechanisms of turning behaviour following unilateral dopamine depletion in mice

Unilateral dopamine (DA) depletion produces ipsiversive turning behaviour, and the injection of DA receptor agonists can produce contraversive turning, but the underlying mechanisms remain unclear. We conducted in vivo recording and pharmacological and optogenetic manipulations to study the role of DA and striatal output in turning behaviour. We used a video-based tracking programme while recording single unit activity in both putative medium spiny projection neurons (MSNs) and fast-spiking interneurons (FSIs) in the dorsal striatum bilaterally. Our results suggest that unilateral DA depletion reduced striatal output from the depleted side, resulting in asymmetric striatal output. Depletion systematically altered activity in both MSNs and FSIs, especially in neurons that increased firing during turning movements. Like D1 agonist SKF 38393, optogenetic stimulation in the depleted striatum increased striatal output and reversed biassed turning. These results suggest that relative striatal outputs from the two cerebral hemispheres determine the direction of turning: Mice turn away from the side of higher striatal output and towards the side of the lower striatal output.

Neural mechanisms underlying the temporal organization of naturalistic animal behavior

Naturalistic animal behavior exhibits a strikingly complex organization in the temporal domain, with variability arising from at least three sources: hierarchical, contextual, and stochastic. What neural mechanisms and computational principles underlie such intricate temporal features? In this review, we provide a critical assessment of the existing behavioral and neurophysiological evidence for these sources of temporal variability in naturalistic behavior. Recent research converges on an emergent mechanistic theory of temporal variability based on attractor neural networks and metastable dynamics, arising via coordinated interactions between mesoscopic neural circuits. We highlight the crucial role played by structural heterogeneities as well as noise from mesoscopic feedback loops in regulating flexible behavior. We assess the shortcomings and missing links in the current theoretical and experimental literature and propose new directions of investigation to fill these gaps.

Information normally considered task-irrelevant drives decision-making and affects premotor circuit recruitment

Decision-making is a continuous and dynamic process with prior experience reflected in and used by the brain to guide adaptive behavior. However, most neurobiological studies constrain behavior and/or analyses to task-related variables, not accounting for the continuous internal and temporal space in which they occur. We show mice rely on information learned through recent and longer-term experience beyond just prior actions and reward - including checking behavior and the passage of time - to guide self-initiated, self-paced, and self-generated actions. These experiences are represented in secondary motor cortex (M2) activity and its projections into dorsal medial striatum (DMS). M2 integrates this information to bias strategy-level decision-making, and DMS projections reflect specific aspects of this recent experience to guide actions. This suggests diverse aspects of experience drive decision-making and its neural representation, and shows premotor corticostriatal circuits are crucial for using selective aspects of experiential information to guide adaptive behavior.

Direct and indirect pathway neurons in ventrolateral striatum differentially regulate licking movement and nigral responses

Drinking behavior in rodents is characterized by stereotyped, rhythmic licking movement, which is regulated by the basal ganglia. It is unclear how direct and indirect pathways control the lick bout and individual spout contact. We find that inactivating D1 and D2 receptor-expressing medium spiny neurons (MSNs) in the ventrolateral striatum (VLS) oppositely alters the number of licks in a bout. D1- and D2-MSNs exhibit different patterns of lick-sequence-related activity and different phases of oscillation time-locked to the lick cycle. On the timescale of a lick cycle, transient inactivation of D1-MSNs during tongue protrusion reduces spout contact probability, whereas transiently inactivating D2-MSNs has no effect. On the timescale of a lick bout, inactivation of D1-MSNs (D2-MSNs) causes rate increase (decrease) in a subset of basal ganglia output neurons that decrease firing during licking. Our results reveal the distinct roles of D1- and D2-MSNs in regulating licking at both coarse and fine timescales.

α-Synuclein Selectively Impairs Motor Sequence Learning and Value Sensitivity: Reversal by the Adenosine A2A Receptor Antagonists

Parkinson's disease (PD) is characterized pathologically by alpha-synuclein (α-Syn) aggregates and clinically by the motor as well as cognitive deficits, including impairments in sequence learning and habit learning. Using intracerebral injection of WT and A53T mutant α-Syn fibrils, we investigate the behavioral mechanism of α-Syn for procedure-learning deficit in PD by critically determining the α-Syn-induced effects on model-based goal-directed behavior, model-free (probability-based) habit learning, and hierarchically organized sequence learning. 1) Contrary to the widely held view of habit-learning deficit in early PD, α-Syn aggregates in the dorsomedial striatum (DMS) and dorsolateral striatum (DLS) did not affect acquisition of habit learning, but selectively impaired goal-directed behavior with reduced value sensitivity. 2) α-Syn in the DLS (but not DMS) and SNc selectively impaired the sequence learning by affecting sequence initiation with the reduced first-step accuracy. 3) Adenosine A2A receptor (A2AR) antagonist KW6002 selectively improved sequence learning by preferentially improving sequence initiation and shift of sequence learning as well as behavioral reactivity. These findings established a casual role of α-Syn in the SN-DLS pathway in sequence-learning deficit and DMS α-Syn in goal-directed behavior deficit and suggest a novel therapeutic strategy to improve sequence-learning deficit in PD with enhanced sequence initiation by A2AR antagonists.

Different Effects of Alcohol Exposure on Action and Outcome-Related Orbitofrontal Cortex Activity

Alcohol dependence can result in long-lasting deficits to decision-making and action control. Neurobiological investigations have identified orbitofrontal cortex (OFC) as important for outcome-related contributions to goal-directed actions during decision-making. Prior work has shown that alcohol dependence induces long-lasting changes to OFC function that persist into protracted withdrawal and disrupts goal-directed control over actions. However, it is unclear whether these changes in function alter representation of action and outcome-related neural activity in OFC. Here, we used the well-validated chronic intermittent ethanol (CIE) exposure and withdrawal procedure to model alcohol dependence in mice and performed in vivo extracellular recordings during an instrumental task in which lever-press actions made for a food outcome. We found alcohol dependence disrupted goal-directed action control and increased OFC activity associated with lever-pressing but decreased OFC activity during outcome-related epochs. The ability to decode outcome-related information, but not action information, from OFC activity following CIE exposure was reduced. Hence, chronic alcohol exposure induced a long-lasting disruption to OFC function such that activity associated with actions was enhanced, but OFC activity contributions to outcome-related information was diminished. This has important implications for hypotheses regarding compulsive and habitual phenotypes observed in addiction.

Basal Ganglia Output Has a Permissive Non-Driving Role in a Signaled Locomotor Action Mediated by the Midbrain

The basal ganglia are important for movement and reinforcement learning. Using mice of either sex, we found that the main basal ganglia GABAergic output in the midbrain, the substantia nigra pars reticulata (SNr), shows movement-related neural activity during the expression of a negatively reinforced signaled locomotor action known as signaled active avoidance; this action involves mice moving away during a warning signal to avoid a threat. In particular, many SNr neurons deactivate during active avoidance responses. However, whether SNr deactivation has an essential role driving or regulating active avoidance responses is unknown. We found that optogenetic excitation of SNr or striatal GABAergic fibers that project to an area in the pedunculopontine tegmentum (PPT) within the midbrain locomotor region abolishes signaled active avoidance responses, while optogenetic inhibition of SNr cells (mimicking the SNr deactivation observed during an active avoidance behavior) serves as an effective conditioned stimulus signal to drive avoidance responses by disinhibiting PPT neurons. However, preclusion of SNr deactivation, or direct inhibition of SNr fibers in the PPT, does not impair the expression of signaled active avoidance, indicating that SNr output does not drive the expression of a signaled locomotor action mediated by the midbrain. Consistent with a permissive regulatory role, SNr output provides information about the state of the ongoing action to downstream structures that mediate the action.SIGNIFICANCE STATEMENT During signaled active avoidance behavior, subjects move away to avoid a threat when directed by an innocuous sensory stimulus. Excitation of GABAergic cells in the substantia nigra pars reticulata (SNr), the main output of the basal ganglia, blocks signaled active avoidance, while inhibition of SNr cells is an effective stimulus to drive active avoidance. Interestingly, many SNr cells inhibit their firing during active avoidance responses, suggesting that SNr inhibition could be driving avoidance responses by disinhibiting downstream areas. However, interfering with the modulation of SNr cells does not impair the behavior. Thus, SNr may regulate the active avoidance movement in downstream areas that mediate the behavior, but does not drive it.

Ventral Tegmental Dopamine Neurons Control the Impulse Vector during Motivated Behavior

The ventral tegmental area (VTA) is a major source of dopamine, especially to the limbic brain regions. Despite decades of research, the function of VTA dopamine neurons remains controversial. Here, using a novel head-fixed behavioral system with five orthogonal force sensors, we show for the first time that the activity of dopamine neurons precisely represents the impulse vector (force exerted over time) generated by the animal. Distinct populations of VTA dopamine neurons contribute to components of the impulse vector in different directions. Optogenetic excitation of these neurons shows a linear relationship between signal injected and impulse generated. Optogenetic inhibition paused force generation or produced force in the backward direction. At the same time, these neurons also regulate the initiation and execution of anticipatory licking. Our results indicate that VTA dopamine controls the magnitude, direction, and duration of force used to move toward or away from any motivationally relevant stimuli.

Opponent regulation of action performance and timing by striatonigral and striatopallidal pathways

The basal ganglia have been implicated in action selection and timing, but the relative contributions of the striatonigral (direct) and striatopallidal (indirect) pathways to these functions remain unclear. We investigated the effects of optogenetic stimulation of D1+ (direct) and A2A+ (indirect) neurons in the ventrolateral striatum in head-fixed mice on a fixed time reinforcement schedule. Direct pathway stimulation initiates licking, whereas indirect pathway stimulation suppresses licking and results in rebound licking after stimulation. Moreover, direct and indirect pathways also play distinct roles in timing. Direct pathway stimulation produced a resetting of the internal timing process, whereas indirect pathway stimulation transiently paused timing, and proportionally delayed the next bout of licking. Our results provide evidence for the continuous and opposing contributions of the direct and indirect pathways in the production and timing of reward-guided behavior.

Activation of the Rostral Intralaminar Thalamus Drives Reinforcement through Striatal Dopamine Release

Glutamatergic projections of the thalamic rostral intralaminar nuclei of the thalamus (rILN) innervate the dorsal striatum (DS) and are implicated in dopamine (DA)-dependent incubation of drug seeking. However, the mechanism by which rILN signaling modulates reward seeking and striatal DA release is unknown. We find that activation of rILN inputs to the DS drives cholinergic interneuron burst-firing behavior and DA D2 receptor-dependent post-burst pauses in cholinergic interneuron firing. In vivo, optogenetic activation of this pathway drives reinforcement in a DA D1 receptor-dependent manner, and chemogenetic suppression of the rILN reduces dopaminergic nigrostriatal terminal activity as measured by fiber photometry. Altogether, these data provide evidence that the rILN activates striatal cholinergic interneurons to enhance the pursuit of reward through local striatal DA release and introduce an additional level of complexity in our understanding of striatal DA signaling.

Cover et al. identify a glutamatergic thalamostriatal pathway that locally elicits striatal dopamine release to drive reward-related behavior in mice.

A Head-Fixation System for Continuous Monitoring of Force Generated During Behavior

Many studies in neuroscience use head-fixed behavioral preparations, which confer a number of advantages, including the ability to limit the behavioral repertoire and use techniques for large-scale monitoring of neural activity. But traditional studies using this approach use extremely limited behavioral measures, in part because it is difficult to detect the subtle movements and postural adjustments that animals naturally exhibit during head fixation. Here we report a new head-fixed setup with analog load cells capable of precisely monitoring the continuous forces exerted by mice. The load cells reveal the dynamic nature of movements generated not only around the time of task-relevant events, such as presentation of stimuli and rewards, but also during periods in between these events, when there is no apparent overt behavior. It generates a new and rich set of behavioral measures that have been neglected in previous experiments. We detail the construction of the system, which can be 3D-printed and assembled at low cost, show behavioral results collected from head-fixed mice, and demonstrate that neural activity can be highly correlated with the subtle, whole-body movements continuously produced during head restraint.

Rats can learn a temporal task in a single session

Fixed interval, peak interval, and temporal bisection procedures have been used to assess cognitive functions and address questions such as how animals perceive, represent, and reproduce time intervals. They have also been extensively used to test the effects of drugs on behavior, and to describe the neural correlates of interval timing. However, those procedures usually require several weeks of training for behavior to stabilize. Here, we investigated a variation of the Differential Reinforcement of Response Duration (DRRD) task with a target time of 1.2 s. We compared three types of training protocols and reported a procedure in which performance by the end of the very first session nearly matches the performance of long-term training. We also showed that the initial distribution of the responses is uni-modal and, as training evolves (and rats improve their performance), a second peak emerges and progressively shifts toward longer times. This one-day training protocol can be used to investigate temporal learning and may be especially useful to electrophysiological and neuropharmacological studies.

Precise Coordination of Three-Dimensional Rotational Kinematics by Ventral Tegmental Area GABAergic Neurons

The ventral tegmental area (VTA) is a midbrain region implicated in a variety of motivated behaviors. However, the function of VTA GABAergic (Vgat+) neurons remains poorly understood. Here, using three-dimensional motion capture, in vivo electrophysiology, calcium imaging, and optogenetics, we demonstrate a novel function of VTAVgat+ neurons. We found three distinct populations of neurons, each representing head angle about a principal axis of rotation: yaw, roll, and pitch. For each axis, opponent cell groups were found that increase firing when the head moves in one direction and decrease firing in the opposite direction. Selective excitation and inhibition of VTAVgat+ neurons generate opposite rotational movements. Thus, VTAVgat+ neurons serve a critical role in the control of rotational kinematics while pursuing a moving target. This general-purpose steering function can guide animals toward desired spatial targets in any motivated behavior.

The Neural Basis of Timing: Distributed Mechanisms for Diverse Functions

Timing is critical to most forms of learning, behavior, and sensory-motor processing. Converging evidence supports the notion that, precisely because of its importance across a wide range of brain functions, timing relies on intrinsic and general properties of neurons and neural circuits; that is, the brain uses its natural cellular and network dynamics to solve a diversity of temporal computations. Many circuits have been shown to encode elapsed time in dynamically changing patterns of neural activity-so-called population clocks. But temporal processing encompasses a wide range of different computations, and just as there are different circuits and mechanisms underlying computations about space, there are a multitude of circuits and mechanisms underlying the ability to tell time and generate temporal patterns.

Neural Circuit and Clinical Insights from Intraoperative Recordings During Deep Brain Stimulation Surgery

Observations using invasive neural recordings from patient populations undergoing neurosurgical interventions have led to critical breakthroughs in our understanding of human neural circuit function and malfunction. The opportunity to interact with patients during neurophysiological mapping allowed for early insights in functional localization to improve surgical outcomes, but has since expanded into exploring fundamental aspects of human cognition including reward processing, language, the storage and retrieval of memory, decision-making, as well as sensory and motor processing. The increasing use of chronic neuromodulation, via deep brain stimulation, for a spectrum of neurological and psychiatric conditions has in tandem led to increased opportunity for linking theories of cognitive processing and neural circuit function. Our purpose here is to motivate the neuroscience and neurosurgical community to capitalize on the opportunities that this next decade will bring. To this end, we will highlight recent studies that have successfully leveraged invasive recordings during deep brain stimulation surgery to advance our understanding of human cognition with an emphasis on reward processing, improving clinical outcomes, and informing advances in neuromodulatory interventions.

A striatal interneuron circuit for continuous target pursuit

Most adaptive behaviors require precise tracking of targets in space. In pursuit behavior with a moving target, mice use distance to target to guide their own movement continuously. Here, we show that in the sensorimotor striatum, parvalbumin-positive fast-spiking interneurons (FSIs) can represent the distance between self and target during pursuit behavior, while striatal projection neurons (SPNs), which receive FSI projections, can represent self-velocity. FSIs are shown to regulate velocity-related SPN activity during pursuit, so that movement velocity is continuously modulated by distance to target. Moreover, bidirectional manipulation of FSI activity can selectively disrupt performance by increasing or decreasing the self-target distance. Our results reveal a key role of the FSI-SPN interneuron circuit in pursuit behavior and elucidate how this circuit implements distance to velocity transformation required for the critical underlying computation.

Many natural behaviours involve tracking of a target in space. Here, the authors describe a task to assess this behaviour in mice and use in vivo electrophysiology, calcium imaging, optogenetics, and chemogenetics to investigate the role of the striatum in target pursuit.

The Basal Ganglia in Action

The basal ganglia (BG) are the major subcortical nuclei in the brain. Disorders implicating the BG are characterized by diverse symptoms, but it remains unclear what these symptoms have in common or how they can be explained by changes in the BG circuits. This review summarizes recent findings that not only question traditional assumptions about the role of the BG in movement but also elucidate general computations performed by these circuits. To explain these findings, a new conceptual framework is introduced for understanding the role of the BG in behavior. According to this framework, the cortico-BG networks implement transition control in an extended hierarchy of closed loop negative feedback control systems. The transition control model provides a solution to the posture/movement problem, by postulating that BG outputs send descending signals to alter the reference states of downstream position control systems for orientation and body configuration. It also explains major neurological symptoms associated with BG pathology as a result of changes in system parameters such as multiplicative gain and damping.

Parvalbumin Interneurons Modulate Striatal Output and Enhance Performance during Associative Learning

The prevailing view is that striatal parvalbumin (PV)-positive interneurons primarily function to downregulate medium spiny projection neuron (MSN) activity via monosynaptic inhibitory signaling. Here, by combining in vivo neural recordings and optogenetics, we unexpectedly find that both suppressing and over-activating PV cells attenuates spontaneous MSN activity. To account for this, we find that, in addition to monosynaptic coupling, PV-MSN interactions are mediated by a competing disynaptic inhibitory circuit involving a variety of neuropeptide Y-expressing interneurons. Next we use optogenetic and chemogenetic approaches to show that dorsolateral striatal PV interneurons influence the initial expression of reward-conditioned responses but that their contribution to performance declines with experience. Consistent with this, we observe with large-scale recordings in behaving animals that the relative contribution of PV cells on MSN activity diminishes with training. Together, this work provides a possible mechanism by which PV interneurons modulate striatal output and selectively enhance performance early in learning.

The role of opponent basal ganglia outputs in behavior

This review is an attempt to explain the role of basal ganglia (BG) outputs in generating movements. Recent work showed that opponent outputs from the BG represent instantaneous body position coordinates during behavior. On the other hand, projection neurons in the striatum, the major input nucleus, as well as dopaminergic neurons that form the nigrostriatal pathway, can represent movement velocity. To explain these findings, a new model is proposed, in which the BG implement the level of transition control in an extended control hierarchy. BG outputs represent descending reference signals that command diverse lower-level position controllers. This model not only explains major neurological symptoms but also makes quantitative and testable predictions.

Representation of spontaneous movement by dopaminergic neurons is cell-type selective and disrupted in parkinsonism

Midbrain dopaminergic neurons are essential for appropriate voluntary movement, as epitomized by the cardinal motor impairments arising in Parkinson's disease. Understanding the basis of such motor control requires understanding how the firing of different types of dopaminergic neuron relates to movement and how this activity is deciphered in target structures such as the striatum. By recording and labeling individual neurons in behaving mice, we show that the representation of brief spontaneous movements in the firing of identified midbrain dopaminergic neurons is cell-type selective. Most dopaminergic neurons in the substantia nigra pars compacta (SNc), but not in ventral tegmental area or substantia nigra pars lateralis, consistently represented the onset of spontaneous movements with a pause in their firing. Computational modeling revealed that the movement-related firing of these dopaminergic neurons can manifest as rapid and robust fluctuations in striatal dopamine concentration and receptor activity. The exact nature of the movement-related signaling in the striatum depended on the type of dopaminergic neuron providing inputs, the striatal region innervated, and the type of dopamine receptor expressed by striatal neurons. Importantly, in aged mice harboring a genetic burden relevant for human Parkinson's disease, the precise movement-related firing of SNc dopaminergic neurons and the resultant striatal dopamine signaling were lost. These data show that distinct dopaminergic cell types differentially encode spontaneous movement and elucidate how dysregulation of their firing in early Parkinsonism can impair their effector circuits.

Striatonigral control of movement velocity in mice

The basal ganglia have long been implicated in action initiation. Using three-dimensional motion capture, we quantified the effects of optogenetic stimulation of the striatonigral (direct) pathway on movement kinematics. We generated transgenic mice with channelrhodopsin-2 expression in striatal neurons that express the D1-like dopamine receptor. With optic fibres placed in the sensorimotor striatum, an area known to contain movement velocity-related single units, photo-stimulation reliably produced movements that could be precisely quantified with our motion capture programme. A single light pulse was sufficient to elicit movements with short latencies (< 30 ms). Increasing stimulation frequency increased movement speed, with a highly linear relationship. These findings support the hypothesis that the sensorimotor striatum is part of a velocity controller that controls rate of change in body configurations.

Does response inhibition have pre- and postdiagnostic utility in Parkinson's disease?

Parkinson's disease (Pd) is the second most prevalent degenerative neurological condition worldwide. Improving and sustaining quality of life is an important goal for Parkinson's patients. Key areas of focus to achieve this goal include earlier diagnosis and individualized treatment. In this review the authors discuss impulse control in Pd and examine how measures of impulse control from a response inhibition task may provide clinically useful information (a) within an objective test battery to aid earlier diagnosis of Pd and (b) in postdiagnostic Pd, to better identify individuals at risk of developing impulse control disorders with dopaminergic medication.

Luminopsins integrate opto- and chemogenetics by using physical and biological light sources for opsin activation

Luminopsins are fusion proteins of luciferase and opsin that allow interrogation of neuronal circuits at different temporal and spatial resolutions by choosing either extrinsic physical or intrinsic biological light for its activation. Building on previous development of fusions of wild-type Gaussia luciferase with channelrhodopsin, here we expanded the utility of luminopsins by fusing bright Gaussia luciferase variants with either channelrhodopsin to excite neurons (luminescent opsin, LMO) or a proton pump to inhibit neurons (inhibitory LMO, iLMO). These improved LMOs could reliably activate or silence neurons in vitro and in vivo. Expression of the improved LMO in hippocampal circuits not only enabled mapping of synaptic activation of CA1 neurons with fine spatiotemporal resolution but also could drive rhythmic circuit excitation over a large spatiotemporal scale. Furthermore, virus-mediated expression of either LMO or iLMO in the substantia nigra in vivo produced not only the expected bidirectional control of single unit activity but also opposing effects on circling behavior in response to systemic injection of a luciferase substrate. Thus, although preserving the ability to be activated by external light sources, LMOs expand the use of optogenetics by making the same opsins accessible to noninvasive, chemogenetic control, thereby allowing the same probe to manipulate neuronal activity over a range of spatial and temporal scales.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.

Beyond reward prediction errors: the role of dopamine in movement kinematics

We recorded activity of dopamine (DA) neurons in the substantia nigra pars compacta in unrestrained mice while monitoring their movements with video tracking. Our approach allows an unbiased examination of the continuous relationship between single unit activity and behavior. Although DA neurons show characteristic burst firing following cue or reward presentation, as previously reported, their activity can be explained by the representation of actual movement kinematics. Unlike neighboring pars reticulata GABAergic output neurons, which can represent vector components of position, DA neurons represent vector components of velocity or acceleration. We found neurons related to movements in four directions-up, down, left, right. For horizontal movements, there is significant lateralization of neurons: the left nigra contains more rightward neurons, whereas the right nigra contains more leftward neurons. The relationship between DA activity and movement kinematics was found on both appetitive trials using sucrose and aversive trials using air puff, showing that these neurons belong to a velocity control circuit that can be used for any number of purposes, whether to seek reward or to avoid harm. In support of this conclusion, mimicry of the phasic activation of DA neurons with selective optogenetic stimulation could also generate movements. Contrary to the popular hypothesis that DA neurons encode reward prediction errors, our results suggest that nigrostriatal DA plays an essential role in controlling the kinematics of voluntary movements. We hypothesize that DA signaling implements gain adjustment for adaptive transition control, and describe a new model of the basal ganglia (BG) in which DA functions to adjust the gain of the transition controller. This model has significant implications for our understanding of movement disorders implicating DA and the BG.

Basal ganglia outputs map instantaneous position coordinates during behavior

The basal ganglia (BG) are implicated in many movement disorders, yet how they contribute to movement remains unclear. Using wireless in vivo recording, we measured BG output from the substantia nigra pars reticulata (SNr) in mice while monitoring their movements with video tracking. The firing rate of most nigral neurons reflected Cartesian coordinates (either x- or y-coordinates) of the animal's head position during movement. The firing rates of SNr neurons are either positively or negatively correlated with the coordinates. Using an egocentric reference frame, four types of neurons can be classified: each type increases firing during movement in a particular direction (left, right, up, down), and decreases firing during movement in the opposite direction. Given the high correlation between the firing rate and the x and y components of the position vector, the movement trajectory can be reconstructed from neural activity. Our results therefore demonstrate a quantitative and continuous relationship between BG output and behavior. Thus, a steady BG output signal from the SNr (i.e., constant firing rate) is associated with the lack of overt movement, when a stable posture is maintained by structures downstream of the BG. Any change in SNr firing rate is associated with a change in position (i.e., movement). We hypothesize that the SNr output quantitatively determines the direction, velocity, and amplitude of voluntary movements. By changing the reference signals to downstream position control systems, the BG can produce transitions in body configurations and initiate actions.

Reassessing models of basal ganglia function and dysfunction

The basal ganglia are a series of interconnected subcortical nuclei. The function and dysfunction of these nuclei have been studied intensively in motor control, but more recently our knowledge of these functions has broadened to include prominent roles in cognition and affective control. This review summarizes historical models of basal ganglia function, as well as findings supporting or conflicting with these models, while emphasizing recent work in animals and humans directly testing the hypotheses generated by these models.

A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface

A computational model yields new insights into the bewildering complexity of cortico-striatal plasticity and its rationale for supporting operant learning.

Operant learning requires that reinforcement signals interact with action representations at a suitable neural interface. Much evidence suggests that this occurs when phasic dopamine, acting as a reinforcement prediction error, gates plasticity at cortico-striatal synapses, and thereby changes the future likelihood of selecting the action(s) coded by striatal neurons. But this hypothesis faces serious challenges. First, cortico-striatal plasticity is inexplicably complex, depending on spike timing, dopamine level, and dopamine receptor type. Second, there is a credit assignment problem—action selection signals occur long before the consequent dopamine reinforcement signal. Third, the two types of striatal output neuron have apparently opposite effects on action selection. Whether these factors rule out the interface hypothesis and how they interact to produce reinforcement learning is unknown. We present a computational framework that addresses these challenges. We first predict the expected activity changes over an operant task for both types of action-coding striatal neuron, and show they co-operate to promote action selection in learning and compete to promote action suppression in extinction. Separately, we derive a complete model of dopamine and spike-timing dependent cortico-striatal plasticity from in vitro data. We then show this model produces the predicted activity changes necessary for learning and extinction in an operant task, a remarkable convergence of a bottom-up data-driven plasticity model with the top-down behavioural requirements of learning theory. Moreover, we show the complex dependencies of cortico-striatal plasticity are not only sufficient but necessary for learning and extinction. Validating the model, we show it can account for behavioural data describing extinction, renewal, and reacquisition, and replicate in vitro experimental data on cortico-striatal plasticity. By bridging the levels between the single synapse and behaviour, our model shows how striatum acts as the action-reinforcement interface.

A key component of survival is the ability to learn which actions, in what contexts, yield useful and rewarding outcomes. Actions are encoded in the brain in the cortex but, as many actions are possible at any one time, there needs to be a mechanism to select which one is to be performed. This problem of action selection is mediated by a set of nuclei known as the basal ganglia, which receive convergent “action requests” from all over the cortex and select the one that is currently most important. Working out which is most important is determined by the strength of the input from each action request: the stronger the connection, the more important that action. Understanding learning thus requires understanding how that strength is changed by the outcome of each action. We built a computational model that demonstrates how the brain's internal signal for outcome (carried by the neurotransmitter dopamine) changes the strength of these cortical connections to learn the selection of rewarded actions, and the suppression of unrewarded ones. Our model shows how several known signals in the brain work together to shape the influence of cortical inputs to the basal ganglia at the interface between our actions and their outcomes.

Distinct neuronal populations in the basal forebrain encode motivational salience and movement

Basal forebrain (BF) is one of the largest cortically-projecting neuromodulatory systems in the mammalian brain, and plays a key role in attention, arousal, learning and memory. The cortically projecting BF neurons, comprised of mainly magnocellular cholinergic and GABAergic neurons, are widely distributed across several brain regions that spatially overlap with the ventral striatopallidal system at the ventral pallidum (VP). As a first step toward untangling the respective functions of spatially overlapping BF and VP systems, the goal of this study was to comprehensively characterize the behavioral correlates and physiological properties of heterogeneous neuronal populations in the BF region. We found that, while rats performed a reward-biased simple reaction time task, distinct neuronal populations encode either motivational salience or movement information. The motivational salience of attended stimuli is encoded by phasic bursting activity of a large population of slow-firing neurons that have large, broad, and complex action potential waveforms. In contrast, two other separate groups of neurons encode movement-related information, and respectively increase and decrease firing rates while rats maintained fixation. These two groups of neurons mostly have higher firing rates and small, narrow action potential waveforms. These results support the conclusion that multiple neurophysiologically distinct neuronal populations in the BF region operate independently of each other as parallel functional circuits. These observations also caution against interpreting neuronal activity in this region as a homogeneous population reflecting the function of either BF or VP alone. We suggest that salience- and movement-related neuronal populations likely correspond to BF corticopetal neurons and VP neurons, respectively.

Striatal firing rate reflects head movement velocity

Although the basal ganglia have long been implicated in the initiation of actions, their contribution to movement remains a matter of dispute. Using wireless multi-electrode recording and motion tracking, we examined the relationship between single-unit activity in the sensorimotor striatum and movement kinematics. We recorded single-unit activity from medium spiny projection neurons and fast-spiking interneurons while monitoring the movements of mice using motion tracking. In Experiment 1, we trained mice to generate movements reliably by water-depriving them and giving them periodic cued sucrose rewards. We found high correlations between single-unit activity and movement velocity in particular directions. This correlation was found in both putative medium spiny projection neurons and fast-spiking interneurons. In Experiment 2, to rule out the possibility that the observed correlations were due to reward expectancy, we repeated the same procedure but added trials in which sucrose delivery was replaced by an aversive air puff stimulus. The air puff generated avoidance movements that were clearly different from movements on rewarded trials, but the same neurons that showed velocity correlation on reward trials exhibited a similar correlation on air puff trials. These experiments show for the first time that the firing rate of striatal neurons reflects movement velocity for different types of movements, whether to seek rewards or to avoid harm.

The inhibitory microcircuit of the substantia nigra provides feedback gain control of the basal ganglia output

Dysfunction of the basal ganglia produces severe deficits in the timing, initiation, and vigor of movement. These diverse impairments suggest a control system gone awry. In engineered systems, feedback is critical for control. By contrast, models of the basal ganglia highlight feedforward circuitry and ignore intrinsic feedback circuits. In this study, we show that feedback via axon collaterals of substantia nigra projection neurons control the gain of the basal ganglia output. Through a combination of physiology, optogenetics, anatomy, and circuit mapping, we elaborate a general circuit mechanism for gain control in a microcircuit lacking interneurons. Our data suggest that diverse tonic firing rates, weak unitary connections and a spatially diffuse collateral circuit with distinct topography and kinetics from feedforward input is sufficient to implement divisive feedback inhibition. The importance of feedback for engineered systems implies that the intranigral microcircuit, despite its absence from canonical models, could be essential to basal ganglia function. DOI: http://dx.doi.org/10.7554/eLife.02397.001.

The role of the substantia nigra in posture control

Disorders implicating the basal ganglia are often characterized by postural deficits, but little is known about the role of the basal ganglia in posture control. Using wireless multi-electrode recording, we measured single unit activity from GABAergic and dopaminergic neurons in the substantia nigra as unrestrained mice stood on an elevated platform while introducing continuous postural disturbances in the roll plane. We found two major types of neurons - those activated by tilt to the left side of the body and suppressed by tilt to the right side, and others activated by tilt to the right side and suppressed by tilt to the left side. Contrary to the prevailing view that the basal ganglia output from the substantia nigra pars reticulata either inhibits or disinhibits downstream structures in an all or none fashion, we showed that it continuously sends anti-phase signals to their downstream targets. We also demonstrated for the first time that nigrostriatal dopaminergic transmission is modulated by postural disturbances.

Control of basal ganglia output by direct and indirect pathway projection neurons

The direct and indirect efferent pathways from striatum ultimately reconverge to influence basal ganglia output nuclei, which in turn regulate behavior via thalamocortical and brainstem motor circuits. However, the distinct contributions of these two efferent pathways in shaping basal ganglia output are not well understood. We investigated these processes using selective optogenetic control of the direct and indirect pathways, in combination with single-unit recording in the basal ganglia output nucleus substantia nigra pars reticulata (SNr) in mice. Optogenetic activation of striatal direct and indirect pathway projection neurons produced diverse cellular responses in SNr neurons, with stimulation of each pathway eliciting both excitations and inhibitions. Despite this response heterogeneity, the effectiveness of direct pathway stimulation in producing movement initiation correlated selectively with the subpopulation of inhibited SNr neurons. In contrast, effective indirect pathway-mediated motor suppression was most strongly influenced by excited SNr neurons. Our results support the theory that key basal ganglia output neurons serve as an inhibitory gate over motor output that can be opened or closed by striatal direct and indirect pathways, respectively.

Action, time and the basal ganglia

The ability to control the speed of movement is compromised in neurological disorders involving the basal ganglia, a set of subcortical cerebral nuclei that receive prominent dopaminergic projections from the midbrain. For example, bradykinesia, slowness of movement, is a major symptom of Parkinson's disease, whereas rapid tics are observed in patients with Tourette syndrome. Recent experimental work has also implicated dopamine (DA) and the basal ganglia in action timing. Here, I advance the hypothesis that the basal ganglia control the rate of change in kinaesthetic perceptual variables. In particular, the sensorimotor cortico-basal ganglia network implements a feedback circuit for the control of movement velocity. By modulating activity in this network, DA can change the gain of velocity reference signals. The lack of DA thus reduces the output of the velocity control system which specifies the rate of change in body configurations, slowing the transition from one body configuration to another.

Motor thalamus integration of cortical, cerebellar and basal ganglia information: implications for normal and parkinsonian conditions

Motor thalamus (Mthal) is implicated in the control of movement because it is strategically located between motor areas of the cerebral cortex and motor-related subcortical structures, such as the cerebellum and basal ganglia (BG). The role of BG and cerebellum in motor control has been extensively studied but how Mthal processes inputs from these two networks is unclear. Specifically, there is considerable debate about the role of BG inputs on Mthal activity. This review summarizes anatomical and physiological knowledge of the Mthal and its afferents and reviews current theories of Mthal function by discussing the impact of cortical, BG and cerebellar inputs on Mthal activity. One view is that Mthal activity in BG and cerebellar-receiving territories is primarily "driven" by glutamatergic inputs from the cortex or cerebellum, respectively, whereas BG inputs are modulatory and do not strongly determine Mthal activity. This theory is steeped in the assumption that the Mthal processes information in the same way as sensory thalamus, through interactions of modulatory inputs with a single driver input. Another view, from BG models, is that BG exert primary control on the BG-receiving Mthal so it effectively relays information from BG to cortex. We propose a new "super-integrator" theory where each Mthal territory processes multiple driver or driver-like inputs (cortex and BG, cortex and cerebellum), which are the result of considerable integrative processing. Thus, BG and cerebellar Mthal territories assimilate motivational and proprioceptive motor information previously integrated in cortico-BG and cortico-cerebellar networks, respectively, to develop sophisticated motor signals that are transmitted in parallel pathways to cortical areas for optimal generation of motor programmes. Finally, we briefly review the pathophysiological changes that occur in the BG in parkinsonism and generate testable hypotheses about how these may affect processing of inputs in the Mthal.

Bidirectional modulation of substantia nigra activity by motivational state

A major output nucleus of the basal ganglia is the substantia nigra pars reticulata, which sends GABAergic projections to brainstem and thalamic nuclei. The GABAergic (GABA) neurons are reciprocally connected with nearby dopaminergic neurons, which project mainly to the basal ganglia, a set of subcortical nuclei critical for goal-directed behaviors. Here we examined the impact of motivational states on the activity of GABA neurons in the substantia nigra pars reticulata and the neighboring dopaminergic (DA) neurons in the pars compacta. Both types of neurons show short-latency bursts to a cue predicting a food reward. As mice became sated by repeated consumption of food pellets, one class of neurons reduced cue-elicited firing, whereas another class of neurons progressively increased firing. Extinction or pre-feeding just before the test session dramatically reduced the phasic responses and their motivational modulation. These results suggest that signals related to the current motivational state bidirectionally modulate behavior and the magnitude of phasic response of both DA and GABA neurons in the substantia nigra.

Signal enhancement in the output stage of the basal ganglia by synaptic short-term plasticity in the direct, indirect, and hyperdirect pathways

Many of the synapses in the basal ganglia display short-term plasticity. Still, computational models have not yet been used to investigate how this affects signaling. Here we use a model of the basal ganglia network, constrained by available data, to quantitatively investigate how synaptic short-term plasticity affects the substantia nigra reticulata (SNr), the basal ganglia output nucleus. We find that SNr becomes particularly responsive to the characteristic burst-like activity seen in both direct and indirect pathway striatal medium spiny neurons (MSN). As expected by the standard model, direct pathway MSNs are responsible for decreasing the activity in SNr. In particular, our simulations indicate that bursting in only a few percent of the direct pathway MSNs is sufficient for completely inhibiting SNr neuron activity. The standard model also suggests that SNr activity in the indirect pathway is controlled by MSNs disinhibiting the subthalamic nucleus (STN) via the globus pallidus externa (GPe). Our model rather indicates that SNr activity is controlled by the direct GPe-SNr projections. This is partly because GPe strongly inhibits SNr but also due to depressing STN-SNr synapses. Furthermore, depressing GPe-SNr synapses allow the system to become sensitive to irregularly firing GPe subpopulations, as seen in dopamine depleted conditions, even when the GPe mean firing rate does not change. Similar to the direct pathway, simulations indicate that only a few percent of bursting indirect pathway MSNs can significantly increase the activity in SNr. Finally, the model predicts depressing STN-SNr synapses, since such an assumption explains experiments showing that a brief transient activation of the hyperdirect pathway generates a tri-phasic response in SNr, while a sustained STN activation has minor effects. This can be explained if STN-SNr synapses are depressing such that their effects are counteracted by the (known) depressing GPe-SNr inputs.

Operant self-stimulation of dopamine neurons in the substantia nigra

We examined the contribution of the nigrostriatal DA system to instrumental learning and behavior using optogenetics in awake, behaving mice. Using Cre-inducible channelrhodopsin-2 (ChR2) in mice expressing Cre recombinase driven by the tyrosine hydroxylase promoter (Th-Cre), we tested whether selective stimulation of DA neurons in the substantia nigra pars compacta (SNC), in the absence of any natural rewards, was sufficient to promote instrumental learning in naive mice. Mice expressing ChR2 in SNC DA neurons readily learned to press a lever to receive laser stimulation, but unlike natural food rewards the lever pressing did not decline with satiation. When the number of presses required to receive a stimulation was altered, mice adjusted their rate of pressing accordingly, suggesting that the rate of stimulation was a controlled variable. Moreover, extinction, i.e. the cessation of action-contingent stimulation, and the complete reversal of the relationship between action and outcome by the imposition of an omission contingency, rapidly abolished lever pressing. Together these results suggest that selective activation of SNC DA neurons can be sufficient for acquisition and maintenance of a new instrumental action.

Differential roles of ventral pallidum subregions during cocaine self-administration behaviors

The ventral pallidum (VP) is necessary for drug-seeking behavior. VP contains ventromedial (VPvm) and dorsolateral (VPdl) subregions, which receive projections from the nucleus accumbens shell and core, respectively. To date no study has investigated the behavioral functions of the VPdl and VPvm subregions. To address this issue, we investigated whether changes in firing rate (FR) differed between VP subregions during four events: approaching toward, responding on, or retreating away from a cocaine-reinforced operandum and a cocaine-associated cue. Baseline FR and waveform characteristics did not differ between subregions. VPdl neurons exhibited a greater change in FR compared with VPvm neurons during approaches toward, as well as responses on, the cocaine-reinforced operandum. VPdl neurons were more likely to exhibit a similar change in FR (direction and magnitude) during approach and response than VPvm neurons. In contrast, VPvm firing patterns were heterogeneous, changing FRs during approach or response alone, or both. VP neurons did not discriminate cued behaviors from uncued behaviors. No differences were found between subregions during the retreat, and no VP neurons exhibited patterned changes in FR in response to the cocaine-associated cue. The stronger, sustained FR changes of VPdl neurons during approach and response may implicate VPdl in the processing of drug-seeking and drug-taking behavior via projections to subthalamic nucleus and substantia nigra pars reticulata. In contrast, the heterogeneous firing patterns of VPvm neurons may implicate VPvm in facilitating mesocortical structures with information related to the sequence of behaviors predicting cocaine self-infusions via projections to mediodorsal thalamus and ventral tegmental area.

Pain and analgesia: the value of salience circuits

Evaluating external and internal stimuli is critical to survival. Potentially tissue-damaging conditions generate sensory experiences that the organism must respond to in an appropriate, adaptive manner (e.g., withdrawal from the noxious stimulus, if possible, or seeking relief from pain and discomfort). The importance we assign to a signal generated by a noxious state, its salience, reflects our belief as to how likely the underlying situation is to impact our chance of survival. Importantly, it has been hypothesized that aberrant functioning of the brain circuits which assign salience values to stimuli may contribute to chronic pain. We describe examples of this phenomenon, including 'feeling pain' in the absence of a painful stimulus, reporting minimal pain in the setting of major trauma, having an 'analgesic' response in the absence of an active treatment, or reporting no pain relief after administration of a potent analgesic medication, which may provide critical insights into the role that salience circuits play in contributing to numerous conditions characterized by persistent pain. Collectively, a refined understanding of abnormal activity or connectivity of elements within the salience network may allow us to more effectively target interventions to relevant components of this network in patients with chronic pain.

Neural signals of extinction in the inhibitory microcircuit of the ventral midbrain

Midbrain dopaminergic (DA) neurons are thought to guide learning via phasic elevations of firing in response to reward predicting stimuli. The circuit mechanism for these signals remains unclear. Using extracellular recording during associative learning we show that inhibitory neurons in the ventral midbrain of mice respond to salient auditory stimuli with a burst of activity that occurs prior to the onset of the phasic response of DA neurons. This population of inhibitory neurons exhibited enhanced responses during extinction and was anti correlated with the phasic response of simultaneously recorded DA neurons. Optogenetic stimulation suggested that this population was in part derived from inhibitory projection neurons of the substantia nigra that provide a robust monosynaptic inhibition of DA neurons. Our results thus elaborate upon the dynamic upstream circuits that shape the phasic activity of DA neurons and suggest that the inhibitory microcircuit of the midbrain is critical for new learning in extinction.