Bidirectional modulation of substantia nigra activity by motivational state

Characterization of striatal dopamine projections across striatal subregions in behavioral flexibility

Behavioural flexibility is key to survival in a dynamic environmentWhile flexible, goal-directed behaviours are initially dependent on dorsomedial striatum, they become dependent on lateral striatum as behaviours become inflexible. Similarly, lesions of dopamine terminals in lateral striatum disrupt the development of inflexible habits. This work suggests that dopamine release in lateral striatum may drive inflexible behaviours, though few studies have investigated a causative role of subpopulations of striatal dopamine terminals in reversal learning, a measure of flexibility. Here, we performed two optogenetic experiments to activate dopamine terminals in dorsomedial (DMS), dorsolateral (DLS) or ventral (nucleus accumbens [NAc]) striatum in DAT-Cre mice that expressed channelrhodopsin-2 via viral injection (Experiment I) or through transgenic breeding with an Ai32 reporter line (Experiment II) to determine how specific dopamine subpopulations impact reversal learning. Mice performed a reversal task in which they self-stimulated DMS, DLS, or NAc dopamine terminals by pressing one of two levers before action-outcome lever contingencies were reversed. Largely consistent with presumed ventromedial/lateral striatal function, we found that mice self-stimulating medial dopamine terminals reversed lever preference following contingency reversal, while mice self-stimulating NAc showed parial flexibility, and DLS self-stimulation resulted in impaired reversal. Impairments in DLS mice were characterized by more regressive errors and reliance on lose-stay strategies following reversal, as well as reduced within-session learning, suggesting reward insensitivity and overreliance on previously learned actions. This study supports a model of striatal function in which DMS and ventral dopamine facilitate goal-directed responding, and DLS dopamine supports more inflexible responding.

Cell type specificity for circuit output in the midbrain dopaminergic system

Midbrain dopaminergic neurons are a relatively small group of neurons in the mammalian brain controlling a wide range of behaviors. In recent years, increasingly sophisticated tracing, imaging, transcriptomic, and machine learning approaches have provided substantial insights into the anatomical, molecular, and functional heterogeneity of dopaminergic neurons. Despite this wealth of new knowledge, it remains unclear whether and how the diverse features defining dopaminergic subclasses converge to delineate functional ensembles within the dopaminergic system. Here, we review recent studies investigating various aspects of dopaminergic heterogeneity and discuss how development, behavior, and disease influence subtype characteristics. We then outline what further approaches could be pursued to gain a more inclusive picture of dopaminergic diversity, which could be crucial to understanding the functional architecture of this system.

Premovement activity in the mesocortical system links peak force but not initiation of force generation under incentive motivation

Motivation facilitates motor performance; however, the neural substrates of the psychological effects on motor performance remain unclear. We conducted a functional magnetic resonance imaging experiment while human subjects performed a ready-set-go task with monetary incentives. Although subjects were only motivated to respond quickly, increasing the incentives improved not only reaction time but also peak grip force. However, the trial-by-trial correlation between reaction time and peak grip force was weak. Extensive areas in the mesocortical system, including the ventral midbrain (VM) and cortical motor-related areas, exhibited motivation-dependent activity in the premovement "Ready" period when the anticipated monetary reward was displayed. This premovement activity in the mesocortical system correlated only with subsequent peak grip force, whereas the activity in motor-related areas alone was associated with subsequent reaction time and peak grip force. These findings suggest that the mesocortical system linking the VM and motor-related regions plays a role in controlling the peak of force generation indirectly associated with incentives but not the initiation of force generation.

Putting early sensory neurons to sleep

Neurons that transmit information from the retina to other parts of the brain are more affected by anesthesia than previously thought.

Striatal mechanisms of turning behaviour following unilateral dopamine depletion in mice

Unilateral dopamine (DA) depletion produces ipsiversive turning behaviour, and the injection of DA receptor agonists can produce contraversive turning, but the underlying mechanisms remain unclear. We conducted in vivo recording and pharmacological and optogenetic manipulations to study the role of DA and striatal output in turning behaviour. We used a video-based tracking programme while recording single unit activity in both putative medium spiny projection neurons (MSNs) and fast-spiking interneurons (FSIs) in the dorsal striatum bilaterally. Our results suggest that unilateral DA depletion reduced striatal output from the depleted side, resulting in asymmetric striatal output. Depletion systematically altered activity in both MSNs and FSIs, especially in neurons that increased firing during turning movements. Like D1 agonist SKF 38393, optogenetic stimulation in the depleted striatum increased striatal output and reversed biassed turning. These results suggest that relative striatal outputs from the two cerebral hemispheres determine the direction of turning: Mice turn away from the side of higher striatal output and towards the side of the lower striatal output.

Reward-specific satiety affects subjective value signals in orbitofrontal cortex during multicomponent economic choice

Sensitivity to satiety constitutes a basic requirement for neuronal coding of subjective reward value. Satiety from natural ongoing consumption affects reward functions in learning and approach behavior. More specifically, satiety reduces the subjective economic value of individual rewards during choice between options that typically contain multiple reward components. The unconfounded assessment of economic reward value requires tests at choice indifference between two options, which is difficult to achieve with sated rewards. By conceptualizing choices between options with multiple reward components ("bundles"), Revealed Preference Theory may offer a solution. Despite satiety, choices against an unaltered reference bundle may remain indifferent when the reduced value of a sated bundle reward is compensated by larger amounts of an unsated reward of the same bundle, and then the value loss of the sated reward is indicated by the amount of the added unsated reward. Here, we show psychophysically titrated choice indifference in monkeys between bundles of differently sated rewards. Neuronal chosen value signals in the orbitofrontal cortex (OFC) followed closely the subjective value change within recording periods of individual neurons. A neuronal classifier distinguishing the bundles and predicting choice substantiated the subjective value change. The choice between conventional single rewards confirmed the neuronal changes seen with two-reward bundles. Thus, reward-specific satiety reduces subjective reward value signals in OFC. With satiety being an important factor of subjective reward value, these results extend the notion of subjective economic reward value coding in OFC neurons.

Mapping excessive "disgust" in the brain: Ventral pallidum inactivation recruits distributed circuitry to make sweetness "disgusting"

The ventral pallidum (VP) is an important structure in processing reward. The VP may be the only brain structure where localized lesions in rats replace normal facial "liking" expressions to sweetness with excessive "disgust" reactions, such as gapes and chin rubs, that are normally reserved for unpalatable tastes. The posterior half of the VP (pVP) contains a hedonic hot spot where opioid or related neurochemical stimulations can amplify positive "liking" reactions to sweet taste. This is the same site where lesions or pharmacological inactivations replace positive hedonic reactions to sucrose with intense negative "disgust." In the present study, we aimed to identify brain networks recruited by pVP inactivation to generate excessive "disgust," using neuronal Fos expression as a marker of neurobiological activation. Microinjections in pVP of inhibitory GABA_A/B agonists (muscimol and baclofen) caused rats to exhibit excessive "disgust" reactions to sucrose. Excessive "disgust" was accompanied by recruitment of neural Fos activation in several subcortical structures, including the posterior medial shell of nucleus accumbens (which also contains another GABAergic "disgust"-inducing "hedonic cold spot"), the bed nucleus of stria terminalis, lateral habenula, hypothalamus, and midbrain ventral tegmentum. Fos suppression was found in cortical limbic regions, including previously identified hedonic hot spots in the anteromedial orbitofrontal cortex and posterior insula. Finally, in addition to inducing excessive "disgust," pVP inactivation abolished motivational "wanting" to eat palatable food, reduced positive social interactions, and reordered sensorimotor relations. Our findings identify potential "disgust" generators in the brain that are released into excitation by pVP inhibition and may serve as targets for future research.

Ethanol produces multiple electrophysiological effects on ventral tegmental area neurons in freely moving rats

Although alcohol (i.e., ethanol) is a major drug of abuse, the acute functional effects of ethanol on the reward circuitry are not well defined in vivo. In freely moving rats, we examined the effect of intravenous ethanol administration on neuronal unit activity in the posterior ventral tegmental area (VTA), a central component of the mesolimbic reward system. VTA units were classified as putative dopamine (DA) neurons, fast-firing GABA neurons, and unidentified neurons based on a combination of electrophysiological properties and DA D₂ receptor pharmacological responses. A gradual infusion of ethanol significantly altered the firing rate of DA neurons in a concentration-dependent manner. The majority of DA neurons were stimulated by ethanol and showed enhanced burst firing activity, but a minority was inhibited. Ethanol also increased the proportion of DA neurons that exhibited pacemaker-like firing patterns. In contrast, ethanol mediated a variety of effects in GABA and other unidentified neurons that were distinct from DA neurons, including a nonlinear increase in firing rate, delayed inhibition, and more biphasic activity. These results provide evidence of discrete electrophysiological effects of ethanol on DA neurons compared with other VTA cell types, suggesting a complex role of the VTA in alcohol-induced responses in freely moving animals.

Progress in opioid reward research: From a canonical two-neuron hypothesis to two neural circuits

Opioid abuse and related overdose deaths continue to rise in the United States, contributing to the national opioid crisis in the USA. The neural mechanisms underlying opioid abuse and addiction are still not fully understood. This review discusses recent progress in basic research dissecting receptor mechanisms and circuitries underlying opioid reward and addiction. We first review the canonical GABA-dopamine neuron hypothesis that was upheld for half a century, followed by major findings challenging this hypothesis. We then focus on recent progress in research evaluating the role of the mesolimbic and nigrostriatal dopamine circuitries in opioid reward and relapse. Based on recent findings that activation of dopamine neurons in the ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) is equally rewarding and that GABA neurons in the rostromedial tegmental nucleus (RMTg) and the substantia nigra pars reticula (SNr) are rich in mu opioid receptors and directly synapse onto midbrain DA neurons, we proposed that the RTMg→VTA → ventrostriatal and SNr → SNc → dorsostriatal pathways may act as the two major neural substrates underlying opioid reward and abuse. Lastly, we discuss possible integrations of these two pathways during initial opioid use, development of opioid abuse and maintenance of compulsive opioid seeking.

A Head-Fixation System for Continuous Monitoring of Force Generated During Behavior

Many studies in neuroscience use head-fixed behavioral preparations, which confer a number of advantages, including the ability to limit the behavioral repertoire and use techniques for large-scale monitoring of neural activity. But traditional studies using this approach use extremely limited behavioral measures, in part because it is difficult to detect the subtle movements and postural adjustments that animals naturally exhibit during head fixation. Here we report a new head-fixed setup with analog load cells capable of precisely monitoring the continuous forces exerted by mice. The load cells reveal the dynamic nature of movements generated not only around the time of task-relevant events, such as presentation of stimuli and rewards, but also during periods in between these events, when there is no apparent overt behavior. It generates a new and rich set of behavioral measures that have been neglected in previous experiments. We detail the construction of the system, which can be 3D-printed and assembled at low cost, show behavioral results collected from head-fixed mice, and demonstrate that neural activity can be highly correlated with the subtle, whole-body movements continuously produced during head restraint.

Precise Coordination of Three-Dimensional Rotational Kinematics by Ventral Tegmental Area GABAergic Neurons

The ventral tegmental area (VTA) is a midbrain region implicated in a variety of motivated behaviors. However, the function of VTA GABAergic (Vgat+) neurons remains poorly understood. Here, using three-dimensional motion capture, in vivo electrophysiology, calcium imaging, and optogenetics, we demonstrate a novel function of VTAVgat+ neurons. We found three distinct populations of neurons, each representing head angle about a principal axis of rotation: yaw, roll, and pitch. For each axis, opponent cell groups were found that increase firing when the head moves in one direction and decrease firing in the opposite direction. Selective excitation and inhibition of VTAVgat+ neurons generate opposite rotational movements. Thus, VTAVgat+ neurons serve a critical role in the control of rotational kinematics while pursuing a moving target. This general-purpose steering function can guide animals toward desired spatial targets in any motivated behavior.

A striatal interneuron circuit for continuous target pursuit

Most adaptive behaviors require precise tracking of targets in space. In pursuit behavior with a moving target, mice use distance to target to guide their own movement continuously. Here, we show that in the sensorimotor striatum, parvalbumin-positive fast-spiking interneurons (FSIs) can represent the distance between self and target during pursuit behavior, while striatal projection neurons (SPNs), which receive FSI projections, can represent self-velocity. FSIs are shown to regulate velocity-related SPN activity during pursuit, so that movement velocity is continuously modulated by distance to target. Moreover, bidirectional manipulation of FSI activity can selectively disrupt performance by increasing or decreasing the self-target distance. Our results reveal a key role of the FSI-SPN interneuron circuit in pursuit behavior and elucidate how this circuit implements distance to velocity transformation required for the critical underlying computation.

Many natural behaviours involve tracking of a target in space. Here, the authors describe a task to assess this behaviour in mice and use in vivo electrophysiology, calcium imaging, optogenetics, and chemogenetics to investigate the role of the striatum in target pursuit.

Acute dopamine receptor blockade in substantia nigra pars reticulata: a possible model for drug-induced Parkinsonism

Dopamine (DA) depletion modifies the firing pattern of neurons in the substantia nigra pars reticulata (SNr), shifting their mostly tonic firing toward irregularity and bursting, traits of pathological firing underlying rigidity and postural instability in Parkinson's disease (PD) patients and animal models of Parkinsonism (PS). Drug-induced Parkinsonism (DIP) represents 20-40% of clinical cases of PS, becoming a problem for differential diagnosis, and is still not well studied with physiological tools. It may co-occur with tardive dyskinesia. Here we use in vitro slice preparations including the SNr to observe drug-induced pathological firing by using drugs that most likely produce it, DA-receptor antagonists (SCH23390 plus sulpiride), to compare with firing patterns found in DA-depleted tissue. The hypothesis is that SNr firing would be similar under both conditions, a prerequisite to the proposal of a similar preparation to test other DIP-producing drugs. Firing was analyzed with three complementary metrics, showing similarities between DA depletion and acute DA-receptor blockade. Moreover, blockade of either nonselective cationic channels or Ca_v3 T-type calcium channels hyperpolarized the membrane and abolished bursting and irregular firing, silencing SNr neurons in both conditions. Therefore, currents generating firing in control conditions are in part responsible for pathological firing. Haloperidol, a DIP-producing drug, reproduced DA-receptor antagonist firing modifications. Since acute DA-receptor blockade induces SNr neuron firing similar to that found in the 6-hydroxydopamine model of PS, output basal ganglia neurons may play a role in generating DIP. Therefore, this study opens the way to test other DIP-producing drugs. NEW & NOTEWORTHY Dopamine (DA) depletion enhances substantia nigra pars reticulata (SNr) neuron bursting and irregular firing, hallmarks of Parkinsonism. Several drugs, including antipsychotics, antidepressants, and calcium channel antagonists, among others, produce drug-induced Parkinsonism. Here we show the first comparison between SNr neuron firing after DA depletion vs. firing found after acute blockade of DA receptors. It was found that firing in both conditions is similar, implying that pathological SNr neuron firing is also a physiological correlate of drug-induced Parkinsonism.

A system-level mathematical model of Basal Ganglia motor-circuit for kinematic planning of arm movements

In this paper, a novel system-level mathematical model of the Basal Ganglia (BG) for kinematic planning, is proposed. An arm composed of several segments presents a geometric redundancy. Thus, selecting one trajectory among an infinite number of possible ones requires overcoming redundancy, according to some kinds of optimization. Solving this optimization is assumed to be the function of BG in planning. In the proposed model, first, a mathematical solution of kinematic planning is proposed for movements of a redundant arm in a plane, based on minimizing energy consumption. Next, the function of each part in the model is interpreted as a possible role of a nucleus of BG. Since the kinematic variables are considered as vectors, the proposed model is presented based on the vector calculus. This vector model predicts different neuronal populations in BG which is in accordance with some recent experimental studies. According to the proposed model, the function of the direct pathway is to calculate the necessary rotation of each joint, and the function of the indirect pathway is to control each joint rotation considering the movement of the other joints. In the proposed model, the local feedback loop between Subthalamic Nucleus and Globus Pallidus externus is interpreted as a local memory to store the previous amounts of movements of the other joints, which are utilized by the indirect pathway. In this model, activities of dopaminergic neurons would encode, at short-term, the error between the desired and actual positions of the end-effector. The short-term modulating effect of dopamine on Striatum is also modeled as cross product. The model is simulated to generate the commands of a redundant manipulator. The performance of the model is studied for different reaching movements between 8 points in a plane. Finally, some symptoms of Parkinson's disease such as bradykinesia and akinesia are simulated by modifying the model parameters, inspired by the dopamine depletion.

Maintenance of persistent activity in a frontal thalamocortical loop

Persistent neural activity maintains information bridging past and future events. Models of persistent activity often invoke reverberations within local cortical circuits, but long-range circuits could also contribute. Neurons in mouse anterior lateral motor cortex (ALM) show selective persistent activity that instructs future actions. ALM is connected bi-directionally with parts of the thalamus, including the ventral medial and ventral anterior-lateral nuclei. We recorded spikes from ALM and thalamus during tactile discrimination with a delayed directional response. Similar to ALM neurons, thalamic neurons exhibited selective persistent delay activity that predicted movement direction. Unilateral photoinhibition of delay activity in ALM or thalamus produced contralesional neglect. Photoinhibition of thalamus caused a short-latency and near total collapse of ALM activity. Similarly, photoinhibition of ALM diminished thalamic activity. Our results reveal thalamus as a circuit hub in motor preparation and suggest that persistent activity requires reciprocal excitation across multiple brain areas.

Does activation of midbrain dopamine neurons promote or reduce feeding?

BACKGROUND

Dopamine (DA) signalling in the brain is necessary for feeding behaviour, and alterations in the DA system have been linked to obesity. However, the precise role of DA in the control of food intake remains debated. On the one hand, food reward and motivation are associated with enhanced DA activity. On the other hand, psychostimulant drugs that increase DA signalling suppress food intake. This poses the questions of how endogenous DA neuronal activity regulates feeding, and whether enhancing DA neuronal activity would either promote or reduce food intake.

METHODS

Here, we used designer receptors exclusively activated by designer drugs (DREADD) technology to determine the effects of enhancing DA neuronal activity on feeding behaviour. We chemogenetically activated selective midbrain DA neuronal subpopulations and assessed the effects on feeding microstructure in rats.

RESULTS

Treatment with the psychostimulant drug amphetamine or the selective DA reuptake inhibitor GBR 12909 significantly suppressed food intake. Selective chemogenetic activation of DA neurons in the ventral tegmental area (VTA) was found to reduce meal size, but had less impact on total food intake. Targeting distinct VTA neuronal pathways revealed that specific activation of the mesolimbic pathway towards nucleus accumbens (NAc) resulted in smaller and shorter meals. In addition, the meal frequency was increased, rendering total food intake unaffected. The disrupted feeding patterns following activation of VTA DA neurons or VTA to NAc projection neurons were accompanied by locomotor hyperactivity. Activation of VTA neurons projecting towards prefrontal cortex or amygdala, or of DA neurons in the substantia nigra, did not affect feeding behaviour.

CONCLUSIONS

Chemogenetic activation of VTA DA neurons or VTA to NAc pathway disrupts feeding patterns. Increased activity of mesolimbic DA neurons appears to both promote and reduce food intake, by facilitating both the initiation and cessation of feeding behaviour.

Monkeys choose as if maximizing utility compatible with basic principles of revealed preference theory

Revealed preference theory provides axiomatic tools for assessing whether individuals make observable choices "as if" they are maximizing an underlying utility function. The theory evokes a tradeoff between goods whereby individuals improve themselves by trading one good for another good to obtain the best combination. Preferences revealed in these choices are modeled as curves of equal choice (indifference curves) and reflect an underlying process of optimization. These notions have far-reaching applications in consumer choice theory and impact the welfare of human and animal populations. However, they lack the empirical implementation in animals that would be required to establish a common biological basis. In a design using basic features of revealed preference theory, we measured in rhesus monkeys the frequency of repeated choices between bundles of two liquids. For various liquids, the animals' choices were compatible with the notion of giving up a quantity of one good to gain one unit of another good while maintaining choice indifference, thereby implementing the concept of marginal rate of substitution. The indifference maps consisted of nonoverlapping, linear, convex, and occasionally concave curves with typically negative, but also sometimes positive, slopes depending on bundle composition. Out-of-sample predictions using homothetic polynomials validated the indifference curves. The animals' preferences were internally consistent in satisfying transitivity. Change of option set size demonstrated choice optimality and satisfied the Weak Axiom of Revealed Preference (WARP). These data are consistent with a version of revealed preference theory in which preferences are stochastic; the monkeys behaved "as if" they had well-structured preferences and maximized utility.

Three Pillars for the Neural Control of Appetite

The neural control of appetite is important for understanding motivated behavior as well as the present rising prevalence of obesity. Over the past several years, new tools for cell type-specific neuron activity monitoring and perturbation have enabled increasingly detailed analyses of the mechanisms underlying appetite-control systems. Three major neural circuits strongly and acutely influence appetite but with notably different characteristics. Although these circuits interact, they have distinct properties and thus appear to contribute to separate but interlinked processes influencing appetite, thereby forming three pillars of appetite control. Here, we summarize some of the key characteristics of appetite circuits that are emerging from recent work and synthesize the findings into a provisional framework that can guide future studies.

A GABAergic nigrotectal pathway for coordination of drinking behavior

The contribution of basal ganglia outputs to consummatory behavior remains poorly understood. We recorded from the substantia nigra pars reticulata (SNR), the major basal ganglia output nucleus, during self-initiated drinking. The firing rates of many lateral SNR neurons were time-locked to individual licks. These neurons send GABAergic projections to the deep layers of the orofacial region of the lateral tectum (superior colliculus, SC). Many tectal neurons are also time-locked to licking, but their activity is usually antiphase to that of SNR neurons, suggesting inhibitory nigrotectal projections. We used optogenetics to selectively activate the GABAergic nigrotectal afferents in the deep layers of the SC. Photo-stimulation of the nigrotectal projections transiently inhibited the activity of the lick-related tectal neurons, disrupted their licking-related oscillatory pattern, and suppressed self-initiated drinking. These results demonstrate that GABAergic nigrotectal projections play a crucial role in coordinating drinking behavior.

Luminopsins integrate opto- and chemogenetics by using physical and biological light sources for opsin activation

Luminopsins are fusion proteins of luciferase and opsin that allow interrogation of neuronal circuits at different temporal and spatial resolutions by choosing either extrinsic physical or intrinsic biological light for its activation. Building on previous development of fusions of wild-type Gaussia luciferase with channelrhodopsin, here we expanded the utility of luminopsins by fusing bright Gaussia luciferase variants with either channelrhodopsin to excite neurons (luminescent opsin, LMO) or a proton pump to inhibit neurons (inhibitory LMO, iLMO). These improved LMOs could reliably activate or silence neurons in vitro and in vivo. Expression of the improved LMO in hippocampal circuits not only enabled mapping of synaptic activation of CA1 neurons with fine spatiotemporal resolution but also could drive rhythmic circuit excitation over a large spatiotemporal scale. Furthermore, virus-mediated expression of either LMO or iLMO in the substantia nigra in vivo produced not only the expected bidirectional control of single unit activity but also opposing effects on circling behavior in response to systemic injection of a luciferase substrate. Thus, although preserving the ability to be activated by external light sources, LMOs expand the use of optogenetics by making the same opsins accessible to noninvasive, chemogenetic control, thereby allowing the same probe to manipulate neuronal activity over a range of spatial and temporal scales.

Neuronal Reward and Decision Signals: From Theories to Data

Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.

Beyond reward prediction errors: the role of dopamine in movement kinematics

We recorded activity of dopamine (DA) neurons in the substantia nigra pars compacta in unrestrained mice while monitoring their movements with video tracking. Our approach allows an unbiased examination of the continuous relationship between single unit activity and behavior. Although DA neurons show characteristic burst firing following cue or reward presentation, as previously reported, their activity can be explained by the representation of actual movement kinematics. Unlike neighboring pars reticulata GABAergic output neurons, which can represent vector components of position, DA neurons represent vector components of velocity or acceleration. We found neurons related to movements in four directions-up, down, left, right. For horizontal movements, there is significant lateralization of neurons: the left nigra contains more rightward neurons, whereas the right nigra contains more leftward neurons. The relationship between DA activity and movement kinematics was found on both appetitive trials using sucrose and aversive trials using air puff, showing that these neurons belong to a velocity control circuit that can be used for any number of purposes, whether to seek reward or to avoid harm. In support of this conclusion, mimicry of the phasic activation of DA neurons with selective optogenetic stimulation could also generate movements. Contrary to the popular hypothesis that DA neurons encode reward prediction errors, our results suggest that nigrostriatal DA plays an essential role in controlling the kinematics of voluntary movements. We hypothesize that DA signaling implements gain adjustment for adaptive transition control, and describe a new model of the basal ganglia (BG) in which DA functions to adjust the gain of the transition controller. This model has significant implications for our understanding of movement disorders implicating DA and the BG.

Elevated dopamine alters consummatory pattern generation and increases behavioral variability during learning

The role of dopamine in controlling behavior remains poorly understood. In this study we examined licking behavior in an established hyperdopaminergic mouse model—dopamine transporter knockout (DAT KO) mice. DAT KO mice showed higher rates of licking, which is due to increased perseveration of licking in a bout. By contrast, they showed increased individual lick durations, and reduced inter-lick intervals. During extinction, both KO and control mice transiently increased variability in lick pattern generation while reducing licking rate, yet they showed very different behavioral patterns. Control mice gradually increased lick duration as well as variability. By contrast, DAT KO mice exhibited more immediate (within 10 licks) adjustments—an immediate increase in lick duration variability, as well as more rapid extinction. These results suggest that the level of dopamine can modulate the persistence and pattern generation of a highly stereotyped consummatory behavior like licking, as well as new learning in response to changes in environmental feedback. Increased dopamine in DAT KO mice not only increased perseveration of bouts and individual lick duration, but also increased the behavioral variability in response to the extinction contingency and the rate of extinction.

Basal ganglia outputs map instantaneous position coordinates during behavior

The basal ganglia (BG) are implicated in many movement disorders, yet how they contribute to movement remains unclear. Using wireless in vivo recording, we measured BG output from the substantia nigra pars reticulata (SNr) in mice while monitoring their movements with video tracking. The firing rate of most nigral neurons reflected Cartesian coordinates (either x- or y-coordinates) of the animal's head position during movement. The firing rates of SNr neurons are either positively or negatively correlated with the coordinates. Using an egocentric reference frame, four types of neurons can be classified: each type increases firing during movement in a particular direction (left, right, up, down), and decreases firing during movement in the opposite direction. Given the high correlation between the firing rate and the x and y components of the position vector, the movement trajectory can be reconstructed from neural activity. Our results therefore demonstrate a quantitative and continuous relationship between BG output and behavior. Thus, a steady BG output signal from the SNr (i.e., constant firing rate) is associated with the lack of overt movement, when a stable posture is maintained by structures downstream of the BG. Any change in SNr firing rate is associated with a change in position (i.e., movement). We hypothesize that the SNr output quantitatively determines the direction, velocity, and amplitude of voluntary movements. By changing the reference signals to downstream position control systems, the BG can produce transitions in body configurations and initiate actions.

The role of the substantia nigra in posture control

Disorders implicating the basal ganglia are often characterized by postural deficits, but little is known about the role of the basal ganglia in posture control. Using wireless multi-electrode recording, we measured single unit activity from GABAergic and dopaminergic neurons in the substantia nigra as unrestrained mice stood on an elevated platform while introducing continuous postural disturbances in the roll plane. We found two major types of neurons - those activated by tilt to the left side of the body and suppressed by tilt to the right side, and others activated by tilt to the right side and suppressed by tilt to the left side. Contrary to the prevailing view that the basal ganglia output from the substantia nigra pars reticulata either inhibits or disinhibits downstream structures in an all or none fashion, we showed that it continuously sends anti-phase signals to their downstream targets. We also demonstrated for the first time that nigrostriatal dopaminergic transmission is modulated by postural disturbances.

The role of pedunculopontine nucleus in choice behavior under risk

The dopaminergic projections to the basal ganglia have long been implicated in reward-guided behavior and decision-making, yet little is known about the role of the posterior pedunculopontine nucleus (pPPN), a major source of excitatory input to the mesolimbic dopamine system. Here we studied the contributions of the pPPN to decision-making under risk, using excitoxic lesions and reversible inactivation in rats. Rats could choose between two options - a small but certain reward on one lever; or a large but uncertain reward on the other lever. The overall payoff associated with each choice is the same, but the reward variance (risk) associated with the risky choice is much higher. In Experiment 1, we showed that excitotoxic lesions of the pPPN before training did not affect acquisition of lever pressing. But whereas the controls strongly preferred the safe choice, the lesioned rats did not. In Experiment 2, we found that muscimol inactivation of the pPPN also produced similar effects, but reversibly. These results show that permanent lesions or reversible inactivation of the pPPN both abolish risk aversion in decision-making.

Dopamine prediction error responses integrate subjective value from different reward dimensions

Prediction error signals enable us to learn through experience. These experiences include economic choices between different rewards that vary along multiple dimensions. Therefore, an ideal way to reinforce economic choice is to encode a prediction error that reflects the subjective value integrated across these reward dimensions. Previous studies demonstrated that dopamine prediction error responses reflect the value of singular reward attributes that include magnitude, probability, and delay. Obviously, preferences between rewards that vary along one dimension are completely determined by the manipulated variable. However, it is unknown whether dopamine prediction error responses reflect the subjective value integrated from different reward dimensions. Here, we measured the preferences between rewards that varied along multiple dimensions, and as such could not be ranked according to objective metrics. Monkeys chose between rewards that differed in amount, risk, and type. Because their choices were complete and transitive, the monkeys chose "as if" they integrated different rewards and attributes into a common scale of value. The prediction error responses of single dopamine neurons reflected the integrated subjective value inferred from the choices, rather than the singular reward attributes. Specifically, amount, risk, and reward type modulated dopamine responses exactly to the extent that they influenced economic choices, even when rewards were vastly different, such as liquid and food. This prediction error response could provide a direct updating signal for economic values.

Action, time and the basal ganglia

The ability to control the speed of movement is compromised in neurological disorders involving the basal ganglia, a set of subcortical cerebral nuclei that receive prominent dopaminergic projections from the midbrain. For example, bradykinesia, slowness of movement, is a major symptom of Parkinson's disease, whereas rapid tics are observed in patients with Tourette syndrome. Recent experimental work has also implicated dopamine (DA) and the basal ganglia in action timing. Here, I advance the hypothesis that the basal ganglia control the rate of change in kinaesthetic perceptual variables. In particular, the sensorimotor cortico-basal ganglia network implements a feedback circuit for the control of movement velocity. By modulating activity in this network, DA can change the gain of velocity reference signals. The lack of DA thus reduces the output of the velocity control system which specifies the rate of change in body configurations, slowing the transition from one body configuration to another.