Pedunculopontine tegmental nucleus controls conditioned responses of midbrain dopamine neurons in behaving rats

A mismatch between striatal cholinergic pauses and dopaminergic reward prediction errors

Striatal acetylcholine and dopamine critically regulate movement, motivation, and reward-related learning. Pauses in cholinergic interneuron (CIN) firing are thought to coincide with dopamine pulses encoding reward prediction errors (RPE) to jointly enable synaptic plasticity. Here, we examine the firing of identified CINs during reward-guided decision-making in freely moving rats and compare this firing to dopamine release. Relationships between CINs, dopamine, and behavior varied strongly by subregion. In the dorsal-lateral striatum, a Go! cue evoked burst-pause CIN spiking, followed by a brief dopamine pulse that was unrelated to RPE. In the dorsal-medial striatum, this cue evoked only a CIN pause, that was curtailed by a movement-selective rebound in firing. Finally, in the ventral striatum, a reward cue evoked RPE-coding increases in both dopamine and CIN firing, without a consistent pause. Our results demonstrate a spatial and temporal dissociation between CIN pauses and dopamine RPE signals and will inform future models of striatal information processing under both normal and pathological conditions.

Distinct cholinergic circuits underlie discrete effects of reward on attention

Attention and reward are functions that are critical for the control of behavior, and massive multi-region neural systems have evolved to support the discrete computations associated with each. Previous research has also identified that attention and reward interact, though our understanding of the neural mechanisms that mediate this interplay is incomplete. Here, we review the basic neuroanatomy of attention, reward, and cholinergic systems. We then examine specific contexts in which attention and reward computations interact. Building on this work, we propose two discrete neural circuits whereby acetylcholine, released from cell groups located in different parts of the brain, mediates the impact of stimulus-reward associations as well as motivation on attentional control. We conclude by examining these circuits as a potential shared loci of dysfunction across diseases states associated with deficits in attention and reward.

The mesopontine tegmentum in reward and aversion: From cellular heterogeneity to behaviour

The mesopontine tegmentum, comprising the pedunculopontine tegmentum (PPN) and the laterodorsal tegmentum (LDT), is intricately connected to various regions of the basal ganglia, motor systems, and limbic systems. The PPN and LDT can regulate the activity of different brain regions of these target systems, and in this way are in a privileged position to modulate motivated behaviours. Despite recent findings, the PPN and LDT have been largely overlooked in discussions about the neural circuits associated with reward and aversion. This review aims to provide a timely and comprehensive resource on past and current research, highlighting the PPN and LDT's connectivity and influence on basal ganglia and limbic, and motor systems. Seminal studies, including lesion, pharmacological, and optogenetic/chemogenetic approaches, demonstrate their critical roles in modulating reward/aversive behaviours. The review emphasizes the need for further investigation into the associated cellular mechanisms, in order to clarify their role in behaviour and contribution for different neuropsychiatric disorders.

Multimodal convergence in the pedunculopontine tegmental nucleus: Motor, sensory and theta-frequency inputs influence activity of single neurons

The pedunculopontine tegmental nucleus of the brainstem (PPTg) has extensive interconnections and neuronal-behavioural correlates. It is implicated in movement control and sensorimotor integration. We investigated whether single neuron activity in freely moving rats is correlated with components of skilled forelimb movement, and whether individual neurons respond to both motor and sensory events. We found that individual PPTg neurons showed changes in firing rate at different times during the reach. This type of temporally specific modulation is like activity seen elsewhere in voluntary movement control circuits, such as the motor cortex, and suggests that PPTg neural activity is related to different specific events occurring during the reach. In particular, many neuronal modulations were time-locked to the end of the extension phase of the reach, when fine distal movements related to food grasping occur, indicating strong engagement of PPTg in this phase of skilled individual forelimb movements. In addition, some neurons showed brief periods of apparent oscillatory firing in the theta range at specific phases of the reach-to-grasp movement. When movement-related neurons were tested with tone stimuli, many also responded to this auditory input, allowing for sensorimotor integration at the cellular level. Together, these data extend the concept of the PPTg as an integrative structure in generation of complex movements, by showing that this function extends to the highly coordinated control of the forelimb during skilled reach to grasp movement, and that sensory and motor-related information converges on single neurons, allowing for direct integration at the cellular level.

Phasic dopamine signals are reduced in the spontaneously hypertensive rat and increased by methylphenidate

The spontaneously hypertensive rat (SHR) is a selectively bred animal strain that is frequently used to model attention-deficit hyperactivity disorder (ADHD) because of certain genetically determined behavioural characteristics. To test the hypothesis that the characteristically altered response to positive reinforcement in SHRs may be due to altered phasic dopamine response to reward, we measured phasic dopamine signals in the SHRs and Sprague Dawley (SD) rats using in vivo fast-scan cyclic voltammetry. The effects of the dopamine reuptake inhibitor, methylphenidate, on these signals were also studied. Phasic dopamine signals during the pairing of a sensory cue with electrical stimulation of midbrain dopamine neurons were significantly smaller in the SHRs than in the SD rats. Over repeated pairings, the dopamine response to the sensory cue increased, whereas the response to the electrical stimulation of dopamine neurons decreased, similarly in both strains. However, the final amplitude of the response to the sensory cue after pairing was significantly smaller in SHRs than in the SD rats. Methylphenidate increased responses to sensory cues to a significantly greater extent in the SHRs than in the SD rats, due largely to differences in the low dose effect. At a higher dose, methylphenidate increased responses to sensory cues and electrical stimulation similarly in SHRs and SD rats. The smaller dopamine responses may explain the reduced salience of reward-predicting cues previously reported in the SHR, whereas the action of methylphenidate on the cue response suggests a potential mechanism for the therapeutic effects of low-dose methylphenidate in ADHD.

Targeting the Actions of Muscarinic Receptors on Dopamine Systems: New Strategies for Treating Neuropsychiatric Disorders

Cholinergic regulation of dopamine (DA) signaling has significant implications for numerous disorders, including schizophrenia, substance use disorders, and mood-related disorders. The activity of midbrain DA neurons and DA release patterns in terminal regions are tightly regulated by cholinergic neurons found in both the striatum and the hindbrain. These cholinergic neurons can modulate DA circuitry by activating numerous receptors, including muscarinic acetylcholine receptor (mAChR) subtypes. This review specifically focuses on the complex role of M2, M4, and M5 mAChR subtypes in regulating DA neuron activity and DA release and the potential clinical implications of targeting these mAChR subtypes.

The Basal Ganglia and Mesencephalic Locomotor Region Connectivity Matrix

Although classically considered a relay station for basal ganglia (BG) output, the anatomy, connectivity, and function of the mesencephalic locomotor region (MLR) were redefined during the last two decades. In striking opposition to what was initially thought, MLR and BG are actually reciprocally and intimately interconnected. New viral-based, optogenetic, and mapping technologies revealed that cholinergic, glutamatergic, and GABAergic neurons coexist in this structure, which, in addition to extending descending projections, send long-range ascending fibers to the BG. These MLR projections to the BG convey motor and non-motor information to specific synaptic targets throughout different nuclei. Moreover, MLR efferent fibers originate from precise neuronal subpopulations located in particular MLR subregions, defining independent anatomo-functional subcircuits involved in particular aspects of animal behavior such as fast locomotion, explorative locomotion, posture, forelimb- related movements, speed, reinforcement, among others. In this review, we revised the literature produced during the last decade linking MLR and BG. We conclude that the classic framework considering the MLR as a homogeneous output structure passively receiving input from the BG needs to be revisited. We propose instead that the multiple subcircuits embedded in this region should be taken as independent entities that convey relevant and specific ascending information to the BG and, thus, actively participate in the execution and tuning of behavior.

Inhibitory Pedunculopontine Neurons Gate Dopamine-Mediated Motor Actions of Unsigned Valence

BACKGROUND

The pedunculopontine nucleus (PPN) maintains a bidirectional connectivity with the basal ganglia that supports their shared roles in the selection and execution of motor actions. Previous studies identified a role for PPN neurons in goal-directed behavior, but the cellular substrates underlying this function have not been elucidated. We recently revealed the existence of a monosynaptic GABAergic input from the PPN that inhibits dopamine neurons of the substantia nigra. Activation of this pathway interferes with the execution of learned motor sequences when the actions are rewarded, even though the inhibition of dopamine neurons did not shift the value of the action, hence suggesting executive control over the gating of behavior.

OBJECTIVE

To test the attributes of the inhibition of dopamine neurons by the PPN in the context of goal-directed behavior regardless of whether the outcome is positively or negatively reinforced.

METHODS

We delivered optogenetic stimulation to PPN GABAergic axon terminals in the substantia nigra during a battery of behavioral tasks with positive and negative valence.

RESULTS

Inhibition of dopamine neurons by PPN optogenetic activation during an appetitive task impaired the initiation and overall execution of the behavioral sequence without affecting the consumption of reward. During an active avoidance task, the same activation impaired the ability of mice to avoid a foot shock, but their escape response was unaffected. In addition, responses to potential threats were significantly attenuated.

CONCLUSION

Our results show that PPN GABAergic neurons modulate learned, goal-directed behavior of unsigned valence without affecting overall motor behavior.

Sound Intensity-dependent Multiple Tonotopic Organizations and Complex Sub-threshold Alterations of Auditory Response Across Sound Frequencies in the Thalamic Reticular Nucleus

The thalamic reticular nucleus (TRN), a cluster of GABAergic cells, modulates sensory attention and perception through its inhibitory projections to thalamic nuclei. Cortical and thalamic topographic projections to the auditory TRN are thought to compose tonotopic organizations for modulation of thalamic auditory processing. The present study determined tonotopies in the TRN and examined interactions between probe and masker sounds to obtain insights into temporal processing associated with tonotopies. Experiments were performed on anesthetized rats, using juxta-cellular recording and labeling techniques. Following determination of tonotopies, effects of sub-threshold masker sound stimuli on onset and late responses evoked by a probe sound were examined. The main findings are as follows. Tonotopic organizations were recognized in cell location and axonal projection. Tonotopic gradients and their clarities were diverse, depending on sound intensity, response type and the tiers of the TRN. Robust alterations in response magnitude, latency and/or burst spiking took place following masker sounds in either a broad or narrow range of frequencies that were close or far away from the probe sound frequency. The majority of alterations were suppression recognizable up to 600 ms in the interval between masker and probe sounds, and directions of alteration differed depending on the interval. Finally, masker sound effects were associated with tonotopic organizations. These findings suggest that the auditory TRN is comprised of sound intensity-dependent multiple tonotopic organizations, which could configure temporal interactions of auditory information across sound frequencies and impose complex but spatiotemporally structured influences on thalamic auditory processing.

A Signaled Locomotor Avoidance Action Is Fully Represented in the Neural Activity of the Midbrain Tegmentum

Animals, including humans, readily learn to avoid harmful and threatening situations by moving in response to cues that predict the threat (e.g., fire alarm, traffic light). During a negatively reinforced sensory-guided locomotor action, known as signaled active avoidance, animals learn to avoid a harmful unconditioned stimulus (US) by moving away when signaled by a harmless conditioned stimulus (CS) that predicts the threat. CaMKII-expressing neurons in the pedunculopontine tegmentum area (PPT) of the midbrain locomotor region have been shown to play a critical role in the expression of this learned behavior, but the activity of these neurons during learned behavior is unknown. Using calcium imaging fiber photometry in freely behaving mice, we show that PPT neurons sharply activate during presentation of the auditory CS that predicts the threat before onset of avoidance movement. PPT neurons activate further during the succeeding CS-driven avoidance movement, or during the faster US-driven escape movement. PPT neuron activation was weak during slow spontaneous movements but correlated sharply with movement speed and, therefore, with the urgency of the behavior. Moreover, using optogenetics, we found that these neurons must discharge during the signaled avoidance interval for naive mice to effectively learn the active avoidance behavior. As an essential hub for signaled active avoidance, neurons in the midbrain tegmentum process the conditioned cue that predicts the threat and discharge sharply relative to the speed or apparent urgency of the avoidance (learned) and escape (innate) responses.SIGNIFICANCE STATEMENT During signaled active avoidance behavior, subjects move away to avoid a threat when directed by an innocuous sensory stimulus. Using imaging methods in freely behaving mice, we found that the activity of neurons in a part of the midbrain, known as the pedunculopontime tegmentum, increases during the presentation of the innocuous sensory stimulus that predicts the threat and also during the expression of the learned behavior as mice move away to avoid the threat. In addition, inhibiting these neurons abolishes the ability of mice to learn the behavior. Thus, neurons in this part of the midbrain code and are essential for signaled active avoidance behavior.

A Causal Role for the Pedunculopontine Nucleus in Human Instrumental Learning

A critical mechanism for maximizing reward is instrumental learning. In standard instrumental learning models, action values are updated on the basis of reward prediction errors (RPEs), defined as the discrepancy between expectations and outcomes. A wealth of evidence across species and experimental techniques has established that RPEs are signaled by midbrain dopamine neurons. However, the way dopamine neurons receive information about reward outcomes remains poorly understood. Recent animal studies suggest that the pedunculopontine nucleus (PPN), a small brainstem structure considered as a locomotor center, is sensitive to reward and sends excitatory projection to dopaminergic nuclei. Here, we examined the hypothesis that the PPN could contribute to reward learning in humans. To this aim, we leveraged a clinical protocol that assessed the therapeutic impact of PPN deep-brain stimulation (DBS) in three patients with Parkinson disease. PPN local field potentials (LFPs), recorded while patients performed an instrumental learning task, showed a specific response to reward outcomes in a low-frequency (alpha-beta) band. Moreover, PPN DBS selectively improved learning from rewards but not from punishments, a pattern that is typically observed following dopaminergic treatment. Computational analyses indicated that the effect of PPN DBS on instrumental learning was best captured by an increase in subjective reward sensitivity. Taken together, these results support a causal role for PPN-mediated reward signals in human instrumental learning.

Neurobiology of reward-related learning

A major goal in psychology is to understand how environmental stimuli associated with primary rewards come to function as conditioned stimuli, acquiring the capacity to elicit similar responses to those elicited by primary rewards. Our neurobiological model is predicated on the Hebbian idea that concurrent synaptic activity on the primary reward neural substrate-proposed to be ventral tegmental area (VTA) dopamine (DA) neurons-strengthens the synapses involved. We propose that VTA DA neurons receive both a strong unconditioned stimulus signal (acetylcholine stimulation of DA cells) from the primary reward capable of unconditionally activating DA cells and a weak stimulus signal (glutamate stimulation of DA cells) from the neutral stimulus. Through joint stimulation the weak signal is potentiated and capable of activating the VTA DA cells, eliciting a conditioned response. The learning occurs when this joint stimulation initiates intracellular second-messenger cascades resulting in enhanced glutamate-DA synapses. In this review we present evidence that led us to propose this model and the most recent evidence supporting it.

A systems-neuroscience model of phasic dopamine

We describe a neurobiologically informed computational model of phasic dopamine signaling to account for a wide range of findings, including many considered inconsistent with the simple reward prediction error (RPE) formalism. The central feature of this PVLV framework is a distinction between a primary value (PV) system for anticipating primary rewards (Unconditioned Stimuli [USs]), and a learned value (LV) system for learning about stimuli associated with such rewards (CSs). The LV system represents the amygdala, which drives phasic bursting in midbrain dopamine areas, while the PV system represents the ventral striatum, which drives shunting inhibition of dopamine for expected USs (via direct inhibitory projections) and phasic pausing for expected USs (via the lateral habenula). Our model accounts for data supporting the separability of these systems, including individual differences in CS-based (sign-tracking) versus US-based learning (goal-tracking). Both systems use competing opponent-processing pathways representing evidence for and against specific USs, which can explain data dissociating the processes involved in acquisition versus extinction conditioning. Further, opponent processing proved critical in accounting for the full range of conditioned inhibition phenomena, and the closely related paradigm of second-order conditioning. Finally, we show how additional separable pathways representing aversive USs, largely mirroring those for appetitive USs, also have important differences from the positive valence case, allowing the model to account for several important phenomena in aversive conditioning. Overall, accounting for all of these phenomena strongly constrains the model, thus providing a well-validated framework for understanding phasic dopamine signaling. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

CaMKII antagonism in the ventral tegmental area impairs acquisition of conditioned approach learning in rats

This study investigated the role of calcium2+/calmodulin-dependent protein kinase II (CaMKII), a protein in the second messenger pathway of NMDA receptors, in the ventral tegmental area (VTA) in the acquisition and performance of conditioned approach learning. Male Long-Evans rats (N = 79) were exposed to 3 (to test acquisition) or 7 (to test performance) conditioning sessions in which they received 30 paired presentations of a light stimulus (CS) and a food pellet (US) on a random time schedule. These conditioning sessions were then followed by one 30-min session without the CS or US and lastly by a CS-only test session, where only the light stimulus was presented (without food) according to the same schedule as the conditioning sessions. Bilateral intra-VTA injections of KN93 (vehicle, 3.0, 4.5 or 6.0 μg/0.5 μL), a CaMKII inhibitor, were administered prior to each conditioning session to test effects on the acquisition of conditioned approach or prior to the CS-only test session to test effects on the performance of conditioned approach. KN93, when given prior to conditioning sessions, significantly reduced the number of conditioned approach responses emitted during CS presentations in the CS-only test. When KN93 was given prior to the CS-only test it had no effect. These results suggest that CaMKII activation in the VTA is necessary for the acquisition, but not the performance, of reward-related learning.

Cross-modal modulation of cell activity by sound in first-order visual thalamic nucleus

Cross-modal auditory influence on cell activity in the primary visual cortex emerging at short latencies raises the possibility that the first-order visual thalamic nucleus, which is considered dedicated to unimodal visual processing, could contribute to cross-modal sensory processing, as has been indicated in the auditory and somatosensory systems. To test this hypothesis, the effects of sound stimulation on visual cell activity in the dorsal lateral geniculate nucleus were examined in anesthetized rats, using juxta-cellular recording and labeling techniques. Visual responses evoked by light (white LED) were modulated by sound (noise burst) given simultaneously or 50-400 ms after the light, even though sound stimuli alone did not evoke cell activity. Alterations of visual response were observed in 71% of cells (57/80) with regard to response magnitude, latency, and/or burst spiking. Suppression predominated in response magnitude modulation, but de novo responses were also induced by combined stimulation. Sound affected not only onset responses but also late responses. Late responses were modulated by sound given before or after onset responses. Further, visual responses evoked by the second light stimulation of a double flash with a 150-700 ms interval were also modulated by sound given together with the first light stimulation. In morphological analysis of labeled cells projection cells comparable to X-, Y-, and W-like cells and interneurons were all susceptible to auditory influence. These findings suggest that the first-order visual thalamic nucleus incorporates auditory influence into parallel and complex thalamic visual processing for cross-modal modulation of visual attention and perception.

Microinjection of urotensin II into the pedunculopontine tegmentum leads to an increase in the consumption of sweet tastants

The pedunculopontine tegmentum (PPTg) plays a role in processing multiple sensory inputs and innervates brain regions associated with reward-related behaviors. The urotensin II receptor, activated by the urotensin II peptide (UII), is selectively expressed by the cholinergic neurons of the PPTg. Although the exact function of cholinergic neurons of the PPTg is unknown, they are thought to contribute to the perception of reward magnitude or salience detection. We hypothesized that the activation of PPTg cholinergic neurons would alter sensory processing across multiple modalities (ex. taste and hearing). Here we had three aims: first, determine if cholinergic activation is involved in consumption behavior of palatable solutions (sucrose). Second, if so, distinguish the impact of the caloric value by using saccharin, a zero calorie sweetener. Lastly, we tested the UII-mediated effects on perception of acoustic stimuli by measuring acoustic startle reflex (ASR). Male Sprague-Dawley rats were bilaterally cannulated into the PPTg, then placed under food restriction lasting the entire consumption experiment (water ad lib.). Treatment consisted of a microinjection of either 1 μL of aCSF or 1 μL of 10 μM UII into the PPTg, and the rats were immediately given access to either sucrose or saccharin. For the remaining five days, rats were allowed one hour access per day to the same sweet solution without any further treatments. During the saccharin experiment rats were tested in a contact lickometer which recorded each individual lick to give insight into the microstructure of the consumption behavior. ASR testing consisted of a baseline (no treatment), treatment day, and two additional days (no treatment). Immediately following the microinjection of UII, consumption of both saccharin and sucrose increased compared to controls. This significant increase persisted for days after the single administration of UII, but there was no generalized arousal or increase in water consumption between testing sessions. The effects on ASR were not significant. Activating cholinergic PPTg neurons may lead to a miscalculation of the salience of external stimuli, implicating the importance of cholinergic input in modulating a variety of behaviors. The long-lasting effects seen after UII treatment support further research into the role of sensory processing on reward related-behaviors at the level of the PPTg cholinergic neurons.

Dichotomy between motor and cognitive functions of midbrain cholinergic neurons

Cholinergic neurons of the pedunculopontine nucleus (PPN) are interconnected with all the basal ganglia structures, as well as with motor centers in the brainstem and medulla. Recent theories put into question whether PPN cholinergic neurons form part of a locomotor region that directly regulates the motor output, and rather suggest a modulatory role in adaptive behavior involving both motor and cognitive functions. In support of this, experimental studies in animals suggest that cholinergic neurons reinforce actions by signaling reward prediction and shape adaptations in behavior during changes of environmental contingencies. This is further supported by clinical studies proposing that decreased cholinergic transmission originated in the PPN is associated with impaired sensorimotor integration and perseverant behavior, giving rise to some of the symptoms observed in Parkinson's disease and progressive supranuclear palsy. Altogether, the evidence suggests that cholinergic neurons of the PPN, mainly through their interactions with the basal ganglia, have a leading role in action control.

The pedunclopontine nucleus and Parkinson's disease

In the last decade, scientific and clinical interest in the pedunculopontine nucleus (PPN) has grown dramatically. This growth is largely a consequence of experimental work demonstrating its connection to the control of gait and of clinical work implicating PPN pathology in levodopa-insensitive gait symptoms of Parkinson's disease (PD). In addition, the development of optogenetic and chemogenetic approaches has made experimental analysis of PPN circuitry and function more tractable. In this brief review, recent findings in the field linking PPN to the basal ganglia and PD are summarized; in addition, an attempt is made to identify key gaps in our understanding and challenges this field faces in moving forward.

NMDA receptor modulation of the pedunculopontine tegmental nucleus underlies the motivational drive for feeding induced by midbrain dopaminergic neurons

The mesolimbic system, particularly the somatodendritic ventral tegmental area (VTA), is responsible for the positive reinforcing aspects of various homeostatic stimuli. In turn, the pedunculopontine tegmental nucleus (PPN) is anatomically and functionally connected with the VTA and substantia nigra (SN). In the present study, we investigated the role of glutamate receptors in the PPN in motivated behaviors by using a model of feeding induced by electrical stimulation of the VTA in male Wistar rats (n = 80). We found that injection of 2.5/5 µg dizocilpine (MK-801; NMDA receptor antagonist) to the PPN significantly reduced the feeding response induced by unilateral VTA-stimulation. This reaction was significantly impaired after local injection of MK-801 into the PPN in the ipsilateral rather than the contralateral hemisphere. After NMDA injection (2/3 µg) to the PPN we did not observe behavioral changes, only a trend of a lengthening/shortening of the latency to a feeding reaction at the highest dose of NMDA (3 µg). Immunohistochemical TH+/c-Fos+ analysis revealed a decrease in the number of TH+ cells in the midbrain (VTA-SN) in all experimental groups and altered activity of c-Fos+ neurons in selected brain structures depending on drug type (MK-801/NMDA) and injection site (ipsi-/contralateral hemisphere). Additionally, the pattern of TH+/c-Fos+ expression showed lateralization of feeding circuit functional connectivity. We conclude that the level of NMDA receptor arousal in the PPN regulates the activity of the midbrain dopaminergic cells, and the PPN-VTA circuit may be important in the regulation of motivational aspects of food intake.

Local Field Potentials Reflect Dopaminergic and Non-Dopaminergic Activities within the Primate Midbrain

Midbrain dopamine neurons are thought to play a crucial role in motivating behaviors toward desired goals. While the activity of dopamine single-units is known to adhere closely to the reward prediction error (RPE) signal hypothesized by learning theory, much less is known about the dynamic coordination of population-level neuronal activities in the midbrain. Local field potentials (LFPs) are thought to reflect the changes in membrane potential synchronized across a population of neurons nearby a recording electrode. These changes involve complex combinations of local spiking activity with synaptic processing that are difficult to interpret. Here we sampled LFPs from the substantia nigra pars compacta (SNc) of behaving monkeys to determine if local population-level synchrony encodes specific aspects of a reward/effort instrumental task and whether dopamine single-units participate in that signal. We found that reward-correlated information is encoded in a low-frequency signal (<32-Hz; delta and beta bands) that is synchronized across a neural population that includes dopamine neurons. Conversely, high-frequency power (>33-Hz; gamma band) was anticorrelated with predicted reward value and dopamine single-units were never phase-locked to those frequencies. This high-frequency signal may reflect inhibitory processes that were not otherwise observable. LFP encoding of movement-related parameters was negligible. Together, LFPs provide novel insights into the multidimensional processing of reward information subserved by dopaminergic and other components of the midbrain.

Dopamine neurons projecting to medial shell of the nucleus accumbens drive heroin reinforcement

The dopamine (DA) hypothesis posits the increase of mesolimbic dopamine levels as a defining commonality of addictive drugs, initially causing reinforcement, eventually leading to compulsive consumption. While much experimental evidence from psychostimulants supports this hypothesis, it has been challenged for opioid reinforcement. Here, we monitor genetically encoded DA and calcium indicators as well as cFos in mice to reveal that heroin activates DA neurons located in the medial part of the VTA, preferentially projecting to the medial shell of the nucleus accumbens (NAc). Chemogenetic and optogenetic manipulations of VTA DA or GABA neurons establish a causal link to heroin reinforcement. Inhibition of DA neurons blocked heroin self-administration, while heroin inhibited optogenetic self-stimulation of DA neurons. Likewise, heroin occluded the self-inhibition of VTA GABA neurons. Together, these experiments support a model of disinhibition of a subset of VTA DA neurons in opioid reinforcement.

Dynamical ventral tegmental area circuit mechanisms of alcohol-dependent dopamine release

A large body of data has identified numerous molecular targets through which ethanol (EtOH) acts on brain circuits. Yet how these multiple mechanisms interact to result in dysregulated dopamine (DA) release under the influence of alcohol in vivo remains unclear. In this manuscript, we delineate potential circuit-level mechanisms responsible for EtOH-dependent dysregulation of DA release from the ventral tegmental area (VTA) into its projection areas. For this purpose, we constructed a circuit model of the VTA that integrates realistic Glutamatergic (Glu) inputs and reproduces DA release observed experimentally. We modelled the concentration-dependent effects of EtOH on its principal VTA targets. We calibrated the model to reproduce the inverted U-shape dose dependence of DA neuron activity on EtOH concentration. The model suggests a primary role of EtOH-induced boost in the I_h and AMPA currents in the DA firing-rate/bursting increase. This is counteracted by potentiated GABA transmission that decreases DA neuron activity at higher EtOH concentrations. Thus, the model connects well-established in vitro pharmacological EtOH targets with its in vivo influence on neuronal activity. Furthermore, we predict that increases in VTA activity produced by moderate EtOH doses require partial synchrony and relatively low rates of the Glu afferents. We propose that the increased frequency of transient (phasic) DA peaks evoked by EtOH results from synchronous population bursts in VTA DA neurons. Our model predicts that the impact of acute ETOH on dopamine release is critically shaped by the structure of the cortical inputs to the VTA.

A Review of the Pedunculopontine Nucleus in Parkinson's Disease

The pedunculopontine nucleus (PPN) is situated in the upper pons in the dorsolateral portion of the ponto-mesencephalic tegmentum. Its main mass is positioned at the trochlear nucleus level, and is part of the mesenphalic locomotor region (MLR) in the upper brainstem. The human PPN is divided into two subnuclei, the pars compacta (PPNc) and pars dissipatus (PPNd), and constitutes both cholinergic and non-cholinergic neurons with afferent and efferent projections to the cerebral cortex, thalamus, basal ganglia (BG), cerebellum, and spinal cord. The BG controls locomotion and posture via GABAergic output of the substantia nigra pars reticulate (SNr). In PD patients, GABAergic BG output levels are abnormally increased, and gait disturbances are produced via abnormal increases in SNr-induced inhibition of the MLR. Since the PPN is vastly connected with the BG and the brainstem, dysfunction within these systems lead to advanced symptomatic progression in Parkinson's disease (PD), including sleep and cognitive issues. To date, the best treatment is to perform deep brain stimulation (DBS) on PD patients as outcomes have shown positive effects in ameliorating the debilitating symptoms of this disease by treating pathological circuitries within the parkinsonian brain. It is therefore important to address the challenges and develop this procedure to improve the quality of life of PD patients.

Pleasure: The missing link in the regulation of sleep

Although largely unrecognized by sleep scholars, sleeping is a pleasure. This report aims first, to fill the gap: sleep, like food, water and sex, is a primary reinforcer. The levels of extracellular mesolimbic dopamine show circadian oscillations and mark the "wanting" for pro-homeostatic stimuli. Further, the dopamine levels decrease during waking and are replenished during sleep, in opposition to sleep propensity. The wanting of sleep, therefore, may explain the homeostatic and circadian regulation of sleep. Accordingly, sleep onset occurs when the displeasure of excessive waking is maximal, coinciding with the minimal levels of mesolimbic dopamine. Reciprocally, sleep ends after having replenished the limbic dopamine levels. Given the direct relation between waking and mesolimbic dopamine, sleep must serve primarily to gain an efficient waking. Pleasant sleep (i.e. emotional sleep), can only exist in animals capable of feeling emotions. Therefore, although sleep-like states have been described in invertebrates and primitive vertebrates, the association sleep-pleasure clearly marks a difference between the sleep of homeothermic vertebrates and cool blooded animals.

A Pause-then-Cancel model of stopping: evidence from basal ganglia neurophysiology

Many studies have implicated the basal ganglia in the suppression of action impulses ('stopping'). Here, we discuss recent neurophysiological evidence that distinct hypothesized processes involved in action preparation and cancellation can be mapped onto distinct basal ganglia cell types and pathways. We examine how movement-related activity in the striatum is related to a 'Go' process and how going may be modulated by brief epochs of beta oscillations. We then describe how, rather than a unitary 'Stop' process, there appear to be separate, complementary 'Pause' and 'Cancel' mechanisms. We discuss the implications of these stopping subprocesses for the interpretation of the stop-signal reaction time-in particular, some activity that seems too slow to causally contribute to stopping when assuming a single Stop processes may actually be fast enough under a Pause-then-Cancel model. Finally, we suggest that combining complementary neural mechanisms that emphasize speed or accuracy respectively may serve more generally to optimize speed-accuracy trade-offs.This article is part of the themed issue 'Movement suppression: brain mechanisms for stopping and stillness'.

Integration of Descending Command Systems for the Generation of Context-Specific Locomotor Behaviors

Over the past decade there has been a renaissance in our understanding of spinal cord circuits; new technologies are beginning to provide key insights into descending circuits which project onto spinal cord central pattern generators. By integrating work from both the locomotor and animal behavioral fields, we can now examine context-specific control of locomotion, with an emphasis on descending modulation arising from various regions of the brainstem. Here we examine approach and avoidance behaviors and the circuits that lead to the production and arrest of locomotion.

Sensorimotor Processing in the Basal Ganglia Leads to Transient Beta Oscillations during Behavior

Brief epochs of beta oscillations have been implicated in sensorimotor control in the basal ganglia of task-performing healthy animals. However, which neural processes underlie their generation and how they are affected by sensorimotor processing remains unclear. To determine the mechanisms underlying transient beta oscillations in the LFP, we combined computational modeling of the subthalamo-pallidal network for the generation of beta oscillations with realistic stimulation patterns derived from single-unit data recorded from different basal ganglia subregions in rats performing a cued choice task. In the recordings, we found distinct firing patterns in the striatum, globus pallidus, and subthalamic nucleus related to sensory and motor events during the behavioral task. Using these firing patterns to generate realistic inputs to our network model led to transient beta oscillations with the same time course as the rat LFP data. In addition, our model can account for further nonintuitive aspects of beta modulation, including beta phase resets after sensory cues and correlations with reaction time. Overall, our model can explain how the combination of temporally regulated sensory responses of the subthalamic nucleus, ramping activity of the subthalamic nucleus, and movement-related activity of the globus pallidus leads to transient beta oscillations during behavior.SIGNIFICANCE STATEMENT Transient beta oscillations emerge in the normal functioning cortico-basal ganglia loop during behavior. Here, we used a unique approach connecting a computational model closely with experimental data. In this way, we achieved a simulation environment for our model that mimics natural input patterns in awake, behaving animals. We demonstrate that a computational model for beta oscillations in Parkinson's disease (PD) can also account for complex patterns of transient beta oscillations in healthy animals. Therefore, we propose that transient beta oscillations in healthy animals share the same mechanism with pathological beta oscillations in PD. This important result connects functional and pathological roles of beta oscillations in the basal ganglia.

Pedunculopontine glutamatergic neurons control spike patterning in substantia nigra dopaminergic neurons

Burst spiking in substantia nigra pars compacta (SNc) dopaminergic neurons is a key signaling event in the circuitry controlling goal-directed behavior. It is widely believed that this spiking mode depends upon an interaction between synaptic activation of N-methyl-D-aspartate receptors (NMDARs) and intrinsic oscillatory mechanisms. However, the role of specific neural networks in burst generation has not been defined. To begin filling this gap, SNc glutamatergic synapses arising from pedunculopotine nucleus (PPN) neurons were characterized using optical and electrophysiological approaches. These synapses were localized exclusively on the soma and proximal dendrites, placing them in a good location to influence spike generation. Indeed, optogenetic stimulation of PPN axons reliably evoked spiking in SNc dopaminergic neurons. Moreover, burst stimulation of PPN axons was faithfully followed, even in the presence of NMDAR antagonists. Thus, PPN-evoked burst spiking of SNc dopaminergic neurons in vivo may not only be extrinsically triggered, but extrinsically patterned as well.

Rethinking the Pedunculopontine Nucleus: From Cellular Organization to Function

The pedunculopontine nucleus (PPN) has long been considered an interface between the basal ganglia and motor systems, and its ability to regulate arousal states puts the PPN in a key position to modulate behavior. Despite the large amount of data obtained over recent decades, a unified theory of its function is still incomplete. By putting together classical concepts and new evidence that dissects the influence of its different neuronal subtypes on their various targets, we propose that the PPN and, in particular, cholinergic neurons have a central role in updating the behavioral state as a result of changes in environmental contingencies. Such a function is accomplished by a combined mechanism that simultaneously restrains ongoing obsolete actions while it facilitates new contextual associations.

Maladaptive Decision Making in Adults with a History of Adolescent Alcohol use, in a Preclinical Model, Is Attributable to the Compromised Assignment of Incentive Value during Stimulus-Reward Learning

According to recent WHO reports, alcohol remains the number one substance used and abused by adolescents, despite public health efforts to curb its use. Adolescence is a critical period of biological maturation where brain development, particularly the mesocorticolimbic dopamine system, undergoes substantial remodeling. These circuits are implicated in complex decision making, incentive learning and reinforcement during substance use and abuse. An appealing theoretical approach has been to suggest that alcohol alters the normal development of these processes to promote deficits in reinforcement learning and decision making, which together make individuals vulnerable to developing substance use disorders in adulthood. Previously we have used a preclinical model of voluntary alcohol intake in rats to show that use in adolescence promotes risky decision making in adulthood that is mirrored by selective perturbations in dopamine network dynamics. Further, we have demonstrated that incentive learning processes in adulthood are also altered by adolescent alcohol use, again mirrored by changes in cue-evoked dopamine signaling. Indeed, we have proposed that these two processes, risk-based decision making and incentive learning, are fundamentally linked through dysfunction of midbrain circuitry where inputs to the dopamine system are disrupted by adolescent alcohol use. Here, we test the behavioral predictions of this model in rats and present the findings in the context of the prevailing literature with reference to the long-term consequences of early-life substance use on the vulnerability to develop substance use disorders. We utilize an impulsive choice task to assess the selectivity of alcohol’s effect on decision-making profiles and conditioned reinforcement to parse out the effect of incentive value attribution, one mechanism of incentive learning. Finally, we use the differential reinforcement of low rates of responding (DRL) task to examine the degree to which behavioral disinhibition may contribute to an overall decision-making profile. The findings presented here support the proposition that early life alcohol use selectively alters risk-based choice behavior through modulation of incentive learning processes, both of which may be inexorably linked through perturbations in mesolimbic circuitry and may serve as fundamental vulnerabilities to the development of substance use disorders.

Activation of Pedunculopontine Glutamate Neurons Is Reinforcing

Dopamine transmission from midbrain ventral tegmental area (VTA) neurons underlies behavioral processes related to motivation and drug addiction. The pedunculopontine tegmental nucleus (PPTg) is a brainstem nucleus containing glutamate-, acetylcholine-, and GABA-releasing neurons with connections to basal ganglia and limbic brain regions. Here we investigated the role of PPTg glutamate neurons in reinforcement, with an emphasis on their projections to VTA dopamine neurons. We used cell-type-specific anterograde tracing and optogenetic methods to selectively label and manipulate glutamate projections from PPTg neurons in mice. We used anatomical, electrophysiological, and behavioral assays to determine their patterns of connectivity and ascribe functional roles in reinforcement. We found that photoactivation of PPTg glutamate cell bodies could serve as a direct positive reinforcer on intracranial self-photostimulation assays. Further, PPTg glutamate neurons directly innervate VTA; photostimulation of this pathway preferentially excites VTA dopamine neurons and is sufficient to induce behavioral reinforcement. These results demonstrate that ascending PPTg glutamate projections can drive motivated behavior, and PPTg to VTA synapses may represent an important target relevant to drug addiction and other mental health disorders.

SIGNIFICANCE STATEMENT

Uncovering brain circuits underlying reward-seeking is an important step toward understanding the circuit bases of drug addiction and other psychiatric disorders. The dopaminergic system emanating from the ventral tegmental area (VTA) plays a key role in regulating reward-seeking behaviors. We used optogenetics to demonstrate that the pedunculopontine tegmental nucleus sends glutamatergic projections to VTA dopamine neurons, and that stimulation of this circuit promotes behavioral reinforcement. The findings support a critical role for pedunculopontine tegmental nucleus glutamate neurotransmission in modulating VTA dopamine neuron activity and behavioral reinforcement.

α6β2 subunit containing nicotinic acetylcholine receptors exert opposing actions on rapid dopamine signaling in the nucleus accumbens of rats with high-versus low-response to novelty

Determining neurobiological factors that contribute to individual variance in drug addiction vulnerability allows for identification of at-risk populations, use of preventative measures and personalized medicine in the treatment of substance use disorders. Rodents that exhibit high locomotor activity when exploring an inescapable novel environment (high-responder; HR) are more susceptible to the reinforcing effects of many abused compounds, including nicotine, as compared to animals that exhibit low locomotor activity (low-responder; LR). Given that nicotinic acetylcholine receptor (nAChR) modulation of reward-related dopamine signaling at accumbal dopamine terminals is critical for the acquisition of drug self-administration, we hypothesized that nAChR modulation of dopamine release would be predicted by an animal's novelty response. Using voltammetry in the nucleus accumbens core of rats, we found that nicotine produced opposite effects in HR and LR animals on stimulation frequencies that model phasic dopamine release, whereby release magnitude was either augmented or attenuated, respectively. Further, nicotine suppressed dopamine release elected by stimulation frequencies that model tonic release in LR animals, but had no effect in HR animals. The differential effects of nicotine were likely due to desensitization of nAChRs, since the nAChR antagonists mecamylamine (non-selective, 2 μM), dihydro-beta-erythroidine (β2-selective, 500 nM), and α-conotoxin MII [H9A; L15A] (α6-selective, 100 nM) produced effects similar to nicotine. Moreover, dihydro-beta-erythroidine failed to show differential effects in HR and LR rats when applied after α-conotoxin MII [H9A; L15A], suggesting a critical role of α6β2 compared non α6-containing nAChRs in the differential effects observed in these phenotypes. These results delineate a potential mechanism for individual variability in behavioral sensitivity to nicotine.

Habenula-Induced Inhibition of Midbrain Dopamine Neurons Is Diminished by Lesions of the Rostromedial Tegmental Nucleus

Neurons in the lateral habenula (LHb) are transiently activated by aversive events and have been implicated in associative learning. Functional changes associated with tonic and phasic activation of the LHb are often attributed to a corresponding inhibition of midbrain dopamine (DA) neurons. Activation of GABAergic neurons in the rostromedial tegmental nucleus (RMTg), a region that receives dense projections from the LHb and projects strongly to midbrain monoaminergic nuclei, is believed to underlie the transient inhibition of DA neurons attributed to activation of the LHb. To test this premise, the effects of axon-sparing lesions of the RMTg were assessed on LHb-induced inhibition of midbrain DA cell firing in anesthetized rats. Quinolinic acid lesions decreased the number of NeuN-positive neurons in the RMTg significantly while largely sparing cells in neighboring regions. Lesions of the RMTg reduced both the number of DA neurons inhibited by, and the duration of inhibition resulting from, LHb stimulation. Although the firing rate was not altered, the regularity of DA cell firing was increased in RMTg-lesioned rats. Locomotor activity in an open field was also elevated. These results are the first to show that RMTg neurons contribute directly to LHb-induced inhibition of DA cell activity and support the widely held proposition that GABAergic neurons in the mesopontine tegmentum are an important component of a pathway that enables midbrain DA neurons to encode the negative valence associated with failed expectations and aversive stimuli.

SIGNIFICANCE STATEMENT

Phasic changes in the activity of midbrain dopamine cells motivate and guide future behavior. Activation of the lateral habenula by aversive events inhibits dopamine neurons transiently, providing a neurobiological representation of learning models that incorporate negative reward prediction errors. Anatomical evidence suggests that this inhibition occurs via the rostromedial tegmental nucleus, but this hypothesis has yet to be tested directly. Here, we show that axon-sparing lesions of the rostromedial tegmentum attenuate habenula-induced inhibition of dopamine neurons significantly. These data support a substantial role for the rostromedial tegmentum in habenula-induced feedforward inhibition of dopamine neurons.

Contribution of synchronized GABAergic neurons to dopaminergic neuron firing and bursting

In the ventral tegmental area (VTA), interactions between dopamine (DA) and γ-aminobutyric acid (GABA) neurons are critical for regulating DA neuron activity and thus DA efflux. To provide a mechanistic explanation of how GABA neurons influence DA neuron firing, we developed a circuit model of the VTA. The model is based on feed-forward inhibition and recreates canonical features of the VTA neurons. Simulations revealed that γ-aminobutyric acid (GABA) receptor (GABAR) stimulation can differentially influence the firing pattern of the DA neuron, depending on the level of synchronization among GABA neurons. Asynchronous activity of GABA neurons provides a constant level of inhibition to the DA neuron and, when removed, produces a classical disinhibition burst. In contrast, when GABA neurons are synchronized by common synaptic input, their influence evokes additional spikes in the DA neuron, resulting in increased measures of firing and bursting. Distinct from previous mechanisms, the increases were not based on lowered firing rate of the GABA neurons or weaker hyperpolarization by the GABAR synaptic current. This phenomenon was induced by GABA-mediated hyperpolarization of the DA neuron that leads to decreases in intracellular calcium (Ca2+) concentration, thus reducing the Ca2+-dependent potassium (K+) current. In this way, the GABA-mediated hyperpolarization replaces Ca2+-dependent K+ current; however, this inhibition is pulsatile, which allows the DA neuron to fire during the rhythmic pauses in inhibition. Our results emphasize the importance of inhibition in the VTA, which has been discussed in many studies, and suggest a novel mechanism whereby computations can occur locally.

Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons

Dopamine neurons encode the difference between actual and predicted reward, or reward prediction error (RPE). Although many models have been proposed to account for this computation, it has been difficult to test these models experimentally. Here we established an awake electrophysiological recording system, combined with rabies virus and optogenetic cell-type identification, to characterize the firing patterns of monosynaptic inputs to dopamine neurons while mice performed classical conditioning tasks. We found that each variable required to compute RPE, including actual and predicted reward, was distributed in input neurons in multiple brain areas. Further, many input neurons across brain areas signaled combinations of these variables. These results demonstrate that even simple arithmetic computations such as RPE are not localized in specific brain areas but, rather, distributed across multiple nodes in a brain-wide network. Our systematic method to examine both activity and connectivity revealed unexpected redundancy for a simple computation in the brain.

Pontomesencephalic Tegmental Afferents to VTA Non-dopamine Neurons Are Necessary for Appetitive Pavlovian Learning

The ventral tegmental area (VTA) receives phenotypically distinct innervations from the pedunculopontine tegmental nucleus (PPTg). While PPTg-to-VTA inputs are thought to play a critical role in stimulus-reward learning, direct evidence linking PPTg-to-VTA phenotypically distinct inputs in the learning process remains lacking. Here, we used optogenetic approaches to investigate the functional contribution of PPTg excitatory and inhibitory inputs to the VTA in appetitive Pavlovian conditioning. We show that photoinhibition of PPTg-to-VTA cholinergic or glutamatergic inputs during cue presentation dampens the development of anticipatory approach responding to the food receptacle during the cue. Furthermore, we employed in vivo optetrode recordings to show that photoinhibition of PPTg cholinergic or glutamatergic inputs significantly decreases VTA non-dopamine (non-DA) neural activity. Consistently, photoinhibition of VTA non-DA neurons disrupts the development of cue-elicited anticipatory approach responding. Taken together, our study reveals a crucial regulatory mechanism by PPTg excitatory inputs onto VTA non-DA neurons during appetitive Pavlovian conditioning.

Segregated cholinergic transmission modulates dopamine neurons integrated in distinct functional circuits

Dopamine neurons in the ventral tegmental area (VTA) receive cholinergic innervation from brainstem structures that are associated with either movement or reward. Whereas cholinergic neurons of the pedunculopontine nucleus (PPN) carry an associative/motor signal, those of the laterodorsal tegmental nucleus (LDT) convey limbic information. We used optogenetics and in vivo juxtacellular recording and labeling to examine the influence of brainstem cholinergic innervation of distinct neuronal subpopulations in the VTA. We found that LDT cholinergic axons selectively enhanced the bursting activity of mesolimbic dopamine neurons that were excited by aversive stimulation. In contrast, PPN cholinergic axons activated and changed the discharge properties of VTA neurons that were integrated in distinct functional circuits and were inhibited by aversive stimulation. Although both structures conveyed a reinforcing signal, they had opposite roles in locomotion. Our results demonstrate that two modes of cholinergic transmission operate in the VTA and segregate the neurons involved in different reward circuits.

Pedunculopontine tegmental nucleus lesions impair probabilistic reversal learning by reducing sensitivity to positive reward feedback

Recent findings indicate that pedunculopontine tegmental nucleus (PPTg) neurons encode reward-related information that is context-dependent. This information is critical for behavioral flexibility when reward outcomes change signaling a shift in response patterns should occur. The present experiment investigated whether NMDA lesions of the PPTg affects the acquisition and/or reversal learning of a spatial discrimination using probabilistic reinforcement. Male Long-Evans rats received a bilateral infusion of NMDA (30nmoles/side) or saline into the PPTg. Subsequently, rats were tested in a spatial discrimination test using a probabilistic learning procedure. One spatial location was rewarded with an 80% probability and the other spatial location rewarded with a 20% probability. After reaching acquisition criterion of 10 consecutive correct trials, the spatial location - reward contingencies were reversed in the following test session. Bilateral and unilateral PPTg-lesioned rats acquired the spatial discrimination test comparable to that as sham controls. In contrast, bilateral PPTg lesions, but not unilateral PPTg lesions, impaired reversal learning. The reversal learning deficit occurred because of increased regressions to the previously 'correct' spatial location after initially selecting the new, 'correct' choice. PPTg lesions also reduced the frequency of win-stay behavior early in the reversal learning session, but did not modify the frequency of lose-shift behavior during reversal learning. The present results suggest that the PPTg contributes to behavioral flexibility under conditions in which outcomes are uncertain, e.g. probabilistic reinforcement, by facilitating sensitivity to positive reward outcomes that allows the reliable execution of a new choice pattern.

Reversal of Alcohol-Induced Dysregulation in Dopamine Network Dynamics May Rescue Maladaptive Decision-making

Alcohol is the most commonly abused substance among adolescents, promoting the development of substance use disorders and compromised decision-making in adulthood. We have previously demonstrated, with a preclinical model in rodents, that adolescent alcohol use results in adult risk-taking behavior that positively correlates with phasic dopamine transmission in response to risky options, but the underlying mechanisms remain unknown. Here, we show that adolescent alcohol use may produce maladaptive decision-making through a disruption in dopamine network dynamics via increased GABAergic transmission within the ventral tegmental area (VTA). Indeed, we find that increased phasic dopamine signaling after adolescent alcohol use is attributable to a midbrain circuit, including the input from the pedunculopontine tegmentum to the VTA. Moreover, we demonstrate that VTA dopamine neurons from adult rats exhibit enhanced IPSCs after adolescent alcohol exposure corresponding to decreased basal dopamine levels in adulthood that negatively correlate with risk-taking. Building on these findings, we develop a model where increased inhibitory tone on dopamine neurons leads to a persistent decrease in tonic dopamine levels and results in a potentiation of stimulus-evoked phasic dopamine release that may drive risky choice behavior. Based on this model, we take a pharmacological approach to the reversal of risk-taking behavior through normalization of this pattern in dopamine transmission. These results isolate the underlying circuitry involved in alcohol-induced maladaptive decision-making and identify a novel therapeutic target.

SIGNIFICANCE STATEMENT

One of the primary problems resulting from chronic alcohol use is persistent, maladaptive decision-making that is associated with ongoing addiction vulnerability and relapse. Indeed, studies with the Iowa Gambling Task, a standard measure of risk-based decision-making, have reliably shown that alcohol-dependent individuals make riskier, more maladaptive choices than nondependent individuals, even after periods of prolonged abstinence. Using a preclinical model, in the current work, we identify a selective disruption in dopamine network dynamics that may promote maladaptive decision-making after chronic adolescent alcohol use and demonstrate its pharmacological reversal in adulthood. Together, these results highlight a novel neural mechanism underlying heightened risk-taking behavior in alcohol-dependent individuals and provide a potential therapeutic target for further investigation.

Complex Multiplexing of Reward-Cue- and Licking-Movement-Related Activity in Single Midline Thalamus Neurons

Midline thalamus is implicated in linking visceral and exteroceptive sensory information with behavior. However, whether neuronal activity is modulated with temporal precision by cues and actions in real time is unknown. Using single-neuron recording and a Pavlovian visual-cue/liquid-reward association task in rats, we discovered phasic responses to sensory cues, appropriately timed to modify information processing in output targets, as well as tonic modulations within and between trials that were differentially reward modulated, which may have distinct arousal functions. Many of the cue-responsive neurons also responded to repetitive licks, consistent with sensorimotor integration. Further, some lick-related neurons were activated only by the first rewarded lick and only if that lick were also part of a conditioned response sequence initiated earlier, consistent with binding action decisions to their ensuing outcome. This rich repertoire of responses provides electrophysiological evidence for midline thalamus as a site of complex information integration for reward-mediated behavior.

SIGNIFICANCE STATEMENT

Disparate brain circuits are involved in sensation, movement, and reward information. These must interact in order for the relationships between cues, actions, and outcomes to be learned. We found that responses of single neurons in midline thalamus to sensory cues are increased when associated with reward. This output may amplify similar signals generated in parallel by the dopamine system. In addition, some neurons coded a three-factor decision in which the neuron fired only if there was a movement, if it was the first one after the reward becoming available, and if it was part of a sequence triggered in response to a preceding cue. These data highlight midline thalamus as an important node integrating multiple types of information for linking sensation, actions, and rewards.

Structural and functional considerations of the cholinergic brainstem

Cholinergic neurons of the brainstem have traditionally been associated with a role in wakefulness as part of the reticular activating system, but their function cannot be explained solely on the basis of their modulation of the brain state. Recent findings about their connectivity and functional heterogeneity suggest a wider role in behavior, where basal ganglia is at the center of their influence. This review focuses on recent findings that suggest an intrinsic functional organization of the cholinergic brainstem that is closely correlated with its connectivity with midbrain and forebrain circuits. Furthermore, recent evidence on the temporal structure of the activation of brainstem cholinergic neurons reveals fundamental aspects about the nature of cholinergic signaling. Consideration of the cholinergic brainstem complex in the context of wider brain circuits is critical to understand its contribution to normal behavior.

The pedunculopontine tegmental nucleus-A functional hypothesis from the comparative literature

We present data from animal studies showing that the pedunculopontine tegmental nucleus-conserved through evolution, compartmentalized, and with a complex pattern of inputs and outputs-has functions that involve formation and updates of action-outcome associations, attention, and rapid decision making. This is in contrast to previous hypotheses about pedunculopontine function, which has served as a basis for clinical interest in the pedunculopontine in movement disorders. Current animal literature points to it being neither a specifically motor structure nor a master switch for sleep regulation. The pedunculopontine is connected to basal ganglia circuitry but also has primary sensory input across modalities and descending connections to pontomedullary, cerebellar, and spinal motor and autonomic control systems. Functional and anatomical studies in animals suggest strongly that, in addition to the pedunculopontine being an input and output station for the basal ganglia and key regulator of thalamic (and consequently cortical) activity, an additional major function is participation in the generation of actions on the basis of a first-pass analysis of incoming sensory data. Such a function-rapid decision making-has very high adaptive value for any vertebrate. We argue that in developing clinical strategies for treating basal ganglia disorders, it is necessary to take an account of the normal functions of the pedunculopontine. We believe that it is possible to use our hypothesis to explain why pedunculopontine deep brain stimulation used clinically has had variable outcomes in the treatment of parkinsonism motor symptoms and effects on cognitive processing. © 2016 International Parkinson and Movement Disorder Society.

Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural Circuitry

Midbrain dopamine (DA) neurons are proposed to signal reward prediction error (RPE), a fundamental parameter in associative learning models. This RPE hypothesis provides a compelling theoretical framework for understanding DA function in reward learning and addiction. New studies support a causal role for DA-mediated RPE activity in promoting learning about natural reward; however, this question has not been explicitly tested in the context of drug addiction. In this review, we integrate theoretical models with experimental findings on the activity of DA systems, and on the causal role of specific neuronal projections and cell types, to provide a circuit-based framework for probing DA-RPE function in addiction. By examining error-encoding DA neurons in the neural network in which they are embedded, hypotheses regarding circuit-level adaptations that possibly contribute to pathological error signaling and addiction can be formulated and tested.

Reward functions of the basal ganglia

Besides their fundamental movement function evidenced by Parkinsonian deficits, the basal ganglia are involved in processing closely linked non-motor, cognitive and reward information. This review describes the reward functions of three brain structures that are major components of the basal ganglia or are closely associated with the basal ganglia, namely midbrain dopamine neurons, pedunculopontine nucleus, and striatum (caudate nucleus, putamen, nucleus accumbens). Rewards are involved in learning (positive reinforcement), approach behavior, economic choices and positive emotions. The response of dopamine neurons to rewards consists of an early detection component and a subsequent reward component that reflects a prediction error in economic utility, but is unrelated to movement. Dopamine activations to non-rewarded or aversive stimuli reflect physical impact, but not punishment. Neurons in pedunculopontine nucleus project their axons to dopamine neurons and process sensory stimuli, movements and rewards and reward-predicting stimuli without coding outright reward prediction errors. Neurons in striatum, besides their pronounced movement relationships, process rewards irrespective of sensory and motor aspects, integrate reward information into movement activity, code the reward value of individual actions, change their reward-related activity during learning, and code own reward in social situations depending on whose action produces the reward. These data demonstrate a variety of well-characterized reward processes in specific basal ganglia nuclei consistent with an important function in non-motor aspects of motivated behavior.