Activity in mouse pedunculopontine tegmental nucleus reflects action and outcome in a decision-making task

The mesopontine tegmentum in reward and aversion: From cellular heterogeneity to behaviour

The mesopontine tegmentum, comprising the pedunculopontine tegmentum (PPN) and the laterodorsal tegmentum (LDT), is intricately connected to various regions of the basal ganglia, motor systems, and limbic systems. The PPN and LDT can regulate the activity of different brain regions of these target systems, and in this way are in a privileged position to modulate motivated behaviours. Despite recent findings, the PPN and LDT have been largely overlooked in discussions about the neural circuits associated with reward and aversion. This review aims to provide a timely and comprehensive resource on past and current research, highlighting the PPN and LDT's connectivity and influence on basal ganglia and limbic, and motor systems. Seminal studies, including lesion, pharmacological, and optogenetic/chemogenetic approaches, demonstrate their critical roles in modulating reward/aversive behaviours. The review emphasizes the need for further investigation into the associated cellular mechanisms, in order to clarify their role in behaviour and contribution for different neuropsychiatric disorders.

The Basal Ganglia and Mesencephalic Locomotor Region Connectivity Matrix

Although classically considered a relay station for basal ganglia (BG) output, the anatomy, connectivity, and function of the mesencephalic locomotor region (MLR) were redefined during the last two decades. In striking opposition to what was initially thought, MLR and BG are actually reciprocally and intimately interconnected. New viral-based, optogenetic, and mapping technologies revealed that cholinergic, glutamatergic, and GABAergic neurons coexist in this structure, which, in addition to extending descending projections, send long-range ascending fibers to the BG. These MLR projections to the BG convey motor and non-motor information to specific synaptic targets throughout different nuclei. Moreover, MLR efferent fibers originate from precise neuronal subpopulations located in particular MLR subregions, defining independent anatomo-functional subcircuits involved in particular aspects of animal behavior such as fast locomotion, explorative locomotion, posture, forelimb- related movements, speed, reinforcement, among others. In this review, we revised the literature produced during the last decade linking MLR and BG. We conclude that the classic framework considering the MLR as a homogeneous output structure passively receiving input from the BG needs to be revisited. We propose instead that the multiple subcircuits embedded in this region should be taken as independent entities that convey relevant and specific ascending information to the BG and, thus, actively participate in the execution and tuning of behavior.

Mixed representations of sound and action in the auditory midbrain

Linking sensory input and its consequences is a fundamental brain operation. Accordingly, neural activity of neo-cortical and limbic systems often reflects dynamic combinations of sensory and behaviorally relevant variables, and these "mixed representations" are suggested to be important for perception, learning, and plasticity. However, the extent to which such integrative computations might occur in brain regions upstream of the forebrain is less clear. Here, we conduct cellular-resolution 2-photon Ca2+ imaging in the superficial "shell" layers of the inferior colliculus (IC), as head-fixed mice of either sex perform a reward-based psychometric auditory task. We find that the activity of individual shell IC neurons jointly reflects auditory cues and mice's actions, such that trajectories of neural population activity diverge depending on mice's behavioral choice. Consequently, simple classifier models trained on shell IC neuron activity can predict trial-by-trial outcomes, even when training data are restricted to neural activity occurring prior to mice's instrumental actions. Thus in behaving animals, auditory midbrain neurons transmit a population code that reflects a joint representation of sound and action.

Characterization of three cholinergic inputs to the cochlear nucleus

Acetylcholine modulates responses throughout the auditory system, including at the earliest brain level, the cochlear nucleus (CN). Previous studies have shown multiple sources of cholinergic input to the CN but information about their relative contributions and the distribution of inputs from each source is lacking. Here, we used staining for cholinergic axons and boutons, retrograde tract tracing, and acetylcholine-selective anterograde tracing to characterize three sources of acetylcholine input to the CN in mice. Staining for cholinergic axons showed heavy cholinergic inputs to granule cell areas and the dorsal CN with lighter input to the ventral CN. Retrograde tract tracing revealed that cholinergic cells from the superior olivary complex, pontomesencephalic tegmentum, and lateral paragigantocellular nucleus send projections to the CN. When we selectively labeled cholinergic axons from each source to the CN, we found surprising similarities in their terminal distributions, with patterns that were overlapping rather than complementary. Each source heavily targeted granule cell areas and the dorsal CN (especially the deep dorsal CN) and sent light input into the ventral CN. Our results demonstrate convergence of cholinergic inputs from multiple sources in most regions of the CN and raise the possibility of convergence onto single CN cells. Linking sources of acetylcholine and their patterns of activity to modulation of specific cell types in the CN will be an important next step in understanding cholinergic modulation of early auditory processing.

The Pedunculopontine Tegmental Nucleus is not Important for Breathing Impairments Observed in a Parkinson's Disease Model

Parkinson's disease (PD) is a motor disorder resulting from degeneration of dopaminergic neurons of substantia nigra pars compacta (SNpc), with classical and non-classical symptoms such as respiratory instability. An important region for breathing control, the Pedunculopontine Tegmental Nucleus (PPTg), is composed of cholinergic, glutamatergic, and GABAergic neurons. We hypothesize that degenerated PPTg neurons in a PD model contribute to the blunted respiratory activity. Adult mice (40 males and 29 females) that express the fluorescent green protein in cholinergic, glutamatergic or GABAergic cells were used (Chat-cre Ai6, Vglut₂-cre Ai6 and Vgat-cre Ai6) and received bilateral intrastriatal injections of vehicle or 6-hydroxydopamine (6-OHDA). Ten days later, the animals were exposed to hypercapnia or hypoxia to activate PPTg neurons. Vglut₂-cre Ai6 animals also received retrograde tracer injections (cholera toxin b) into the retrotrapezoid nucleus (RTN) or preBötzinger Complex (preBötC) and anterograde tracer injections (AAV-mCherry) into the SNpc. In 6-OHDA-injected mice, there is a 77% reduction in the number of dopaminergic neurons in SNpc without changing the number of neurons in the PPTg. Hypercapnia activated fewer Vglut₂ neurons in PD, and hypoxia did not activate PPTg neurons. PPTg neurons do not input RTN or preBötC regions but receive projections from SNpc. Although our results did not show a reduction in the number of glutamatergic neurons in PPTg, we observed a reduction in the number of neurons activated by hypercapnia in the PD animal model, suggesting that PPTg may participate in the hypercapnia ventilatory response.

Neuronal structures controlling locomotor behavior during active and inactive motor states

Animal behaviors can be divided into two states according to their motor activity: the active motor state, which involves significant body movements, and the inactive motor state, which refers to when the animal is stationary. The timing and duration of these states are determined by the activity of the neuronal circuits involved in motor control. Among these motor circuits, those that generate locomotion are some of the most studied neuronal networks and are widely distributed from the spinal cord to the cerebral cortex. In this review, we discuss recent discoveries, mainly in rodents using state-of-the-art experimental approaches, of the neuronal mechanisms underlying the initiation and termination of locomotion in the brainstem, basal ganglia, and prefrontal cortex. These findings is discussed with reference to studies on the neuronal mechanism of motor control during sleep and the modulation of cortical states in these structures. Accumulating evidence has unraveled the complex yet highly structured network that controls the transition between motor states.

Glutamatergic pedunculopontine tegmental neurons control wakefulness and locomotion via distinct axonal projections

STUDY OBJECTIVES

The pedunculopontine tegmental (PPT) nucleus is implicated in many brain functions, ranging from sleep/wake control and locomotion, to reward mechanisms and learning. The PPT contains cholinergic, GABAergic, and glutamatergic neurons with extensive ascending and descending axonal projections. Glutamatergic PPT (PPTvGlut2) neurons are thought to promote wakefulness, but the mechanisms through which this occurs are unknown. In addition, some researchers propose that PPTvGlut2 neurons promote locomotion, yet even though the PPT is a target for deep brain stimulation in Parkinson's disease, the role of the PPT in locomotion is debated. We hypothesized that PPTvGluT2 neurons drive arousal and specific waking behaviors via certain projections and modulate locomotion via others.

METHODS

We mapped the axonal projections of PPTvGlut2 neurons using conditional anterograde tracing and then photostimulated PPTvGlut2 soma or their axon terminal fields across sleep/wake states and analyzed sleep/wake behavior, muscle activity, and locomotion in transgenic mice.

RESULTS

We found that stimulation of PPTvGlut2 soma and their axon terminals rapidly triggered arousals from non-rapid eye movement sleep, especially with activation of terminals in the basal forebrain (BF) and lateral hypothalamus (LH). With photoactivation of PPTvGlut2 terminals in the BF and LH, this wakefulness was accompanied by locomotion and other active behaviors, but stimulation of PPTvGlut2 soma and terminals in the substantia nigra triggered only quiet wakefulness without locomotion.

CONCLUSIONS

These findings demonstrate the importance of the PPTvGluT2 neurons in driving various aspects of arousal and show that heterogeneous brain nuclei, such as the PPT, can promote a variety of behaviors via distinct axonal projections.

Motor context modulates substantia nigra pars reticulata spike activity in patients with Parkinson's disease

OBJECTIVE

The severity of motor symptoms in Parkinson's disease (PD) depends on environmental conditions. For example, the presence of external patterns such as a rhythmic tone can attenuate bradykinetic impairments. However, the neural mechanisms for this context-dependent attenuation (e.g., paradoxical kinesis) remain unknown. Here, we investigate whether context-dependent symptom attenuation is reflected in single-unit activity recorded in the operating room from the substantia nigra pars reticulata (SNr) of patients with PD undergoing deep brain stimulation surgery. The SNr is known to influence motor planning and execution in animal models, but its role in humans remains understudied.

METHODS

We recorded SNr activity while subjects performed cued directional movements in response to auditory stimuli under interleaved 'patterned' and 'unpatterned' contexts. SNr localisation was independently confirmed with expert intraoperative assessment as well as post hoc imaging-based reconstructions.

RESULTS

As predicted, we found that motor performance was improved in the patterned context, reflected in increased reaction speed and accuracy compared with the unpatterned context. These behavioural differences were associated with enhanced responsiveness of SNr neurons-that is, larger changes in activity from baseline-in the patterned context. Unsupervised clustering analysis revealed two distinct subtypes of SNr neurons: one exhibited context-dependent enhanced responsiveness exclusively during movement preparation, whereas the other showed enhanced responsiveness during portions of the task associated with both motor and non-motor processes.

CONCLUSIONS

Our findings indicate the SNr participates in motor planning and execution, as well as warrants greater attention in the study of human sensorimotor integration and as a target for neuromodulatory therapies.

Cholinergic neurons in the pedunculopontine nucleus guide reversal learning by signaling the changing reward contingency

Cognitive flexibility enables effective switching between mental processes to generate appropriate responses. Cholinergic neurons (CNs) within the pedunculopontine nucleus (PPN) are associated with many functions, but their contribution to cognitive flexibility remains poorly understood. Here we measure PPN cholinergic activities using calcium indicators during the attentional set-shifting task. We find that PPN CNs exhibit increasing activities correlated with rewards during each stage and error trials in reversal stages, indicating sensitivity to rule switching. Inhibition of PPN cholinergic activity selectively impairs reversal learning, which improves with PPN CN activation. Activation of PPN CNs projecting to the substantia nigra pars compacta, mediodorsal thalamus, and parafascicular nucleus in a time-locked manner with reward improves reversal learning. Therefore, PPN CNs may encode not only reward signals but also the information of changing reward contingency that contributes to guiding reversal learning through output projections to multiple nuclei that participate in flexibility.

Targeted activation of midbrain neurons restores locomotor function in mouse models of parkinsonism

The pedunculopontine nucleus (PPN) is a locomotor command area containing glutamatergic neurons that control locomotor initiation and maintenance. These motor actions are deficient in Parkinson’s disease (PD), where dopaminergic neurodegeneration alters basal ganglia activity. Being downstream of the basal ganglia, the PPN may be a suitable target for ameliorating parkinsonian motor symptoms. Here, we use in vivo cell-type specific PPN activation to restore motor function in two mouse models of parkinsonism made by acute pharmacological blockage of dopamine transmission. With a combination of chemo- and opto-genetics, we show that excitation of caudal glutamatergic PPN neurons can normalize the otherwise severe locomotor deficit in PD, whereas targeting the local GABAergic population only leads to recovery of slow locomotion. The motor rescue driven by glutamatergic PPN activation is independent of activity in nearby locomotor promoting glutamatergic Cuneiform neurons. Our observations point to caudal glutamatergic PPN neurons as a potential target for neuromodulatory restoration of locomotor function in PD.

Here, the authors use cell-type specific stimulation of brainstem neurons within the caudal pedunculopontine nucleus to show that activation of excitatory neurons can normalize severe locomotor deficit in mouse models of parkinsonism. The study defines a potential target for neuromodulatory restoration of locomotor function in Parkinson’s disease.

Disrupted basal ganglia output during movement preparation in hemiparkinsonian mice is consistent with behavioral deficits

Parkinsonian motor deficits are associated with elevated inhibitory output from the basal ganglia (BG). However, several features of Parkinson's disease (PD) have not been accounted for by this simple "classical rate model" framework, including the observation in patients with PD that movements guided by external stimuli are less impaired than otherwise identical movements generated based on internal goals. Is this difference due to divergent processing within the BG itself or due to the recruitment of extra-BG pathways by sensory processing? In addition, surprisingly little is known about precisely when, in the sequence from selecting to executing movements, BG output is altered by PD. Here, we address these questions by recording activity in the substantia nigra pars reticulata (SNr), a key BG output nucleus, in hemiparkinsonian mice performing a well-controlled behavioral task requiring stimulus-guided and internally specified directional movements. We found that hemiparkinsonian mice exhibited a bias ipsilateral to the side of dopaminergic cell loss that was stronger when movements were internally specified rather than stimulus guided, consistent with clinical observations in patients with Parkinson's disease. We further found that changes in parkinsonian SNr activity during movement preparation were consistent with the ipsilateral behavioral bias, as well as its greater magnitude for internally specified movements. Although these findings are inconsistent with some aspects of the classical rate model, they are accounted for by a related "directional rate model" positing that SNr output phasically overinhibits motor output in a direction-specific manner. These results suggest that parkinsonian changes in BG output underlying movement preparation contribute to the greater deficit in internally specified than stimulus-guided movements.NEW & NOTEWORTHY Movements of patients with Parkinson's disease are often less impaired when guided by external stimuli than when generated based on internal goals. Whether this effect is due to distinct processing in the basal ganglia (BG) or due to compensation from other motor pathways is an open question with therapeutic implications. We recorded BG output in behaving parkinsonian mice and found that BG activity during movement preparation was consistent with the differences between these forms of movement.

A Causal Role for the Pedunculopontine Nucleus in Human Instrumental Learning

A critical mechanism for maximizing reward is instrumental learning. In standard instrumental learning models, action values are updated on the basis of reward prediction errors (RPEs), defined as the discrepancy between expectations and outcomes. A wealth of evidence across species and experimental techniques has established that RPEs are signaled by midbrain dopamine neurons. However, the way dopamine neurons receive information about reward outcomes remains poorly understood. Recent animal studies suggest that the pedunculopontine nucleus (PPN), a small brainstem structure considered as a locomotor center, is sensitive to reward and sends excitatory projection to dopaminergic nuclei. Here, we examined the hypothesis that the PPN could contribute to reward learning in humans. To this aim, we leveraged a clinical protocol that assessed the therapeutic impact of PPN deep-brain stimulation (DBS) in three patients with Parkinson disease. PPN local field potentials (LFPs), recorded while patients performed an instrumental learning task, showed a specific response to reward outcomes in a low-frequency (alpha-beta) band. Moreover, PPN DBS selectively improved learning from rewards but not from punishments, a pattern that is typically observed following dopaminergic treatment. Computational analyses indicated that the effect of PPN DBS on instrumental learning was best captured by an increase in subjective reward sensitivity. Taken together, these results support a causal role for PPN-mediated reward signals in human instrumental learning.

Deciphering midbrain mechanisms underlying prepulse inhibition of startle

Prepulse inhibition (PPI) is an operational measure of sensorimotor gating. Deficits of PPI are a hallmark of schizophrenia and associated with several other psychiatric illnesses such as e.g. autism spectrum disorder, yet the mechanisms underlying PPI are still not fully understood. There is growing evidence contradicting the long-standing hypothesis that PPI is mediated by a short feed-forward midbrain circuitry including inhibitory cholinergic projections from the pedunculopontine tegmental nucleus (PPTg) to the startle pathway. Here, we employed a chemogenetic approach to explore the involvement of the PPTg in general, and cholinergic neurons specifically, in PPI. Activation of inhibitory DREADDs (designer receptors exclusively activated by designer drugs) in the PPTg by systemic administration of clozapine-N-oxide (CNO) disrupted PPI, confirming the involvement of the PPTg in PPI. In contrast, chemogenetic inhibition of specifically cholinergic PPTg neurons had no effect on PPI, but inhibited morphine-induced conditioned place preference (CPP) in the same animals, showing that the DREADDs were effective in modulating behavior. These findings support a functional role of the PPTg and/or neighboring structures in PPI in accordance with previous lesion studies, but also provide strong evidence against the hypothesis that specifically cholinergic PPTg neurons are involved in mediating PPI, implicating rather non-cholinergic midbrain neurons.

Dichotomy between motor and cognitive functions of midbrain cholinergic neurons

Cholinergic neurons of the pedunculopontine nucleus (PPN) are interconnected with all the basal ganglia structures, as well as with motor centers in the brainstem and medulla. Recent theories put into question whether PPN cholinergic neurons form part of a locomotor region that directly regulates the motor output, and rather suggest a modulatory role in adaptive behavior involving both motor and cognitive functions. In support of this, experimental studies in animals suggest that cholinergic neurons reinforce actions by signaling reward prediction and shape adaptations in behavior during changes of environmental contingencies. This is further supported by clinical studies proposing that decreased cholinergic transmission originated in the PPN is associated with impaired sensorimotor integration and perseverant behavior, giving rise to some of the symptoms observed in Parkinson's disease and progressive supranuclear palsy. Altogether, the evidence suggests that cholinergic neurons of the PPN, mainly through their interactions with the basal ganglia, have a leading role in action control.

Spatial representations in the superior colliculus are modulated by competition among targets

Selecting and moving to spatial targets are critical components of goal-directed behavior, yet their neural bases are not well understood. The superior colliculus (SC) is thought to contain a topographic map of contralateral space in which the activity of specific neuronal populations corresponds to particular spatial locations. However, these spatial representations are modulated by several decision-related variables, suggesting that they reflect information beyond simply the location of an upcoming movement. Here, we examine the extent to which these representations arise from competitive spatial choice. We recorded SC activity in male mice performing a behavioral task requiring orienting movements to targets for a water reward in two contexts. In "competitive" trials, either the left or right target could be rewarded, depending on which stimulus was presented at the central port. In "noncompetitive" trials, the same target (e.g., left) was rewarded throughout an entire block. While both trial types required orienting movements to the same spatial targets, only in competitive trials do targets compete for selection. We found that in competitive trials, pre-movement SC activity predicted movement to contralateral targets, as expected. However, in noncompetitive trials, some neurons lost their spatial selectivity and in others activity predicted movement to ipsilateral targets. Consistent with these findings, unilateral optogenetic inactivation of pre-movement SC activity ipsiversively biased competitive, but not noncompetitive, trials. Incorporating these results into an attractor model of SC activity points to distinct pathways for orienting movements under competitive and noncompetitive conditions, with the SC specifically required for selecting among multiple potential targets.

What, If, and When to Move: Basal Ganglia Circuits and Self-Paced Action Initiation

Deciding what to do and when to move is vital to our survival. Clinical and fundamental studies have identified basal ganglia circuits as critical for this process. The main input nucleus of the basal ganglia, the striatum, receives inputs from frontal, sensory, and motor cortices and interconnected thalamic areas that provide information about potential goals, context, and actions and directly or indirectly modulates basal ganglia outputs. The striatum also receives dopaminergic inputs that can signal reward prediction errors and also behavioral transitions and movement initiation. Here we review studies and models of how direct and indirect pathways can modulate basal ganglia outputs to facilitate movement initiation, and we discuss the role of cortical and dopaminergic inputs to the striatum in determining what to do and if and when to do it. Complex but exciting scenarios emerge that shed new light on how basal ganglia circuits modulate self-paced movement initiation.

The Role of Cholinergic Midbrain Neurons in Startle and Prepulse Inhibition

One of the two major cholinergic centers of the mammalian brain is located in the midbrain, i.e., the pedunculopontine tegmentum (PPTg) and the adjacent laterodorsal tegmentum. These cholinergic neurons have been shown to be important for e.g., arousal, reward associations, and sleep. They also have been suggested to mediate sensorimotor gating, measured as prepulse inhibition of startle (PPI). PPI disruptions are a hallmark of schizophrenia and are observed in various other psychiatric disorders, where they are associated with, and often predictive of, other cognitive symptoms. PPI has been proposed to be mediated by a short midbrain circuitry including inhibitory cholinergic projections from PPTg to the startle pathway. Although the data indicating the involvement of the PPTg is very robust, some more recent evidence challenges that there is a cholinergic contribution to PPI. We here use transient optogenetic activation of specifically the cholinergic PPTg neurons in male and female rats to address their role in startle modulation in general, and in PPI specifically. Although we could confirm the crucial role of PPTg cholinergic neurons in associative reward learning, validating our experimental approach, we found that activation of cholinergic PPTg neurons did not inhibit startle responses. In contrast, activation of cholinergic PPTg neurons enhanced startle, which is in accordance with their general role in arousal and indicate a potential involvement in sensitization of startle. We conclude that noncholinergic PPTg neurons mediate PPI in contrast to the longstanding hypothetical view that PPI is mediated by cholinergic PPTg neurons.SIGNIFICANCE STATEMENT Activation of cholinergic neurons in the midbrain has been assumed to mediate prepulse inhibition of startle (PPI), a common measure of sensorimotor gating that is disrupted in schizophrenia and other psychiatric disorders. We here revisit this long-standing hypothesis using optogenetic activation of these specific neurons combined with startle testing in rats. In contrast to the hypothetical role of these neurons in startle modulation, we show that their activation leads to an increase of baseline startle and to prepulse facilitation. This supports recent data by others that have started to cast some doubt on the cholinergic hypothesis of PPI, and calls for a revision of the theoretical construct of PPI mechanisms.

Distinct Contributions of Mesencephalic Locomotor Region Nuclei to Locomotor Control in the Freely Behaving Mouse

The mesencephalic locomotor region (MLR) has been initially identified as a supraspinal center capable of initiating and modulating locomotion. Whereas its functional contribution to locomotion has been widely documented throughout the phylogeny from the lamprey to humans, there is still debate about its exact organization. Combining kinematic and electrophysiological recordings in mouse genetics, our study reveals that glutamatergic neurons of the cuneiform nucleus initiate locomotion and induce running gaits, whereas glutamatergic and cholinergic neurons of the pedunculopontine nucleus modulate locomotor pattern and rhythm, contributing to slow-walking gaits. By initiating, modulating, and accelerating locomotion, our study identifies and characterizes distinct neuronal populations of this functional region important to locomotor command.

Pedunculopontine glutamatergic neurons control spike patterning in substantia nigra dopaminergic neurons

Burst spiking in substantia nigra pars compacta (SNc) dopaminergic neurons is a key signaling event in the circuitry controlling goal-directed behavior. It is widely believed that this spiking mode depends upon an interaction between synaptic activation of N-methyl-D-aspartate receptors (NMDARs) and intrinsic oscillatory mechanisms. However, the role of specific neural networks in burst generation has not been defined. To begin filling this gap, SNc glutamatergic synapses arising from pedunculopotine nucleus (PPN) neurons were characterized using optical and electrophysiological approaches. These synapses were localized exclusively on the soma and proximal dendrites, placing them in a good location to influence spike generation. Indeed, optogenetic stimulation of PPN axons reliably evoked spiking in SNc dopaminergic neurons. Moreover, burst stimulation of PPN axons was faithfully followed, even in the presence of NMDAR antagonists. Thus, PPN-evoked burst spiking of SNc dopaminergic neurons in vivo may not only be extrinsically triggered, but extrinsically patterned as well.

Reward and Behavioral Factors Contributing to the Tonic Activity of Monkey Pedunculopontine Tegmental Nucleus Neurons during Saccade Tasks

The pedunculopontine tegmental nucleus (PPTg) in the brainstem plays a role in controlling reinforcement learning and executing conditioned behavior. We previously examined the activity of PPTg neurons in monkeys during a reward-conditioned, visually guided saccade task, and reported that a population of these neurons exhibited tonic responses throughout the task period. These tonic responses might depend on prediction of the upcoming reward, successful execution of the task, or both. Here, we sought to further distinguish these factors and to investigate how each contributes to the tonic neuronal activity of the PPTg. In our normal visually guided saccade task, the monkey initially fixated on the central fixation target (FT), then made saccades to the peripheral saccade target and received a juice reward after the saccade target disappeared. Most of the tonic activity terminated shortly after the reward delivery, when the monkey broke fixation. To distinguish between reward and behavioral epochs, we then changed the task sequence for a block of trials, such that the saccade target remained visible after the reward delivery. Under these visible conditions, the monkeys tended to continue fixating on the saccade target even after the reward delivery. Therefore, the prediction of the upcoming reward and the end of an individual trial were separated in time. Regardless of the task conditions, half of the tonically active PPTg neurons terminated their activity around the time of the reward delivery, consistent with the view that PPTg neurons might send reward prediction signals until the time of reward delivery, which is essential for computing reward prediction error in reinforcement learning. On the other hand, the other half of the tonically active PPTg neurons changed their activity dependent on the task condition. In the normal condition, the tonic responses terminated around the time of the reward delivery, while in the visible condition, the activity continued until the disappearance of the saccade target (ST) after reward delivery. Thus, for these neurons, the tonic activity might be related to maintaining attention to complete fixation behavior. These results suggest that, in addition to the reward value information, some PPTg neurons might contribute to the execution of conditioned task behavior.

Mesencephalic representations of recent experience influence decision making

Decisions are influenced by recent experience, but the neural basis for this phenomenon is not well understood. Here, we address this question in the context of action selection. We focused on activity in the pedunculopontine tegmental nucleus (PPTg), a mesencephalic region that provides input to several nuclei in the action selection network, in well-trained mice selecting actions based on sensory cues and recent trial history. We found that, at the time of action selection, the activity of many PPTg neurons reflected the action on the previous trial and its outcome, and the strength of this activity predicted the upcoming choice. Further, inactivating the PPTg predictably decreased the influence of recent experience on action selection. These findings suggest that PPTg input to downstream motor regions, where it can be integrated with other relevant information, provides a simple mechanism for incorporating recent experience into the computations underlying action selection.

DOI:http://dx.doi.org/10.7554/eLife.16572.001

The decisions we make are influenced by recent experience, yet it is not known how this experience is represented in the brain. For decisions about when, where and how to move, researchers have hypothesized that recent experience might influence activity in a region of the brainstem – the central trunk of the brain – that is known to be involved in movement.

When deciding when, where and how to move, several areas of the brain are involved in selecting the optimal action. Recent studies suggest that groups of neurons known as locomotor brainstem nuclei may also contribute to making decisions about movements.

Thompson et al. investigated whether a brainstem locomotor area called the pedunculopontine tegmental (PPTg) nucleus in mice might contribute to decision making rather than just conveying the selected response. The mice were trained to recognize particular odors and move to either the left or right to collect a food reward. While the mice were selecting an action, the activity of neurons in the PPTg nucleus reflected the action they had chosen on a previous experience and the outcome of that choice (i.e. whether they received a reward). These representations of past experiences influenced the upcoming decision the mice were about to take.

The findings of Thompson et al. suggest that the PPTg nucleus might play a critical role in the process of selecting the optimal action. Future work will examine what kinds of information about the environment or recent experience have the biggest effect on the activity of this region.

DOI:http://dx.doi.org/10.7554/eLife.16572.002

Basal ganglia output reflects internally-specified movements

How movements are selected is a fundamental question in systems neuroscience. While many studies have elucidated the sensorimotor transformations underlying stimulus-guided movements, less is known about how internal goals - critical drivers of goal-directed behavior - guide movements. The basal ganglia are known to bias movement selection according to value, one form of internal goal. Here, we examine whether other internal goals, in addition to value, also influence movements via the basal ganglia. We designed a novel task for mice that dissociated equally rewarded internally-specified and stimulus-guided movements, allowing us to test how each engaged the basal ganglia. We found that activity in the substantia nigra pars reticulata, a basal ganglia output, predictably differed preceding internally-specified and stimulus-guided movements. Incorporating these results into a simple model suggests that internally-specified movements may be facilitated relative to stimulus-guided movements by basal ganglia processing.

Cell-Type-Specific Control of Brainstem Locomotor Circuits by Basal Ganglia

The basal ganglia (BG) are critical for adaptive motor control, but the circuit principles underlying their pathway-specific modulation of target regions are not well understood. Here, we dissect the mechanisms underlying BG direct and indirect pathway-mediated control of the mesencephalic locomotor region (MLR), a brainstem target of BG that is critical for locomotion. We optogenetically dissect the locomotor function of the three neurochemically distinct cell types within the MLR: glutamatergic, GABAergic, and cholinergic neurons. We find that the glutamatergic subpopulation encodes locomotor state and speed, is necessary and sufficient for locomotion, and is selectively innervated by BG. We further show activation and suppression, respectively, of MLR glutamatergic neurons by direct and indirect pathways, which is required for bidirectional control of locomotion by BG circuits. These findings provide a fundamental understanding of how BG can initiate or suppress a motor program through cell-type-specific regulation of neurons linked to specific actions.

Pedunculopontine tegmental nucleus lesions impair probabilistic reversal learning by reducing sensitivity to positive reward feedback

Recent findings indicate that pedunculopontine tegmental nucleus (PPTg) neurons encode reward-related information that is context-dependent. This information is critical for behavioral flexibility when reward outcomes change signaling a shift in response patterns should occur. The present experiment investigated whether NMDA lesions of the PPTg affects the acquisition and/or reversal learning of a spatial discrimination using probabilistic reinforcement. Male Long-Evans rats received a bilateral infusion of NMDA (30nmoles/side) or saline into the PPTg. Subsequently, rats were tested in a spatial discrimination test using a probabilistic learning procedure. One spatial location was rewarded with an 80% probability and the other spatial location rewarded with a 20% probability. After reaching acquisition criterion of 10 consecutive correct trials, the spatial location - reward contingencies were reversed in the following test session. Bilateral and unilateral PPTg-lesioned rats acquired the spatial discrimination test comparable to that as sham controls. In contrast, bilateral PPTg lesions, but not unilateral PPTg lesions, impaired reversal learning. The reversal learning deficit occurred because of increased regressions to the previously 'correct' spatial location after initially selecting the new, 'correct' choice. PPTg lesions also reduced the frequency of win-stay behavior early in the reversal learning session, but did not modify the frequency of lose-shift behavior during reversal learning. The present results suggest that the PPTg contributes to behavioral flexibility under conditions in which outcomes are uncertain, e.g. probabilistic reinforcement, by facilitating sensitivity to positive reward outcomes that allows the reliable execution of a new choice pattern.

Structural and functional considerations of the cholinergic brainstem

Cholinergic neurons of the brainstem have traditionally been associated with a role in wakefulness as part of the reticular activating system, but their function cannot be explained solely on the basis of their modulation of the brain state. Recent findings about their connectivity and functional heterogeneity suggest a wider role in behavior, where basal ganglia is at the center of their influence. This review focuses on recent findings that suggest an intrinsic functional organization of the cholinergic brainstem that is closely correlated with its connectivity with midbrain and forebrain circuits. Furthermore, recent evidence on the temporal structure of the activation of brainstem cholinergic neurons reveals fundamental aspects about the nature of cholinergic signaling. Consideration of the cholinergic brainstem complex in the context of wider brain circuits is critical to understand its contribution to normal behavior.

The pedunculopontine tegmental nucleus-A functional hypothesis from the comparative literature

We present data from animal studies showing that the pedunculopontine tegmental nucleus-conserved through evolution, compartmentalized, and with a complex pattern of inputs and outputs-has functions that involve formation and updates of action-outcome associations, attention, and rapid decision making. This is in contrast to previous hypotheses about pedunculopontine function, which has served as a basis for clinical interest in the pedunculopontine in movement disorders. Current animal literature points to it being neither a specifically motor structure nor a master switch for sleep regulation. The pedunculopontine is connected to basal ganglia circuitry but also has primary sensory input across modalities and descending connections to pontomedullary, cerebellar, and spinal motor and autonomic control systems. Functional and anatomical studies in animals suggest strongly that, in addition to the pedunculopontine being an input and output station for the basal ganglia and key regulator of thalamic (and consequently cortical) activity, an additional major function is participation in the generation of actions on the basis of a first-pass analysis of incoming sensory data. Such a function-rapid decision making-has very high adaptive value for any vertebrate. We argue that in developing clinical strategies for treating basal ganglia disorders, it is necessary to take an account of the normal functions of the pedunculopontine. We believe that it is possible to use our hypothesis to explain why pedunculopontine deep brain stimulation used clinically has had variable outcomes in the treatment of parkinsonism motor symptoms and effects on cognitive processing. © 2016 International Parkinson and Movement Disorder Society.

Decoding brain state transitions in the pedunculopontine nucleus: cooperative phasic and tonic mechanisms

Cholinergic neurons of the pedunculopontine nucleus (PPN) are most active during the waking state. Their activation is deemed to cause a switch in the global brain activity from sleep to wakefulness, while their sustained discharge may contribute to upholding the waking state and enhancing arousal. Similarly, non-cholinergic PPN neurons are responsive to brain state transitions and their activation may influence some of the same targets of cholinergic neurons, suggesting that they operate in coordination. Yet, it is not clear how the discharge of distinct classes of PPN neurons organize during brain states. Here, we monitored the in vivo network activity of PPN neurons in the anesthetized rat across two distinct levels of cortical dynamics and their transitions. We identified a highly structured configuration in PPN network activity during slow-wave activity that was replaced by decorrelated activity during the activated state (AS). During the transition, neurons were predominantly excited (phasically or tonically), but some were inhibited. Identified cholinergic neurons displayed phasic and short latency responses to sensory stimulation, whereas the majority of non-cholinergic showed tonic responses and remained at high discharge rates beyond the state transition. In vitro recordings demonstrate that cholinergic neurons exhibit fast adaptation that prevents them from discharging at high rates over prolonged time periods. Our data shows that PPN neurons have distinct but complementary roles during brain state transitions, where cholinergic neurons provide a fast and transient response to sensory events that drive state transitions, whereas non-cholinergic neurons maintain an elevated firing rate during global activation.

An integrative role for the superior colliculus in selecting targets for movements

A fundamental goal of systems neuroscience is to understand the neural mechanisms underlying decision making. The midbrain superior colliculus (SC) is known to be central to the selection of one among many potential spatial targets for movements, which represents an important form of decision making that is tractable to rigorous experimental investigation. In this review, we first discuss data from mammalian models-including primates, cats, and rodents-that inform our understanding of how neural activity in the SC underlies the selection of targets for movements. We then examine the anatomy and physiology of inputs to the SC from three key regions that are themselves implicated in motor decisions-the basal ganglia, parabrachial region, and neocortex-and discuss how they may influence SC activity related to target selection. Finally, we discuss the potential for methodological advances to further our understanding of the neural bases of target selection. Our overarching goal is to synthesize what is known about how the SC and its inputs act together to mediate the selection of targets for movements, to highlight open questions about this process, and to spur future studies addressing these questions.

Deep brain stimulation of different pedunculopontine targets in a novel rodent model of parkinsonism

The pedunculopontine tegmental nucleus (PPTg) has been proposed as a target for deep brain stimulation (DBS) in parkinsonian patients, particularly for symptoms such as gait and postural difficulties refractory to dopaminergic treatments. Several patients have had electrodes implanted aimed at the PPTg, but outcomes have been disappointing, with little evidence that gait and posture are improved. The PPTg is a heterogeneous structure. Consequently, exact target sites in PPTg, possible DBS mechanisms, and potential benefits still need systematic investigation in good animal models. We have investigated the role of PPTg in gait, developed a refined model of parkinsonism including partial loss of the PPTg with bilateral destruction of nigrostriatal dopamine neurons that mimics human pathophysiology, and investigated the effect of DBS at different PPTg locations on gait and posture using a wireless device that lets rats move freely while receiving stimulation. Neither partial nor complete lesions of PPTg caused gait deficits, underlining questions raised previously about the status of PPTg as a motor control structure. The effect of DBS in the refined and standard model of parkinsonism were very different despite minimal behavioral differences in nonstimulation control conditions. Anterior PPTg DBS caused severe episodes of freezing and worsened gait, whereas specific gait parameters were mildly improved by stimulation of posterior PPTg. These results emphasize the critical importance of intra-PPTg DBS location and highlight the need to take PPTg degeneration into consideration when modeling parkinsonian symptoms. They also further implicate a role for PPTg in the pathophysiology of parkinsonism.

Optogenetic cholinergic modulation of the mouse superior colliculus in vivo

The superior colliculus (SC) plays a critical role in orienting movements, in part by integrating modulatory influences on the sensorimotor transformations it performs. Many species exhibit a robust brain stem cholinergic projection to the intermediate and deep layers of the SC arising mainly from the pedunculopontine tegmental nucleus (PPTg), which may serve to modulate SC function. However, the physiological effects of this input have not been examined in vivo, preventing an understanding of its functional role. Given the data from slice experiments, cholinergic input may have a net excitatory effect on the SC. Alternatively, the input could have mixed effects, via activation of inhibitory neurons within or upstream of the SC. Distinguishing between these possibilities requires in vivo experiments in which endogenous cholinergic input is directly manipulated. Here we used anatomical and optogenetic techniques to identify and selectively activate brain stem cholinergic terminals entering the intermediate and deep layers of the awake mouse SC and recorded SC neuronal responses. We first quantified the pattern of the cholinergic input to the mouse SC, finding that it was predominantly localized to the intermediate and deep layers. We then found that optogenetic stimulation of cholinergic terminals in the SC significantly increased the activity of a subpopulation of SC neurons. Interestingly, cholinergic input had a broad range of effects on the magnitude and timing of SC responses, perhaps reflecting both monosynaptic and polysynaptic innervation. These findings begin to elucidate the functional role of this cholinergic projection in modulating the processing underlying sensorimotor transformations in the SC.

The integrative role of the pedunculopontine nucleus in human gait

The brainstem pedunculopontine nucleus has a likely, although unclear, role in gait control, and is a potential deep brain stimulation target for treating resistant gait disorders. These disorders are a major therapeutic challenge for the ageing population, especially in Parkinson's disease where gait and balance disorders can become resistant to both dopaminergic medication and subthalamic nucleus stimulation. Here, we present electrophysiological evidence that the pedunculopontine and subthalamic nuclei are involved in distinct aspects of gait using a locomotor imagery task in 14 patients with Parkinson's disease undergoing surgery for the implantation of pedunculopontine or subthalamic nuclei deep brain stimulation electrodes. We performed electrophysiological recordings in two phases, once during surgery, and again several days after surgery in a subset of patients. The majority of pedunculopontine nucleus neurons (57%) recorded intrasurgically exhibited changes in activity related to different task components, with 29% modulated during visual stimulation, 41% modulated during voluntary hand movement, and 49% modulated during imaginary gait. Pedunculopontine nucleus local field potentials recorded post-surgically were modulated in the beta and gamma bands during visual and motor events, and we observed alpha and beta band synchronization that was sustained for the duration of imaginary gait and spatially localized within the pedunculopontine nucleus. In contrast, significantly fewer subthalamic nucleus neurons (27%) recorded intrasurgically were modulated during the locomotor imagery, with most increasing or decreasing activity phasically during the hand movement that initiated or terminated imaginary gait. Our data support the hypothesis that the pedunculopontine nucleus influences gait control in manners extending beyond simply driving pattern generation. In contrast, the subthalamic nucleus seems to control movement execution that is not likely to be gait-specific. These data highlight the crucial role of these two nuclei in motor control and shed light on the complex functions of the lateral mesencephalus in humans.

Selective corticostriatal plasticity during acquisition of an auditory discrimination task

Perceptual decisions are based on the activity of sensory cortical neurons, but how organisms learn to transform this activity into appropriate actions remains unknown. Projections from the auditory cortex to the auditory striatum carry information that drives decisions in an auditory frequency discrimination task¹. To assess the role of these projections in learning, we developed a Channelrhodopsin-2-based assay to selectively probe for synaptic plasticity associated with corticostriatal neurons representing different frequencies. Here we report that learning this auditory discrimination preferentially potentiates corticostriatal synapses from neurons representing either high or low frequencies, depending on reward contingencies. We observed frequency-dependent corticostriatal potentiation in vivo over the course of training, and in vitro in striatal brain slices. Our findings suggest a model in which the corticostriatal synapses made by neurons tuned to different features of the sound are selectively potentiated to enable the learned transformation of sound into action.

Selective lesions of the cholinergic neurons within the posterior pedunculopontine do not alter operant learning or nicotine sensitization

Cholinergic neurons within the pedunculopontine tegmental nucleus have been implicated in a range of functions, including behavioral state control, attention, and modulation of midbrain and basal ganglia systems. Previous experiments with excitotoxic lesions have found persistent learning impairment and altered response to nicotine following lesion of the posterior component of the PPTg (pPPTg). These effects have been attributed to disrupted input to midbrain dopamine systems, particularly the ventral tegmental area. The pPPTg contains a dense collection of cholinergic neurons and also large numbers of glutamatergic and GABAergic neurons. Because these interdigitated populations of neurons are all susceptible to excitotoxins, the effects of such lesions cannot be attributed to one neuronal population. We wished to assess whether the learning impairments and altered responses to nicotine in excitotoxic PPTg-lesioned rats were due to loss of cholinergic neurons within the pPPTg. Selective depletion of cholinergic pPPTg neurons is achievable with the fusion toxin Dtx-UII, which targets UII receptors expressed only by cholinergic neurons in this region. Rats bearing bilateral lesions of cholinergic pPPTg neurons (>90% ChAT+ neuronal loss) displayed no deficits in the learning or performance of fixed and variable ratio schedules of reinforcement for pellet reward. Separate rats with the same lesions had a normal locomotor response to nicotine and furthermore sensitized to repeated administration of nicotine at the same rate as sham controls. Previously seen changes in these behaviors following excitotoxic pPPTg lesions cannot be attributed solely to loss of cholinergic neurons. These findings indicate that non-cholinergic neurons within the pPPTg are responsible for the learning deficits and altered responses to nicotine seen after excitotoxic lesions. The functions of cholinergic neurons may be related to behavioral state control and attention rather than learning.

Nicotinic alteration of decision-making

Addiction to nicotine is characterized by impulses, urges and lack of self-control towards cigarettes. A key element in the process of addiction is the development of habits oriented towards nicotine consumption that surpass flexible systems as a consequence of a gradual adaptation to chronic drug exposure. However, the long-term effects of nicotine on brain circuits also induce wide changes in decision-making processes, affecting behaviors unrelated to cigarettes. This review aims at providing an update on the implications of nicotine on general decision-making processes, with an emphasis on impulsivity and risk-taking. As impulsivity is a rather ambiguous behavioral trait, we build on economic and normative theories to better characterize these nicotine-induced alterations in decision-making. Nonetheless, experimental data are sparse and often contradictory. We will discuss how the latest findings on the neurobiological basis of choice behavior may help disentangling these issues. We focus on the role of nicotine acetylcholine receptors and their different subunits, and on the spatio-temporal dynamics (i.e. diversity of the neural circuits, short- and long-term effects) of both endogenous acetylcholine and nicotine action. Finally, we try to link these neurobiological results with neuro-computational models of attention, valuation and action, and of the role of acetylcholine in these decision processes. This article is part of the Special Issue entitled 'The Nicotinic Acetylcholine Receptor: From Molecular Biology to Cognition'.

Deficits in motor performance after pedunculopontine lesions in rats--impairment depends on demands of task

Anatomically and functionally located between basal ganglia and brainstem circuitry, the pedunculopontine tegmental nucleus (PPTg) is in a pivotal position to contribute to motor behavior. Studies in primates have reported akinesia and postural instability following destruction of the PPTg. In humans, the PPTg partially degenerates in Parkinson's disease and stimulation of this region is under investigation as a possible therapeutic. Studies in rats report no crude motor impairment following PPTg lesion, although a detailed assessment of the role of the PPTg in rat motor function has not been reported. Our studies applied motor tests generally used in rodent models of Parkinson's disease to rats bearing either excitotoxic damage to all neuronal populations within PPTg, or selective destruction of the cholinergic subpopulation created with the toxin Dtx-UII. Neither lesion type altered baseline locomotion. On the rotarod, excitotoxic lesions produced a persistent impairment on the accelerating, but not fixed speed, conditions. In the vermicelli handling task (a quantitative measure of fine motor control and effective behavioral sequencing) excitotoxic lesions produced no single impairment, but globally increased the number of normal and abnormal behaviors. In contrast, depletion of cholinergic PPTg neurons produced impairment on the accelerating rotarod but no changes in vermicelli handling. Together, these results show that while PPTg lesions produce no impairment in the execution of individual motor actions, impairments emerge when the demands of the task increase. Results are discussed in terms of PPTg acting as part of a rapid action selection system, which integrates sensory information into motor output.

Pedunculopontine tegmental nucleus neurons provide reward, sensorimotor, and alerting signals to midbrain dopamine neurons

Dopamine (DA) neurons in the midbrain are crucial for motivational control of behavior. However, recent studies suggest that signals transmitted by DA neurons are heterogeneous. This may reflect a wide range of inputs to DA neurons, but which signals are provided by which brain areas is still unclear. Here we focused on the pedunculopontine tegmental nucleus (PPTg) in macaque monkeys and characterized its inputs to DA neurons. Since the PPTg projects to many brain areas, it is crucial to identify PPTg neurons that project to DA neuron areas. For this purpose we used antidromic activation technique by electrically stimulating three locations (medial, central, lateral) in the substantia nigra pars compacta (SNc). We found SNc-projecting neurons mainly in the PPTg, and some in the cuneiform nucleus. Electrical stimulation in the SNc-projecting PPTg regions induced a burst of spikes in presumed DA neurons, suggesting that the PPTg-DA (SNc) connection is excitatory. Behavioral tasks and clinical tests showed that the SNc-projecting PPTg neurons encoded reward, sensorimotor and arousal/alerting signals. Importantly, reward-related PPTg neurons tended to project to the medial and central SNc, whereas sensorimotor/arousal/alerting-related PPTg neurons tended to project to the lateral SNc. Most reward-related signals were positively biased: excitation and inhibition when a better and worse reward was expected, respectively. These PPTg neurons tended to retain the reward value signal until after a reward outcome, representing 'value state'; this was different from DA neurons which show phasic signals representing 'value change'. Our data, together with previous studies, suggest that PPTg neurons send positive reward-related signals mainly to the medial-central SNc where DA neurons encode motivational values, and sensorimotor/arousal signals to the lateral SNc where DA neurons encode motivational salience.