Mesencephalic representations of recent experience influence decision making

The Basal Ganglia and Mesencephalic Locomotor Region Connectivity Matrix

Although classically considered a relay station for basal ganglia (BG) output, the anatomy, connectivity, and function of the mesencephalic locomotor region (MLR) were redefined during the last two decades. In striking opposition to what was initially thought, MLR and BG are actually reciprocally and intimately interconnected. New viral-based, optogenetic, and mapping technologies revealed that cholinergic, glutamatergic, and GABAergic neurons coexist in this structure, which, in addition to extending descending projections, send long-range ascending fibers to the BG. These MLR projections to the BG convey motor and non-motor information to specific synaptic targets throughout different nuclei. Moreover, MLR efferent fibers originate from precise neuronal subpopulations located in particular MLR subregions, defining independent anatomo-functional subcircuits involved in particular aspects of animal behavior such as fast locomotion, explorative locomotion, posture, forelimb- related movements, speed, reinforcement, among others. In this review, we revised the literature produced during the last decade linking MLR and BG. We conclude that the classic framework considering the MLR as a homogeneous output structure passively receiving input from the BG needs to be revisited. We propose instead that the multiple subcircuits embedded in this region should be taken as independent entities that convey relevant and specific ascending information to the BG and, thus, actively participate in the execution and tuning of behavior.

Inhibitory Pedunculopontine Neurons Gate Dopamine-Mediated Motor Actions of Unsigned Valence

BACKGROUND

The pedunculopontine nucleus (PPN) maintains a bidirectional connectivity with the basal ganglia that supports their shared roles in the selection and execution of motor actions. Previous studies identified a role for PPN neurons in goal-directed behavior, but the cellular substrates underlying this function have not been elucidated. We recently revealed the existence of a monosynaptic GABAergic input from the PPN that inhibits dopamine neurons of the substantia nigra. Activation of this pathway interferes with the execution of learned motor sequences when the actions are rewarded, even though the inhibition of dopamine neurons did not shift the value of the action, hence suggesting executive control over the gating of behavior.

OBJECTIVE

To test the attributes of the inhibition of dopamine neurons by the PPN in the context of goal-directed behavior regardless of whether the outcome is positive or negative.

METHODS

We delivered optogenetic stimulation to PPN GABAergic axon terminals in the substantia nigra during a battery of behavioral tasks with positive and negative valence.

RESULTS

Inhibition of dopamine neurons by PPN optogenetic activation during an appetitive task impaired the initiation and overall execution of the behavioral sequence without affecting the consumption of reward. During an active avoidance task, the same activation impaired the ability of mice to avoid a foot shock, but their escape response was unaffected. In addition, responses to potential threats were significantly attenuated.

CONCLUSION

Our results show that PPN GABAergic neurons modulate learned, goal-directed behavior of unsigned valence without affecting overall motor behavior.

Influence of Recent Trial History on Interval Timing

Interval timing is involved in a variety of cognitive behaviors such as associative learning and decision-making. While it has been shown that time estimation is adaptive to the temporal context, it remains unclear how interval timing behavior is influenced by recent trial history. Here we found that, in mice trained to perform a licking-based interval timing task, a decrease of inter-reinforcement interval in the previous trial rapidly shifted the time of anticipatory licking earlier. Optogenetic inactivation of the anterior lateral motor cortex (ALM), but not the medial prefrontal cortex, for a short time before reward delivery caused a decrease in the peak time of anticipatory licking in the next trial. Electrophysiological recordings from the ALM showed that the response profiles preceded by short and long inter-reinforcement intervals exhibited task-engagement-dependent temporal scaling. Thus, interval timing is adaptive to recent experience of the temporal interval, and ALM activity during time estimation reflects recent experience of interval.

Motor context modulates substantia nigra pars reticulata spike activity in patients with Parkinson's disease

OBJECTIVE

The severity of motor symptoms in Parkinson's disease (PD) depends on environmental conditions. For example, the presence of external patterns such as a rhythmic tone can attenuate bradykinetic impairments. However, the neural mechanisms for this context-dependent attenuation (e.g., paradoxical kinesis) remain unknown. Here, we investigate whether context-dependent symptom attenuation is reflected in single-unit activity recorded in the operating room from the substantia nigra pars reticulata (SNr) of patients with PD undergoing deep brain stimulation surgery. The SNr is known to influence motor planning and execution in animal models, but its role in humans remains understudied.

METHODS

We recorded SNr activity while subjects performed cued directional movements in response to auditory stimuli under interleaved 'patterned' and 'unpatterned' contexts. SNr localisation was independently confirmed with expert intraoperative assessment as well as post hoc imaging-based reconstructions.

RESULTS

As predicted, we found that motor performance was improved in the patterned context, reflected in increased reaction speed and accuracy compared with the unpatterned context. These behavioural differences were associated with enhanced responsiveness of SNr neurons-that is, larger changes in activity from baseline-in the patterned context. Unsupervised clustering analysis revealed two distinct subtypes of SNr neurons: one exhibited context-dependent enhanced responsiveness exclusively during movement preparation, whereas the other showed enhanced responsiveness during portions of the task associated with both motor and non-motor processes.

CONCLUSIONS

Our findings indicate the SNr participates in motor planning and execution, as well as warrants greater attention in the study of human sensorimotor integration and as a target for neuromodulatory therapies.

Cholinergic neurons in the pedunculopontine nucleus guide reversal learning by signaling the changing reward contingency

Cognitive flexibility enables effective switching between mental processes to generate appropriate responses. Cholinergic neurons (CNs) within the pedunculopontine nucleus (PPN) are associated with many functions, but their contribution to cognitive flexibility remains poorly understood. Here we measure PPN cholinergic activities using calcium indicators during the attentional set-shifting task. We find that PPN CNs exhibit increasing activities correlated with rewards during each stage and error trials in reversal stages, indicating sensitivity to rule switching. Inhibition of PPN cholinergic activity selectively impairs reversal learning, which improves with PPN CN activation. Activation of PPN CNs projecting to the substantia nigra pars compacta, mediodorsal thalamus, and parafascicular nucleus in a time-locked manner with reward improves reversal learning. Therefore, PPN CNs may encode not only reward signals but also the information of changing reward contingency that contributes to guiding reversal learning through output projections to multiple nuclei that participate in flexibility.

Non-motor connections of the pedunculopontine nucleus of the rat and human brain

INTRODUCTION

The connections of the pedunculopontine nucleus (PPN) with motor areas of the central nervous system (CNS) are well described in the literature, in contrast relations with non-motor areas are lacking. Thus, the aim of the present study is to define the non-motor connections of the PPN in rats using the fluoro-gold (FG) tracer and compare the presence of these connections in healthy human adults using diffusion tensor tractography (DTI).

MATERIALS AND METHODS

We injected FG into the PPN of 12 rats. The non-motor connections of the PPN with cortical, subcortical, and brainstem structures were documented. The non-motor connections of the rats were compared with the DTI obtained from 35 healthy adults.

RESULTS

The results of the tract-tracing study in the rat showed that the PPN was connected to non-motor cortical (cingulate, somatosensory, visual, auditory, medial frontal cortices), subcortical (amygdala, hypothalamus, thalamus, habenular, and bed nucleus of stria terminalis), and brainstem (medullary reticular, trigeminal spinal, external cuneate, pontine reticular, vestibular, superior and inferior colliculus, locus ceruleus, periaqueductal gray, parabrachial, dorsal raphe, pretectal, lateral lemniscus nuclei, and the contralateral PPN) structures. The DTI obtained from healthy adults showed similar PPN non-motor connections as in rats.

CONCLUSION

Understanding the connections of the PPN with non-motor cortical, subcortical, and brainstem areas of the CNS will enrich our knowledge of its contribution in various circuits and the areas that PPN activity can influence. Further, it will provide insight into the role of Parkinson's disease and related disorders and explain the non-motor complications which occur subsequent to deep brain stimulation (DBS) of the PPN.

A Causal Role for the Pedunculopontine Nucleus in Human Instrumental Learning

A critical mechanism for maximizing reward is instrumental learning. In standard instrumental learning models, action values are updated on the basis of reward prediction errors (RPEs), defined as the discrepancy between expectations and outcomes. A wealth of evidence across species and experimental techniques has established that RPEs are signaled by midbrain dopamine neurons. However, the way dopamine neurons receive information about reward outcomes remains poorly understood. Recent animal studies suggest that the pedunculopontine nucleus (PPN), a small brainstem structure considered as a locomotor center, is sensitive to reward and sends excitatory projection to dopaminergic nuclei. Here, we examined the hypothesis that the PPN could contribute to reward learning in humans. To this aim, we leveraged a clinical protocol that assessed the therapeutic impact of PPN deep-brain stimulation (DBS) in three patients with Parkinson disease. PPN local field potentials (LFPs), recorded while patients performed an instrumental learning task, showed a specific response to reward outcomes in a low-frequency (alpha-beta) band. Moreover, PPN DBS selectively improved learning from rewards but not from punishments, a pattern that is typically observed following dopaminergic treatment. Computational analyses indicated that the effect of PPN DBS on instrumental learning was best captured by an increase in subjective reward sensitivity. Taken together, these results support a causal role for PPN-mediated reward signals in human instrumental learning.

Control of adaptive action selection by secondary motor cortex during flexible visual categorization

Adaptive action selection during stimulus categorization is an important feature of flexible behavior. To examine neural mechanism underlying this process, we trained mice to categorize the spatial frequencies of visual stimuli according to a boundary that changed between blocks of trials in a session. Using a model with a dynamic decision criterion, we found that sensory history was important for adaptive action selection after the switch of boundary. Bilateral inactivation of the secondary motor cortex (M2) impaired adaptive action selection by reducing the behavioral influence of sensory history. Electrophysiological recordings showed that M2 neurons carried more information about upcoming choice and previous sensory stimuli when sensorimotor association was being remapped than when it was stable. Thus, M2 causally contributes to flexible action selection during stimulus categorization, with the representations of upcoming choice and sensory history regulated by the demand to remap stimulus-action association.

Hidden neural states underlie canary song syntax

Coordinated skills such as speech or dance involve sequences of actions that follow syntactic rules in which transitions between elements depend on the identity and order of past actions. Canary songs are comprised of repeated syllables, called phrases, and the ordering of these phrases follows long-range rules¹, where the choice of what to sing depends on song structure many seconds prior. The neural substrates that support these long-range correlations are unknown. Using miniature head-mounted microscopes and cell-type-specific genetic tools, we observed neural activity in the premotor nucleus HVC^2–4 as canaries explore various phrase sequences in their repertoire. We find neurons that encode past transitions, extending over 4 phrases and spanning up to 4 seconds and 40 syllables. These neurons preferentially encode past actions rather than future actions, can reflect more than a single song history, and occur mostly during the rare phrases that involve history-dependent transitions in song. These findings demonstrate that HVC dynamics includes “hidden states” not reflected in ongoing behavior – states that carry information about prior actions. These states provide a possible substrate to control syntax transitions governed by long-range rules.

Spatial representations in the superior colliculus are modulated by competition among targets

Selecting and moving to spatial targets are critical components of goal-directed behavior, yet their neural bases are not well understood. The superior colliculus (SC) is thought to contain a topographic map of contralateral space in which the activity of specific neuronal populations corresponds to particular spatial locations. However, these spatial representations are modulated by several decision-related variables, suggesting that they reflect information beyond simply the location of an upcoming movement. Here, we examine the extent to which these representations arise from competitive spatial choice. We recorded SC activity in male mice performing a behavioral task requiring orienting movements to targets for a water reward in two contexts. In "competitive" trials, either the left or right target could be rewarded, depending on which stimulus was presented at the central port. In "noncompetitive" trials, the same target (e.g., left) was rewarded throughout an entire block. While both trial types required orienting movements to the same spatial targets, only in competitive trials do targets compete for selection. We found that in competitive trials, pre-movement SC activity predicted movement to contralateral targets, as expected. However, in noncompetitive trials, some neurons lost their spatial selectivity and in others activity predicted movement to ipsilateral targets. Consistent with these findings, unilateral optogenetic inactivation of pre-movement SC activity ipsiversively biased competitive, but not noncompetitive, trials. Incorporating these results into an attractor model of SC activity points to distinct pathways for orienting movements under competitive and noncompetitive conditions, with the SC specifically required for selecting among multiple potential targets.

Short-Term Influence of Recent Trial History on Perceptual Choice Changes with Stimulus Strength

Perceptual decisions, especially for difficult stimuli, can be influenced by choices and outcomes in previous trials. However, it is not well understood how stimulus strength modulates the temporal characteristics as well as the magnitude of trial history influence. We addressed this question using a contrast detection task in freely moving mice. We found that, at lower as compared to higher stimulus contrast, the current choice of the mice was more influenced by choices and outcomes in the past trials and the influence emerged from a longer history. To examine the neural basis of stimulus strength-dependent history influence, we recorded from the secondary motor cortex (M2), a prefrontal region that plays an important role in cue-guided actions and memory-guided behaviors. We found that more M2 neurons conveyed information about choices on the past two trials at lower than at higher contrast. Furthermore, history-trial activity in M2 was important for decoding upcoming choice at low contrast. Thus, trial history influence of perceptual choice is adaptive to the strength of sensory evidence, which may be important for action selection in a dynamic environment.

Rethinking the Pedunculopontine Nucleus: From Cellular Organization to Function

The pedunculopontine nucleus (PPN) has long been considered an interface between the basal ganglia and motor systems, and its ability to regulate arousal states puts the PPN in a key position to modulate behavior. Despite the large amount of data obtained over recent decades, a unified theory of its function is still incomplete. By putting together classical concepts and new evidence that dissects the influence of its different neuronal subtypes on their various targets, we propose that the PPN and, in particular, cholinergic neurons have a central role in updating the behavioral state as a result of changes in environmental contingencies. Such a function is accomplished by a combined mechanism that simultaneously restrains ongoing obsolete actions while it facilitates new contextual associations.