Value encoding in the globus pallidus: fMRI reveals an interaction effect between reward and dopamine drive

Volitional modulation of neuronal activity in the external globus pallidus by engagement of the cortical-basal ganglia circuit

Volitional modulation of neural activity is not confined to the cortex but extends to various brain regions. Yet, it remains unclear whether neurons in the basal ganglia structure, the external globus pallidus (GPe), can be volitionally controlled. Here, we employed a volitional conditioning task to compare the volitional modulation of GPe and primary motor cortex (M1) neurons as well as the underlying circuits and control mechanisms. The results revealed that the volitional modulation of GPe neuronal activity engaged both M1 and substantia nigra pars reticulata (SNr) neurons, indicating the involvement of the cortex-GPe-SNr loop. In contrast, the volitional modulation of M1 neurons primarily occurred through the engagement of M1 local circuitry. Furthermore, lesioning M1 neurons did not affect the volitional learning or volitional control signal in GPe, whereas lesioning of GPe neurons impaired the learning process for the volitional modulation of M1 neuronal activity at the intermediate stage. Additionally, lesion of GPe neurons enhanced M1 neuronal activity when performing the volitional control task without reward delivery and a random reward test. Taken together, our findings demonstrated that GPe neurons could be volitionally controlled by engagement of the cortical-basal ganglia circuit and inhibit learning process for the volitional modulation of M1 neuronal activity by regulating M1 neuronal activity. Thus, GPe neurons can be effectively harnessed for independent volitional modulation for neurorehabilitation in patients with cortical damage. KEY POINTS: The cortical-basal ganglia circuit contributes to the volitional modulation of GPe neurons. Volitional modulation of M1 neuronal activity mainly engages M1 local circuitry. Bilateral GPe lesioning impedes volitional learning at the intermediate stages. Lesioning of GPe neurons inhibits volitional learning process by regulating M1 neuronal activity.

Distinct basal ganglia contributions to learning from implicit and explicit value signals in perceptual decision-making

Metacognitive evaluations of confidence provide an estimate of decision accuracy that could guide learning in the absence of explicit feedback. We examine how humans might learn from this implicit feedback in direct comparison with that of explicit feedback, using simultaneous EEG-fMRI. Participants performed a motion direction discrimination task where stimulus difficulty was increased to maintain performance, with intermixed explicit- and no-feedback trials. We isolate single-trial estimates of post-decision confidence using EEG decoding, and find these neural signatures re-emerge at the time of feedback together with separable signatures of explicit feedback. We identified these signatures of implicit versus explicit feedback along a dorsal-ventral gradient in the striatum, a finding uniquely enabled by an EEG-fMRI fusion. These two signals appear to integrate into an aggregate representation in the external globus pallidus, which could broadcast updates to improve cortical decision processing via the thalamus and insular cortex, irrespective of the source of feedback.

Enhanced putamen functional connectivity underlies altered risky decision-making in age-related cognitive decline

Risky decision-making is critical to survival and development, which has been compromised in elderly populations. However, the neural substrates of altered financial risk-taking behavior in aging are still under-investigated. Here we examined the intrinsic putamen network in modulating risk-taking behaviors of Balloon Analogue Risk Task in healthy young and older adults using resting-state fMRI. Compared with the young group, the elderly group showed significantly different task performance. Based on the task performance, older adults were further subdivided into two subgroups, showing young-like and over-conservative risk behaviors, regardless of cognitive decline. Compared with young adults, the intrinsic pattern of putamen connectivity was significantly different in over-conservative older adults, but not in young-like older adults. Notably, age-effects on risk behaviors were mediated via the putamen functional connectivity. In addition, the putamen gray matter volume showed significantly different relationships with risk behaviors and functional connectivity in over-conservative older adults. Our findings suggest that reward-based risky behaviors might be a sensitive indicator of brain aging, highlighting the critical role of the putamen network in maintaining optimal risky decision-making in age-related cognitive decline.

Dysbindin-1A modulation of astrocytic dopamine and basal ganglia dependent behaviors relevant to schizophrenia

The mechanisms underlying the dichotomic cortical/basal ganglia dopaminergic abnormalities in schizophrenia are unclear. Astrocytes are important non-neuronal modulators of brain circuits, but their role in dopaminergic system remains poorly explored. Microarray analyses, immunohistochemistry, and two-photon laser scanning microscopy revealed that Dys1 hypofunction increases the reactivity of astrocytes, which express only the Dys1A isoform. Notably, behavioral and electrochemical assessments in mice selectively lacking the Dys1A isoform unraveled a more prominent impact of Dys1A in behavioral and dopaminergic/D2 alterations related to basal ganglia, but not cortical functioning. Ex vivo electron microscopy and protein expression analyses indicated that selective Dys1A disruption might alter intracellular trafficking in astrocytes, but not in neurons. In agreement, Dys1A disruption only in astrocytes resulted in decreased motivation and sensorimotor gating deficits, increased astrocytic dopamine D2 receptors and decreased dopaminergic tone within basal ganglia. These processes might have clinical relevance because the caudate, but not the cortex, of patients with schizophrenia shows a reduction of the Dys1A isoform. Therefore, we started to show a hitherto unknown role for the Dys1A isoform in astrocytic-related modulation of basal ganglia behavioral and dopaminergic phenotypes, with relevance to schizophrenia.

Distinct Roles of the Human Subthalamic Nucleus and Dorsal Pallidum in Parkinson's Disease Impulsivity

BACKGROUND

Impulsivity and impulse control disorders are common in Parkinson's disease and lead to increased morbidity and reduced quality of life. Impulsivity is thought to arise from aberrant reward processing and inhibitory control, but it is unclear why deep brain stimulation of either the subthalamic nucleus (STN) or globus pallidus internus (GPi) affects levels of impulsivity. Our aim was to assess the role of the STN and GPi in impulsivity using invasive local field potential (LFP) recordings from deep brain stimulation electrodes.

METHODS

We measured LFPs during a simple rewarding Go/NoGo paradigm in 39 female and male human patients with Parkinson's disease manifesting variable amounts of impulsivity who were undergoing unilateral deep brain stimulation of either the STN (18 nuclei) or GPi (28 nuclei). We identified reward-specific LFP event-related potentials and correlated them to impulsivity severity.

RESULTS

LFPs in both structures modulated during reward-specific Go and NoGo stimulus evaluation, reward feedback, and loss feedback. Motor and limbic functions were anatomically separable in the GPi but not in the STN. Across participants, LFP reward processing responses in the STN and GPi uniquely depended on the severity of impulsivity.

CONCLUSIONS

This study establishes LFP correlates of impulsivity within the STN and GPi regions. We propose a model for basal ganglia reward processing that includes the bottom-up role of the GPi in reward salience and the top-down role of the STN in cognitive control.

A change of mind: Globus pallidus activity and effective connectivity during changes in choice selections

The basal ganglia are a group of interconnected subcortical nuclei that plays a key role in multiple motor and cognitive processes, in a close interplay with several cortical regions. Two conflicting theories postulate that the basal ganglia pathways can either foster or suppress the cortico-striatal output or, alternatively, they can stabilize or destabilize the cortico-striatal circuit dynamics. These different approaches significantly impact the understanding of observable behaviours and cognitive processes in healthy, as well as clinical populations. We investigated the predictions of these models in healthy participants (N = 28), using dynamic causal modeling of fMRI BOLD activity to estimate time- and context-dependent changes in the indirect pathway effective connectivity, in association with repetitions or changes of choice selections. We used two multi-option tasks that required the participants to adapt to uncontrollable environmental changes, by performing sequential choice selections, with and without value-based feedbacks. We found that, irrespective of the task, the trials that were characterized by changes in choice selections (switch trials) were associated with a neural response that mostly overlapped with a network commonly described for the encoding of uncertainty. More interestingly, dynamic causal modeling and family-wise model comparison identified with high likelihood a directed causal relation from the external to the internal part of the globus pallidus (i.e., the short indirect pathway in the basal ganglia), in association with the switch trials. This finding supports the hypothesis that the short indirect pathway in the basal ganglia drives instability in the network dynamics, resulting in changes in choice selection.

Using pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults

Dopamine (DA) plays a key role in reward processing and is implicated in psychological disorders such as depression, substance use, and schizophrenia. The role of DA in reward processing is an area of highly active research. One approach to this question is drug challenge studies with drugs known to alter DA function. These studies provide good experimental control and can be performed in parallel in laboratory animals and humans. This review aimed to summarize results of studies using pharmacological manipulations of DA in healthy adults. 'Reward' is a complex process, so we separated 'phases' of reward, including anticipation, evaluation of cost and benefits of upcoming reward, execution of actions to obtain reward, pleasure in response to receiving a reward, and reward learning. Results indicated that i) DAergic drugs have different effects on different phases of reward; ii) the relationship between DA and reward functioning appears unlikely to be linear; iii) our ability to detect the effects of DAergic drugs varies depending on whether subjective, behavioral, imaging measures are used.

Reduced Activation in the Pallidal-Thalamic-Motor Pathway Is Associated With Deficits in Reward-Modulated Inhibitory Control in Adults With a History of Attention-Deficit/Hyperactivity Disorder

BACKGROUND

Attention-deficit/hyperactivity disorder (ADHD) symptoms persist into adulthood and are associated with functional impairments. Neuroimaging studies of reward-modulated inhibitory control can identify potential objective markers of impairment and may deepen our understanding of why probands engage in costly behaviors leading to adverse outcomes. The study aimed to identify reward-modulated inhibitory control neural circuitries, their association with ADHD symptoms, and real-world implications of a decreased capacity to engage in reward-modulated inhibitory control.

METHODS

A total of 106 adults (90% male) with rigorous childhood diagnoses of ADHD were scanned with functional magnetic resonance imaging during the Monetary Incentive Go/NoGo task. Adulthood symptoms of inattention and hyperactivity/impulsivity based on self- and informant report were assessed. The number of lifetime attempts taken to quit smoking were also assessed as an exemplar real-world outcome.

RESULTS

Hyperactivity/impulsivity was negatively associated with activation in the pallidum and primary motor cortex when inhibiting a previously rewarded Go stimulus that yielded a small immediate reward in order to obtain a larger reward later on. Reduced recruitment of the pallidal-thalamic-motor circuit mediated the negative association between hyperactivity/impulsivity and reward-modulated inhibitory control accuracy. Reduced pallidum activation, in response to reward-modulated inhibitory control, was also associated with more attempts made to successfully quit smoking.

CONCLUSIONS

Probands with persistent hyperactivity/impulsivity symptoms have alterations in brain regions that calculate the value of inhibiting an action that yields an immediate reward in order to obtain delayed larger rewards. This deficit results in poor inhibitory control on basic tasks and during real-world behaviors that rely on similar processes.

Inactivation of endopeduncular nucleus impaired fear conditioning and hippocampal synaptic plasticity in rats

The internal globus pallidus (GPi) is one part of basal ganglion nucleuses which play fundamental role in motor function. Recent studies indicated that GPi could modulate emotional processing and learning, but the possible mechanism remains still unknown. In this study, the effects of endopeduncular nucleus (EP, a rodent homolog of GPi) on fear conditioning were tested in rats. GABA_A receptor agonist muscimol was bilaterally delivered into the EP 15 min before or immediately after fear conditioning in rats. We found that EP inactivation impaired the acquisition but not consolidation of fear memory in rats. Furthermore, the long-term potentiation (LTP) in hippocampal CA1 area was impaired, and the learning related phosphorylation of α-amino-3-hydroxy-5-methyl-4-isoxazole-propionic acid receptor (AMPAR) subunit 1 (GluA1) at the Ser845 site in hippocampus was decreased in muscimol treated group. These results demonstrated that dysfunction of EP impaired hippocampal dependent learning and memory in rats.

Long-Term Voluntary Physical Exercise Exerts Neuroprotective Effects and Motor Disturbance Alleviation in a Rat Model of Parkinson's Disease

Background

Parkinson's disease (PD) is the second most prevalent neurodegenerative disorder affecting 7–10 million individuals. The pathologic hallmark of PD is nigrostriatal dopaminergic neuron loss, leading to several motor and nonmotor disturbances, such as akinesia, gait disturbance, depression, and anxiety. Recent animal studies have demonstrated that physical exercise improves behavioral and neuropathological deficits in PD. However, the exact underlying mechanism underlying this effect remains unclear. In this study, we investigated whether long-term exercise has neuroprotective effects on dopaminergic nigrostriatal neurons and whether it further alleviates impairment of the gait pattern, locomotor activity, akinesia, and anxiety-like behavior in PD rats.

Methods

A hemiparkinsonian rat model, generated by unilateral injection of 6-hydroxydopamine (6-OHDA) into the medial forebrain bundle, was applied to evaluate neuroprotective effects and motor behaviors. Comprehensive spatiotemporal gait analysis, open-field locomotor activity, akinesia, apomorphine-induced rotational analysis, and dopaminergic neuron degeneration level were assessed every week and up to 8 weeks after daily voluntary running wheel exercise.

Results

Compared with the sham-treated group, we found that 10 weeks of voluntary exercise (i.e., 2-week exercise before PD lesion and 8-week exercise post-PD lesion) significantly reduced 6-OHDA-induced motor deficits in the gait pattern, akinesia, and rotational behavior in the exercise group. Immunohistochemically, a tyrosine hydroxylase-positive neuron in the substantia nigra was significantly preserved in the exercise group.

Conclusions

Our results demonstrated that long-term exercise training is effective for neuroprotection and further attenuates motor declines induced by 6-OHDA in an experimental model of PD. Our data further highlighted potential therapeutic effects of long-term physical exercise relevant to clinical effects for further potential application on human PD subjects.

A Multilevel Computational Characterization of Endophenotypes in Addiction

Addiction is characterized by a profound intersubject (phenotypic) variability in the expression of addictive symptomatology and propensity to relapse following treatment. However, laboratory investigations have primarily focused on common neural substrates in addiction and have not yet been able to identify mechanisms that can account for the multifaceted phenotypic behaviors reported in the literature. To fill this knowledge gap theoretically, here we simulated phenotypic variations in addiction symptomology and responses to putative treatments, using both a neural model, based on cortico-striatal circuit dynamics, and an algorithmic model of reinforcement learning (RL). These simulations rely on the widely accepted assumption that both the ventral, model-based, goal-directed system and the dorsal, model-free, habitual system are vulnerable to extra-physiologic dopamine reinforcements triggered by addictive rewards. We found that endophenotypic differences in the balance between the two circuit or control systems resulted in an inverted-U shape in optimal choice behavior. Specifically, greater unbalance led to a higher likelihood of developing addiction and more severe drug-taking behaviors. Furthermore, endophenotypes with opposite asymmetrical biases among cortico-striatal circuits expressed similar addiction behaviors, but responded differently to simulated treatments, suggesting personalized treatment development could rely on endophenotypic rather than phenotypic differentiations. We propose our simulated results, confirmed across neural and algorithmic levels of analysis, inform on a fundamental and, to date, neglected quantitative method to characterize clinical heterogeneity in addiction.