Differential contributions of the globus pallidus and ventral thalamus to stimulus-response learning in humans

Reward prediction error in learning-related behaviors

Learning is a complex process, during which our opinions and decisions are easily changed due to unexpected information. But the neural mechanism underlying revision and correction during the learning process remains unclear. For decades, prediction error has been regarded as the core of changes to perception in learning, even driving the learning progress. In this article, we reviewed the concept of reward prediction error, and the encoding mechanism of dopaminergic neurons and the related neural circuities. We also discussed the relationship between reward prediction error and learning-related behaviors, including reversal learning. We then demonstrated the evidence of reward prediction error signals in several neurological diseases, including Parkinson's disease and addiction. These observations may help to better understand the regulatory mechanism of reward prediction error in learning-related behaviors.

Pallidal neuromodulation of the explore/exploit trade-off in decision-making

Every decision that we make involves a conflict between exploiting our current knowledge of an action's value or exploring alternative courses of action that might lead to a better, or worse outcome. The sub-cortical nuclei that make up the basal ganglia have been proposed as a neural circuit that may contribute to resolving this explore-exploit 'dilemma'. To test this hypothesis, we examined the effects of neuromodulating the basal ganglia's output nucleus, the globus pallidus interna, in patients who had undergone deep brain stimulation (DBS) for isolated dystonia. Neuromodulation enhanced the number of exploratory choices to the lower value option in a two-armed bandit probabilistic reversal-learning task. Enhanced exploration was explained by a reduction in the rate of evidence accumulation (drift rate) in a reinforcement learning drift diffusion model. We estimated the functional connectivity profile between the stimulating DBS electrode and the rest of the brain using a normative functional connectome derived from heathy controls. Variation in the extent of neuromodulation induced exploration between patients was associated with functional connectivity from the stimulation electrode site to a distributed brain functional network. We conclude that the basal ganglia's output nucleus, the globus pallidus interna, can adaptively modify decision choice when faced with the dilemma to explore or exploit.

The Association Between Lentiform Nucleus Function and Cognitive Impairments in Schizophrenia

Introduction: Cognitive decline is the core schizophrenia symptom, which is now well accepted. Holding a role in various aspects of cognition, lentiform nucleus (putamen and globus pallidus) dysfunction contributes to the psychopathology of this disease. However, the effects of lentiform nucleus function on cognitive impairments in schizophrenia are yet to be investigated.

Objectives: We aim to detect the fractional amplitude of low-frequency fluctuation (fALFF) alterations in patients with schizophrenia, and examine how their behavior correlates in relation to the cognitive impairments of the patients.

Methods: All participants underwent magnetic resonance imaging (MRI) and cognitive assessment (digit span and digit symbol coding tests). Screening of brain regions with significant changes in fALFF values was based on analysis of the whole brain. The data were analyzed between Jun 2020 and Mar 2021. There were no interventions beyond the routine therapy determined by their clinicians on the basis of standard clinical practice.

Results: There were 136 patients (75 men and 61 women, 24.1 ± 7.4 years old) and 146 healthy controls (82 men and 64 women, 24.2 ± 5.2 years old) involved in the experiments seriatim. Patients with schizophrenia exhibited decreased raw scores in cognitive tests (p < 0.001) and increased fALFF in the bilateral lentiform nuclei (left: 67 voxels; x = −24, y = −6, z = 3; peak t-value = 6.90; right: 16 voxels; x = 18, y = 0, z = 3; peak t-value = 6.36). The fALFF values in the bilateral lentiform nuclei were positively correlated with digit span-backward test scores (left: r = 0.193, p = 0.027; right: r = 0.190, p = 0.030), and the right lentiform nucleus was positively correlated with digit symbol coding scores (r = 0.209, p = 0.016).

Conclusion: This study demonstrates that cognitive impairments in schizophrenia are associated with lentiform nucleus function as revealed by MRI, involving working memory and processing speed.

Astrocyte-neuron interaction in the dorsal striatum-pallidal circuits and alcohol-seeking behaviors

In the striatum, two main types of GABAergic medium spiny neurons (MSNs), denoted striatonigral (or direct-pathway MSNs, dMSNs) and striatopallidal neurons (indirect-pathway MSNs, iMSNs), form circuits with distinct pallidal nuclei, which sends "GO" or "NO-GO" signals through the thalamus. These striatopallidal circuits evaluate and execute reward-seeking and taking behaviors. Especially, the dorsal striatum can be further divided into the dorsomedial striatum (DMS, equivalent to caudate in primates and humans) and dorsolateral striatum (DLS, equivalent to putamen), which orchestrates goal-directed and habitual reward-seeking and taking behaviors, respectively. Using optogenetics, chemogenetics and in vivo calcium imaging technologies combined with electrophysiology and digitalized behavior phenotyping, recent studies have revealed cell-, circuit- and context-specific functions of these microcircuits in addictive behaviors. Also, region-specific astrocytes regulate the homeostatic activities of the dMSNs and iMSNs as well as the downstream circuits, which determine the net balance of cortico-striato-pallidal activities to the thalamic neurons. This review will summarize the recent progress of striatopallidal circuits focusing on astrocyte-neuron interaction and, reward- and alcohol-seeking behaviors. Our review will also discuss the translational and clinical implications of these microcircuit studies. This article is part of the special Issue on "Neurocircuitry Modulating Drug and Alcohol Abuse".

The impact of modern-day neuroimaging on the field of deep brain stimulation

PURPOSE OF REVIEW

Deep brain stimulation (DBS) is an established but growing treatment option for multiple brain disorders. Over the last decade, electrode placement and their effects were increasingly analyzed with modern-day neuroimaging methods like spatial normalization, fibertracking, or resting-state functional MRI. Similarly, specialized basal ganglia MRI sequences were introduced and imaging at high field strengths has become increasingly popular.

RECENT FINDINGS

To facilitate the process of precise electrode localizations, specialized software pipelines were introduced. By those means, DBS targets could recently be refined and significant relationships between electrode placement and clinical improvement could be shown. Furthermore, by combining electrode reconstructions with network imaging methods, relationships between electrode connectivity and clinical improvement were investigated. This led to a broad series of imaging-based insights about DBS that are reviewed in the present work.

SUMMARY

The reviewed literature makes a strong case that brain imaging plays an increasingly important role in DBS targeting and programming. Furthermore, brain imaging will likely help to better understand the mechanism of action of DBS.

Inactivation of endopeduncular nucleus impaired fear conditioning and hippocampal synaptic plasticity in rats

The internal globus pallidus (GPi) is one part of basal ganglion nucleuses which play fundamental role in motor function. Recent studies indicated that GPi could modulate emotional processing and learning, but the possible mechanism remains still unknown. In this study, the effects of endopeduncular nucleus (EP, a rodent homolog of GPi) on fear conditioning were tested in rats. GABA_A receptor agonist muscimol was bilaterally delivered into the EP 15 min before or immediately after fear conditioning in rats. We found that EP inactivation impaired the acquisition but not consolidation of fear memory in rats. Furthermore, the long-term potentiation (LTP) in hippocampal CA1 area was impaired, and the learning related phosphorylation of α-amino-3-hydroxy-5-methyl-4-isoxazole-propionic acid receptor (AMPAR) subunit 1 (GluA1) at the Ser845 site in hippocampus was decreased in muscimol treated group. These results demonstrated that dysfunction of EP impaired hippocampal dependent learning and memory in rats.

Lead-DBS v2: Towards a comprehensive pipeline for deep brain stimulation imaging

Deep brain stimulation (DBS) is a highly efficacious treatment option for movement disorders and a growing number of other indications are investigated in clinical trials. To ensure optimal treatment outcome, exact electrode placement is required. Moreover, to analyze the relationship between electrode location and clinical results, a precise reconstruction of electrode placement is required, posing specific challenges to the field of neuroimaging. Since 2014 the open source toolbox Lead-DBS is available, which aims at facilitating this process. The tool has since become a popular platform for DBS imaging. With support of a broad community of researchers worldwide, methods have been continuously updated and complemented by new tools for tasks such as multispectral nonlinear registration, structural/functional connectivity analyses, brain shift correction, reconstruction of microelectrode recordings and orientation detection of segmented DBS leads. The rapid development and emergence of these methods in DBS data analysis require us to revisit and revise the pipelines introduced in the original methods publication. Here we demonstrate the updated DBS and connectome pipelines of Lead-DBS using a single patient example with state-of-the-art high-field imaging as well as a retrospective cohort of patients scanned in a typical clinical setting at 1.5T. Imaging data of the 3T example patient is co-registered using five algorithms and nonlinearly warped into template space using ten approaches for comparative purposes. After reconstruction of DBS electrodes (which is possible using three methods and a specific refinement tool), the volume of tissue activated is calculated for two DBS settings using four distinct models and various parameters. Finally, four whole-brain tractography algorithms are applied to the patient's preoperative diffusion MRI data and structural as well as functional connectivity between the stimulation volume and other brain areas are estimated using a total of eight approaches and datasets. In addition, we demonstrate impact of selected preprocessing strategies on the retrospective sample of 51 PD patients. We compare the amount of variance in clinical improvement that can be explained by the computer model depending on the preprocessing method of choice. This work represents a multi-institutional collaborative effort to develop a comprehensive, open source pipeline for DBS imaging and connectomics, which has already empowered several studies, and may facilitate a variety of future studies in the field.

Reinforcement magnitudes modulate subthalamic beta band activity in patients with Parkinson's disease

We set out to investigate whether beta oscillations in the human basal ganglia are modulated during reinforcement learning. Based on previous research, we assumed that beta activity might either reflect the magnitudes of individuals' received reinforcements (reinforcement hypothesis), their reinforcement prediction errors (dopamine hypothesis) or their tendencies to repeat versus adapt responses based upon reinforcements (status-quo hypothesis). We tested these hypotheses by recording local field potentials (LFPs) from the subthalamic nuclei of 19 Parkinson's disease patients engaged in a reinforcement-learning paradigm. We then correlated patients' reinforcement magnitudes, reinforcement prediction errors and response repetition tendencies with task-related power changes in their LFP oscillations. During feedback presentation, activity in the frequency range of 14 to 27 Hz (beta spectrum) correlated positively with reinforcement magnitudes. During responding, alpha and low beta activity (6 to 18 Hz) was negatively correlated with previous reinforcement magnitudes. Reinforcement prediction errors and response repetition tendencies did not correlate significantly with LFP oscillations. These results suggest that alpha and beta oscillations during reinforcement learning reflect patients' observed reinforcement magnitudes, rather than their reinforcement prediction errors or their tendencies to repeat versus adapt their responses, arguing both against an involvement of phasic dopamine and against applicability of the status-quo theory.

A diffusion weighted imaging study of basal ganglia in schizophrenia

OBJECTIVES

Several magnetic resonance imaging (MRI) studies provided evidence of selective brain abnormalities in schizophrenia, both in cortical and subcortical structures. Basal ganglia are of particular interest, given not only the high concentration of dopaminergic neurons and receptors, but also for their crucial role in cognitive functions, commonly impaired in schizophrenia. To date, very few studies explored basal ganglia using diffusion imaging, which is sensitive to microstructural organization in brain tissues. The aim of our study is to explore basal ganglia structures with diffusion imaging in a sizeable sample of patients affected by schizophrenia and healthy controls.

METHODS

We enrolled 52 subjects affected by schizophrenia according to DMS-IV-R criteria and 46 healthy controls. Diffusion weighted images were obtained using a 1.5 Tesla scanner and apparent diffusion coefficient (ADC) values were determined in axial and coronal sections at the level of basal ganglia.

RESULTS

Patients affected by schizophrenia showed a significantly higher ADC compared to healthy controls in the left anterior lenticular nucleus (F = 3.9, p = .05). A significant positive correlation between right anterior lenticular nucleus and psychotropic dosages was found (r = 0.4, p = .01).

CONCLUSIONS

Our study provides evidence of lenticular nucleus microstructure alterations in schizophrenia, potentially sustaining cognitive and motor deficits in schizophrenia. Key points The basal ganglia structures was explored with diffusion imaging in a sizeable sample of patients affected by schizophrenia and healthy controls. Patients affected by schizophrenia showed a significantly higher ADC compared to healthy controls in the left anterior lenticular nucleus. Our study provides evidence of lenticular nucleus microstructure alterations in schizophrenia, potentially sustaining cognitive and motor deficits in schizophrenia.

Toward defining deep brain stimulation targets in MNI space: A subcortical atlas based on multimodal MRI, histology and structural connectivity

Three-dimensional atlases of subcortical brain structures are valuable tools to reference anatomy in neuroscience and neurology. For instance, they can be used to study the position and shape of the three most common deep brain stimulation (DBS) targets, the subthalamic nucleus (STN), internal part of the pallidum (GPi) and ventral intermediate nucleus of the thalamus (VIM) in spatial relationship to DBS electrodes. Here, we present a composite atlas based on manual segmentations of a multimodal high resolution brain template, histology and structural connectivity. In a first step, four key structures were defined on the template itself using a combination of multispectral image analysis and manual segmentation. Second, these structures were used as anchor points to coregister a detailed histological atlas into standard space. Results show that this approach significantly improved coregistration accuracy over previously published methods. Finally, a sub-segmentation of STN and GPi into functional zones was achieved based on structural connectivity. The result is a composite atlas that defines key nuclei on the template itself, fills the gaps between them using histology and further subdivides them using structural connectivity. We show that the atlas can be used to segment DBS targets in single subjects, yielding more accurate results compared to priorly published atlases. The atlas will be made publicly available and constitutes a resource to study DBS electrode localizations in combination with modern neuroimaging methods.

Ethanol-Sensitive Pacemaker Neurons in the Mouse External Globus Pallidus

Although ethanol is one of the most widely used drugs, we still lack a full understanding of which neuronal subtypes are affected by this drug. Pacemaker neurons exert powerful control over brain circuit function, but little is known about ethanol effects on these types of neurons. Neurons in the external globus pallidus (GPe) generate pacemaker activity that controls basal ganglia, circuitry associated with habitual and compulsive drug use. We performed patch-clamp recordings from GPe neurons and found that bath application of ethanol dose-dependently decreased the firing rate of low-frequency GPe neurons, but did not alter the firing of high-frequency neurons. GABA or glutamate receptor antagonists did not block the ethanol effect. The GPe is comprised of a heterogeneous population of neurons. We used Lhx6-EGFP and Npas1-tdTm mice strains to identify low-frequency neurons. Lhx6 and Npas1 neurons exhibited decreased firing with ethanol, but only Npas1 neurons were sensitive to 10 mM ethanol. Large-conductance voltage and Ca²⁺-activated K⁺ (BK) channel have a key role in the ethanol effect on GPe neurons, as the application of BK channel inhibitors blocked the ethanol-induced firing decrease. Ethanol also increased BK channel open probability measured in single-channel recordings from Npas1-tdTm neurons. In addition, in vivo electrophysiological recordings from GPe showed that ethanol decreased the firing of a large subset of low-frequency neurons. These findings indicate how selectivity of ethanol effects on pacemaker neurons can occur, and enhance our understanding of the mechanisms contributing to acute ethanol effects on the basal ganglia.

Human centromedian-parafascicular complex signals sensory cues for goal-oriented behavior selection

Experimental research has shown that the centromedian-parafascicular complex (CM-Pf) of the intralaminar thalamus is activated in attentional orienting and processing of behaviorally relevant stimuli. These observations resulted in the hypothesis that the CM-Pf plays a pivotal role in goal-oriented behavior selection. We here set out to test this hypothesis with electrophysiological recordings from patients with electrodes implanted in CM-Pf for deep brain stimulation (DBS) treatment of chronic neuropathic pain. Six patients participated in (1) an auditory three-class oddball experiment, which required a button press to target tones, but not to standard and deviant tones and in (2) a multi-speaker experiment with a target word that required attention selection and a target image that required response selection. Subjects showed transient neural responses (8-15Hz) to the target tone and the target word. Two subjects additionally showed transient neural responses (15-25Hz) to the target image. All sensory target stimuli were related to an internal goal and required a behavior selection (attention selection, response selection). In group analyses, neural responses were greater to target tones than deviant and standard tones and to target words than other task-relevant words that did not require attention selection. The transient neural responses occurred after the target stimuli but prior to the overt behavioral response. Our results demonstrate that in human subjects the CM-Pf is involved in signaling sensory inputs related to goal-oriented selection of behavior.

Probabilistic conversion of neurosurgical DBS electrode coordinates into MNI space

In neurosurgical literature, findings such as deep brain stimulation (DBS) electrode positions are conventionally reported in relation to the anterior and posterior commissures of the individual patient (AC/PC coordinates). However, the neuroimaging literature including neuroanatomical atlases, activation patterns, and brain connectivity maps has converged on a different population-based standard (MNI coordinates). Ideally, one could relate these two literatures by directly transforming MRIs from neurosurgical patients into MNI space. However obtaining these patient MRIs can prove difficult or impossible, especially for older studies or those with hundreds of patients. Here, we introduce a methodology for mapping an AC/PC coordinate (such as a DBS electrode position) to MNI space without the need for MRI scans from the patients themselves. We validate our approach using a cohort of DBS patients in which MRIs are available, and test whether several variations on our approach provide added benefit. We then use our approach to convert previously reported DBS electrode coordinates from eight different neurological and psychiatric diseases into MNI space. Finally, we demonstrate the value of such a conversion using the DBS target for essential tremor as an example, relating the site of the active DBS contact to different MNI atlases as well as anatomical and functional connectomes in MNI space.

The human subthalamic nucleus and globus pallidus internus differentially encode reward during action control

The subthalamic nucleus (STN) and globus pallidus internus (GPi) have recently been shown to encode reward, but few studies have been performed in humans. We investigated STN and GPi encoding of reward and loss (i.e., valence) in humans with Parkinson's disease. To test the hypothesis that STN and GPi neurons would change their firing rate in response to reward- and loss-related stimuli, we recorded the activity of individual neurons while participants performed a behavioral task. In the task, action choices were associated with potential rewarding, punitive, or neutral outcomes. We found that STN and GPi neurons encode valence-related information during action control, but the proportion of valence-responsive neurons was greater in the STN compared to the GPi. In the STN, reward-related stimuli mobilized a greater proportion of neurons than loss-related stimuli. We also found surprising limbic overlap with the sensorimotor regions in both the STN and GPi, and this overlap was greater than has been previously reported. These findings may help to explain alterations in limbic function that have been observed following deep brain stimulation therapy of the STN and GPi. Hum Brain Mapp 38:1952-1964, 2017. © 2017 Wiley Periodicals, Inc.

Preliminary evidence for human globus pallidus pars interna neurons signaling reward and sensory stimuli

•

Non-motor responses of human GPi neurons are described.

•

Cells were identified that showed increased firing to reward-stimuli.

•

Visual-sensory responses unrelated to reward also observed.

The globus pallidus pars interna (GPi) is a component of the basal ganglia, a network of subcortical nuclei that process motor, associative, and limbic information. While non-human primate studies have suggested a role for the GPi in non-motor functions, there have been no single-unit studies of non-motor electrophysiological behavior of human GPi neurons. We therefore sought to extend these findings by collecting single-unit recordings from awake patients during functional stereotactic neurosurgery targeting the GPi for deep brain stimulation. To assess cellular responses to non-motor information, patients performed a reward task where virtual money could be won, lost, or neither, depending on their performance while cellular activity was monitored. Changes in the firing rates of isolated GPi neurons after the presentation of reward-related stimuli were compared between different reward contingencies (win, loss, null). We observed neurons that modulated their firing rate significantly to the presentation of reward-related stimuli. We furthermore found neurons that responded to visual-stimuli more broadly. This is the first single-unit evidence of human GPi neurons carrying non-motor information. These results are broadly consistent with previous findings in the animal literature and suggest non-motor information may be represented in the single-unit activity of human GPi neurons.