Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making

Dynamic control of decision and movement speed in the human basal ganglia

To optimally adjust our behavior to changing environments we need to both adjust the speed of our decisions and movements. Yet little is known about the extent to which these processes are controlled by common or separate mechanisms. Furthermore, while previous evidence from computational models and empirical studies suggests that the basal ganglia play an important role during adjustments of decision-making, it remains unclear how this is implemented. Leveraging the opportunity to directly access the subthalamic nucleus of the basal ganglia in humans undergoing deep brain stimulation surgery, we here combine invasive electrophysiological recordings, electrical stimulation and computational modelling of perceptual decision-making. We demonstrate that, while similarities between subthalamic control of decision- and movement speed exist, the causal contribution of the subthalamic nucleus to these processes can be disentangled. Our results show that the basal ganglia independently control the speed of decisions and movement for each hemisphere during adaptive behavior.

A diffusion model for the congruency sequence effect

Two-choice reaction tasks for which stimuli differ on irrelevant and relevant dimensions (e.g., Simon, flanker, and Stroop tasks) show congruency effects. The diffusion model for conflict tasks (DMC) has provided a quantitative account of the mechanisms underlying decisions in such conflict tasks, but it has not been applied to the congruency sequence effect (CSE) for which the congruency on the prior trial influences performance on the current trial. The present study expands analysis of the reaction time (RT) distributions reflected by delta plots to the CSE, and then extends the DMC to simulate the results. With increasing RT: (1) the spatial Simon effect was almost unchanged following congruent trials but initially became smaller and finally reversed following incongruent trials; (2) the arrow-based Simon effects increased following both congruent and incongruent trials, but more so for the former than the latter; (3) the flanker congruency effect varied quadratically following congruent trials but increased linearly following incongruent trials. These results were modeled by the CSE-DMC, extended from the DMC with two additional assumptions: (1) feature integration influences only the controlled processes; (2) following incongruent trials, the automatic process is weakened. The results fit better with the CSE-DMC than with two variants that separately had only one of the two additional assumptions. These findings indicate that the CSEs for different conflict tasks have disparate RT distributions and that these disparities are likely due to the controlled and automatic processes being influenced differently for each trial sequence.

Locus coeruleus integrity correlates with inhibitory functions of the fronto-subthalamic 'hyperdirect' pathway in Parkinson's disease

A long-running debate concerns whether dopamine or noradrenaline deficiency drives response disinhibition in Parkinson's disease (PD). This study aimed to investigate whether damage to the locus coeruleus (LC) or substantia nigra (SN) might impact inhibitory functions of the fronto-subthalamic hyperdirect or fronto-striatal indirect pathway. Patients with PD (n = 29, 13 women) and matched healthy controls (n = 29, 15 women) participated in this cross-sectional study. LC and SN integrity was assessed using neuromelanin-sensitive MRI. Response inhibition was measured using fMRI with a stop-signal task. In healthy controls, LC (but not SN) integrity correlated with the stopping-related activity of the right inferior frontal gyrus (IFG) and right subthalamic nucleus (STN), which further correlated with stop-signal reaction time (SSRT). PD patients showed reduced LC integrity, longer SSRT, and lower stopping-related activity over the right IFG, pre-supplementary motor area, and right caudate nucleus than healthy controls. In PD patients, the relationship between SSRT and the fronto-subthalamic pathway was preserved. However, LC integrity no longer correlated with the stopping-related right IFG or right STN activity. No contribution of SN integrity was found during stopping. In conclusion, LC (but not SN) might modulate inhibitory functions of the right IFG-STN pathway. Damage to the LC might impact the right IFG-STN pathway during stopping, leading to response disinhibition in PD.

A neurocomputational theory of action regulation predicts motor behavior in neurotypical individuals and patients with Parkinson’s disease

Surviving in an uncertain environment requires not only the ability to select the best action, but also the flexibility to withhold inappropriate actions when the environmental conditions change. Although selecting and withholding actions have been extensively studied in both human and animals, there is still lack of consensus on the mechanism underlying these action regulation functions, and more importantly, how they inter-relate. A critical gap impeding progress is the lack of a computational theory that will integrate the mechanisms of action regulation into a unified framework. The current study aims to advance our understanding by developing a neurodynamical computational theory that models the mechanism of action regulation that involves suppressing responses, and predicts how disruption of this mechanism can lead to motor deficits in Parkinson’s disease (PD) patients. We tested the model predictions in neurotypical individuals and PD patients in three behavioral tasks that involve free action selection between two opposed directions, action selection in the presence of conflicting information and abandoning an ongoing action when a stop signal is presented. Our results and theory suggest an integrated mechanism of action regulation that affects both action initiation and inhibition. When this mechanism is disrupted, motor behavior is affected, leading to longer reaction times and higher error rates in action inhibition.

Estimating the Time to Do Nothing: Toward Next-Generation Models of Response Inhibition

Controlled behavior requires response inhibition, which is a cognitive function that involves withholding action as goals change. Response inhibition is often assessed using the stop-signal paradigm, in which participants respond to most stimuli but periodically withhold their response when a subsequent stop signal occurs. The stop-signal paradigm rests on the theoretical foundation of the independent race model, which assumes a stop racer that races independently against a go racer; behavior is determined by which racer finishes first. We highlight work showing violations of the keystone independence assumption of existing stop models and discuss promising new models of response inhibition.

Moving beyond response times with accessible measures of manual dynamics

Button-press measures of response time (RT) and accuracy have long served a central role in psychological research. However, RT and accuracy provide limited insight into how cognitive processes unfold over time. To address this limitation, researchers have used hand-tracking techniques to investigate how cognitive processes unfold over the course of a response, are modulated by recent experience, and function across the lifespan. Despite the efficacy of these techniques for investigating a wide range of psychological phenomena, widespread adoption of hand-tracking techniques within the field is hindered by a range of factors, including equipment costs and the use of specialized software. Here, we demonstrate that the behavioral dynamics previously observed with specialized motion-tracking equipment in an Eriksen flanker task can be captured with an affordable, portable, and easy-to-assemble response box. Six-to-eight-year-olds and adults (N = 90) completed a computerized version of the flanker task by pressing and holding a central button until a stimulus array appeared. Participants then responded by releasing the central button and reaching to press one of two response buttons. This method allowed RT to be separated into initiation time (when the central button was released) and movement time (time elapsed between initiation and completion of the response). Consistent with previous research using motion-tracking techniques, initiation times and movement times revealed distinct patterns of effects across trials and between age groups, indicating that the method used in the current study presents a simple solution for researchers from across the psychological and brain sciences looking to move beyond RTs.

Abnormal neural oscillations during gait and dual-task in Parkinson’s disease

Gait dysfunctions are debilitating motor symptoms of Parkinson’s disease (PD) and may result in frequent falling with health complications. The contribution of the motor-cognitive network to gait disturbance can be studied more thoroughly by challenging motor-cognitive dual-task gait performances. Gait is a complex motor task that requires an appropriate contribution from motor and cognitive networks, reflected in frequency modulations among several cortical and subcortical networks. Electrophysiological recordings by scalp electroencephalography and implanted deep brain stimulation (DBS) electrodes have unveiled modulations of specific oscillatory patterns in the cortical-subcortical circuits in PD. In this review, we summarize oscillatory contributions of the cortical, basal ganglia, mesencephalic locomotor, and cerebellar regions during gait and dual-task activities in PD. We detail the involvement of the cognitive network in dual-task settings and compare how abnormal oscillations in the specific frequency bands in the cortical and subcortical regions correlate with gait deficits in PD, particularly freezing of gait (FOG). We suggest that altered neural oscillations in different frequencies can cause derangements in broader brain networks, so neuromodulation and pharmacological therapies should be considered to normalize those network oscillations to improve challenged gait and dual-task motor functions in PD. Specifically, the theta and beta bands in premotor cortical areas, subthalamic nucleus, as well as alpha band activity in the brainstem prepontine nucleus, modulate under clinically effective levodopa and DBS therapies, improving gait and dual-task performance in PD with FOG, compared to PD without FOG and age-matched healthy control groups.

Comparing Stop Signal Reaction Times in Alzheimer's and Parkinson's Disease

BACKGROUND

To investigate the relative contributions of cerebral cortex and basal ganglia to movement stopping, we tested the optimum combination Stop Signal Reaction Time (ocSSRT) and median visual reaction time (RT) in patients with Alzheimer's disease (AD) and Parkinson's disease (PD) and compared values with data from healthy controls.

METHODS

Thirty-five PD patients, 22 AD patients, and 29 healthy controls were recruited to this study. RT and ocSSRT were measured using a hand-held battery-operated electronic box through a stop signal paradigm.

RESULT

The mean ocSSRT was found to be 309 ms, 368 ms, and 265 ms in AD, PD, and healthy controls, respectively, and significantly prolonged in PD compared to healthy controls (p = 0.001). The ocSSRT but not RT could separate AD from PD patients (p = 0.022).

CONCLUSION

Our data suggest that subcortical networks encompassing dopaminergic pathways in the basal ganglia play a more important role than cortical networks in movement-stopping. Combining ocSSRT with other putative indices or biomarkers of AD (and other dementias) could increase the accuracy of early diagnosis.

Essential tremor impairs the ability to suppress involuntary action impulses

Essential tremor (ET) is a movement disorder characterized primarily by action tremor which affects the regulation of movements. Disruptions in cerebello-thalamocortical networks could interfere with cognitive control over actions in ET, for example, the ability to suppress a strong automatic impulse over a more appropriate action (conflict control). The current study investigated whether ET impacts conflict control proficiency. Forty-one ET patients and 29 age-matched healthy controls (HCs) performed a conflict control task (Simon task). Participants were instructed to give a left or right response to a spatially lateralized arrow (direction of the arrow). When the action signaled by the spatial location and direction of the arrow were non-corresponding (induced conflict), the inappropriate action impulse required suppression. Overall, ET patients responded slower and less accurately compared to HCs. ET patients were especially less accurate on non-corresponding conflict (Nc) versus corresponding (Cs) trials. A focused analysis on fast impulsive response rates (based on the accuracy rate at the fastest reaction times on Nc trials) showed that ET patients made more fast errors compared to HCs. Results suggest impaired conflict control in ET compared to HCs. The increased impulsive errors seen in the ET population may be a symptom of deficiencies in the cerebello-thalamocortical networks, or, be caused by indirect effects on the cortico-striatal pathways. Future studies into the functional networks impacted by ET (cortico-striatal and cerebello-thalamocortical pathways) could advance our understanding of inhibitory control in general and the cognitive deficits in ET.

Evidence for non-selective response inhibition in uncertain contexts revealed by combined meta-analysis and Bayesian analysis of fMRI data

Response inhibition is typically considered a brain mechanism selectively triggered by particular “inhibitory” stimuli or events. Based on recent research, an alternative non-selective mechanism was proposed by several authors. Presumably, the inhibitory brain activity may be triggered not only by the presentation of “inhibitory” stimuli but also by any imperative stimuli, including Go stimuli, when the context is uncertain. Earlier support for this notion was mainly based on the absence of a significant difference between neural activity evoked by equiprobable Go and NoGo stimuli. Equiprobable Go/NoGo design with a simple response time task limits potential confounds between response inhibition and accompanying cognitive processes while not preventing prepotent automaticity. However, previous neuroimaging studies used classical null hypothesis significance testing, making it impossible to accept the null hypothesis. Therefore, the current research aimed to provide evidence for the practical equivalence of neuronal activity in the Go and NoGo trials using Bayesian analysis of functional magnetic resonance imaging (fMRI) data. Thirty-four healthy participants performed a cued Go/NoGo task with an equiprobable presentation of Go and NoGo stimuli. To independently localize brain areas associated with response inhibition in similar experimental conditions, we performed a meta-analysis of fMRI studies using equal-probability Go/NoGo tasks. As a result, we observed overlap between response inhibition areas and areas that demonstrate the practical equivalence of neuronal activity located in the right dorsolateral prefrontal cortex, parietal cortex, premotor cortex, and left inferior frontal gyrus. Thus, obtained results favour the existence of non-selective response inhibition, which can act in settings of contextual uncertainty induced by the equal probability of Go and NoGo stimuli.

Biophysical and Architectural Mechanisms of Subthalamic Theta under Response Conflict

The cortico-basal ganglia circuit is needed to suppress prepotent actions and to facilitate controlled behavior. Under conditions of response conflict, the frontal cortex and subthalamic nucleus (STN) exhibit increased spiking and theta band power, which are linked to adaptive regulation of behavioral output. The electrophysiological mechanisms underlying these neural signatures of impulse control remain poorly understood. To address this lacuna, we constructed a novel large-scale, biophysically principled model of the subthalamopallidal (STN-globus pallidus externus) network and examined the mechanisms that modulate theta power and spiking in response to cortical input. Simulations confirmed that theta power does not emerge from intrinsic network dynamics but is robustly elicited in response to cortical input as burst events representing action selection dynamics. Rhythmic burst events of multiple cortical populations, representing a state of conflict where cortical motor plans vacillate in the theta range, led to prolonged STN theta and increased spiking, consistent with empirical literature. Notably, theta band signaling required NMDA, but not AMPA, currents, which were in turn related to a triphasic STN response characterized by spiking, silence, and bursting periods. Finally, theta band resonance was also strongly modulated by architectural connectivity, with maximal theta arising when multiple cortical populations project to individual STN "conflict detector" units because of an NMDA-dependent supralinear response. Our results provide insights into the biophysical principles and architectural constraints that give rise to STN dynamics during response conflict, and how their disruption can lead to impulsivity and compulsivity.SIGNIFICANCE STATEMENT The subthalamic nucleus exhibits theta band power modulation related to cognitive control over motor actions during conditions of response conflict. However, the mechanisms of such dynamics are not understood. Here we developed a novel biophysically detailed and data-constrained large-scale model of the subthalamopallidal network, and examined the impacts of cellular and network architectural properties that give rise to theta dynamics. Our investigations implicate an important role for NMDA receptors and cortico-subthalamic nucleus topographical connectivities in theta power modulation.

The computational roots of positivity and confirmation biases in reinforcement learning

Humans do not integrate new information objectively: outcomes carrying a positive affective value and evidence confirming one's own prior belief are overweighed. Until recently, theoretical and empirical accounts of the positivity and confirmation biases assumed them to be specific to 'high-level' belief updates. We present evidence against this account. Learning rates in reinforcement learning (RL) tasks, estimated across different contexts and species, generally present the same characteristic asymmetry, suggesting that belief and value updating processes share key computational principles and distortions. This bias generates over-optimistic expectations about the probability of making the right choices and, consequently, generates over-optimistic reward expectations. We discuss the normative and neurobiological roots of these RL biases and their position within the greater picture of behavioral decision-making theories.

Trauma Disrupts Reinforcement Learning in Rats-A Novel Animal Model of Chronic Stress Exposure

Trauma, as well as chronic stress that characterizes a modern fast-paced lifestyle, contributes to numerous psychopathologies and psychological problems. Psychiatric patients with traumas, as well as healthy individuals who experienced traumas in the past, are often characterized by diminished cognitive abilities. In our protocol, we used an animal model to explore the influence of chronic trauma on cognitive abilities and behavior in the group of 20 rats (Rattus norvegicus). The experimental group was introduced to chronic (12 consecutive days) exposure to predator odor (bobcat urine). We measured the reinforcement learning of each individual before and after the exposition via the Probabilistic Selection Task (PST) and we used Social Interaction Test (SIT) to assess the behavioral changes of each individual before and after the trauma. In the experimental group, there was a significant decrease in reinforcement learning after exposure to a single trauma (Wilcoxon Test, p = 0.034) as well as after 11 days of chronic trauma (Wilcoxon-test, p = 0.01) in comparison to pre-trauma performance. The control group, which was not exposed to predator odor but underwent the same testing protocol, did not present significant deterioration in reinforcement learning. In cross-group comparisons, there was no difference between the experimental and control group in PST before odor protocol (U Mann-Whitney two-sided, p = 0.909). After exposure to chronic trauma, the experimental group deteriorated in PST performance compared to control (U Mann-Whitney Two-sided, p = 0.0005). In SIT, the experimental group spent less time in an Interaction Zone with an unfamiliar rat after trauma protocol (Wilcoxon two-sided test, p = 0.019). Major strengths of our models are: (1) protocol allows investigating reinforcement learning before and after exposition to chronic trauma, with the same group of rats, (2) translational scope, as the PST is displayed on touchscreen, similarly to human studies, (3) protocol delivers chronic trauma that impairs reward learning, but behaviorally does not induce full-blown anhedonia, thus rats performed voluntarily throughout all the procedures.

The Effects of Subthalamic Nucleus Deep Brain Stimulation in Parkinson's Disease on Associative Learning of Verbal and Non-Verbal Information by Trial and Error or with Corrective Feedback

BACKGROUND

Parkinson's disease (PD) and subthalamic nucleus deep brain stimulation (STN-DBS) are both known to induce cognitive changes.

OBJECTIVE

The aim of our study was to investigate the impact of STN-DBS on two forms of conditional associative learning (CAL), trial and error or corrective feedback learning, which differed in difficulty to test the load-dependency hypothesis of the cognitive effects of STN-DBS in PD.

METHODS

We recruited two groups of PD patients, those who had STN-DBS surgery bilaterally (n = 24) and a second unoperated group (n = 9) who were assessed on two versions of a task of visual CAL involving either a more difficult trial and error learning or a relatively easier corrective feedback learning. Each task was completed twice by both groups, On and Off STN-DBS for the operated group and a first and second time by the unoperated group.

RESULTS

With STN-DBS Off, corrective feedback learning was superior to trial and error CAL, but not with STN-DBS On. The unoperated PD group had improved performance during the second assessment. To control for the improvement observed with repeated assessment in the PD control group, we split the STN-DBS group into two subgroups based on the condition of the first assessment (Off first vs. On first). While we found no STN-DBS effects for the Off first subgroup (N = 14), we observed improved performance during the second STN-DBS Off session for the On first subgroup (N = 10).

CONCLUSION

The findings suggest that in PD, STN-DBS interferes with use of corrective feedback and its integration in the conditional associative learning process. Also STN stimulation affected the ability of operated patients to resolve proactive interference during learning of the arbitrary visual associations by trial and error or with corrective feedback.

Filling the gaps: Cognitive control as a critical lens for understanding mechanisms of value-based decision-making

While often seeming to investigate rather different problems, research into value-based decision making and cognitive control have historically offered parallel insights into how people select thoughts and actions. While the former studies how people weigh costs and benefits to make a decision, the latter studies how they adjust information processing to achieve their goals. Recent work has highlighted ways in which decision-making research can inform our understanding of cognitive control. Here, we provide the complementary perspective: how cognitive control research has informed understanding of decision-making. We highlight three particular areas of research where this critical interchange has occurred: (1) how different types of goals shape the evaluation of choice options, (2) how people use control to adjust the ways they make their decisions, and (3) how people monitor decisions to inform adjustments to control at multiple levels and timescales. We show how adopting this alternate viewpoint offers new insight into the determinants of both decisions and control; provides alternative interpretations for common neuroeconomic findings; and generates fruitful directions for future research.

Coarse-Grained Neural Network Model of the Basal Ganglia to Simulate Reinforcement Learning Tasks

Computational models of the basal ganglia (BG) provide a mechanistic account of different phenomena observed during reinforcement learning tasks performed by healthy individuals, as well as by patients with various nervous or mental disorders. The aim of the present work was to develop a BG model that could represent a good compromise between simplicity and completeness. Based on more complex (fine-grained neural network, FGNN) models, we developed a new (coarse-grained neural network, CGNN) model by replacing layers of neurons with single nodes that represent the collective behavior of a given layer while preserving the fundamental anatomical structures of BG. We then compared the functionality of both the FGNN and CGNN models with respect to several reinforcement learning tasks that are based on BG circuitry, such as the Probabilistic Selection Task, Probabilistic Reversal Learning Task and Instructed Probabilistic Selection Task. We showed that CGNN still has a functionality that mirrors the behavior of the most often used reinforcement learning tasks in human studies. The simplification of the CGNN model reduces its flexibility but improves the readability of the signal flow in comparison to more detailed FGNN models and, thus, can help to a greater extent in the translation between clinical neuroscience and computational modeling.

Songbird subthalamic neurons project to dopaminergic midbrain and exhibit singing-related activity

Skill learning requires motor output to be evaluated against internal performance benchmarks. In songbirds, ventral tegmental area (VTA) dopamine neurons (DA) signal performance errors important for learning, but it remains unclear which brain regions project to VTA and how these inputs may contribute to DA error signaling. Here, we find that the songbird subthalamic nucleus (STN) projects to VTA and that STN microstimulation can excite VTA neurons. We also discover that STN receives inputs from motor cortical, auditory cortical, and ventral pallidal brain regions previously implicated in song evaluation. In the first neural recordings from songbird STN, we discover that the activity of most STN neurons is associated with body movements and not singing, but a small fraction of neurons exhibits precise song timing and performance error signals. Our results place the STN in a pathway important for song learning, but not song production, and expand the territories of songbird brain potentially associated with song learning.NEW & NOTEWORTHY Songbird subthalamic (STN) neurons exhibit singing-related signals and are interconnected with the motor cortical nucleus, auditory pallium, ventral pallidum, and ventral tegmental area, areas important for song generation and learning.

Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits

Adaptive sequential behavior is a hallmark of human cognition. In particular, humans can learn to produce precise spatiotemporal sequences given a certain context. For instance, musicians can not only reproduce learned action sequences in a context-dependent manner, they can also quickly and flexibly reapply them in any desired tempo or rhythm without overwriting previous learning. Existing neural network models fail to account for these properties. We argue that this limitation emerges from the fact that sequence information (i.e., the position of the action) and timing (i.e., the moment of response execution) are typically stored in the same neural network weights. Here, we augment a biologically plausible recurrent neural network of cortical dynamics to include a basal ganglia-thalamic module which uses reinforcement learning to dynamically modulate action. This “associative cluster-dependent chain” (ACDC) model modularly stores sequence and timing information in distinct loci of the network. This feature increases computational power and allows ACDC to display a wide range of temporal properties (e.g., multiple sequences, temporal shifting, rescaling, and compositionality), while still accounting for several behavioral and neurophysiological empirical observations. Finally, we apply this ACDC network to show how it can learn the famous “Thunderstruck” song intro and then flexibly play it in a “bossa nova” rhythm without further training.

How do humans flexibly adapt action sequences? For instance, musicians can learn a song and quickly speed up or slow down the tempo, or even play the song following a completely different rhythm (e.g., a rock song using a bossa nova rhythm). In this work, we build a biologically plausible network of cortico-basal ganglia interactions that explains how this temporal flexibility may emerge in the brain. Crucially, our model factorizes sequence order and action timing, respectively represented in cortical and basal ganglia dynamics. This factorization allows full temporal flexibility, i.e. the timing of a learned action sequence can be recomposed without interfering with the order of the sequence. As such, our model is capable of learning asynchronous action sequences, and flexibly shift, rescale, and recompose them, while accounting for biological data.

Neural Substrates of the Drift-Diffusion Model in Brain Disorders

Many studies on the drift-diffusion model (DDM) explain decision-making based on a unified analysis of both accuracy and response times. This review provides an in-depth account of the recent advances in DDM research which ground different DDM parameters on several brain areas, including the cortex and basal ganglia. Furthermore, we discuss the changes in DDM parameters due to structural and functional impairments in several clinical disorders, including Parkinson's disease, Attention Deficit Hyperactivity Disorder (ADHD), Autism Spectrum Disorders, Obsessive-Compulsive Disorder (OCD), and schizophrenia. This review thus uses DDM to provide a theoretical understanding of different brain disorders.

Competition, Conflict and Change of Mind: A Role of GABAergic Inhibition in the Primary Motor Cortex

Deciding between different voluntary movements implies a continuous control of the competition between potential actions. Many theories postulate a leading role of prefrontal cortices in this executive function, but strong evidence exists that a motor region like the primary motor cortex (M1) is also involved, possibly via inhibitory mechanisms. This was already shown during the pre-movement decision period, but not after movement onset. For this pilot experiment we designed a new task compatible with the dynamics of post-onset control to study the silent period (SP) duration, a pause in electromyographic activity after single-pulse transcranial magnetic stimulation that reflects inhibitory mechanisms. A careful analysis of the SP during the ongoing movement indicates a gradual increase in inhibitory mechanisms with the level of competition, consistent with an increase in mutual inhibition between alternative movement options. However, we also observed a decreased SP duration for high-competition trials associated with change-of-mind inflections in their trajectories. Our results suggest a new post-onset adaptive process that consists in a transient reduction of GABAergic inhibition within M1 for highly conflicting situations. We propose that this reduced inhibition softens the competition between concurrent motor options, thereby favoring response vacillation, an adaptive strategy that proved successful at improving behavioral performance.

Deep brain stimulation effect on anterior pallidum reduces motor impulsivity in Parkinson's disease

BACKGROUND

Deep Brain Stimulation (DBS) of the subthalamic nucleus or globus pallidus internus is used to treat the motor symptoms of Parkinson's disease. The former can worsen impulsive and compulsive behaviors after controlling for the reduction of dopaminergic medications. However, the effect of pallidal DBS on such behaviors in PD patients is less clear.

OBJECTIVE/HYPOTHESIS

We hypothesized that greater stimulation spread to the pallidum with prefrontal connectivity would reduce motor impulsivity.

METHODS

Seven Parkinson's patients with stable globus pallidus internus DBS settings for 3 months, disease duration of 13 ± 1.3 years, and Montreal Cognitive Assessment of 26.8 ± 1.1 each had two stimulation settings defined based on reconstructions of lead placement and volume of tissue activation targeting either a dorsal or ventral position along the DBS electrode but still within the globus pallidus internus. Subjects performed a stop signal reaction time task with the DBS turned off vs. on in each of the defined stimulation settings, which was correlated with the degree of stimulation effect on pallidal subregions.

RESULTS

A shorter distance between the volume of tissue activation and the right prefrontally-connected GPi correlated with less impulsivity on the stop signal reaction time task (r = 0.69, p < 0.05). Greater volume of tissue activation overlap with the non-prefrontally-connected globus pallidus internus was associated with increased impulsivity.

CONCLUSION

These data can be leveraged to optimize DBS programming in PD patients with problematic impulsivity or in other disorders involving impulsive behaviors such as substance use disorders.

Dorsal visual stream is preferentially engaged during externally guided action selection in Parkinson Disease

OBJECTIVE

In patients with Parkinson Disease (PD), self-imitated or internally cued (IC) actions are thought to be compromised by the disease process, as exemplified by impairments in action initiation. In contrast, externally-cued (EC) actions which are made in response to sensory prompts can restore a remarkable degree of movement capability in PD, particularly alleviating freezing-of-gait. This study investigates the electrophysiological underpinnings of movement facilitation in PD through visuospatial cuing, with particular attention to the dynamics within the posterior parietal cortex (PPC) and lateral premotor cortex (LPMC) axis of the dorsal visual stream.

METHODS

Invasive cortical recordings over the PPC and LPMC were obtained during deep brain stimulation lead implantation surgery. Thirteen PD subjects performed an action selection task, which was constituted by left or right joystick movement with directional visual cuing in the EC condition and internally generated direction selection in the IC condition. Time-resolved neural activities within and between the PPC and LPMC were compared between EC and IC conditions.

RESULTS

Reaction times (RT) were significantly faster in the EC condition relative to the IC condition (paired t-test, p = 0.0015). PPC-LPMC inter-site phase synchrony within the β-band (13-35 Hz) was significantly greater in the EC relative to the IC condition. Greater PPC-LPMC β debiased phase lag index (dwPLI) prior to movement onset was correlated with faster reaction times only in the EC condition. Multivariate granger causality (GC) was greater in the EC condition relative to the IC condition, prior to and during movement.

CONCLUSION

Relative to IC actions, we report relative increase in inter-site phase synchrony and directional PPC to LPMC connectivity in the β-band during preparation and execution of EC actions. Furthermore, increased strength of connectivity is predictive of faster RT, which are pathologically slow in PD patients. Stronger engagement of the PPC-LPMC cortical network by an EC specifically through the channel of β-modulation is implicated in correcting the pathological slowing of action initiation seen in Parkinson's patients.

SIGNIFICANCE

These findings shed light on the electrophysiological mechanisms that underlie motor facilitation in PD patients through visuospatial cuing.

Cortico-subcortical β burst dynamics underlying movement cancellation in humans

Dominant neuroanatomical models hold that humans regulate their movements via loop-like cortico-subcortical networks, which include the subthalamic nucleus (STN), motor thalamus, and sensorimotor cortex (SMC). Inhibitory commands across these networks are purportedly sent via transient, burst-like signals in the β frequency (15-29 Hz). However, since human depth-recording studies are typically limited to one recording site, direct evidence for this proposition is hitherto lacking. Here, we present simultaneous multi-site recordings from SMC and either STN or motor thalamus in humans performing the stop-signal task. In line with their purported function as inhibitory signals, subcortical β-bursts were increased on successful stop-trials. STN bursts in particular were followed within 50 ms by increased β-bursting over SMC. Moreover, between-site comparisons (including in a patient with simultaneous recordings from SMC, thalamus, and STN) confirmed that β-bursts in STN temporally precede thalamic β-bursts. This highly unique set of recordings provides empirical evidence for the role of β-bursts in conveying inhibitory commands along long-proposed cortico-subcortical networks underlying movement regulation in humans.

Intrinsic timescales across the basal ganglia

Recent studies have shown that temporal stability of the neuronal activity over time can be estimated by the structure of the spike-count autocorrelation of neuronal populations. This estimation, called the intrinsic timescale, has been computed for several cortical areas and can be used to propose a cortical hierarchy reflecting a scale of temporal receptive windows between areas. In this study, we performed an autocorrelation analysis on neuronal populations of three basal ganglia (BG) nuclei, including the striatum and the subthalamic nucleus (STN), the input structures of the BG, and the external globus pallidus (GPe). The analysis was performed during the baseline period of a motivational visuomotor task in which monkeys had to apply different amounts of force to receive different amounts of reward. We found that the striatum and the STN have longer intrinsic timescales than the GPe. Moreover, our results allow for the placement of these subcortical structures within the already-defined scale of cortical temporal receptive windows. Estimates of intrinsic timescales are important in adding further constraints in the development of computational models of the complex dynamics among these nuclei and throughout cortico-BG-thalamo-cortical loops.

Simultaneously recorded subthalamic and cortical LFPs reveal different lexicality effects during reading aloud

Many language functions are traditionally assigned to cortical brain areas, leaving the contributions of subcortical structures to language processing largely unspecified. The present study examines a potential role of the subthalamic nucleus (STN) in lexical processing, specifically, reading aloud of words (e.g., 'fate') and pseudowords (e.g., 'fape'). We recorded local field potentials simultaneously from the STN and the cortex (precentral, postcentral, and superior temporal gyri) of 13 people with Parkinson's disease undergoing awake deep brain stimulation and compared STN's lexicality-related neural activity with that of the cortex. Both STN and cortical activity demonstrated significant task-related modulations, but the lexicality effects were different in the two brain structures. In the STN, an increase in gamma band activity (31-70 Hz) was present in pseudoword trials compared to word trials during subjects' spoken response. In the cortex, a greater decrease in beta band activity (12-30 Hz) was observed for pseudowords in the precentral gyrus. Additionally, 11 individual cortical sites showed lexicality effects with varying temporal and topographic characteristics in the alpha and beta frequency bands. These findings suggest that the STN and the sampled cortical regions are involved differently in the processing of lexical distinctions.

Common and Unique Inhibitory Control Signatures of Action-Stopping and Attentional Capture Suggest That Actions Are Stopped in Two Stages

The ability to stop an already initiated action is paramount to adaptive behavior. Much scientific debate in the field of human action-stopping currently focuses on two interrelated questions. (1) Which cognitive and neural processes uniquely underpin the implementation of inhibitory control when actions are stopped after explicit stop signals, and which processes are instead commonly evoked by all salient signals, even those that do not require stopping? (2) Why do purported (neuro)physiological signatures of inhibition occur at two different latencies after stop signals? Here, we address both questions via two preregistered experiments that combined measurements of corticospinal excitability, EMG, and whole-scalp EEG. Adult human subjects performed a stop signal task that also contained "ignore" signals: equally salient signals that did not require stopping but rather completion of the Go response. We found that both stop- and ignore signals produced equal amounts of early-latency inhibition of corticospinal excitability and EMG, which took place ∼150 ms following either signal. Multivariate pattern analysis of the whole-scalp EEG data further corroborated that this early processing stage was shared between stop- and ignore signals, as neural activity following the two signals could not be decoded from each other until a later time period. In this later period, unique activity related to stop signals emerged at frontocentral scalp sites, reflecting an increased stop signal P3. These findings suggest a two-step model of action-stopping, according to which an initial, universal inhibitory response to the saliency of the stop signal is followed by a slower process that is unique to outright stopping.SIGNIFICANCE STATEMENT Humans often have to stop their ongoing actions when indicated by environmental stimuli (stop signals). Successful action-stopping requires both the ability to detect these salient stop signals and to subsequently inhibit ongoing motor programs. Because of this tight entanglement of attentional control and motor inhibition, identifying unique neurophysiological signatures of action-stopping is difficult. Indeed, we report that recently proposed early-latency signatures of motor inhibition during action-stopping are also found after salient signals that do not require stopping. However, using multivariate pattern analysis of scalp-recorded neural data, we also identified subsequent neural activity that uniquely distinguished action-stopping from saliency detection. These results suggest that actions are stopped in two stages: the first common to all salient events and the second unique to action-stopping.

The Pause-then-Cancel model of human action-stopping: Theoretical considerations and empirical evidence

The ability to stop already-initiated actions is a key cognitive control ability. Recent work on human action-stopping has been dominated by two controversial debates. First, the contributions (and neural signatures) of attentional orienting and motor inhibition after stop-signals are near-impossible to disentangle. Second, the timing of purportedly inhibitory (neuro)physiological activity after stop-signals has called into question which neural signatures reflect processes that actually contribute to action-stopping. Here, we propose that a two-stage model of action-stopping - proposed by Schmidt and Berke (2017) based on subcortical rodent recordings - may resolve these controversies. Translating this model to humans, we first argue that attentional orienting and motor inhibition are inseparable because orienting to salient events like stop-signals automatically invokes broad motor inhibition, reflecting a fast-acting, ubiquitous Pause process. We then argue that inhibitory signatures after stop-signals differ in latency because they map onto two sequential stages: the salience-related Pause and a slower, stop-specific Cancel process. We formulate the model, discuss recent supporting evidence in humans, and interpret existing data within its context.

Distinct population code for movement kinematics and changes of ongoing movements in human subthalamic nucleus

The subthalamic nucleus (STN) is theorized to globally suppress movement through connections with downstream basal ganglia structures. Current theories are supported by increased STN activity when subjects withhold an uninitiated action plan, but a critical test of these theories requires studying STN responses when an ongoing action is replaced with an alternative. We perform this test in subjects with Parkinson’s disease using an extended reaching task where the movement trajectory changes mid-action. We show that STN activity decreases during action switches, contrary to prevalent theories. Furthermore, beta oscillations in the STN local field potential, which are associated with movement inhibition, do not show increased power or spiking entrainment during switches. We report an inhomogeneous population neural code in STN, with one sub-population encoding movement kinematics and direction and another encoding unexpected action switches. We suggest an elaborate neural code in STN that contributes to planning actions and changing the plans.

Attentional capture in goal-directed action during childhood, adolescence, and early adulthood

Attentional capture occurs when salient but task-irrelevant information disrupts our ability to respond to task-relevant information. Although attentional capture costs have been found to decrease between childhood and adulthood, it is currently unclear the extent to which such age-related changes reflect an improved ability to recover from attentional capture or to avoid attentional capture. In addition, recent research using hand-tracking techniques with adults indicates that attentional capture by a distractor can generate response activations corresponding to the distractor's location, consistent with action-centered models of attention. However, it is unknown whether attentional capture can also result in the capture of action in children and adolescents. Therefore, we presented 5-year-olds, 9-year-olds, 13- and 14-year-olds, and adults (N = 96) with a singleton search task in which participants responded by reaching to touch targets on a digital display. Consistent with action-centered models of attention, distractor effects were evident in each age group's movement trajectories. In contrast to movement trajectories, movement times revealed significant age-related reductions in the costs of attentional capture, suggesting that age-related improvements in attentional control may be driven in part by an enhanced ability to recover from-as opposed to avoid-attentional capture. Children's performance was also significantly affected by response repetition effects, indicating that children may be more susceptible to interference from a wider range of task-irrelevant factors than adults. In addition to presenting novel insights into the development of attention and action, these results highlight the benefits of incorporating hand-tracking techniques into developmental research.

Subthalamic nucleus deep brain stimulation and impulsivity in Parkinson's disease: a descriptive review

Standard treatment of Parkinson’s disease involves the dopaminergic medications. Deep brain stimulation of the subthalamic nucleus (STN-DBS) is an important neurosurgical intervention often used as alternative treatment to drug therapy; however, it can be associated with increase of impulsive behaviors. This descriptive review focused on studies investigating the correlation between Deep brain stimulation of the subthalamic nucleus and impulsivity in Parkinson’s disease patients, arguing, the action’s mechanism and the specific role of the subthalamic nucleus. We searched on PubMed and Web of Science databases and screening references of included studies and review articles for additional citations. From initial 106 studies, only 15 met the search criteria. Parkinson’s Disease patients with and without Deep Brain Stimulation were compared with healthy controls, through 16 different tasks that assessed some aspects of impulsivity. Both Deep brain stimulation of the subthalamic nucleus and medication were associated with impulsive behavior and influenced decision-making processes. Moreover, findings demonstrated that: Impulse Control Disorders (ICDs) occurred soon after surgery, while, in pharmacological treatment, they appeared mainly after the initiation of treatment or the increase in dosage, especially with dopamine agonists. The subthalamic nucleus plays a part in the fronto-striato-thalamic-cortical loops mediating motor, cognitive, and emotional functions: this could explain the role of the Deep Brain Stimulation in behavior modulation in Parkinson’s Disease patients. Indeed, increase impulsivity has been reported also after deep brain stimulation of the subthalamic nucleus independently by dopaminergic medication status.

OCD Influences Evidence Accumulation During Decision Making in Males but Not Females During Perceptual and Value-Driven Choice

Individuals with obsessive-compulsive disorder (OCD) often have difficulty making decisions. Valuation and value-based judgements are particularly difficult. The mechanisms underlying these impairments are still poorly understood. Previous work has suggested that individuals with OCD require more information prior to making a choice during perceptual discrimination tasks. Little previous work has examined value-guided choice in OCD. Here we examined perceptual and value-based decision making in adults with OCD, using a novel task in which the two types of decision are tested in parallel using the same individually calibrated sets of visual stimuli (Perceptual and Value-based decision-making task, PVDM). Twenty-seven unmedicated participants with OCD (16 female) and thirty-one healthy controls (15 female) were tested. Data were analyzed using hierarchical drift-diffusion modeling (HDDM). Decision formation was altered in OCD, but differentially between genders: males with OCD, but not females, accumulated more information (i.e., were more cautious) and were less effective in evidence accumulation than age- and IQ-matched healthy males. Furthermore, males with OCD, but not females, were less likely than controls to adjust the process of evidence accumulation across decision contexts. These unexpectedly gender-dimorphic effects suggest that more attention should be paid to gender differences in studies of OCD, and of pathophysiology more broadly.

Not all errors are alike: modulation of error-related neural responses in musical joint action

During joint action, the sense of agency enables interaction partners to implement corrective and adaptive behaviour in response to performance errors. When agency becomes ambiguous (e.g. when action similarity encourages perceptual self-other overlap), confusion as to who produced what may disrupt this process. The current experiment investigated how ambiguity of agency affects behavioural and neural responses to errors in a joint action domain where self-other overlap is common: musical duos. Pairs of pianists performed piano pieces in synchrony, playing either the same pitches (ambiguous agency) or different pitches (unambiguous agency) while electroencephalography (EEG) was recorded for each individual. Behavioural and event-related potential results showed no effects of the agency manipulation but revealed differences in how distinct error types are processed. Self-produced 'wrong note' errors (substitutions) were left uncorrected, showed post-error slowing and elicited an error-related negativity (ERN) peaking before erroneous keystrokes (pre-ERN). In contrast, self-produced 'extra note' errors (additions) exhibited pre-error slowing, error and post-error speeding, were rapidly corrected and elicited the ERN. Other-produced errors evoked a feedback-related negativity but no behavioural effects. Overall findings shed light upon how the nervous system supports fluent interpersonal coordination in real-time joint action by employing distinct mechanisms to manage different types of errors.

Cortical and subcortical contributions to interference resolution and inhibition - An fMRI ALE meta-analysis

Interacting with our environment requires the selection of appropriate responses and the inhibition of others. Such effortful inhibition is achieved by a number of interference resolution and global inhibition processes. This meta-analysis including 57 studies and 73 contrasts revisits the overlap and differences in brain areas supporting interference resolution and global inhibition in cortical and subcortical brain areas. Activation likelihood estimation was used to discern the brain regions subserving each type of cognitive control. Individual contrast analysis revealed a common activation of the bilateral insula and supplementary motor areas. Subtraction analyses demonstrated the voxel-wise differences in recruitment in a number of areas including the precuneus in the interference tasks and the frontal pole and dorsal striatum in the inhibition tasks. Our results display a surprising lack of subcortical involvement within these types of cognitive control, a finding that is likely to reflect a systematic gap in the field of functional neuroimaging.

An association between prediction errors and risk-seeking: Theory and behavioral evidence

Reward prediction errors (RPEs) and risk preferences have two things in common: both can shape decision making behavior, and both are commonly associated with dopamine. RPEs drive value learning and are thought to be represented in the phasic release of striatal dopamine. Risk preferences bias choices towards or away from uncertainty; they can be manipulated with drugs that target the dopaminergic system. Based on the common neural substrate, we hypothesize that RPEs and risk preferences are linked on the level of behavior as well. Here, we develop this hypothesis theoretically and test it empirically. First, we apply a recent theory of learning in the basal ganglia to predict how RPEs influence risk preferences. We find that positive RPEs should cause increased risk-seeking, while negative RPEs should cause risk-aversion. We then test our behavioral predictions using a novel bandit task in which value and risk vary independently across options. Critically, conditions are included where options vary in risk but are matched for value. We find that our prediction was correct: participants become more risk-seeking if choices are preceded by positive RPEs, and more risk-averse if choices are preceded by negative RPEs. These findings cannot be explained by other known effects, such as nonlinear utility curves or dynamic learning rates.

Identification of biomarkers that predict response to subthalamic nucleus deep brain stimulation in resistant obsessive-compulsive disorder: protocol for an open-label follow-up study

INTRODUCTION

Deep brain stimulation (DBS) of bilateral anteromedial subthalamic nucleus (amSTN) has been found to be helpful in a subset of patients with severe, chronic and treatment-refractory obsessive-compulsive disorder (OCD). Biomarkers may aid in patient selection and optimisation of this invasive treatment. In this trial, we intend to evaluate neurocognitive function related to STN and related biosignatures as potential biomarkers for STN DBS in OCD.

METHODS AND ANALYSIS

Twenty-four subjects with treatment-refractory OCD will undergo open-label STN DBS. Structural/functional imaging, electrophysiological recording and neurocognitive assessment would be performed at baseline. The subjects would undergo a structured clinical assessment for 12 months postsurgery. A group of 24 healthy volunteers and 24 subjects with treatment-refractory OCD who receive treatment as usual would be recruited for comparison of biomarkers and treatment response, respectively. Baseline biomarkers would be evaluated as predictors of clinical response. Neuroadaptive changes would be studied through a reassessment of neurocognitive functioning, imaging and electrophysiological activity post DBS.

ETHICS AND DISSEMINATION

The protocol has been approved by the National Institute of Mental Health and Neurosciences Ethics Committee. The study findings will be disseminated through peer-reviewed scientific journals and scientific meetings.

Proactive inhibition is not modified by deep brain stimulation for Parkinson's disease: An electrical neuroimaging study

In predictable contexts, motor inhibitory control can be deployed before the actual need for response suppression. The brain functional underpinnings of proactive inhibition, and notably the role of basal ganglia, are not entirely identified. We investigated the effects of deep brain stimulation of the subthalamic nucleus or internal globus pallidus on proactive inhibition in patients with Parkinson's disease. They completed a cued go/no-go proactive inhibition task ON and (unilateral) OFF stimulation while EEG was recorded. We found no behavioural effect of either subthalamic nucleus or internal globus pallidus deep brain stimulation on proactive inhibition, despite a general improvement of motor performance with subthalamic nucleus stimulation. In the non-operated and subthalamic nucleus group, we identified periods of topographic EEG modulation by the level of proactive inhibition. In the subthalamic nucleus group, source estimation analysis suggested the initial involvement of bilateral frontal and occipital areas, followed by a right lateralized fronto-basal network, and finally of right premotor and left parietal regions. Our results confirm the overall preservation of proactive inhibition capacities in both subthalamic nucleus and internal globus pallidus deep brain stimulation, and suggest a partly segregated network for proactive inhibition, with a preferential recruitment of the indirect pathway.

Analogous computations in working memory input, output and motor gating: Electrophysiological and computational modeling evidence

Adaptive cognitive-control involves a hierarchical cortico-striatal gating system that supports selective updating, maintenance, and retrieval of useful cognitive and motor information. Here, we developed a task that independently manipulates selective gating operations into working-memory (input gating), from working-memory (output gating), and of responses (motor gating) and tested the neural dynamics and computational principles that support them. Increases in gating demands, captured by gate switches, were expressed by distinct EEG correlates at each gating level that evolved dynamically in partially overlapping time windows. Further, categorical representations of specific maintained items and of motor responses could be decoded from EEG when the corresponding gate was switching, thereby linking gating operations to prioritization. Finally, gate switching at all levels was related to increases in the motor decision threshold as quantified by the drift diffusion model. Together these results support the notion that cognitive gating operations scaffold on top of mechanisms involved in motor gating.

Corticostriatal Regulation of Language Functions

The role of corticostriatal circuits in language functions is unclear. In this review, we consider evidence from language learning, syntax, and controlled language production and comprehension tasks that implicate various corticostriatal circuits. Converging evidence from neuroimaging in healthy individuals, studies in populations with subcortical dysfunction, pharmacological studies, and brain stimulation suggests a domain-general regulatory role of corticostriatal systems in language operations. The role of corticostriatal systems in language operations identified in this review is likely to reflect a broader function of the striatum in responding to uncertainty and conflict which demands selection, sequencing, and cognitive control. We argue that this role is dynamic and varies depending on the degree and form of cognitive control required, which in turn will recruit particular corticostriatal circuits and components organised in a cognitive hierarchy.

Neurophysiology of Human Perceptual Decision-Making

The discovery of neural signals that reflect the dynamics of perceptual decision formation has had a considerable impact. Not only do such signals enable detailed investigations of the neural implementation of the decision-making process but they also can expose key elements of the brain's decision algorithms. For a long time, such signals were only accessible through direct animal brain recordings, and progress in human neuroscience was hampered by the limitations of noninvasive recording techniques. However, recent methodological advances are increasingly enabling the study of human brain signals that finely trace the dynamics of the unfolding decision process. In this review, we highlight how human neurophysiological data are now being leveraged to furnish new insights into the multiple processing levels involved in forming decisions, to inform the construction and evaluation of mathematical models that can explain intra- and interindividual differences, and to examine how key ancillary processes interact with core decision circuits.

The Human Basal Ganglia Mediate the Interplay between Reactive and Proactive Control of Response through Both Motor Inhibition and Sensory Modulation

The basal ganglia (BG) have long been known for contributing to the regulation of motor behaviour by means of a complex interplay between tonic and phasic inhibitory mechanisms. However, after having focused for a long time on phasic reactive mechanisms, it is only recently that psychological research in healthy humans has modelled tonic proactive mechanisms of control. Mutual calibration between anatomo-functional and psychological models is still needed to better understand the unclear role of the BG in the interplay between proactive and reactive mechanisms of control. Here, we implemented an event-related fMRI design allowing proper analysis of both the brain activity preceding the target-stimulus and the brain activity induced by the target-stimulus during a simple go/nogo task, with a particular interest in the ambiguous role of the basal ganglia. Post-stimulus activity was evoked in the left dorsal striatum, the subthalamus nucleus and internal globus pallidus by any stimulus when the situation was unpredictable, pinpointing its involvement in reactive, non-selective inhibitory mechanisms when action restraint is required. Pre-stimulus activity was detected in the ventral, not the dorsal, striatum, when the situation was unpredictable, and was associated with changes in functional connectivity with the early visual, not the motor, cortex. This suggests that the ventral striatum supports modulatory influence over sensory processing during proactive control.

Stimulation of Different Sectors of the Human Dorsal Premotor Cortex Induces a Shift from Reactive to Predictive Action Strategies and Changes in Motor Inhibition: A Dense Transcranial Magnetic Stimulation (TMS) Mapping Study

Delayed motor tasks require timely interaction between immobility and action. The neural substrates of these processes probably reside in the premotor and motor circuits; however, fine-grained anatomical/functional information is still lacking. Participants performed a delayed simple reaction task, structured as a ready-set-go sequence, with a fixed, predictable, SET-period. Responses were given with lip movements. During the SET-period, we performed a systematic dense-mapping of the bilateral dorsal premotor region (dPM) by means of single transcranial magnetic stimulation (TMS) pulses on an 18-spot mapping grid, interleaved with sham TMS which served as a baseline. Reaction times (RTs) in TMS trials over each grid spot were compared to RTs in sham trials to build a statistical parametric z-map. The results reveal a rostro-caudal functional gradient in the dPM. TMS of the rostral dPM induced a shift from reactive towards predictive response strategies. TMS of the caudal dPM interfered with the SET-period duration. By means of dense TMS mapping, we have drawn a putative functional map of the role of the dPM during the SET-period. A higher-order rostral component is involved in setting action strategies and a caudal, lower-order, part is probably involved in the inhibitory control of motor output.

The credit assignment problem in cortico-basal ganglia-thalamic networks: A review, a problem and a possible solution

The question of how cortico-basal ganglia-thalamic (CBGT) pathways use dopaminergic feedback signals to modify future decisions has challenged computational neuroscientists for decades. Reviewing the literature on computational representations of dopaminergic corticostriatal plasticity, we show how the field is converging on a normative, synaptic-level learning algorithm that elegantly captures both neurophysiological properties of CBGT circuits and behavioral dynamics during reinforcement learning. Unfortunately, the computational studies that have led to this normative algorithmic model have all relied on simplified circuits that use abstracted action-selection rules. As a result, the application of this corticostriatal plasticity algorithm to a full model of the CBGT pathways immediately fails because the spatiotemporal distance between integration (corticostriatal circuits), action selection (thalamocortical loops) and learning (nigrostriatal circuits) means that the network does not know which synapses should be reinforced to favor previously rewarding actions. We show how observations from neurophysiology, in particular the sustained activation of selected action representations, can provide a simple means of resolving this credit assignment problem in models of CBGT learning. Using a biologically realistic spiking model of the full CBGT circuit, we demonstrate how this solution can allow a network to learn to select optimal targets and to relearn action-outcome contingencies when the environment changes. This simple illustration highlights how the normative framework for corticostriatal plasticity can be expanded to capture macroscopic network dynamics during learning and decision-making.

Anticipatory human subthalamic area beta-band power responses to dissociable tastes correlate with weight gain

The availability of enticing sweet, fatty tastes is prevalent in the modern diet and contribute to overeating and obesity. In animal models, the subthalamic area plays a role in mediating appetitive and consummatory feeding behaviors, however, its role in human feeding is unknown. We used intraoperative, subthalamic field potential recordings while participants (n = 5) engaged in a task designed to provoke responses of taste anticipation and receipt. Decreased subthalamic beta-band (15-30 Hz) power responses were observed for both sweet-fat and neutral tastes. Anticipatory responses to taste-neutral cues started with an immediate decrease in beta-band power from baseline followed by an early beta-band rebound above baseline. On the contrary, anticipatory responses to sweet-fat were characterized by a greater and sustained decrease in beta-band power. These activity patterns were topographically specific to the subthalamic nucleus and substantia nigra. Further, a neural network trained on this beta-band power signal accurately predicted (AUC ≥ 74%) single trials corresponding to either taste. Finally, the magnitude of the beta-band rebound for a neutral taste was associated with increased body mass index after starting deep brain stimulation therapy. We provide preliminary evidence of discriminatory taste encoding within the subthalamic area associated with control mechanisms that mediate appetitive and consummatory behaviors.

Experimental investigation into the role of the subthalamic nucleus (STN) in motor control using optogenetics in mice

The subthalamic nucleus (STN) is critical for the execution of intended movements. Loss of its normal function is strongly associated with several movement disorders, including Parkinson's disease for which the STN is an important target area in deep brain stimulation (DBS) therapy. Classical basal ganglia models postulate that two parallel pathways, the direct and indirect pathways, exert opposing control over movement, with the STN acting within the indirect pathway. The STN is regulated by both inhibitory and excitatory input, and is itself excitatory. While most functional knowledge of this clinically relevant brain structure has been gained from pathological conditions and models, primarily parkinsonian, experimental evidence for its role in normal motor control has remained more sparse. The objective here was to tease out the selective impact of the STN on several motor parameters required to achieve intended movement, including locomotion, balance and motor coordination. Optogenetic excitation and inhibition using both bilateral and unilateral stimulations of the STN were implemented in freely-moving mice. The results demonstrate that selective optogenetic inhibition of the STN enhances locomotion while its excitation reduces locomotion. These findings lend experimental support to basal ganglia models of the STN in terms of locomotion. In addition, optogenetic excitation in freely-exploring mice induced self-grooming, disturbed gait and a jumping/escaping behavior, while causing reduced motor coordination in advanced motor tasks, independent of grooming and jumping. This study contributes experimentally validated evidence for a regulatory role of the STN in several aspects of motor control.

Distinct roles of dorsal and ventral subthalamic neurons in action selection and cancellation

The subthalamic nucleus (STN) supports action selection by inhibiting all motor programs except the desired one. Recent evidence suggests that STN can also cancel an already selected action when goals change, a key aspect of cognitive control. However, there is little neurophysiological evidence for dissociation between selecting and cancelling actions in the human STN. We recorded single neurons in the STN of humans performing a stop-signal task. Movement-related neurons suppressed their activity during successful stopping, whereas stop-signal neurons activated at low-latencies near the stop-signal reaction time. In contrast, STN and motor-cortical beta-bursting occurred only later in the stopping process. Task-related neuronal properties varied by recording location from dorsolateral movement to ventromedial stop-signal tuning. Therefore, action selection and cancellation coexist in STN but are anatomically segregated. These results show that human ventromedial STN neurons carry fast stop-related signals suitable for implementing cognitive control.

Inhibitory control dysfunction in parkinsonian impulse control disorders

Impulse control disorders (ICDs) in Parkinson's disease have been associated with dysfunctions in the control of value- or reward-based responding (choice impulsivity) and abnormalities in mesocorticolimbic circuits. The hypothesis that dysfunctions in the control of response inhibition (action impulsivity) also play a role in Parkinson's disease ICDs has recently been raised, but the underlying neural mechanisms have not been probed directly. We used high-resolution EEG recordings from 41 patients with Parkinson's disease with and without ICDs to track the spectral and dynamical signatures of different mechanisms involved in inhibitory control in a simple visuomotor task involving no selection between competing responses and no reward to avoid potential confounds with reward-based decision. Behaviourally, patients with Parkinson's disease with ICDs proved to be more impulsive than those without ICDs. This was associated with decreased beta activity in the precuneus and in a region of the medial frontal cortex centred on the supplementary motor area. The underlying dynamical patterns pinpointed dysfunction of proactive inhibitory control, an executive mechanism intended to gate motor responses in anticipation of stimulation in uncertain contexts. The alteration of the cortical drive of proactive response inhibition in Parkinson's disease ICDs pinpoints the neglected role the precuneus might play in higher order executive functions in coordination with the supplementary motor area, specifically for switching between executive settings. Clinical perspectives are discussed in the light of the non-dopaminergic basis of this function.

A spiking model of basal ganglia dynamics in stopping behavior supported by arkypallidal neurons

The common view that stopping action plans by the basal ganglia is achieved mainly by the subthalamic nucleus alone due to its direct excitatory projection onto the output nuclei of the basal ganglia has been challenged by recent findings. The proposed "pause-then-cancel" model suggests that the subthalamic nucleus provides a rapid stimulus-unspecific "pause" signal, followed by a stop-cue-specific "cancel" signal from striatum-projecting arkypallidal neurons. To determine more precisely the relative contribution of the different basal ganglia nuclei in stopping, we simulated a stop-signal task with a spiking neuron model of the basal ganglia, considering recently discovered connections from the arkypallidal neurons, and cortex-projecting GPe neurons. For the arkypallidal and prototypical GPe neurons, we obtained neuron model parameters by fitting their neuronal responses to published experimental data. Our model replicates findings of stop-signal tasks at neuronal and behavioral levels. We provide evidence for the existence of a stop-related cortical input to the arkypallidal and cortex-projecting GPe neurons such that the stop responses of the subthalamic nucleus, the arkypallidal neurons, and the cortex-projecting GPe neurons complement each other to achieve functional stopping behavior. Particularly, the cortex-projecting GPe neurons may complement the stopping within the basal ganglia caused by the arkypallidal and STN neurons by diminishing cortical go-related processes. Furthermore, we predict effects of lesions on stopping performance and propose that arkypallidal neurons mainly participate in stopping by inhibiting striatal neurons of the indirect rather than the direct pathway.

The "when" and "where" of the interplay between attentional capture and response inhibition during a Go/NoGo variant

Inhibitory control relies on attention, inhibition, and other functions that are integrated across neural networks in an interactive manner. Functional MRI studies have provided excellent spatial mapping of the involved regions. However, finer temporal resolution is needed to capture the underlying neural dynamics and the pattern of their functional contributions. Here, we used anatomically-constrained magnetoencephalography (aMEG) which combines MEG with structural MRI to examine how the spatial ("where") and temporal ("when") processing stages and interregional co-oscillations unfold in real time to contribute to inhibitory control. Healthy participants completed a modified Go/NoGo paradigm in which a subset of stimuli was modified to be visually salient (SAL). Compared to the non-modified condition, the SAL manipulation facilitated response withholding on NoGo trials and hindered responding to Go stimuli, reflecting attentional capture effectuated by an orienting response to SAL stimuli. aMEG source estimates indicate SAL stimuli elicited the attentional "circuit breaker" effect through early activity within a right-lateralized network centered around the lateral temporal cortex with additional activity in the pre-supplementary motor area (preSMA) and anterior insula (aINS/FO). Activity of the bilateral inferior frontal cortex responded specifically to inhibitory demands and was generally unaffected by the attentional manipulation. In contrast, early aINS/FO activity was sensitive to stimulus salience while subsequent activity was specific to inhibitory control. Activity estimated to the medial prefrontal cortex including the dorsal anterior cingulate cortex and preSMA reflected an integrative role that was sensitive to both inhibitory and attentional stimulus properties. At the level of neurofunctional networks, neural synchrony in the theta band (4-7 Hz) revealed interactions between principal cortical regions subserving attentional and inhibitory processes. Together, these results underscore the dynamic, integrative processing stages underlying inhibitory control.