Role of the indirect pathway of the basal ganglia in perceptual decision making

Clinically established early Parkinson's disease patients do not show impaired use of priors in conditions of perceptual uncertainty

The ability to use past learned experiences to guide decisions is an important component of adaptive behavior, especially when decision-making is performed under time pressure or when perceptual information is unreliable. Previous studies using visual discrimination tasks have shown that this prior-informed decision-making ability is impaired in Parkinson's disease (PD), but the mechanisms underlying this deficit and the precise impact of dopaminergic denervation within cortico-basal circuits remain unclear. To shed light on this problem, we evaluated prior-informed decision-making under various conditions of perceptual uncertainty in a sample of 13 clinically established early PD patients, and compared behavioral performance with healthy control (HC) subjects matched in age, sex and education. PD patients and HC subjects performed a random dot motion task in which they had to decide the net direction (leftward vs. rightward) of a field of moving dots and communicate their choices through manual button presses. We manipulated prior knowledge by modulating the probability of occurrence of leftward vs. rightward motion stimuli between blocks of trials, and by explicitly giving these probabilities to subjects at the beginning of each block. We further manipulated stimulus discriminability by varying the proportion of dots moving coherently in the signal direction and speed-accuracy instructions. PD patients used choice probabilities to guide perceptual decisions in both speed and accuracy conditions, and their performance did not significantly differ from that of HC subjects. An additional analysis of the data with the diffusion decision model confirmed this conclusion. These results suggest that the impaired use of priors during visual discrimination observed at more advanced stages of PD is independent of dopaminergic denervation, though additional studies with larger sample sizes are needed to more firmly establish this conclusion.

The subthalamic nucleus contributes causally to perceptual decision-making in monkeys

The subthalamic nucleus (STN) plays critical roles in the motor and cognitive function of the basal ganglia (BG), but the exact nature of these roles is not fully understood, especially in the context of decision-making based on uncertain evidence. Guided by theoretical predictions of specific STN contributions, we used single-unit recording and electrical microstimulation in the STN of healthy monkeys to assess its causal, computational roles in visual-saccadic decisions based on noisy evidence. The recordings identified subpopulations of STN neurons with distinct task-related activity patterns that related to different theoretically predicted functions. Microstimulation caused changes in behavioral choices and response times that reflected multiple contributions to an "accumulate-to-bound"-like decision process, including modulation of decision bounds and evidence accumulation, and to non-perceptual processes. These results provide new insights into the multiple ways that the STN can support higher brain function.

Unraveling the enigmatic role of the subthalamic nucleus

Subpopulations of neurons in the subthalamic nucleus have distinct activity patterns that relate to the three hypotheses of the Drift Diffusion Model.

Response inhibition in premotor cortex corresponds to a complex reshuffle of the mesoscopic information network

Recent studies have explored functional and effective neural networks in animal models; however, the dynamics of information propagation among functional modules under cognitive control remain largely unknown. Here, we addressed the issue using transfer entropy and graph theory methods on mesoscopic neural activities recorded in the dorsal premotor cortex of rhesus monkeys. We focused our study on the decision time of a Stop-signal task, looking for patterns in the network configuration that could influence motor plan maturation when the Stop signal is provided. When comparing trials with successful inhibition to those with generated movement, the nodes of the network resulted organized into four clusters, hierarchically arranged, and distinctly involved in information transfer. Interestingly, the hierarchies and the strength of information transmission between clusters varied throughout the task, distinguishing between generated movements and canceled ones and corresponding to measurable levels of network complexity. Our results suggest a putative mechanism for motor inhibition in premotor cortex: a topological reshuffle of the information exchanged among ensembles of neurons.

How cortico-basal ganglia-thalamic subnetworks can shift decision policies to maximize reward rate

All mammals exhibit flexible decision policies that depend, at least in part, on the cortico-basal ganglia-thalamic (CBGT) pathways. Yet understanding how the complex connectivity, dynamics, and plasticity of CBGT circuits translates into experience-dependent shifts of decision policies represents a longstanding challenge in neuroscience. Here we used a computational approach to address this problem. Specifically, we simulated decisions driven by CBGT circuits under baseline, unrewarded conditions using a spiking neural network, and fit the resulting behavior to an evidence accumulation model. Using canonical correlation analysis, we then replicated the existence of three recently identified control ensembles (responsiveness, pliancy and choice) within CBGT circuits, with each ensemble mapping to a specific configuration of the evidence accumulation process. We subsequently simulated learning in a simple two-choice task with one optimal (i.e., rewarded) target. We find that value-based learning, via dopaminergic signals acting on cortico-striatal synapses, effectively manages the speed-accuracy tradeoff so as to increase reward rate over time. Within this process, learning-related changes in decision policy can be decomposed in terms of the contributions of each control ensemble, and these changes are driven by sequential reward prediction errors on individual trials. Our results provide a clear and simple mechanism for how dopaminergic plasticity shifts specific subnetworks within CBGT circuits so as to strategically modulate decision policies in order to maximize effective reward rate.

Competing neural representations of choice shape evidence accumulation in humans

Making adaptive choices in dynamic environments requires flexible decision policies. Previously, we showed how shifts in outcome contingency change the evidence accumulation process that determines decision policies. Using in silico experiments to generate predictions, here we show how the cortico-basal ganglia-thalamic (CBGT) circuits can feasibly implement shifts in decision policies. When action contingencies change, dopaminergic plasticity redirects the balance of power, both within and between action representations, to divert the flow of evidence from one option to another. When competition between action representations is highest, the rate of evidence accumulation is the lowest. This prediction was validated in in vivo experiments on human participants, using fMRI, which showed that (1) evoked hemodynamic responses can reliably predict trial-wise choices and (2) competition between action representations, measured using a classifier model, tracked with changes in the rate of evidence accumulation. These results paint a holistic picture of how CBGT circuits manage and adapt the evidence accumulation process in mammals.

Dopamine Alters the Effect of Brain Stimulation on Decision-Making

Noninvasive brain stimulation techniques, such as transcranial direct current stimulation (tDCS), show promise in treating a range of psychiatric and neurologic conditions. However, optimization of such applications requires a better understanding of how tDCS alters cognition and behavior. Existing evidence implicates dopamine in tDCS alterations of brain activity and plasticity; however, there is as yet no causal evidence for a role of dopamine in tDCS effects on cognition and behavior. Here, in a preregistered, double-blinded study, we examined how pharmacologically manipulating dopamine altered the effect of tDCS on the speed-accuracy trade-off, which taps ubiquitous strategic operations. Cathodal tDCS was delivered over the left prefrontal cortex and the superior medial frontal cortex before participants (N = 62, 24 males, 38 females) completed a dot-motion task, making judgments on the direction of a field of moving dots under instructions to emphasize speed, accuracy, or both. We leveraged computational modeling to uncover how our interventions altered latent decisional processes driving the speed-accuracy trade-off. We show that dopamine in combination with tDCS (but not tDCS alone nor dopamine alone) not only impaired decision accuracy but also impaired discriminability, which suggests that these manipulations altered the encoding or representation of discriminative evidence. This is, to the best of our knowledge, the first direct evidence implicating dopamine in the way tDCS affects cognition and behavior.SIGNIFICANCE STATEMENT tDCS can improve cognitive and behavioral impairments in clinical conditions; however, a better understanding of its mechanisms is required to optimize future clinical applications. Here, using a pharmacological approach to manipulate brain dopamine levels in healthy adults, we demonstrate a role for dopamine in the effects of tDCS in the speed-accuracy trade-off, a strategic cognitive process ubiquitous in many contexts. In doing so, we provide direct evidence implicating dopamine in the way tDCS affects cognition and behavior.

Contributions of the Basal Ganglia to Visual Perceptual Decisions

The basal ganglia (BG) make up a prominent nexus between visual and motor-related brain regions. In contrast to the BG's well-established roles in movement control and value-based decision making, their contributions to the transformation of visual input into an action remain unclear, especially in the context of perceptual decisions based on uncertain visual evidence. This article reviews recent progress in our understanding of the BG's contributions to the formation, evaluation, and adjustment of such decisions. From theoretical and experimental perspectives, the review focuses on four key stations in the BG network, namely, the striatum, pallidum, subthalamic nucleus, and midbrain dopamine neurons, which can have different roles and together support the decision process.

Dopamine regulates decision thresholds in human reinforcement learning in males

Dopamine fundamentally contributes to reinforcement learning, but recent accounts also suggest a contribution to specific action selection mechanisms and the regulation of response vigour. Here, we examine dopaminergic mechanisms underlying human reinforcement learning and action selection via a combined pharmacological neuroimaging approach in male human volunteers (n = 31, within-subjects; Placebo, 150 mg of the dopamine precursor L-dopa, 2 mg of the D2 receptor antagonist Haloperidol). We found little credible evidence for previously reported beneficial effects of L-dopa vs. Haloperidol on learning from gains and altered neural prediction error signals, which may be partly due to differences experimental design and/or drug dosages. Reinforcement learning drift diffusion models account for learning-related changes in accuracy and response times, and reveal consistent decision threshold reductions under both drugs, in line with the idea that lower dosages of D2 receptor antagonists increase striatal DA release via an autoreceptor-mediated feedback mechanism. These results are in line with the idea that dopamine regulates decision thresholds during reinforcement learning, and may help to bridge action selection and response vigor accounts of dopamine.

Basal ganglia network dynamics and function: Role of direct, indirect and hyper-direct pathways in action selection

Basal ganglia (BG) are a widely recognized neural basis for action selection, but its decision-making mechanism is still a difficult problem for researchers. Therefore, we constructed a spiking neural network inspired by the BG anatomical data. Simulation experiments were based on the principle of dis-inhibition and our functional hypothesis within the BG: the direct pathway, the indirect pathway, and the hyper-direct pathway of the BG jointly implement the initiation execution and termination of motor programs. Firstly, we studied the dynamic process of action selection with the network, which contained intra-group competition and inter-group competition. Secondly, we focused on the effects of the stimulus intensity and the proportion of excitation and inhibition on the GPi/SNr. The results suggested that inhibition and excitation shape action selection. They also explained why the firing rate of GPi/SNr did not continue to increase in the action-selection experiment. Finally, we discussed the experimental results with the functional hypothesis. Uniquely, this paper summarized the decision-making neural mechanism of action selection based on the direct pathway, the indirect pathway, and the hyper-direct pathway within BG.

Identifying control ensembles for information processing within the cortico-basal ganglia-thalamic circuit

In situations featuring uncertainty about action-reward contingencies, mammals can flexibly adopt strategies for decision-making that are tuned in response to environmental changes. Although the cortico-basal ganglia thalamic (CBGT) network has been identified as contributing to the decision-making process, it features a complex synaptic architecture, comprised of multiple feed-forward, reciprocal, and feedback pathways, that complicate efforts to elucidate the roles of specific CBGT populations in the process by which evidence is accumulated and influences behavior. In this paper we apply a strategic sampling approach, based on Latin hypercube sampling, to explore how variations in CBGT network properties, including subpopulation firing rates and synaptic weights, map to variability of parameters in a normative drift diffusion model (DDM), representing algorithmic aspects of information processing during decision-making. Through the application of canonical correlation analysis, we find that this relationship can be characterized in terms of three low-dimensional control ensembles within the CBGT network that impact specific qualities of the emergent decision policy: responsiveness (a measure of how quickly evidence evaluation gets underway, associated with overall activity in corticothalamic and direct pathways), pliancy (a measure of the standard of evidence needed to commit to a decision, associated largely with overall activity in components of the indirect pathway of the basal ganglia), and choice (a measure of commitment toward one available option, associated with differences in direct and indirect pathways across action channels). These analyses provide mechanistic predictions about the roles of specific CBGT network elements in tuning the way that information is accumulated and translated into decision-related behavior.

Excitatory deep brain stimulation quenches beta oscillations arising in a computational model of the subthalamo-pallidal loop

Parkinson’s disease (PD) is associated with abnormal \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta$$\end{document}β band oscillations (13–30 Hz) in the cortico-basal ganglia circuits. Abnormally increased striato-pallidal inhibition and strengthening the synaptic coupling between subthalamic nucleus (STN) and globus pallidus externa (GPe), due to the loss of dopamine, are considered as the potential sources of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta$$\end{document}β oscillations in the basal ganglia. Deep brain stimulation (DBS) of the basal ganglia subregions is known as a way to reduce the pathological \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta$$\end{document}β oscillations and motor deficits related to PD. Despite the success of the DBS, its underlying mechanism is poorly understood and, there is controversy about the inhibitory or excitatory role of the DBS in the literature. Here, we utilized a computational network model of basal ganglia which consists of STN, GPe, globus pallidus interna, and thalamic neuronal population. This model can reproduce healthy and pathological \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta$$\end{document}β oscillations similar to what has been observed in experimental studies. Using this model, we investigated the effect of DBS to understand whether its effect is excitatory or inhibitory. Our results show that the excitatory DBS is able to quench the pathological synchrony and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta$$\end{document}β oscillations, while, applying inhibitory DBS failed to quench the PD signs. In light of simulation results, we conclude that the effect of the DBS on its target is excitatory.

Restoration and targeting of aberrant neurotransmitters in Parkinson's disease therapeutics

Neurotransmitters are considered as a fundamental regulator in the process of neuronal growth, differentiation and survival. Parkinson's Disease (PD) occurs due to extensive damage of dopamine-producing neurons; this causes dopamine deficits in the midbrain, followed by the alternation of various other neurotransmitters (glutamate, GABA, serotonin, etc.). It has been observed that fluctuation of neurotransmission in the basal ganglia exhibits a great impact on the pathophysiology of PD. Dopamine replacement therapy, such as the use of L-DOPA, can increase the dopamine level, but it majorly ameliorates the motor symptoms and is also associated with long-term complications (for e.g., LID). While the non-dopaminergic system can efficiently target non-motor symptoms, for instance, the noradrenergic system regulates the synthesis of BDNF via the MAPK pathway, which is important in learning and memory. Herein, we briefly discuss the role of different neurotransmitters, implementation of neurotransmitter receptors in PD. We also illustrate the recent advances of neurotransmitter-based drugs, which are currently under in vivo and clinical studies. Reinstating normal neurotransmitter levels has been believed to be advantageous in the treatment of PD. Thus, there is an increasing demand for drugs that can specifically target the neurotransmission system and reinstate the normal levels of neurotransmitters, which might prevent or delay neurodegeneration in PD.

Dynamic decision policy reconfiguration under outcome uncertainty

In uncertain or unstable environments, sometimes the best decision is to change your mind. To shed light on this flexibility, we evaluated how the underlying decision policy adapts when the most rewarding action changes. Human participants performed a dynamic two-armed bandit task that manipulated the certainty in relative reward (conflict) and the reliability of action-outcomes (volatility). Continuous estimates of conflict and volatility contributed to shifts in exploratory states by changing both the rate of evidence accumulation (drift rate) and the amount of evidence needed to make a decision (boundary height), respectively. At the trialwise level, following a switch in the optimal choice, the drift rate plummets and the boundary height weakly spikes, leading to a slow exploratory state. We find that the drift rate drives most of this response, with an unreliable contribution of boundary height across experiments. Surprisingly, we find no evidence that pupillary responses associated with decision policy changes. We conclude that humans show a stereotypical shift in their decision policies in response to environmental changes.

Flexible brain dynamics underpins complex behaviours as observed in Parkinson's disease

Rapid reconfigurations of brain activity support efficient neuronal communication and flexible behaviour. Suboptimal brain dynamics is associated to impaired adaptability, possibly leading to functional deficiencies. We hypothesize that impaired flexibility in brain activity can lead to motor and cognitive symptoms of Parkinson’s disease (PD). To test this hypothesis, we studied the ‘functional repertoire’—the number of distinct configurations of neural activity—using source-reconstructed magnetoencephalography in PD patients and controls. We found stereotyped brain dynamics and reduced flexibility in PD. The intensity of this reduction was proportional to symptoms severity, which can be explained by beta-band hyper-synchronization. Moreover, the basal ganglia were prominently involved in the abnormal patterns of brain activity. Our findings support the hypotheses that: symptoms in PD relate to impaired brain flexibility, this impairment preferentially involves the basal ganglia, and beta-band hypersynchronization is associated with reduced brain flexibility. These findings highlight the importance of extensive functional repertoires for correct behaviour.

Insights on the role of external globus pallidus in controlling absence seizures

Absence epilepsy, characterized by transient loss of awareness and bilaterally synchronous 2-4 Hz spike and wave discharges (SWDs) on electroencephalography (EEG) during absence seizures, is generally believed to arise from abnormal interactions between the cerebral cortex (Ctx) and thalamus. Recent animal electrophysiological studies suggested that changing the neural activation level of the external globus pallidus (GPe) neurons can remarkably modify firing rates of the thalamic reticular nucleus (TRN) neurons through the GABAergic GPe-TRN pathway. However, the existing experimental evidence does not provide a clear answer as to whether the GPe-TRN pathway contributes to regulating absence seizures. Here, using a biophysically based mean-field model of the GPe-corticothalamic (GCT) network, we found that both directly decreasing the strength of the GPe-TRN pathway and inactivating GPe neurons can effectively suppress absence seizures. Also, the pallido-cortical pathway and the recurrent connection of GPe neurons facilitate the regulation of absence seizures through the GPe-TRN pathway. Specifically, in the controllable situation, enhancing the coupling strength of either of the two pathways can successfully terminate absence seizures. Moreover, the competition between the GPe-TRN and pallido-cortical pathways may lead to the GPe bidirectionally controlling absence seizures, and this bidirectional control manner can be significantly modulated by the Ctx-TRN pathway. Importantly, when the strength of the Ctx-TRN pathway is relatively strong, the bidirectional control of absence seizures by changing GPe neural activities can be observed at both weak and strong strengths of the pallido-cortical pathway.These findings suggest that the GPe-TRN pathway may have crucial functional roles in regulating absence seizures, which may provide a testable hypothesis for further experimental studies and new perspectives on the treatment of absence epilepsy.

The basal ganglia corticostriatal loops and conditional learning

Brief maneuvering of the literature as to the various roles attributed to the basal ganglia corticostriatal circuits in a variety of cognitive processes such as working memory, selective attention, and category learning has inspired us to investigate the interplay of the two major basal ganglia open-recurrent loops, namely, visual and executive loops specifically the possible involvement of their overlap in conditional learning. We propose that the interaction of the visual and executive loops reflected through their cortical overlap in the dorsolateral prefrontal cortex (DL-PFC), lateral orbitofrontal cortex (LO-PFC), and presupplementary motor area (SMA) plays an instrumental role preliminary first in forming associations between a series of correct responses following similar stimuli and then in shifting, abstracting, and generalizing conditioned responses. The premotor and supplementary motor areas have been shown essential to producing a sequence of movements while the SMA is engaged in monitoring complex movements. In light of the recent studies, we will suggest that the interaction of visual and executive loops could strengthen or weaken learned associations following different reward values. Furthermore, we speculate that the overlap of the visual and executive loops can account for the switching between the associative vs. rule-based category learning systems.

The effects of chloride dynamics on substantia nigra pars reticulata responses to pallidal and striatal inputs

As a rodent basal ganglia (BG) output nucleus, the substantia nigra pars reticulata (SNr) is well positioned to impact behavior. SNr neurons receive GABAergic inputs from the striatum (direct pathway) and globus pallidus (GPe, indirect pathway). Dominant theories of action selection rely on these pathways' inhibitory actions. Yet, experimental results on SNr responses to these inputs are limited and include excitatory effects. Our study combines experimental and computational work to characterize, explain, and make predictions about these pathways. We observe diverse SNr responses to stimulation of SNr-projecting striatal and GPe neurons, including biphasic and excitatory effects, which our modeling shows can be explained by intracellular chloride processing. Our work predicts that ongoing GPe activity could tune the SNr operating mode, including its responses in decision-making scenarios, and GPe output may modulate synchrony and low-frequency oscillations of SNr neurons, which we confirm using optogenetic stimulation of GPe terminals within the SNr.

Delta oscillations are a robust biomarker of dopamine depletion severity and motor dysfunction in awake mice

Delta oscillations (0.5-4 Hz) are a robust feature of basal ganglia pathophysiology in patients with Parkinson's disease (PD) in relationship to tremor, but their relationship to other parkinsonian symptoms has not been investigated. While delta oscillations have been observed in mouse models of PD, they have only been investigated in anesthetized animals, suggesting that the oscillations may be an anesthesia artifact and limiting the ability to relate them to motor symptoms. Here, we establish a novel approach to detect spike oscillations embedded in noise to provide the first study of delta oscillations in awake, dopamine-depleted mice. We find that approximately half of neurons in the substantia nigra pars reticulata (SNr) exhibit delta oscillations in dopamine depletion and that these oscillations are a strong indicator of dopamine loss and akinesia, outperforming measures such as changes in firing rate, irregularity, bursting, and synchrony. These oscillations are typically weakened, but not ablated, during movement. We further establish that these oscillations are caused by the loss of D2-receptor activation and do not originate from motor cortex, contrary to previous findings in anesthetized animals. Instead, SNr oscillations precede those in M1 at a 100- to 300-ms lag, and these neurons' relationship to M1 oscillations can be used as the basis for a novel classification of SNr into two subpopulations. These results give insight into how dopamine loss leads to motor dysfunction and suggest a reappraisal of delta oscillations as a marker of akinetic symptoms in PD.NEW & NOTEWORTHY This work introduces a novel method to detect spike oscillations amidst neural noise. Using this method, we demonstrate that delta oscillations in the basal ganglia are a defining feature of awake, dopamine-depleted mice and are strongly correlated with dopamine loss and parkinsonian motor symptoms. These oscillations arise from a loss of D2-receptor activation and do not require motor cortex. Similar oscillations in human patients may be an underappreciated marker and target for Parkinson's disease (PD) treatment.

A non-linear deterministic model of action selection in the basal ganglia to simulate motor fluctuations in Parkinson's disease

Motor fluctuations and dyskinesias are severe complications of Parkinson's disease (PD), especially evident at its advanced stage, under long-term levodopa therapy. Despite their strong clinical prevalence, the neural origin of these motor symptoms is still a subject of intense debate. In this work, a non-linear deterministic neurocomputational model of the basal ganglia (BG), inspired by biology, is used to provide more insights into possible neural mechanisms at the basis of motor complications in PD. In particular, the model is used to simulate the finger tapping task. The model describes the main neural pathways involved in the BG to select actions [the direct or Go, the indirect or NoGo, and the hyperdirect pathways via the action of the sub-thalamic nucleus (STN)]. A sensitivity analysis is performed on some crucial model parameters (the dopamine level, the strength of the STN mechanism, and the strength of competition among different actions in the motor cortex) at different levels of synapses, reflecting major or minor motor training. Depending on model parameters, results show that the model can reproduce a variety of clinically relevant motor patterns, including normokinesia, bradykinesia, several attempts before movement, freezing, repetition, and also irregular fluctuations. Motor symptoms are, especially, evident at low or high dopamine levels, with excessive strength of the STN and with weak competition among alternative actions. Moreover, these symptoms worsen if the synapses are subject to insufficient learning. The model may help improve the comprehension of motor complications in PD and, ultimately, may contribute to the treatment design.

A biologically constrained spiking neural network model of the primate basal ganglia with overlapping pathways exhibits action selection

Action selection has been hypothesized to be a key function of the basal ganglia, yet the nuclei involved, their interactions and the importance of the direct/indirect pathway segregation in such process remain debated. Here, we design a spiking computational model of the monkey basal ganglia derived from a previously published population model, initially parameterized to reproduce electrophysiological activity at rest and to embody as much quantitative anatomical data as possible. As a particular feature, both models exhibit the strong overlap between the direct and indirect pathways that has been documented in non-human primates. Here, we first show how the translation from a population to an individual neuron model was achieved, with the addition of a minimal number of parameters. We then show that our model performs action selection, even though it was built without any assumption on the activity carried out during behaviour. We investigate the mechanisms of this selection through circuit disruptions and found an instrumental role of the off-centre/on-surround structure of the MSN-STN-GPi circuit, as well as of the MSN-MSN and FSI-MSN projections. This validates their potency in enabling selection. We finally study the pervasive centromedian and parafascicular thalamic inputs that reach all basal ganglia nuclei and whose influence is therefore difficult to anticipate. Our model predicts that these inputs modulate the responsiveness of action selection, making them a candidate for the regulation of the speed-accuracy trade-off during decision-making.

The caudate nucleus contributes causally to decisions that balance reward and uncertain visual information

Our decisions often balance what we observe and what we desire. A prime candidate for implementing this complex balancing act is the basal ganglia pathway, but its roles have not yet been examined experimentally in detail. Here, we show that a major input station of the basal ganglia, the caudate nucleus, plays a causal role in integrating uncertain visual evidence and reward context to guide adaptive decision-making. In monkeys making saccadic decisions based on motion cues and asymmetric reward-choice associations, single caudate neurons encoded both sources of information. Electrical microstimulation at caudate sites during motion viewing affected the monkeys’ decisions. These microstimulation effects included coordinated changes in multiple computational components of the decision process that mimicked the monkeys’ similarly coordinated voluntary strategies for balancing visual and reward information. These results imply that the caudate nucleus plays causal roles in coordinating decision processes that balance external evidence and internal preferences.

Mechanisms of competitive selection: A canonical neural circuit framework

Competitive selection, the transformation of multiple competing sensory inputs and internal states into a unitary choice, is a fundamental component of animal behavior. Selection behaviors have been studied under several intersecting umbrellas including decision-making, action selection, perceptual categorization, and attentional selection. Neural correlates of these behaviors and computational models have been investigated extensively. However, specific, identifiable neural circuit mechanisms underlying the implementation of selection remain elusive. Here, we employ a first principles approach to map competitive selection explicitly onto neural circuit elements. We decompose selection into six computational primitives, identify demands that their execution places on neural circuit design, and propose a canonical neural circuit framework. The resulting framework has several links to neural literature, indicating its biological feasibility, and has several common elements with prominent computational models, suggesting its generality. We propose that this framework can help catalyze experimental discovery of the neural circuit underpinnings of competitive selection.

Basal ganglia role in learning rewarded actions and executing previously learned choices: Healthy and diseased states

The basal ganglia (BG) is a collection of nuclei located deep beneath the cerebral cortex that is involved in learning and selection of rewarded actions. Here, we analyzed BG mechanisms that enable these functions. We implemented a rate model of a BG-thalamo-cortical loop and simulated its performance in a standard action selection task. We have shown that potentiation of corticostriatal synapses enables learning of a rewarded option. However, these synapses became redundant later as direct connections between prefrontal and premotor cortices (PFC-PMC) were potentiated by Hebbian learning. After we switched the reward to the previously unrewarded option (reversal), the BG was again responsible for switching to the new option. Due to the potentiated direct cortical connections, the system was biased to the previously rewarded choice, and establishing the new choice required a greater number of trials. Guided by physiological research, we then modified our model to reproduce pathological states of mild Parkinson's and Huntington's diseases. We found that in the Parkinsonian state PMC activity levels become extremely variable, which is caused by oscillations arising in the BG-thalamo-cortical loop. The model reproduced severe impairment of learning and predicted that this is caused by these oscillations as well as a reduced reward prediction signal. In the Huntington state, the potentiation of the PFC-PMC connections produced better learning, but altered BG output disrupted expression of the rewarded choices. This resulted in random switching between rewarded and unrewarded choices resembling an exploratory phase that never ended. Along with other computational studies, our results further reconcile the apparent contradiction between the critical involvement of the BG in execution of previously learned actions and yet no impairment of these actions after BG output is ablated by lesions or deep brain stimulation. We predict that the cortico-BG-thalamo-cortical loop conforms to previously learned choice in healthy conditions, but impedes those choices in disease states.

Beta-Band Resonance and Intrinsic Oscillations in a Biophysically Detailed Model of the Subthalamic Nucleus-Globus Pallidus Network

Increased beta-band oscillatory activity in the basal ganglia network is associated with Parkinsonian motor symptoms and is suppressed with medication and deep brain stimulation (DBS). The origins of the beta-band oscillations, however, remains unclear with both intrinsic oscillations arising within the subthalamic nucleus (STN)-external globus pallidus (GPe) network and exogenous beta-activity, originating outside the network, proposed as potential sources of the pathological activity. The aim of this study was to explore the relative contribution of autonomous oscillations and exogenous oscillatory inputs in the generation of pathological oscillatory activity in a biophysically detailed model of the parkinsonian STN-GPe network. The network model accounts for the integration of synaptic currents and their interaction with intrinsic membrane currents in dendritic structures within the STN and GPe. The model was used to investigate the development of beta-band synchrony and bursting within the STN-GPe network by changing the balance of excitation and inhibition in both nuclei, and by adding exogenous oscillatory inputs with varying phase relationships through the hyperdirect cortico-subthalamic and indirect striato-pallidal pathways. The model showed an intrinsic susceptibility to beta-band oscillations that was manifest in weak autonomously generated oscillations within the STN-GPe network and in selective amplification of exogenous beta-band synaptic inputs near the network's endogenous oscillation frequency. The frequency at which this resonance peak occurred was determined by the net level of excitatory drive to the network. Intrinsic or endogenously generated oscillations were too weak to support a pacemaker role for the STN-GPe network, however, they were considerably amplified by sparse cortical beta inputs and were further amplified by striatal beta inputs that promoted anti-phase firing of the cortex and GPe, resulting in maximum transient inhibition of STN neurons. The model elucidates a mechanism of cortical patterning of the STN-GPe network through feedback inhibition whereby intrinsic susceptibility to beta-band oscillations can lead to phase locked spiking under parkinsonian conditions. These results point to resonance of endogenous oscillations with exogenous patterning of the STN-GPe network as a mechanism of pathological synchronization, and a role for the pallido-striatal feedback loop in amplifying beta oscillations.

Reward-driven changes in striatal pathway competition shape evidence evaluation in decision-making

Cortico-basal-ganglia-thalamic (CBGT) networks are critical for adaptive decision-making, yet how changes to circuit-level properties impact cognitive algorithms remains unclear. Here we explore how dopaminergic plasticity at corticostriatal synapses alters competition between striatal pathways, impacting the evidence accumulation process during decision-making. Spike-timing dependent plasticity simulations showed that dopaminergic feedback based on rewards modified the ratio of direct and indirect corticostriatal weights within opposing action channels. Using the learned weight ratios in a full spiking CBGT network model, we simulated neural dynamics and decision outcomes in a reward-driven decision task and fit them with a drift diffusion model. Fits revealed that the rate of evidence accumulation varied with inter-channel differences in direct pathway activity while boundary height varied with overall indirect pathway activity. This multi-level modeling approach demonstrates how complementary learning and decision computations can emerge from corticostriatal plasticity.

Cognitive process models such as reinforcement learning (RL) and the drift diffusion model (DDM) have helped to elucidate the basic algorithms underlying error-corrective learning and the evaluation of accumulating decision evidence leading up to a choice. While these relatively abstract models help to guide experimental and theoretical probes into associated phenomena, they remain uninformative about the actual physical mechanics by which learning and decision algorithms are carried out in a neurobiological substrate during adaptive choice behavior. Here we present an “upwards mapping” approach to bridging neural and cognitive models of value-based decision-making, showing how dopaminergic feedback alters the network-level dynamics of cortico-basal-ganglia-thalamic (CBGT) pathways during learning to bias behavioral choice towards more rewarding actions. By mapping “up” the levels of analysis, this approach yields specific predictions about aspects of neuronal activity that map to the quantities appearing in the cognitive decision-making framework.

Errors in Action Timing and Inhibition Facilitate Learning by Tuning Distinct Mechanisms in the Underlying Decision Process

Goal-directed behavior requires integrating action selection processes with learning systems that adapt control using environmental feedback. These functions are known to intersect at a common neural substrate with multiple known targets of plasticity (the cortico-basal ganglia-thalamic network), suggesting that feedback signals have a multifaceted impact on future decisions. Using a hybrid of accumulation-to-bound decision models and reinforcement learning, we modeled the performance of humans in a stop signal task where participants (N 75: 37 males, 38 females) learned the prior distribution of the timing of a stop signal through trial-and-error feedback. Changes in the drift rate of the action execution process were driven by errors in action timing, whereas adaptation in the boundary height served to increase caution following failed stops. These findings highlight two interactive learning mechanisms for adapting the control of goal-directed actions based on dissociable dimensions of feedback error.SIGNIFICANCE STATEMENT Many complex behavioral goals rely on the ability to regulate the timing of action execution while also maintaining enough control to cancel actions in response to "Stop" cues in the environment. Here we examined how these fundamental components of behavior become tuned to the control demands of the environment by combining principles of reinforcement learning with accumulation-to-bound models. Model fits to behavioral data in an adaptive stop signal task revealed two adaptive mechanisms: (1) timing error-related changes in the rate of the execution signal; and (2) an increase in the execution boundary after failed stops. These findings demonstrate unique effects of timing and control errors on the underlying mechanisms of control, the rate and threshold of accumulating action signals.

Perceptual Decision-Making: Biases in Post-Error Reaction Times Explained by Attractor Network Dynamics

Perceptual decision-making is the subject of many experimental and theoretical studies. Most modeling analyses are based on statistical processes of accumulation of evidence. In contrast, very few works confront attractor network models' predictions with empirical data from continuous sequences of trials. Recently however, numerical simulations of a biophysical competitive attractor network model have shown that such a network can describe sequences of decision trials and reproduce repetition biases observed in perceptual decision experiments. Here we get more insights into such effects by considering an extension of the reduced attractor network model of Wong and Wang (2006), taking into account an inhibitory current delivered to the network once a decision has been made. We make explicit the conditions on this inhibitory input for which the network can perform a succession of trials, without being either trapped in the first reached attractor, or losing all memory of the past dynamics. We study in detail how, during a sequence of decision trials, reaction times and performance depend on nonlinear dynamics of the network, and we confront the model behavior with empirical findings on sequential effects. Here we show that, quite remarkably, the network exhibits, qualitatively and with the correct order of magnitude, post-error slowing and post-error improvement in accuracy, two subtle effects reported in behavioral experiments in the absence of any feedback about the correctness of the decision. Our work thus provides evidence that such effects result from intrinsic properties of the nonlinear neural dynamics.SIGNIFICANCE STATEMENT Much experimental and theoretical work is being devoted to the understanding of the neural correlates of perceptual decision-making. In a typical behavioral experiment, animals or humans perform a continuous series of binary discrimination tasks. To model such experiments, we consider a biophysical decision-making attractor neural network, taking into account an inhibitory current delivered to the network once a decision is made. Here we provide evidence that the same intrinsic properties of the nonlinear network dynamics underpins various sequential effects reported in experiments. Quite remarkably, in the absence of feedback on the correctness of the decisions, the network exhibits post-error slowing (longer reaction times after error trials) and post-error improvement in accuracy (smaller error rates after error trials).

Insights into Parkinson's disease from computational models of the basal ganglia

Movement disorders arise from the complex interplay of multiple changes to neural circuits. Successful treatments for these disorders could interact with these complex changes in myriad ways, and as a consequence their mechanisms of action and their amelioration of symptoms are incompletely understood. Using Parkinson's disease as a case study, we review here how computational models are a crucial tool for taming this complexity, across causative mechanisms, consequent neural dynamics and treatments. For mechanisms, we review models that capture the effects of losing dopamine on basal ganglia function; for dynamics, we discuss models that have transformed our understanding of how beta-band (15-30 Hz) oscillations arise in the parkinsonian basal ganglia. For treatments, we touch on the breadth of computational modelling work trying to understand the therapeutic actions of deep brain stimulation. Collectively, models from across all levels of description are providing a compelling account of the causes, symptoms and treatments for Parkinson's disease.

Ongoing, rational calibration of reward-driven perceptual biases

Decision-making is often interpreted in terms of normative computations that maximize a particular reward function for stable, average behaviors. Aberrations from the reward-maximizing solutions, either across subjects or across different sessions for the same subject, are often interpreted as reflecting poor learning or physical limitations. Here we show that such aberrations may instead reflect the involvement of additional satisficing and heuristic principles. For an asymmetric-reward perceptual decision-making task, three monkeys produced adaptive biases in response to changes in reward asymmetries and perceptual sensitivity. Their choices and response times were consistent with a normative accumulate-to-bound process. However, their context-dependent adjustments to this process deviated slightly but systematically from the reward-maximizing solutions. These adjustments were instead consistent with a rational process to find satisficing solutions based on the gradient of each monkey's reward-rate function. These results suggest new dimensions for assessing the rational and idiosyncratic aspects of flexible decision-making.

Paradoxical Decision-Making: A Framework for Understanding Cognition in Parkinson's Disease

People with Parkinson's disease (PD) show impaired decision-making when sensory and memory information must be combined. This recently identified impairment results from an inability to accumulate the proper amount of information needed to make a decision and appears to be independent of dopamine tone and reinforcement learning mechanisms. Although considerable work focuses on PD and decisions involving risk and reward, in this Opinion article we propose that the emerging findings in perceptual decision-making highlight the multisystem nature of PD, and that unraveling the neuronal circuits underlying perceptual decision-making impairment may help in understanding other cognitive impairments in people with PD. We also discuss how a decision-making framework may be extended to gain insights into mechanisms of motor impairments in PD.

Neurochemical changes in basal ganglia affect time perception in parkinsonians

BACKGROUND

Parkinson's disease is described as resulting from dopaminergic cells progressive degeneration, specifically in the substantia nigra pars compacta that influence the voluntary movements control, decision making and time perception.

AIM

This review had a goal to update the relation between time perception and Parkinson's Disease.

METHODOLOGY

We used the PRISMA methodology for this investigation built guided for subjects dopaminergic dysfunction in the time judgment, pharmacological models with levodopa and new studies on the time perception in Parkinson's Disease. We researched on databases Scielo, Pubmed / Medline and ISI Web of Knowledge on August 2017 and repeated in September 2017 and February 2018 using terms and associations relevant for obtaining articles in English about the aspects neurobiology incorporated in time perception. No publication status or restriction of publication date was imposed, but we used as exclusion criteria: dissertations, book reviews, conferences or editorial work.

RESULTS/DISCUSSION

We have demonstrated that the time cognitive processes are underlying to performance in cognitive tasks and that many are the brain areas and functions involved and the modulators in the time perception performance.

CONCLUSIONS

The influence of dopaminergic on Parkinson's Disease is an important research tool in Neuroscience while allowing for the search for clarifications regarding behavioral phenotypes of Parkinson's disease patients and to study the areas of the brain that are involved in the dopaminergic circuit and their integration with the time perception mechanisms.

Perceptual decisions based on previously learned information are independent of dopaminergic tone

Both cognitive and motor symptoms in people with Parkinson's disease (PD) arise from either too little or too much dopamine (DA). Akinesia stems from DA neuronal cell loss, and dyskinesia often stems from an overdose of DA medication. Cognitive behaviors typically associated with frontal cortical function, such as working memory and task switching, are also affected by too little or too much DA in PD. Whether motor and cognitive circuits overlap in PD is unknown. In this article, we show that whereas motor performance improves in people with PD when on dopaminergic medication compared with off medication, perceptual decision-making based on previously learned information (priors) remains impaired whether on or off medications. To rule out effects of long-term DA treatment and dopaminergic neuronal loss such as occur in PD, we also tested a group of people with dopa-unresponsive focal dystonia, a disease that involves the basal ganglia, like PD, but has motor symptoms that are insensitive to dopamine treatment and is not thought to involve frontal cortical DA circuits, unlike PD. We found that people with focal dystonia showed intact perceptual decision-making performance but impaired use of priors in perceptual decision-making, similar to people with PD. Together, the results show a dissociation between motor and cognitive performance in people with PD and reveal a novel cognitive impairment, independent of sensory and motor impairment, in people with focal dystonia. The combined results from people with PD and people with focal dystonia provide mechanistic insights into the role of basal ganglia non-dopaminergic circuits in perceptual decision-making based on priors.

Sensorimotor Processing in the Basal Ganglia Leads to Transient Beta Oscillations during Behavior

Brief epochs of beta oscillations have been implicated in sensorimotor control in the basal ganglia of task-performing healthy animals. However, which neural processes underlie their generation and how they are affected by sensorimotor processing remains unclear. To determine the mechanisms underlying transient beta oscillations in the LFP, we combined computational modeling of the subthalamo-pallidal network for the generation of beta oscillations with realistic stimulation patterns derived from single-unit data recorded from different basal ganglia subregions in rats performing a cued choice task. In the recordings, we found distinct firing patterns in the striatum, globus pallidus, and subthalamic nucleus related to sensory and motor events during the behavioral task. Using these firing patterns to generate realistic inputs to our network model led to transient beta oscillations with the same time course as the rat LFP data. In addition, our model can account for further nonintuitive aspects of beta modulation, including beta phase resets after sensory cues and correlations with reaction time. Overall, our model can explain how the combination of temporally regulated sensory responses of the subthalamic nucleus, ramping activity of the subthalamic nucleus, and movement-related activity of the globus pallidus leads to transient beta oscillations during behavior.SIGNIFICANCE STATEMENT Transient beta oscillations emerge in the normal functioning cortico-basal ganglia loop during behavior. Here, we used a unique approach connecting a computational model closely with experimental data. In this way, we achieved a simulation environment for our model that mimics natural input patterns in awake, behaving animals. We demonstrate that a computational model for beta oscillations in Parkinson's disease (PD) can also account for complex patterns of transient beta oscillations in healthy animals. Therefore, we propose that transient beta oscillations in healthy animals share the same mechanism with pathological beta oscillations in PD. This important result connects functional and pathological roles of beta oscillations in the basal ganglia.

Computational models of basal ganglia dysfunction: the dynamics is in the details

The development, simulation, and analysis of mathematical models offer helpful tools for integrating experimental findings and exploring or suggesting possible explanatory mechanisms. As models relating to basal ganglia dysfunction have proliferated, however, there has not always been consistency among their findings. This work points out several ways in which biological details, relating to ionic currents and synaptic pathways, can influence the dynamics of models of the basal ganglia under parkinsonian conditions and hence may be important for inclusion in models. It also suggests some additional useful directions for future modeling studies relating to basal ganglia dysfunction.

Reward Based Motor Adaptation Mediated by Basal Ganglia

It is widely accepted that the basal ganglia (BG) play a key role in action selection and reinforcement learning. However, despite considerable number of studies, the BG architecture and function are not completely understood. Action selection and reinforcement learning are facilitated by the activity of dopaminergic neurons, which encode reward prediction errors when reward outcomes are higher or lower than expected. The BG are thought to select proper motor responses by gating appropriate actions, and suppressing inappropriate ones. The direct striato-nigral (GO) and the indirect striato-pallidal (NOGO) pathways have been suggested to provide the functions of BG in the two-pathway concept. Previous models confirmed the idea that these two pathways can mediate the behavioral choice, but only for a relatively small number of potential behaviors. Recent studies have provided new evidence of BG involvement in motor adaptation tasks, in which adaptation occurs in a non-error-based manner. In such tasks, there is a continuum of possible actions, each represented by a complex neuronal activity pattern. We extended the classical concept of the two-pathway BG by creating a model of BG interacting with a movement execution system, which allows for an arbitrary number of possible actions. The model includes sensory and premotor cortices, BG, a spinal cord network, and a virtual mechanical arm performing 2D reaching movements. The arm is composed of 2 joints (shoulder and elbow) controlled by 6 muscles (4 mono-articular and 2 bi-articular). The spinal cord network contains motoneurons, controlling the muscles, and sensory interneurons that receive afferent feedback and mediate basic reflexes. Given a specific goal-oriented motor task, the BG network through reinforcement learning constructs a behavior from an arbitrary number of basic actions represented by cortical activity patterns. Our study confirms that, with slight modifications, the classical two-pathway BG concept is consistent with results of previous studies, including non-error based motor adaptation experiments, pharmacological manipulations with BG nuclei, and functional deficits observed in BG-related motor disorders.

Inhibitory Control in the Cortico-Basal Ganglia-Thalamocortical Loop: Complex Regulation and Interplay with Memory and Decision Processes

We developed a circuit model of spiking neurons that includes multiple pathways in the basal ganglia (BG) and is endowed with feedback mechanisms at three levels: cortical microcircuit, corticothalamic loop, and cortico-BG-thalamocortical system. We focused on executive control in a stop signal task, which is known to depend on BG across species. The model reproduces a range of experimental observations and shows that the newly discovered feedback projection from external globus pallidus to striatum is crucial for inhibitory control. Moreover, stopping process is enhanced by the cortico-subcortical reverberatory dynamics underlying persistent activity, establishing interdependence between working memory and inhibitory control. Surprisingly, the stop signal reaction time (SSRT) can be adjusted by weights of certain connections but is insensitive to other connections in this complex circuit, suggesting novel circuit-based intervention for inhibitory control deficits associated with mental illness. Our model provides a unified framework for inhibitory control, decision making, and working memory.

Patients with Parkinson's Disease Show Impaired Use of Priors in Conditions of Sensory Uncertainty

Perceptual decisions arise after considering the available sensory evidence [1]. When sensory information is unreliable, a good strategy is to rely on previous experience in similar situations to guide decisions [2-6]. It is well known that patients with Parkinson's disease (PD) are impaired at value-based decision-making [7-11]. How patients combine past experience and sensory information to make perceptual decisions is unknown. We developed a novel, perceptual decision-making task and manipulated the statistics of the sensory stimuli presented to patients with PD and healthy participants to determine the influence of past experience on decision-making. We show that patients with PD are impaired at combining previously learned information with current sensory information to guide decisions. We modeled the results using the drift-diffusion model (DDM) and found that the impairment corresponds to a failure in adjusting the amount of sensory evidence needed to make a decision. Our modeling results also show that two complementary mechanisms operate to implement a bias when two sets of priors are learned concurrently. Asymmetric decision threshold adjustments, as reflected by changes in the starting point of evidence accumulation, are responsible for a general choice bias, whereas the adjustment of a dynamic bias that develops over the course of a trial, as reflected by a drift-rate offset, provides the stimulus-specific component of the prior. A proper interplay between these two processes is required to implement a bias based on concurrent, stimulus-specific priors in decision-making. We show here that patients with PD are impaired in these across-trial decision threshold adjustments.

The functional logic of corticostriatal connections

Unidirectional connections from the cortex to the matrix of the corpus striatum initiate the cortico-basal ganglia (BG)-thalamocortical loop, thought to be important in momentary action selection and in longer-term fine tuning of behavioural repertoire; a discrete set of striatal compartments, striosomes, has the complementary role of registering or anticipating reward that shapes corticostriatal plasticity. Re-entrant signals traversing the cortico-BG loop impact predominantly frontal cortices, conveyed through topographically ordered output channels; by contrast, striatal input signals originate from a far broader span of cortex, and are far more divergent in their termination. The term 'disclosed loop' is introduced to describe this organisation: a closed circuit that is open to outside influence at the initial stage of cortical input. The closed circuit component of corticostriatal afferents is newly dubbed 'operative', as it is proposed to establish the bid for action selection on the part of an incipient cortical action plan; the broader set of converging corticostriatal afferents is described as contextual. A corollary of this proposal is that every unit of the striatal volume, including the long, C-shaped tail of the caudate nucleus, should receive a mandatory component of operative input, and hence include at least one area of BG-recipient cortex amongst the sources of its corticostriatal afferents. Individual operative afferents contact twin classes of GABAergic striatal projection neuron (SPN), distinguished by their neurochemical character, and onward circuitry. This is the basis of the classic direct and indirect pathway model of the cortico-BG loop. Each pathway utilises a serial chain of inhibition, with two such links, or three, providing positive and negative feedback, respectively. Operative co-activation of direct and indirect SPNs is, therefore, pictured to simultaneously promote action, and to restrain it. The balance of this rival activity is determined by the contextual inputs, which summarise the external and internal sensory environment, and the state of ongoing behavioural priorities. Notably, the distributed sources of contextual convergence upon a striatal locus mirror the transcortical network harnessed by the origin of the operative input to that locus, thereby capturing a similar set of contingencies relevant to determining action. The disclosed loop formulation of corticostriatal and subsequent BG loop circuitry, as advanced here, refines the operating rationale of the classic model and allows the integration of more recent anatomical and physiological data, some of which can appear at variance with the classic model. Equally, it provides a lucid functional context for continuing cellular studies of SPN biophysics and mechanisms of synaptic plasticity.

Properties of Neurons in External Globus Pallidus Can Support Optimal Action Selection

The external globus pallidus (GPe) is a key nucleus within basal ganglia circuits that are thought to be involved in action selection. A class of computational models assumes that, during action selection, the basal ganglia compute for all actions available in a given context the probabilities that they should be selected. These models suggest that a network of GPe and subthalamic nucleus (STN) neurons computes the normalization term in Bayes’ equation. In order to perform such computation, the GPe needs to send feedback to the STN equal to a particular function of the activity of STN neurons. However, the complex form of this function makes it unlikely that individual GPe neurons, or even a single GPe cell type, could compute it. Here, we demonstrate how this function could be computed within a network containing two types of GABAergic GPe projection neuron, so-called ‘prototypic’ and ‘arkypallidal’ neurons, that have different response properties in vivo and distinct connections. We compare our model predictions with the experimentally-reported connectivity and input-output functions (f-I curves) of the two populations of GPe neurons. We show that, together, these dichotomous cell types fulfil the requirements necessary to compute the function needed for optimal action selection. We conclude that, by virtue of their distinct response properties and connectivities, a network of arkypallidal and prototypic GPe neurons comprises a neural substrate capable of supporting the computation of the posterior probabilities of actions.

Choosing an appropriate action as quickly and accurately as possible in a given situation is critical for the survival of animals and humans. One of the brain regions involved in action selection is a set of subcortical nuclei known as the basal ganglia. The importance of understanding information processing in the basal ganglia is further emphasised by the fact that their disturbed interactions in Parkinson’s disease results in profound difficulties in movement. Computational models have suggested how the basal ganglia could select actions in the fastest possible way for the required accuracy level. These models further predict that a part of basal ganglia, called the external globus pallidus (GPe), needs to calculate a particular function of its inputs. This paper proposes how this function could be computed in a mathematical model of a network within GPe. Furthermore, it shows that the experimentally observed connectivity and response properties of GPe neurons fulfil the requirements necessary to support optimal action selection. This suggests the GPe neurons have properties that allow them to contribute to optimal action selection in the whole basal ganglia.

Believer-Skeptic Meets Actor-Critic: Rethinking the Role of Basal Ganglia Pathways during Decision-Making and Reinforcement Learning

The flexibility of behavioral control is a testament to the brain's capacity for dynamically resolving uncertainty during goal-directed actions. This ability to select actions and learn from immediate feedback is driven by the dynamics of basal ganglia (BG) pathways. A growing body of empirical evidence conflicts with the traditional view that these pathways act as independent levers for facilitating (i.e., direct pathway) or suppressing (i.e., indirect pathway) motor output, suggesting instead that they engage in a dynamic competition during action decisions that computationally captures action uncertainty. Here we discuss the utility of encoding action uncertainty as a dynamic competition between opposing control pathways and provide evidence that this simple mechanism may have powerful implications for bridging neurocomputational theories of decision making and reinforcement learning.

Neural Correlates of Decision Thresholds in the Human Subthalamic Nucleus

If humans are faced with difficult choices when making decisions, the ability to slow down responses becomes critical in order to avoid suboptimal choices. Current models of decision making assume that the subthalamic nucleus (STN) mediates this function by elevating decision thresholds, thereby requiring more evidence to be accumulated before responding [1-9]. However, direct electrophysiological evidence for the exact role of STN during adjustment of decision thresholds is lacking. Here, we show that trial-by-trial variations in STN low-frequency oscillatory activity predict adjustments of decision thresholds before subjects make a response. The relationship between STN activity and decision thresholds critically depends on the subjects' level of cautiousness. While increased oscillatory activity of the STN predicts elevated decision thresholds during high levels of cautiousness, it predicts decreased decision thresholds during low levels of cautiousness. This context-dependent relationship may be mediated by increased influence of the medial prefrontal cortex (mPFC)-STN pathway on decision thresholds during high cautiousness. Subjects who exhibit a stronger increase in phase alignment of low-frequency oscillatory activity in mPFC and STN before making a response have higher decision thresholds and commit fewer erroneous responses. Together, our results demonstrate that STN low-frequency oscillatory activity and corresponding mPFC-STN coupling are involved in determining how much evidence subjects accumulate before making a decision. This finding might explain why deep-brain stimulation of the STN can impair subjects' ability to slow down responses and can induce impulsive suboptimal decisions.

Magnitude Estimation with Noisy Integrators Linked by an Adaptive Reference

Judgments of physical stimuli show characteristic biases; relatively small stimuli are overestimated whereas relatively large stimuli are underestimated (regression effect). Such biases likely result from a strategy that seeks to minimize errors given noisy estimates about stimuli that itself are drawn from a distribution, i.e., the statistics of the environment. While being conceptually well described, it is unclear how such a strategy could be implemented neurally. The present paper aims toward answering this question. A theoretical approach is introduced that describes magnitude estimation as two successive stages of noisy (neural) integration. Both stages are linked by a reference memory that is updated with every new stimulus. The model reproduces the behavioral characteristics of magnitude estimation and makes several experimentally testable predictions. Moreover, the model identifies the regression effect as a means of minimizing estimation errors and explains how this optimality strategy depends on the subject's discrimination abilities and on the stimulus statistics. The latter influence predicts another property of magnitude estimation, the so-called range effect. Beyond being successful in describing decision-making, the present work suggests that noisy integration may also be important in processing magnitudes.

Downstream Effect of Ramping Neuronal Activity through Synapses with Short-Term Plasticity

Ramping neuronal activity refers to spiking activity with a rate that increases quasi-linearly over time. It has been observed in multiple cortical areas and is correlated with evidence accumulation processes or timing. In this work, we investigated the downstream effect of ramping neuronal activity through synapses that display short-term facilitation (STF) or depression (STD). We obtained an analytical result for a synapse driven by deterministic linear ramping input that exhibits pure STF or STD and numerically investigated the general case when a synapse displays both STF and STD. We show that the analytical deterministic solution gives an accurate description of the averaging synaptic activation of many inputs converging onto a postsynaptic neuron, even when fluctuations in the ramping input are strong. Activation of a synapse with STF shows an initial cubical increase with time, followed by a linear ramping similar to a synapse without STF. Activation of a synapse with STD grows in time to a maximum before falling and reaching a plateau, and this steady state is independent of the slope of the ramping input. For a synapse displaying both STF and STD, an increase in the depression time constant from a value much smaller than the facilitation time constant τ(F) to a value much larger than τ(F) leads to a transition from facilitation dominance to depression dominance. Therefore, our work provides insights into the impact of ramping neuronal activity on downstream neurons through synapses that display short-term plasticity. In a perceptual decision-making process, ramping activity has been observed in the parietal and prefrontal cortices, with a slope that decreases with task difficulty. Our work predicts that neurons downstream from such a decision circuit could instead display a firing plateau independent of the task difficulty, provided that the synaptic connection is endowed with short-term depression.

Function approximation in inhibitory networks

In performance-optimized artificial neural networks, such as convolutional networks, each neuron makes excitatory connections with some of its targets and inhibitory connections with others. In contrast, physiological neurons are typically either excitatory or inhibitory, not both. This is a puzzle, because it seems to constrain computation, and because there are several counter-examples that suggest that it may not be a physiological necessity. Parisien et al. (2008) showed that any mixture of excitatory and inhibitory functional connections could be realized by a purely excitatory projection in parallel with a two-synapse projection through an inhibitory population. They showed that this works well with ratios of excitatory and inhibitory neurons that are realistic for the neocortex, suggesting that perhaps the cortex efficiently works around this apparent computational constraint. Extending this work, we show here that mixed excitatory and inhibitory functional connections can also be realized in networks that are dominated by inhibition, such as those of the basal ganglia. Further, we show that the function-approximation capacity of such connections is comparable to that of idealized mixed-weight connections. We also study whether such connections are viable in recurrent networks, and find that such recurrent networks can flexibly exhibit a wide range of dynamics. These results offer a new perspective on computation in the basal ganglia, and also perhaps on inhibitory networks within the cortex.