Modeling facilitation and inhibition of competing motor programs in basal ganglia subthalamic nucleus-pallidal circuits

Basal ganglia network dynamics and function: Role of direct, indirect and hyper-direct pathways in action selection

Basal ganglia (BG) are a widely recognized neural basis for action selection, but its decision-making mechanism is still a difficult problem for researchers. Therefore, we constructed a spiking neural network inspired by the BG anatomical data. Simulation experiments were based on the principle of dis-inhibition and our functional hypothesis within the BG: the direct pathway, the indirect pathway, and the hyper-direct pathway of the BG jointly implement the initiation execution and termination of motor programs. Firstly, we studied the dynamic process of action selection with the network, which contained intra-group competition and inter-group competition. Secondly, we focused on the effects of the stimulus intensity and the proportion of excitation and inhibition on the GPi/SNr. The results suggested that inhibition and excitation shape action selection. They also explained why the firing rate of GPi/SNr did not continue to increase in the action-selection experiment. Finally, we discussed the experimental results with the functional hypothesis. Uniquely, this paper summarized the decision-making neural mechanism of action selection based on the direct pathway, the indirect pathway, and the hyper-direct pathway within BG.

Differential effects of deep brain stimulation and levodopa on brain activity in Parkinson's disease

Levodopa is the first-line treatment for Parkinson’s disease, although the precise mechanisms mediating its efficacy remain elusive. We aimed to elucidate treatment effects of levodopa on brain activity during the execution of fine movements and to compare them with deep brain stimulation of the subthalamic nuclei. We studied 32 patients with Parkinson’s disease using functional MRI during the execution of finger-tapping task, alternating epochs of movement and rest. The task was performed after withdrawal and administration of a single levodopa dose. A subgroup of patients (n = 18) repeated the experiment after electrode implantation with stimulator on and off. Investigating levodopa treatment, we found a significant interaction between both factors of treatment state (off, on) and experimental task (finger tapping, rest) in bilateral putamen, but not in other motor regions. Specifically, during the off state of levodopa medication, activity in the putamen at rest was higher than during tapping. This represents an aberrant activity pattern probably indicating the derangement of basal ganglia network activity due to the lack of dopaminergic input. Levodopa medication reverted this pattern, so that putaminal activity during finger tapping was higher than during rest, as previously described in healthy controls. Within-group comparison with deep brain stimulation underlines the specificity of our findings with levodopa treatment. Indeed, a significant interaction was observed between treatment approach (levodopa, deep brain stimulation) and treatment state (off, on) in bilateral putamen. Our functional MRI study compared for the first time the differential effects of levodopa treatment and deep brain stimulation on brain motor activity. We showed modulatory effects of levodopa on brain activity of the putamen during finger movement execution, which were not observed with deep brain stimulation.

The Connectivity Fingerprint of the Human Frontal Cortex, Subthalamic Nucleus, and Striatum

Within the cortico basal ganglia (BG)-thalamic network, the direct and indirect pathways comprise of projections from the cortex to the striatum (STR), whereas the hyperdirect pathway(s) consist of cortical projections toward the subthalamic nucleus (STN). Each pathway possesses a functionally distinct role for action selection. The current study quantified and compared the structural connectivity between 17 distinct cortical areas with the STN and STR using 7 Tesla diffusion weighted magnetic resonance imaging (dMRI) and resting-state functional MRI (rs-fMRI) in healthy young subjects. The selection of these cortical areas was based on a literature search focusing on animal tracer studies. The results indicate that, relative to other cortical areas, both the STN and STR showed markedly weaker structural connections to areas assumed to be essential for action inhibition such as the inferior frontal cortex pars opercularis. Additionally, the cortical connectivity fingerprint of the STN and STR indicated relatively strong connections to areas related to voluntary motor initiation such as the cingulate motor area and supplementary motor area. Overall the results indicated that the cortical-STN connections were sparser compared to the STR. There were two notable exceptions, namely for the orbitofrontal cortex and ventral medial prefrontal cortex, where a higher tract strength was found for the STN. These two areas are thought to be involved in reward processing and action bias.

Deep Brain Stimulation of the Subthalamic Nucleus Improves Lexical Switching in Parkinsons Disease Patients

Objective

Reduced verbal fluency (VF) has been reported in patients with Parkinson’s disease (PD), especially those treated by Deep Brain Stimulation of the subthalamic nucleus (STN DBS). To delineate the nature of this dysfunction we aimed at identifying the particular VF-related operations modified by STN DBS.

Method

Eleven PD patients performed VF tasks in their STN DBS ON and OFF condition. To differentiate VF-components modulated by the stimulation, a temporal cluster analysis was performed, separating production spurts (i.e., ‘clusters’ as correlates of automatic activation spread within lexical fields) from slower cluster transitions (i.e., ‘switches’ reflecting set-shifting towards new lexical fields). The results were compared to those of eleven healthy control subjects.

Results

PD patients produced significantly more switches accompanied by shorter switch times in the STN DBS ON compared to the STN DBS OFF condition. The number of clusters and time intervals between words within clusters were not affected by the treatment state. Although switch behavior in patients with DBS ON improved, their task performance was still lower compared to that of healthy controls.

Discussion

Beyond impacting on motor symptoms, STN DBS seems to influence the dynamics of cognitive procedures. Specifically, the results are in line with basal ganglia roles for cognitive switching, in the particular case of VF, from prevailing lexical concepts to new ones.

Muscle co-activity tuning in Parkinsonian hand movement: disease-specific changes at behavioral and cerebral level

We investigated simple directional hand movements based on different degrees of muscle co-activity, at behavioral and cerebral level in healthy subjects and Parkinson's disease (PD) patients. We compared “singular” movements, dominated by the activity of one agonist muscle, to “composite” movements, requiring conjoint activity of multiple muscles, in a center-out (right hand) step-tracking task. Behavioral parameters were obtained by EMG and kinematic recordings. fMRI was used to investigate differences in underlying brain activations between PD patients (N = 12) and healthy (age-matched) subjects (N = 18). In healthy subjects, composite movements recruited the striatum and cortical areas comprising bilaterally the supplementary motor area and premotor cortex, contralateral medial prefrontal cortex, primary motor cortex, primary visual cortex, and ipsilateral superior parietal cortex. Contrarily, the ipsilateral cerebellum was more involved in singular movements. This striking dichotomy between striatal and cortical recruitment vs. cerebellar involvement was considered to reflect the complementary roles of these areas in motor control, in which the basal ganglia are involved in movement selection and the cerebellum in movement optimization. Compared to healthy subjects, PD patients showed decreased activation of the striatum and cortical areas in composite movement, while performing worse at behavioral level. This implies that PD patients are especially impaired on tasks requiring highly tuned muscle co-activity. Singular movement, on the other hand, was characterized by a combination of increased activation of the ipsilateral parietal cortex and left cerebellum. As singular movement performance was only slightly compromised, we interpret this as a reflection of increased visuospatial processing, possibly as a compensational mechanism.

Speech serial control in healthy speakers and speakers with hypokinetic or ataxic dysarthria: effects of sequence length and practice

The current study investigated the processes responsible for selection of sounds and syllables during production of speech sequences in 10 adults with hypokinetic dysarthria from Parkinson's disease, five adults with ataxic dysarthria, and 14 healthy control speakers. Speech production data from a choice reaction time task were analyzed to evaluate the effects of sequence length and practice on speech sound sequencing. Speakers produced sequences that were between one and five syllables in length over five experimental runs of 60 trials each. In contrast to the healthy speakers, speakers with hypokinetic dysarthria demonstrated exaggerated sequence length effects for both inter-syllable intervals (ISIs) and speech error rates. Conversely, speakers with ataxic dysarthria failed to demonstrate a sequence length effect on ISIs and were also the only group that did not exhibit practice-related changes in ISIs and speech error rates over the five experimental runs. The exaggerated sequence length effects in the hypokinetic speakers with Parkinson's disease are consistent with an impairment of action selection during speech sequence production. The absent length effects observed in the speakers with ataxic dysarthria is consistent with previous findings that indicate a limited capacity to buffer speech sequences in advance of their execution. In addition, the lack of practice effects in these speakers suggests that learning-related improvements in the production rate and accuracy of speech sequences involves processing by structures of the cerebellum. Together, the current findings inform models of serial control for speech in healthy speakers and support the notion that sequencing deficits contribute to speech symptoms in speakers with hypokinetic or ataxic dysarthria. In addition, these findings indicate that speech sequencing is differentially impaired in hypokinetic and ataxic dysarthria.

Computational modeling of stuttering caused by impairments in a basal ganglia thalamo-cortical circuit involved in syllable selection and initiation

Atypical white-matter integrity and elevated dopamine levels have been reported for individuals who stutter. We investigated how such abnormalities may lead to speech dysfluencies due to their effects on a syllable-sequencing circuit that consists of basal ganglia (BG), thalamus, and left ventral premotor cortex (vPMC). "Neurally impaired" versions of the neurocomputational speech production model GODIVA were utilized to test two hypotheses: (1) that white-matter abnormalities disturb the circuit via corticostriatal projections carrying copies of executed motor commands and (2) that dopaminergic abnormalities disturb the circuit via the striatum. Simulation results support both hypotheses: in both scenarios, the neural abnormalities delay readout of the next syllable's motor program, leading to dysfluency. The results also account for brain imaging findings during dysfluent speech. It is concluded that each of the two abnormality types can cause stuttering moments, probably by affecting the same BG-thalamus-vPMC circuit.

Computational studies of the role of serotonin in the basal ganglia

It has been well established that serotonin (5-HT) plays an important role in the striatum. For example, during levodopa therapy for Parkinson's disease (PD), the serotonergic projections from the dorsal raphe nucleus (DRN) release dopamine as a false transmitter, and there are strong indications that this pulsatile release is connected to dyskinesias that reduce the effectiveness of the therapy. Here we present hypotheses about the functional role of 5-HT in the normal striatum and present computational studies showing the feasibility of these hypotheses. Dopaminergic projections to the striatum inhibit the medium spiny neurons (MSN) in the striatopalladal (indirect) pathway and excite MSNs in the striatonigral (direct) pathway. It has long been hypothesized that the effect of dopamine (DA) depletion caused by the loss of SNc cells in PD is to change the "balance" between the pathways to favor the indirect pathway. Originally, "balance" was understood to mean equal firing rates, but now it is understood that the level of DA affects the patterns of firing in the two pathways too. There are dense 5-HT projections to the striatum from the dorsal raphe nucleus and it is known that increased 5-HT in the striatum facilitates DA release from DA terminals. The direct pathway excites various cortical nuclei and some of these nuclei send inhibitory projections to the DRN. Our hypothesis is that this feedback circuit from the striatum to the cortex to the DRN to the striatum serves to stabilize the balance between the direct and indirect pathways, and this is confirmed by our model calculations. Our calculations also show that this circuit contributes to the stability of the dopamine concentration in the striatum as SNc cells die during Parkinson's disease progression (until late phase). There may be situations in which there are physiological reasons to "unbalance" the direct and indirect pathways, and we show that projections to the DRN from the cortex or other brain regions could accomplish this task.

Cortical information flow in Parkinson's disease: a composite network/field model

The basal ganglia play a crucial role in the execution of movements, as demonstrated by the severe motor deficits that accompany Parkinson's disease (PD). Since motor commands originate in the cortex, an important question is how the basal ganglia influence cortical information flow, and how this influence becomes pathological in PD. To explore this, we developed a composite neuronal network/neural field model. The network model consisted of 4950 spiking neurons, divided into 15 excitatory and inhibitory cell populations in the thalamus and cortex. The field model consisted of the cortex, thalamus, striatum, subthalamic nucleus, and globus pallidus. Both models have been separately validated in previous work. Three field models were used: one with basal ganglia parameters based on data from healthy individuals, one based on data from individuals with PD, and one purely thalamocortical model. Spikes generated by these field models were then used to drive the network model. Compared to the network driven by the healthy model, the PD-driven network had lower firing rates, a shift in spectral power toward lower frequencies, and higher probability of bursting; each of these findings is consistent with empirical data on PD. In the healthy model, we found strong Granger causality between cortical layers in the beta and low gamma frequency bands, but this causality was largely absent in the PD model. In particular, the reduction in Granger causality from the main “input” layer of the cortex (layer 4) to the main “output” layer (layer 5) was pronounced. This may account for symptoms of PD that seem to reflect deficits in information flow, such as bradykinesia. In general, these results demonstrate that the brain's large-scale oscillatory environment, represented here by the field model, strongly influences the information processing that occurs within its subnetworks. Hence, it may be preferable to drive spiking network models with physiologically realistic inputs rather than pure white noise.

On the origin of tremor in Parkinson's disease

The exact origin of tremor in Parkinson’s disease remains unknown. We explain why the existing data converge on the basal ganglia-thalamo-cortical loop as a tremor generator and consider a conductance-based model of subthalamo-pallidal circuits embedded into a simplified representation of the basal ganglia-thalamo-cortical circuit to investigate the dynamics of this loop. We show how variation of the strength of dopamine-modulated connections in the basal ganglia-thalamo-cortical loop (representing the decreasing dopamine level in Parkinson’s disease) leads to the occurrence of tremor-like burst firing. These tremor-like oscillations are suppressed when the connections are modulated back to represent a higher dopamine level (as it would be the case in dopaminergic therapy), as well as when the basal ganglia-thalamo-cortical loop is broken (as would be the case for ablative anti-parkinsonian surgeries). Thus, the proposed model provides an explanation for the basal ganglia-thalamo-cortical loop mechanism of tremor generation. The strengthening of the loop leads to tremor oscillations, while the weakening or disconnection of the loop suppresses them. The loop origin of parkinsonian tremor also suggests that new tremor-suppression therapies may have anatomical targets in different cortical and subcortical areas as long as they are within the basal ganglia-thalamo-cortical loop.

Cerebral activations related to ballistic, stepwise interrupted and gradually modulated movements in Parkinson patients

Patients with Parkinson's disease (PD) experience impaired initiation and inhibition of movements such as difficulty to start/stop walking. At single-joint level this is accompanied by reduced inhibition of antagonist muscle activity. While normal basal ganglia (BG) contributions to motor control include selecting appropriate muscles by inhibiting others, it is unclear how PD-related changes in BG function cause impaired movement initiation and inhibition at single-joint level. To further elucidate these changes we studied 4 right-hand movement tasks with fMRI, by dissociating activations related to abrupt movement initiation, inhibition and gradual movement modulation. Initiation and inhibition were inferred from ballistic and stepwise interrupted movement, respectively, while smooth wrist circumduction enabled the assessment of gradually modulated movement. Task-related activations were compared between PD patients (N = 12) and healthy subjects (N = 18). In healthy subjects, movement initiation was characterized by antero-ventral striatum, substantia nigra (SN) and premotor activations while inhibition was dominated by subthalamic nucleus (STN) and pallidal activations, in line with the known role of these areas in simple movement. Gradual movement mainly involved antero-dorsal putamen and pallidum. Compared to healthy subjects, patients showed reduced striatal/SN and increased pallidal activation for initiation, whereas for inhibition STN activation was reduced and striatal-thalamo-cortical activation increased. For gradual movement patients showed reduced pallidal and increased thalamo-cortical activation. We conclude that PD-related changes during movement initiation fit the (rather static) model of alterations in direct and indirect BG pathways. Reduced STN activation and regional cortical increased activation in PD during inhibition and gradual movement modulation are better explained by a dynamic model that also takes into account enhanced responsiveness to external stimuli in this disease and the effects of hyper-fluctuating cortical inputs to the striatum and STN in particular.

Action selection and action value in frontal-striatal circuits

The role that frontal-striatal circuits play in normal behavior remains unclear. Two of the leading hypotheses suggest that these circuits are important for action selection or reinforcement learning. To examine these hypotheses, we carried out an experiment in which monkeys had to select actions in two different task conditions. In the first (random) condition, actions were selected on the basis of perceptual inference. In the second (fixed) condition, the animals used reinforcement from previous trials to select actions. Examination of neural activity showed that the representation of the selected action was stronger in lateral prefrontal cortex (lPFC), and occurred earlier in the lPFC than it did in the dorsal striatum (dSTR). In contrast to this, the representation of action values, in both the random and fixed conditions, was stronger in the dSTR. Thus, the dSTR contains an enriched representation of action value, but it followed frontal cortex in action selection.

Neural dynamics in parkinsonian brain: the boundary between synchronized and nonsynchronized dynamics

Synchronous oscillatory dynamics is frequently observed in the human brain. We analyze the fine temporal structure of phase-locking in a realistic network model and match it with the experimental data from Parkinsonian patients. We show that the experimentally observed intermittent synchrony can be generated just by moderately increased coupling strength in the basal ganglia circuits due to the lack of dopamine. Comparison of the experimental and modeling data suggest that brain activity in Parkinson's disease resides in the large boundary region between synchronized and nonsynchronized dynamics. Being on the edge of synchrony may allow for easy formation of transient neuronal assemblies.

The arbitration-extension hypothesis: a hierarchical interpretation of the functional organization of the Basal Ganglia

Based on known anatomy and physiology, we present a hypothesis where the basal ganglia motor loop is hierarchically organized in two main subsystems: the arbitration system and the extension system. The arbitration system, comprised of the subthalamic nucleus, globus pallidus, and pedunculopontine nucleus, serves the role of selecting one out of several candidate actions as they are ascending from various brain stem motor regions and aggregated in the centromedian thalamus or descending from the extension system or from the cerebral cortex. This system is an action-input/action-output system whose winner-take-all mechanism finds the strongest response among several candidates to execute. This decision is communicated back to the brain stem by facilitating the desired action via cholinergic/glutamatergic projections and suppressing conflicting alternatives via GABAergic connections. The extension system, comprised of the striatum and, again, globus pallidus, can extend the repertoire of responses by learning to associate novel complex states to certain actions. This system is a state-input/action-output system, whose organization enables it to encode arbitrarily complex Boolean logic rules using striatal neurons that only fire given specific constellations of inputs (Boolean AND) and pallidal neurons that are silenced by any striatal input (Boolean OR). We demonstrate the capabilities of this hierarchical system by a computational model where a simulated generic “animal” interacts with an environment by selecting direction of movement based on combinations of sensory stimuli, some being appetitive, others aversive or neutral. While the arbitration system can autonomously handle conflicting actions proposed by brain stem motor nuclei, the extension system is required to execute learned actions not suggested by external motor centers. Being precise in the functional role of each component of the system, this hypothesis generates several readily testable predictions.

Speech motor program maintenance, but not switching, is enhanced by left-hemispheric deep brain stimulation in Parkinson's disease

Speech reaction time (SRT) was measured in a response priming protocol in 12 participants with Parkinson's disease (PD) and hypokinetic dysarthria "on" and "off" left-hemispheric deep brain stimulation (DBS). Speech preparation was measured during speech motor programming in two randomly ordered speech conditions: speech maintenance and switching. Double blind testing was completed in participants with DBS of globus pallidus pars interna (GPi) (n = 5) or subthalamic nucleus (STN) (n = 7). SRT was significantly faster in the maintenance vs switch task, regardless of DBS state. SRT was faster in the speech maintenance task "on" stimulation, while there was no difference in speech switching "on" and "off" DBS. These data suggest that left-hemispheric DBS may have differential effects on aspects of speech preparation in PD. It is hypothesized that speech maintenance improvements may result from DBS-induced cortical enhancements, while the lack of difference in switching may be related to inhibition deficits mediated by the right-hemisphere. Alternatively, DBS may have little influence on the higher level motor processes (i.e., motor planning) which it is believed the switch task engaged to a greater extent than the maintenance task.

The capabilities and limitations of conductance-based compartmental neuron models with reduced branched or unbranched morphologies and active dendrites

Conductance-based neuron models are frequently employed to study the dynamics of biological neural networks. For speed and ease of use, these models are often reduced in morphological complexity. Simplified dendritic branching structures may process inputs differently than full branching structures, however, and could thereby fail to reproduce important aspects of biological neural processing. It is not yet well understood which processing capabilities require detailed branching structures. Therefore, we analyzed the processing capabilities of full or partially branched reduced models. These models were created by collapsing the dendritic tree of a full morphological model of a globus pallidus (GP) neuron while preserving its total surface area and electrotonic length, as well as its passive and active parameters. Dendritic trees were either collapsed into single cables (unbranched models) or the full complement of branch points was preserved (branched models). Both reduction strategies allowed us to compare dynamics between all models using the same channel density settings. Full model responses to somatic inputs were generally preserved by both types of reduced model while dendritic input responses could be more closely preserved by branched than unbranched reduced models. However, features strongly influenced by local dendritic input resistance, such as active dendritic sodium spike generation and propagation, could not be accurately reproduced by any reduced model. Based on our analyses, we suggest that there are intrinsic differences in processing capabilities between unbranched and branched models. We also indicate suitable applications for different levels of reduction, including fast searches of full model parameter space.

Modeling shifts in the rate and pattern of subthalamopallidal network activity during deep brain stimulation

Deep brain stimulation (DBS) of the subthlamic nucleus (STN) represents an effective treatment for medically refractory Parkinson's disease; however, understanding of its effects on basal ganglia network activity remains limited. We constructed a computational model of the subthalamopallidal network, trained it to fit in vivo recordings from parkinsonian monkeys, and evaluated its response to STN DBS. The network model was created with synaptically connected single compartment biophysical models of STN and pallidal neurons, and stochastically defined inputs driven by cortical beta rhythms. A least mean square error training algorithm was developed to parameterize network connections and minimize error when compared to experimental spike and burst rates in the parkinsonian condition. The output of the trained network was then compared to experimental data not used in the training process. We found that reducing the influence of the cortical beta input on the model generated activity that agreed well with recordings from normal monkeys. Further, during STN DBS in the parkinsonian condition the simulations reproduced the reduction in GPi bursting found in existing experimental data. The model also provided the opportunity to greatly expand analysis of GPi bursting activity, generating three major predictions. First, its reduction was proportional to the volume of STN activated by DBS. Second, GPi bursting decreased in a stimulation frequency dependent manner, saturating at values consistent with clinically therapeutic DBS. And third, ablating STN neurons, reported to generate similar therapeutic outcomes as STN DBS, also reduced GPi bursting. Our theoretical analysis of stimulation induced network activity suggests that regularization of GPi firing is dependent on the volume of STN tissue activated and a threshold level of burst reduction may be necessary for therapeutic effect.

Network perspectives on the mechanisms of deep brain stimulation

Deep brain stimulation (DBS) is an established medical therapy for the treatment of movement disorders and shows great promise for several other neurological disorders. However, after decades of clinical utility the underlying therapeutic mechanisms remain undefined. Early attempts to explain the mechanisms of DBS focused on hypotheses that mimicked an ablative lesion to the stimulated brain region. More recent scientific efforts have explored the wide-spread changes in neural activity generated throughout the stimulated brain network. In turn, new theories on the mechanisms of DBS have taken a systems-level approach to begin to decipher the network activity. This review provides an introduction to some of the network based theories on the function and pathophysiology of the cortico-basal-ganglia-thalamo-cortical loops commonly targeted by DBS. We then analyze some recent results on the effects of DBS on these networks, with a focus on subthalamic DBS for the treatment of Parkinson's disease. Finally we attempt to summarize how DBS could be achieving its therapeutic effects by overriding pathological network activity.

Increased dependence of action selection on recent motor history in Parkinson's disease

It is well known that the basal ganglia are involved in switching between movement sequences. Here we test the hypothesis that this contribution is an instance of a more general role of the basal ganglia in selecting actions that deviate from the context defined by the recent motor history, even when there is no sequential structure to learn or implement. We investigated the effect of striatal dopamine depletion [in Parkinson's disease (PD)] on the ability to switch between independent action plans. PD patients with markedly lateralized signs performed a hand laterality judgment task that involved action selection of their most and least affected hand. Trials where patients selected the same (repeat) or the alternative (switch) hand as in a previous trial were compared, and this was done separately for the most and least affected hand. Behaviorally, PD patients showed switch-costs that were specific to the most affected hand and that increased with disease severity. Functional magnetic resonance imaging (fMRI) showed that this behavioral effect was related to the state of the frontostriatal system: as disease severity increased, contributions of the basal ganglia to the selection process and their effective connectivity with the medial frontal cortex (MFC) decreased, whereas involvement of the MFC increased. We conclude that the basal ganglia are important for rapidly switching toward novel motor plans even when there is no sequential structure to learn or implement. The enhanced MFC activity may result either from reduced focusing abilities of the basal ganglia or from compensatory processes.

Thalamocortical relay fidelity varies across subthalamic nucleus deep brain stimulation protocols in a data-driven computational model

The therapeutic effectiveness of deep brain stimulation (DBS) of the subthalamic nucleus (STN) may arise through its effects on inhibitory basal ganglia outputs, including those from the internal segment of the globus pallidus (GPi). Changes in GPi activity will impact its thalamic targets, representing a possible pathway for STN-DBS to modulate basal ganglia-thalamocortical processing. To study the effect of STN-DBS on thalamic activity, we examined thalamocortical (TC) relay cell responses to an excitatory input train under a variety of inhibitory signals, using a computational model. The inhibitory signals were obtained from single-unit GPi recordings from normal monkeys and from monkeys rendered parkinsonian through arterial 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine injection. The parkinsonian GPi data were collected in the absence of STN-DBS, under sub-therapeutic STN-DBS, and under therapeutic STN-DBS. Our simulations show that inhibition from parkinsonian GPi activity recorded without DBS-compromised TC relay of excitatory inputs compared with the normal case, whereas TC relay fidelity improved significantly under inhibition from therapeutic, but not sub-therapeutic, STN-DBS GPi activity. In a heterogeneous model TC cell population, response failures to the same input occurred across multiple TC cells significantly more often without DBS than in the therapeutic DBS case and in the normal case. Inhibitory signals preceding successful TC relay were relatively constant, whereas those before failures changed more rapidly. Computationally generated inhibitory inputs yielded similar effects on TC relay. These results support the hypothesis that STN-DBS alters parkinsonian GPi activity in a way that may improve TC relay fidelity.

Is there a brainstem substrate for action selection?

The search for the neural substrate of vertebrate action selection has focused on structures in the forebrain and midbrain, and particularly on the group of sub-cortical nuclei known as the basal ganglia. Yet, the behavioural repertoire of decerebrate and neonatal animals suggests the existence of a relatively self-contained neural substrate for action selection in the brainstem. We propose that the medial reticular formation (mRF) is the substrate's main component and review evidence showing that the mRF's inputs, outputs and intrinsic organization are consistent with the requirements of an action-selection system. The internal architecture of the mRF is composed of interconnected neuron clusters. We present an anatomical model which suggests that the mRF's intrinsic circuitry constitutes a small-world network and extend this result to show that it may have evolved to reduce axonal wiring. Potential configurations of action representation within the internal circuitry of the mRF are then assessed by computational modelling. We present new results demonstrating that each cluster's output is most likely to represent activation of a component action; thus, coactivation of a set of these clusters would lead to the coordinated behavioural response observed in the animal. Finally, we consider the potential integration of the basal ganglia and mRF substrates for selection and suggest that they may collectively form a layered/hierarchical control system.

Action selection and refinement in subcortical loops through basal ganglia and cerebellum

Subcortical loops through the basal ganglia and the cerebellum form computationally powerful distributed processing modules (DPMs). This paper relates the computational features of a DPM's loop through the basal ganglia to experimental results for two kinds of natural action selection. First, functional imaging during a serial order recall task was used to study human brain activity during the selection of sequential actions from working memory. Second, microelectrode recordings from monkeys trained in a step-tracking task were used to study the natural selection of corrective submovements. Our DPM-based model assisted in the interpretation of puzzling data from both of these experiments. We come to posit that the many loops through the basal ganglia each regulate the embodiment of pattern formation in a given area of cerebral cortex. This operation serves to instantiate different kinds of action (or thought) mediated by different areas of cerebral cortex. We then use our findings to formulate a model of the aetiology of schizophrenia.

A scale-free systems theory of motivation and addiction

Scale-free organizations, characterized by uneven distributions of linkages between nodal elements, describe the structure and function of many life-based complex systems developing under evolutionary pressures. We explore motivated behavior as a scale-free map toward a comprehensive translational theory of addiction. Motivational and behavioral repertoires are reframed as link and nodal element sets, respectively, comprising a scale-free structure. These sets are generated by semi-independent information-processing streams within cortical-striatal circuits that cooperatively provide decision-making and sequential processing functions necessary for traversing maps of motivational links connecting behavioral nodes. Dopamine modulation of cortical-striatal plasticity serves a central-hierarchical mechanism for survival-adaptive sculpting and development of motivational-behavioral repertoires by guiding a scale-free design. Drug-induced dopamine activity promotes drug taking as a highly connected behavioral hub at the expense of natural-adaptive motivational links and behavioral nodes. Conceptualizing addiction as pathological alteration of scale-free motivational-behavioral repertoires unifies neurobiological, neurocomputational and behavioral research while addressing addiction vulnerability in adolescence and psychiatric illness. This model may inform integrative research in defining more effective prevention and treatment strategies for addiction.

A physiologically plausible model of action selection and oscillatory activity in the basal ganglia

The basal ganglia (BG) have long been implicated in both motor function and dysfunction. It has been proposed that the BG form a centralized action selection circuit, resolving conflict between multiple neural systems competing for access to the final common motor pathway. We present a new spiking neuron model of the BG circuitry to test this proposal, incorporating all major features and many physiologically plausible details. We include the following: effects of dopamine in the subthalamic nucleus (STN) and globus pallidus (GP), transmission delays between neurons, and specific distributions of synaptic inputs over dendrites. All main parameters were derived from experimental studies. We find that the BG circuitry supports motor program selection and switching, which deteriorates under dopamine-depleted and dopamine-excessive conditions in a manner consistent with some pathologies associated with those dopamine states. We also validated the model against data describing oscillatory properties of BG. We find that the same model displayed detailed features of both gamma-band (30-80 Hz) and slow (approximately 1 Hz) oscillatory phenomena reported by Brown et al. (2002) and Magill et al. (2001), respectively. Only the parameters required to mimic experimental conditions (e.g., anesthetic) or manipulations (e.g., lesions) were changed. From the results, we derive the following novel predictions about the STN-GP feedback loop: (1) the loop is functionally decoupled by tonic dopamine under normal conditions and recoupled by dopamine depletion; (2) the loop does not show pacemaking activity under normal conditions in vivo (but does after combined dopamine depletion and cortical lesion); (3) the loop has a resonant frequency in the gamma-band.

Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making

The basal ganglia (BG) coordinate decision making processes by facilitating adaptive frontal motor commands while suppressing others. In previous work, neural network simulations accounted for response selection deficits associated with BG dopamine depletion in Parkinson's disease. Novel predictions from this model have been subsequently confirmed in Parkinson patients and in healthy participants under pharmacological challenge. Nevertheless, one clear limitation of that model is in its omission of the subthalamic nucleus (STN), a key BG structure that participates in both motor and cognitive processes. The present model incorporates the STN and shows that by modulating when a response is executed, the STN reduces premature responding and therefore has substantial effects on which response is ultimately selected, particularly when there are multiple competing responses. Increased cortical response conflict leads to dynamic adjustments in response thresholds via cortico-subthalamic-pallidal pathways. The model accurately captures the dynamics of activity in various BG areas during response selection. Simulated dopamine depletion results in emergent oscillatory activity in BG structures, which has been linked with Parkinson's tremor. Finally, the model accounts for the beneficial effects of STN lesions on these oscillations, but suggests that this benefit may come at the expense of impaired decision making.

Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal

The authors explore the division of labor between the basal ganglia-dopamine (BG-DA) system and the orbitofrontal cortex (OFC) in decision making. They show that a primitive neural network model of the BG-DA system slowly learns to make decisions on the basis of the relative probability of rewards but is not as sensitive to (a) recency or (b) the value of specific rewards. An augmented model that explores BG-OFC interactions is more successful at estimating the true expected value of decisions and is faster at switching behavior when reinforcement contingencies change. In the augmented model, OFC areas exert top-down control on the BG and premotor areas by representing reinforcement magnitudes in working memory. The model successfully captures patterns of behavior resulting from OFC damage in decision making, reversal learning, and devaluation paradigms and makes additional predictions for the underlying source of these deficits.

Competition between feedback loops underlies normal and pathological dynamics in the basal ganglia

Experiments performed in normal animals suggest that the basal ganglia (BG) are crucial in motor program selection. BG are also involved in movement disorders. In particular, BG neuronal activity in parkinsonian animals and patients is more oscillatory and more synchronous than in normal individuals. We propose a new model for the function and dysfunction of the motor part of BG. We hypothesize that the striatum, the subthalamic nucleus, the internal pallidum (GPi), the thalamus, and the cortex are involved in closed feedback loops. The direct (cortex-striatum-GPi-thalamus-cortex) and the hyperdirect loops (cortex-subthalamic nucleus-GPi-thalamus-cortex), which have different polarities, play a key role in the model. We show that the competition between these two loops provides the BG-cortex system with the ability to perform motor program selection. Under the assumption that dopamine potentiates corticostriatal synaptic transmission, we demonstrate that, in our model, moderate dopamine depletion leads to a complete loss of action selection ability. High depletion can lead to synchronous oscillations. These modifications of the network dynamical state stem from an imbalance between the feedback in the direct and hyperdirect loops when dopamine is depleted. Our model predicts that the loss of selection ability occurs before the appearance of oscillations, suggesting that Parkinson's disease motor impairments are not directly related to abnormal oscillatory activity. Another major prediction of our model is that synchronous oscillations driven by the hyperdirect loop appear in BG after inactivation of the striatum.

Globus pallidus neurons dynamically regulate the activity pattern of subthalamic nucleus neurons through the frequency-dependent activation of postsynaptic GABAA and GABAB receptors

Reciprocally connected GABAergic neurons of the globus pallidus (GP) and glutamatergic neurons of the subthalamic nucleus (STN) are a putative generator of pathological rhythmic burst firing in Parkinson's disease (PD). Burst firing of STN neurons may be driven by rebound depolarization after barrages of GABA(A) receptor (GABA(A)R)-mediated IPSPs arising from pallidal fibers. To determine the conditions under which pallidosubthalamic transmission activates these and other postsynaptic GABARs, a parasagittal mouse brain slice preparation was developed in which pallidosubthalamic connections were preserved. Intact connectivity was first confirmed through the injection of a neuronal tracer into the GP. Voltage-clamp and gramicidin-based perforated-patch current-clamp recordings were then used to study the relative influences of GABA(A)R- and GABA(B)R-mediated pallidosubthalamic transmission on STN neurons. Spontaneous phasic, but not tonic, activation of postsynaptic GABA(A)Rs reduced the frequency and disrupted the rhythmicity of autonomous firing in STN neurons. However, postsynaptic GABA(B)Rs were only sufficiently activated to impact STN firing when pallidosubthalamic transmission was elevated or pallidal fibers were synchronously activated by electrical stimulation. In a subset of neurons, rebound burst depolarizations followed high-frequency, synchronous stimulation of pallidosubthalamic fibers. Although GABA(B)R-mediated hyperpolarization was itself sufficient to generate rebound bursts, coincident activation of postsynaptic GABA(A)Rs produced longer and more intense burst firing. These findings elucidate a novel route through which burst activity can be generated in the STN, and suggest that GABARs on STN neurons could act in a synergistic manner to generate abnormal burst activity in PD.

Spatial interference during bimanual coordination: differential brain networks associated with control of movement amplitude and direction

Bimanual interference emerges when spatial features, such as movement direction or amplitude, differ between limbs, as indicated by a mutual bias of limb trajectories. Although first insights into the neural basis of directional interference have been revealed recently, little is known about the neural network associated with amplitude interference. We investigated whether amplitude versus directional interference activates differential networks. Functional magnetic resonance imaging (fMRI) was applied while subjects performed cyclical, bimanual joystick movements with either the same vs. different amplitudes, directions, or both. The kinematic analysis confirmed that subjects experienced amplitude interference when they moved with different as compared to the same amplitude, and directional interference when they moved along different as compared to the same direction. On the brain level, amplitude and directional interference both resulted in activation of a bilateral superior parietal-premotor network, which is known to contribute to sensorimotor transformations during goal-directed movements. Interestingly, amplitude but not directional interference exclusively activated a bilateral network containing the dorsolateral prefrontal cortex, anterior cingulate, and supramarginal gyrus, which was shown previously to contribute to executive functions. Even though the encoding of amplitude and directional information converged and activated the same neural substrate, our data thus show that additional and partly independent mechanisms are involved in bimanual amplitude as compared to that in directional control.