Cumulative and after-effects of short and weak coordinated reset stimulation: a modeling study

Perspectives on adaptive dynamical systems

Adaptivity is a dynamical feature that is omnipresent in nature, socio-economics, and technology. For example, adaptive couplings appear in various real-world systems, such as the power grid, social, and neural networks, and they form the backbone of closed-loop control strategies and machine learning algorithms. In this article, we provide an interdisciplinary perspective on adaptive systems. We reflect on the notion and terminology of adaptivity in different disciplines and discuss which role adaptivity plays for various fields. We highlight common open challenges and give perspectives on future research directions, looking to inspire interdisciplinary approaches.

Decoupling of interacting neuronal populations by time-shifted stimulation through spike-timing-dependent plasticity

The synaptic organization of the brain is constantly modified by activity-dependent synaptic plasticity. In several neurological disorders, abnormal neuronal activity and pathological synaptic connectivity may significantly impair normal brain function. Reorganization of neuronal circuits by therapeutic stimulation has the potential to restore normal brain dynamics. Increasing evidence suggests that the temporal stimulation pattern crucially determines the long-lasting therapeutic effects of stimulation. Here, we tested whether a specific pattern of brain stimulation can enable the suppression of pathologically strong inter-population synaptic connectivity through spike-timing-dependent plasticity (STDP). More specifically, we tested how introducing a time shift between stimuli delivered to two interacting populations of neurons can effectively decouple them. To that end, we first used a tractable model, i.e., two bidirectionally coupled leaky integrate-and-fire (LIF) neurons, to theoretically analyze the optimal range of stimulation frequency and time shift for decoupling. We then extended our results to two reciprocally connected neuronal populations (modules) where inter-population delayed connections were modified by STDP. As predicted by the theoretical results, appropriately time-shifted stimulation causes a decoupling of the two-module system through STDP, i.e., by unlearning pathologically strong synaptic interactions between the two populations. Based on the overall topology of the connections, the decoupling of the two modules, in turn, causes a desynchronization of the populations that outlasts the cessation of stimulation. Decoupling effects of the time-shifted stimulation can be realized by time-shifted burst stimulation as well as time-shifted continuous simulation. Our results provide insight into the further optimization of a variety of multichannel stimulation protocols aiming at a therapeutic reshaping of diseased brain networks.

Efficient suppression of parkinsonian beta oscillations in a closed-loop model of deep brain stimulation with amplitude modulation

Introduction

Parkinson's disease (PD) is a movement disorder characterized by the pathological beta band (15-30 Hz) neural oscillations within the basal ganglia (BG). It is shown that the suppression of abnormal beta oscillations is correlated with the improvement of PD motor symptoms, which is a goal of standard therapies including deep brain stimulation (DBS). To overcome the stimulation-induced side effects and inefficiencies of conventional DBS (cDBS) and to reduce the administered stimulation current, closed-loop adaptive DBS (aDBS) techniques were developed. In this method, the frequency and/or amplitude of stimulation are modulated based on various disease biomarkers.

Methods

Here, by computational modeling of a cortico-BG-thalamic network in normal and PD conditions, we show that closed-loop aDBS of the subthalamic nucleus (STN) with amplitude modulation leads to a more effective suppression of pathological beta oscillations within the parkinsonian BG.

Results

Our results show that beta band neural oscillations are restored to their normal range and the reliability of the response of the thalamic neurons to motor cortex commands is retained due to aDBS with amplitude modulation. Furthermore, notably less stimulation current is administered during aDBS compared with cDBS due to a closed-loop control of stimulation amplitude based on the STN local field potential (LFP) beta activity.

Discussion

Efficient models of closed-loop stimulation may contribute to the clinical development of optimized aDBS techniques designed to reduce potential stimulation-induced side effects of cDBS in PD patients while leading to a better therapeutic outcome.

Synaptic reshaping of plastic neuronal networks by periodic multichannel stimulation with single-pulse and burst stimuli

Synaptic dysfunction is associated with several brain disorders, including Alzheimer's disease, Parkinson's disease (PD) and obsessive compulsive disorder (OCD). Utilizing synaptic plasticity, brain stimulation is capable of reshaping synaptic connectivity. This may pave the way for novel therapies that specifically counteract pathological synaptic connectivity. For instance, in PD, novel multichannel coordinated reset stimulation (CRS) was designed to counteract neuronal synchrony and down-regulate pathological synaptic connectivity. CRS was shown to entail long-lasting therapeutic aftereffects in PD patients and related animal models. This is in marked contrast to conventional deep brain stimulation (DBS) therapy, where PD symptoms return shortly after stimulation ceases. In the present paper, we study synaptic reshaping by periodic multichannel stimulation (PMCS) in networks of leaky integrate-and-fire (LIF) neurons with spike-timing-dependent plasticity (STDP). During PMCS, phase-shifted periodic stimulus trains are delivered to segregated neuronal subpopulations. Harnessing STDP, PMCS leads to changes of the synaptic network structure. We found that the PMCS-induced changes of the network structure depend on both the phase lags between stimuli and the shape of individual stimuli. Single-pulse stimuli and burst stimuli with low intraburst frequency down-regulate synapses between neurons receiving stimuli simultaneously. In contrast, burst stimuli with high intraburst frequency up-regulate these synapses. We derive theoretical approximations of the stimulation-induced network structure. This enables us to formulate stimulation strategies for inducing a variety of network structures. Our results provide testable hypotheses for future pre-clinical and clinical studies and suggest that periodic multichannel stimulation may be suitable for reshaping plastic neuronal networks to counteract pathological synaptic connectivity. Furthermore, we provide novel insight on how the stimulus type may affect the long-lasting outcome of conventional DBS. This may strongly impact parameter adjustment procedures for clinical DBS, which, so far, primarily focused on acute effects of stimulation.

Dynamics of phase oscillator networks with synaptic weight and structural plasticity

We study the dynamics of Kuramoto oscillator networks with two distinct adaptation processes, one varying the coupling strengths and the other altering the network structure. Such systems model certain networks of oscillatory neurons where the neuronal dynamics, synaptic weights, and network structure interact with and shape each other. We model synaptic weight adaptation with spike-timing-dependent plasticity (STDP) that runs on a longer time scale than neuronal spiking. Structural changes that include addition and elimination of contacts occur at yet a longer time scale than the weight adaptations. First, we study the steady-state dynamics of Kuramoto networks that are bistable and can settle in synchronized or desynchronized states. To compare the impact of adding structural plasticity, we contrast the network with only STDP to one with a combination of STDP and structural plasticity. We show that the inclusion of structural plasticity optimizes the synchronized state of a network by allowing for synchronization with fewer links than a network with STDP alone. With non-identical units in the network, the addition of structural plasticity leads to the emergence of correlations between the oscillators' natural frequencies and node degrees. In the desynchronized regime, the structural plasticity decreases the number of contacts, leading to a sparse network. In this way, adding structural plasticity strengthens both synchronized and desynchronized states of a network. Second, we use desynchronizing coordinated reset stimulation and synchronizing periodic stimulation to induce desynchronized and synchronized states, respectively. Our findings indicate that a network with a combination of STDP and structural plasticity may require stronger and longer stimulation to switch between the states than a network with STDP only.

Inhibitory Spike-Timing-Dependent Plasticity Can Account for Pathological Strengthening of Pallido-Subthalamic Synapses in Parkinson's Disease

Parkinson's disease (PD) is a neurodegenerative brain disorder associated with dysfunction of the basal ganglia (BG) circuitry. Dopamine (DA) depletion in experimental PD models leads to the pathological strengthening of pallido-subthalamic synaptic connections, contributing to the emergence of abnormally synchronized neuronal activity in the external segment of the globus pallidus (GPe) and subthalamic nucleus (STN). Augmented GPe-STN transmission following loss of DA was attributed to heterosynaptic plasticity mechanisms induced by cortico-subthalamic inputs. However, synaptic plasticity may play a role in this process. Here, by employing computational modeling we show that assuming inhibitory spike-timing-dependent plasticity (iSTDP) at pallido-subthalamic synapses can account for pathological strengthening of pallido-subthalamic synapses in PD by further promoting correlated neuronal activity in the GPe-STN network. In addition, we show that GPe-STN transmission delays can shape bistable activity-connectivity states due to iSTDP, characterized by strong connectivity and strong synchronized activity (pathological states) as opposed to weak connectivity and desynchronized activity (physiological states). Our results may shed light on how abnormal reshaping of GPe-STN connectivity by synaptic plasticity during parkinsonism is related to the PD pathophysiology and contribute to the development of therapeutic brain stimulation techniques targeting plasticity-induced rewiring of network connectivity.

Optimizing charge-balanced pulse stimulation for desynchronization

Collective synchronization in a large population of self-sustained units appears both in natural and engineered systems. Sometimes this effect is in demand, while in some cases, it is undesirable, which calls for control techniques. In this paper, we focus on pulsatile control, with the goal to either increase or decrease the level of synchrony. We quantify this level by the entropy of the phase distribution. Motivated by possible applications in neuroscience, we consider pulses of a realistic shape. Exploiting the noisy Kuramoto-Winfree model, we search for the optimal pulse profile and the optimal stimulation phase. For this purpose, we derive an expression for the change of the phase distribution entropy due to the stimulus. We relate this change to the properties of individual units characterized by generally different natural frequencies and phase response curves and the population's state. We verify the general result by analyzing a two-frequency population model and demonstrating a good agreement of the theory and numerical simulations.

Long-Term Desynchronization by Coordinated Reset Stimulation in a Neural Network Model With Synaptic and Structural Plasticity

Several brain disorders are characterized by abnormal neuronal synchronization. To specifically counteract abnormal neuronal synchrony and, hence, related symptoms, coordinated reset (CR) stimulation was computationally developed. In principle, successive epochs of synchronizing and desynchronizing stimulation may reversibly move neural networks with plastic synapses back and forth between stable regimes with synchronized and desynchronized firing. Computationally derived predictions have been verified in pre-clinical and clinical studies, paving the way for novel therapies. However, as yet, computational models were not able to reproduce the clinically observed increase of desynchronizing effects of regularly administered CR stimulation intermingled by long stimulation-free epochs. We show that this clinically important phenomenon can be computationally reproduced by taking into account structural plasticity (SP), a mechanism that deletes or generates synapses in order to homeostatically adapt the firing rates of neurons to a set point-like target firing rate in the course of days to months. If we assume that CR stimulation favorably reduces the target firing rate of SP, the desynchronizing effects of CR stimulation increase after long stimulation-free epochs, in accordance with clinically observed phenomena. Our study highlights the pivotal role of stimulation- and dosing-induced modulation of homeostatic set points in therapeutic processes.

Long-Lasting Desynchronization Effects of Coordinated Reset Stimulation Improved by Random Jitters

Abnormally strong synchronized activity is related to several neurological disorders, including essential tremor, epilepsy, and Parkinson's disease. Chronic high-frequency deep brain stimulation (HF DBS) is an established treatment for advanced Parkinson's disease. To reduce the delivered integral electrical current, novel theory-based stimulation techniques such as coordinated reset (CR) stimulation directly counteract the abnormal synchronous firing by delivering phase-shifted stimuli through multiple stimulation sites. In computational studies in neuronal networks with spike-timing-dependent plasticity (STDP), it was shown that CR stimulation down-regulates synaptic weights and drives the network into an attractor of a stable desynchronized state. This led to desynchronization effects that outlasted the stimulation. Corresponding long-lasting therapeutic effects were observed in preclinical and clinical studies. Computational studies suggest that long-lasting effects of CR stimulation depend on the adjustment of the stimulation frequency to the dominant synchronous rhythm. This may limit clinical applicability as different pathological rhythms may coexist. To increase the robustness of the long-lasting effects, we study randomized versions of CR stimulation in networks of leaky integrate-and-fire neurons with STDP. Randomization is obtained by adding random jitters to the stimulation times and by shuffling the sequence of stimulation site activations. We study the corresponding long-lasting effects using analytical calculations and computer simulations. We show that random jitters increase the robustness of long-lasting effects with respect to changes of the number of stimulation sites and the stimulation frequency. In contrast, shuffling does not increase parameter robustness of long-lasting effects. Studying the relation between acute, acute after-, and long-lasting effects of stimulation, we find that both acute after- and long-lasting effects are strongly determined by the stimulation-induced synaptic reshaping, whereas acute effects solely depend on the statistics of administered stimuli. We find that the stimulation duration is another important parameter, as effective stimulation only entails long-lasting effects after a sufficient stimulation duration. Our results show that long-lasting therapeutic effects of CR stimulation with random jitters are more robust than those of regular CR stimulation. This might reduce the parameter adjustment time in future clinical trials and make CR with random jitters more suitable for treating brain disorders with abnormal synchronization in multiple frequency bands.

Deep Brain Stimulation for Tremor: Update on Long-Term Outcomes, Target Considerations and Future Directions

Deep brain stimulation (DBS) of the thalamic ventral intermediate nucleus is one of the main advanced neurosurgical treatments for drug-resistant tremor. However, not every patient may be eligible for this procedure. Nowadays, various other functional neurosurgical procedures are available. In particular cases, radiofrequency thalamotomy, focused ultrasound and radiosurgery are proven alternatives to DBS. Besides, other DBS targets, such as the posterior subthalamic area (PSA) or the dentato-rubro-thalamic tract (DRT), may be appraised as well. In this review, the clinical characteristics and pathophysiology of tremor syndromes, as well as long-term outcomes of DBS in different targets, will be summarized. The effectiveness and safety of lesioning procedures will be discussed, and an evidence-based clinical treatment approach for patients with drug-resistant tremor will be presented. Lastly, the future directions in the treatment of severe tremor syndromes will be elaborated.

An Embedded Multi-Core Real-Time Simulation Platform of Basal Ganglia for Deep Brain Stimulation

Closed-loop deep brain stimulation (DBS) paradigm is gaining tremendous favor due to its potential capability of further and more efficient improvements in neurological diseases. Preclinical validation of closed-loop controller is quite necessary in order to minimize injury risks of clinical trials to patients, which can greatly benefit from real-time computational models and thus potentially reduce research and development costs and time. Here we developed an embedded multi-core real-time simulation platform (EMC-RTP) for a biological-faithful computational network model of basal ganglia (BG). The single neuron model is implemented in a highly real-time manner using a reasonable simplification. A modular mapping architecture with hierarchical routing organization was constructed to mimic the pathological neural activities of BG observed in parkinsonian conditions. A closed-loop simulation testbed for DBS validation was then set up using a host computer as the DBS controller. The availability of EMC-RTP and the testbed system was validated by comparing the performance of open-loop and proportional-integral (PI) controllers. Our experimental results showed that the proposed EMC-RTP reproduces abnormal beta bursts of BG in parkinsonian conditions while meets requirements of both real-time and computational accuracy as well. Closed-loop DBS experiments using the EMC-RTP suggested that the platform could perform reasonable output under different kinds of DBS strategies, indicating the usability of the platform.

Multistability in a star network of Kuramoto-type oscillators with synaptic plasticity

We analyze multistability in a star-type network of phase oscillators with coupling weights governed by phase-difference-dependent plasticity. It is shown that a network with N leaves can evolve into \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^N$$\end{document}2N various asymptotic states, characterized by different values of the coupling strength between the hub and the leaves. Starting from the simple case of two coupled oscillators, we develop an analytical approach based on two small parameters \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varepsilon$$\end{document}ε and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mu$$\end{document}μ, where \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varepsilon$$\end{document}ε is the ratio of the time scales of the phase variables and synaptic weights, and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mu$$\end{document}μ defines the sharpness of the plasticity boundary function. The limit \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mu \rightarrow 0$$\end{document}μ→0 corresponds to a hard boundary. The analytical results obtained on the model of two oscillators are generalized for multi-leaf star networks. Multistability with \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^N$$\end{document}2N various asymptotic states is numerically demonstrated for one-, two-, three- and nine-leaf star-type networks.

Coordinated Reset Vibrotactile Stimulation Induces Sustained Cumulative Benefits in Parkinson's Disease

BACKGROUND

Abnormal synchronization of neuronal activity in dopaminergic circuits is related to motor impairment in Parkinson's disease (PD). Vibrotactile coordinated reset (vCR) fingertip stimulation aims to counteract excessive synchronization and induce sustained unlearning of pathologic synaptic connectivity and neuronal synchrony. Here, we report two clinical feasibility studies that examine the effect of regular and noisy vCR stimulation on PD motor symptoms. Additionally, in one clinical study (study 1), we examine cortical beta band power changes in the sensorimotor cortex. Lastly, we compare these clinical results in relation to our computational findings.

METHODS

Study 1 examines six PD patients receiving noisy vCR stimulation and their cortical beta power changes after 3 months of daily therapy. Motor evaluations and at-rest electroencephalographic (EEG) recordings were assessed off medication pre- and post-noisy vCR. Study 2 follows three patients for 6+ months, two of whom received daily regular vCR and one patient from study 1 who received daily noisy vCR. Motor evaluations were taken at baseline, and follow-up visits were done approximately every 3 months. Computationally, in a network of leaky integrate-and-fire (LIF) neurons with spike timing-dependent plasticity, we study the differences between regular and noisy vCR by using a stimulus model that reproduces experimentally observed central neuronal phase locking.

RESULTS

Clinically, in both studies, we observed significantly improved motor ability. EEG recordings observed from study 1 indicated a significant decrease in off-medication cortical sensorimotor high beta power (21-30 Hz) at rest after 3 months of daily noisy vCR therapy. Computationally, vCR and noisy vCR cause comparable parameter-robust long-lasting synaptic decoupling and neuronal desynchronization.

CONCLUSION

In these feasibility studies of eight PD patients, regular vCR and noisy vCR were well tolerated, produced no side effects, and delivered sustained cumulative improvement of motor performance, which is congruent with our computational findings. In study 1, reduction of high beta band power over the sensorimotor cortex may suggest noisy vCR is effectively modulating the beta band at the cortical level, which may play a role in improved motor ability. These encouraging therapeutic results enable us to properly plan a proof-of-concept study.

Long-Lasting Desynchronization of Plastic Neural Networks by Random Reset Stimulation

Excessive neuronal synchrony is a hallmark of neurological disorders such as epilepsy and Parkinson's disease. An established treatment for medically refractory Parkinson's disease is high-frequency (HF) deep brain stimulation (DBS). However, symptoms return shortly after cessation of HF-DBS. Recently developed decoupling stimulation approaches, such as Random Reset (RR) stimulation, specifically target pathological connections to achieve long-lasting desynchronization. During RR stimulation, a temporally and spatially randomized stimulus pattern is administered. However, spatial randomization, as presented so far, may be difficult to realize in a DBS-like setup due to insufficient spatial resolution. Motivated by recently developed segmented DBS electrodes with multiple stimulation sites, we present a RR stimulation protocol that copes with the limited spatial resolution of currently available depth electrodes for DBS. Specifically, spatial randomization is realized by delivering stimuli simultaneously to L randomly selected stimulation sites out of a total of M stimulation sites, which will be called L/M-RR stimulation. We study decoupling by L/M-RR stimulation in networks of excitatory integrate-and-fire neurons with spike-timing dependent plasticity by means of theoretical and computational analysis. We find that L/M-RR stimulation yields parameter-robust decoupling and long-lasting desynchronization. Furthermore, our theory reveals that strong high-frequency stimulation is not suitable for inducing long-lasting desynchronization effects. As a consequence, low and high frequency L/M-RR stimulation affect synaptic weights in qualitatively different ways. Our simulations confirm these predictions and show that qualitative differences between low and high frequency L/M-RR stimulation are present across a wide range of stimulation parameters, rendering stimulation with intermediate frequencies most efficient. Remarkably, we find that L/M-RR stimulation does not rely on a high spatial resolution, characterized by the density of stimulation sites in a target area, corresponding to a large M. In fact, L/M-RR stimulation with low resolution performs even better at low stimulation amplitudes. Our results provide computational evidence that L/M-RR stimulation may present a way to exploit modern segmented lead electrodes for long-lasting therapeutic effects.

Technology of deep brain stimulation: current status and future directions

Deep brain stimulation (DBS) is a neurosurgical procedure that allows targeted circuit-based neuromodulation. DBS is a standard of care in Parkinson disease, essential tremor and dystonia, and is also under active investigation for other conditions linked to pathological circuitry, including major depressive disorder and Alzheimer disease. Modern DBS systems, borrowed from the cardiac field, consist of an intracranial electrode, an extension wire and a pulse generator, and have evolved slowly over the past two decades. Advances in engineering and imaging along with an improved understanding of brain disorders are poised to reshape how DBS is viewed and delivered to patients. Breakthroughs in electrode and battery designs, stimulation paradigms, closed-loop and on-demand stimulation, and sensing technologies are expected to enhance the efficacy and tolerability of DBS. In this Review, we provide a comprehensive overview of the technical development of DBS, from its origins to its future. Understanding the evolution of DBS technology helps put the currently available systems in perspective and allows us to predict the next major technological advances and hurdles in the field.

Deep brain stimulation: a review of the open neural engineering challenges

OBJECTIVE

Deep brain stimulation (DBS) is an established and valid therapy for a variety of pathological conditions ranging from motor to cognitive disorders. Still, much of the DBS-related mechanism of action is far from being understood, and there are several side effects of DBS whose origin is unclear. In the last years DBS limitations have been tackled by a variety of approaches, including adaptive deep brain stimulation (aDBS), a technique that relies on using chronically implanted electrodes on 'sensing mode' to detect the neural markers of specific motor symptoms and to deliver on-demand or modulate the stimulation parameters accordingly. Here we will review the state of the art of the several approaches to improve DBS and summarize the main challenges toward the development of an effective aDBS therapy.

APPROACH

We discuss models of basal ganglia disorders pathogenesis, hardware and software improvements for conventional DBS, and candidate neural and non-neural features and related control strategies for aDBS.

MAIN RESULTS

We identify then the main operative challenges toward optimal DBS such as (i) accurate target localization, (ii) increased spatial resolution of stimulation, (iii) development of in silico tests for DBS, (iv) identification of specific motor symptoms biomarkers, in particular (v) assessing how LFP oscillations relate to behavioral disfunctions, and (vi) clarify how stimulation affects the cortico-basal-ganglia-thalamic network to (vii) design optimal stimulation patterns.

SIGNIFICANCE

This roadmap will lead neural engineers novel to the field toward the most relevant open issues of DBS, while the in-depth readers might find a careful comparison of advantages and drawbacks of the most recent attempts to improve DBS-related neuromodulatory strategies.

Controlling collective synchrony in oscillatory ensembles by precisely timed pulses

We present an efficient technique for control of synchrony in a globally coupled ensemble by pulsatile action. We assume that we can observe the collective oscillation and can stimulate all elements of the ensemble simultaneously. We pay special attention to the minimization of intervention into the system. The key idea is to stimulate only at the most sensitive phase. To find this phase, we implement an adaptive feedback control. Estimating the instantaneous phase of the collective mode on the fly, we achieve efficient suppression using a few pulses per oscillatory cycle. We discuss the possible relevance of the results for neuroscience, namely, for the development of advanced algorithms for deep brain stimulation, a medical technique used to treat Parkinson's disease.

Impact of number of stimulation sites on long-lasting desynchronization effects of coordinated reset stimulation

Excessive neuronal synchrony is a hallmark of several neurological disorders, e.g., Parkinson's disease. An established treatment for medically refractory Parkinson's disease is high-frequency deep brain stimulation. However, it provides only acute relief, and symptoms return shortly after cessation of stimulation. A theory-based approach called coordinated reset (CR) has shown great promise in achieving long-lasting effects. During CR stimulation, phase-shifted stimuli are delivered to multiple stimulation sites to counteract neuronal synchrony. Computational studies in plastic neuronal networks reported that synaptic weights reduce during stimulation, which may cause sustained structural changes leading to stabilized desynchronized activity even after stimulation ceases. Corresponding long-lasting effects were found in recent preclinical and clinical studies. We study long-lasting desynchronization by CR stimulation in excitatory recurrent neuronal networks of integrate-and-fire neurons with spike-timing-dependent plasticity (STDP). We focus on the impact of the stimulation frequency and the number of stimulation sites on long-lasting effects. We compare theoretical predictions to simulations of plastic neuronal networks. Our results are important regarding CR calibration for two reasons. We reveal that long-lasting effects become most pronounced when stimulation parameters are adjusted to the characteristics of STDP-rather than to neuronal frequency characteristics. This is in contrast to previous studies where the CR frequency was adjusted to the dominant neuronal rhythm. In addition, we reveal a nonlinear dependence of long-lasting effects on the number of stimulation sites and the CR frequency. Intriguingly, optimal long-lasting desynchronization does not require larger numbers of stimulation sites.

Reinforcement learning for suppression of collective activity in oscillatory ensembles

We present the use of modern machine learning approaches to suppress self-sustained collective oscillations typically signaled by ensembles of degenerative neurons in the brain. The proposed hybrid model relies on two major components: an environment of oscillators and a policy-based reinforcement learning block. We report a model-agnostic synchrony control based on proximal policy optimization and two artificial neural networks in an Actor-Critic configuration. A class of physically meaningful reward functions enabling the suppression of collective oscillatory mode is proposed. The synchrony suppression is demonstrated for two models of neuronal populations-for the ensembles of globally coupled limit-cycle Bonhoeffer-van der Pol oscillators and for the bursting Hindmarsh-Rose neurons using rectangular and charge-balanced stimuli.

Acoustic coordinated reset therapy for tinnitus with perceptually relevant frequency spacing and levels

Acoustic coordinated reset (CR) therapy based on neuromodulation and neuroplasticity principles has been proposed for the treatment of tonal tinnitus. The original therapy involved periodic delivery of randomly ordered sequences of four low-level tones centered around the frequency of a tone that matched the tinnitus pitch, f_T, with fixed ratios relative to f_T and delivered several hours/day over several weeks. Here we transform the original CR tone selection method to a more perceptually-relevant equivalent rectangular bandwidth (ERB) frequency scale, the ERB_N-number scale. Specifically, we provide a mathematical model that enables calculation of CR tones that accounts for f_T- and hearing loss-related ERB widening and ERB overlaps and gaps of CR tone alignments. Further, the model ensures symmetric CR tone alignments based on modelling studies that indicate the effect is optimal if the CR stimuli are symmetrically spaced relative to the tinnitus-related population of abnormally synchronized cortical neurons to activate the adjacent sub-populations. We also present experimentally testable ERB-based CR tone alignment strategies and explain how to use the ERB-based model in experiments, clinical studies, other types of tinnitus sound treatment such as tailor-made notch music training and limitations of our approach.

Proceedings of the Sixth Deep Brain Stimulation Think Tank Modulation of Brain Networks and Application of Advanced Neuroimaging, Neurophysiology, and Optogenetics

The annual deep brain stimulation (DBS) Think Tank aims to create an opportunity for a multidisciplinary discussion in the field of neuromodulation to examine developments, opportunities and challenges in the field. The proceedings of the Sixth Annual Think Tank recapitulate progress in applications of neurotechnology, neurophysiology, and emerging techniques for the treatment of a range of psychiatric and neurological conditions including Parkinson’s disease, essential tremor, Tourette syndrome, epilepsy, cognitive disorders, and addiction. Each section of this overview provides insight about the understanding of neuromodulation for specific disease and discusses current challenges and future directions. This year’s report addresses key issues in implementing advanced neurophysiological techniques, evolving use of novel modulation techniques to deliver DBS, ans improved neuroimaging techniques. The proceedings also offer insights into the new era of brain network neuromodulation and connectomic DBS to define and target dysfunctional brain networks. The proceedings also focused on innovations in applications and understanding of adaptive DBS (closed-loop systems), the use and applications of optogenetics in the field of neurostimulation and the need to develop databases for DBS indications. Finally, updates on neuroethical, legal, social, and policy issues relevant to DBS research are discussed.

Controlling Synchronization of Spiking Neuronal Networks by Harnessing Synaptic Plasticity

Disrupting the pathological synchronous firing patterns of neurons with high frequency stimulation is a common treatment for Parkinsonian symptoms and epileptic seizures when pharmaceutical drugs fail. In this paper, our goal is to design a desynchronization strategy for large networks of spiking neurons such that the neuronal activity of the network remains in the desynchronized regime for a long period of time after the removal of the stimulation. We develop a novel "Forced Temporal-Spike Time Stimulation (FTSTS)" strategy that harnesses the spike-timing dependent plasticity to control the synchronization of neural activity in the network by forcing the neurons in the network to artificially fire in a specific temporal pattern. Our strategy modulates the synaptic strengths of selective synapses to achieve a desired synchrony of neural activity in the network. Our simulation results show that the FTSTS strategy can effectively synchronize or desynchronize neural activity in large spiking neuron networks and keep them in the desired state for a long period of time after the removal of the external stimulation. Using simulations, we demonstrate the robustness of our strategy in desynchronizing neural activity of networks against uncertainties in the designed stimulation pulses and network parameters. Additionally, we show in simulation, how our strategy could be incorporated within the existing desynchronization strategies to improve their overall efficacy in desynchronizing large networks. Our proposed strategy provides complete control over the synchronization of neurons in large networks and can be used to either synchronize or desynchronize neural activity based on specific applications. Moreover, it can be incorporated within other desynchronization strategies to improve the efficacy of existing therapies for numerous neurological and psychiatric disorders associated with pathological synchronization.

Dendritic and Axonal Propagation Delays May Shape Neuronal Networks With Plastic Synapses

Biological neuronal networks are highly adaptive and plastic. For instance, spike-timing-dependent plasticity (STDP) is a core mechanism which adapts the synaptic strengths based on the relative timing of pre- and postsynaptic spikes. In various fields of physiology, time delays cause a plethora of biologically relevant dynamical phenomena. However, time delays increase the complexity of model systems together with the computational and theoretical analysis burden. Accordingly, in computational neuronal network studies propagation delays were often neglected. As a downside, a classic STDP rule in oscillatory neurons without propagation delays is unable to give rise to bidirectional synaptic couplings, i.e., loops or uncoupled states. This is at variance with basic experimental results. In this mini review, we focus on recent theoretical studies focusing on how things change in the presence of propagation delays. Realistic propagation delays may lead to the emergence of neuronal activity and synaptic connectivity patterns, which cannot be captured by classic STDP models. In fact, propagation delays determine the inventory of attractor states and shape their basins of attractions. The results reviewed here enable to overcome fundamental discrepancies between theory and experiments. Furthermore, these findings are relevant for the development of therapeutic brain stimulation techniques aiming at shifting the diseased brain to more favorable attractor states.

Propagation delays determine neuronal activity and synaptic connectivity patterns emerging in plastic neuronal networks

In plastic neuronal networks, the synaptic strengths are adapted to the neuronal activity. Specifically, spike-timing-dependent plasticity (STDP) is a fundamental mechanism that modifies the synaptic strengths based on the relative timing of pre- and postsynaptic spikes, taking into account the spikes' temporal order. In many studies, propagation delays were neglected to avoid additional dynamic complexity or computational costs. So far, networks equipped with a classic STDP rule typically rule out bidirectional couplings (i.e., either loops or uncoupled states) and are, hence, not able to reproduce fundamental experimental findings. In this review paper, we consider additional features, e.g., extensions of the classic STDP rule or additional aspects like noise, in order to overcome the contradictions between theory and experiment. In addition, we review in detail recent studies showing that a classic STDP rule combined with realistic propagation patterns is able to capture relevant experimental findings. In two coupled oscillatory neurons with propagation delays, bidirectional synapses can be preserved and potentiated. This result also holds for large networks of type-II phase oscillators. In addition, not only the mean of the initial distribution of synaptic weights, but also its standard deviation crucially determines the emergent structural connectivity, i.e., the mean final synaptic weight, the number of two-neuron loops, and the symmetry of the final connectivity pattern. The latter is affected by the firing rates, where more symmetric synaptic configurations emerge at higher firing rates. Finally, we discuss these findings in the context of the computational neuroscience-based development of desynchronizing brain stimulation techniques.

Periodic flashing coordinated reset stimulation paradigm reduces sensitivity to ON and OFF period durations

Pathological synchronization in the basal ganglia network has been considered an important component of Parkinson’s disease pathophysiology. An established treatment for some patients with Parkinson’s disease is deep brain stimulation, in which a tonic high-frequency pulse train is delivered to target regions of the brain. In recent years, a novel neuromodulation paradigm called coordinated reset stimulation has been proposed, which aims to reverse the pathological synchrony by sequentially delivering short high-frequency bursts to distinct sub-regions of the pathologically synchronized network, with an average intra-burst interval for each sub-region corresponding to period of the pathological oscillation. It has further been proposed that the resultant desynchronization can be enhanced when stimulation is interrupted periodically, and that it is particularly beneficial to precisely tune the stimulation ON and OFF time-windows to the underlying pathological frequency. Pre-clinical and clinical studies of coordinated reset stimulation have relied on these proposals for their stimulation protocols. In this study, we present a modified ON-OFF coordinated reset stimulation paradigm called periodic flashing and study its behavior through computational modeling using the Kuramoto coupled phase oscillator model. We demonstrate that in contrast to conventional coordinated reset stimulation, the periodic flashing variation does not exhibit a need for precise turning of the ON-OFF periods to the pathological frequency, and demonstrates desynchronization for a wide range of ON and OFF periods. We provide a mechanistic explanation for the previously observed sensitivities and demonstrate that they are an artifact of the specific ON-OFF cycling paradigm used. As a practical consequence, the periodic flashing paradigm simplifies the tuning of optimal stimulation parameters by decreasing the dimension of the search space. It also suggests new, more flexible ways of delivering coordinated reset stimulation.

Suppressing bursting synchronization in a modular neuronal network with synaptic plasticity

Excessive synchronization of neurons in cerebral cortex is believed to play a crucial role in the emergence of neuropsychological disorders such as Parkinson's disease, epilepsy and essential tremor. This study, by constructing a modular neuronal network with modified Oja's learning rule, explores how to eliminate the pathological synchronized rhythm of interacted busting neurons numerically. When all neurons in the modular neuronal network are strongly synchronous within a specific range of coupling strength, the result reveals that synaptic plasticity with large learning rate can suppress bursting synchronization effectively. For the relative small learning rate not capable of suppressing synchronization, the technique of nonlinear delayed feedback control including differential feedback control and direct feedback control is further proposed to reduce the synchronized bursting state of coupled neurons. It is demonstrated that the two kinds of nonlinear feedback control can eliminate bursting synchronization significantly when the control parameters of feedback strength and feedback delay are appropriately tuned. For the former control technique, the control domain of effective synchronization suppression is similar to a semi-elliptical domain in the simulated parameter space of feedback strength and feedback delay, while for the latter one, the effective control domain is similar to a fan-shaped domain in the simulated parameter space.

How stimulation frequency and intensity impact on the long-lasting effects of coordinated reset stimulation

Several brain diseases are characterized by abnormally strong neuronal synchrony. Coordinated Reset (CR) stimulation was computationally designed to specifically counteract abnormal neuronal synchronization processes by desynchronization. In the presence of spike-timing-dependent plasticity (STDP) this may lead to a decrease of synaptic excitatory weights and ultimately to an anti-kindling, i.e. unlearning of abnormal synaptic connectivity and abnormal neuronal synchrony. The long-lasting desynchronizing impact of CR stimulation has been verified in pre-clinical and clinical proof of concept studies. However, as yet it is unclear how to optimally choose the CR stimulation frequency, i.e. the repetition rate at which the CR stimuli are delivered. This work presents the first computational study on the dependence of the acute and long-term outcome on the CR stimulation frequency in neuronal networks with STDP. For this purpose, CR stimulation was applied with Rapidly Varying Sequences (RVS) as well as with Slowly Varying Sequences (SVS) in a wide range of stimulation frequencies and intensities. Our findings demonstrate that acute desynchronization, achieved during stimulation, does not necessarily lead to long-term desynchronization after cessation of stimulation. By comparing the long-term effects of the two different CR protocols, the RVS CR stimulation turned out to be more robust against variations of the stimulation frequency. However, SVS CR stimulation can obtain stronger anti-kindling effects. We revealed specific parameter ranges that are favorable for long-term desynchronization. For instance, RVS CR stimulation at weak intensities and with stimulation frequencies in the range of the neuronal firing rates turned out to be effective and robust, in particular, if no closed loop adaptation of stimulation parameters is (technically) available. From a clinical standpoint, this may be relevant in the context of both invasive as well as non-invasive CR stimulation.

Computationally Developed Sham Stimulation Protocol for Multichannel Desynchronizing Stimulation

A characteristic pattern of abnormal brain activity is abnormally strong neuronal synchronization, as found in several brain disorders, such as tinnitus, Parkinson's disease, and epilepsy. As observed in several diseases, different therapeutic interventions may induce a placebo effect that may be strong and hinder reliable clinical evaluations. Hence, to distinguish between specific, neuromodulation-induced effects and unspecific, placebo effects, it is important to mimic the therapeutic procedure as precisely as possibly, thereby providing controls that actually lack specific effects. Coordinated Reset (CR) stimulation has been developed to specifically counteract abnormally strong synchronization by desynchronization. CR is a spatio-temporally patterned multichannel stimulation which reduces the extent of coincident neuronal activity and aims at an anti-kindling, i.e., an unlearning of both synaptic connectivity and neuronal synchrony. Apart from acute desynchronizing effects, CR may cause sustained, long-lasting desynchronizing effects, as already demonstrated in pre-clinical and clinical proof of concept studies. In this computational study, we set out to computationally develop a sham stimulation protocol for multichannel desynchronizing stimulation. To this end, we compare acute effects and long-lasting effects of six different spatio-temporally patterned stimulation protocols, including three variants of CR, using a no-stimulation condition as additional control. This is to provide an inventory of different stimulation algorithms with similar fundamental stimulation parameters (e.g., mean stimulation rates) but qualitatively different acute and/or long-lasting effects. Stimulation protocols sharing basic parameters, but inducing nevertheless completely different or even no acute effects and/or after-effects, might serve as controls to validate the specific effects of particular desynchronizing protocols such as CR. In particular, based on our computational findings we propose a multichannel sham (i.e., inactive) stimulation protocol as control condition for phase 2 and phase 3 studies with desynchronizing multichannel stimulation techniques.

Acute effects and after-effects of acoustic coordinated reset neuromodulation in patients with chronic subjective tinnitus

Chronic subjective tinnitus is an auditory phantom phenomenon characterized by abnormal neuronal synchrony in the central auditory system. As shown computationally, acoustic coordinated reset (CR) neuromodulation causes a long-lasting desynchronization of pathological synchrony by downregulating abnormal synaptic connectivity. In a previous proof of concept study acoustic CR neuromodulation, employing stimulation tone patterns tailored to the dominant tinnitus frequency, was compared to noisy CR-like stimulation, a CR version significantly detuned by sparing the tinnitus-related pitch range and including substantial random variability of the tone spacing on the frequency axis. Both stimulation protocols caused an acute relief as measured with visual analogue scale scores for tinnitus loudness (VAS-L) and annoyance (VAS-A) in the stimulation-ON condition (i.e. 15 min after stimulation onset), but only acoustic CR neuromodulation had sustained long-lasting therapeutic effects after 12 weeks of treatment as assessed with VAS-L, VAS-A scores and a tinnitus questionnaire (TQ) in the stimulation-OFF condition (i.e. with patients being off stimulation for at least 2.5 h). To understand the source of the long-lasting therapeutic effects, we here study whether acoustic CR neuromodulation has different electrophysiological effects on oscillatory brain activity as compared to noisy CR-like stimulation under stimulation-ON conditions and immediately after cessation of stimulation. To this end, we used a single-blind, single application, cross over design in 18 patients with chronic tonal subjective tinnitus and administered three different 16-minute stimulation protocols: acoustic CR neuromodulation, noisy CR-like stimulation and low frequency range (LFR) stimulation, a CR type stimulation with deliberately detuned pitch and repetition rate of stimulation tones, as control stimulation. We measured VAS-L and VAS-A scores together with spontaneous EEG activity pre-, during- and post-stimulation. Under stimulation-ON conditions acoustic CR neuromodulation and noisy CR-like stimulation had similar effects: a reduction of VAS-L and VAS-A scores together with a decrease of auditory delta power and an increase of auditory alpha and gamma power, without significant differences. In contrast, LFR stimulation had significantly weaker EEG effects and no significant clinical effects under stimulation-ON conditions. The distinguishing feature between acoustic CR neuromodulation and noisy CR-like stimulation were the electrophysiological after-effects. Acoustic CR neuromodulation caused the longest significant reduction of delta and gamma and increase of alpha power in the auditory cortex region. Noisy CR-like stimulation had weaker and LFR stimulation hardly any electrophysiological after-effects. This qualitative difference further supports the assertion that long-term effects of acoustic CR neuromodulation on tinnitus are mediated by a specific disruption of synchronous neural activity. Furthermore, our results indicate that acute electrophysiological after-effects might serve as a marker to further improve desynchronizing sound stimulation.

Closed-loop deep brain stimulation by pulsatile delayed feedback with increased gap between pulse phases

Computationally it was shown that desynchronizing delayed feedback stimulation methods are effective closed-loop techniques for the control of synchronization in ensembles of interacting oscillators. We here computationally design stimulation signals for electrical stimulation of neuronal tissue that preserve the desynchronizing delayed feedback characteristics and comply with mandatory charge deposit-related safety requirements. For this, the amplitude of the high-frequency (HF) train of biphasic charge-balanced pulses used by the standard HF deep brain stimulation (DBS) is modulated by the smooth feedback signals. In this way we combine the desynchronizing delayed feedback approach with the HF DBS technique. We show that such a pulsatile delayed feedback stimulation can effectively and robustly desynchronize a network of model neurons comprising subthalamic nucleus and globus pallidus external and suggest this approach for desynchronizing closed-loop DBS. Intriguingly, an interphase gap introduced between the recharging phases of the charge-balanced biphasic pulses can significantly improve the stimulation-induced desynchronization and reduce the amount of the administered stimulation. In view of the recent experimental and clinical studies indicating a superiority of the closed-loop DBS to open-loop HF DBS, our results may contribute to a further development of effective stimulation methods for the treatment of neurological disorders characterized by abnormal neuronal synchronization.

Pulsatile desynchronizing delayed feedback for closed-loop deep brain stimulation

High-frequency (HF) deep brain stimulation (DBS) is the gold standard for the treatment of medically refractory movement disorders like Parkinson’s disease, essential tremor, and dystonia, with a significant potential for application to other neurological diseases. The standard setup of HF DBS utilizes an open-loop stimulation protocol, where a permanent HF electrical pulse train is administered to the brain target areas irrespectively of the ongoing neuronal dynamics. Recent experimental and clinical studies demonstrate that a closed-loop, adaptive DBS might be superior to the open-loop setup. We here combine the notion of the adaptive high-frequency stimulation approach, that aims at delivering stimulation adapted to the extent of appropriately detected biomarkers, with specifically desynchronizing stimulation protocols. To this end, we extend the delayed feedback stimulation methods, which are intrinsically closed-loop techniques and specifically designed to desynchronize abnormal neuronal synchronization, to pulsatile electrical brain stimulation. We show that permanent pulsatile high-frequency stimulation subjected to an amplitude modulation by linear or nonlinear delayed feedback methods can effectively and robustly desynchronize a STN-GPe network of model neurons and suggest this approach for desynchronizing closed-loop DBS.

Stimulus-induced Epileptic Spike-Wave Discharges in Thalamocortical Model with Disinhibition

Epileptic absence seizure characterized by the typical 2–4 Hz spike-wave discharges (SWD) are known to arise due to the physiologically abnormal interactions within the thalamocortical network. By introducing a second inhibitory neuronal population in the cortical system, here we propose a modified thalamocortical field model to mathematically describe the occurrences and transitions of SWD under the mutual functions between cortex and thalamus, as well as the disinhibitory modulations of SWD mediated by the two different inhibitory interneuronal populations. We first show that stimulation can induce the recurrent seizures of SWD in the modified model. Also, we demonstrate the existence of various types of firing states including the SWD. Moreover, we can identify the bistable parametric regions where the SWD can be both induced and terminated by stimulation perturbations applied in the background resting state. Interestingly, in the absence of stimulation disinhibitory functions between the two different interneuronal populations can also both initiate and abate the SWD, which suggests that the mechanism of disinhibition is comparable to the effect of stimulation in initiating and terminating the epileptic SWD. Hopefully, the obtained results can provide theoretical evidences in exploring dynamical mechanism of epileptic seizures.

A new bio-inspired stimulator to suppress hyper-synchronized neural firing in a cortical network

Hyper-synchronous neural oscillations are the character of several neurological diseases such as epilepsy. On the other hand, glial cells and particularly astrocytes can influence neural synchronization. Therefore, based on the recent researches, a new bio-inspired stimulator is proposed which basically is a dynamical model of the astrocyte biophysical model. The performance of the new stimulator is investigated on a large-scale, cortical network. Both excitatory and inhibitory synapses are also considered in the simulated spiking neural network. The simulation results show that the new stimulator has a good performance and is able to reduce recurrent abnormal excitability which in turn avoids the hyper-synchronous neural firing in the spiking neural network. In this way, the proposed stimulator has a demand controlled characteristic and is a good candidate for deep brain stimulation (DBS) technique to successfully suppress the neural hyper-synchronization.

Coordinated Reset Deep Brain Stimulation of Subthalamic Nucleus Produces Long-Lasting, Dose-Dependent Motor Improvements in the 1-Methyl-4-phenyl-1,2,3,6-tetrahydropyridine Non-Human Primate Model of Parkinsonism

BACKGROUND

Novel deep brain stimulation (DBS) paradigms are being explored in an effort to further optimize therapeutic outcome for patients with Parkinson's disease (PD). One approach, termed 'Coordinated Reset' (CR) DBS, was developed to target pathological oscillatory network activity. with desynchronizing effects and associated therapeutic benefit hypothesized to endure beyond cessation of stimulus delivery.

OBJECTIVE

To characterize the acute and carry-over effects of low-intensity CR DBS versus traditional DBS (tDBS) in the region of the subthalamic nucleus (STN).

METHODS

A within-subject, block treatment design involving the 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) non-human primate model of parkinsonism was used. Each treatment block consisted of five days of daily DBS delivery followed by a one week minimum post-treatment observation window. Motor behavior was quantified using a modified rating scale for both animals combined with an objective, upper-extremity reach task in one animal.

RESULTS

Both animals demonstrated significant motor improvements during acute tDBS; however, within-session and post-treatment carry-over was limited. Acute motor improvements were also observed in response to low-intensity CR DBS; however, both within- and between-session therapeutic carry-over enhanced progressively following each daily treatment. Moreover, in contrast to tDBS, five consecutive days of CR DBS treatment yielded carry-over benefits that persisted for up to two weeks without additional intervention. Notably, the magnitude and time-course of CR DBS' effects on each animal varied with daily dose-duration, pointing to possible interaction effects involving baseline parkinsonian severity.

CONCLUSION

Our results support the therapeutic promise of CR DBS for PD, including its potential to induce carryover while reducing both side effect risk and hardware power consumption.

Anti-kindling Induced by Two-Stage Coordinated Reset Stimulation with Weak Onset Intensity

Abnormal neuronal synchrony plays an important role in a number of brain diseases. To specifically counteract abnormal neuronal synchrony by desynchronization, Coordinated Reset (CR) stimulation, a spatiotemporally patterned stimulation technique, was designed with computational means. In neuronal networks with spike timing–dependent plasticity CR stimulation causes a decrease of synaptic weights and finally anti-kindling, i.e., unlearning of abnormally strong synaptic connectivity and abnormal neuronal synchrony. Long-lasting desynchronizing aftereffects of CR stimulation have been verified in pre-clinical and clinical proof of concept studies. In general, for different neuromodulation approaches, both invasive and non-invasive, it is desirable to enable effective stimulation at reduced stimulation intensities, thereby avoiding side effects. For the first time, we here present a two-stage CR stimulation protocol, where two qualitatively different types of CR stimulation are delivered one after another, and the first stage comes at a particularly weak stimulation intensity. Numerical simulations show that a two-stage CR stimulation can induce the same degree of anti-kindling as a single-stage CR stimulation with intermediate stimulation intensity. This stimulation approach might be clinically beneficial in patients suffering from brain diseases characterized by abnormal neuronal synchrony where a first treatment stage should be performed at particularly weak stimulation intensities in order to avoid side effects. This might, e.g., be relevant in the context of acoustic CR stimulation in tinnitus patients with hyperacusis or in the case of electrical deep brain CR stimulation with sub-optimally positioned leads or side effects caused by stimulation of the target itself. We discuss how to apply our method in first in man and proof of concept studies.

Noise-enhanced coupling between two oscillators with long-term plasticity

Spike timing-dependent plasticity is a fundamental adaptation mechanism of the nervous system. It induces structural changes of synaptic connectivity by regulation of coupling strengths between individual cells depending on their spiking behavior. As a biophysical process its functioning is constantly subjected to natural fluctuations. We study theoretically the influence of noise on a microscopic level by considering only two coupled neurons. Adopting a phase description for the neurons we derive a two-dimensional system which describes the averaged dynamics of the coupling strengths. We show that a multistability of several coupling configurations is possible, where some configurations are not found in systems without noise. Intriguingly, it is possible that a strong bidirectional coupling, which is not present in the noise-free situation, can be stabilized by the noise. This means that increased noise, which is normally expected to desynchronize the neurons, can be the reason for an antagonistic response of the system, which organizes itself into a state of stronger coupling and counteracts the impact of noise. This mechanism, as well as a high potential for multistability, is also demonstrated numerically for a coupled pair of Hodgkin-Huxley neurons.

Augmented brain function by coordinated reset stimulation with slowly varying sequences

Several brain disorders are characterized by abnormally strong neuronal synchrony. Coordinated Reset (CR) stimulation was developed to selectively counteract abnormal neuronal synchrony by desynchronization. For this, phase resetting stimuli are delivered to different subpopulations in a timely coordinated way. In neural networks with spike timing-dependent plasticity CR stimulation may eventually lead to an anti-kindling, i.e., an unlearning of abnormal synaptic connectivity and abnormal synchrony. The spatiotemporal sequence by which all stimulation sites are stimulated exactly once is called the stimulation site sequence, or briefly sequence. So far, in simulations, pre-clinical and clinical applications CR was applied either with fixed sequences or rapidly varying sequences (RVS). In this computational study we show that appropriate repetition of the sequence with occasional random switching to the next sequence may significantly improve the anti-kindling effect of CR. To this end, a sequence is applied many times before randomly switching to the next sequence. This new method is called SVS CR stimulation, i.e., CR with slowly varying sequences. In a neuronal network with strong short-range excitatory and weak long-range inhibitory dynamic couplings SVS CR stimulation turns out to be superior to CR stimulation with fixed sequences or RVS.

The spacing principle for unlearning abnormal neuronal synchrony

Desynchronizing stimulation techniques were developed to specifically counteract abnormal neuronal synchronization relevant to several neurological and psychiatric disorders. The goal of our approach is to achieve an anti-kindling, where the affected neural networks unlearn abnormal synaptic connectivity and, hence, abnormal neuronal synchrony, by means of desynchronizing stimulation, in particular, Coordinated Reset (CR) stimulation. As known from neuroscience, psychology and education, learning effects can be enhanced by means of the spacing principle, i.e. by delivering repeated stimuli spaced by pauses as opposed to delivering a massed stimulus (in a single long stimulation session). To illustrate that the spacing principle may boost the anti-kindling effect of CR neuromodulation, in this computational study we carry this approach to extremes. To this end, we deliver spaced CR neuromodulation at particularly weak intensities which render permanently delivered CR neuromodulation ineffective. Intriguingly, spaced CR neuromodulation at these particularly weak intensities effectively induces an anti-kindling. In fact, the spacing principle enables the neuronal population to successively hop from one attractor to another one, finally approaching attractors characterized by down-regulated synaptic connectivity and synchrony. Our computational results might open up novel opportunities to effectively induce sustained desynchronization at particularly weak stimulation intensities, thereby avoiding side effects, e.g., in the case of deep brain stimulation.

Maladaptive neural synchrony in tinnitus: origin and restoration

Tinnitus is the conscious perception of sound heard in the absence of physical sound sources external or internal to the body, reflected in aberrant neural synchrony of spontaneous or resting-state brain activity. Neural synchrony is generated by the nearly simultaneous firing of individual neurons, of the synchronization of membrane-potential changes in local neural groups as reflected in the local field potentials, resulting in the presence of oscillatory brain waves in the EEG. Noise-induced hearing loss, often resulting in tinnitus, causes a reorganization of the tonotopic map in auditory cortex and increased spontaneous firing rates and neural synchrony. Spontaneous brain rhythms rely on neural synchrony. Abnormal neural synchrony in tinnitus appears to be confined to specific frequency bands of brain rhythms. Increases in delta-band activity are generated by deafferented/deprived neuronal networks resulting from hearing loss. Coordinated reset (CR) stimulation was developed in order to specifically counteract such abnormal neuronal synchrony by desynchronization. The goal of acoustic CR neuromodulation is to desynchronize tinnitus-related abnormal delta-band oscillations. CR neuromodulation does not require permanent stimulus delivery in order to achieve long-lasting desynchronization or even a full-blown anti-kindling but may have cumulative effects, i.e., the effect of different CR epochs separated by pauses may accumulate. Unlike other approaches, acoustic CR neuromodulation does not intend to reduce tinnitus-related neuronal activity by employing lateral inhibition. The potential efficacy of acoustic CR modulation was shown in a clinical proof of concept trial, where effects achieved in 12 weeks of treatment delivered 4–6 h/day persisted through a preplanned 4-week therapy pause and showed sustained long-term effects after 10 months of therapy, leading to 75% responders.

Improving desynchronization of Parkinsonian neuronal network via triplet-structure coordinated reset stimulation

We investigate how the triplet-structure coordinated reset stimulations (CRS), which acts on the GPe, STN and GPi within the basal ganglia-thalamocortical motor circuit, can destabilize the strong synchronous state and improve the reliability of thalamic relay in the parkinsonian network. It is shown that compared with the permanent (1:0 ON-OFF) CRS or the classic deep brain stimulation paradigm, the periodic m:n ON-OFF CRS (i.e., m ON-cycles stimulation followed by n OFF-cycles stimulation) can significantly desynchronize the neuronal network of Parkinson's disease, and evidently improve the fidelity of thalamic relay. In addition, the CRS-induced desynchronization can be greatly enhanced when the STN subpopulation within the pathologic network is subjected to the synaptic plasticity. Furthermore, the desynchronization and reliability can also be further improved as the closed-loop CRS strategy is introduced. The obtained results can be helpful for us to understand the pathophysiology mechanism of Parkinson's disease, even though the feasibility of CRS still needs to be explored in clinic.

Control of abnormal synchronization in neurological disorders

In the nervous system, synchronization processes play an important role, e.g., in the context of information processing and motor control. However, pathological, excessive synchronization may strongly impair brain function and is a hallmark of several neurological disorders. This focused review addresses the question of how an abnormal neuronal synchronization can specifically be counteracted by invasive and non-invasive brain stimulation as, for instance, by deep brain stimulation for the treatment of Parkinson’s disease, or by acoustic stimulation for the treatment of tinnitus. On the example of coordinated reset (CR) neuromodulation, we illustrate how insights into the dynamics of complex systems contribute to successful model-based approaches, which use methods from synergetics, non-linear dynamics, and statistical physics, for the development of novel therapies for normalization of brain function and synaptic connectivity. Based on the intrinsic multistability of the neuronal populations induced by spike timing-dependent plasticity (STDP), CR neuromodulation utilizes the mutual interdependence between synaptic connectivity and dynamics of the neuronal networks in order to restore more physiological patterns of connectivity via desynchronization of neuronal activity. The very goal is to shift the neuronal population by stimulation from an abnormally coupled and synchronized state to a desynchronized regime with normalized synaptic connectivity, which significantly outlasts the stimulation cessation, so that long-lasting therapeutic effects can be achieved.

Coordinated reset stimulation in a large-scale model of the STN-GPe circuit

Synchronization of populations of neurons is a hallmark of several brain diseases. Coordinated reset (CR) stimulation is a model-based stimulation technique which specifically counteracts abnormal synchrony by desynchronization. Electrical CR stimulation, e.g., for the treatment of Parkinson's disease (PD), is administered via depth electrodes. In order to get a deeper understanding of this technique, we extended the top-down approach of previous studies and constructed a large-scale computational model of the respective brain areas. Furthermore, we took into account the spatial anatomical properties of the simulated brain structures and incorporated a detailed numerical representation of 2 · 10⁴ simulated neurons. We simulated the subthalamic nucleus (STN) and the globus pallidus externus (GPe). Connections within the STN were governed by spike-timing dependent plasticity (STDP). In this way, we modeled the physiological and pathological activity of the considered brain structures. In particular, we investigated how plasticity could be exploited and how the model could be shifted from strongly synchronized (pathological) activity to strongly desynchronized (healthy) activity of the neuronal populations via CR stimulation of the STN neurons. Furthermore, we investigated the impact of specific stimulation parameters especially the electrode position on the stimulation outcome. Our model provides a step forward toward a biophysically realistic model of the brain areas relevant to the emergence of pathological neuronal activity in PD. Furthermore, our model constitutes a test bench for the optimization of both stimulation parameters and novel electrode geometries for efficient CR stimulation.

Sisyphus effect in pulse-coupled excitatory neural networks with spike-timing-dependent plasticity

The collective dynamics of excitatory pulse-coupled neural networks with spike-timing-dependent plasticity (STDP) is studied. Depending on the model parameters stationary states characterized by high or low synchronization can be observed. In particular, at the transition between these two regimes, persistent irregular low frequency oscillations between strongly and weakly synchronized states are observable, which can be identified as infraslow oscillations with frequencies ≃0.02-0.03 Hz. Their emergence can be explained in terms of the Sisyphus effect, a mechanism caused by a continuous feedback between the evolution of the coherent population activity and of the average synaptic weight. Due to this effect, the synaptic weights have oscillating equilibrium values, which prevents the neuronal population from relaxing into a stationary macroscopic state.

Optimal number of stimulation contacts for coordinated reset neuromodulation

In this computational study we investigate coordinated reset (CR) neuromodulation designed for an effective control of synchronization by multi-site stimulation of neuronal target populations. This method was suggested to effectively counteract pathological neuronal synchrony characteristic for several neurological disorders. We study how many stimulation sites are required for optimal CR-induced desynchronization. We found that a moderate increase of the number of stimulation sites may significantly prolong the post-stimulation desynchronized transient after the stimulation is completely switched off. This can, in turn, reduce the amount of the administered stimulation current for the intermittent ON-OFF CR stimulation protocol, where time intervals with stimulation ON are recurrently followed by time intervals with stimulation OFF. In addition, we found that the optimal number of stimulation sites essentially depends on how strongly the administered current decays within the neuronal tissue with increasing distance from the stimulation site. In particular, for a broad spatial stimulation profile, i.e., for a weak spatial decay rate of the stimulation current, CR stimulation can optimally be delivered via a small number of stimulation sites. Our findings may contribute to an optimization of therapeutic applications of CR neuromodulation.

A phase plane analysis of neuron-astrocyte interactions

Intensive experimental studies have shown that astrocytes are active partners in modulation of synaptic transmission. In the present research, we study neuron-astrocyte signaling using a biologically inspired model of one neuron synapsing one astrocyte. In this model, the firing dynamics of the neuron is described by the Morris-Lecar model and the Ca(2+) dynamics of a single astrocyte explained by a functional model introduced by Postnov and colleagues. Using the coupled neuron-astrocyte model and based on the results of the phase plane analyses, it is demonstrated that the astrocyte is able to activate the silent neuron or change the neuron spiking frequency through bidirectional communication. This suggests that astrocyte feedback signaling is capable of modulating spike transmission frequency by changing neuron spiking frequency. This effect is described by a saddle-node on invariant circle bifurcation in the coupled neuron-astrocyte model. In this way, our results suggest that the neuron-astrocyte crosstalk has a fundamental role in producing diverse neuronal activities and therefore enhances the information processing capabilities of the brain.

Impact of acoustic coordinated reset neuromodulation on effective connectivity in a neural network of phantom sound

Chronic subjective tinnitus is an auditory phantom phenomenon characterized by abnormal neuronal synchrony in the central auditory system. As recently shown in a proof of concept clinical trial, acoustic coordinated reset (CR) neuromodulation causes a significant relief of tinnitus symptoms combined with a significant decrease of pathological oscillatory activity in a network comprising auditory and non-auditory brain areas. The objective of the present study was to analyze whether CR therapy caused an alteration of the effective connectivity in a tinnitus related network of localized EEG brain sources. To determine which connections matter, in a first step, we considered a larger network of brain sources previously associated with tinnitus. To that network we applied a data-driven approach, combining empirical mode decomposition and partial directed coherence analysis, in patients with bilateral tinnitus before and after 12 weeks of CR therapy as well as in healthy controls. To increase the signal-to-noise ratio, we focused on the good responders, classified by a reliable-change-index (RCI). Prior to CR therapy and compared to the healthy controls, the good responders showed a significantly increased connectivity between the left primary cortex auditory cortex and the posterior cingulate cortex in the gamma and delta bands together with a significantly decreased effective connectivity between the right primary auditory cortex and the dorsolateral prefrontal cortex in the alpha band. Intriguingly, after 12 weeks of CR therapy most of the pathological interactions were gone, so that the connectivity patterns of good responders and healthy controls became statistically indistinguishable. In addition, we used dynamic causal modeling (DCM) to examine the types of interactions which were altered by CR therapy. Our DCM results show that CR therapy specifically counteracted the imbalance of excitation and inhibition. CR significantly weakened the excitatory connection between posterior cingulate cortex and primary auditory cortex and significantly strengthened inhibitory connections between auditory cortices and the dorsolateral prefrontal cortex. The overall impact of CR therapy on the entire tinnitus-related network showed up as a qualitative transformation of its spectral response, in terms of a drastic change of the shape of its averaged transfer function. Based on our findings we hypothesize that CR therapy restores a silence based cognitive auditory comparator function of the posterior cingulate cortex.

Neuromodulation: selected approaches and challenges

The brain operates through complex interactions in the flow of information and signal processing within neural networks. The 'wiring' of such networks, being neuronal or glial, can physically and/or functionally go rogue in various pathological states. Neuromodulation, as a multidisciplinary venture, attempts to correct such faulty nets. In this review, selected approaches and challenges in neuromodulation are discussed. The use of water-dispersible carbon nanotubes has been proven effective in the modulation of neurite outgrowth in culture and in aiding regeneration after spinal cord injury in vivo. Studying neural circuits using computational biology and analytical engineering approaches brings to light geometrical mapping of dynamics within neural networks, much needed information for stimulation interventions in medical practice. Indeed, sophisticated desynchronization approaches used for brain stimulation have been successful in coaxing 'misfiring' neuronal circuits to resume productive firing patterns in various human disorders. Devices have been developed for the real-time measurement of various neurotransmitters as well as electrical activity in the human brain during electrical deep brain stimulation. Such devices can establish the dynamics of electrochemical changes in the brain during stimulation. With increasing application of nanomaterials in devices for electrical and chemical recording and stimulating in the brain, the era of cellular, and even intracellular, precision neuromodulation will soon be upon us.

Spatiotemporal visualization of deep brain stimulation-induced effects in the subthalamic nucleus

Deep brain stimulation (DBS) is a successful surgical therapy used to treat the disabling symptoms of movement disorders such as Parkinson's disease. It involves the chronic stimulation of disorder-specific nuclei. However, the mechanisms that lead to clinical improvements remain unclear. Consequently, this slows the optimization of present-day DBS therapy and hinders its future development and application. We used a computational model to calculate the distribution of electric potential induced by DBS and study the effect of stimulation on the spiking activity of a subthalamic nucleus (STN) projection neuron. We previously showed that such a model can reveal detailed spatial effects of stimulation in the vicinity of the electrode. However, this multi-compartmental STN neuron model can fire in either a burst or tonic mode and, in this study, we hypothesized that the firing mode of the cell will have a major impact on the DBS-induced effects. Our simulations showed that the bursting model exhibits behaviour observed in studies of high-frequency stimulation of STN neurons, such as the presence of a silent period at stimulation offset and frequency-dependent stimulation effects. We validated the model by simulating the clinical parameter settings used for a Parkinsonian patient and showed, in a patient-specific anatomical model, that the region of affected tissue is consistent with clinical observations of the optimal DBS site. Our results demonstrated a method of quantitatively assessing neuronal changes induced by DBS, to maximize therapeutic benefit and minimize unwanted side effects.