Vibrotactile Coordinated Reset Stimulation for the Treatment of Neurological Diseases: Concepts and Device Specifications

Perspectives on adaptive dynamical systems

Adaptivity is a dynamical feature that is omnipresent in nature, socio-economics, and technology. For example, adaptive couplings appear in various real-world systems, such as the power grid, social, and neural networks, and they form the backbone of closed-loop control strategies and machine learning algorithms. In this article, we provide an interdisciplinary perspective on adaptive systems. We reflect on the notion and terminology of adaptivity in different disciplines and discuss which role adaptivity plays for various fields. We highlight common open challenges and give perspectives on future research directions, looking to inspire interdisciplinary approaches.

Long-Lasting Desynchronization of Plastic Neuronal Networks by Double-Random Coordinated Reset Stimulation

Hypersynchrony of neuronal activity is associated with several neurological disorders, including essential tremor and Parkinson's disease (PD). Chronic high-frequency deep brain stimulation (HF DBS) is the standard of care for medically refractory PD. Symptoms may effectively be suppressed by HF DBS, but return shortly after cessation of stimulation. Coordinated reset (CR) stimulation is a theory-based stimulation technique that was designed to specifically counteract neuronal synchrony by desynchronization. During CR, phase-shifted stimuli are delivered to multiple neuronal subpopulations. Computational studies on CR stimulation of plastic neuronal networks revealed long-lasting desynchronization effects obtained by down-regulating abnormal synaptic connectivity. This way, networks are moved into attractors of stable desynchronized states such that stimulation-induced desynchronization persists after cessation of stimulation. Preclinical and clinical studies confirmed corresponding long-lasting therapeutic and desynchronizing effects in PD. As PD symptoms are associated with different pathological synchronous rhythms, stimulation-induced long-lasting desynchronization effects should favorably be robust to variations of the stimulation frequency. Recent computational studies suggested that this robustness can be improved by randomizing the timings of stimulus deliveries. We study the long-lasting effects of CR stimulation with randomized stimulus amplitudes and/or randomized stimulus timing in networks of leaky integrate-and-fire (LIF) neurons with spike-timing-dependent plasticity. Performing computer simulations and analytical calculations, we study long-lasting desynchronization effects of CR with and without randomization of stimulus amplitudes alone, randomization of stimulus times alone as well as the combination of both. Varying the CR stimulation frequency (with respect to the frequency of abnormal target rhythm) and the number of separately stimulated neuronal subpopulations, we reveal parameter regions and related mechanisms where the two qualitatively different randomization mechanisms improve the robustness of long-lasting desynchronization effects of CR. In particular, for clinically relevant parameter ranges double-random CR stimulation, i.e., CR stimulation with the specific combination of stimulus amplitude randomization and stimulus time randomization, may outperform regular CR stimulation with respect to long-lasting desynchronization. In addition, our results provide the first evidence that an effective reduction of the overall stimulation current by stimulus amplitude randomization may improve the frequency robustness of long-lasting therapeutic effects of brain stimulation.

Spike-Timing-Dependent Plasticity Mediated by Dopamine and its Role in Parkinson's Disease Pathophysiology

Parkinson's disease (PD) is a multi-systemic neurodegenerative brain disorder. Motor symptoms of PD are linked to the significant dopamine (DA) loss in substantia nigra pars compacta (SNc) followed by basal ganglia (BG) circuit dysfunction. Increasing experimental and computational evidence indicates that (synaptic) plasticity plays a key role in the emergence of PD-related pathological changes following DA loss. Spike-timing-dependent plasticity (STDP) mediated by DA provides a mechanistic model for synaptic plasticity to modify synaptic connections within the BG according to the neuronal activity. To shed light on how DA-mediated STDP can shape neuronal activity and synaptic connectivity in the PD condition, we reviewed experimental and computational findings addressing the modulatory effect of DA on STDP as well as other plasticity mechanisms and discussed their potential role in PD pathophysiology and related network dynamics and connectivity. In particular, reshaping of STDP profiles together with other plasticity-mediated processes following DA loss may abnormally modify synaptic connections in competing pathways of the BG. The cascade of plasticity-induced maladaptive or compensatory changes can impair the excitation-inhibition balance towards the BG output nuclei, leading to the emergence of pathological activity-connectivity patterns in PD. Pre-clinical, clinical as well as computational studies reviewed here provide an understanding of the impact of synaptic plasticity and other plasticity mechanisms on PD pathophysiology, especially PD-related network activity and connectivity, after DA loss. This review may provide further insights into the abnormal structure-function relationship within the BG contributing to the emergence of pathological states in PD. Specifically, this review is intended to provide detailed information for the development of computational network models for PD, serving as testbeds for the development and optimization of invasive and non-invasive brain stimulation techniques. Computationally derived hypotheses may accelerate the development of therapeutic stimulation techniques and potentially reduce the number of related animal experiments.

Clinical Efficacy and Dosing of Vibrotactile Coordinated Reset Stimulation in Motor and Non-motor Symptoms of Parkinson's Disease: A Study Protocol

Enhanced neuronal synchronization of the subthalamic nucleus (STN) is commonly found in PD patients and corresponds to decreased motor ability. Coordinated reset (CR) was developed to decouple synchronized states causing long lasting desynchronization of neural networks. Vibrotactile CR stimulation (vCR) was developed as non-invasive therapeutic that delivers gentle vibrations to the fingertips. A previous study has shown that vCR can desynchronize abnormal brain rhythms within the sensorimotor cortex of PD patients, corresponding to sustained motor relief after 3 months of daily treatment. To further develop vCR, we created a protocol that has two phases. Study 1, a double blinded randomized sham-controlled study, is designed to address motor and non-motor symptoms, sensorimotor integration, and potential calibration methods. Study 2 examines dosing effects of vCR using a remote study design. In Study 1, we will perform a 7-month double-blind sham-controlled study including 30 PD patients randomly placed into an active vCR or inactive (sham) vCR condition. Patients will receive stimulation for 4 h a day in 2-h blocks for 6 months followed by a 1-month pause in stimulation to assess long lasting effects. Our primary outcome measure is the Movement Disorders Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) part III off medication after 6 months of treatment. Secondary measures include a freezing of gait (FOG) questionnaire, objective motor evaluations, sensorimotor electroencephalography (EEG) results, a vibratory temporal discrimination task (VTDT), non-motor symptom evaluations/tests such as sleep, smell, speech, quality of life measurements and Levodopa Equivalent Daily Dose (LEDD). Patients will be evaluated at baseline, 3, 6, and 7 months. In the second, unblinded study phase (Study 2), all patients will be given the option to receive active vCR stimulation at a reduced dose for an additional 6 months remotely. The remote MDS-UPDRS part III off medication will be our primary outcome measure. Secondary measures include sleep, quality of life, objective motor evaluations, FOG and LEDD. Patients will be evaluated in the same time periods as the first study. Results from this study will provide clinical efficacy of vCR and help validate our investigational vibrotactile device for the purpose of obtaining FDA clearance. Clinical Trial Registration: ClinicalTrials.gov, identifier: NCT04877015.

Long-Term Desynchronization by Coordinated Reset Stimulation in a Neural Network Model With Synaptic and Structural Plasticity

Several brain disorders are characterized by abnormal neuronal synchronization. To specifically counteract abnormal neuronal synchrony and, hence, related symptoms, coordinated reset (CR) stimulation was computationally developed. In principle, successive epochs of synchronizing and desynchronizing stimulation may reversibly move neural networks with plastic synapses back and forth between stable regimes with synchronized and desynchronized firing. Computationally derived predictions have been verified in pre-clinical and clinical studies, paving the way for novel therapies. However, as yet, computational models were not able to reproduce the clinically observed increase of desynchronizing effects of regularly administered CR stimulation intermingled by long stimulation-free epochs. We show that this clinically important phenomenon can be computationally reproduced by taking into account structural plasticity (SP), a mechanism that deletes or generates synapses in order to homeostatically adapt the firing rates of neurons to a set point-like target firing rate in the course of days to months. If we assume that CR stimulation favorably reduces the target firing rate of SP, the desynchronizing effects of CR stimulation increase after long stimulation-free epochs, in accordance with clinically observed phenomena. Our study highlights the pivotal role of stimulation- and dosing-induced modulation of homeostatic set points in therapeutic processes.

Long-Lasting Desynchronization Effects of Coordinated Reset Stimulation Improved by Random Jitters

Abnormally strong synchronized activity is related to several neurological disorders, including essential tremor, epilepsy, and Parkinson's disease. Chronic high-frequency deep brain stimulation (HF DBS) is an established treatment for advanced Parkinson's disease. To reduce the delivered integral electrical current, novel theory-based stimulation techniques such as coordinated reset (CR) stimulation directly counteract the abnormal synchronous firing by delivering phase-shifted stimuli through multiple stimulation sites. In computational studies in neuronal networks with spike-timing-dependent plasticity (STDP), it was shown that CR stimulation down-regulates synaptic weights and drives the network into an attractor of a stable desynchronized state. This led to desynchronization effects that outlasted the stimulation. Corresponding long-lasting therapeutic effects were observed in preclinical and clinical studies. Computational studies suggest that long-lasting effects of CR stimulation depend on the adjustment of the stimulation frequency to the dominant synchronous rhythm. This may limit clinical applicability as different pathological rhythms may coexist. To increase the robustness of the long-lasting effects, we study randomized versions of CR stimulation in networks of leaky integrate-and-fire neurons with STDP. Randomization is obtained by adding random jitters to the stimulation times and by shuffling the sequence of stimulation site activations. We study the corresponding long-lasting effects using analytical calculations and computer simulations. We show that random jitters increase the robustness of long-lasting effects with respect to changes of the number of stimulation sites and the stimulation frequency. In contrast, shuffling does not increase parameter robustness of long-lasting effects. Studying the relation between acute, acute after-, and long-lasting effects of stimulation, we find that both acute after- and long-lasting effects are strongly determined by the stimulation-induced synaptic reshaping, whereas acute effects solely depend on the statistics of administered stimuli. We find that the stimulation duration is another important parameter, as effective stimulation only entails long-lasting effects after a sufficient stimulation duration. Our results show that long-lasting therapeutic effects of CR stimulation with random jitters are more robust than those of regular CR stimulation. This might reduce the parameter adjustment time in future clinical trials and make CR with random jitters more suitable for treating brain disorders with abnormal synchronization in multiple frequency bands.

Coordinated Reset Vibrotactile Stimulation Induces Sustained Cumulative Benefits in Parkinson's Disease

BACKGROUND

Abnormal synchronization of neuronal activity in dopaminergic circuits is related to motor impairment in Parkinson's disease (PD). Vibrotactile coordinated reset (vCR) fingertip stimulation aims to counteract excessive synchronization and induce sustained unlearning of pathologic synaptic connectivity and neuronal synchrony. Here, we report two clinical feasibility studies that examine the effect of regular and noisy vCR stimulation on PD motor symptoms. Additionally, in one clinical study (study 1), we examine cortical beta band power changes in the sensorimotor cortex. Lastly, we compare these clinical results in relation to our computational findings.

METHODS

Study 1 examines six PD patients receiving noisy vCR stimulation and their cortical beta power changes after 3 months of daily therapy. Motor evaluations and at-rest electroencephalographic (EEG) recordings were assessed off medication pre- and post-noisy vCR. Study 2 follows three patients for 6+ months, two of whom received daily regular vCR and one patient from study 1 who received daily noisy vCR. Motor evaluations were taken at baseline, and follow-up visits were done approximately every 3 months. Computationally, in a network of leaky integrate-and-fire (LIF) neurons with spike timing-dependent plasticity, we study the differences between regular and noisy vCR by using a stimulus model that reproduces experimentally observed central neuronal phase locking.

RESULTS

Clinically, in both studies, we observed significantly improved motor ability. EEG recordings observed from study 1 indicated a significant decrease in off-medication cortical sensorimotor high beta power (21-30 Hz) at rest after 3 months of daily noisy vCR therapy. Computationally, vCR and noisy vCR cause comparable parameter-robust long-lasting synaptic decoupling and neuronal desynchronization.

CONCLUSION

In these feasibility studies of eight PD patients, regular vCR and noisy vCR were well tolerated, produced no side effects, and delivered sustained cumulative improvement of motor performance, which is congruent with our computational findings. In study 1, reduction of high beta band power over the sensorimotor cortex may suggest noisy vCR is effectively modulating the beta band at the cortical level, which may play a role in improved motor ability. These encouraging therapeutic results enable us to properly plan a proof-of-concept study.

Treatment Tone Spacing and Acute Effects of Acoustic Coordinated Reset Stimulation in Tinnitus Patients

Acoustic coordinated reset (aCR) therapy for tinnitus aims to desynchronize neuronal populations in the auditory cortex that exhibit pathologically increased coincident firing. The original therapeutic paradigm involves fixed spacing of four low-intensity tones centered around the frequency of a tone matching the tinnitus pitch, f _T , but it is unknown whether these tones are optimally spaced for induction of desynchronization. Computational and animal studies suggest that stimulus amplitude, and relatedly, spatial stimulation profiles, of coordinated reset pulses can have a major impact on the degree of desynchronization achievable. In this study, we transform the tone spacing of aCR into a scale that takes into account the frequency selectivity of the auditory system at each therapeutic tone's center frequency via a measure called the gap index. Higher gap indices are indicative of more loosely spaced aCR tones. The gap index was found to be a significant predictor of symptomatic improvement, with larger gap indices, i.e., more loosely spaced aCR tones, resulting in reduction of tinnitus loudness and annoyance scores in the acute stimulation setting. A notable limitation of this study is the intimate relationship of hearing impairment with the gap index. Particularly, the shape of the audiogram in the vicinity of the tinnitus frequency can have a major impact on tone spacing. However, based on our findings we suggest hypotheses-based experimental protocols that may help to disentangle the impact of hearing loss and tone spacing on clinical outcome, to assess the electrophysiologic correlates of clinical improvement, and to elucidate the effects following chronic rather than acute stimulation.

The Evolution of Neuromodulation in the Treatment of Chronic Pain: Forward-Looking Perspectives

Background

The field of neuromodulation is continually evolving, with the past decade showing significant advancement in the therapeutic efficacy of neuromodulation procedures. The continued evolution of neuromodulation technology brings with it the promise of addressing the needs of both patients and physicians, as current technology improves and clinical applications expand.

Design

This review highlights the current state of the art of neuromodulation for treating chronic pain, describes key areas of development including stimulation patterns and neural targets, expanding indications and applications, feedback-controlled systems, noninvasive approaches, and biomarkers for neuromodulation and technology miniaturization.

Results and Conclusions

The field of neuromodulation is undergoing a renaissance of technology development with potential for profoundly improving the care of chronic pain patients. New and emerging targets like the dorsal root ganglion, as well as high-frequency and patterned stimulation methodologies such as burst stimulation, are paving the way for better clinical outcomes. As we look forward to the future, neural sensing, novel target-specific stimulation patterns, and approaches combining neuromodulation therapies are likely to significantly impact how neuromodulation is used. Moreover, select biomarkers may influence and guide the use of neuromodulation and help objectively demonstrate efficacy and outcomes.

Dopaminergic Modulation of Synaptic Plasticity, Its Role in Neuropsychiatric Disorders, and Its Computational Modeling

Neuromodulators modify intrinsic characteristics of the nervous system in order to reconfigure the functional properties of neural circuits. This reconfiguration is crucial for the flexibility of the nervous system to respond on an input-modulated basis. Such a functional rearrangement is realized by modification of intrinsic properties of the neural circuits including synaptic interactions. Dopamine is an important neuromodulator involved in motivation and stimulus-reward learning process, and adjusts synaptic dynamics in multiple time scales through different pathways. The modification of synaptic plasticity by dopamine underlies the change in synaptic transmission and integration mechanisms, which affects intrinsic properties of the neural system including membrane excitability, probability of neurotransmitters release, receptors’ response to neurotransmitters, protein trafficking, and gene transcription. Dopamine also plays a central role in behavioral control, whereas its malfunction can cause cognitive disorders. Impaired dopamine signaling is implicated in several neuropsychiatric disorders such as Parkinson’s disease, drug addiction, schizophrenia, attention-deficit/hyperactivity disorder, obsessive-compulsive disorder and Tourette’s syndrome. Therefore, dopamine plays a crucial role in the nervous system, where its proper modulation of neural circuits may enhance plasticity-related procedures, but disturbances in dopamine signaling might be involved in numerous neuropsychiatric disorders. In recent years, several computational models are proposed to formulate the involvement of dopamine in synaptic plasticity or neuropsychiatric disorders and address their connection based on the experimental findings.

Dendritic and Axonal Propagation Delays May Shape Neuronal Networks With Plastic Synapses

Biological neuronal networks are highly adaptive and plastic. For instance, spike-timing-dependent plasticity (STDP) is a core mechanism which adapts the synaptic strengths based on the relative timing of pre- and postsynaptic spikes. In various fields of physiology, time delays cause a plethora of biologically relevant dynamical phenomena. However, time delays increase the complexity of model systems together with the computational and theoretical analysis burden. Accordingly, in computational neuronal network studies propagation delays were often neglected. As a downside, a classic STDP rule in oscillatory neurons without propagation delays is unable to give rise to bidirectional synaptic couplings, i.e., loops or uncoupled states. This is at variance with basic experimental results. In this mini review, we focus on recent theoretical studies focusing on how things change in the presence of propagation delays. Realistic propagation delays may lead to the emergence of neuronal activity and synaptic connectivity patterns, which cannot be captured by classic STDP models. In fact, propagation delays determine the inventory of attractor states and shape their basins of attractions. The results reviewed here enable to overcome fundamental discrepancies between theory and experiments. Furthermore, these findings are relevant for the development of therapeutic brain stimulation techniques aiming at shifting the diseased brain to more favorable attractor states.

Propagation delays determine neuronal activity and synaptic connectivity patterns emerging in plastic neuronal networks

In plastic neuronal networks, the synaptic strengths are adapted to the neuronal activity. Specifically, spike-timing-dependent plasticity (STDP) is a fundamental mechanism that modifies the synaptic strengths based on the relative timing of pre- and postsynaptic spikes, taking into account the spikes' temporal order. In many studies, propagation delays were neglected to avoid additional dynamic complexity or computational costs. So far, networks equipped with a classic STDP rule typically rule out bidirectional couplings (i.e., either loops or uncoupled states) and are, hence, not able to reproduce fundamental experimental findings. In this review paper, we consider additional features, e.g., extensions of the classic STDP rule or additional aspects like noise, in order to overcome the contradictions between theory and experiment. In addition, we review in detail recent studies showing that a classic STDP rule combined with realistic propagation patterns is able to capture relevant experimental findings. In two coupled oscillatory neurons with propagation delays, bidirectional synapses can be preserved and potentiated. This result also holds for large networks of type-II phase oscillators. In addition, not only the mean of the initial distribution of synaptic weights, but also its standard deviation crucially determines the emergent structural connectivity, i.e., the mean final synaptic weight, the number of two-neuron loops, and the symmetry of the final connectivity pattern. The latter is affected by the firing rates, where more symmetric synaptic configurations emerge at higher firing rates. Finally, we discuss these findings in the context of the computational neuroscience-based development of desynchronizing brain stimulation techniques.

Delay-Induced Multistability and Loop Formation in Neuronal Networks with Spike-Timing-Dependent Plasticity

Spike-timing-dependent plasticity (STDP) adjusts synaptic strengths according to the precise timing of pre- and postsynaptic spike pairs. Theoretical and computational studies have revealed that STDP may contribute to the emergence of a variety of structural and dynamical states in plastic neuronal populations. In this manuscript, we show that by incorporating dendritic and axonal propagation delays in recurrent networks of oscillatory neurons, the asymptotic connectivity displays multistability, where different structures emerge depending on the initial distribution of the synaptic strengths. In particular, we show that the standard deviation of the initial distribution of synaptic weights, besides its mean, determines the main properties of the emergent structural connectivity such as the mean final synaptic weight, the number of two-neuron loops and the symmetry of the final structure. We also show that the firing rates of the neurons affect the evolution of the network, and a more symmetric configuration of the synapses emerges at higher firing rates. We justify the network results based on a two-neuron framework and show how the results translate to large recurrent networks.

Computationally Developed Sham Stimulation Protocol for Multichannel Desynchronizing Stimulation

A characteristic pattern of abnormal brain activity is abnormally strong neuronal synchronization, as found in several brain disorders, such as tinnitus, Parkinson's disease, and epilepsy. As observed in several diseases, different therapeutic interventions may induce a placebo effect that may be strong and hinder reliable clinical evaluations. Hence, to distinguish between specific, neuromodulation-induced effects and unspecific, placebo effects, it is important to mimic the therapeutic procedure as precisely as possibly, thereby providing controls that actually lack specific effects. Coordinated Reset (CR) stimulation has been developed to specifically counteract abnormally strong synchronization by desynchronization. CR is a spatio-temporally patterned multichannel stimulation which reduces the extent of coincident neuronal activity and aims at an anti-kindling, i.e., an unlearning of both synaptic connectivity and neuronal synchrony. Apart from acute desynchronizing effects, CR may cause sustained, long-lasting desynchronizing effects, as already demonstrated in pre-clinical and clinical proof of concept studies. In this computational study, we set out to computationally develop a sham stimulation protocol for multichannel desynchronizing stimulation. To this end, we compare acute effects and long-lasting effects of six different spatio-temporally patterned stimulation protocols, including three variants of CR, using a no-stimulation condition as additional control. This is to provide an inventory of different stimulation algorithms with similar fundamental stimulation parameters (e.g., mean stimulation rates) but qualitatively different acute and/or long-lasting effects. Stimulation protocols sharing basic parameters, but inducing nevertheless completely different or even no acute effects and/or after-effects, might serve as controls to validate the specific effects of particular desynchronizing protocols such as CR. In particular, based on our computational findings we propose a multichannel sham (i.e., inactive) stimulation protocol as control condition for phase 2 and phase 3 studies with desynchronizing multichannel stimulation techniques.

Short-Term Dosage Regimen for Stimulation-Induced Long-Lasting Desynchronization

In this paper, we computationally generate hypotheses for dose-finding studies in the context of desynchronizing neuromodulation techniques. Abnormally strong neuronal synchronization is a hallmark of several brain disorders. Coordinated Reset (CR) stimulation is a spatio-temporally patterned stimulation technique that specifically aims at disrupting abnormal neuronal synchrony. In networks with spike-timing-dependent plasticity CR stimulation may ultimately cause an anti-kindling, i.e., an unlearning of abnormal synaptic connectivity and neuronal synchrony. This long-lasting desynchronization was theoretically predicted and verified in several pre-clinical and clinical studies. We have shown that CR stimulation with rapidly varying sequences (RVS) robustly induces an anti-kindling at low intensities e.g., if the CR stimulation frequency (i.e., stimulus pattern repetition rate) is in the range of the frequency of the neuronal oscillation. In contrast, CR stimulation with slowly varying sequences (SVS) turned out to induce an anti-kindling more strongly, but less robustly with respect to variations of the CR stimulation frequency. Motivated by clinical constraints and inspired by the spacing principle of learning theory, in this computational study we propose a short-term dosage regimen that enables a robust anti-kindling effect of both RVS and SVS CR stimulation, also for those parameter values where RVS and SVS CR stimulation previously turned out to be ineffective. Intriguingly, for the vast majority of parameter values tested, spaced multishot CR stimulation with demand-controlled variation of stimulation frequency and intensity caused a robust and pronounced anti-kindling. In contrast, spaced CR stimulation with fixed stimulation parameters as well as singleshot CR stimulation of equal integral duration failed to improve the stimulation outcome. In the model network under consideration, our short-term dosage regimen enables to robustly induce long-term desynchronization at comparably short stimulation duration and low integral stimulation duration. Currently, clinical proof of concept is available for deep brain CR stimulation for Parkinson's therapy and acoustic CR stimulation for tinnitus therapy. Promising first in human data is available for vibrotactile CR stimulation for Parkinson's treatment. For the clinical development of these treatments it is mandatory to perform dose-finding studies to reveal optimal stimulation parameters and dosage regimens. Our findings can straightforwardly be tested in human dose-finding studies.