Propagation delays determine neuronal activity and synaptic connectivity patterns emerging in plastic neuronal networks

Coordinated reset stimulation of plastic neural networks with spatially dependent synaptic connections

Background

Abnormal neuronal synchrony is associated with several neurological disorders, including Parkinson's disease (PD), essential tremor, dystonia, and epilepsy. Coordinated reset (CR) stimulation was developed computationally to counteract abnormal neuronal synchrony. During CR stimulation, phase-shifted stimuli are delivered to multiple stimulation sites. Computational studies in plastic neural networks reported that CR stimulation drove the networks into an attractor of a stable desynchronized state by down-regulating synaptic connections, which led to long-lasting desynchronization effects that outlasted stimulation. Later, corresponding long-lasting desynchronization and therapeutic effects were found in animal models of PD and PD patients. To date, it is unclear how spatially dependent synaptic connections, as typically observed in the brain, shape CR-induced synaptic downregulation and long-lasting effects.

Methods

We performed numerical simulations of networks of leaky integrate-and-fire neurons with spike-timing-dependent plasticity and spatially dependent synaptic connections to study and further improve acute and long-term responses to CR stimulation.

Results

The characteristic length scale of synaptic connections relative to the distance between stimulation sites plays a key role in CR parameter adjustment. In networks with short synaptic length scales, a substantial synaptic downregulation can be achieved by selecting appropriate stimulus-related parameters, such as the stimulus amplitude and shape, regardless of the employed spatiotemporal pattern of stimulus deliveries. Complex stimulus shapes can induce local connectivity patterns in the vicinity of the stimulation sites. In contrast, in networks with longer synaptic length scales, the spatiotemporal sequence of stimulus deliveries is of major importance for synaptic downregulation. In particular, rapid shuffling of the stimulus sequence is advantageous for synaptic downregulation.

Conclusion

Our results suggest that CR stimulation parameters can be adjusted to synaptic connectivity to further improve the long-lasting effects. Furthermore, shuffling of CR sequences is advantageous for long-lasting desynchronization effects. Our work provides important hypotheses on CR parameter selection for future preclinical and clinical studies.

Synchronization of delayed coupled neurons with multiple synaptic connections

Synchronization is a key feature of the brain dynamics and is necessary for information transmission across brain regions and in higher brain functions like cognition, learning and memory. Experimental findings demonstrated that in cortical microcircuits there are multiple synapses between pairs of connected neurons. Synchronization of neurons in the presence of multiple synaptic connections may be relevant for optimal learning and memory, however, its effect on the dynamics of the neurons is not adequately studied. Here, we address the question that how changes in the strength of the synaptic connections and transmission delays between neurons impact synchronization in a two-neuron system with multiple synapses. To this end, we analytically and computationally investigated synchronization dynamics by considering both phase oscillator model and conductance-based Hodgkin-Huxley (HH) model. Our results show that symmetry/asymmetry of feedforward and feedback connections crucially determines stability of the phase locking of the system based on the strength of connections and delays. In both models, the two-neuron system with multiple synapses achieves in-phase synchrony in the presence of small and large delays, whereas an anti-phase synchronization state is favored for median delays. Our findings can expand the understanding of the functional role of multisynaptic contacts in neuronal synchronization and may shed light on the dynamical consequences of pathological multisynaptic connectivity in a number of brain disorders.

Inhibitory neurons control the consolidation of neural assemblies via adaptation to selective stimuli

Brain circuits display modular architecture at different scales of organization. Such neural assemblies are typically associated to functional specialization but the mechanisms leading to their emergence and consolidation still remain elusive. In this paper we investigate the role of inhibition in structuring new neural assemblies driven by the entrainment to various inputs. In particular, we focus on the role of partially synchronized dynamics for the creation and maintenance of structural modules in neural circuits by considering a network of excitatory and inhibitory [Formula: see text]-neurons with plastic Hebbian synapses. The learning process consists of an entrainment to temporally alternating stimuli that are applied to separate regions of the network. This entrainment leads to the emergence of modular structures. Contrary to common practice in artificial neural networks-where the acquired weights are typically frozen after the learning session-we allow for synaptic adaptation even after the learning phase. We find that the presence of inhibitory neurons in the network is crucial for the emergence and the post-learning consolidation of the modular structures. Indeed networks made of purely excitatory neurons or of neurons not respecting Dale's principle are unable to form or to maintain the modular architecture induced by the stimuli. We also demonstrate that the number of inhibitory neurons in the network is directly related to the maximal number of neural assemblies that can be consolidated, supporting the idea that inhibition has a direct impact on the memory capacity of the neural network.

Delay-dependent transitions of phase synchronization and coupling symmetry between neurons shaped by spike-timing-dependent plasticity

Synchronization plays a key role in learning and memory by facilitating the communication between neurons promoted by synaptic plasticity. Spike-timing-dependent plasticity (STDP) is a form of synaptic plasticity that modifies the strength of synaptic connections between neurons based on the coincidence of pre- and postsynaptic spikes. In this way, STDP simultaneously shapes the neuronal activity and synaptic connectivity in a feedback loop. However, transmission delays due to the physical distance between neurons affect neuronal synchronization and the symmetry of synaptic coupling. To address the question that how transmission delays and STDP can jointly determine the emergent pairwise activity-connectivity patterns, we studied phase synchronization properties and coupling symmetry between two bidirectionally coupled neurons using both phase oscillator and conductance-based neuron models. We show that depending on the range of transmission delays, the activity of the two-neuron motif can achieve an in-phase/anti-phase synchronized state and its connectivity can attain a symmetric/asymmetric coupling regime. The coevolutionary dynamics of the neuronal system and the synaptic weights due to STDP stabilizes the motif in either one of these states by transitions between in-phase/anti-phase synchronization states and symmetric/asymmetric coupling regimes at particular transmission delays. These transitions crucially depend on the phase response curve (PRC) of the neurons, but they are relatively robust to the heterogeneity of transmission delays and potentiation-depression imbalance of the STDP profile.

Decoupling of interacting neuronal populations by time-shifted stimulation through spike-timing-dependent plasticity

The synaptic organization of the brain is constantly modified by activity-dependent synaptic plasticity. In several neurological disorders, abnormal neuronal activity and pathological synaptic connectivity may significantly impair normal brain function. Reorganization of neuronal circuits by therapeutic stimulation has the potential to restore normal brain dynamics. Increasing evidence suggests that the temporal stimulation pattern crucially determines the long-lasting therapeutic effects of stimulation. Here, we tested whether a specific pattern of brain stimulation can enable the suppression of pathologically strong inter-population synaptic connectivity through spike-timing-dependent plasticity (STDP). More specifically, we tested how introducing a time shift between stimuli delivered to two interacting populations of neurons can effectively decouple them. To that end, we first used a tractable model, i.e., two bidirectionally coupled leaky integrate-and-fire (LIF) neurons, to theoretically analyze the optimal range of stimulation frequency and time shift for decoupling. We then extended our results to two reciprocally connected neuronal populations (modules) where inter-population delayed connections were modified by STDP. As predicted by the theoretical results, appropriately time-shifted stimulation causes a decoupling of the two-module system through STDP, i.e., by unlearning pathologically strong synaptic interactions between the two populations. Based on the overall topology of the connections, the decoupling of the two modules, in turn, causes a desynchronization of the populations that outlasts the cessation of stimulation. Decoupling effects of the time-shifted stimulation can be realized by time-shifted burst stimulation as well as time-shifted continuous simulation. Our results provide insight into the further optimization of a variety of multichannel stimulation protocols aiming at a therapeutic reshaping of diseased brain networks.

Efficient suppression of parkinsonian beta oscillations in a closed-loop model of deep brain stimulation with amplitude modulation

Introduction

Parkinson's disease (PD) is a movement disorder characterized by the pathological beta band (15-30 Hz) neural oscillations within the basal ganglia (BG). It is shown that the suppression of abnormal beta oscillations is correlated with the improvement of PD motor symptoms, which is a goal of standard therapies including deep brain stimulation (DBS). To overcome the stimulation-induced side effects and inefficiencies of conventional DBS (cDBS) and to reduce the administered stimulation current, closed-loop adaptive DBS (aDBS) techniques were developed. In this method, the frequency and/or amplitude of stimulation are modulated based on various disease biomarkers.

Methods

Here, by computational modeling of a cortico-BG-thalamic network in normal and PD conditions, we show that closed-loop aDBS of the subthalamic nucleus (STN) with amplitude modulation leads to a more effective suppression of pathological beta oscillations within the parkinsonian BG.

Results

Our results show that beta band neural oscillations are restored to their normal range and the reliability of the response of the thalamic neurons to motor cortex commands is retained due to aDBS with amplitude modulation. Furthermore, notably less stimulation current is administered during aDBS compared with cDBS due to a closed-loop control of stimulation amplitude based on the STN local field potential (LFP) beta activity.

Discussion

Efficient models of closed-loop stimulation may contribute to the clinical development of optimized aDBS techniques designed to reduce potential stimulation-induced side effects of cDBS in PD patients while leading to a better therapeutic outcome.

Noise-modulated multistable synapses in a Wilson-Cowan-based model of plasticity

Frequency-dependent plasticity refers to changes in synaptic strength in response to different stimulation frequencies. Resonance is a factor known to be of importance in such frequency dependence, however, the role of neural noise in the process remains elusive. Considering the brain is an inherently noisy system, understanding its effects may prove beneficial in shaping therapeutic interventions based on non-invasive brain stimulation protocols. The Wilson-Cowan (WC) model is a well-established model to describe the average dynamics of neural populations and has been shown to exhibit bistability in the presence of noise. However, the important question of how the different stable regimes in the WC model can affect synaptic plasticity when cortical populations interact has not yet been addressed. Therefore, we investigated plasticity dynamics in a WC-based model of interacting neural populations coupled with activity-dependent synapses in which a periodic stimulation was applied in the presence of noise of controlled intensity. The results indicate that for a narrow range of the noise variance, synaptic strength can be optimized. In particular, there is a regime of noise intensity for which synaptic strength presents a triple-stable state. Regulating noise intensity affects the probability that the system chooses one of the stable states, thereby controlling plasticity. These results suggest that noise is a highly influential factor in determining the outcome of plasticity induced by stimulation.

Inhibitory Spike-Timing-Dependent Plasticity Can Account for Pathological Strengthening of Pallido-Subthalamic Synapses in Parkinson's Disease

Parkinson's disease (PD) is a neurodegenerative brain disorder associated with dysfunction of the basal ganglia (BG) circuitry. Dopamine (DA) depletion in experimental PD models leads to the pathological strengthening of pallido-subthalamic synaptic connections, contributing to the emergence of abnormally synchronized neuronal activity in the external segment of the globus pallidus (GPe) and subthalamic nucleus (STN). Augmented GPe-STN transmission following loss of DA was attributed to heterosynaptic plasticity mechanisms induced by cortico-subthalamic inputs. However, synaptic plasticity may play a role in this process. Here, by employing computational modeling we show that assuming inhibitory spike-timing-dependent plasticity (iSTDP) at pallido-subthalamic synapses can account for pathological strengthening of pallido-subthalamic synapses in PD by further promoting correlated neuronal activity in the GPe-STN network. In addition, we show that GPe-STN transmission delays can shape bistable activity-connectivity states due to iSTDP, characterized by strong connectivity and strong synchronized activity (pathological states) as opposed to weak connectivity and desynchronized activity (physiological states). Our results may shed light on how abnormal reshaping of GPe-STN connectivity by synaptic plasticity during parkinsonism is related to the PD pathophysiology and contribute to the development of therapeutic brain stimulation techniques targeting plasticity-induced rewiring of network connectivity.

Optimal reinforcement learning near the edge of a synchronization transition

Recent experimental and theoretical studies have indicated that the putative criticality of cortical dynamics may correspond to a synchronization phase transition. The critical dynamics near such a critical point needs further investigation specifically when compared to the critical behavior near the standard absorbing state phase transition. Since the phenomena of learning and self-organized criticality (SOC) at the edge of synchronization transition can emerge jointly in spiking neural networks due to the presence of spike-timing dependent plasticity (STDP), it is tempting to ask the following: what is the relationship between synchronization and learning in neural networks? Further, does learning benefit from SOC at the edge of synchronization transition? In this paper, we intend to address these important issues. Accordingly, we construct a biologically inspired model of a cognitive system which learns to perform stimulus-response tasks. We train this system using a reinforcement learning rule implemented through dopamine-modulated STDP. We find that the system exhibits a continuous transition from synchronous to asynchronous neural oscillations upon increasing the average axonal time delay. We characterize the learning performance of the system and observe that it is optimized near the synchronization transition. We also study neuronal avalanches in the system and provide evidence that optimized learning is achieved in a slightly supercritical state.

The Origin of Abnormal Beta Oscillations in the Parkinsonian Corticobasal Ganglia Circuits

Parkinson's disease (PD) is a neurodegenerative brain disorder associated with motor and nonmotor symptoms. Exaggerated beta band (15–30 Hz) neuronal oscillations are widely observed in corticobasal ganglia (BG) circuits during parkinsonism. Abnormal beta oscillations have been linked to motor symptoms of PD, but their exact relationship is poorly understood. Nevertheless, reduction of beta oscillations can induce therapeutic effects in PD patients. While it is widely believed that the external globus pallidus (GPe) and subthalamic nucleus (STN) are jointly responsible for abnormal rhythmogenesis in the parkinsonian BG, the role of other cortico-BG circuits cannot be ignored. To shed light on the origin of abnormal beta oscillations in PD, here we review changes of neuronal activity observed in experimental PD models and discuss how the cortex and different BG nuclei cooperate to generate and stabilize abnormal beta oscillations during parkinsonism. This may provide further insights into the complex relationship between abnormal beta oscillations and motor dysfunction in PD, which is crucial for potential target-specific therapeutic interventions in PD patients.

Spike-Timing-Dependent Plasticity Mediated by Dopamine and its Role in Parkinson's Disease Pathophysiology

Parkinson's disease (PD) is a multi-systemic neurodegenerative brain disorder. Motor symptoms of PD are linked to the significant dopamine (DA) loss in substantia nigra pars compacta (SNc) followed by basal ganglia (BG) circuit dysfunction. Increasing experimental and computational evidence indicates that (synaptic) plasticity plays a key role in the emergence of PD-related pathological changes following DA loss. Spike-timing-dependent plasticity (STDP) mediated by DA provides a mechanistic model for synaptic plasticity to modify synaptic connections within the BG according to the neuronal activity. To shed light on how DA-mediated STDP can shape neuronal activity and synaptic connectivity in the PD condition, we reviewed experimental and computational findings addressing the modulatory effect of DA on STDP as well as other plasticity mechanisms and discussed their potential role in PD pathophysiology and related network dynamics and connectivity. In particular, reshaping of STDP profiles together with other plasticity-mediated processes following DA loss may abnormally modify synaptic connections in competing pathways of the BG. The cascade of plasticity-induced maladaptive or compensatory changes can impair the excitation-inhibition balance towards the BG output nuclei, leading to the emergence of pathological activity-connectivity patterns in PD. Pre-clinical, clinical as well as computational studies reviewed here provide an understanding of the impact of synaptic plasticity and other plasticity mechanisms on PD pathophysiology, especially PD-related network activity and connectivity, after DA loss. This review may provide further insights into the abnormal structure-function relationship within the BG contributing to the emergence of pathological states in PD. Specifically, this review is intended to provide detailed information for the development of computational network models for PD, serving as testbeds for the development and optimization of invasive and non-invasive brain stimulation techniques. Computationally derived hypotheses may accelerate the development of therapeutic stimulation techniques and potentially reduce the number of related animal experiments.

Voltage-dependent plasticity of spin-polarized conductance in phenyl-based single-molecule magnetic tunnel junctions

Synaptic strengths between neurons in brain networks are highly adaptive due to synaptic plasticity. Spike-timing-dependent plasticity (STDP) is a form of synaptic plasticity induced by temporal correlations between the firing activity of neurons. The development of experimental techniques in recent years enabled the realization of brain-inspired neuromorphic devices. Particularly, magnetic tunnel junctions (MTJs) provide a suitable means for the implementation of learning processes in molecular junctions. Here, we first considered a two-neuron motif subjected to STDP. By employing theoretical analysis and computer simulations we showed that the dynamics and emergent structure of the motif can be predicted by introducing an effective two-neuron synaptic conductance. Then, we considered a phenyl-based single-molecule MTJ connected to two ferromagnetic (FM) cobalt electrodes and investigated its electrical properties using the non-equilibrium Green’s function (NEGF) formalism. Similar to the two-neuron motif, we introduced an effective spin-polarized conductance in the MTJ. Depending on the polarity, frequency and strength of the bias voltage applied to the MTJ, the system can learn input signals by adaptive changes of the effective conductance. Interestingly, this voltage-dependent plasticity is an intrinsic property of the MTJ where its behavior is reminiscent of the classical temporally asymmetric STDP. Furthermore, the shape of voltage-dependent plasticity in the MTJ is determined by the molecule-electrode coupling strength or the length of the molecule. Our results may be relevant for the development of single-molecule devices that capture the adaptive properties of synapses in the brain.

Frequency-Resolved Functional Connectivity: Role of Delay and the Strength of Connections

The brain functional network extracted from the BOLD signals reveals the correlated activity of the different brain regions, which is hypothesized to underlie the integration of the information across functionally specialized areas. Functional networks are not static and change over time and in different brain states, enabling the nervous system to engage and disengage different local areas in specific tasks on demand. Due to the low temporal resolution, however, BOLD signals do not allow the exploration of spectral properties of the brain dynamics over different frequency bands which are known to be important in cognitive processes. Recent studies using imaging tools with a high temporal resolution has made it possible to explore the correlation between the regions at multiple frequency bands. These studies introduce the frequency as a new dimension over which the functional networks change, enabling brain networks to transmit multiplex of information at any time. In this computational study, we explore the functional connectivity at different frequency ranges and highlight the role of the distance between the nodes in their correlation. We run the generalized Kuramoto model with delayed interactions on top of the brain's connectome and show that how the transmission delay and the strength of the connections, affect the correlation between the pair of nodes over different frequency bands.

Consciousness, Redux

There have been many attempts to explain consciousness, ranging from Plato's archetypes, to Descartes' 'Mind-Body Dualism', and more recently to Chalmers' Qualia, and Andy Clarke's extended mind. Yet none of these conceptualizations of consciousness provide empiric evidence for what consciousness actually constitutes. The present hypothesis is that Consciousness is a product of the Singularity/Big Bang resulting from the endogenization of factors in the environment that have formed our physiology. Understanding the origin of consciousness as the Consciousness of the Singularity/Big Bang requires that it diachronically cuts across space-time. Consciousness functions based on the same data operating system as Cosmology. We can transcend consciousness and approach Consciousness by authoring our own software once we recognize this fundamental, mechanistic interrelationship.

Spike-Timing-Dependent Plasticity With Axonal Delay Tunes Networks of Izhikevich Neurons to the Edge of Synchronization Transition With Scale-Free Avalanches

Critical brain hypothesis has been intensively studied both in experimental and theoretical neuroscience over the past two decades. However, some important questions still remain: (i) What is the critical point the brain operates at? (ii) What is the regulatory mechanism that brings about and maintains such a critical state? (iii) The critical state is characterized by scale-invariant behavior which is seemingly at odds with definitive brain oscillations? In this work we consider a biologically motivated model of Izhikevich neuronal network with chemical synapses interacting via spike-timing-dependent plasticity (STDP) as well as axonal time delay. Under generic and physiologically relevant conditions we show that the system is organized and maintained around a synchronization transition point as opposed to an activity transition point associated with an absorbing state phase transition. However, such a state exhibits experimentally relevant signs of critical dynamics including scale-free avalanches with finite-size scaling as well as critical branching ratios. While the system displays stochastic oscillations with highly correlated fluctuations, it also displays dominant frequency modes seen as sharp peaks in the power spectrum. The role of STDP as well as time delay is crucial in achieving and maintaining such critical dynamics, while the role of inhibition is not as crucial. In this way we provide possible answers to all three questions posed above. We also show that one can achieve supercritical or subcritical dynamics if one changes the average time delay associated with axonal conduction.

Dendritic and Axonal Propagation Delays May Shape Neuronal Networks With Plastic Synapses

Biological neuronal networks are highly adaptive and plastic. For instance, spike-timing-dependent plasticity (STDP) is a core mechanism which adapts the synaptic strengths based on the relative timing of pre- and postsynaptic spikes. In various fields of physiology, time delays cause a plethora of biologically relevant dynamical phenomena. However, time delays increase the complexity of model systems together with the computational and theoretical analysis burden. Accordingly, in computational neuronal network studies propagation delays were often neglected. As a downside, a classic STDP rule in oscillatory neurons without propagation delays is unable to give rise to bidirectional synaptic couplings, i.e., loops or uncoupled states. This is at variance with basic experimental results. In this mini review, we focus on recent theoretical studies focusing on how things change in the presence of propagation delays. Realistic propagation delays may lead to the emergence of neuronal activity and synaptic connectivity patterns, which cannot be captured by classic STDP models. In fact, propagation delays determine the inventory of attractor states and shape their basins of attractions. The results reviewed here enable to overcome fundamental discrepancies between theory and experiments. Furthermore, these findings are relevant for the development of therapeutic brain stimulation techniques aiming at shifting the diseased brain to more favorable attractor states.