Noise-enhanced coupling between two oscillators with long-term plasticity

Adaptive coupling between neurons widens the entrainment range of the suprachiasmatic nucleus

In many realistic systems, such as neural networks in the brain, the coupling strength between neurons is not fixed, but adaptively adjusts according to their activities. The suprachiasmatic nucleus (SCN), as the main clock in the mammalian brain, has been found to be a plastic neural network, and the coupling strength between neurons is highly dynamical. An important function of the SCN is entrainment, reflecting the ability of the SCN to synchronize with the external light-dark cycle. The entrainment ability is reflected by the entrainment range, which is a period range for the external light-dark cycle to which the SCN can entrain. In this article, we investigated whether the entrainment range of the SCN is affected by the adaptive coupling. We use a modified Kuramoto model with external light-dark cycle. We found that when the light sensitivity is larger than the fixed coupling strength (the coupling strength without adaptive rules), adaptive coupling can widen the entrainment range. Our findings help to understand the impact of the adaptive coupling between oscillatorty neurons on the collective behavior of the SCN, and provides a possible explanation for the plasticity of coupling in the master clock network.

Adaptation rules inducing synchronization of heterogeneous Kuramoto oscillator network with triadic couplings

A class of adaptation functions is found for which a synchronous mode with different number of phase clusters exists in a network of phase oscillators with triadic couplings. This mode is implemented in a fairly wide range of initial conditions and the maximum number of phase clusters is four. The joint influence of coupling strength and adaptation parameters on synchronization in the network has been studied. The desynchronization transition under variation of the adaptation parameter occurs abruptly and begins with the highest-frequency oscillator, spreading hierarchically to all other elements.

Hebbian and anti-Hebbian adaptation-induced dynamical states in adaptive networks

We investigate the interplay of an external forcing and an adaptive network, whose connection weights coevolve with the dynamical states of the phase oscillators. In particular, we consider the Hebbian and anti-Hebbian adaptation mechanisms for the evolution of the connection weights. The Hebbian adaptation manifests several interesting partially synchronized states, such as phase and frequency clusters, bump state, bump frequency phase clusters, and forced entrained clusters, in addition to the completely synchronized and forced entrained states. Anti-Hebbian adaptation facilitates the manifestation of the itinerant chimera characterized by randomly evolving coherent and incoherent domains along with some of the aforementioned dynamical states induced by the Hebbian adaptation. We introduce three distinct measures for the strength of incoherence based on the local standard deviations of the time-averaged frequency and the instantaneous phase of each oscillator, and the time-averaged mean frequency for each bin to corroborate the distinct dynamical states and to demarcate the two parameter phase diagrams. We also arrive at the existence and stability conditions for the forced entrained state using the linear stability analysis, which is found to be consistent with the simulation results.

Mean-Field Approximations With Adaptive Coupling for Networks With Spike-Timing-Dependent Plasticity

Understanding the effect of spike-timing-dependent plasticity (STDP) is key to elucidating how neural networks change over long timescales and to design interventions aimed at modulating such networks in neurological disorders. However, progress is restricted by the significant computational cost associated with simulating neural network models with STDP and by the lack of low-dimensional description that could provide analytical insights. Phase-difference-dependent plasticity (PDDP) rules approximate STDP in phase oscillator networks, which prescribe synaptic changes based on phase differences of neuron pairs rather than differences in spike timing. Here we construct mean-field approximations for phase oscillator networks with STDP to describe part of the phase space for this very high-dimensional system. We first show that single-harmonic PDDP rules can approximate a simple form of symmetric STDP, while multiharmonic rules are required to accurately approximate causal STDP. We then derive exact expressions for the evolution of the average PDDP coupling weight in terms of network synchrony. For adaptive networks of Kuramoto oscillators that form clusters, we formulate a family of low-dimensional descriptions based on the mean-field dynamics of each cluster and average coupling weights between and within clusters. Finally, we show that such a two-cluster mean-field model can be fitted to synthetic data to provide a low-dimensional approximation of a full adaptive network with symmetric STDP. Our framework represents a step toward a low-dimensional description of adaptive networks with STDP, and could for example inform the development of new therapies aimed at maximizing the long-lasting effects of brain stimulation.

Synchronization transitions in Kuramoto networks with higher-mode interaction

Synchronization is an omnipresent collective phenomenon in nature and technology, whose understanding is still elusive for real-world systems in particular. We study the synchronization transition in a phase oscillator system with two nonvanishing Fourier-modes in the interaction function, hence going beyond the Kuramoto paradigm. We show that the transition scenarios crucially depend on the interplay of the two coupling modes. We describe the multistability induced by the presence of a second coupling mode. By extending the collective coordinate approach, we describe the emergence of various states observed in the transition from incoherence to coherence. Remarkably, our analysis suggests that, in essence, the two-mode coupling gives rise to states characterized by two independent but interacting groups of oscillators. We believe that these findings will stimulate future research on dynamical systems, including complex interaction functions beyond the Kuramoto-type.

Perspectives on adaptive dynamical systems

Adaptivity is a dynamical feature that is omnipresent in nature, socio-economics, and technology. For example, adaptive couplings appear in various real-world systems, such as the power grid, social, and neural networks, and they form the backbone of closed-loop control strategies and machine learning algorithms. In this article, we provide an interdisciplinary perspective on adaptive systems. We reflect on the notion and terminology of adaptivity in different disciplines and discuss which role adaptivity plays for various fields. We highlight common open challenges and give perspectives on future research directions, looking to inspire interdisciplinary approaches.

Complex dynamics in adaptive phase oscillator networks

Networks of coupled dynamical units give rise to collective dynamics such as the synchronization of oscillators or neurons in the brain. The ability of the network to adapt coupling strengths between units in accordance with their activity arises naturally in a variety of contexts, including neural plasticity in the brain, and adds an additional layer of complexity: the dynamics on the nodes influence the dynamics of the network and vice versa. We study a minimal model of Kuramoto phase oscillators including a general adaptive learning rule with three parameters (strength of adaptivity, adaptivity offset, adaptivity shift), mimicking learning paradigms based on spike-time-dependent plasticity. Importantly, the strength of adaptivity allows to tune the system away from the limit of the classical Kuramoto model, corresponding to stationary coupling strengths and no adaptation and, thus, to systematically study the impact of adaptivity on the collective dynamics. We carry out a detailed bifurcation analysis for the minimal model consisting of N=2 oscillators. The non-adaptive Kuramoto model exhibits very simple dynamic behavior, drift, or frequency-locking; but once the strength of adaptivity exceeds a critical threshold non-trivial bifurcation structures unravel: A symmetric adaptation rule results in multi-stability and bifurcation scenarios, and an asymmetric adaptation rule generates even more intriguing and rich dynamics, including a period-doubling cascade to chaos as well as oscillations displaying features of both librations and rotations simultaneously. Generally, adaptation improves the synchronizability of the oscillators. Finally, we also numerically investigate a larger system consisting of N=50 oscillators and compare the resulting dynamics with the case of N=2 oscillators.

Inhibitory neurons control the consolidation of neural assemblies via adaptation to selective stimuli

Brain circuits display modular architecture at different scales of organization. Such neural assemblies are typically associated to functional specialization but the mechanisms leading to their emergence and consolidation still remain elusive. In this paper we investigate the role of inhibition in structuring new neural assemblies driven by the entrainment to various inputs. In particular, we focus on the role of partially synchronized dynamics for the creation and maintenance of structural modules in neural circuits by considering a network of excitatory and inhibitory [Formula: see text]-neurons with plastic Hebbian synapses. The learning process consists of an entrainment to temporally alternating stimuli that are applied to separate regions of the network. This entrainment leads to the emergence of modular structures. Contrary to common practice in artificial neural networks-where the acquired weights are typically frozen after the learning session-we allow for synaptic adaptation even after the learning phase. We find that the presence of inhibitory neurons in the network is crucial for the emergence and the post-learning consolidation of the modular structures. Indeed networks made of purely excitatory neurons or of neurons not respecting Dale's principle are unable to form or to maintain the modular architecture induced by the stimuli. We also demonstrate that the number of inhibitory neurons in the network is directly related to the maximal number of neural assemblies that can be consolidated, supporting the idea that inhibition has a direct impact on the memory capacity of the neural network.

Heterogeneous Nucleation in Finite-Size Adaptive Dynamical Networks

Phase transitions in equilibrium and nonequilibrium systems play a major role in the natural sciences. In dynamical networks, phase transitions organize qualitative changes in the collective behavior of coupled dynamical units. Adaptive dynamical networks feature a connectivity structure that changes over time, coevolving with the nodes' dynamical state. In this Letter, we show the emergence of two distinct first-order nonequilibrium phase transitions in a finite-size adaptive network of heterogeneous phase oscillators. Depending on the nature of defects in the internal frequency distribution, we observe either an abrupt single-step transition to full synchronization or a more gradual multistep transition. This observation has a striking resemblance to heterogeneous nucleation. We develop a mean-field approach to study the interplay between adaptivity and nodal heterogeneity and describe the dynamics of multicluster states and their role in determining the character of the phase transition. Our work provides a theoretical framework for studying the interplay between adaptivity and nodal heterogeneity.

Interplay of different synchronization modes and synaptic plasticity in a system of class I neurons

We analyze the effect of spike-timing-dependent plasticity (STDP) on a system of pulse-coupled class I neurons. Our research begins with a system of two mutually connected quadratic integrate-and-fire (QIF) neurons, which are canonical representatives of class I neurons. Along with various asymptotic modes previously observed in other neuronal models with plastic synapses, we found a stable synchronous mode characterized by unidirectional link from a slower neuron to a faster neuron. In this frequency-locked mode, the faster neuron emits multiple spikes per cycle of the slower neuron. We analytically obtain the Arnold tongues for this mode without STDP and with STDP. We also consider larger plastic networks of QIF neurons and show that the detected mode can manifest itself in such a way that slow neurons become pacemakers. As a result, slow and fast neurons can form large synchronous clusters that generate low-frequency oscillations. We demonstrate the generality of the results obtained with two connected QIF neurons using Wang-Buzsáki and Morris-Lecar biophysically plausible class I neuron models.

Dynamics of phase oscillator networks with synaptic weight and structural plasticity

We study the dynamics of Kuramoto oscillator networks with two distinct adaptation processes, one varying the coupling strengths and the other altering the network structure. Such systems model certain networks of oscillatory neurons where the neuronal dynamics, synaptic weights, and network structure interact with and shape each other. We model synaptic weight adaptation with spike-timing-dependent plasticity (STDP) that runs on a longer time scale than neuronal spiking. Structural changes that include addition and elimination of contacts occur at yet a longer time scale than the weight adaptations. First, we study the steady-state dynamics of Kuramoto networks that are bistable and can settle in synchronized or desynchronized states. To compare the impact of adding structural plasticity, we contrast the network with only STDP to one with a combination of STDP and structural plasticity. We show that the inclusion of structural plasticity optimizes the synchronized state of a network by allowing for synchronization with fewer links than a network with STDP alone. With non-identical units in the network, the addition of structural plasticity leads to the emergence of correlations between the oscillators' natural frequencies and node degrees. In the desynchronized regime, the structural plasticity decreases the number of contacts, leading to a sparse network. In this way, adding structural plasticity strengthens both synchronized and desynchronized states of a network. Second, we use desynchronizing coordinated reset stimulation and synchronizing periodic stimulation to induce desynchronized and synchronized states, respectively. Our findings indicate that a network with a combination of STDP and structural plasticity may require stronger and longer stimulation to switch between the states than a network with STDP only.

Critical Parameters in Dynamic Network Modeling of Sepsis

In this work, we propose a dynamical systems perspective on the modeling of sepsis and its organ-damaging consequences. We develop a functional two-layer network model for sepsis based upon the interaction of parenchymal cells and immune cells via cytokines, and the coevolutionary dynamics of parenchymal, immune cells, and cytokines. By means of the simple paradigmatic model of phase oscillators in a two-layer system, we analyze the emergence of organ threatening interactions between the dysregulated immune system and the parenchyma. We demonstrate that the complex cellular cooperation between parenchyma and stroma (immune layer) either in the physiological or in the pathological case can be related to dynamical patterns of the network. In this way we explain sepsis by the dysregulation of the healthy homeostatic state (frequency synchronized) leading to a pathological state (desynchronized or multifrequency cluster) in the parenchyma. We provide insight into the complex stabilizing and destabilizing interplay of parenchyma and stroma by determining critical interaction parameters. The coupled dynamics of parenchymal cells (metabolism) and nonspecific immune cells (response of the innate immune system) is represented by nodes of a duplex layer. Cytokine interaction is modeled by adaptive coupling weights between nodes representing immune cells (with fast adaptation timescale) and parenchymal cells (slow adaptation timescale), and between pairs of parenchymal and immune cells in the duplex network (fixed bidirectional coupling). The proposed model allows for a functional description of organ dysfunction in sepsis and the recurrence risk in a plausible pathophysiological context.

Spontaneous dynamics of synaptic weights in stochastic models with pair-based spike-timing-dependent plasticity

We investigate spike-timing dependent plasticity (STPD) in the case of a synapse connecting two neuronal cells. We develop a theoretical analysis of several STDP rules using Markovian theory. In this context there are two different timescales, fast neuronal activity and slower synaptic weight updates. Exploiting this timescale separation, we derive the long-time limits of a single synaptic weight subject to STDP. We show that the pairing model of presynaptic and postsynaptic spikes controls the synaptic weight dynamics for small external input on an excitatory synapse. This result implies in particular that mean-field analysis of plasticity may miss some important properties of STDP. Anti-Hebbian STDP favors the emergence of a stable synaptic weight. In the case of an inhibitory synapse the pairing schemes matter less, and we observe convergence of the synaptic weight to a nonnull value only for Hebbian STDP. We extensively study different asymptotic regimes for STDP rules, raising interesting questions for future work on adaptative neuronal networks and, more generally, on adaptative systems.

Collective Activity Bursting in a Population of Excitable Units Adaptively Coupled to a Pool of Resources

We study the collective dynamics in a population of excitable units (neurons) adaptively interacting with a pool of resources. The resource pool is influenced by the average activity of the population, whereas the feedback from the resources to the population is comprised of components acting homogeneously or inhomogeneously on individual units of the population. Moreover, the resource pool dynamics is assumed to be slow and has an oscillatory degree of freedom. We show that the feedback loop between the population and the resources can give rise to collective activity bursting in the population. To explain the mechanisms behind this emergent phenomenon, we combine the Ott-Antonsen reduction for the collective dynamics of the population and singular perturbation theory to obtain a reduced system describing the interaction between the population mean field and the resources.

Exotic states induced by coevolving connection weights and phases in complex networks

We consider an adaptive network, whose connection weights coevolve in congruence with the dynamical states of the local nodes that are under the influence of an external stimulus. The adaptive dynamical system mimics the adaptive synaptic connections common in neuronal networks. The adaptive network under external forcing displays exotic dynamical states such as itinerant chimeras whose population density of coherent and incoherent domains coevolves with the synaptic connection, bump states, and bump frequency cluster states, which do not exist in adaptive networks without forcing. In addition, the adaptive network also exhibits partial synchronization patterns such as phase and frequency clusters, forced entrained, and incoherent states. We introduce two measures for the strength of incoherence based on the standard deviation of the temporally averaged (mean) frequency and on the mean frequency to classify the emergent dynamical states as well as their transitions. We provide a two-parameter phase diagram showing the wealth of dynamical states. We additionally deduce the stability condition for the frequency-entrained state. We use the paradigmatic Kuramoto model of phase oscillators, which is a simple generic model that has been widely employed in unraveling a plethora of cooperative phenomena in natural and man-made systems.

Modeling Tumor Disease and Sepsis by Networks of Adaptively Coupled Phase Oscillators

In this study, we provide a dynamical systems perspective to the modelling of pathological states induced by tumors or infection. A unified disease model is established using the innate immune system as the reference point. We propose a two-layer network model for carcinogenesis and sepsis based upon the interaction of parenchymal cells and immune cells via cytokines, and the co-evolutionary dynamics of parenchymal, immune cells, and cytokines. Our aim is to show that the complex cellular cooperation between parenchyma and stroma (immune layer) in the physiological and pathological case can be qualitatively and functionally described by a simple paradigmatic model of phase oscillators. By this, we explain carcinogenesis, tumor progression, and sepsis by destabilization of the healthy homeostatic state (frequency synchronized), and emergence of a pathological state (desynchronized or multifrequency cluster). The coupled dynamics of parenchymal cells (metabolism) and nonspecific immune cells (reaction of innate immune system) are represented by nodes of a duplex layer. The cytokine interaction is modeled by adaptive coupling weights between the nodes representing the immune cells (with fast adaptation time scale) and the parenchymal cells (slow adaptation time scale) and between the pairs of parenchymal and immune cells in the duplex network (fixed bidirectional coupling). Thereby, carcinogenesis, organ dysfunction in sepsis, and recurrence risk can be described in a correct functional context.

Numerical Simulation: Fluctuation in Background Synaptic Activity Regulates Synaptic Plasticity

Synaptic plasticity is vital for learning and memory in the brain. It consists of long-term potentiation (LTP) and long-term depression (LTD). Spike frequency is one of the major components of synaptic plasticity in the brain, a noisy environment. Recently, we mathematically analyzed the frequency-dependent synaptic plasticity (FDP) in vivo and found that LTP is more likely to occur with an increase in the frequency of background synaptic activity. Meanwhile, previous studies suggest statistical fluctuation in the amplitude of background synaptic activity. Little is understood, however, about its contribution to synaptic plasticity. To address this issue, we performed numerical simulations of a calcium-based synapse model. Then, we found attenuation of the tendency to become LTD due to an increase in the fluctuation of background synaptic activity, leading to an enhancement of synaptic weight. Our result suggests that the fluctuation affects synaptic plasticity in the brain.

Generalized splay states in phase oscillator networks

Networks of coupled phase oscillators play an important role in the analysis of emergent collective phenomena. In this article, we introduce generalized m-splay states constituting a special subclass of phase-locked states with vanishing mth order parameter. Such states typically manifest incoherent dynamics, and they often create high-dimensional families of solutions (splay manifolds). For a general class of phase oscillator networks, we provide explicit linear stability conditions for splay states and exemplify our results with the well-known Kuramoto-Sakaguchi model. Importantly, our stability conditions are expressed in terms of just a few observables such as the order parameter or the trace of the Jacobian. As a result, these conditions are simple and applicable to networks of arbitrary size. We generalize our findings to phase oscillators with inertia and adaptively coupled phase oscillator models.

Multistability in a star network of Kuramoto-type oscillators with synaptic plasticity

We analyze multistability in a star-type network of phase oscillators with coupling weights governed by phase-difference-dependent plasticity. It is shown that a network with N leaves can evolve into \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^N$$\end{document}2N various asymptotic states, characterized by different values of the coupling strength between the hub and the leaves. Starting from the simple case of two coupled oscillators, we develop an analytical approach based on two small parameters \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varepsilon$$\end{document}ε and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mu$$\end{document}μ, where \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varepsilon$$\end{document}ε is the ratio of the time scales of the phase variables and synaptic weights, and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mu$$\end{document}μ defines the sharpness of the plasticity boundary function. The limit \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mu \rightarrow 0$$\end{document}μ→0 corresponds to a hard boundary. The analytical results obtained on the model of two oscillators are generalized for multi-leaf star networks. Multistability with \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^N$$\end{document}2N various asymptotic states is numerically demonstrated for one-, two-, three- and nine-leaf star-type networks.

What adaptive neuronal networks teach us about power grids

Power grid networks, as well as neuronal networks with synaptic plasticity, describe real-world systems of tremendous importance for our daily life. The investigation of these seemingly unrelated types of dynamical networks has attracted increasing attention over the past decade. In this paper, we provide insight into the fundamental relation between these two types of networks. For this, we consider well-established models based on phase oscillators and show their intimate relation. In particular, we prove that phase oscillator models with inertia can be viewed as a particular class of adaptive networks. This relation holds even for more general classes of power grid models that include voltage dynamics. As an immediate consequence of this relation, we discover a plethora of multicluster states for phase oscillators with inertia. Moreover, the phenomenon of cascading line failure in power grids is translated into an adaptive neuronal network.

Desynchronization Transitions in Adaptive Networks

Adaptive networks change their connectivity with time, depending on their dynamical state. While synchronization in structurally static networks has been studied extensively, this problem is much more challenging for adaptive networks. In this Letter, we develop the master stability approach for a large class of adaptive networks. This approach allows for reducing the synchronization problem for adaptive networks to a low-dimensional system, by decoupling topological and dynamical properties. We show how the interplay between adaptivity and network structure gives rise to the formation of stability islands. Moreover, we report a desynchronization transition and the emergence of complex partial synchronization patterns induced by an increasing overall coupling strength. We illustrate our findings using adaptive networks of coupled phase oscillators and FitzHugh-Nagumo neurons with synaptic plasticity.

Dynamics of a stochastic excitable system with slowly adapting feedback

We study an excitable active rotator with slowly adapting nonlinear feedback and noise. Depending on the adaptation and the noise level, this system may display noise-induced spiking, noise-perturbed oscillations, or stochastic bursting. We show how the system exhibits transitions between these dynamical regimes, as well as how one can enhance or suppress the coherence resonance or effectively control the features of the stochastic bursting. The setup can be considered a paradigmatic model for a neuron with a slow recovery variable or, more generally, as an excitable system under the influence of a nonlinear control mechanism. We employ a multiple timescale approach that combines the classical adiabatic elimination with averaging of rapid oscillations and stochastic averaging of noise-induced fluctuations by a corresponding stationary Fokker-Planck equation. This allows us to perform a numerical bifurcation analysis of a reduced slow system and to determine the parameter regions associated with different types of dynamics. In particular, we demonstrate the existence of a region of bistability, where the noise-induced switching between a stationary and an oscillatory regime gives rise to stochastic bursting.

Two paradigmatic scenarios for inverse stochastic resonance

Inverse stochastic resonance comprises a nonlinear response of an oscillatory system to noise where the frequency of noise-perturbed oscillations becomes minimal at an intermediate noise level. We demonstrate two generic scenarios for inverse stochastic resonance by considering a paradigmatic model of two adaptively coupled stochastic active rotators whose local dynamics is close to a bifurcation threshold. In the first scenario, shown for the two rotators in the excitable regime, inverse stochastic resonance emerges due to a biased switching between the oscillatory and the quasi-stationary metastable states derived from the attractors of the noiseless system. In the second scenario, illustrated for the rotators in the oscillatory regime, inverse stochastic resonance arises due to a trapping effect associated with a noise-enhanced stability of an unstable fixed point. The details of the mechanisms behind the resonant effect are explained in terms of slow-fast analysis of the corresponding noiseless systems.

Birth and Stabilization of Phase Clusters by Multiplexing of Adaptive Networks

We propose a concept to generate and stabilize diverse partial synchronization patterns (phase clusters) in adaptive networks which are widespread in neuroscience and social sciences, as well as biology, engineering, and other disciplines. We show by theoretical analysis and computer simulations that multiplexing in a multilayer network with symmetry can induce various stable phase cluster states in a situation where they are not stable or do not even exist in the single layer. Further, we develop a method for the analysis of Laplacian matrices of multiplex networks which allows for insight into the spectral structure of these networks enabling a reduction to the stability problem of single layers. We employ the multiplex decomposition to provide analytic results for the stability of the multilayer patterns. As local dynamics we use the paradigmatic Kuramoto phase oscillator, which is a simple generic model and has been successfully applied in the modeling of synchronization phenomena in a wide range of natural and technological systems.

Frequency cluster formation and slow oscillations in neural populations with plasticity

We report the phenomenon of frequency clustering in a network of Hodgkin-Huxley neurons with spike timing-dependent plasticity. The clustering leads to a splitting of a neural population into a few groups synchronized at different frequencies. In this regime, the amplitude of the mean field undergoes low-frequency modulations, which may contribute to the mechanism of the emergence of slow oscillations of neural activity observed in spectral power of local field potentials or electroencephalographic signals at high frequencies. In addition to numerical simulations of such multi-clusters, we investigate the mechanisms of the observed phenomena using the simplest case of two clusters. In particular, we propose a phenomenological model which describes the dynamics of two clusters taking into account the adaptation of coupling weights. We also determine the set of plasticity functions (update rules), which lead to multi-clustering.

Hierarchical frequency clusters in adaptive networks of phase oscillators

Adaptive dynamical networks appear in various real-word systems. One of the simplest phenomenological models for investigating basic properties of adaptive networks is the system of coupled phase oscillators with adaptive couplings. In this paper, we investigate the dynamics of this system. We extend recent results on the appearance of hierarchical frequency multiclusters by investigating the effect of the time scale separation. We show that the slow adaptation in comparison with the fast phase dynamics is necessary for the emergence of the multiclusters and their stability. Additionally, we study the role of double antipodal clusters, which appear to be unstable for all considered parameter values. We show that such states can be observed for a relatively long time, i.e., they are metastable. A geometrical explanation for such an effect is based on the emergence of a heteroclinic orbit.

Dendritic and Axonal Propagation Delays May Shape Neuronal Networks With Plastic Synapses

Biological neuronal networks are highly adaptive and plastic. For instance, spike-timing-dependent plasticity (STDP) is a core mechanism which adapts the synaptic strengths based on the relative timing of pre- and postsynaptic spikes. In various fields of physiology, time delays cause a plethora of biologically relevant dynamical phenomena. However, time delays increase the complexity of model systems together with the computational and theoretical analysis burden. Accordingly, in computational neuronal network studies propagation delays were often neglected. As a downside, a classic STDP rule in oscillatory neurons without propagation delays is unable to give rise to bidirectional synaptic couplings, i.e., loops or uncoupled states. This is at variance with basic experimental results. In this mini review, we focus on recent theoretical studies focusing on how things change in the presence of propagation delays. Realistic propagation delays may lead to the emergence of neuronal activity and synaptic connectivity patterns, which cannot be captured by classic STDP models. In fact, propagation delays determine the inventory of attractor states and shape their basins of attractions. The results reviewed here enable to overcome fundamental discrepancies between theory and experiments. Furthermore, these findings are relevant for the development of therapeutic brain stimulation techniques aiming at shifting the diseased brain to more favorable attractor states.

Propagation delays determine neuronal activity and synaptic connectivity patterns emerging in plastic neuronal networks

In plastic neuronal networks, the synaptic strengths are adapted to the neuronal activity. Specifically, spike-timing-dependent plasticity (STDP) is a fundamental mechanism that modifies the synaptic strengths based on the relative timing of pre- and postsynaptic spikes, taking into account the spikes' temporal order. In many studies, propagation delays were neglected to avoid additional dynamic complexity or computational costs. So far, networks equipped with a classic STDP rule typically rule out bidirectional couplings (i.e., either loops or uncoupled states) and are, hence, not able to reproduce fundamental experimental findings. In this review paper, we consider additional features, e.g., extensions of the classic STDP rule or additional aspects like noise, in order to overcome the contradictions between theory and experiment. In addition, we review in detail recent studies showing that a classic STDP rule combined with realistic propagation patterns is able to capture relevant experimental findings. In two coupled oscillatory neurons with propagation delays, bidirectional synapses can be preserved and potentiated. This result also holds for large networks of type-II phase oscillators. In addition, not only the mean of the initial distribution of synaptic weights, but also its standard deviation crucially determines the emergent structural connectivity, i.e., the mean final synaptic weight, the number of two-neuron loops, and the symmetry of the final connectivity pattern. The latter is affected by the firing rates, where more symmetric synaptic configurations emerge at higher firing rates. Finally, we discuss these findings in the context of the computational neuroscience-based development of desynchronizing brain stimulation techniques.

Delay-Induced Multistability and Loop Formation in Neuronal Networks with Spike-Timing-Dependent Plasticity

Spike-timing-dependent plasticity (STDP) adjusts synaptic strengths according to the precise timing of pre- and postsynaptic spike pairs. Theoretical and computational studies have revealed that STDP may contribute to the emergence of a variety of structural and dynamical states in plastic neuronal populations. In this manuscript, we show that by incorporating dendritic and axonal propagation delays in recurrent networks of oscillatory neurons, the asymptotic connectivity displays multistability, where different structures emerge depending on the initial distribution of the synaptic strengths. In particular, we show that the standard deviation of the initial distribution of synaptic weights, besides its mean, determines the main properties of the emergent structural connectivity such as the mean final synaptic weight, the number of two-neuron loops and the symmetry of the final structure. We also show that the firing rates of the neurons affect the evolution of the network, and a more symmetric configuration of the synapses emerges at higher firing rates. We justify the network results based on a two-neuron framework and show how the results translate to large recurrent networks.

Modulation of neuronal dynamic range using two different adaptation mechanisms

The capability of neurons to discriminate between intensity of external stimulus is measured by its dynamic range. A larger dynamic range indicates a greater probability of neuronal survival. In this study, the potential roles of adaptation mechanisms (ion currents) in modulating neuronal dynamic range were numerically investigated. Based on the adaptive exponential integrate-and-fire model, which includes two different adaptation mechanisms, i.e. subthreshold and suprathreshold (spike-triggered) adaptation, our results reveal that the two adaptation mechanisms exhibit rather different roles in regulating neuronal dynamic range. Specifically, subthreshold adaptation acts as a negative factor that observably decreases the neuronal dynamic range, while suprathreshold adaptation has little influence on the neuronal dynamic range. Moreover, when stochastic noise was introduced into the adaptation mechanisms, the dynamic range was apparently enhanced, regardless of what state the neuron was in, e.g. adaptive or non-adaptive. Our model results suggested that the neuronal dynamic range can be differentially modulated by different adaptation mechanisms. Additionally, noise was a non-ignorable factor, which could effectively modulate the neuronal dynamic range.

Dendritic and Axonal Propagation Delays Determine Emergent Structures of Neuronal Networks with Plastic Synapses

Spike-timing-dependent plasticity (STDP) modifies synaptic strengths based on the relative timing of pre- and postsynaptic spikes. The temporal order of spikes turned out to be crucial. We here take into account how propagation delays, composed of dendritic and axonal delay times, may affect the temporal order of spikes. In a minimal setting, characterized by neglecting dendritic and axonal propagation delays, STDP eliminates bidirectional connections between two coupled neurons and turns them into unidirectional connections. In this paper, however, we show that depending on the dendritic and axonal propagation delays, the temporal order of spikes at the synapses can be different from those in the cell bodies and, consequently, qualitatively different connectivity patterns emerge. In particular, we show that for a system of two coupled oscillatory neurons, bidirectional synapses can be preserved and potentiated. Intriguingly, this finding also translates to large networks of type-II phase oscillators and, hence, crucially impacts on the overall hierarchical connectivity patterns of oscillatory neuronal networks.