Frequency cluster formation and slow oscillations in neural populations with plasticity

Emergent order in adaptively rewired networks

We explore adaptive link change strategies that can lead a system to network configurations that yield ordered dynamical states. We propose two adaptive strategies based on feedback from the global synchronization error. In the first strategy, the connectivity matrix changes if the instantaneous synchronization error is larger than a prescribed threshold. In the second strategy, the probability of a link changing at any instant of time is proportional to the magnitude of the instantaneous synchronization error. We demonstrate that both these strategies are capable of guiding networks to chaos suppression within a prescribed tolerance, in two prototypical systems of coupled chaotic maps. So, the adaptation works effectively as an efficient search in the vast space of connectivities for a configuration that serves to yield a targeted pattern. The mean synchronization error shows the presence of a sharply defined transition to very low values after a critical coupling strength, in all cases. For the first strategy, the total time during which a network undergoes link adaptation also exhibits a distinct transition to a small value under increasing coupling strength. Analogously, for the second strategy, the mean fraction of links that change in the network over time, after transience, drops to nearly zero, after a critical coupling strength, implying that the network reaches a static link configuration that yields the desired dynamics. These ideas can then potentially help us to devise control methods for extended interactive systems, as well as suggest natural mechanisms capable of regularizing complex networks.

Recurrent chaotic clustering and slow chaos in adaptive networks

Adaptive dynamical networks are network systems in which the structure co-evolves and interacts with the dynamical state of the nodes. We study an adaptive dynamical network in which the structure changes on a slower time scale relative to the fast dynamics of the nodes. We identify a phenomenon we refer to as recurrent adaptive chaotic clustering (RACC), in which chaos is observed on a slow time scale, while the fast time scale exhibits regular dynamics. Such slow chaos is further characterized by long (relative to the fast time scale) regimes of frequency clusters or frequency-synchronized dynamics, interrupted by fast jumps between these regimes. We also determine parameter values where the time intervals between jumps are chaotic and show that such a state is robust to changes in parameters and initial conditions.

Disparity-driven heterogeneous nucleation in finite-size adaptive networks

Phase transitions are crucial in shaping the collective dynamics of a broad spectrum of natural systems across disciplines. Here, we report two distinct heterogeneous nucleation facilitating single step and multistep phase transitions to global synchronization in a finite-size adaptive network due to the trade off between time scale adaptation and coupling strength disparities. Specifically, small intracluster nucleations coalesce either at the population interface or within the populations resulting in the two distinct phase transitions depending on the degree of the disparities. We find that the coupling strength disparity largely controls the nature of phase transition in the phase diagram irrespective of the adaptation disparity. We provide a mesoscopic description for the cluster dynamics using the collective coordinates approach that brilliantly captures the multicluster dynamics among the populations leading to distinct phase transitions. Further, we also deduce the upper bound for the coupling strength for the existence of two intraclusters explicitly in terms of adaptation and coupling strength disparities. These insights may have implications across domains ranging from neurological disorders to segregation dynamics in social networks.

Hebbian and anti-Hebbian adaptation-induced dynamical states in adaptive networks

We investigate the interplay of an external forcing and an adaptive network, whose connection weights coevolve with the dynamical states of the phase oscillators. In particular, we consider the Hebbian and anti-Hebbian adaptation mechanisms for the evolution of the connection weights. The Hebbian adaptation manifests several interesting partially synchronized states, such as phase and frequency clusters, bump state, bump frequency phase clusters, and forced entrained clusters, in addition to the completely synchronized and forced entrained states. Anti-Hebbian adaptation facilitates the manifestation of the itinerant chimera characterized by randomly evolving coherent and incoherent domains along with some of the aforementioned dynamical states induced by the Hebbian adaptation. We introduce three distinct measures for the strength of incoherence based on the local standard deviations of the time-averaged frequency and the instantaneous phase of each oscillator, and the time-averaged mean frequency for each bin to corroborate the distinct dynamical states and to demarcate the two parameter phase diagrams. We also arrive at the existence and stability conditions for the forced entrained state using the linear stability analysis, which is found to be consistent with the simulation results.

Mean-Field Approximations With Adaptive Coupling for Networks With Spike-Timing-Dependent Plasticity

Understanding the effect of spike-timing-dependent plasticity (STDP) is key to elucidating how neural networks change over long timescales and to design interventions aimed at modulating such networks in neurological disorders. However, progress is restricted by the significant computational cost associated with simulating neural network models with STDP and by the lack of low-dimensional description that could provide analytical insights. Phase-difference-dependent plasticity (PDDP) rules approximate STDP in phase oscillator networks, which prescribe synaptic changes based on phase differences of neuron pairs rather than differences in spike timing. Here we construct mean-field approximations for phase oscillator networks with STDP to describe part of the phase space for this very high-dimensional system. We first show that single-harmonic PDDP rules can approximate a simple form of symmetric STDP, while multiharmonic rules are required to accurately approximate causal STDP. We then derive exact expressions for the evolution of the average PDDP coupling weight in terms of network synchrony. For adaptive networks of Kuramoto oscillators that form clusters, we formulate a family of low-dimensional descriptions based on the mean-field dynamics of each cluster and average coupling weights between and within clusters. Finally, we show that such a two-cluster mean-field model can be fitted to synthetic data to provide a low-dimensional approximation of a full adaptive network with symmetric STDP. Our framework represents a step toward a low-dimensional description of adaptive networks with STDP, and could for example inform the development of new therapies aimed at maximizing the long-lasting effects of brain stimulation.

Engineering spatiotemporal patterns: information encoding, processing, and controllability in oscillator ensembles

The ability to finely manipulate spatiotemporal patterns displayed in neuronal populations is critical for understanding and influencing brain functions, sleep cycles, and neurological pathologies. However, such control tasks are challenged not only by the immense scale but also by the lack of real-time state measurements of neurons in the population, which deteriorates the control performance. In this paper, we formulate the control of dynamic structures in an ensemble of neuron oscillators as a tracking problem and propose a principled control technique for designing optimal stimuli that produce desired spatiotemporal patterns in a network of interacting neurons without requiring feedback information. We further reveal an interesting presentation of information encoding and processing in a neuron ensemble in terms of its controllability property. The performance of the presented technique in creating complex spatiotemporal spiking patterns is demonstrated on neural populations described by mathematically ideal and biophysical models, including the Kuramoto and Hodgkin-Huxley models, as well as real-time experiments on Wein bridge oscillators.

Synchronization transitions in Kuramoto networks with higher-mode interaction

Synchronization is an omnipresent collective phenomenon in nature and technology, whose understanding is still elusive for real-world systems in particular. We study the synchronization transition in a phase oscillator system with two nonvanishing Fourier-modes in the interaction function, hence going beyond the Kuramoto paradigm. We show that the transition scenarios crucially depend on the interplay of the two coupling modes. We describe the multistability induced by the presence of a second coupling mode. By extending the collective coordinate approach, we describe the emergence of various states observed in the transition from incoherence to coherence. Remarkably, our analysis suggests that, in essence, the two-mode coupling gives rise to states characterized by two independent but interacting groups of oscillators. We believe that these findings will stimulate future research on dynamical systems, including complex interaction functions beyond the Kuramoto-type.

Perspectives on adaptive dynamical systems

Adaptivity is a dynamical feature that is omnipresent in nature, socio-economics, and technology. For example, adaptive couplings appear in various real-world systems, such as the power grid, social, and neural networks, and they form the backbone of closed-loop control strategies and machine learning algorithms. In this article, we provide an interdisciplinary perspective on adaptive systems. We reflect on the notion and terminology of adaptivity in different disciplines and discuss which role adaptivity plays for various fields. We highlight common open challenges and give perspectives on future research directions, looking to inspire interdisciplinary approaches.

Heterogeneous Nucleation in Finite-Size Adaptive Dynamical Networks

Phase transitions in equilibrium and nonequilibrium systems play a major role in the natural sciences. In dynamical networks, phase transitions organize qualitative changes in the collective behavior of coupled dynamical units. Adaptive dynamical networks feature a connectivity structure that changes over time, coevolving with the nodes' dynamical state. In this Letter, we show the emergence of two distinct first-order nonequilibrium phase transitions in a finite-size adaptive network of heterogeneous phase oscillators. Depending on the nature of defects in the internal frequency distribution, we observe either an abrupt single-step transition to full synchronization or a more gradual multistep transition. This observation has a striking resemblance to heterogeneous nucleation. We develop a mean-field approach to study the interplay between adaptivity and nodal heterogeneity and describe the dynamics of multicluster states and their role in determining the character of the phase transition. Our work provides a theoretical framework for studying the interplay between adaptivity and nodal heterogeneity.

Asymmetric adaptivity induces recurrent synchronization in complex networks

Rhythmic activities that alternate between coherent and incoherent phases are ubiquitous in chemical, ecological, climate, or neural systems. Despite their importance, general mechanisms for their emergence are little understood. In order to fill this gap, we present a framework for describing the emergence of recurrent synchronization in complex networks with adaptive interactions. This phenomenon is manifested at the macroscopic level by temporal episodes of coherent and incoherent dynamics that alternate recurrently. At the same time, the dynamics of the individual nodes do not change qualitatively. We identify asymmetric adaptation rules and temporal separation between the adaptation and the dynamics of individual nodes as key features for the emergence of recurrent synchronization. Our results suggest that asymmetric adaptation might be a fundamental ingredient for recurrent synchronization phenomena as seen in pattern generators, e.g., in neuronal systems.

Collective Activity Bursting in a Population of Excitable Units Adaptively Coupled to a Pool of Resources

We study the collective dynamics in a population of excitable units (neurons) adaptively interacting with a pool of resources. The resource pool is influenced by the average activity of the population, whereas the feedback from the resources to the population is comprised of components acting homogeneously or inhomogeneously on individual units of the population. Moreover, the resource pool dynamics is assumed to be slow and has an oscillatory degree of freedom. We show that the feedback loop between the population and the resources can give rise to collective activity bursting in the population. To explain the mechanisms behind this emergent phenomenon, we combine the Ott-Antonsen reduction for the collective dynamics of the population and singular perturbation theory to obtain a reduced system describing the interaction between the population mean field and the resources.

Exotic states induced by coevolving connection weights and phases in complex networks

We consider an adaptive network, whose connection weights coevolve in congruence with the dynamical states of the local nodes that are under the influence of an external stimulus. The adaptive dynamical system mimics the adaptive synaptic connections common in neuronal networks. The adaptive network under external forcing displays exotic dynamical states such as itinerant chimeras whose population density of coherent and incoherent domains coevolves with the synaptic connection, bump states, and bump frequency cluster states, which do not exist in adaptive networks without forcing. In addition, the adaptive network also exhibits partial synchronization patterns such as phase and frequency clusters, forced entrained, and incoherent states. We introduce two measures for the strength of incoherence based on the standard deviation of the temporally averaged (mean) frequency and on the mean frequency to classify the emergent dynamical states as well as their transitions. We provide a two-parameter phase diagram showing the wealth of dynamical states. We additionally deduce the stability condition for the frequency-entrained state. We use the paradigmatic Kuramoto model of phase oscillators, which is a simple generic model that has been widely employed in unraveling a plethora of cooperative phenomena in natural and man-made systems.

Modeling Tumor Disease and Sepsis by Networks of Adaptively Coupled Phase Oscillators

In this study, we provide a dynamical systems perspective to the modelling of pathological states induced by tumors or infection. A unified disease model is established using the innate immune system as the reference point. We propose a two-layer network model for carcinogenesis and sepsis based upon the interaction of parenchymal cells and immune cells via cytokines, and the co-evolutionary dynamics of parenchymal, immune cells, and cytokines. Our aim is to show that the complex cellular cooperation between parenchyma and stroma (immune layer) in the physiological and pathological case can be qualitatively and functionally described by a simple paradigmatic model of phase oscillators. By this, we explain carcinogenesis, tumor progression, and sepsis by destabilization of the healthy homeostatic state (frequency synchronized), and emergence of a pathological state (desynchronized or multifrequency cluster). The coupled dynamics of parenchymal cells (metabolism) and nonspecific immune cells (reaction of innate immune system) are represented by nodes of a duplex layer. The cytokine interaction is modeled by adaptive coupling weights between the nodes representing the immune cells (with fast adaptation time scale) and the parenchymal cells (slow adaptation time scale) and between the pairs of parenchymal and immune cells in the duplex network (fixed bidirectional coupling). Thereby, carcinogenesis, organ dysfunction in sepsis, and recurrence risk can be described in a correct functional context.

Critical Parameters in Dynamic Network Modeling of Sepsis

In this work, we propose a dynamical systems perspective on the modeling of sepsis and its organ-damaging consequences. We develop a functional two-layer network model for sepsis based upon the interaction of parenchymal cells and immune cells via cytokines, and the coevolutionary dynamics of parenchymal, immune cells, and cytokines. By means of the simple paradigmatic model of phase oscillators in a two-layer system, we analyze the emergence of organ threatening interactions between the dysregulated immune system and the parenchyma. We demonstrate that the complex cellular cooperation between parenchyma and stroma (immune layer) either in the physiological or in the pathological case can be related to dynamical patterns of the network. In this way we explain sepsis by the dysregulation of the healthy homeostatic state (frequency synchronized) leading to a pathological state (desynchronized or multifrequency cluster) in the parenchyma. We provide insight into the complex stabilizing and destabilizing interplay of parenchyma and stroma by determining critical interaction parameters. The coupled dynamics of parenchymal cells (metabolism) and nonspecific immune cells (response of the innate immune system) is represented by nodes of a duplex layer. Cytokine interaction is modeled by adaptive coupling weights between nodes representing immune cells (with fast adaptation timescale) and parenchymal cells (slow adaptation timescale), and between pairs of parenchymal and immune cells in the duplex network (fixed bidirectional coupling). The proposed model allows for a functional description of organ dysfunction in sepsis and the recurrence risk in a plausible pathophysiological context.

Generalized splay states in phase oscillator networks

Networks of coupled phase oscillators play an important role in the analysis of emergent collective phenomena. In this article, we introduce generalized m-splay states constituting a special subclass of phase-locked states with vanishing mth order parameter. Such states typically manifest incoherent dynamics, and they often create high-dimensional families of solutions (splay manifolds). For a general class of phase oscillator networks, we provide explicit linear stability conditions for splay states and exemplify our results with the well-known Kuramoto-Sakaguchi model. Importantly, our stability conditions are expressed in terms of just a few observables such as the order parameter or the trace of the Jacobian. As a result, these conditions are simple and applicable to networks of arbitrary size. We generalize our findings to phase oscillators with inertia and adaptively coupled phase oscillator models.

What adaptive neuronal networks teach us about power grids

Power grid networks, as well as neuronal networks with synaptic plasticity, describe real-world systems of tremendous importance for our daily life. The investigation of these seemingly unrelated types of dynamical networks has attracted increasing attention over the past decade. In this paper, we provide insight into the fundamental relation between these two types of networks. For this, we consider well-established models based on phase oscillators and show their intimate relation. In particular, we prove that phase oscillator models with inertia can be viewed as a particular class of adaptive networks. This relation holds even for more general classes of power grid models that include voltage dynamics. As an immediate consequence of this relation, we discover a plethora of multicluster states for phase oscillators with inertia. Moreover, the phenomenon of cascading line failure in power grids is translated into an adaptive neuronal network.

Long-Lasting Desynchronization of Plastic Neural Networks by Random Reset Stimulation

Excessive neuronal synchrony is a hallmark of neurological disorders such as epilepsy and Parkinson's disease. An established treatment for medically refractory Parkinson's disease is high-frequency (HF) deep brain stimulation (DBS). However, symptoms return shortly after cessation of HF-DBS. Recently developed decoupling stimulation approaches, such as Random Reset (RR) stimulation, specifically target pathological connections to achieve long-lasting desynchronization. During RR stimulation, a temporally and spatially randomized stimulus pattern is administered. However, spatial randomization, as presented so far, may be difficult to realize in a DBS-like setup due to insufficient spatial resolution. Motivated by recently developed segmented DBS electrodes with multiple stimulation sites, we present a RR stimulation protocol that copes with the limited spatial resolution of currently available depth electrodes for DBS. Specifically, spatial randomization is realized by delivering stimuli simultaneously to L randomly selected stimulation sites out of a total of M stimulation sites, which will be called L/M-RR stimulation. We study decoupling by L/M-RR stimulation in networks of excitatory integrate-and-fire neurons with spike-timing dependent plasticity by means of theoretical and computational analysis. We find that L/M-RR stimulation yields parameter-robust decoupling and long-lasting desynchronization. Furthermore, our theory reveals that strong high-frequency stimulation is not suitable for inducing long-lasting desynchronization effects. As a consequence, low and high frequency L/M-RR stimulation affect synaptic weights in qualitatively different ways. Our simulations confirm these predictions and show that qualitative differences between low and high frequency L/M-RR stimulation are present across a wide range of stimulation parameters, rendering stimulation with intermediate frequencies most efficient. Remarkably, we find that L/M-RR stimulation does not rely on a high spatial resolution, characterized by the density of stimulation sites in a target area, corresponding to a large M. In fact, L/M-RR stimulation with low resolution performs even better at low stimulation amplitudes. Our results provide computational evidence that L/M-RR stimulation may present a way to exploit modern segmented lead electrodes for long-lasting therapeutic effects.

Desynchronization Transitions in Adaptive Networks

Adaptive networks change their connectivity with time, depending on their dynamical state. While synchronization in structurally static networks has been studied extensively, this problem is much more challenging for adaptive networks. In this Letter, we develop the master stability approach for a large class of adaptive networks. This approach allows for reducing the synchronization problem for adaptive networks to a low-dimensional system, by decoupling topological and dynamical properties. We show how the interplay between adaptivity and network structure gives rise to the formation of stability islands. Moreover, we report a desynchronization transition and the emergence of complex partial synchronization patterns induced by an increasing overall coupling strength. We illustrate our findings using adaptive networks of coupled phase oscillators and FitzHugh-Nagumo neurons with synaptic plasticity.