Hierarchical frequency clusters in adaptive networks of phase oscillators

Coordinated reset stimulation of plastic neural networks with spatially dependent synaptic connections

Background

Abnormal neuronal synchrony is associated with several neurological disorders, including Parkinson's disease (PD), essential tremor, dystonia, and epilepsy. Coordinated reset (CR) stimulation was developed computationally to counteract abnormal neuronal synchrony. During CR stimulation, phase-shifted stimuli are delivered to multiple stimulation sites. Computational studies in plastic neural networks reported that CR stimulation drove the networks into an attractor of a stable desynchronized state by down-regulating synaptic connections, which led to long-lasting desynchronization effects that outlasted stimulation. Later, corresponding long-lasting desynchronization and therapeutic effects were found in animal models of PD and PD patients. To date, it is unclear how spatially dependent synaptic connections, as typically observed in the brain, shape CR-induced synaptic downregulation and long-lasting effects.

Methods

We performed numerical simulations of networks of leaky integrate-and-fire neurons with spike-timing-dependent plasticity and spatially dependent synaptic connections to study and further improve acute and long-term responses to CR stimulation.

Results

The characteristic length scale of synaptic connections relative to the distance between stimulation sites plays a key role in CR parameter adjustment. In networks with short synaptic length scales, a substantial synaptic downregulation can be achieved by selecting appropriate stimulus-related parameters, such as the stimulus amplitude and shape, regardless of the employed spatiotemporal pattern of stimulus deliveries. Complex stimulus shapes can induce local connectivity patterns in the vicinity of the stimulation sites. In contrast, in networks with longer synaptic length scales, the spatiotemporal sequence of stimulus deliveries is of major importance for synaptic downregulation. In particular, rapid shuffling of the stimulus sequence is advantageous for synaptic downregulation.

Conclusion

Our results suggest that CR stimulation parameters can be adjusted to synaptic connectivity to further improve the long-lasting effects. Furthermore, shuffling of CR sequences is advantageous for long-lasting desynchronization effects. Our work provides important hypotheses on CR parameter selection for future preclinical and clinical studies.

Emergence of phase clusters and coexisting states reveals the structure-function relationship

The Brain Connectome Project has made significant strides in uncovering the structural connections within the brain on various levels. This has led to the question of how brain structure and function are related. Our research explores this relationship in an adaptive neural network in which synaptic conductance between neurons follows spike-time synaptic plasticity rules. By adjusting the plasticity boundary, the network exhibits diverse collective behaviors, including phase synchronization, phase locking, hierarchical synchronization (phase clusters), and coexisting states. Using graph theory, we found that hierarchical synchronization is related to the community structure, while coexisting states are related to the hierarchical self-organizing and core-periphery structure. The network evolves into several tightly connected modules, with sparsely intermodule connections resulting in the formation of phase clusters. In addition, the hierarchical self-organizing structure facilitates the emergence of coexisting states. The coexistence state promotes the evolution of the core-periphery structure. Our results point towards the equivalence between function and structure, with function emerging from structure, and structure being influenced by function in a complex dynamic process.

Hebbian and anti-Hebbian adaptation-induced dynamical states in adaptive networks

We investigate the interplay of an external forcing and an adaptive network, whose connection weights coevolve with the dynamical states of the phase oscillators. In particular, we consider the Hebbian and anti-Hebbian adaptation mechanisms for the evolution of the connection weights. The Hebbian adaptation manifests several interesting partially synchronized states, such as phase and frequency clusters, bump state, bump frequency phase clusters, and forced entrained clusters, in addition to the completely synchronized and forced entrained states. Anti-Hebbian adaptation facilitates the manifestation of the itinerant chimera characterized by randomly evolving coherent and incoherent domains along with some of the aforementioned dynamical states induced by the Hebbian adaptation. We introduce three distinct measures for the strength of incoherence based on the local standard deviations of the time-averaged frequency and the instantaneous phase of each oscillator, and the time-averaged mean frequency for each bin to corroborate the distinct dynamical states and to demarcate the two parameter phase diagrams. We also arrive at the existence and stability conditions for the forced entrained state using the linear stability analysis, which is found to be consistent with the simulation results.

Synchronization transitions in Kuramoto networks with higher-mode interaction

Synchronization is an omnipresent collective phenomenon in nature and technology, whose understanding is still elusive for real-world systems in particular. We study the synchronization transition in a phase oscillator system with two nonvanishing Fourier-modes in the interaction function, hence going beyond the Kuramoto paradigm. We show that the transition scenarios crucially depend on the interplay of the two coupling modes. We describe the multistability induced by the presence of a second coupling mode. By extending the collective coordinate approach, we describe the emergence of various states observed in the transition from incoherence to coherence. Remarkably, our analysis suggests that, in essence, the two-mode coupling gives rise to states characterized by two independent but interacting groups of oscillators. We believe that these findings will stimulate future research on dynamical systems, including complex interaction functions beyond the Kuramoto-type.

Perspectives on adaptive dynamical systems

Adaptivity is a dynamical feature that is omnipresent in nature, socio-economics, and technology. For example, adaptive couplings appear in various real-world systems, such as the power grid, social, and neural networks, and they form the backbone of closed-loop control strategies and machine learning algorithms. In this article, we provide an interdisciplinary perspective on adaptive systems. We reflect on the notion and terminology of adaptivity in different disciplines and discuss which role adaptivity plays for various fields. We highlight common open challenges and give perspectives on future research directions, looking to inspire interdisciplinary approaches.

Transient Phase Clusters in a Two-Population Network of Kuramoto Oscillators with Heterogeneous Adaptive Interaction

Adaptive interactions are an important property of many real-word network systems. A feature of such networks is the change in their connectivity depending on the current states of the interacting elements. In this work, we study the question of how the heterogeneous character of adaptive couplings influences the emergence of new scenarios in the collective behavior of networks. Within the framework of a two-population network of coupled phase oscillators, we analyze the role of various factors of heterogeneous interaction, such as the rules of coupling adaptation and the rate of their change in the formation of various types of coherent behavior of the network. We show that various schemes of heterogeneous adaptation lead to the formation of transient phase clusters of various types.

Complex dynamics in adaptive phase oscillator networks

Networks of coupled dynamical units give rise to collective dynamics such as the synchronization of oscillators or neurons in the brain. The ability of the network to adapt coupling strengths between units in accordance with their activity arises naturally in a variety of contexts, including neural plasticity in the brain, and adds an additional layer of complexity: the dynamics on the nodes influence the dynamics of the network and vice versa. We study a minimal model of Kuramoto phase oscillators including a general adaptive learning rule with three parameters (strength of adaptivity, adaptivity offset, adaptivity shift), mimicking learning paradigms based on spike-time-dependent plasticity. Importantly, the strength of adaptivity allows to tune the system away from the limit of the classical Kuramoto model, corresponding to stationary coupling strengths and no adaptation and, thus, to systematically study the impact of adaptivity on the collective dynamics. We carry out a detailed bifurcation analysis for the minimal model consisting of N=2 oscillators. The non-adaptive Kuramoto model exhibits very simple dynamic behavior, drift, or frequency-locking; but once the strength of adaptivity exceeds a critical threshold non-trivial bifurcation structures unravel: A symmetric adaptation rule results in multi-stability and bifurcation scenarios, and an asymmetric adaptation rule generates even more intriguing and rich dynamics, including a period-doubling cascade to chaos as well as oscillations displaying features of both librations and rotations simultaneously. Generally, adaptation improves the synchronizability of the oscillators. Finally, we also numerically investigate a larger system consisting of N=50 oscillators and compare the resulting dynamics with the case of N=2 oscillators.

Inhibitory neurons control the consolidation of neural assemblies via adaptation to selective stimuli

Brain circuits display modular architecture at different scales of organization. Such neural assemblies are typically associated to functional specialization but the mechanisms leading to their emergence and consolidation still remain elusive. In this paper we investigate the role of inhibition in structuring new neural assemblies driven by the entrainment to various inputs. In particular, we focus on the role of partially synchronized dynamics for the creation and maintenance of structural modules in neural circuits by considering a network of excitatory and inhibitory [Formula: see text]-neurons with plastic Hebbian synapses. The learning process consists of an entrainment to temporally alternating stimuli that are applied to separate regions of the network. This entrainment leads to the emergence of modular structures. Contrary to common practice in artificial neural networks-where the acquired weights are typically frozen after the learning session-we allow for synaptic adaptation even after the learning phase. We find that the presence of inhibitory neurons in the network is crucial for the emergence and the post-learning consolidation of the modular structures. Indeed networks made of purely excitatory neurons or of neurons not respecting Dale's principle are unable to form or to maintain the modular architecture induced by the stimuli. We also demonstrate that the number of inhibitory neurons in the network is directly related to the maximal number of neural assemblies that can be consolidated, supporting the idea that inhibition has a direct impact on the memory capacity of the neural network.

Interlayer antisynchronization in degree-biased duplex networks

With synchronization being one of nature's most ubiquitous collective behaviors, the field of network synchronization has experienced tremendous growth, leading to significant theoretical developments. However, most previous studies consider uniform connection weights and undirected networks with positive coupling. In the present article, we incorporate the asymmetry in a two-layer multiplex network by assigning the ratio of the adjacent nodes' degrees as the weights to the intralayer edges. Despite the presence of degree-biased weighting mechanism and attractive-repulsive coupling strengths, we are able to find the necessary conditions for intralayer synchronization and interlayer antisynchronization and test whether these two macroscopic states can withstand demultiplexing in a network. During the occurrence of these two states, we analytically calculate the oscillator's amplitude. In addition to deriving the local stability conditions for interlayer antisynchronization via the master stability function approach, we also construct a suitable Lyapunov function to determine a sufficient condition for global stability. We provide numerical evidence to show the necessity of negative interlayer coupling strength for the occurrence of antisynchronization, and such repulsive interlayer coupling coefficients cannot destroy intralayer synchronization.

Heterogeneous Nucleation in Finite-Size Adaptive Dynamical Networks

Phase transitions in equilibrium and nonequilibrium systems play a major role in the natural sciences. In dynamical networks, phase transitions organize qualitative changes in the collective behavior of coupled dynamical units. Adaptive dynamical networks feature a connectivity structure that changes over time, coevolving with the nodes' dynamical state. In this Letter, we show the emergence of two distinct first-order nonequilibrium phase transitions in a finite-size adaptive network of heterogeneous phase oscillators. Depending on the nature of defects in the internal frequency distribution, we observe either an abrupt single-step transition to full synchronization or a more gradual multistep transition. This observation has a striking resemblance to heterogeneous nucleation. We develop a mean-field approach to study the interplay between adaptivity and nodal heterogeneity and describe the dynamics of multicluster states and their role in determining the character of the phase transition. Our work provides a theoretical framework for studying the interplay between adaptivity and nodal heterogeneity.

Synaptic reshaping of plastic neuronal networks by periodic multichannel stimulation with single-pulse and burst stimuli

Synaptic dysfunction is associated with several brain disorders, including Alzheimer's disease, Parkinson's disease (PD) and obsessive compulsive disorder (OCD). Utilizing synaptic plasticity, brain stimulation is capable of reshaping synaptic connectivity. This may pave the way for novel therapies that specifically counteract pathological synaptic connectivity. For instance, in PD, novel multichannel coordinated reset stimulation (CRS) was designed to counteract neuronal synchrony and down-regulate pathological synaptic connectivity. CRS was shown to entail long-lasting therapeutic aftereffects in PD patients and related animal models. This is in marked contrast to conventional deep brain stimulation (DBS) therapy, where PD symptoms return shortly after stimulation ceases. In the present paper, we study synaptic reshaping by periodic multichannel stimulation (PMCS) in networks of leaky integrate-and-fire (LIF) neurons with spike-timing-dependent plasticity (STDP). During PMCS, phase-shifted periodic stimulus trains are delivered to segregated neuronal subpopulations. Harnessing STDP, PMCS leads to changes of the synaptic network structure. We found that the PMCS-induced changes of the network structure depend on both the phase lags between stimuli and the shape of individual stimuli. Single-pulse stimuli and burst stimuli with low intraburst frequency down-regulate synapses between neurons receiving stimuli simultaneously. In contrast, burst stimuli with high intraburst frequency up-regulate these synapses. We derive theoretical approximations of the stimulation-induced network structure. This enables us to formulate stimulation strategies for inducing a variety of network structures. Our results provide testable hypotheses for future pre-clinical and clinical studies and suggest that periodic multichannel stimulation may be suitable for reshaping plastic neuronal networks to counteract pathological synaptic connectivity. Furthermore, we provide novel insight on how the stimulus type may affect the long-lasting outcome of conventional DBS. This may strongly impact parameter adjustment procedures for clinical DBS, which, so far, primarily focused on acute effects of stimulation.

Collective Activity Bursting in a Population of Excitable Units Adaptively Coupled to a Pool of Resources

We study the collective dynamics in a population of excitable units (neurons) adaptively interacting with a pool of resources. The resource pool is influenced by the average activity of the population, whereas the feedback from the resources to the population is comprised of components acting homogeneously or inhomogeneously on individual units of the population. Moreover, the resource pool dynamics is assumed to be slow and has an oscillatory degree of freedom. We show that the feedback loop between the population and the resources can give rise to collective activity bursting in the population. To explain the mechanisms behind this emergent phenomenon, we combine the Ott-Antonsen reduction for the collective dynamics of the population and singular perturbation theory to obtain a reduced system describing the interaction between the population mean field and the resources.

Exotic states induced by coevolving connection weights and phases in complex networks

We consider an adaptive network, whose connection weights coevolve in congruence with the dynamical states of the local nodes that are under the influence of an external stimulus. The adaptive dynamical system mimics the adaptive synaptic connections common in neuronal networks. The adaptive network under external forcing displays exotic dynamical states such as itinerant chimeras whose population density of coherent and incoherent domains coevolves with the synaptic connection, bump states, and bump frequency cluster states, which do not exist in adaptive networks without forcing. In addition, the adaptive network also exhibits partial synchronization patterns such as phase and frequency clusters, forced entrained, and incoherent states. We introduce two measures for the strength of incoherence based on the standard deviation of the temporally averaged (mean) frequency and on the mean frequency to classify the emergent dynamical states as well as their transitions. We provide a two-parameter phase diagram showing the wealth of dynamical states. We additionally deduce the stability condition for the frequency-entrained state. We use the paradigmatic Kuramoto model of phase oscillators, which is a simple generic model that has been widely employed in unraveling a plethora of cooperative phenomena in natural and man-made systems.

Modeling Tumor Disease and Sepsis by Networks of Adaptively Coupled Phase Oscillators

In this study, we provide a dynamical systems perspective to the modelling of pathological states induced by tumors or infection. A unified disease model is established using the innate immune system as the reference point. We propose a two-layer network model for carcinogenesis and sepsis based upon the interaction of parenchymal cells and immune cells via cytokines, and the co-evolutionary dynamics of parenchymal, immune cells, and cytokines. Our aim is to show that the complex cellular cooperation between parenchyma and stroma (immune layer) in the physiological and pathological case can be qualitatively and functionally described by a simple paradigmatic model of phase oscillators. By this, we explain carcinogenesis, tumor progression, and sepsis by destabilization of the healthy homeostatic state (frequency synchronized), and emergence of a pathological state (desynchronized or multifrequency cluster). The coupled dynamics of parenchymal cells (metabolism) and nonspecific immune cells (reaction of innate immune system) are represented by nodes of a duplex layer. The cytokine interaction is modeled by adaptive coupling weights between the nodes representing the immune cells (with fast adaptation time scale) and the parenchymal cells (slow adaptation time scale) and between the pairs of parenchymal and immune cells in the duplex network (fixed bidirectional coupling). Thereby, carcinogenesis, organ dysfunction in sepsis, and recurrence risk can be described in a correct functional context.

Critical Parameters in Dynamic Network Modeling of Sepsis

In this work, we propose a dynamical systems perspective on the modeling of sepsis and its organ-damaging consequences. We develop a functional two-layer network model for sepsis based upon the interaction of parenchymal cells and immune cells via cytokines, and the coevolutionary dynamics of parenchymal, immune cells, and cytokines. By means of the simple paradigmatic model of phase oscillators in a two-layer system, we analyze the emergence of organ threatening interactions between the dysregulated immune system and the parenchyma. We demonstrate that the complex cellular cooperation between parenchyma and stroma (immune layer) either in the physiological or in the pathological case can be related to dynamical patterns of the network. In this way we explain sepsis by the dysregulation of the healthy homeostatic state (frequency synchronized) leading to a pathological state (desynchronized or multifrequency cluster) in the parenchyma. We provide insight into the complex stabilizing and destabilizing interplay of parenchyma and stroma by determining critical interaction parameters. The coupled dynamics of parenchymal cells (metabolism) and nonspecific immune cells (response of the innate immune system) is represented by nodes of a duplex layer. Cytokine interaction is modeled by adaptive coupling weights between nodes representing immune cells (with fast adaptation timescale) and parenchymal cells (slow adaptation timescale), and between pairs of parenchymal and immune cells in the duplex network (fixed bidirectional coupling). The proposed model allows for a functional description of organ dysfunction in sepsis and the recurrence risk in a plausible pathophysiological context.

Generalized splay states in phase oscillator networks

Networks of coupled phase oscillators play an important role in the analysis of emergent collective phenomena. In this article, we introduce generalized m-splay states constituting a special subclass of phase-locked states with vanishing mth order parameter. Such states typically manifest incoherent dynamics, and they often create high-dimensional families of solutions (splay manifolds). For a general class of phase oscillator networks, we provide explicit linear stability conditions for splay states and exemplify our results with the well-known Kuramoto-Sakaguchi model. Importantly, our stability conditions are expressed in terms of just a few observables such as the order parameter or the trace of the Jacobian. As a result, these conditions are simple and applicable to networks of arbitrary size. We generalize our findings to phase oscillators with inertia and adaptively coupled phase oscillator models.

Transient circulant clusters in two-population network of Kuramoto oscillators with different rules of coupling adaptation

We considered a network consisting of two populations of phase oscillators, the interaction of which is determined by different rules for the coupling adaptation. The introduction of various adaptation rules leads to the suppression of splay states and the emergence of each population complex non-stationary behavior called transient circulant clusters. In such states, each population contains a pair of anti-phase clusters whose size and composition slowly change over time as a result of successive transitions of oscillators between clusters. We show that an increase in the mismatch of the adaptation rules makes it possible to stop the process of rearrangement of clusters in one or both populations of the network. Transitions to such modes are always preceded by the appearance of solitary states in one of the populations.

Repulsive inter-layer coupling induces anti-phase synchronization

We present numerical results for the synchronization phenomena in a bilayer network of repulsively coupled 2D lattices of van der Pol oscillators. We consider the cases when the network layers have either different or the same types of intra-layer coupling topology. When the layers are uncoupled, the lattice of van der Pol oscillators with a repulsive interaction typically demonstrates a labyrinth-like pattern, while the lattice with attractively coupled van der Pol oscillators shows a regular spiral wave structure. We reveal for the first time that repulsive inter-layer coupling leads to anti-phase synchronization of spatiotemporal structures for all considered combinations of intra-layer coupling. As a synchronization measure, we use the correlation coefficient between the symmetrical pairs of network nodes, which is always close to -1 in the case of anti-phase synchronization. We also study how the form of synchronous structures depends on the intra-layer coupling strengths when the repulsive inter-layer coupling is varied.

Self-Organized Multifrequency Clusters in an Oscillating Electrochemical System with Strong Nonlinear Coupling

We study the spatiotemporal dynamics of the oscillatory photoelectrodissolution of n-type Si in a fluoride-containing electrolyte under anodic potentials using in situ ellipsometric imaging. When lowering the illumination intensity stepwise, we successively observe uniform oscillations, modulated amplitude clusters, and the coexistence of multifrequency clusters, i.e., regions with different frequencies, with a stationary domain. We argue that the multifrequency clusters emerge due to an adaptive, nonlinear, and nonlocal coupling, similar to those found in the context of neural dynamics.

Blinking Networks of Memristor Oscillatory Circuits in the Flux-Charge Domain

Multistability phenomena and complex nonlinear dynamics in memristor oscillators pave the way to obtain efficient solutions to optimization problems by means of novel computational architectures based on the interconnection of single–device oscillators. It is well-known that topological properties of interconnections permit to control synchronization and spatio–temporal patterns in oscillatory networks. When the interconnections can change in time with a given probability to connect two oscillators, the whole network acts as a complex network with blinking couplings. The work of has shown that a particular class of blinking complex networks are able to completely synchronize in a faster fashion with respect to other coupling strategies. This work focuses on the specific class of blinking complex networks made of Memristor–based Oscillatory Circuits (MOCs). By exploiting the recent Flux–Charge Analysis Method, we make clear that synchronization phenomena in blinking networks of memristor oscillators having stochastic couplings, i.e., Blinking Memristor Oscillatory Networks (BMONs), correspond to global periodic oscillations on invariant manifolds and the effect of a blinking link is to shift the nonlinear dynamics through the infinite (invariant) manifolds. Numerical simulations performed on MOCs prove that synchronization phenomena can be controlled just by changing the coupling amongst them.

What adaptive neuronal networks teach us about power grids

Power grid networks, as well as neuronal networks with synaptic plasticity, describe real-world systems of tremendous importance for our daily life. The investigation of these seemingly unrelated types of dynamical networks has attracted increasing attention over the past decade. In this paper, we provide insight into the fundamental relation between these two types of networks. For this, we consider well-established models based on phase oscillators and show their intimate relation. In particular, we prove that phase oscillator models with inertia can be viewed as a particular class of adaptive networks. This relation holds even for more general classes of power grid models that include voltage dynamics. As an immediate consequence of this relation, we discover a plethora of multicluster states for phase oscillators with inertia. Moreover, the phenomenon of cascading line failure in power grids is translated into an adaptive neuronal network.

Desynchronization Transitions in Adaptive Networks

Adaptive networks change their connectivity with time, depending on their dynamical state. While synchronization in structurally static networks has been studied extensively, this problem is much more challenging for adaptive networks. In this Letter, we develop the master stability approach for a large class of adaptive networks. This approach allows for reducing the synchronization problem for adaptive networks to a low-dimensional system, by decoupling topological and dynamical properties. We show how the interplay between adaptivity and network structure gives rise to the formation of stability islands. Moreover, we report a desynchronization transition and the emergence of complex partial synchronization patterns induced by an increasing overall coupling strength. We illustrate our findings using adaptive networks of coupled phase oscillators and FitzHugh-Nagumo neurons with synaptic plasticity.

Introduction to Focus Issue: Symmetry and optimization in the synchronization and collective behavior of complex systems

Synchronization phenomena and collective behavior are commonplace in complex systems with applications ranging from biological processes such as coordinated neuron firings and cell cycles to the stability of alternating current power grids. A fundamental pursuit is the study of how various types of symmetry-e.g., as manifest in network structure or coupling dynamics-impact a system's collective behavior. Understanding the intricate relations between structural and dynamical symmetry/asymmetry also provides new paths to develop strategies that enhance or inhibit synchronization. Previous research has revealed symmetry as a key factor in identifying optimization mechanisms, but the particular ways that symmetry/asymmetry influence collective behavior can generally depend on the type of dynamics, networks, and form of synchronization (e.g., phase synchronization, group synchronization, and chimera states). Other factors, such as time delay, noise, time-varying structure, multilayer connections, basin stability, and transient dynamics, also play important roles, and many of these remain underexplored. This Focus Issue brings together a survey of theoretical and applied research articles that push forward this important line of questioning.

Birth and Stabilization of Phase Clusters by Multiplexing of Adaptive Networks

We propose a concept to generate and stabilize diverse partial synchronization patterns (phase clusters) in adaptive networks which are widespread in neuroscience and social sciences, as well as biology, engineering, and other disciplines. We show by theoretical analysis and computer simulations that multiplexing in a multilayer network with symmetry can induce various stable phase cluster states in a situation where they are not stable or do not even exist in the single layer. Further, we develop a method for the analysis of Laplacian matrices of multiplex networks which allows for insight into the spectral structure of these networks enabling a reduction to the stability problem of single layers. We employ the multiplex decomposition to provide analytic results for the stability of the multilayer patterns. As local dynamics we use the paradigmatic Kuramoto phase oscillator, which is a simple generic model and has been successfully applied in the modeling of synchronization phenomena in a wide range of natural and technological systems.

Frequency cluster formation and slow oscillations in neural populations with plasticity

We report the phenomenon of frequency clustering in a network of Hodgkin-Huxley neurons with spike timing-dependent plasticity. The clustering leads to a splitting of a neural population into a few groups synchronized at different frequencies. In this regime, the amplitude of the mean field undergoes low-frequency modulations, which may contribute to the mechanism of the emergence of slow oscillations of neural activity observed in spectral power of local field potentials or electroencephalographic signals at high frequencies. In addition to numerical simulations of such multi-clusters, we investigate the mechanisms of the observed phenomena using the simplest case of two clusters. In particular, we propose a phenomenological model which describes the dynamics of two clusters taking into account the adaptation of coupling weights. We also determine the set of plasticity functions (update rules), which lead to multi-clustering.