Refractory period in network models of excitable nodes: self-sustaining stable dynamics, extended scaling region and oscillatory behavior

Stochastic and deterministic dynamics in networks with excitable nodes

Networks of excitable systems provide a flexible and tractable model for various phenomena in biology, social sciences, and physics. A large class of such models undergo a continuous phase transition as the excitability of the nodes is increased. However, models of excitability that result in this continuous phase transition are based implicitly on the assumption that the probability that a node gets excited, its transfer function, is linear for small inputs. In this paper, we consider the effect of cooperative excitations, and more generally the case of a nonlinear transfer function, on the collective dynamics of networks of excitable systems. We find that the introduction of any amount of nonlinearity changes qualitatively the dynamical properties of the system, inducing a discontinuous phase transition and hysteresis. We develop a mean-field theory that allows us to understand the features of the dynamics with a one-dimensional map. We also study theoretically and numerically finite-size effects by examining the fate of initial conditions where only one node is excited in large but finite networks. Our results show that nonlinear transfer functions result in a rich effective phase diagram for finite networks, and that one should be careful when interpreting predictions of models that assume noncooperative excitations.

Optimal reinforcement learning near the edge of a synchronization transition

Recent experimental and theoretical studies have indicated that the putative criticality of cortical dynamics may correspond to a synchronization phase transition. The critical dynamics near such a critical point needs further investigation specifically when compared to the critical behavior near the standard absorbing state phase transition. Since the phenomena of learning and self-organized criticality (SOC) at the edge of synchronization transition can emerge jointly in spiking neural networks due to the presence of spike-timing dependent plasticity (STDP), it is tempting to ask the following: what is the relationship between synchronization and learning in neural networks? Further, does learning benefit from SOC at the edge of synchronization transition? In this paper, we intend to address these important issues. Accordingly, we construct a biologically inspired model of a cognitive system which learns to perform stimulus-response tasks. We train this system using a reinforcement learning rule implemented through dopamine-modulated STDP. We find that the system exhibits a continuous transition from synchronous to asynchronous neural oscillations upon increasing the average axonal time delay. We characterize the learning performance of the system and observe that it is optimized near the synchronization transition. We also study neuronal avalanches in the system and provide evidence that optimized learning is achieved in a slightly supercritical state.

Similar local neuronal dynamics may lead to different collective behavior

This report is concerned with the relevance of the microscopic rules that implement individual neuronal activation, in determining the collective dynamics, under variations of the network topology. To fix ideas we study the dynamics of two cellular automaton models, commonly used, rather in-distinctively, as the building blocks of large-scale neuronal networks. One model, due to Greenberg and Hastings (GH), can be described by evolution equations mimicking an integrate-and-fire process, while the other model, due to Kinouchi and Copelli (KC), represents an abstract branching process, where a single active neuron activates a given number of postsynaptic neurons according to a prescribed "activity" branching ratio. Despite the apparent similarity between the local neuronal dynamics of the two models, it is shown that they exhibit very different collective dynamics as a function of the network topology. The GH model shows qualitatively different dynamical regimes as the network topology is varied, including transients to a ground (inactive) state, continuous and discontinuous dynamical phase transitions. In contrast, the KC model only exhibits a continuous phase transition, independently of the network topology. These results highlight the importance of paying attention to the microscopic rules chosen to model the interneuronal interactions in large-scale numerical simulations, in particular when the network topology is far from a mean-field description. One such case is the extensive work being done in the context of the Human Connectome, where a wide variety of types of models are being used to understand the brain collective dynamics.

AVALANCHES IN A SHORT-MEMORY EXCITABLE NETWORK

We study propagation of avalanches in a certain excitable network. The model is a particular case of the one introduced in [24], and is mathematically equivalent to an endemic variation of the Reed-Frost epidemic model introduced in [28]. Two types of heuristic approximation are frequently used for models of this type in applications, a branching process for avalanches of a small size at the beginning of the process and a deterministic dynamical system once the avalanche spreads to a significant fraction of a large network. In this paper we prove several results concerning the exact relation between the avalanche model and these limits, including rates of convergence and rigorous bounds for common characteristics of the model.

Role of anaxonic local neurons in the crossover to continuously varying exponents for avalanche activity

Local anaxonic neurons with graded potential release are important ingredients of nervous systems, present in the olfactory bulb system of mammalians and in the human visual system, as well as in arthropods and nematodes. We develop a neuronal network model including both axonic and anaxonic neurons and monitor the activity tuned by the following parameters: the decay length of the graded potential in local neurons, the fraction of local neurons, the largest eigenvalue of the adjacency matrix, and the range of connections of the local neurons. Tuning the fraction of local neurons, we derive the phase diagram including two transition lines: a critical line separating subcritical and supercritical regions, characterized by power-law distributions of avalanche sizes and durations, and a bifurcation line. We find that the overall behavior of the system is controlled by a parameter tuning the relevance of local neuron transmission with respect to the axonal one. The statistical properties of spontaneous activity are affected by local neurons at large fractions and on the condition that the graded potential transmission dominates the axonal one. In this case the scaling properties of spontaneous activity exhibit continuously varying exponents, rather than the mean-field branching model universality class.

Spike-Timing-Dependent Plasticity With Axonal Delay Tunes Networks of Izhikevich Neurons to the Edge of Synchronization Transition With Scale-Free Avalanches

Critical brain hypothesis has been intensively studied both in experimental and theoretical neuroscience over the past two decades. However, some important questions still remain: (i) What is the critical point the brain operates at? (ii) What is the regulatory mechanism that brings about and maintains such a critical state? (iii) The critical state is characterized by scale-invariant behavior which is seemingly at odds with definitive brain oscillations? In this work we consider a biologically motivated model of Izhikevich neuronal network with chemical synapses interacting via spike-timing-dependent plasticity (STDP) as well as axonal time delay. Under generic and physiologically relevant conditions we show that the system is organized and maintained around a synchronization transition point as opposed to an activity transition point associated with an absorbing state phase transition. However, such a state exhibits experimentally relevant signs of critical dynamics including scale-free avalanches with finite-size scaling as well as critical branching ratios. While the system displays stochastic oscillations with highly correlated fluctuations, it also displays dominant frequency modes seen as sharp peaks in the power spectrum. The role of STDP as well as time delay is crucial in achieving and maintaining such critical dynamics, while the role of inhibition is not as crucial. In this way we provide possible answers to all three questions posed above. We also show that one can achieve supercritical or subcritical dynamics if one changes the average time delay associated with axonal conduction.

Coexistence of scale-invariant and rhythmic behavior in self-organized criticality

Scale-free behavior as well as oscillations are frequently observed in the activity of many natural systems. One important example is the cortical tissues of mammalian brain where both phenomena are simultaneously observed. Rhythmic oscillations as well as critical (scale-free) dynamics are thought to be important, but theoretically incompatible, features of a healthy brain. Motivated by the above, we study the possibility of the coexistence of scale-free avalanches along with rhythmic behavior within the framework of self-organized criticality. In particular, we add an oscillatory perturbation to local threshold condition of the continuous Zhang model and characterize the subsequent activity of the system. We observe regular oscillations embedded in well-defined avalanches which exhibit scale-free size and duration in line with observed neuronal avalanches. The average amplitude of such oscillations are shown to decrease with increasing frequency consistent with real brain oscillations. Furthermore, it is shown that optimal amplification of oscillations occur at the critical point, further providing evidence for functional advantages of criticality.

Beta-Rhythm Oscillations and Synchronization Transition in Network Models of Izhikevich Neurons: Effect of Topology and Synaptic Type

Despite their significant functional roles, beta-band oscillations are least understood. Synchronization in neuronal networks have attracted much attention in recent years with the main focus on transition type. Whether one obtains explosive transition or a continuous transition is an important feature of the neuronal network which can depend on network structure as well as synaptic types. In this study we consider the effect of synaptic interaction (electrical and chemical) as well as structural connectivity on synchronization transition in network models of Izhikevich neurons which spike regularly with beta rhythms. We find a wide range of behavior including continuous transition, explosive transition, as well as lack of global order. The stronger electrical synapses are more conducive to synchronization and can even lead to explosive synchronization. The key network element which determines the order of transition is found to be the clustering coefficient and not the small world effect, or the existence of hubs in a network. These results are in contrast to previous results which use phase oscillator models such as the Kuramoto model. Furthermore, we show that the patterns of synchronization changes when one goes to the gamma band. We attribute such a change to the change in the refractory period of Izhikevich neurons which changes significantly with frequency.

Robustness of functional networks at criticality against structural defects

The robustness of dynamical properties of neuronal networks against structural damages is a central problem in computational and experimental neuroscience. Research has shown that the cortical network of a healthy brain works near a critical state and, moreover, that functional neuronal networks often have scale-free and small-world properties. In this work, we study how the robustness of simple functional networks at criticality is affected by structural defects. In particular, we consider a two-dimensional Ising model at the critical temperature and investigate how its functional network changes with the increasing degree of structural defects. We show that the scale-free and small-world properties of the functional network at criticality are robust against large degrees of structural lesions while the system remains below the percolation limit. Although the Ising model is only a conceptual description of a two-state neuron, our research reveals fundamental robustness properties of functional networks derived from classical statistical mechanics models.