Multistability in recurrent neural loops arising from delay

Existence and Stability Criteria for Global Synchrony and for Synchrony in two Alternating Clusters of Pulse-Coupled Oscillators Updated to Include Conduction Delays

Phase Response Curves (PRCs) have been useful in determining and analyzing various phase-locking modes in networks of oscillators under pulse-coupling assumptions, as reviewed in Mathematical Biosciences, 226:77-96, 2010. Here, we update that review to include progress since 2010 on pulse coupled oscillators with conduction delays. We then present original results that extend the derivation of the criteria for stability of global synchrony in networks of pulse-coupled oscillators to include conduction delays. We also incorporate conduction delays to extend previous studies that showed how an alternating firing pattern between two synchronized clusters could enforce within cluster synchrony, even for clusters unable to synchronize themselves in isolation. To obtain these results, we used self-connected neurons to represent clusters. These results greatly extend the applicability of the stability analyses to networks of pulse-coupled oscillators since conduction delays are ubiquitous and strongly impact the stability of synchrony. Although these analyses only strictly apply to identical oscillators with identical connections to other oscillators, the principles are general and suggest how to promote or impede synchrony in physiological networks of neurons, for example. Heterogeneity can be interpreted as a form of frozen noise, and approximate synchrony can be sustained despite heterogeneity. The pulse-coupled oscillator model can not only be used to describe biological neuronal networks but also cardiac pacemakers, lasers, fireflies, artificial neural networks, social self-organization, and wireless sensor networks.

AMS Subject Classification

37N25, 39A06, 39A30, 92B25, 92C20.

Optimal phase-based control of strongly perturbed limit cycle oscillators using phase reduction techniques

Phase reduction is a well-established technique for analysis and control of weakly perturbed limit cycle oscillators. However, its accuracy is diminished in a strongly perturbed setting where information about the amplitude dynamics must also be considered. In this paper, we consider phase-based control of general limit cycle oscillators in both weakly and strongly perturbed regimes. For use at the strongly perturbed end of the continuum, we propose a strategy for optimal phase control of general limit cycle oscillators that uses an adaptive phase-amplitude reduced order model in conjunction with dynamic programming. This strategy can accommodate large magnitude inputs at the expense of requiring additional dimensions in the reduced order equations, thereby increasing the computational complexity. We apply this strategy to two biologically motivated prototype problems and provide direct comparisons to two related phase-based control algorithms. In situations where other commonly used strategies fail due to the application of large magnitude inputs, the adaptive phase-amplitude reduction provides a viable reduced order model while still yielding a computationally tractable control problem. These results highlight the need for discernment in reduced order model selection for limit cycle oscillators to balance the trade-off between accuracy and dimensionality.

Noise-induced switching in an oscillator with pulse delayed feedback: A discrete stochastic modeling approach

We study the dynamics of an oscillatory system with pulse delayed feedback and noise of two types: (i) phase noise acting on the oscillator and (ii) stochastic fluctuations of the feedback delay. Using an event-based approach, we reduce the system dynamics to a stochastic discrete map. For weak noise, we find that the oscillator fluctuates around a deterministic state, and we derive an autoregressive model describing the system dynamics. For stronger noise, the oscillator demonstrates noise-induced switching between various deterministic states; our theory provides a good estimate of the switching statistics in the linear limit. We show that the robustness of the system toward this switching is strikingly different depending on the type of noise. We compare the analytical results for linear coupling to numerical simulations of nonlinear coupling and find that the linear model also provides a qualitative explanation for the differences in robustness to both types of noise. Moreover, phase noise drives the system toward higher frequencies, while stochastic delays do not, and we relate this effect to our theoretical results.

Robust spike timing in an excitable cell with delayed feedback

The initiation and regeneration of pulsatile activity is a ubiquitous feature observed in excitable systems with delayed feedback. Here, we demonstrate this phenomenon in a real biological cell. We establish a critical role of the delay resulting from the finite propagation speed of electrical impulses in the emergence of persistent multiple-spike patterns. We predict the coexistence of a number of such patterns in a mathematical model and use a biological cell subject to dynamic clamp to confirm our predictions in a living mammalian system. Given the general nature of our mathematical model and experimental system, we believe that our results capture key hallmarks of physiological excitability that are fundamental to information processing.

Spontaneous transitions to focal-onset epileptic seizures: A dynamical study

Given the complex temporal evolution of epileptic seizures, understanding their dynamic nature might be beneficial for clinical diagnosis and treatment. Yet, the mechanisms behind, for instance, the onset of seizures are still unknown. According to an existing classification, two basic types of dynamic onset patterns plus a number of more complex onset waveforms can be distinguished. Here, we introduce a basic three-variable model with two time scales to study potential mechanisms of spontaneous seizure onset. We expand the model to demonstrate how coupling of oscillators leads to more complex seizure onset waveforms. Finally, we test the response to pulse perturbation as a potential biomarker of interictal changes.

An integrate-and-fire model for pulsatility in the neuroendocrine system

A model for pulsatility in neuroendocrine regulation is proposed which combines Goodwin-type feedback control with impulsive input from neurons located in the hypothalamus. The impulsive neural input is modeled using an integrate-and-fire mechanism; namely, inputs are generated only when the membrane potential crosses a threshold, after which it is reset to baseline. The resultant model takes the form of a functional-differential equation with continuous and impulsive components. Despite the impulsive nature of the inputs, realistic hormone profiles are generated, including ultradian and circadian rhythms, pulsatile secretory patterns, and even chaotic dynamics.

Mode Hopping in Oscillating Systems with Stochastic Delays

We study a noisy oscillator with pulse delayed feedback, theoretically and in an electronic experimental implementation. Without noise, this system has multiple stable periodic regimes. We consider two types of noise: (i) phase noise acting on the oscillator state variable and (ii) stochastic fluctuations of the coupling delay. For both types of stochastic perturbations the system hops between the deterministic regimes, but it shows dramatically different scaling properties for different types of noise. The robustness to conventional phase noise increases with coupling strength. However for stochastic variations in the coupling delay, the lifetimes decrease exponentially with the coupling strength. We provide an analytic explanation for these scaling properties in a linearized model. Our findings thus indicate that the robustness of a system to stochastic perturbations strongly depends on the nature of these perturbations.

A data-driven phase and isostable reduced modeling framework for oscillatory dynamical systems

Phase-amplitude reduction is of growing interest as a strategy for the reduction and analysis of oscillatory dynamical systems. Augmentation of the widely studied phase reduction with amplitude coordinates can be used to characterize transient behavior in directions transverse to a limit cycle to give a richer description of the dynamical behavior. Various definitions for amplitude coordinates have been suggested, but none are particularly well suited for implementation in experimental systems where output recordings are readily available but the underlying equations are typically unknown. In this work, a reduction framework is developed for inferring a phase-amplitude reduced model using only the observed model output from an arbitrarily high-dimensional system. This framework employs a proper orthogonal reduction strategy to identify important features of the transient decay of solutions to the limit cycle. These features are explicitly related to previously developed phase and isostable coordinates and used to define so-called data-driven phase and isostable coordinates that are valid in the entire basin of attraction of a limit cycle. The utility of this reduction strategy is illustrated in examples related to neural physiology and is used to implement an optimal control strategy that would otherwise be computationally intractable. The proposed data-driven phase and isostable coordinate system and associated reduced modeling framework represent a useful tool for the study of nonlinear dynamical systems in situations where the underlying dynamical equations are unknown and in particularly high-dimensional or complicated numerical systems for which standard phase-amplitude reduction techniques are not computationally feasible.

Outgrowing seizures in Childhood Absence Epilepsy: time delays and bistability

We formulate a conductance-based model for a 3-neuron motif associated with Childhood Absence Epilepsy (CAE). The motif consists of neurons from the thalamic relay (TC) and reticular nuclei (RT) and the cortex (CT). We focus on a genetic defect common to the mouse homolog of CAE which is associated with loss of GABA_A receptors on the TC neuron, and the fact that myelination of axons as children age can increase the conduction velocity between neurons. We show the combination of low GABA_A mediated inhibition of TC neurons and the long corticothalamic loop delay gives rise to a variety of complex dynamics in the motif, including bistability. This bistability disappears as the corticothalamic conduction delay shortens even though GABA_A activity remains impaired. Thus the combination of deficient GABA_A activity and changing axonal myelination in the corticothalamic loop may be sufficient to account for the clinical course of CAE.

Isostable reduction of oscillators with piecewise smooth dynamics and complex Floquet multipliers

Phase-amplitude reduction is a widely applied technique in the study of limit cycle oscillators with the ability to represent a complicated and high-dimensional dynamical system in a more analytically tractable set of coordinates. Recent work has focused on the use of isostable coordinates, which characterize the transient decay of solutions toward a periodic orbit, and can ultimately be used to increase the accuracy of these reduced models. The breadth of systems to which this phase-amplitude reduction strategy can be applied, however, is still rather limited. In this work, the theory of phase-amplitude reduction using isostable coordinates is further developed to accommodate a broader set of dynamical systems. In the first part, limit cycles of piecewise smooth dynamical systems are considered and strategies are developed to compute the associated reduced equations. In the second part, the notion of isostable coordinates for complex-valued Floquet multipliers is introduced, resulting in one phaselike coordinate and one amplitudelike coordinate for each pair of complex conjugate Floquet multipliers. Examples are given with relevance to piecewise smooth representations of excitable cardiomyocytes and the relationship between the reduced coordinate system and the emergence of cardiac alternans is discussed. Also, phase-amplitude reduction is implemented for a chaotic, externally forced pendulum with complex Floquet multipliers and a resulting control strategy for the stabilization of its periodic solution is investigated.

Propensity for Bistability of Bursting and Silence in the Leech Heart Interneuron

The coexistence of neuronal activity regimes has been reported under normal and pathological conditions. Such multistability could enhance the flexibility of the nervous system and has many implications for motor control, memory, and decision making. Multistability is commonly promoted by neuromodulation targeting specific membrane ionic currents. Here, we investigated how modulation of different ionic currents could affect the neuronal propensity for bistability. We considered a leech heart interneuron model. It exhibits bistability of bursting and silence in a narrow range of the leak current parameters, conductance (g_leak) and reversal potential (E_leak). We assessed the propensity for bistability of the model by using bifurcation diagrams. On the diagram (g_leak, E_leak), we mapped bursting and silent regimes. For the canonical value of E_leak we determined the range of g_leak which supported the bistability. We use this range as an index of propensity for bistability. We investigated how this index was affected by alterations of ionic currents. We systematically changed their conductances, one at a time, and built corresponding bifurcation diagrams in parameter planes of the maximal conductance of a given current and the leak conductance. We found that conductance of only one current substantially affected the index of propensity; the increase of the maximal conductance of the hyperpolarization-activated cationic current increased the propensity index. The second conductance with the strongest effect was the conductance of the low-threshold fast Ca²⁺ current; its reduction increased the propensity index although the effect was about two times smaller in magnitude. Analyzing the model with both changes applied simultaneously, we found that the diagram (g_leak, E_leak) showed a progressively expanded area of bistability of bursting and silence.

Embedding the dynamics of a single delay system into a feed-forward ring

We investigate the relation between the dynamics of a single oscillator with delayed self-feedback and a feed-forward ring of such oscillators, where each unit is coupled to its next neighbor in the same way as in the self-feedback case. We show that periodic solutions of the delayed oscillator give rise to families of rotating waves with different wave numbers in the corresponding ring. In particular, if for the single oscillator the periodic solution is resonant to the delay, it can be embedded into a ring with instantaneous couplings. We discover several cases where the stability of a periodic solution for the single unit can be related to the stability of the corresponding rotating wave in the ring. As a specific example, we demonstrate how the complex bifurcation scenario of simultaneously emerging multijittering solutions can be transferred from a single oscillator with delayed pulse feedback to multijittering rotating waves in a sufficiently large ring of oscillators with instantaneous pulse coupling. Finally, we present an experimental realization of this dynamical phenomenon in a system of coupled electronic circuits of FitzHugh-Nagumo type.

Jittering waves in rings of pulse oscillators

Rings of oscillators with delayed pulse coupling are studied analytically, numerically, and experimentally. The basic regimes observed in such rings are rotating waves with constant interspike intervals and phase lags between the neighbors. We show that these rotating waves may destabilize leading to the so-called jittering waves. For these regimes, the interspike intervals are no more equal but form a periodic sequence in time. Analytic criterion for the emergence of jittering waves is derived and confirmed by the numerical and experimental data. The obtained results contribute to the hypothesis that the multijitter instability is universal in systems with pulse coupling.

Emergence and combinatorial accumulation of jittering regimes in spiking oscillators with delayed feedback

Interaction via pulses is common in many natural systems, especially neuronal. In this article we study one of the simplest possible systems with pulse interaction: a phase oscillator with delayed pulsatile feedback. When the oscillator reaches a specific state, it emits a pulse, which returns after propagating through a delay line. The impact of an incoming pulse is described by the oscillator's phase reset curve (PRC). In such a system we discover an unexpected phenomenon: for a sufficiently steep slope of the PRC, a periodic regular spiking solution bifurcates with several multipliers crossing the unit circle at the same parameter value. The number of such critical multipliers increases linearly with the delay and thus may be arbitrary large. This bifurcation is accompanied by the emergence of numerous "jittering" regimes with nonequal interspike intervals (ISIs). Each of these regimes corresponds to a periodic solution of the system with a period roughly proportional to the delay. The number of different "jittering" solutions emerging at the bifurcation point increases exponentially with the delay. We describe the combinatorial mechanism that underlies the emergence of such a variety of solutions. In particular, we show how a periodic solution exhibiting several distinct ISIs can imply the existence of multiple other solutions obtained by rearranging of these ISIs. We show that the theoretical results for phase oscillators accurately predict the behavior of an experimentally implemented electronic oscillator with pulsatile feedback.

Multistable jittering in oscillators with pulsatile delayed feedback

Oscillatory systems with time-delayed pulsatile feedback appear in various applied and theoretical research areas, and received a growing interest in recent years. For such systems, we report a remarkable scenario of destabilization of a periodic regular spiking regime. At the bifurcation point numerous regimes with nonequal interspike intervals emerge. We show that the number of the emerging, so-called "jittering" regimes grows exponentially with the delay value. Although this appears as highly degenerate from a dynamical systems viewpoint, the "multijitter" bifurcation occurs robustly in a large class of systems. We observe it not only in a paradigmatic phase-reduced model, but also in a simulated Hodgkin-Huxley neuron model and in an experiment with an electronic circuit.

Towards a complex system understanding of bipolar disorder: A map based model of a complex winnerless competition

Bipolar disorder is characterized by repeated erratic episodes of mania and depression, which can be understood as pathological complex system behavior involving cognitive, affective and psychomotor disturbance. In order to illuminate dynamical aspects of the longitudinal course of the illness, we propose here a novel complex model based on the notion of competition between recurrent maps, which mathematically represent the dynamics of activation in excitatory (Glutamatergic) and inhibitory (GABAergic) pathways. We assume that manic and depressive states can be considered stable sub attractors of a dynamical system through which the mood trajectory moves. The model provides a theoretical framework which can account for a number of complex phenomena of bipolar disorder, including intermittent transition between the two poles of the disorder, rapid and ultra-rapid cycling of episodes and manicogenic effects of antidepressants.

Design of charge-balanced time-optimal stimuli for spiking neuron oscillators

In this letter, we investigate the fundamental limits on how the interspike time of a neuron oscillator can be perturbed by the application of a bounded external control input (a current stimulus) with zero net electric charge accumulation. We use phase models to study the dynamics of neurons and derive charge-balanced controls that achieve the minimum and maximum interspike times for a given bound on the control amplitude. Our derivation is valid for any arbitrary shape of the phase response curve and for any value of the given control amplitude bound. In addition, we characterize the change in the structures of the charge-balanced time-optimal controls with the allowable control amplitude. We demonstrate the applicability of the derived optimal control laws by applying them to mathematically ideal and experimentally observed neuron phase models, including the widely studied Hodgkin-Huxley phase model, and by verifying them with the corresponding original full state-space models. This work addresses a fundamental problem in the field of neural control and provides a theoretical investigation to the optimal control of oscillatory systems.

On the nature of seizure dynamics

Seizures can occur spontaneously and in a recurrent manner, which defines epilepsy; or they can be induced in a normal brain under a variety of conditions in most neuronal networks and species from flies to humans. Such universality raises the possibility that invariant properties exist that characterize seizures under different physiological and pathological conditions. Here, we analysed seizure dynamics mathematically and established a taxonomy of seizures based on first principles. For the predominant seizure class we developed a generic model called Epileptor. As an experimental model system, we used ictal-like discharges induced in vitro in mouse hippocampi. We show that only five state variables linked by integral-differential equations are sufficient to describe the onset, time course and offset of ictal-like discharges as well as their recurrence. Two state variables are responsible for generating rapid discharges (fast time scale), two for spike and wave events (intermediate time scale) and one for the control of time course, including the alternation between 'normal' and ictal periods (slow time scale). We propose that normal and ictal activities coexist: a separatrix acts as a barrier (or seizure threshold) between these states. Seizure onset is reached upon the collision of normal brain trajectories with the separatrix. We show theoretically and experimentally how a system can be pushed toward seizure under a wide variety of conditions. Within our experimental model, the onset and offset of ictal-like discharges are well-defined mathematical events: a saddle-node and homoclinic bifurcation, respectively. These bifurcations necessitate a baseline shift at onset and a logarithmic scaling of interspike intervals at offset. These predictions were not only confirmed in our in vitro experiments, but also for focal seizures recorded in different syndromes, brain regions and species (humans and zebrafish). Finally, we identified several possible biophysical parameters contributing to the five state variables in our model system. We show that these parameters apply to specific experimental conditions and propose that there exists a wide array of possible biophysical mechanisms for seizure genesis, while preserving central invariant properties. Epileptor and the seizure taxonomy will guide future modeling and translational research by identifying universal rules governing the initiation and termination of seizures and predicting the conditions necessary for those transitions.

Emergence of metastable state dynamics in interconnected cortical networks with propagation delays

The importance of the large number of thin-diameter and unmyelinated axons that connect different cortical areas is unknown. The pronounced propagation delays in these axons may prevent synchronization of cortical networks and therefore hinder efficient information integration and processing. Yet, such global information integration across cortical areas is vital for higher cognitive function. We hypothesized that delays in communication between cortical areas can disrupt synchronization and therefore enhance the set of activity trajectories and computations interconnected networks can perform. To evaluate this hypothesis, we studied the effect of long-range cortical projections with propagation delays in interconnected large-scale cortical networks that exhibited spontaneous rhythmic activity. Long-range connections with delays caused the emergence of metastable, spatio-temporally distinct activity states between which the networks spontaneously transitioned. Interestingly, the observed activity patterns correspond to macroscopic network dynamics such as globally synchronized activity, propagating wave fronts, and spiral waves that have been previously observed in neurophysiological recordings from humans and animal models. Transient perturbations with simulated transcranial alternating current stimulation (tACS) confirmed the multistability of the interconnected networks by switching the networks between these metastable states. Our model thus proposes that slower long-range connections enrich the landscape of activity states and represent a parsimonious mechanism for the emergence of multistability in cortical networks. These results further provide a mechanistic link between the known deficits in connectivity and cortical state dynamics in neuropsychiatric illnesses such as schizophrenia and autism, as well as suggest non-invasive brain stimulation as an effective treatment for these illnesses.

Coherence, phase differences, phase shift, and phase lock in EEG/ERP analyses

Electroencephalogram (EEG) coherence is a mixture of phase locking interrupted by phase shifts in the spontaneous EEG. Average reference, Laplacian transforms, and independent component (ICA) reconstruction of time series can distort physiologically generated phase differences and invalidate the computation of coherence and phase differences as well as in the computation of directed coherence and phase reset. Time domain measures of phase shift and phase lock are less prone to artifact and are independent of volume conduction. Cross-frequency synchrony in the surface EEG and in Low Resolution Electromagnetic Tomography (LORETA) provides insights into dynamic functions of the brain.

Reciprocal inhibition and slow calcium decay in perigeniculate interneurons explain changes of spontaneous firing of thalamic cells caused by cortical inactivation

The role of cortical feedback in the thalamocortical processing loop has been extensively investigated over the last decades. With an exception of several cases, these searches focused on the cortical feedback exerted onto thalamo-cortical relay (TC) cells of the dorsal lateral geniculate nucleus (LGN). In a previous, physiological study, we showed in the cat visual system that cessation of cortical input, despite decrease of spontaneous activity of TC cells, increased spontaneous firing of their recurrent inhibitory interneurons located in the perigeniculate nucleus (PGN). To identify mechanisms underlying such functional changes we conducted a modeling study in NEURON on several networks of point neurons with varied model parameters, such as membrane properties, synaptic weights and axonal delays. We considered six network topologies of the retino-geniculo-cortical system. All models were robust against changes of axonal delays except for the delay between the LGN feed-forward interneuron and the TC cell. The best representation of physiological results was obtained with models containing reciprocally connected PGN cells driven by the cortex and with relatively slow decay of intracellular calcium. This strongly indicates that the thalamic reticular nucleus plays an essential role in the cortical influence over thalamo-cortical relay cells while the thalamic feed-forward interneurons are not essential in this process. Further, we suggest that the dependence of the activity of PGN cells on the rate of calcium removal can be one of the key factors determining individual cell response to elimination of cortical input.

Neuronal avalanches, epileptic quakes and other transient forms of neurodynamics

Power-law behaviors in brain activity in healthy animals, in the form of neuronal avalanches, potentially benefit the computational activities of the brain, including information storage, transmission and processing. In contrast, power-law behaviors associated with seizures, in the form of epileptic quakes, potentially interfere with the brain's computational activities. This review draws attention to the potential roles played by homeostatic mechanisms and multistable time-delayed recurrent inhibitory loops in the generation of power-law phenomena. Moreover, it is suggested that distinctions between health and disease are scale-dependent. In other words, what is abnormal and defines disease it is not the propagation of neural activity but the propagation of activity in a neural population that is large enough to interfere with the normal activities of the brain. From this point of view, epilepsy is a disease that results from a failure of mechanisms, possibly located in part in the cortex itself or in the deep brain nuclei and brainstem, which truncate or otherwise confine the spatiotemporal scales of these power-law phenomena.

Stability switches and multistability coexistence in a delay-coupled neural oscillators system

In this paper, we present a neural network system composed of two delay-coupled neural oscillators, where each of these can be regarded as the dynamical system describing the average activity of neural population. Analyzing the corresponding characteristic equation, the local stability of rest state is studied. The system exhibits the switch phenomenon between the rest state and periodic activity. Furthermore, the Hopf bifurcation is analyzed and the bifurcation curve is given in the parameters plane. The stability of the bifurcating periodic solutions and direction of the Hopf bifurcation are exhibited. Regarding time delay and coupled weight as the bifurcation parameters, the Fold-Hopf bifurcation is investigated in detail in terms of the central manifold reduction and normal form method. The neural system demonstrates the coexistence of the rest states and periodic activities in the different parameter regions. Employing the normal form of the original system, the coexistence regions are illustrated approximately near the Fold-Hopf singularity point. Finally, numerical simulations are performed to display more complex dynamics. The results illustrate that system may exhibit the rich coexistence of the different neuro-computational properties, such as the rest states, periodic activities, and quasi-periodic behavior. In particular, some periodic activities can evolve into the bursting-type behaviors with the varying time delay. It implies that the coexistence of the quasi-periodic activity and bursting-type behavior can be obtained if the suitable value of system parameter is chosen.

Neural assembly computing

Spiking neurons can realize several computational operations when firing cooperatively. This is a prevalent notion, although the mechanisms are not yet understood. A way by which neural assemblies compute is proposed in this paper. It is shown how neural coalitions represent things (and world states), memorize them, and control their hierarchical relations in order to perform algorithms. It is described how neural groups perform statistic logic functions as they form assemblies. Neural coalitions can reverberate, becoming bistable loops. Such bistable neural assemblies become short- or long-term memories that represent the event that triggers them. In addition, assemblies can branch and dismantle other neural groups generating new events that trigger other coalitions. Hence, such capabilities and the interaction among assemblies allow neural networks to create and control hierarchical cascades of causal activities, giving rise to parallel algorithms. Computing and algorithms are used here as in a nonstandard computation approach. In this sense, neural assembly computing (NAC) can be seen as a new class of spiking neural network machines. NAC can explain the following points: 1) how neuron groups represent things and states; 2) how they retain binary states in memories that do not require any plasticity mechanism; and 3) how branching, disbanding, and interaction among assemblies may result in algorithms and behavioral responses. Simulations were carried out and the results are in agreement with the hypothesis presented. A MATLAB code is available as a supplementary material.

Nonlinear dynamics of the membrane potential of a bursting pacemaker cell

This article presents the results of an exploration of one two-parameter space of the Chay model of a cell excitable membrane. There are two main regions: a peripheral one, where the system dynamics will relax to an equilibrium point, and a central one where the expected dynamics is oscillatory. In the second region, we observe a variety of self-sustained oscillations including periodic oscillation, as well as bursting dynamics of different types. These oscillatory dynamics can be observed as periodic oscillations with different periodicities, and in some cases, as chaotic dynamics. These results, when displayed in bifurcation diagrams, result in complex bifurcation structures, which have been suggested as relevant to understand biological cell signaling.

Effect of duration of synaptic activity on spike rate of a Hodgkin-Huxley neuron with delayed feedback

A recurrent loop consisting of a single Hodgkin-Huxley neuron influenced by a chemical excitatory delayed synaptic feedback is considered. We show that the behavior of the system depends on the duration of the activity of the synapse, which is determined by the activation and deactivation time constants of the synapse. For the fast synapses, those for which the effect of the synaptic activity is small compared to the period of firing, depending on the delay time, spiking with single and multiple interspike intervals is possible and the average firing rate can be smaller or larger than that of the open loop neuron. For slow synapses for which the synaptic time constants are of order of the period of the firing, the self-excitation increases the firing rate for all values of the delay time. We also show that for a chain consisting of few similar oscillators, if the synapses are chosen from different time constants, the system will follow the dynamics imposed by the fastest element, which is the oscillator that receives excitations via a slow synapse. The generalization of the results to other types of relaxation oscillators is discussed and the results are compared to those of the loops with inhibitory synapses as well as with gap junctions.

Variability of spatio-temporal patterns in non-homogeneous rings of spiking neurons

We show that a ring of unidirectionally delay-coupled spiking neurons may possess a multitude of stable spiking patterns and provide a constructive algorithm for generating a desired spiking pattern. More specifically, for a given time-periodic pattern, in which each neuron fires once within the pattern period at a predefined time moment, we provide the coupling delays and/or coupling strengths leading to this particular pattern. The considered homogeneous networks demonstrate a great multistability of various travelling time- and space-periodic waves which can propagate either along the direction of coupling or in opposite direction. Such a multistability significantly enhances the variability of possible spatio-temporal patterns and potentially increases the coding capability of oscillatory neuronal loops. We illustrate our results using FitzHugh-Nagumo neurons interacting via excitatory chemical synapses as well as limit-cycle oscillators.

The delayed and noisy nervous system: implications for neural control

Recent advances in the study of delay differential equations draw attention to the potential benefits of the interplay between random perturbations ('noise') and delay in neural control. The phenomena include transient stabilizations of unstable steady states by noise, control of fast movements using time-delayed feedback and the occurrence of long-lived delay-induced transients. In particular, this research suggests that the interplay between noise and delay necessitates the use of intermittent, discontinuous control strategies in which corrective movements are made only when controlled variables cross certain thresholds. A potential benefit of such strategies is that they may be optimal for minimizing energy expenditures associated with control. In this paper, the concepts are made accessible by introducing them through simple illustrative examples that can be readily reproduced using software packages, such as XPPAUT.

Effects of conduction delays on the existence and stability of one to one phase locking between two pulse-coupled oscillators

Gamma oscillations can synchronize with near zero phase lag over multiple cortical regions and between hemispheres, and between two distal sites in hippocampal slices. How synchronization can take place over long distances in a stable manner is considered an open question. The phase resetting curve (PRC) keeps track of how much an input advances or delays the next spike, depending upon where in the cycle it is received. We use PRCs under the assumption of pulsatile coupling to derive existence and stability criteria for 1:1 phase-locking that arises via bidirectional pulse coupling of two limit cycle oscillators with a conduction delay of any duration for any 1:1 firing pattern. The coupling can be strong as long as the effect of one input dissipates before the next input is received. We show the form that the generic synchronous and anti-phase solutions take in a system of two identical, identically pulse-coupled oscillators with identical delays. The stability criterion has a simple form that depends only on the slopes of the PRCs at the phases at which inputs are received and on the number of cycles required to complete the delayed feedback loop. The number of cycles required to complete the delayed feedback loop depends upon both the value of the delay and the firing pattern. We successfully tested the predictions of our methods on networks of model neurons. The criteria can easily be extended to include the effect of an input on the cycle after the one in which it is received.

Challenges for emerging neurostimulation-based therapies for real-time seizure control

In step with the worthwhile aim of this special issue, two junior investigators impart their insights on the therapeutic challenges imposed by pharmacoresistant epilepsies and offer viable approaches to improvement of treatment outcomes. Sunderam's comprehensive perspective addresses issues of critical importance for the design of efficacious therapies. Talathi delves into the thorny roles of so-called "interictal" spikes in ictio- and epileptogenesis, roles that are central to understanding the dynamics of these phenomena and implicitly of how to prevent them or abort them. First, however, Osorio and co-workers illustrate the complex behavior of the epileptogenic network and point to the importance of real-time intraindividual adaptation and optimization of therapies for seizures originating from the same epileptogenic network.

Optimal design of minimum-power stimuli for phase models of neuron oscillators

In this paper, we study optimal control problems of spiking neurons whose dynamics are described by a phase model. We design minimum-power current stimuli (controls) that lead to targeted spiking times. In particular, we consider bounded control amplitude and characterize the range of possible spiking times determined by the bound, which can be chosen sufficiently small within the range where the phase model is valid. We show that for a given bound the corresponding feasible spiking times are optimally achieved by piecewise continuous controls. We present analytic expressions with numerical simulations of the minimum-power stimuli for several phase models. We demonstrate the applicability of our method with an experimentally determined phase response curve.

Robust convergence in pulse-coupled oscillators with delays

We show that for pulse-coupled oscillators a class of phase response curves with both excitation and inhibition exhibit robust convergence to synchrony on arbitrary aperiodic connected graphs with delays. We describe the basins of convergence and give explicit bounds on the convergence times. These results provide new and more robust methods for synchronization of sensor nets and also have biological implications.

Co-existent activity patterns in inhibitory neuronal networks with short-term synaptic depression

A network of two neurons mutually coupled through inhibitory synapses that display short-term synaptic depression is considered. We show that synaptic depression expands the number of possible activity patterns that the network can display and allows for co-existence of different patterns. Specifically, the network supports different types of n-m anti-phase firing patterns, where one neuron fires n spikes followed by the other neuron firing m spikes. When maximal synaptic conductances are identical, n-n anti-phase firing patterns are obtained and there are conductance intervals over which different pairs of these solutions co-exist. The multitude of n-m anti-phase patterns and their co-existence are not found when the synapses are non-depressing. Geometric singular perturbation methods for dynamical systems are applied to the original eight-dimensional model system to derive a set of one-dimensional conditions for the existence and co-existence of different anti-phase solutions. The generality and validity of these conditions are demonstrated through numerical simulations utilizing the Hodgkin-Huxley and Morris-Lecar neuronal models.

Firing responses of bursting neurons with delayed feedback

Thalamic neurons, which play important roles in the genesis of rhythmic activities of the brain, show various bursting behaviors, particularly modulated by complex thalamocortical feedback via cortical neurons. As a first step to explore this complex neural system and focus on the effects of the feedback on the bursting behavior, a simple loop structure delayed in time and scaled by a coupling strength is added to a recent mean-field model of bursting neurons. Depending on the coupling strength and delay time, the modeled neurons show two distinct response patterns: one entrained to the unperturbed bursting frequency of the neurons and one entrained to the resonant frequency of the loop structure. Transitions between these two patterns are explored in the model's parameter space via extensive numerical simulations. It is found that at a fixed loop delay, there is a critical coupling strength at which the dominant response frequency switches from the unperturbed bursting frequency to the loop-induced one. Furthermore, alternating occurrence of these two response frequencies is observed when the delay varies at fixed coupling strength. The results demonstrate that bursting is coupled with feedback to yield new dynamics, which will provide insights into such effects in more complex neural systems.

Pulse coupled oscillators and the phase resetting curve

Limit cycle oscillators that are coupled in a pulsatile manner are referred to as pulse coupled oscillators. In these oscillators, the interactions take the form of brief pulses such that the effect of one input dies out before the next is received. A phase resetting curve (PRC) keeps track of how much an input advances or delays the next spike in an oscillatory neuron depending upon where in the cycle the input is applied. PRCs can be used to predict phase locking in networks of pulse coupled oscillators. In some studies of pulse coupled oscillators, a specific form is assumed for the interactions between oscillators, but a more general approach is to formulate the problem assuming a PRC that is generated using a perturbation that approximates the input received in the real biological network. In general, this approach requires that circuit architecture and a specific firing pattern be assumed. This allows the construction of discrete maps from one event to the next. The fixed points of these maps correspond to periodic firing modes and are easier to locate and analyze for stability compared to locating and analyzing periodic modes in the original network directly. Alternatively, maps based on the PRC have been constructed that do not presuppose a firing order. Specific circuits that have been analyzed under the assumption of pulsatile coupling include one to one lockings in a periodically forced oscillator or an oscillator forced at a fixed delay after a threshold event, two bidirectionally coupled oscillators with and without delays, a unidirectional N-ring of oscillators, and N all-to-all networks.

Epilepsy as a dynamic disease: a tutorial of the past with an eye to the future

How can clinical epileptologists and computational neuroscientists learn to function together within the confines of interdisciplinary teams to develop new and more effective treatment strategies for epilepsy? Here we introduce epileptologists to the way modelers think about epilepsy as a dynamic disease. Not only is there terminology to be learned, but also it is necessary to identify those areas where clinical input might be expected to have the greatest impact. It is concluded that both groups have major roles to play in educating, evaluating, and shaping the direction of the efforts of each other.

Dynamics of globally delay-coupled neurons displaying subthreshold oscillations

We study an ensemble of neurons that are coupled through their time-delayed collective mean field. The individual neuron is modelled using a Hodgkin-Huxley-type conductance model with parameters chosen such that the uncoupled neuron displays autonomous subthreshold oscillations of the membrane potential. We find that the ensemble generates a rich variety of oscillatory activities that are mainly controlled by two time scales: the natural period of oscillation at the single neuron level and the delay time of the global coupling. When the neuronal oscillations are synchronized, they can be either in-phase or out-of-phase. The phase-shifted activity is interpreted as the result of a phase-flip bifurcation, also occurring in a set of globally delay-coupled limit cycle oscillators. At the bifurcation point, there is a transition from in-phase to out-of-phase (or vice versa) synchronized oscillations, which is accompanied by an abrupt change in the common oscillation frequency. This phase-flip bifurcation was recently investigated in two mutually delay-coupled oscillators and can play a role in the mechanisms by which the neurons switch among different firing patterns.

Functional phase response curves: a method for understanding synchronization of adapting neurons

Phase response curves (PRCs) for a single neuron are often used to predict the synchrony of mutually coupled neurons. Previous theoretical work on pulse-coupled oscillators used single-pulse perturbations. We propose an alternate method in which functional PRCs (fPRCs) are generated using a train of pulses applied at a fixed delay after each spike, with the PRC measured when the phasic relationship between the stimulus and the subsequent spike in the neuron has converged. The essential information is the dependence of the recovery time from pulse onset until the next spike as a function of the delay between the previous spike and the onset of the applied pulse. Experimental fPRCs in Aplysia pacemaker neurons were different from single-pulse PRCs, principally due to adaptation. In the biological neuron, convergence to the fully adapted recovery interval was slower at some phases than that at others because the change in the effective intrinsic period due to adaptation changes the effective phase resetting in a way that opposes and slows the effects of adaptation. The fPRCs for two isolated adapting model neurons were used to predict the existence and stability of 1:1 phase-locked network activity when the two neurons were coupled. A stability criterion was derived by linearizing a coupled map based on the fPRC and the existence and stability criteria were successfully tested in two-simulated-neuron networks with reciprocal inhibition or excitation. The fPRC is the first PRC-based tool that can account for adaptation in analyzing networks of neural oscillators.

Interplay of subthreshold activity, time-delayed feedback, and noise on neuronal firing patterns

Feedback connections and noise are ubiquitous features of neuronal networks and affect in a determinant way the patterns of neural activity. Here we study how the subthreshold dynamics of a neuron interacts with time-delayed feedback and noise. We use a Hodgkin-Huxley-type model of a thermoreceptor neuron and assume the feedback to be linear, corresponding effectively to a recurrent electrical connection via gap junctions. This type of feedback can model electrical autapses, which connect the terminal fibers of a neuron's axon with dendrites from the same neuron. Thus the delay in the feedback loop is due basically to the axonal propagation time. We chose model parameters for which the neuron displays, in the absence of feedback and noise, only subthreshold oscillations. These oscillations, however, take the neuron close to the firing threshold, such that small perturbations can drive it above the level for generation of action potentials. The resulting interplay between weak delayed feedback, noise, and the subthreshold intrinsic activity is nontrivial. For negative feedback, depending on the delay, the firing rate can be lower than in the noise-free situation. This is due to the fact that noise inhibits feedback-induced spikes by driving the neuronal oscillations away from the firing threshold. For positive feedback, there are regions of delay values where the noise-induced spikes are inhibited by the feedback; in this case, it is the feedback that drives the neuronal oscillations away from the threshold. Our study contributes to a better understanding of the role of electrical self-connections in the presence of noise and subthreshold activity.

Distributed delays stabilize neural feedback systems

We consider the effect of distributed delays in neural feedback systems. The avian optic tectum is reciprocally connected with the isthmic nuclei. Extracellular stimulation combined with intracellular recordings reveal a range of signal delays from 3 to 9 ms between isthmotectal elements. This observation together with prior mathematical analysis concerning the influence of a delay distribution on system dynamics raises the question whether a broad delay distribution can impact the dynamics of neural feedback loops. For a system of reciprocally connected model neurons, we found that distributed delays enhance system stability in the following sense. With increased distribution of delays, the system converges faster to a fixed point and converges slower toward a limit cycle. Further, the introduction of distributed delays leads to an increased range of the average delay value for which the system's equilibrium point is stable. The system dynamics are determined almost exclusively by the mean and the variance of the delay distribution and show only little dependence on the particular shape of the distribution.

Long-term activity-dependent plasticity of action potential propagation delay and amplitude in cortical networks

BACKGROUND

The precise temporal control of neuronal action potentials is essential for regulating many brain functions. From the viewpoint of a neuron, the specific timings of afferent input from the action potentials of its synaptic partners determines whether or not and when that neuron will fire its own action potential. Tuning such input would provide a powerful mechanism to adjust neuron function and in turn, that of the brain. However, axonal plasticity of action potential timing is counter to conventional notions of stable propagation and to the dominant theories of activity-dependent plasticity focusing on synaptic efficacies.

METHODOLOGY/PRINCIPAL FINDINGS

Here we show the occurrence of activity-dependent plasticity of action potential propagation delays (up to 4 ms or 40% after minutes and 13 ms or 74% after hours) and amplitudes (up to 87%). We used a multi-electrode array to induce, detect, and track changes in propagation in multiple neurons while they adapted to different patterned stimuli in controlled neocortical networks in vitro. The changes did not occur when the same stimulation was repeated while blocking ionotropic gabaergic and glutamatergic receptors. Even though induction of changes in action potential timing and amplitude depended on synaptic transmission, the expression of these changes persisted in the presence of the synaptic receptor blockers.

CONCLUSIONS/SIGNIFICANCE

We conclude that, along with changes in synaptic efficacy, propagation plasticity provides a cellular mechanism to tune neuronal network function in vitro and potentially learning and memory in the brain.

Resonant properties in the paddlefish electrosensory system caused by delayed feedback

INTRODUCTION

The paddlefish electrosensory system consists of receptor cells in the skin that sense minute electric fields from their prey, small water fleas. The receptors thereby measure the difference of the voltage at the skin surface against the voltage inside the animal. Due to a high skin impedance, this internal voltage is considered to be relatively fixed.

RESULTS

We found, however, that this internal voltage can fluctuate. It shows damped oscillations to a single short electric field pulse and changes, with some time delay, according to the previous history of stimulation, and shows resonance at a certain frequency.

CONCLUSIONS

Computer simulations show that these phenomena can be explained by the presence of delayed feedback where the internal voltage is part of the feedback loop.

Reverberating activity in a neural network with distributed signal transmission delays

It is known that an identical delay in all transmission lines can destabilize the macroscopic stationarity of a neural network, causing oscillation. We analyze the collective dynamics of a network whose transmission delays are distributed in time. Here, a neuron is modeled as a discrete-time threshold element that responds in an all-or-nothing manner to a linear sum of signals that arrive after delays assigned to individual transmission lines. Even though transmission delays are distributed in time, a whole network exhibits a single collective oscillation with a period close to the average transmission delay. The collective oscillation cannot only be a simple alternation of the consecutive firing and resting, but also arbitrarily sequenced series of firing and resting, reverberating in a certain period of time. Moreover, the system dynamics can be made quasiperiodic or chaotic by changing the distribution of delays.

Multistability in spiking neuron models of delayed recurrent inhibitory loops

We consider the effect of the effective timing of a delayed feedback on the excitatory neuron in a recurrent inhibitory loop, when biological realities of firing and absolute refractory period are incorporated into a phenomenological spiking linear or quadratic integrate-and-fire neuron model. We show that such models are capable of generating a large number of asymptotically stable periodic solutions with predictable patterns of oscillations. We observe that the number of fixed points of the so-called phase resetting map coincides with the number of distinct periods of all stable periodic solutions rather than the number of stable patterns. We demonstrate how configurational information corresponding to these distinct periods can be explored to calculate and predict the number of stable patterns.

Dynamically maintained spike timing sequences in networks of pulse-coupled oscillators with delays

We demonstrate the widespread occurrence of dynamically maintained spike timing sequences in recurrent networks of pulse-coupled spiking neurons with large time delays. The sequences occur in transient, quasistable phase-locking states. The system spontaneously jumps between these states. This collective dynamics enables the system to generate a large number of distinct precise spike timing sequences. Distributed time delays play a constructive role by enhancing the dominance in parameter space of the dynamics responsible for producing the large variety of spike timing sequences.