Synchronized firings in the networks of class 1 excitable neurons with excitatory and inhibitory connections and their dependences on the forms of interactions

Acetylcholine-mediated top-down attention improves the response to bottom-up inputs by deformation of the attractor landscape

To understand the effect of attention on neuronal dynamics, we propose a multi-module network, with each module consisting of fully interconnected groups of excitatory and inhibitory neurons. This network shows transitive dynamics among quasi-attractors as its typical dynamics. When the release of acetylcholine onto the network is simulated by attention, the transitive dynamics change into stable dynamics in which the system converges to an attractor. We found that this network can reproduce three experimentally observed properties of attention-dependent response modulation, namely an increase in the firing rate, a decrease in the Fano factor of the firing rate, and a decrease in the correlation coefficients between the firing rates of pairs of neurons. Moreover, we also showed theoretically that the release of acetylcholine increases the sensitivity to bottom-up inputs by changing the response function.

Relationship between the mechanisms of gamma rhythm generation and the magnitude of the macroscopic phase response function in a population of excitatory and inhibitory modified quadratic integrate-and-fire neurons

Gamma oscillations are thought to play an important role in brain function. Interneuron gamma (ING) and pyramidal interneuron gamma (PING) mechanisms have been proposed as generation mechanisms for these oscillations. However, the relation between the generation mechanisms and the dynamical properties of the gamma oscillation are still unclear. Among the dynamical properties of the gamma oscillation, the phase response function (PRF) is important because it encodes the response of the oscillation to inputs. Recently, the PRF for an inhibitory population of modified theta neurons that generate an ING rhythm was computed by the adjoint method applied to the associated Fokker-Planck equation (FPE) for the model. The modified theta model incorporates conductance-based synapses as well as the voltage and current dynamics. Here, we extended this previous work by creating an excitatory-inhibitory (E-I) network using the modified theta model and described the population dynamics with the corresponding FPE. We conducted a bifurcation analysis of the FPE to find parameter regions which generate gamma oscillations. In order to label the oscillatory parameter regions by their generation mechanisms, we defined ING- and PING-type gamma oscillation in a mathematically plausible way based on the driver of the inhibitory population. We labeled the oscillatory parameter regions by these generation mechanisms and derived PRFs via the adjoint method on the FPE in order to investigate the differences in the responses of each type of oscillation to inputs. PRFs for PING and ING mechanisms are derived and compared. We found the amplitude of the PRF for the excitatory population is larger in the PING case than in the ING case. Finally, the E-I population of the modified theta neuron enabled us to analyze the PRFs of PING-type gamma oscillation and the entrainment ability of E and I populations. We found a parameter region in which PRFs of E and I are both purely positive in the case of PING oscillations. The different entrainment abilities of E and I stimulation as governed by the respective PRFs was compared to direct simulations of finite populations of model neurons. We find that it is easier to entrain the gamma rhythm by stimulating the inhibitory population than by stimulating the excitatory population as has been found experimentally.

Chaotic Pattern Alternations Can Reproduce Properties of Dominance Durations in Multistable Perception

We propose a pulse neural network that exhibits chaotic pattern alternations among stored patterns as a model of multistable perception, which is reflected in phenomena such as binocular rivalry and perceptual ambiguity. When we regard the mixed state of patterns as a part of each pattern, the durations of the retrieved pattern obey unimodal distributions. We confirmed that no chaotic properties are observed in the time series of durations, consistent with the findings of previous psychological studies. Moreover, it is shown that our model also reproduces two properties of multistable perception that characterize the relationship between the contrast of inputs and the durations.

An attractor-based complexity measurement for Boolean recurrent neural networks

We provide a novel refined attractor-based complexity measurement for Boolean recurrent neural networks that represents an assessment of their computational power in terms of the significance of their attractor dynamics. This complexity measurement is achieved by first proving a computational equivalence between Boolean recurrent neural networks and some specific class of -automata, and then translating the most refined classification of -automata to the Boolean neural network context. As a result, a hierarchical classification of Boolean neural networks based on their attractive dynamics is obtained, thus providing a novel refined attractor-based complexity measurement for Boolean recurrent neural networks. These results provide new theoretical insights to the computational and dynamical capabilities of neural networks according to their attractive potentialities. An application of our findings is illustrated by the analysis of the dynamics of a simplified model of the basal ganglia-thalamocortical network simulated by a Boolean recurrent neural network. This example shows the significance of measuring network complexity, and how our results bear new founding elements for the understanding of the complexity of real brain circuits.

Population dynamics of the modified theta model: macroscopic phase reduction and bifurcation analysis link microscopic neuronal interactions to macroscopic gamma oscillation

Gamma oscillations of the local field potential are organized by collective dynamics of numerous neurons and have many functional roles in cognition and/or attention. To mathematically and physiologically analyse relationships between individual inhibitory neurons and macroscopic oscillations, we derive a modification of the theta model, which possesses voltage-dependent dynamics with appropriate synaptic interactions. Bifurcation analysis of the corresponding Fokker-Planck equation (FPE) enables us to consider how synaptic interactions organize collective oscillations. We also develop the adjoint method (infinitesimal phase resetting curve) for simultaneous equations consisting of ordinary differential equations representing synaptic dynamics and a partial differential equation for determining the probability distribution of the membrane potential. This method provides a macroscopic phase response function (PRF), which gives insights into how it is modulated by external perturbation or internal changes of parameters. We investigate the effects of synaptic time constants and shunting inhibition on these gamma oscillations. The sensitivity of rising and decaying time constants is analysed in the oscillatory parameter regions; we find that these sensitivities are not largely dependent on rate of synaptic coupling but, rather, on current and noise intensity. Analyses of shunting inhibition reveal that it can affect both promotion and elimination of gamma oscillations. When the macroscopic oscillation is far from the bifurcation, shunting promotes the gamma oscillations and the PRF becomes flatter as the reversal potential of the synapse increases, indicating the insensitivity of gamma oscillations to perturbations. By contrast, when the macroscopic oscillation is near the bifurcation, shunting eliminates gamma oscillations and a stable firing state appears. More interestingly, under appropriate balance of parameters, two branches of bifurcation are found in our analysis of the FPE. In this case, shunting inhibition can effect both promotion and elimination of the gamma oscillation depending only on the reversal potential.

Deformation of attractor landscape via cholinergic presynaptic modulations: a computational study using a phase neuron model

Corticopetal acetylcholine (ACh) is released transiently from the nucleus basalis of Meynert (NBM) into the cortical layers and is associated with top-down attention. Recent experimental data suggest that this release of ACh disinhibits layer 2/3 pyramidal neurons (PYRs) via muscarinic presynaptic effects on inhibitory synapses. Together with other possible presynaptic cholinergic effects on excitatory synapses, this may result in dynamic and temporal modifications of synapses associated with top-down attention. However, the system-level consequences and cognitive relevance of such disinhibitions are poorly understood. Herein, we propose a theoretical possibility that such transient modifications of connectivity associated with ACh release, in addition to top-down glutamatergic input, may provide a neural mechanism for the temporal reactivation of attractors as neural correlates of memories. With baseline levels of ACh, the brain returns to quasi-attractor states, exhibiting transitive dynamics between several intrinsic internal states. This suggests that top-down attention may cause the attention-induced deformations between two types of attractor landscapes: the quasi-attractor landscape (Q-landscape, present under low-ACh, non-attentional conditions) and the attractor landscape (A-landscape, present under high-ACh, top-down attentional conditions). We present a conceptual computational model based on experimental knowledge of the structure of PYRs and interneurons (INs) in cortical layers 1 and 2/3 and discuss the possible physiological implications of our results.

Rewiring-induced chaos in pulse-coupled neural networks

The dependence of the dynamics of pulse-coupled neural networks on random rewiring of excitatory and inhibitory connections is examined. When both excitatory and inhibitory connections are rewired, periodic synchronization emerges with a Hopf-like bifurcation and a subsequent period-doubling bifurcation; chaotic synchronization is also observed. When only excitatory connections are rewired, periodic synchronization emerges with a saddle node-like bifurcation, and chaotic synchronization is also observed. This result suggests that randomness in the system does not necessarily contaminate the system, and sometimes it even introduces rich dynamics to the system such as chaos.

Roles of inhibitory neurons in rewiring-induced synchronization in pulse-coupled neural networks

The roles of inhibitory neurons in synchronous firing are examined in a network of excitatory and inhibitory neurons with Watts and Strogatz's rewiring. By examining the persistence of the synchronous firing that exists in the random network, it was found that there is a probability of rewiring at which a transition between the synchronous state and the asynchronous state takes place, and the dynamics of the inhibitory neurons play an important role in determining this probability.

Noise-driven attractor switching device

Problems with artificial neural networks originate from their deterministic nature and inevitable prior learnings, resulting in inadequate adaptability against unpredictable, abrupt environmental change. Here we show that a stochastically excitable threshold unit can be utilized by these systems to partially overcome the environmental change. Using an excitable threshold system, attractors were created that represent quasiequilibrium states into which a system settles until disrupted by environmental change. Furthermore, noise-driven attractor stabilization and switching were embodied by inhibitory connections. Noise works as a power source to stabilize and switch attractors, and endows the system with hysteresis behavior that resembles that of stereopsis and binocular rivalry in the human visual cortex. A canonical model of the ring network with inhibitory connections composed of class 1 neurons also shows properties that are similar to the simple threshold system.

Synchronization dynamics of two coupled neural oscillators receiving shared and unshared noisy stimuli

The response of neurons to external stimuli greatly depends on the intrinsic dynamics of the network. Here, the intrinsic dynamics are modeled as coupling and the external input is modeled as shared and unshared noise. We assume the neurons are repetitively firing action potentials (i.e., neural oscillators), are weakly and identically coupled, and the external noise is weak. Shared noise can induce bistability between the synchronous and anti-phase states even though the anti-phase state is the only stable state in the absence of noise. We study the Fokker-Planck equation of the system and perform an asymptotic reduction rho(0). The rho(0) solution is more computationally efficient than both the Monte Carlo simulations and the 2D Fokker-Planck solver, and agrees remarkably well with the full system with weak noise and weak coupling. With moderate noise and coupling, rho(0) is still qualitatively correct despite the small noise and coupling assumption in the asymptotic reduction. Our phase model accurately predicts the behavior of a realistic synaptically coupled Morris-Lecar system.

Epileptogenesis due to glia-mediated synaptic scaling

Homeostatic regulation of neuronal activity is fundamental for the stable functioning of the cerebral cortex. One form of homeostatic synaptic scaling has been recently shown to be mediated by glial cells that interact with neurons through the diffusible messenger tumour necrosis factor-alpha (TNF-alpha). Interestingly, TNF-alpha is also used by the immune system as a pro-inflammatory messenger, suggesting potential interactions between immune system signalling and the homeostatic regulation of neuronal activity. We present the first computational model of neuron-glia interaction in TNF-alpha-mediated synaptic scaling. The model shows how under normal conditions the homeostatic mechanism is effective in balancing network activity. After chronic immune activation or TNF-alpha overexpression by glia, however, the network develops seizure-like activity patterns. This may explain why under certain conditions brain inflammation increases the risk of seizures. Additionally, the model shows that TNF-alpha diffusion may be responsible for epileptogenesis after localized brain lesions.

Chaotic pattern transitions in pulse neural networks

In models of associative memory composed of pulse neurons, chaotic pattern transitions where the pattern retrieved by the network changes chaotically were found. The network is composed of multiple modules of pulse neurons, and when the inter-module connection strength decreased, the stability of pattern retrieval changed from stable to chaotic. It was found that the mixed pattern of stored patterns plays an important role in chaotic pattern transitions.

Analysis of Synchronization Between Two Modules of Pulse Neural Networks with Excitatory and Inhibitory Connections

To study the synchronized oscillations among distant neurons in the visual cortex, we analyzed the synchronization between two modules of pulse neural networks using the phase response function. It was found that the intermodule connections from excitatory to excitatory ensembles tend to stabilize the antiphase synchronization and that the intermodule connections from excitatory to inhibitory ensembles tend to stabilize the in-phase synchronization. It was also found that the intermodule synchronization was more noticeable when the inner-module synchronization was weak.

Detecting chaotic structures in noisy pulse trains based on interspike interval reconstruction

The nonlinear prediction method based on the interspike interval (ISI) reconstruction is applied to the ISI sequence of noisy pulse trains and the detection of the deterministic structure is performed. It is found that this method cannot discriminate between the noisy periodic pulse train and the noisy chaotic one when noise-induced pulses exist. When the noise-induced pulses are eliminated by the grouping of ISI sequence with the genetic algorithm, the chaotic structure of the chaotic firings becomes clear, and the noisy chaotic pulse train could be discriminated from the periodic one.