Oscillatory model of attention-guided object selection and novelty detection

A Neurodynamic Model of Feature-Based Spatial Selection

Huang and Pashler (2007) suggested that feature-based attention creates a special form of spatial representation, which is termed a Boolean map. It partitions the visual scene into two distinct and complementary regions: selected and not selected. Here, we developed a model of a recurrent competitive network that is capable of state-dependent computation. It selects multiple winning locations based on a joint top-down cue. We augmented a model of the WTA circuit that is based on linear-threshold units with two computational elements: dendritic non-linearity that acts on the excitatory units and activity-dependent modulation of synaptic transmission between excitatory and inhibitory units. Computer simulations showed that the proposed model could create a Boolean map in response to a featured cue and elaborate it using the logical operations of intersection and union. In addition, it was shown that in the absence of top-down guidance, the model is sensitive to bottom-up cues such as saliency and abrupt visual onset.

Winner-take-all in a phase oscillator system with adaptation

We consider a system of generalized phase oscillators with a central element and radial connections. In contrast to conventional phase oscillators of the Kuramoto type, the dynamic variables in our system include not only the phase of each oscillator but also the natural frequency of the central oscillator, and the connection strengths from the peripheral oscillators to the central oscillator. With appropriate parameter values the system demonstrates winner-take-all behavior in terms of the competition between peripheral oscillators for the synchronization with the central oscillator. Conditions for the winner-take-all regime are derived for stationary and non-stationary types of system dynamics. Bifurcation analysis of the transition from stationary to non-stationary winner-take-all dynamics is presented. A new bifurcation type called a Saddle Node on Invariant Torus (SNIT) bifurcation was observed and is described in detail. Computer simulations of the system allow an optimal choice of parameters for winner-take-all implementation.

Attentional Bias Through Oscillatory Coherence Between Excitatory Activity and Inhibitory Minima

An implementation of attentional bias is presented for a network model that couples excitatory and inhibitory oscillatory units in a manner that is inspired by the mechanisms that generate cortical gamma oscillations. Attentional biases are implemented as oscillatory coherences between excitatory units that encode the spatial location or features of the target and the pool of inhibitory units. This form of attentional bias is motivated by neurophysiological findings that relate selective attention to spike field coherence. Including also pattern recognition mechanisms, we demonstrate how this implementation of attentional bias leads to selection of an attentional target while suppressing distracters for cases of spatial and feature-based attention. With respect to neurophysiological observations, we argue that the recently found positive correlation between high firing rates and strong gamma locking with attention (Vinck, Womelsdorf, Buffalo, Desimone, & Fries, 2013) may point to an essential mechanism of the brain's attentional selection and suppression processes.

Theta-alpha cross-frequency synchronization facilitates working memory control - a modeling study

Despite decades of research, the neural mechanism of central executive and working memory is still unclear. In this paper, we propose a new neural network model for the real-time control of working memory. The key idea is to consider separately the role of neural activation from that of oscillatory phase. Neural populations encoding different information would not confuse each other when the populations have different oscillatory phases. Depending on the current situation, relevant memories bind together through phase-locking between theta-frequency oscillation of a Central Unit and alpha-frequency oscillations of the relevant group of Memory Units. The Central Unit dynamically controls which Memory Units should be synchronized (and the encoded memory would be processed), and which units should be out of phase (the encoded memory is standby and would not be processed yet). Simulations of two working memory tasks are provided as examples. The model is in agreement with many recent experimental results of human scalp EEG analysis, which reported observations of neural synchronization and cross-frequency coupling during working memory tasks. This model offers a possible explanation of the underlying mechanism for these experiments.

A dynamical pattern recognition model of γ activity in auditory cortex

This paper describes a dynamical process which serves both as a model of temporal pattern recognition in the brain and as a forward model of neuroimaging data. This process is considered at two separate levels of analysis: the algorithmic and implementation levels. At an algorithmic level, recognition is based on the use of Occurrence Time features. Using a speech digit database we show that for noisy recognition environments, these features rival standard cepstral coefficient features. At an implementation level, the model is defined using a Weakly Coupled Oscillator (WCO) framework and uses a transient synchronization mechanism to signal a recognition event. In a second set of experiments, we use the strength of the synchronization event to predict the high gamma (75–150 Hz) activity produced by the brain in response to word versus non-word stimuli. Quantitative model fits allow us to make inferences about parameters governing pattern recognition dynamics in the brain.

A neural model of selective attention and object segmentation in the visual scene: an approach based on partial synchronization and star-like architecture of connections

A brain-inspired computational system is presented that allows sequential selection and processing of objects from a visual scene. The system is comprised of three modules. The selective attention module is designed as a network of spiking neurons of the Hodgkin-Huxley type with star-like connections between the central unit and peripheral elements. The attention focus is represented by those peripheral neurons that generate spikes synchronously with the central neuron while the activity of other peripheral neurons is suppressed. Such dynamics corresponds to the partial synchronization mode. It is shown that peripheral neurons with higher firing rates are preferentially drawn into partial synchronization. We show that local excitatory connections facilitate synchronization, while local inhibitory connections help distinguishing between two groups of peripheral neurons with similar intrinsic frequencies. The module automatically scans a visual scene and sequentially selects regions of interest for detailed processing and object segmentation. The contour extraction module implements standard image processing algorithms for contour extraction. The module computes raw contours of objects accompanied by noise and some spurious inclusions. At the next stage, the object segmentation module designed as a network of phase oscillators is used for precise determination of object boundaries and noise suppression. This module has a star-like architecture of connections. The segmented object is represented by a group of peripheral oscillators working in the regime of partial synchronization with the central oscillator. The functioning of each module is illustrated by an example of processing of the visual scene taken from a visual stream of a robot camera.

Selective attention model with spiking elements

A new biologically plausible model of visual selective attention is developed based on synaptically coupled Hodgkin-Huxley neurons. The model is designed according to a two-layer architecture of excitatory and inhibitory connections which comprises two central neurons and a population of peripheral neurons. Two types of inhibition from the central neurons are present: fixed inhibition which is responsible for the formation of the attention focus, and short-term plastic inhibition which is responsible for the shift of attention. The regimes of synchronous dynamics associated with the development of the attentional focus are studied. In particular, the regime of partial synchronization between spiking activity of the central and peripheral neurons is interpreted as object selection to the focus of attention. It is shown that peripheral neurons with higher firing rates are selected preferentially by the attention system. The model correctly reproduces some observations concerning the mechanisms of attentional control, such as the coherence of spikes in the population of neurons included in the focus of attention, and the inhibition of neurons outside the focus of attention. Sequential selection of stimuli simultaneously present in the visual scene is demonstrated by the model in the frequency domain in both a formal example and a real image.

The role of the hippocampus in long-term memory: is it memory store or comparator?

Several attempts have been made to reconcile a number of rival theories on the role of the hippocampus in long-term memory. Those attempts fail to explain the basic effects of the theories from the same point of view. We are reviewing the four major theories, and shall demonstrate, with the use of mathematical models of attention and memory, that only one theory is capable of reconciling all of them by explaining the basic effects of each theory in a unified fashion, without altogether sacrificing their individual contributions. The key issue here is whether or not a memory trace is ever stored in the hippocampus itself, and there is no reconciliation unless the answer to that question is that there is not. As a result of the reconciliation that we are proposing, there is a simple solution to several outstanding problems concerning the neurobiology of memory such as: consolidation and reconsolidation, persistency of long term memory, novelty detection, habituation, long-term potentiation, and the multifrequency oscillatory self-organization of the brain.

Oscillations and waves in the models of interactive neural populations

The dynamics of activity in interactive neural populations is simulated by the networks of Wilson-Cowan oscillators. Two extreme cases of connection architectures in the networks are considered: (1) 1D and 2D regular and homogeneous grids with local connections and (2) sparse random coupling. Propagating waves in the network have been found under the stationary external input and the regime of partial synchronization has been obtained for the periodic input. It has been shown that in the case of random coupling about 60% of neural populations demonstrate oscillatory activity and some of these oscillations are synchronous. The role of different types of dynamics in information processing is discussed. In particular, we discuss the regime of partial synchronization in the context of cortical microcircuits.

An Oscillatory Neural Model of Multiple Object Tracking

An oscillatory neural network model of multiple object tracking is described. The model works with a set of identical visual objects moving around the screen. At the initial stage, the model selects into the focus of attention a subset of objects initially marked as targets. Other objects are used as distractors. The model aims to preserve the initial separation between targets and distractors while objects are moving. This is achieved by a proper interplay of synchronizing and desynchronizing interactions in a multilayer network, where each layer is responsible for tracking a single target. The results of the model simulation are presented and compared with experimental data. In agreement with experimental evidence, simulations with a larger number of targets have shown higher error rates. Also, the functioning of the model in the case of temporarily overlapping objects is presented.

Object segmentation and recovery via neural oscillators implementing the similarity and prior knowledge gestalt rules

Object recognition requires the solution of the binding and segmentation problems, i.e., grouping different features to achieve a coherent representation. Synchronization of neural activity in the gamma-band, associated with gestalt perception, has often been proposed as a putative mechanism to solve these problems, not only as to low-level processing, but also in higher cortical functions. In the present work, a network of Wilson-Cowan oscillators is used to segment simultaneous objects, and recover an object from partial or corrupted information, by implementing two gestalt rules: similarity and prior knowledge. The network consists of H different areas, each devoted to representation of a particular feature of the object, according to a topological organization. The similarity law is realized via lateral intra-area connections, arranged as a "Mexican-hat". Prior knowledge is realized via inter-area connections, which link properties belonging to a previously memorized object. A global inhibitor allows segmentation of several objects avoiding interference. Simulation results, performed using three simultaneous input objects, show that the network is able to detect an object even in difficult conditions (i.e., when some features are absent or shifted with respect to the original one). Moreover, the trade-off between sensitivity (capacity to detect true positives) and specificity (capacity to reject false positives) can be controlled acting on the extension of lateral synapses (i.e., on the level of accepted similarity). Finally, the network can also deal with correlated objects, i.e., objects which have some common features. Simulations performed using a different number of objects (2, 3, 4 or 5) suggest that the network is able to segment and recall up to four objects, but the oscillation frequency must increase, the lower the number of objects simultaneously present. The model, although quite simpler compared with neurophysiology, may represent a theoretical framework for the analysis of the relationships between object representation, memory, learning, and gamma-band activity. In particular, it extends previous studies on autoassociative memory since it exploits not only oscillatory dynamics, but also a topological organization of features.

Object segmentation and reconstruction via an oscillatory neural network: interaction among learning, memory, topological organization and gamma-band synchronization

Synchronization of neuronal activity in the gamma-band has been shown to play an important role in higher cognitive functions, by grouping together the necessary information in different cortical areas to achieve a coherent perception. In the present work, we used a neural network of Wilson-Cowan oscillators to analyze the problem of binding and segmentation of high-level objects. Binding is achieved by implementing in the network the similarity and prior knowledge Gestalt rules. Similarity law is realized via topological maps within the network. Prior knowledge originates by means of a Hebbian rule of synaptic change; objects are memorized in the network with different strengths. Segmentation is realized via a global inhibitor which allows desynchronisation among multiple objects avoiding interference. Simulation results performed with a 40x40 neural grid, using three simultaneous input objects, show that the network is able to recognize and segment objects in several different conditions (different degrees of incompleteness or distortion of input patterns), exhibiting the higher reconstruction performances the higher the strength of object memory. The presented model represents an integrated approach for investigating the relationships among learning, memory, topological organization and gamma-band synchronization.

Coexistence of tonic spiking oscillations in a leech neuron model

The leech neuron model studied here has a remarkable dynamical plasticity. It exhibits a wide range of activities including various types of tonic spiking and bursting. In this study we apply methods of the qualitative theory of dynamical systems and the bifurcation theory to analyze the dynamics of the leech neuron model with emphasis on tonic spiking regimes. We show that the model can demonstrate bi-stability, such that two modes of tonic spiking coexist. Under a certain parameter regime, both tonic spiking modes are represented by the periodic attractors. As a bifurcation parameter is varied, one of the attractors becomes chaotic through a cascade of period-doubling bifurcations, while the other remains periodic. Thus, the system can demonstrate co-existence of a periodic tonic spiking with either periodic or chaotic tonic spiking. Pontryagin's averaging technique is used to locate the periodic orbits in the phase space.

A systems approach to appraisal mechanisms in emotion

While artificial neural networks are regularly employed in modeling the perception of facial and vocal emotion expression as well as in automatic expression decoding by artificial agents, this approach is yet to be extended to the modeling of emotion elicitation and differentiation. In part, this may be due to the dominance of discrete and dimensional emotion models, which have not encouraged computational modeling. This situation has changed with the advent of appraisal theories of emotion and a number of attempts to develop rule-based models can be found in the literature. However, most of these models operate at a high level of conceptual abstraction and rarely include the underlying neural architecture. In this contribution, an appraisal-based emotion theory, the Component Process Model (CPM), is described that seems particularly suited to modeling with the help of artificial neural network approaches. This is due to its high degree of specificity in postulating underlying mechanisms including efferent physiological and behavioral manifestations as well as to the possibility of linking the theoretical assumptions to underlying neural architectures and dynamic processes. This paper provides a brief overview of the model, suggests constraints imposed by neural circuits, and provides examples on how the temporal unfolding of emotion can be conceptualized and experimentally tested. In addition, it is shown that the specific characteristics of emotion episodes can be profitably explored with the help of non-linear dynamic systems theory.