Object selection based on oscillatory correlation

A Neurodynamic Model of Feature-Based Spatial Selection

Huang and Pashler (2007) suggested that feature-based attention creates a special form of spatial representation, which is termed a Boolean map. It partitions the visual scene into two distinct and complementary regions: selected and not selected. Here, we developed a model of a recurrent competitive network that is capable of state-dependent computation. It selects multiple winning locations based on a joint top-down cue. We augmented a model of the WTA circuit that is based on linear-threshold units with two computational elements: dendritic non-linearity that acts on the excitatory units and activity-dependent modulation of synaptic transmission between excitatory and inhibitory units. Computer simulations showed that the proposed model could create a Boolean map in response to a featured cue and elaborate it using the logical operations of intersection and union. In addition, it was shown that in the absence of top-down guidance, the model is sensitive to bottom-up cues such as saliency and abrupt visual onset.

Winner-take-all in a phase oscillator system with adaptation

We consider a system of generalized phase oscillators with a central element and radial connections. In contrast to conventional phase oscillators of the Kuramoto type, the dynamic variables in our system include not only the phase of each oscillator but also the natural frequency of the central oscillator, and the connection strengths from the peripheral oscillators to the central oscillator. With appropriate parameter values the system demonstrates winner-take-all behavior in terms of the competition between peripheral oscillators for the synchronization with the central oscillator. Conditions for the winner-take-all regime are derived for stationary and non-stationary types of system dynamics. Bifurcation analysis of the transition from stationary to non-stationary winner-take-all dynamics is presented. A new bifurcation type called a Saddle Node on Invariant Torus (SNIT) bifurcation was observed and is described in detail. Computer simulations of the system allow an optimal choice of parameters for winner-take-all implementation.

A neural network model for visual selection and shifting

In this paper, a two-layer network is built to simulate the mechanism of visual selection and shifting based on the mapping dynamic model for instantaneous frequency. Unlike the differential equation model using limit cycle to simulate neuron oscillation, we build an instantaneous frequency mapping dynamic model to describe the change of the neuron frequency to avoid the difficulty of generating limit cycle. The activity of the neuron is rebuilt based on the instantaneous frequency and in this work, we use the first layer of neurons to implement image segmentation and the second layer of neurons to act as visual selector. The frequency of the second neuron (central neuron) is always changing, while central neuron resonates with the neurons corresponding to an object, the object is selected, then with the central neuron frequency changing, the selected object loses attention, the process goes on.

Oscillatory response in a sensory network of ON and OFF cells with instantaneous and delayed recurrent connections

A neural field model with multiple cell-to-cell feedback connections is investigated. Our model incorporates populations of ON and OFF cells, receiving sensory inputs with direct and inverted polarity, respectively. Oscillatory responses to spatially localized stimuli are found to occur via Andronov-Hopf bifurcations of stationary activity. We explore the impact of multiple delayed feedback components as well as additional excitatory and/or inhibitory non-delayed recurrent signals on the instability threshold. Paradoxically, instantaneous excitatory recurrent terms are found to enhance network responsiveness by reducing the oscillatory response threshold, allowing smaller inputs to trigger oscillatory activity. Instantaneous inhibitory components do the opposite. The frequency of these response oscillations is further shaped by the polarity of the non-delayed terms.

Dynamics of driven recurrent networks of ON and OFF cells

A globally coupled network of ON and OFF cells is studied using neural field theory. ON cells increase their activity when the amplitude of an external stimulus increases, while OFF cells do the opposite given the same stimulus. Theory predicts that, without input, multiple transitions to oscillations can occur depending on feedback delay and the difference between ON and OFF resting states. Static spatial stimuli can induce or suppress global oscillations via a Andronov-Hopf bifurcation. This is the case for either polarity of such stimuli. In contrast, only excitatory inputs can induce or suppress oscillations in an equivalent network built of ON cells only even though oscillations are more prevalent in such systems. Nonmonotonic responses to local stimuli occur where responses lateral to the stimulus switch from excitatory to inhibitory as the input amplitude increases. With local time-periodic forcing, the unforced cells oscillate at twice the driving frequency via full-wave rectification mediated by the feedback. Our results agree with simulations of the neural field model, and further, qualitative agreement is found with the behavior of a network of spiking stochastic integrate-and-fire model neurons.

Computation with spikes in a winner-take-all network

The winner-take-all (WTA) computation in networks of recurrently connected neurons is an important decision element of many models of cortical processing. However, analytical studies of the WTA performance in recurrent networks have generally addressed rate-based models. Very few have addressed networks of spiking neurons, which are relevant for understanding the biological networks themselves and also for the development of neuromorphic electronic neurons that commmunicate by action potential like address-events. Here, we make steps in that direction by using a simplified Markov model of the spiking network to examine analytically the ability of a spike-based WTA network to discriminate the statistics of inputs ranging from stationary regular to nonstationary Poisson events. Our work extends previous theoretical results showing that a WTA recurrent network receiving regular spike inputs can select the correct winner within one interspike interval. We show first for the case of spike rate inputs that input discrimination and the effects of self-excitation and inhibition on this discrimination are consistent with results obtained from the standard rate-based WTA models. We also extend this discrimination analysis of spiking WTAs to nonstationary inputs with time-varying spike rates resembling statistics of real-world sensory stimuli. We conclude that spiking WTAs are consistent with their continuous counterparts for steady-state inputs, but they also exhibit high discrimination performance with nonstationary inputs.

A neural model of selective attention and object segmentation in the visual scene: an approach based on partial synchronization and star-like architecture of connections

A brain-inspired computational system is presented that allows sequential selection and processing of objects from a visual scene. The system is comprised of three modules. The selective attention module is designed as a network of spiking neurons of the Hodgkin-Huxley type with star-like connections between the central unit and peripheral elements. The attention focus is represented by those peripheral neurons that generate spikes synchronously with the central neuron while the activity of other peripheral neurons is suppressed. Such dynamics corresponds to the partial synchronization mode. It is shown that peripheral neurons with higher firing rates are preferentially drawn into partial synchronization. We show that local excitatory connections facilitate synchronization, while local inhibitory connections help distinguishing between two groups of peripheral neurons with similar intrinsic frequencies. The module automatically scans a visual scene and sequentially selects regions of interest for detailed processing and object segmentation. The contour extraction module implements standard image processing algorithms for contour extraction. The module computes raw contours of objects accompanied by noise and some spurious inclusions. At the next stage, the object segmentation module designed as a network of phase oscillators is used for precise determination of object boundaries and noise suppression. This module has a star-like architecture of connections. The segmented object is represented by a group of peripheral oscillators working in the regime of partial synchronization with the central oscillator. The functioning of each module is illustrated by an example of processing of the visual scene taken from a visual stream of a robot camera.

Chaotic phase synchronization and desynchronization in an oscillator network for object selection

Object selection refers to the mechanism of extracting objects of interest while ignoring other objects and background in a given visual scene. It is a fundamental issue for many computer vision and image analysis techniques and it is still a challenging task to artificial visual systems. Chaotic phase synchronization takes place in cases involving almost identical dynamical systems and it means that the phase difference between the systems is kept bounded over the time, while their amplitudes remain chaotic and may be uncorrelated. Instead of complete synchronization, phase synchronization is believed to be a mechanism for neural integration in brain. In this paper, an object selection model is proposed. Oscillators in the network representing the salient object in a given scene are phase synchronized, while no phase synchronization occurs for background objects. In this way, the salient object can be extracted. In this model, a shift mechanism is also introduced to change attention from one object to another. Computer simulations show that the model produces some results similar to those observed in natural vision systems.

Selective attention model with spiking elements

A new biologically plausible model of visual selective attention is developed based on synaptically coupled Hodgkin-Huxley neurons. The model is designed according to a two-layer architecture of excitatory and inhibitory connections which comprises two central neurons and a population of peripheral neurons. Two types of inhibition from the central neurons are present: fixed inhibition which is responsible for the formation of the attention focus, and short-term plastic inhibition which is responsible for the shift of attention. The regimes of synchronous dynamics associated with the development of the attentional focus are studied. In particular, the regime of partial synchronization between spiking activity of the central and peripheral neurons is interpreted as object selection to the focus of attention. It is shown that peripheral neurons with higher firing rates are selected preferentially by the attention system. The model correctly reproduces some observations concerning the mechanisms of attentional control, such as the coherence of spikes in the population of neurons included in the focus of attention, and the inhibition of neurons outside the focus of attention. Sequential selection of stimuli simultaneously present in the visual scene is demonstrated by the model in the frequency domain in both a formal example and a real image.

Coupled oscillators for modeling and analysis of EEG/MEG oscillations

This study presents three EEG/MEG applications in which the modeling of oscillatory signal components offers complementary analysis and an improved explanation of the underlying generator structures. Coupled oscillator networks were used for modeling. Parameters of the corresponding ordinary coupled differential equation (ODE) system are identified using EEG/MEG data and the resulting solution yields the modeled signals. This model-related analysis strategy provides information about the coupling quantity and quality between signal components (example 1, neonatal EEG during quiet sleep), allows identification of the possible contribution of hidden generator structures (example 2, 600-Hz MEG oscillations in somatosensory evoked magnetic fields), and can explain complex signal characteristics such as amplitude-frequency coupling and frequency entrainment (example 3, EEG burst patterns in sedated patients).

An Oscillatory Neural Model of Multiple Object Tracking

An oscillatory neural network model of multiple object tracking is described. The model works with a set of identical visual objects moving around the screen. At the initial stage, the model selects into the focus of attention a subset of objects initially marked as targets. Other objects are used as distractors. The model aims to preserve the initial separation between targets and distractors while objects are moving. This is achieved by a proper interplay of synchronizing and desynchronizing interactions in a multilayer network, where each layer is responsible for tracking a single target. The results of the model simulation are presented and compared with experimental data. In agreement with experimental evidence, simulations with a larger number of targets have shown higher error rates. Also, the functioning of the model in the case of temporarily overlapping objects is presented.

Attention-based dynamic visual search using inner-scene similarity: algorithms and bounds

A visual search is required when applying a recognition process on a scene containing multiple objects. In such cases, we would like to avoid an exhaustive sequential search. This work proposes a dynamic visual search framework based mainly on innerscene similarity. Given a number of candidates (e.g., subimages), we hypothesize is that more visually similar candidates are more likely to have the same identity. We use this assumption for determining the order of attention. Both deterministic and stochastic approaches, relying on this hypothesis, are considered. Under the deterministic approach, we suggest a measure similar to Kolmogorov's epsilon-covering that quantifies the difficulty of a search task. We show that this measure bounds the performance of all search algorithms and suggest a simple algorithm that meets this bound. Under the stochastic approach, we model the identity of the candidates as a set of correlated random variables and derive a search procedure based on linear estimation. Several experiments are presented in which the statistical characteristics, search algorithm, and bound are evaluated and verified.

The time dimension for scene analysis

A fundamental issue in neural computation is the binding problem, which refers to how sensory elements in a scene organize into perceived objects, or percepts. The issue of binding is hotly debated in recent years in neuroscience and related communities. Much of the debate, however, gives little attention to computational considerations. This review intends to elucidate the computational issues that bear directly on the binding issue. The review starts with two problems considered by Rosenblatt to be the most challenging to the development of perceptron theory more than 40 years ago, and argues that the main challenge is the figure-ground separation problem, which is intrinsically related to the binding problem. The theme of the review is that the time dimension is essential for systematically attacking Rosenblatt's challenge. The temporal correlation theory as well as its special form--oscillatory correlation theory-is discussed as an adequate representation theory to address the binding problem. Recent advances in understanding oscillatory dynamics are reviewed, and these advances have overcome key computational obstacles for the development of the oscillatory correlation theory. We survey a variety of studies that address the scene analysis problem. The results of these studies have substantially advanced the capability of neural networks for figure-ground separation. A number of issues regarding oscillatory correlation are considered and clarified. Finally, the time dimension is argued to be necessary for versatile computing.

Bio-computational model of object-recognition: Quantum Hebbian processing with neurally shaped Gabor wavelets

Theoretical and simulational evidence, as well as experimental indications, are accumulating that quantum associative memory and imaging are possible. We compare these data with biological evidence, since we find them to a significant extent compatible. This paper presents a computationally implementable integrative model of appearance-based viewpoint-invariant recognition of objects. The neuro-quantum hybrid model incorporates neural processing up to V1 and quantum associative processing in V1, achieving together an object-recognition result in V2 and ITC. Results of our simulation of the central quantum-like parts of the bio-model, receiving neurally pre-processed inputs, are presented. This part contains our original simulated storage by multiple quantum interference of image-encoding Gabor wavelets done in a Hebbian way, especially using the Griniasty et al. pose-sequence learning rule.

Cue-guided search: a computational model of selective attention

Selective visual attention in a natural environment can be seen as the interaction between the external visual stimulus and task specific knowledge of the required behavior. This interaction between the bottom-up stimulus and the top-down, task-related knowledge is crucial for what is selected in the space and time within the scene. In this paper, we propose a computational model for selective attention for a visual search task. We go beyond simple saliency-based attention models to model selective attention guided by top-down visual cues, which are dynamically integrated with the bottom-up information. In this way, selection of a location is accomplished by interaction between bottom-up and top-down information. First, the general structure of our model is briefly introduced and followed by a description of the top-down processing of task-relevant cues. This is then followed by a description of the processing of the external images to give three feature maps that are combined to give an overall bottom-up map. Second, the development of the formalism for our novel interactive spiking neural network (ISNN) is given, with the interactive activation rule that calculates the integration map. The learning rule for both bottom-up and top-down weight parameters are given, together with some further analysis of the properties of the resulting ISNN. Third, the model is applied to a face detection task to search for the location of a specific face that is cued. The results show that the trajectories of attention are dramatically changed by interaction of information and variations of cues, giving an appropriate, task-relevant search pattern. Finally, we discuss ways in which these results can be seen as compatible with existing psychological evidence.

Efficient visual search without top-down or bottom-up guidance

Two types of mechanisms have dominated theoretical accounts of efficient visual search. The first are bottom-up processes related to the characteristics of retinotopic feature maps. The second are top-down mechanisms related to feature selection. To expose the potential involvement of other mechanisms, we introduce a new search paradigm whereby a target is defined only in a context-dependent manner by multiple conjunctions of feature dimensions. Because targets in a multiconjunction task cannot be distinguished from distractors either by bottom-up guidance or top-down guidance, current theories of visual search predict inefficient search. While inefficient search does occur for the multiple conjunctions of orientation with color or luminance, we find efficient search for multiple conjunctions of luminance/size, luminance/shape, and luminance/topology. We also show that repeated presentations of either targets or a set of distractors result in much faster performance and that bottom-up feature extraction and top-down selection cannot account for efficient search on their own. In light of this, we discuss the possible role of perceptual organization in visual search. Furthermore, multiconjunction search could provide a new method for investigating perceptual grouping in visual search.

Oscillatory model of attention-guided object selection and novelty detection

We develop a new oscillatory model that combines consecutive selection of objects and discrimination between new and familiar objects. The model works with visual information and fulfils the following operations: (1) separation of different objects according to their spatial connectivity; (2) consecutive selection of objects located in the visual field into the attention focus; (3) extraction of features; (4) representation of objects in working memory; (5) novelty detection of objects. The functioning of the model is based on two main principles: the synchronization of oscillators through phase-locking and resonant increase of the amplitudes of oscillators if they work in-phase with other oscillators. The results of computer simulation of the model are described for visual stimuli representing printed words.

Recurrent network with large representational capacity

A recurrent network is proposed with the ability to bind image features into a unified surface representation within a single layer and without capacity limitations or border effects. A group of cells belonging to the same object or surface is labeled with the same activity amplitude, while cells in different groups are kept segregated due to lateral inhibition. Labeling is achieved by activity spreading through local excitatory connections. In order to prevent uncontrolled spreading, a separate network computes the intensity difference between neighboring locations and signals the presence of the surface boundary, which constrains local excitation. The quality of surface representation is not compromised due to the self-excitation. The model is also applied on gray-level images. In order to remove small, noisy regions, a feedforward network is proposed that computes the size of surfaces. Size estimation is based on the difference of dendritic inhibition in lateral excitatory and inhibitory pathways, which allows the network to selectively integrate signals only from cells with the same activity amplitude. When the output of the size estimation network is combined with the recurrent network, good segmentation results are obtained. Both networks are based on biophysically realistic mechanisms such as dendritic inhibition and multiplicative integration among different dendritic branches.

Neural mechanism for noise exclusion in spatial cueing

Spatial cueing in an orientation discrimination task with targets embedded in high or low external noise indicates noise exclusion as a primary mechanism for attentional modulation. To implement noise exclusion in a neural network, a new mechanism is proposed based on a dendritic computation of difference between self-inhibition and lateral inhibition signals. A computer simulation illustrates that the model exhibits a strong cueing effect for high noise input and no effect when the noiseless input is presented, as is consistent with behavioral signatures of noise exclusion. It is argued that the model could also exhibit object-based selection if uniform activity distribution is assumed for all cells representing the object.

A neurodynamical model for selective visual attention using oscillators

We present a neurodynamical model to study and simulate visual search tasks experiments. The model consists of different pools of interconnected phase oscillators. Each oscillator is described by an integrate-and-fire type equation. Visual attention appears as an emergent property of the dynamic of the system, resulting from the temporal synchronization of the pools which bind the features of the searched target. The time courses observed in the psychophysical visual search experiments can be explained within a purely parallel dynamic and without assuming priority maps and serial spotlight mechanisms, as is usually done in the standard theories. The model fits also the measured activity reported for the neural responses in inferotemporal visual cortex of monkeys performing visual search tasks.