Feedback enhances feedforward figure-ground segmentation by changing firing mode

Spiking model of fixational eye movements and figure-ground segmentation

We present a model connecting eye movements and cortical state. Its structure includes simulated retinal images, motion detection, feature detectors and layers of spiking neurons. The designed scheme shows how the effect of micro-saccadic scale eye movements can lead to successful figure segregation in a figure-ground paradigm, by inducing changes in the neural dynamics through the time evolution of the inhibition range.

Vergence eye movements during figure-ground perception

Figure-ground, that is the segmentation of visual information into objects and their surrounding backgrounds, provides structure for visual attention. Recent evidence shows a novel role of vergence eye movements in visual attention. In the present work, vergence responses during figure-ground segregation tasks are psychophysically investigated. We show that during a figure-ground detection task, subjects convergence their eyes. Vergence eye movements are larger in figure trials than in ground trials. In detected figures trials, vergence are stronger than in trials where the figure went unnoticed. Moreover in figure trials, vergence responses are stronger to low-contrast figures than to high-contrast figures. We argue that these discriminative vergence responses have a role in figure-ground.

Early recurrence enables figure border ownership

Rubin's face-vase illusion demonstrates how one can switch back and forth between two different interpretations depending on how the figure outlines are assigned. In the primate visual system, assigning ownership along figure borders is encoded by neurons called the border ownership (BO) cells. Studies show that the responses of these neurons not only depend on the local features within their receptive fields, but also on contextual information. Despite two decades of studies on BO neurons, the ownership assignment mechanism in the brain is still unknown. Here, we propose a hierarchical recurrent model grounded on the hypothesis that neurons in the dorsal stream provide the context required for ownership assignment. Our proposed model incorporates early recurrence from the dorsal pathway as well as lateral modulations within the ventral stream. While dorsal modulations initiate the response difference to figure on either side of the border, lateral modulations enhance the difference. We found responses of our dorsally-modulated BO cells, similar to their biological counterparts, are invariant to size, position and solid/outlined figures. Moreover, our model BO cells exhibit comparable levels of reliability in the ownership signal to biological BO neurons. We found dorsal modulations result in high levels of accuracy and robustness for BO assignments in complex scenes compared to previous models based on ventral feedback. Finally, our experiments with illusory contours suggest that BO encoding could explain the perception of such contours in higher processing stages in the brain.

Early Numerosity Encoding in Visual Cortex Is Not Sufficient for the Representation of Numerical Magnitude

Recent studies have demonstrated that the numerosity of visually presented dot arrays is represented in low-level visual cortex extremely early in latency. However, whether or not such an early neural signature reflects the perceptual representation of numerosity remains unknown. Alternatively, such a signature may indicate the raw sensory representation of the dot-array stimulus before becoming the perceived representation of numerosity. Here, we addressed this question by using the connectedness illusion, whereby arrays with pairwise connected dots are perceived to be less numerous compared with arrays containing isolated dots. Using EEG and fMRI in two independent experiments, we measured neural responses to dot-array stimuli comprising 16 or 32 dots, either isolated or pairwise connected. The effect of connectedness, which reflects the segmentation of the visual stimulus into perceptual units, was observed in the neural activity after 150 msec post stimulus onset in the EEG experiment and in area V3 in the fMRI experiment using a multivariate pattern analysis. In contrast, earlier neural activity before 100 msec and in area V2 was strictly modulated by numerosity regardless of connectedness, suggesting that this early activity reflects the sensory representation of a dot array before perceptual segmentation. Our findings thus demonstrate that the neural representation for numerosity in early visual cortex is not sufficient for visual number perception and suggest that the perceptual encoding of numerosity occurs at or after the segmentation process that takes place later in area V3.

Pharmacological manipulation of GABA activity in nucleus subpretectalis/interstitio-pretecto-subpretectalis (SP/IPS) impairs figure-ground discrimination in pigeons: Running head: SP/IPS in figure-ground segregation

Figure-ground segregation is a fundamental visual ability that allows an organism to separate an object from its background. Our earlier research has shown that nucleus rotundus (Rt), a thalamic nucleus processing visual information in pigeons, together with its inhibitory complex, nucleus subpretectalis/interstitio-pretecto-subpretectalis (SP/IPS), are critically involved in figure-ground discrimination (Acerbo et al., 2012; Scully et al., 2014). Here, we further investigated the role of SP/IPS by conducting bilateral microinjections of GABAergic receptor antagonist and agonists (bicuculline and muscimol, respectively) and non-NMDA glutamate receptor antagonist (CNQX) after the pigeons mastered figure-ground discrimination task. We used two doses of each drug (bicuculline: 0.1 mM and 0.05 mM; muscimol: 4.4 mM and 8.8 mM; CNQX: 2.15 mM and 4.6 mM) in a within-subject design, and alternated drug injections with baseline (ACSF). The order of injections was randomized across birds to reduce potential carryover effects. We found that a low dose of bicuculline produced a decrement on figure trials but not on background trials, whereas a high dose impaired performance on background trials but not on figure trials. Muscimol produced an equivalent, dose-dependent impairment on both types of trials. Finally, CNQX had no consistent effect at either dose. Together, these results further confirm our earlier hypothesis that inhibitory projections from SP to Rt modulate figure-ground discrimination, and suggest that the Rt and the SP/IPS provide a plausible substrate that could perform figure-ground segregation in avian brain.

Attentional Selection Accompanied by Eye Vergence as Revealed by Event-Related Brain Potentials

Neural mechanisms of attention allow selective sensory information processing. Top-down deployment of visual-spatial attention is conveyed by cortical feedback connections from frontal regions to lower sensory areas modulating late stimulus responses. A recent study reported the occurrence of small eye vergence during orienting top-down attention. Here we assessed a possible link between vergence and attention by comparing visual event related potentials (vERPs) to a cue stimulus that induced attention to shift towards the target location to the vERPs to a no-cue stimulus that did not trigger orienting attention. The results replicate the findings of eye vergence responses during orienting attention and show that the strength and time of eye vergence coincide with the onset and strength of the vERPs when subjects oriented attention. Our findings therefore support the idea that eye vergence relates to and possibly has a role in attentional selection.

Global oscillation regime change by gated inhibition

The role of sensory inputs in the modelling of synchrony regimes is exhibited by means of networks of spiking cells where the relative strength of the inhibitory interaction is controlled by the activation of a linear unit working as a gating variable. Adaptation to stimulus size is determined by the value of a changing length scale, modelled by the time-varying radius of a circular receptive field. In this set-up, 'consolidation' time intervals relevant to attentional effects are shown to depend on the dynamics governing the evolution of the introduced length scale.

Neural dynamics of feedforward and feedback processing in figure-ground segregation

Determining whether a region belongs to the interior or exterior of a shape (figure-ground segregation) is a core competency of the primate brain, yet the underlying mechanisms are not well understood. Many models assume that figure-ground segregation occurs by assembling progressively more complex representations through feedforward connections, with feedback playing only a modulatory role. We present a dynamical model of figure-ground segregation in the primate ventral stream wherein feedback plays a crucial role in disambiguating a figure's interior and exterior. We introduce a processing strategy whereby jitter in RF center locations and variation in RF sizes is exploited to enhance and suppress neural activity inside and outside of figures, respectively. Feedforward projections emanate from units that model cells in V4 known to respond to the curvature of boundary contours (curved contour cells), and feedback projections from units predicted to exist in IT that strategically group neurons with different RF sizes and RF center locations (teardrop cells). Neurons (convex cells) that preferentially respond when centered on a figure dynamically balance feedforward (bottom-up) information and feedback from higher visual areas. The activation is enhanced when an interior portion of a figure is in the RF via feedback from units that detect closure in the boundary contours of a figure. Our model produces maximal activity along the medial axis of well-known figures with and without concavities, and inside algorithmically generated shapes. Our results suggest that the dynamic balancing of feedforward signals with the specific feedback mechanisms proposed by the model is crucial for figure-ground segregation.

A feed-forward spiking model of shape-coding by IT cells

The ability to recognize a shape is linked to figure-ground (FG) organization. Cell preferences appear to be correlated across contrast-polarity reversals and mirror reversals of polygon displays, but not so much across FG reversals. Here we present a network structure which explains both shape-coding by simulated IT cells and suppression of responses to FG reversed stimuli. In our model FG segregation is achieved before shape discrimination, which is itself evidenced by the difference in spiking onsets of a pair of output cells. The studied example also includes feature extraction and illustrates a classification of binary images depending on the dominance of vertical or horizontal borders.

Stimulus detection after interruption of the feedforward response in a backward masking paradigm

In backward masking, a target stimulus is rendered invisible by the presentation of a second stimulus, the mask. When the mask is effective, neural responses to the target are suppressed. Nevertheless, weak target responses sometimes may produce a behavioural response. It remains unclear whether the reduced target response is a purely feedforward response or that it includes recurrent activity. Using a feedforward neural network of biological plausible spiking neurons, we tested whether a transient spike burst is sufficient for face categorization. After training the network, the system achieved face/non-face categorization for sets of grayscale images. In a backward masking paradigm, the transient burst response was cut off thereby reducing the feedforward target response. Despite the suppressed feedforward responses stimulus classification remained robust. Thus according to our model data stimulus detection is possible with purely, suppressed feedforward responses.

Noise destroys feedback enhanced figure-ground segmentation but not feedforward figure-ground segmentation

Figure-ground (FG) segmentation is the separation of visual information into background and foreground objects. In the visual cortex, FG responses are observed in the late stimulus response period, when neurons fire in tonic mode, and are accompanied by a switch in cortical state. When such a switch does not occur, FG segmentation fails. Currently, it is not known what happens in the brain on such occasions. A biologically plausible feedforward spiking neuron model was previously devised that performed FG segmentation successfully. After incorporating feedback the FG signal was enhanced, which was accompanied by a change in spiking regime. In a feedforward model neurons respond in a bursting mode whereas in the feedback model neurons fired in tonic mode. It is known that bursts can overcome noise, while tonic firing appears to be much more sensitive to noise. In the present study, we try to elucidate how the presence of noise can impair FG segmentation, and to what extent the feedforward and feedback pathways can overcome noise. We show that noise specifically destroys the feedback enhanced FG segmentation and leaves the feedforward FG segmentation largely intact. Our results predict that noise produces failure in FG perception.

Masking of figure-ground texture and single targets by surround inhibition: a computational spiking model

A visual stimulus can be made invisible, i.e. masked, by the presentation of a second stimulus. In the sensory cortex, neural responses to a masked stimulus are suppressed, yet how this suppression comes about is still debated. Inhibitory models explain masking by asserting that the mask exerts an inhibitory influence on the responses of a neuron evoked by the target. However, other models argue that the masking interferes with recurrent or reentrant processing. Using computer modeling, we show that surround inhibition evoked by ON and OFF responses to the mask suppresses the responses to a briefly presented stimulus in forward and backward masking paradigms. Our model results resemble several previously described psychophysical and neurophysiological findings in perceptual masking experiments and are in line with earlier theoretical descriptions of masking. We suggest that precise spatiotemporal influence of surround inhibition is relevant for visual detection.

Proline and COMT status affect visual connectivity in children with 22q11.2 deletion syndrome

Background

Individuals with the 22q11.2 deletion syndrome (22q11DS) are at increased risk for schizophrenia and Autism Spectrum Disorders (ASDs). Given the prevalence of visual processing deficits in these three disorders, a causal relationship between genes in the deleted region of chromosome 22 and visual processing is likely. Therefore, 22q11DS may represent a unique model to understand the neurobiology of visual processing deficits related with ASD and psychosis.

Methodology

We measured Event-Related Potentials (ERPs) during a texture segregation task in 58 children with 22q11DS and 100 age-matched controls. The C1 component was used to index afferent activity of visual cortex area V1; the texture negativity wave provided a measure for the integrity of recurrent connections in the visual cortical system. COMT genotype and plasma proline levels were assessed in 22q11DS individuals.

Principal Findings

Children with 22q11DS showed enhanced feedforward activity starting from 70 ms after visual presentation. ERP activity related to visual feedback activity was reduced in the 22q11DS group, which was seen as less texture negativity around 150 ms post presentation. Within the 22q11DS group we further demonstrated an association between high plasma proline levels and aberrant feedback/feedforward ratios, which was moderated by the COMT¹⁵⁸ genotype.

Conclusions

These findings confirm the presence of early visual processing deficits in 22q11DS. We discuss these in terms of dysfunctional synaptic plasticity in early visual processing areas, possibly associated with deviant dopaminergic and glutamatergic transmission. As such, our findings may serve as a promising biomarker related to the development of schizophrenia among 22q11DS individuals.