Cue-invariant detection of centre-surround discontinuity by V1 neurons in awake macaque monkey

Visual surround suppression at the neural and perceptual levels

Surround suppression was initially identified as a phenomenon at the neural level in which stimuli outside the neuron's receptive field alone cannot activate responses but can modulate neural responses to stimuli covered inside the receptive field. Subsequent studies showed that surround suppression is not only a critical property of neurons across species and brain areas but also has been found in visual perceptions. More importantly, surround suppression varies across individuals and shows significant differences between normal controls and patients with certain mental disorders. Here, we combined results from related literature and summarized the findings derived from physiological and psychophysical evidence. We first outline the basic properties of surround suppression in the visual system and perceptions. Then, we mainly summarize the differences in perceptual surround suppression among different human subjects. Our review suggests that there is no consensus regarding whether the strength of perceptual surround suppression could be used as an effective index to distinguish particular populations. Then, we summarized the similar mechanisms for surround suppression and cognitive impairments to further explore the potential clinical applications of surround suppression. A clearer understanding of the mechanisms of surround suppression in neural responses and perceptions is necessary for facilitating its clinical applications.

Cognitive penetrability of scene representations based on horizontal image disparities

The structure of natural scenes is signaled by many visual cues. Principal amongst them are the binocular disparities created by the laterally separated viewpoints of the two eyes. Disparity cues are believed to be processed hierarchically, first in terms of local measurements of absolute disparity and second in terms of more global measurements of relative disparity that allow extraction of the depth structure of a scene. Psychophysical and oculomotor studies have suggested that relative disparities are particularly relevant to perception, whilst absolute disparities are not. Here, we compare neural responses to stimuli that isolate the absolute disparity cue with stimuli that contain additional relative disparity cues, using the high temporal resolution of EEG to determine the temporal order of absolute and relative disparity processing. By varying the observers' task, we assess the extent to which each cue is cognitively penetrable. We find that absolute disparity is extracted before relative disparity, and that task effects arise only at or after the extraction of relative disparity. Our results indicate a hierarchy of disparity processing stages leading to the formation of a proto-object representation upon which higher cognitive processes can act.

Visually induced γ band rhythm in spatial summation beyond the receptive field in mouse primary visual cortex

Recent studies in many kinds of mammals have established the existence of multiple γ rhythms in the cerebral cortex subserving different functions. In the primary visual cortex (V1), visually induced γ rhythms are dependent on stimulus features. However, experimental findings of γ power induced by varying the size of the drifting grating are inconsistent. Here, we reinvestigated the spatial summation properties of visually induced spike and γ rhythm activities in mouse V1. Our results show that drifting sinusoidal grating stimuli mainly induce 2 γ band rhythms, including a low-frequency band (25-45 Hz) and a high-frequency band (55-75 Hz). Unlike previous findings, we discovered that visually induced γ power could also exhibit extrareceptive field (ERF) modulatory properties. The modulation by ERF stimulation could be either suppressive, countersuppressive, or nonsuppressive, mostly similar to the local spike activity. Moreover, further analysis of the neuron group exhibiting surround suppression in both spike and γ activity revealed that the strength of the surround suppression and the receptive field size showed moderate correlations between measurements by spike and γ rhythm activity. Our findings improve the understanding of the characteristics and neural mechanisms of induced γ rhythms in visual spatial summation.

Hidden in plain sight

[Figure: see text].

Feedback generates a second receptive field in neurons of the visual cortex

Animals sense the environment through pathways that link sensory organs to the brain. In the visual system, these feedforward pathways define the classical feedforward receptive field (ffRF), the area in space in which visual stimuli excite a neuron1. The visual system also uses visual context-the visual scene surrounding a stimulus-to predict the content of the stimulus2, and accordingly, neurons have been identified that are excited by stimuli outside their ffRF3-8. However, the mechanisms that generate excitation to stimuli outside the ffRF are unclear. Here we show that feedback projections onto excitatory neurons in the mouse primary visual cortex generate a second receptive field that is driven by stimuli outside the ffRF. The stimulation of this feedback receptive field (fbRF) elicits responses that are slower and are delayed in comparison with those resulting from the stimulation of the ffRF. These responses are preferentially reduced by anaesthesia and by silencing higher visual areas. Feedback inputs from higher visual areas have scattered receptive fields relative to their putative targets in the primary visual cortex, which enables the generation of the fbRF. Neurons with fbRFs are located in cortical layers that receive strong feedback projections and are absent in the main input layer, which is consistent with a laminar processing hierarchy. The observation that large, uniform stimuli-which cover both the fbRF and the ffRF-suppress these responses indicates that the fbRF and the ffRF are mutually antagonistic. Whereas somatostatin-expressing inhibitory neurons are driven by these large stimuli, inhibitory neurons that express parvalbumin and vasoactive intestinal peptide have mutually antagonistic fbRF and ffRF, similar to excitatory neurons. Feedback projections may therefore enable neurons to use context to estimate information that is missing from the ffRF and to report differences in stimulus features across visual space, regardless of whether excitation occurs inside or outside the ffRF. By complementing the ffRF, the fbRF that we identify here could contribute to predictive processing.

Image Segmentation Based on Relative Motion and Relative Disparity Cues in Topographically Organized Areas of Human Visual Cortex

The borders between objects and their backgrounds create discontinuities in image feature maps that can be used to recover object shape. Here we used functional magnetic resonance imaging to identify cortical areas that encode two of the most important image segmentation cues: relative motion and relative disparity. Relative motion and disparity cues were isolated by defining a central 2-degree disk using random-dot kinematograms and stereograms, respectively. For motion, the disk elicited retinotopically organized activations starting in V1 and extending through V2 and V3. In the surrounding region, we observed phase-inverted activations indicative of suppression, extending out to at least 6 degrees of retinal eccentricity. For disparity, disk activations were only found in V3, while suppression was observed in all early visual areas. Outside of early visual cortex, several areas were sensitive to both types of cues, most notably LO1, LO2 and V3B, making them additional candidate areas for motion- and disparity-cue combination. Adding an orthogonal task at fixation did not diminish these effects, and in fact led to small but measurable disk activations in V1 and V2 for disparity. The overall pattern of extra-striate activations is consistent with recent three-stream models of cortical organization.

Subdomains within orientation columns of primary visual cortex

In the mammalian visual system, early stages of visual form processing begin with orientation-selective neurons in primary visual cortex (V1). In many species (including humans, monkeys, tree shrews, cats, and ferrets), these neurons are organized in a beautifully arrayed pinwheel-like orientation columns, which shift in orientation preference across V1. However, to date, the relationship of orientation architecture to the encoding of multiple elemental aspects of visual contours is still unknown. Here, using a novel, highly accurate method of targeting electrode position, we report for the first time the presence of three subdomains within single orientation domains. We suggest that these zones subserve computation of distinct aspects of visual contours and propose a novel tripartite pinwheel-centered view of an orientation hypercolumn.

Revisiting the functional significance of binocular cues for perceiving motion-in-depth

Binocular differencing of spatial cues required for perceiving depth relationships is associated with decreased sensitivity to the corresponding retinal image displacements. However, binocular summation of contrast signals increases sensitivity. Here, we investigated this divergence in sensitivity by making direct neural measurements of responses to suprathreshold motion in human adults and 5-month-old infants using steady-state visually evoked potentials. Interocular differences in retinal image motion generated suppressed response functions and correspondingly elevated perceptual thresholds compared to motion matched between the two eyes. This suppression was of equal strength for horizontal and vertical motion and therefore not specific to the perception of motion-in-depth. Suppression is strongly dependent on the presence of spatial references in the image and highly immature in infants. Suppression appears to be the manifestation of a succession of spatial and interocular opponency operations that occur at an intermediate processing stage either before or in parallel with the extraction of motion-in-depth.

A Fast Contour Detection Model Inspired by Biological Mechanisms in Primary Vision System

Compared to computer vision systems, the human visual system is more fast and accurate. It is well accepted that V1 neurons can well encode contour information. There are plenty of computational models about contour detection based on the mechanism of the V1 neurons. Multiple-cue inhibition operator is one well-known model, which is based on the mechanism of V1 neurons' non-classical receptive fields. However, this model is time-consuming and noisy. To solve these two problems, we propose an improved model which integrates some additional other mechanisms of the primary vision system. Firstly, based on the knowledge that the salient contours only occupy a small portion of the whole image, the prior filtering is introduced to decrease the running time. Secondly, based on the physiological finding that nearby neurons often have highly correlated responses and thus include redundant information, we adopt the uniform samplings to speed up the algorithm. Thirdly, sparse coding is introduced to suppress the unwanted noises. Finally, to validate the performance, we test it on Berkeley Segmentation Data Set. The results show that the improved model can decrease running time as well as keep the accuracy of the contour detection.

Phase-specific Surround suppression in Mouse Primary Visual Cortex Correlates with Figure Detection Behavior Based on Phase Discontinuity

In the primary visual cortex (V1), neuronal responses to stimuli within the receptive field (RF) are modulated by stimuli in the RF surround. A common effect of surround modulation is surround suppression, which is dependent on the feature difference between stimuli within and surround the RF and is suggested to be involved in the perceptual phenomenon of figure-ground segregation. In this study, we examined the relationship between feature-specific surround suppression of V1 neurons and figure detection behavior based on figure-ground feature difference. We trained freely moving mice to perform a figure detection task using figure and ground gratings that differed in spatial phase. The performance of figure detection increased with the figure-ground phase difference, and was modulated by stimulus contrast. Electrophysiological recordings from V1 in head-fixed mice showed that the increase in phase difference between stimuli within and surround the RF caused a reduction in surround suppression, which was associated with an increase in V1 neural discrimination between stimuli with and without RF-surround phase difference. Consistent with the behavioral performance, the sensitivity of V1 neurons to RF-surround phase difference could be influenced by stimulus contrast. Furthermore, inhibiting V1 by optogenetically activating either parvalbumin (PV)- or somatostatin (SOM)-expressing inhibitory neurons both decreased the behavioral performance of figure detection. Thus, the phase-specific surround suppression in V1 represents a neural correlate of figure detection behavior based on figure-ground phase discontinuity.

ASCII Art Synthesis from Natural Photographs

While ASCII art is a worldwide popular art form, automatic generating structure-based ASCII art from natural photographs remains challenging. The major challenge lies on extracting the perception-sensitive structure from the natural photographs so that a more concise ASCII art reproduction can be produced based on the structure. However, due to excessive amount of texture in natural photos, extracting perception-sensitive structure is not easy, especially when the structure may be weak and within the texture region. Besides, to fit different target text resolutions, the amount of the extracted structure should also be controllable. To tackle these challenges, we introduce a visual perception mechanism of non-classical receptive field modulation (non-CRF modulation) from physiological findings to this ASCII art application, and propose a new model of non-CRF modulation which can better separate the weak structure from the crowded texture, and also better control the scale of texture suppression. Thanks to our non-CRF model, more sensible ASCII art reproduction can be obtained. In addition, to produce more visually appealing ASCII arts, we propose a novel optimization scheme to obtain the optimal placement of proportional-font characters. We apply our method on a rich variety of images, and visually appealing ASCII art can be obtained in all cases.

End-Stopping Predicts Curvature Tuning along the Ventral Stream

Neurons in primate inferotemporal cortex (IT) are clustered into patches of shared image preferences. Functional imaging has shown that these patches are activated by natural categories (e.g., faces, body parts, and places), artificial categories (numerals, words) and geometric features (curvature and real-world size). These domains develop in the same cortical locations across monkeys and humans, which raises the possibility of common innate mechanisms. Although these commonalities could be high-level template-based categories, it is alternatively possible that the domain locations are constrained by low-level properties such as end-stopping, eccentricity, and the shape of the preferred images. To explore this, we looked for correlations among curvature preference, receptive field (RF) end-stopping, and RF eccentricity in the ventral stream. We recorded from sites in V1, V4, and posterior IT (PIT) from six monkeys using microelectrode arrays. Across all visual areas, we found a tendency for end-stopped sites to prefer curved over straight contours. Further, we found a progression in population curvature preferences along the visual hierarchy, where, on average, V1 sites preferred straight Gabors, V4 sites preferred curved stimuli, and many PIT sites showed a preference for curvature that was concave relative to fixation. Our results provide evidence that high-level functional domains may be mapped according to early rudimentary properties of the visual system.

SIGNIFICANCE STATEMENT

The macaque occipitotemporal cortex contains clusters of neurons with preferences for categories such as faces, body parts, and places. One common question is how these clusters (or "domains") acquire their cortical position along the ventral stream. We and other investigators previously established an fMRI-level correlation among these category domains, retinotopy, and curvature preferences: for example, in inferotemporal cortex, face- and curvature-preferring domains show a central visual field bias whereas place- and rectilinear-preferring domains show a more peripheral visual field bias. Here, we have found an electrophysiological-level explanation for the correlation among domain preference, curvature, and retinotopy based on neuronal preference for short over long contours, also called end-stopping.

The effects of orientation and attention during surround suppression of small image features: A 7 Tesla fMRI study

Although V1 responses are driven primarily by elements within a neuron's receptive field, which subtends about 1° visual angle in parafoveal regions, previous work has shown that localized fMRI responses to visual elements reflect not only local feature encoding but also long-range pattern attributes. However, separating the response to an image feature from the response to the surrounding stimulus and studying the interactions between these two responses demands both spatial precision and signal independence, which may be challenging to attain with fMRI. The present study used 7 Tesla fMRI with 1.2-mm resolution to measure the interactions between small sinusoidal grating patches (targets) at 3° eccentricity and surrounds of various sizes and orientations to test the conditions under which localized, context-dependent fMRI responses could be predicted from either psychophysical or electrophysiological data. Targets were presented at 8%, 16%, and 32% contrast while manipulating (a) spatial extent of parallel (strongly suppressive) or orthogonal (weakly suppressive) surrounds, (b) locus of attention, (c) stimulus onset asynchrony between target and surround, and (d) blocked versus event-related design. In all experiments, the V1 fMRI signal was lower when target stimuli were flanked by parallel versus orthogonal context. Attention amplified fMRI responses to all stimuli but did not show a selective effect on central target responses or a measurable effect on orientation-dependent surround suppression. Suppression of the V1 fMRI response by parallel surrounds was stronger than predicted from psychophysics but showed a better match to previous electrophysiological reports.

Potential roles of the interaction between model V1 neurons with orientation-selective and non-selective surround inhibition in contour detection

Both the neurons with orientation-selective and with non-selective surround inhibition have been observed in the primary visual cortex (V1) of primates and cats. Though the inhibition coming from the surround region (named as non-classical receptive field, nCRF) has been considered playing critical role in visual perception, the specific role of orientation-selective and non-selective inhibition in the task of contour detection is less known. To clarify above question, we first carried out computational analysis of the contour detection performance of V1 neurons with different types of surround inhibition, on the basis of which we then proposed two integrated models to evaluate their role in this specific perceptual task by combining the two types of surround inhibition with two different ways. The two models were evaluated with synthetic images and a set of challenging natural images, and the results show that both of the integrated models outperform the typical models with orientation-selective or non-selective inhibition alone. The findings of this study suggest that V1 neurons with different types of center–surround interaction work in cooperative and adaptive ways at least when extracting organized structures from cluttered natural scenes. This work is expected to inspire efficient phenomenological models for engineering applications in field of computational machine-vision.

Input-gain control produces feature-specific surround suppression

In primary visual cortex (V1), neuronal responses are sensitive to context. For example, responses to stimuli presented within the receptive field (RF) center are often suppressed by stimuli within the RF surround, and this suppression tends to be strongest when the center and surround stimuli match. We sought to identify the mechanism that gives rise to these properties of surround modulation. To do so, we exploited the stability of implanted multielectrode arrays to record from neurons in V1 of alert monkeys with multiple stimulus sets that more exhaustively probed center-surround interactions. We first replicated previous results concerning center-surround similarity using gratings representing all combinations of center and surround orientation. With this stimulus set, the surround simply scaled population responses to the center, such that the overall population tuning curve had the same shape and peak response. However, when the center contained two superimposed gratings (i.e., a visual "plaid"), one component of which always matched the surround orientation, suppression selectively affected the portion of the response driven by the matching center component, thereby producing shifts in the peak of the population orientation tuning curve. In effect, the surround caused neurons to respond predominantly to the component grating of the center plaid that was unmatched to the surround grating, as if by reducing the effective strength of whichever stimulus attributes were matched to the surround. These results provide key physiological support for theoretical models that propose feature-specific, input-gain control as the mechanism underlying surround suppression.

Multifeature-based surround inhibition improves contour detection in natural images

To effectively perform visual tasks like detecting contours, the visual system normally needs to integrate multiple visual features. Sufficient physiological studies have revealed that for a large number of neurons in the primary visual cortex (V1) of monkeys and cats, neuronal responses elicited by the stimuli placed within the classical receptive field (CRF) are substantially modulated, normally inhibited, when difference exists between the CRF and its surround, namely, non-CRF, for various local features. The exquisite sensitivity of V1 neurons to the center-surround stimulus configuration is thought to serve important perceptual functions, including contour detection. In this paper, we propose a biologically motivated model to improve the performance of perceptually salient contour detection. The main contribution is the multifeature-based center-surround framework, in which the surround inhibition weights of individual features, including orientation, luminance, and luminance contrast, are combined according to a scale-guided strategy, and the combined weights are then used to modulate the final surround inhibition of the neurons. The performance was compared with that of single-cue-based models and other existing methods (especially other biologically motivated ones). The results show that combining multiple cues can substantially improve the performance of contour detection compared with the models using single cue. In general, luminance and luminance contrast contribute much more than orientation to the specific task of contour extraction, at least in gray-scale natural images.

An Orientation Map for Motion Boundaries in Macaque V2

The ability to extract the shape of moving objects is fundamental to visual perception. However, where such computations are processed in the visual system is unknown. To address this question, we used intrinsic signal optical imaging in awake monkeys to examine cortical response to perceptual contours defined by motion contrast (motion boundaries, MBs). We found that MB stimuli elicit a robust orientation response in area V2. Orientation maps derived from subtraction of orthogonal MB stimuli aligned well with the orientation maps obtained with luminance gratings (LGs). In contrast, area V1 responded well to LGs, but exhibited a much weaker orientation response to MBs. We further show that V2 direction domains respond to motion contrast, which is required in the detection of MB in V2. These results suggest that V2 represents MB information, an important prerequisite for shape recognition and figure-ground segregation.

Experience-dependent specialization of receptive field surround for selective coding of natural scenes

At eye opening, neurons in primary visual cortex (V1) are selective for stimulus features, but circuits continue to refine in an experience-dependent manner for some weeks thereafter. How these changes contribute to the coding of visual features embedded in complex natural scenes remains unknown. Here we show that normal visual experience after eye opening is required for V1 neurons to develop a sensitivity for the statistical structure of natural stimuli extending beyond the boundaries of their receptive fields (RFs), which leads to improvements in coding efficiency for full-field natural scenes (increased selectivity and information rate). These improvements are mediated by an experience-dependent increase in the effectiveness of natural surround stimuli to hyperpolarize the membrane potential specifically during RF-stimulus epochs triggering action potentials. We suggest that neural circuits underlying surround modulation are shaped by the statistical structure of visual input, which leads to more selective coding of features in natural scenes.

•

V1 firing is more selective to natural than phase-scrambled surround stimuli

•

Improved selectivity is caused by Vm hyperpolarisation prior to RF-spiking events

•

Natural surround sensitivity is experience dependent, absent in immature/deprived V1

•

Vision shapes circuits to improve V1 coding of natural scenes across RF and surround

The detection of orientation continuity and discontinuity by cat V1 neurons

The orientation tuning properties of the non-classical receptive field (nCRF or “surround”) relative to that of the classical receptive field (CRF or “center”) were tested for 119 neurons in the cat primary visual cortex (V1). The stimuli were concentric sinusoidal gratings generated on a computer screen with the center grating presented at an optimal orientation to stimulate the CRF and the surround grating with variable orientations stimulating the nCRF. Based on the presence or absence of surround suppression, measured by the suppression index at the optimal orientation of the cells, we subdivided the neurons into two categories: surround-suppressive (SS) cells and surround-non-suppressive (SN) cells. When stimulated with an optimally oriented grating centered at CRF, the SS cells showed increasing surround suppression when the stimulus grating was expanded beyond the boundary of the CRF, whereas for the SN cells, expanding the stimulus grating beyond the CRF caused no suppression of the center response. For the SS cells, strength of surround suppression was dependent on the relative orientation between CRF and nCRF: an iso-orientation grating over center and surround at the optimal orientation evoked strongest suppression and a surround grating orthogonal to the optimal center grating evoked the weakest or no suppression. By contrast, the SN cells showed slightly increased responses to an iso-orientation stimulus and weak suppression to orthogonal surround gratings. This iso-/orthogonal orientation selectivity between center and surround was analyzed in 22 SN and 97 SS cells, and for the two types of cells, the different center-surround orientation selectivity was dependent on the suppressive strength of the cells. We conclude that SN cells are suitable to detect orientation continuity or similarity between CRF and nCRF, whereas the SS cells are adapted to the detection of discontinuity or differences in orientation between CRF and nCRF.

Major histocompatibility complex class I haplotype diversity in Chinese rhesus macaques

The use of Chinese-origin rhesus macaques (Macaca mulatta) for infectious disease immunity research is increasing despite the relative lack of major histocompatibility complex (MHC) class I immunogenetics information available for this population. We determined transcript-based MHC class I haplotypes for 385 Chinese rhesus macaques from five different experimental cohorts, providing a concise representation of the full complement of MHC class I major alleles expressed by each animal. In total, 123 Mamu-A and Mamu-B haplotypes were defined in the full Chinese rhesus macaque cohort. We then performed an analysis of haplotype frequencies across the experimental cohorts of Chinese rhesus macaques, as well as a comparison against a group of 96 Indian rhesus macaques. Notably, 35 of the 51 Mamu-A and Mamu-B haplotypes observed in Indian rhesus macaques were also detected in the Chinese population, with 85% of the 385 Chinese-origin rhesus macaques expressing at least one of these class I haplotypes. This unexpected conservation of Indian rhesus macaque MHC class I haplotypes in the Chinese rhesus macaque population suggests that immunologic insights originally gleaned from studies using Indian rhesus macaques may be more applicable to Chinese rhesus macaques than previously appreciated and may provide an opportunity for studies of CD8(+) T-cell responses between populations. It may also be possible to extend these studies across multiple species of macaques, as we found evidence of shared ancestral haplotypes between Chinese rhesus and Mauritian cynomolgus macaques.

Motion-defined contour processing in the early visual cortex

From our daily experience, it is very clear that relative motion cues can contribute to correctly identifying object boundaries and perceiving depth. Motion-defined contours are not only generated by the motion of objects in a scene but also by the movement of an observer's head and body (motion parallax). However, the neural mechanism involved in detecting these contours is still unknown. To explore this mechanism, we extracellularly recorded visual responses of area 18 neurons in anesthetized and paralyzed cats. The goal of this study was to determine if motion-defined contours could be detected by neurons that have been previously shown to detect luminance-, texture-, and contrast-defined contours cue invariantly. Motion-defined contour stimuli were generated by modulating the velocity of high spatial frequency sinusoidal luminance gratings (carrier gratings) by a moving squarewave envelope. The carrier gratings were outside the luminance passband of a neuron, such that presence of the carrier alone within the receptive field did not elicit a response. Most neurons that responded to contrast-defined contours also responded to motion-defined contours. The orientation and direction selectivity of these neurons for motion-defined contours was similar to that of luminance gratings. A given neuron also exhibited similar selectivity for the spatial frequency of the carrier gratings of contrast- and motion-defined contours. These results suggest that different second-order contours are detected in a form-cue invariant manner, through a common neural mechanism in area 18.

The time course of segmentation and cue-selectivity in the human visual cortex

Texture discontinuities are a fundamental cue by which the visual system segments objects from their background. The neural mechanisms supporting texture-based segmentation are therefore critical to visual perception and cognition. In the present experiment we employ an EEG source-imaging approach in order to study the time course of texture-based segmentation in the human brain. Visual Evoked Potentials were recorded to four types of stimuli in which periodic temporal modulation of a central 3° figure region could either support figure-ground segmentation, or have identical local texture modulations but not produce changes in global image segmentation. The image discontinuities were defined either by orientation or phase differences across image regions. Evoked responses to these four stimuli were analyzed both at the scalp and on the cortical surface in retinotopic and functional regions-of-interest (ROIs) defined separately using fMRI on a subject-by-subject basis. Texture segmentation (tsVEP: segmenting versus non-segmenting) and cue-specific (csVEP: orientation versus phase) responses exhibited distinctive patterns of activity. Alternations between uniform and segmented images produced highly asymmetric responses that were larger after transitions from the uniform to the segmented state. Texture modulations that signaled the appearance of a figure evoked a pattern of increased activity starting at ∼143 ms that was larger in V1 and LOC ROIs, relative to identical modulations that didn't signal figure-ground segmentation. This segmentation-related activity occurred after an initial response phase that did not depend on the global segmentation structure of the image. The two cue types evoked similar tsVEPs up to 230 ms when they differed in the V4 and LOC ROIs. The evolution of the response proceeded largely in the feed-forward direction, with only weak evidence for feedback-related activity.

Cortical Surround Interactions and Perceptual Salience via Natural Scene Statistics

Spatial context in images induces perceptual phenomena associated with salience and modulates the responses of neurons in primary visual cortex (V1). However, the computational and ecological principles underlying contextual effects are incompletely understood. We introduce a model of natural images that includes grouping and segmentation of neighboring features based on their joint statistics, and we interpret the firing rates of V1 neurons as performing optimal recognition in this model. We show that this leads to a substantial generalization of divisive normalization, a computation that is ubiquitous in many neural areas and systems. A main novelty in our model is that the influence of the context on a target stimulus is determined by their degree of statistical dependence. We optimized the parameters of the model on natural image patches, and then simulated neural and perceptual responses on stimuli used in classical experiments. The model reproduces some rich and complex response patterns observed in V1, such as the contrast dependence, orientation tuning and spatial asymmetry of surround suppression, while also allowing for surround facilitation under conditions of weak stimulation. It also mimics the perceptual salience produced by simple displays, and leads to readily testable predictions. Our results provide a principled account of orientation-based contextual modulation in early vision and its sensitivity to the homogeneity and spatial arrangement of inputs, and lends statistical support to the theory that V1 computes visual salience.

Contrast-dependent variations in the excitatory classical receptive field and suppressive nonclassical receptive field of cat primary visual cortex

In area V1 of cat and monkey, there is a surround region beyond the classical receptive field (CRF) which alone is unresponsive but may modulate the cell's response. This field is referred to as the "nonclassical receptive field" (nCRF). It has been reported in monkey that the extent of CRF and/or nCRF of V1 neurons is not fixed but varies with stimulus contrast. We reexamined the contrast dependence of V1 neurons in cat to determine whether this differs from previous studies in macaque. By fitting the spatial summation curves obtained at different contrasts with a difference of Gaussians model, we estimated quantitatively the effect of contrast on the spatial extent of the CRF and nCRF as well as the strength of surround suppression. Our results showed that both the CRF and nCRF expanded at low contrast, but the expansion is more marked for the CRF than for the nCRF. Although the effect of contrast on surround suppression was varied, the overall suppression increased significantly at high contrast. Moreover, the contrast-dependent change in the extent of CRF is independent of the change in suppression strength. Overall, our results in cat are in agreement with those obtained in macaque money.

Morphological bases of suppressive and facilitative spatial summation in the striate cortex of the cat

In V1 of cats and monkeys, activity of neurons evoked by stimuli within the receptive field can be modulated by stimuli in the extra-receptive field (ERF). This modulating effect can be suppressive (S-ERF) or facilitatory (F-ERF) and plays different roles in visual information processing. Little is known about the cellular bases underlying the different types of ERF modulating effects. Here, we focus on the morphological differences between the S-ERF and F-ERF neurons. Single unit activities were recorded from V1 of the cat. The ERF properties of each neuron were assessed by area-response functions using sinusoidal grating stimuli. On completion of the functional tests, the cells were injected intracellularly with biocytin. The labeled cells were reconstructed and morphologically characterized in terms of the ERF modulation effects. We show that the vast majority of S-ERF neurons and F-ERF neurons are pyramidal cells and that the two types of cells clearly differ in the size of the soma, in complexity of dendrite branching, in spine size and density, and in the range of innervations of the axon collaterals. We propose that different pyramidal cell phenotypes reflect a high degree of specificity of neuronal connections associated with different types of spatial modulation.

Axon topography of layer IV spiny cells to orientation map in the cat primary visual cortex (area 18)

Our aim was to reveal the relationship between layer IV horizontal connections and the functional architecture of the cat primary visual cortex because these connections play important roles in the first cortical stage of visual signals integration. We investigated bouton distribution of spiny neurons over an orientation preference map using in vivo optical imaging, unit recordings, and single neuron reconstructions. The radial extent of reconstructed axons (14 star pyramidal and 9 spiny stellate cells) was ~1.5 mm. In the vicinity of the parent somata (<400 μm), boutons occupied chiefly iso-orientations, however, more distally, 7 cells projected preferentially to non-iso-orientations. Boutons of each cell were partitioned into 1-15 distinct clusters based on the mean-shift algorithm, of which 57 clusters preferred iso-orientations and 43 clusters preferred cross-orientations, each showing sharp orientation preference "tuning." However, unlike layer III/V pyramidal cells preferring chiefly iso-orientations, layer IV cells were engaged with broad orientations because each bouton cluster from the same cell could show different orientation preference. These results indicate that the circuitry of layer IV spiny cells is organized differently from that of iso-orientation dominant layer III/V cells and probably processes visual signals in a different manner from that of the superficial and deeper layers.

Analysis of the context integration mechanisms underlying figure-ground organization in the visual cortex

Most neurons in visual cortex respond to contrast borders and are orientation selective, and some are also selective for which side of a border is figure and which side is ground ("border ownership coding"). These neurons are influenced by the image context far beyond the classical receptive field (CRF) and as early as 25 ms after the onset of activity in the cortex. The nature of the fast context integration mechanism is not well understood. What parts of a figure contribute to the context effect? What is the structure of the "extraclassical surround"? Is the context information propagated through horizontal fibers within cortex or through reciprocal connections via higher-level areas? To address these questions, we studied border ownership modulation with fragmented figures. Neurons were recorded in areas V1 and V2 of Macaca mulatta under behaviorally induced fixation. Test figures were fragmented rectangles. While one edge was centered on the CRF, the presence of the fragments outside the CRF was varied. The surround fragments produced facilitation on the preferred border ownership side as well as suppression on the nonpreferred side, with approximately 80% of the locations contributing on average. Fragments far from the CRF influenced the responses even in the absence of fragments closer to the CRF, and without the extra delay that would incur from propagation through horizontal fibers. Three principally different models are discussed. The results support a model in which the antagonistic surround influences are produced by reentrant signals from a higher-level area.

Feed-forward segmentation of figure-ground and assignment of border-ownership

Figure-ground is the segmentation of visual information into objects and their surrounding backgrounds. Two main processes herein are boundary assignment and surface segregation, which rely on the integration of global scene information. Recurrent processing either by intrinsic horizontal connections that connect surrounding neurons or by feedback projections from higher visual areas provide such information, and are considered to be the neural substrate for figure-ground segmentation. On the contrary, a role of feedforward projections in figure-ground segmentation is unknown. To have a better understanding of a role of feedforward connections in figure-ground organization, we constructed a feedforward spiking model using a biologically plausible neuron model. By means of surround inhibition our simple 3-layered model performs figure-ground segmentation and one-sided border-ownership coding. We propose that the visual system uses feed forward suppression for figure-ground segmentation and border-ownership assignment.

Contextual effects in speed perception may occur at an early stage of processing

How does nearby motion affect the perceived speed of a target region? When a central drifting Gabor patch is surrounded by translating noise, its speed can be misperceived over a fourfold range. Typically, when a surround moves in the same direction, perceived centre speed is reduced; for opposite-direction surrounds it increases. Measuring this illusion for a variety of surround properties reveals that the motion context effects are a saturating function of surround speed (Experiment I) and contrast (Experiment II). Our analyses indicate that the effects are consistent with a subtractive process, rather than with speed being averaged over area. In Experiment III we exploit known properties of the motion system to ask where these surround effects impact. Using 2D plaid stimuli, we find that surround-induced shifts in perceived speed of one plaid component produce substantial shifts in perceived plaid direction. This indicates that surrounds exert their influence early in processing, before pattern motion direction is computed. These findings relate to ongoing investigations of surround suppression for direction discrimination, and are consistent with single-cell findings of direction-tuned suppressive and facilitatory interactions in primary visual cortex (V1).

Surround suppression of V1 neurons mediates orientation-based representation of high-order visual features

Neurons with surround suppression have been implicated in processing high-order visual features such as contrast- or texture-defined boundaries and subjective contours. However, little is known regarding how these neurons encode high-order visual information in a systematic manner as a population. To address this issue, we have measured detailed spatial structures of classical center and suppressive surround regions of receptive fields of primary visual cortex (V1) neurons and examined how a population of such neurons allow encoding of various high-order features and shapes in visual scenes. Using a novel method to reconstruct structures, we found that the center and surround regions are often both elongated parallel to each other, reminiscent of on and off subregions of simple cells without surround suppression. These structures allow V1 neurons to extract high-order contours of various orientations and spatial frequencies, with a variety of optimal values across neurons. The results show that a wide range of orientations and widths of the high-order features are systematically represented by the population of V1 neurons with surround suppression.