Macaque V1 neurons can signal 'illusory' contours

fMRI activation in response to illusory contours and salient regions in the human lateral occipital complex

Regions in the human Lateral Occipital Complex (LOC) show fMRI responses to illusory surfaces. We show that the LOC activation is due to the globally completed region and occurs even when the region is not bounded by illusory contours (ICs). Kanizsa-type stimuli were modified by rounding the corners of the "pacmen" inducers and misaligning them slightly. The impression of an enclosed, salient region (SR) remained, although ICs were no longer perceived (psychophysical data). fMRI activity was elevated for both the IC and SR stimuli, compared to their control stimuli. The LOC response to salient regions may be the result of fast but crude region-based segmentation processes, which are useful for selecting parts of cluttered images for more detailed, computationally intensive processing.

Contour integration in the primary visual cortex of the opossum

To investigate whether contour integration is a generalized mammalian feature we studied single cells in V1 on the South-America opossum ( ), a plesiomorphic animal believed to retain basic characteristics of early mammals. We observed that when a cell's receptive field (RF) was masked (i.e. an artificial scotoma was produced), sweeping a long bar (several times the length of the RF) at the cell's preferred orientation elicited robust responses in many cells (28/103, or 27%). Therefore, some cells in the primary visual cortex of the opossum interpolate under conditions consistent with physical occlusion. The present results indicate that the property of contour integration appears to be a basic property of the mammalian visual system.

Contextual influences on visual processing

The visual image formed on the retina represents an amalgam of visual scene properties, including the reflectances of surfaces, their relative positions, and the type of illumination. The challenge facing the visual system is to extract the "meaning" of the image by decomposing it into its environmental causes. For each local region of the image, that extraction of meaning is only possible if information from other regions is taken into account. Of particular importance is a set of image cues revealing surface occlusion and/or lighting conditions. These information-rich cues direct the perceptual interpretation of other more ambiguous image regions. This context-dependent transformation from image to perception has profound-but frequently under-appreciated-implications for neurophysiological studies of visual processing: To demonstrate that neuronal responses are correlated with perception of visual scene properties, rather than visual image features, neuronal sensitivity must be assessed in varied contexts that differentially influence perceptual interpretation. We review a number of recent studies that have used this context-based approach to explore the neuronal bases of visual scene perception.

Stereoscopic illusory contours--cortical neuron responses and human perception

In human perception, figure-ground segregation suggests that stereoscopic cues are grouped over wide areas of the visual field. For example, two abutting rectangles of equal luminance and size are seen as a uniform surface when presented at the same depth, but appear as two surfaces separated by an illusory contour and a step in depth when presented with different retinal disparities. Here, we describe neurons in the monkey visual cortex that signal such illusory contours and can be selective for certain figure-ground directions that human observers perceive at these contours. The results suggest that these neurons group stereoscopic cues over distances up to 8 degrees. In addition, we compare these results with human perception and show that the mean stimulus parameters required by these neurons also induce optimal percepts of illusory contours in human observers.

The spatiotemporal dynamics of illusory contour processing: combined high-density electrical mapping, source analysis, and functional magnetic resonance imaging

Because environmental information is often suboptimal, visual perception must frequently rely on the brain's reconstruction of contours absent from retinal images. Illusory contour (IC) stimuli have been used to investigate these "filling-in" processes. Intracranial recordings and neuroimaging studies show IC sensitivity in lower-tier area V2, and to a lesser extent V1. Some interpret these data as evidence for feedforward processing of IC stimuli, beginning at lower-tier visual areas. On the basis of lesion, visual evoked potentials (VEP), and neuroimaging evidence, others contend that IC sensitivity is a later, higher-order process. Whether IC sensitivity seen in lower-tier areas indexes feedforward or feedback processing remains unresolved. In a series of experiments, we addressed the spatiotemporal dynamics of IC processing. Centrally presented IC stimuli resulted in early VEP modulation (88-100 msec) over lateral-occipital (LOC) scalp--the IC effect. The IC effect followed visual response onset by 40 msec. Scalp current density topographic mapping, source analysis, and functional magnetic resonance imaging results all localized the IC effect to bilateral LOC areas. We propose that IC sensitivity described in V2 and V1 may reflect predominantly feedback modulation from higher-tier LOC areas, where IC sensitivity first occurs. Two additional observations further support this proposal. The latency of the IC effect shifted dramatically later (approximately 120 msec) when stimuli were laterally presented, indicating that retinotopic position alters IC processing. Immediately preceding the IC effect, the VEP modulated with inducer eccentricity--the configuration effect. We interpret this to represent contributions from global stimulus parameters to scene analysis. In contrast to the IC effect, the topography of the configuration effect was restricted to central parieto-occipital scalp.

Magnetic responses of human visual cortex to illusory contours

To examine the neural mechanism underlying illusory-contour perception, we measured the magnetic responses of the human visual cortex to an abutting-line grating inducing illusory contours (test stimulus) and a non-abutting-line grating (control stimulus) using the technique of magnetoencephalography (MEG). In the initial latency period of 60-80 ms, the MEG response to the test stimulus was nearly identical with that to the control stimulus, but in the subsequent period of 80-150 ms, the former was larger than the latter. The origin of the peak MEG response to the test stimulus was estimated to be in the vicinity of striate cortex/extrastriate visual cortex for two of the four subjects. These results suggest that, in accord with those of the previous electrophysiological and functional magnetic resonance imaging studies, illusory-contour signals are generated in the very early stage(s) of processing in the primate visual cortex.

The nature of illusory contour computation

Neural correlates of illusory contour perception have been found in both the early and the higher visual areas. But the locus and the mechanism for its computation remain elusive. Psychophysical evidence provided in this issue of Neuron shows that perceptual contour completion is likely done in the early visual cortex in a cascade manner using horizontal connections.

Perceptual completion across the vertical meridian and the role of early visual cortex

Perceptual completion can link widely separated contour fragments and interpolate illusory contours (ICs) between them. The mechanisms underlying such long-range linking are not well understood. Here we report that completion is much poorer when ICs cross the vertical meridian than when they reside entirely within the left or right visual hemifield. This deficit reflects limitations in cross-hemispheric integration. We also show that the sensitivity to the interhemispheric divide is unique to perceptual completion: a comparable task which did not require completion showed no across-meridian impairment. We propose that these findings support the existence of specialized completion mechanisms in early visual cortical areas (V1/V2), since those areas are likely to be more sensitive to the interhemispheric divide.

Electrophysiological indexes of illusory contours perception in humans

The present study investigated brain mechanisms underlying the perception of illusory contours, using recordings of event-related potentials of the brain (ERPs) in right-handed individuals. Forty different stimuli were presented randomly 1600 times in foveal vision; twenty of them produced the perception of illusory contours of a Kanizsa square, the remaining were obtained rotating outwards the inducers and they did not produce any illusory percept. Half of them had white inducers on a black background and vice versa; half of them were symmetrical and the other half asymmetrical. In lateral occipital areas illusory percepts produced larger evoked responses starting as early as 145 ms post-stimulus with the N1 peak. ERP data did not provide evidence of right-sided lateralisation of the processes underlying illusory contours formation at sensory level, as suggested by some neuroimaging and neuropsychological studies. The two cerebral hemispheres were differently activated while the subjective patterns formation progressed through neural processing stages. Indeed, brain response to illusory contours was more pronounced in the left occipital area at N2 component level (about 250 ms post-stimulus) and at right parietal sites at the latency of P300 component. Both background luminance and stimulus symmetry interacted with illusory boundaries formation. Present results confirm the hypothesis that the integration of contours arises at early stages of visual processing and highlight the primary role of edges continuity and boundary alignment in illusory contours perception.

The role of feedback connections in shaping the responses of visual cortical neurons

The results of a previous study [Hupé et al. (1998) Nature, 394: 784-787] led us to conclude that feedback connections are important for differentiating a figure from the background, particularly in the case of low salience stimuli. This conclusion was principally based on the observation in area V3 neurons that inactivating MT by cooling led to a severe weakening of the center response and of the center-surround interactions, and that these effects were particularly strong for low salience stimuli. In the present paper, we first show that the results extend to areas V1 and V2. In particular, the inhibitory center-surround interactions in areas V1, V2 and V3 disappear almost completely in the absence of feedback input from MT for low salience stimuli, whereas the effects are much more limited for stimuli of middle and high salience. We then compare the results obtained in studies of feedback connections from MT to those obtained in a study of the feedback action of area V2 onto V1 neurons [Hupé et al. (2001) J. Neurophysiol., 85: 146-163], in which the same effects were observed on the center mechanism (decrease in response), but no effects were seen on the center-surround interactions. We conclude that feedback connections act in a non-linear fashion to boost the gain of the center mechanism and that they combine with horizontal connections to generate the center-surround interactions.

Processing of second-order stimuli in the visual cortex

Naturally occurring visual stimuli are rich in examples of objects delineated from their backgrounds simply by differences in luminance, so-called first-order stimuli, as well as those defined by differences of contrast or texture, referred to as second-order stimuli. Here we provide a brief overview of visual cortical processing of second-order stimuli, as well as some comparative background on first-order processing, concentrating on single-unit neurophysiology, but also discussing relationships to human psychophysics and to neuroimaging. The selectivity of visual cortical neurons to orientation, spatial frequency, and direction of movement of first-order, luminance-defined stimuli is conventionally understood in terms of simple linear filter models, albeit with some minor nonlinearities such as thresholding and gain control. However, these kinds of models fail entirely to account for responses of neurons to second-order stimuli such as contrast envelopes, illusory contours, or texture borders. Second-order stimuli constructed from sinusoidal components have been used to analyze the neurophysiological mechanisms of such responses; these experiments demonstrate that the same neuron can exhibit three distinct kinds of tuning to spatial frequency, and also to orientation. These results can be understood in terms of a type of nonlinear 'filter-->rectify-->filter' model, which has been widely used in human psychophysics. Finally, several general issues will be discussed, including potential artifacts in experiments with second-order stimuli, and strategies for avoiding or controlling for them; caveats about definitions of first- vs. second-order mechanisms and stimuli; the concept of form-cue invariance; and the functional significance of second-order processing.

Cortical plasticity revealed by circumscribed retinal lesions or artificial scotomas

We review the work of others in which the effects of circumscribed, topographically corresponding binocular retinal lesions on the topographic organization of the visual cortex revealed that there is a substantial degree of topographical plasticity in the primary visual cortices of adult cats and macaque monkeys. Despite the evidence indicating that the reorganization of the topographic map in primary visual cortices of adult cats and macaques related to the input from one eye could be suppressed for a long time by inputs related to the other eye, we observed a substantial degree of topographical plasticity in the primary visual cortices of adult cats in which we have made circumscribed monocular retinal lesions. Overall, in both binocularly and monocularly lesioned adult animals, most cells recorded in the cortical projection zone of the retinal lesion (LPZ), several hours, several weeks or several months after placement of the lesions exhibited 'ectopic' excitatory visual receptive fields (RFs) which were displaced to the normal retina in the immediate vicinity of the lesion. The presence of ectopic RFs in cells recorded in the cortical LPZ, combined with the presence of normal cortical representation of the part of the retina in the vicinity of the lesion, indicate a clear expansion of the cortical representation of the part of the retina surrounding the lesion. When stimulated via the ectopic RFs, cortical cells exhibited normal orientation tuning and in the case of animals with monocular lesions, the orientation tuning of binocular cells when stimulated via ectopic RFs appeared to be very similar to that when the cells were stimulated via the RFs in the normal, unlesioned eye. In both binocularly and monocularly lesioned animals, the responses evoked by optimal visual stimuli from the ectopic RFs were substantially weaker than those evoked from their normal counterparts. Similarly, upper velocity limits were significantly lower when visual stimuli were presented via the ectopic RFs. In contrast to cats in which the retinal lesions were made in adulthood, in cats lesioned monocularly in adolescence (8-11 weeks postnatal), both the peak discharge rates and upper velocity limits of responses to photic stimuli presented via the ectopic RFs were very similar to those to stimuli presented via the normal eye. The intracortical mechanism(s) underlying the long-term cortical plasticity revealed by retinal lesions are likely to be closely linked to the mechanism(s) underlying the short-term reversible enlargement of cortical receptive fields observed with artificial scotomas. Furthermore, a similar putative intracortical mechanism(s) appears to underlie psychophysical phenomena observed in studies of retinal scotomas in humans. Overall, the research reviewed here strongly challenges the view that receptive fields of neurons in mammalian visual cortices are 'hard-wired'.

Modulations of the processing of line discontinuities under selective attention conditions?

We examined whether the processing of discontinuities involved in figure-ground segmentation, like line ends, can be modulated under selective attention conditions. Subjects decided whether a gap in collinear or parallel lines was located to the right or left. Two stimuli were displayed in immediate succession. When the gaps were on the same side, reaction times (RTs) for the second stimulus increased when collinear lines followed parallel lines, or the reverse, but only when the two stimuli shared the same orientation and location. The effect did not depend on the global form of the stimuli or on the relative orientation of the gaps. A frame drawn around collinear elements affected the results, suggesting a crucial role of the "amodal" orthogonal lines produced when line ends are aligned. Including several gaps in the first stimulus also eliminated RT variations. By contrast, RT variations remained stable across several experimental blocks and were significant for interstimulus intervals from 50 to 600 msec between the two stimuli. These results are interpreted in terms of a modulation of the processing of line ends or the production of amodal lines, arising when attention is selectively drawn to a gap.

Two eccentricity-dependent limitations on subjective contour discrimination

Eccentricity-dependent sensitivity losses in spatial discrimination tasks can often be overcome by scaling stimuli at each eccentricity by a factor F=1+E/E(2). However, because there may be more than one eccentricity-dependent limitation at play in a particular task a single scaling function may be insufficient to explain all sensitivity losses as stimuli are moved from foveal to peripheral retinal locations. We propose a method explicitly designed to determine whether a single scaling factor is sufficient to capture all eccentricity-dependent sensitivity losses in a task. The methodology was applied to subjective contour stimuli that varied in aperture size (sigma) and carrier wavelength (omega). For a range of stimulus configurations [2(-0.5)log(sigma/omega)] we measured threshold scale [2(-0.5)log(sigma omega)] and fit data at each eccentricity to rectangular parabolas that expressed sensitivity limitations arising from aperture size and carrier wavelength. Although a single scaling factor (E(2)) explains much of the variability in the data there are systematic sources of variance in the residuals (i.e., deviations of the data from the best fitting functions). Our analysis shows that two scaling factors are required to capture all eccentricity-dependent limitations in the data.

Attention-dependent brief adaptation to contour orientation: a high-level aftereffect for convexity?

In contrast to the abundant literature investigating how orientation coding depends on edges defined by various image features, relatively little is known about how coding of orientation might also depend on the two distinct functional roles that oriented edges commonly play. Oriented lines can delineate outline contours of a figure or they can form texture. The results of five experiments using orientation aftereffects measured with brief tests (27 ms, backward masked; adapt-to-test interval=201 ms) provided evidence that brief stimuli (<135 ms) selectively adapt coding of contour-line orientation rather than coding of line-texture orientation. Furthermore, parametric results revealed that the rapidly adapting aftereffects for contour orientation are characterized by (1) broad orientation tuning (peaking at +/-30 degrees to +/-50 degrees from test orientation), (2) indifference as to how the contours are defined (e.g. bright lines, high-pass-filtered lines, faint lines generated by the spatial inhomogeneity of visual sensitivity), (3) rapid saturation at low contrast energy, (4) strong modulation by selective attention, and (5) relative size tolerance. These characteristics appear to parallel those of cells in the high end of the visual form processing pathway (such as inferotemporal cortex). It is thus suggested that the rapidly adapting contour orientation aftereffects reported here may be mediated by high-level neural units that encode global configurations of orientation (e.g. convexity and concavity).

Visual summation of luminance lines and illusory contours induced by pictorial, motion, and disparity cues

Illusory contours where no contrast exists in the image can be seen between pairs of spatially separate but aligned inducing real contours defined either by pictorial cues (luminance contrasts or offset gratings), kinetic contrast, or binocular disparity contrast. In previous studies it has been shown that the detection of a thin luminous line is facilitated when the line is superimposed on illusory contours and the inducing flanking elements are defined by luminance contrast. By using a spatial forced-choice technique I show that luminous lines summate with illusory contours induced by luminance contrast, offset gratings, motion contrast, and disparity contrast when the line is superimposed on the illusory contour. Control experiments show that the positional cues, offered by the inducing contours, are unable to account for these results. It is suggested that real luminous lines or edges and illusory contours activate common neural mechanisms in the brain irrespectively of the stimulus attributes that induce the illusory contour.

Is second-order spatial loss in amblyopia explained by the loss of first-order spatial input?

The purpose of the study was to determine whether amblyopes show detection loss for second-order spatial information, and if present, whether the loss is explained by the loss of first-order spatial input. We psychophysically determined detection thresholds for the amblyopic and non-amblyopic eyes of five adult amblyopes and the dominant eyes of three control observers. We found that four amblyopic eyes and two non-amblyopic eyes showed second-order loss relative to the control eyes. The second-order loss was greater than the first-order loss at the carrier spatial frequency (first-order input). The extra second-order loss indicates an early amplification of cortical neural loss that we speculate is due to deficient binocular input to second-order neurons.

Simulation of neuronal responses defining depth order and contrast polarity at illusory contours in monkey area V2

Neurophysiological, brain imaging, and perceptual studies in animals and humans suggest that illusory (occluding) contours are represented at an early level of visual cortical processing. Comparatively little is known about the mechanisms defining the depth order and the brightness illusion associated with such contours. Baumann et al. (1997) found neurons in area V2 of the alert monkey that signaled not only illusory contours but also the figure-ground direction that human observers perceive at such contours. The majority of these neurons showed this property independent stimulus contrast; a small minority preferred a certain combination of figure-ground direction and contrast polarity at these contours. In this article, we simulate the responses of these neurons by means of a grouping mechanism that uses occlusion cues (line-ends, corners) to define figure-ground direction and contrast polarity at such contours.

Visual inter-attribute contour completion

A new visual phenomenon, inter-attribute illusory (completed) contours, is demonstrated. Contour completions are perceived between any combination of spatially separate pairs of inducing elements (Kanizsa-like 'pacman' figures) defined either by pictorial cues (luminance contrast or offset gratings), temporal contrast (motion, second-order-motion or 'phantom' contours), or binocular-disparity contrast. In a first experiment, observers reported the perceived occurrence of contour completion for all pair combinations of inducing elements. In a second experiment they rated the perceived clarity of the completed contours. Both methods generated similar results contour completions were perceived even though the inducing elements were defined by different attributes. Ratings of inter-attribute clarity were no lower than in either of the two corresponding intra-attribute conditions and seem to be the average of these two ratings. The results provide evidence for the existence of attribute-invariant Gestalt processes, and on a mechanistic level indicate that the completion process operates on attribute-invariant contour detectors.

Cognitive neuroscience: early learning centres

Learning leads to neural changes often considered to be driven by 'smart' areas of the brain. A recent study of the cellular changes that underlie perceptual learning has found that plasticity in the primary visual cortex V1 is necessary for learning and the changes that correlate with learning are more complex than one might expect.

Linking the laminar circuits of visual cortex to visual perception: development, grouping, and attention

How do the laminar circuits of visual cortical areas V1 and V2 implement context-sensitive binding processes such as perceptual grouping and attention, and how do these circuits develop and learn in a stable way? Recent neural models clarify how preattentive and attentive perceptual mechanisms are intimately linked within the laminar circuits of visual cortex, notably how bottom-up, top-down, and horizontal cortical connections interact within the cortical layers. These laminar circuits allow the responses of visual cortical neurons to be influenced, not only by the stimuli within their classical receptive fields, but also by stimuli in the extra-classical surround. Such context-sensitive visual processing can greatly enhance the analysis of visual scenes, especially those containing targets that are low contrast, partially occluded, or crowded by distractors. Attentional enhancement can selectively propagate along groupings of both real and illusory contours, thereby showing how attention can selectively enhance object representations. Recent models explain how attention may have a stronger facilitatory effect on low contrast than on high contrast stimuli, and how pop-out from orientation contrast may occur. The specific functional roles which the model proposes for the cortical layers allow several testable neurophysiological predictions to be made. Model mechanisms clarify how intracortical and intercortical feedback help to stabilize cortical development and learning. Although feedback plays a key role, fast feedforward processing is possible in response to unambiguous information. Model circuits are capable of synchronizing quickly, but context-sensitive persistence of previous events can influence how synchrony develops.

Explicit and implicit perception of illusory contours in unilateral spatial neglect: behavioural and anatomical correlates of preattentive grouping mechanisms

Studies of hemispatial neglect suggest that some perceptual processes still operate on contralesional stimuli independent from spatial attention or awareness. Here we examined whether preattentive processing in extrastriate areas may group unconnected elements inducing illusory contours despite neglect. While it has been debated whether illusory contours arise from preattentive grouping or higher cognitive processes, neurophysiological studies show that neurones in secondary visual cortex (V2) can code for illusory contours. Twelve patients with right hemisphere damage and left neglect were tested for implicit and explicit detection of illusory contours using, respectively: (1) a bisection task where patients were not explicitly required to attend to lateral elements and judged the midpoint of Kanizsa illusory stimuli, as well as other physically connected or unconnected stimuli of the same length; (2) a matching task where patients had to overtly attend to lateral elements and made same/different judgements on pairs of illusory stimuli with identical or different inducers on the right or left side. In some patients, bisection judgements were consistently similar on Kanizsa stimuli with illusory contours and connected stimuli with real contours but different on unconnected gap figures, regardless of their length, suggesting implicit grouping of inducing elements prior to processing stages where a spatial attentional bias arose. Their lesions centred on the inferior parietal cortex or thalamus. Other patients did not show a systematic bisection pattern and had lesions extending posteriorly in the lateral occipital cortex. However, both groups of patients failed to detect left-side inducers in explicit matching judgements, even though errors often revealed unconscious processing, and they showed similar neglect severity on other standard tests. These findings suggest that grouping by illusory contours can occur preattentively and influence bisection independently from the ability to detect contralateral inducers explicitly, severity of inattention, and other forms of unconscious processing. Implicit grouping may depend on the sparing of lateral occipital areas involved in figure-ground segmentation at early stages of visual processing.

Influence of the direction of elemental luminance gradients on the responses of V4 cells to textured surfaces

The texture of an object provides important cues for its recognition; however, little is known about the neural representation of texture. To investigate the representation of texture in the visual cortex, we recorded single-cell activities in area V4 of macaque monkeys. To distinguish the sensitivity of the cells to texture parameters such as density and element size from that to spatial frequency, we used texture stimuli mimicking shaded granular surfaces. We varied the size and density of the texture elements and the direction of elemental luminance gradients (apparent shadings) as stimulus parameters. Most macaque V4 cells (151 of 170; 89%) exhibited sensitivity to the texture parameters. Interestingly, 21 of these cells were tuned to single shading directions (unidirectional tuning). This unidirectional tuning cannot be explained by complex-cell-like tuning for spectral power of spatial frequency, because texture stimuli with a shading direction and its opposite have almost the same spectral power. Unidirectional tunings of these cells were invariant for the position of the texture elements. Thus, this tuning cannot be explained by simple-cell-like phase-dependent spatial frequency tuning or selectivity to a particular arrangement of the elements. Moreover, the unidirectional tuning had a bias toward vertical directions, consistent with an anisotropy in the perception of three-dimensional shape from shading. This novel spatial property suggests that V4 cells are involved in extracting texture features from objects, including their three-dimensionality.

Real and illusory contour processing in area V1 of the primate: a cortical balancing act

It is known that neurons in area V2 (the second visual area) can signal the orientation of illusory contours in the primate. Whether area V1 (primary visual cortex) can signal illusory contour orientation is more controversial. While some electrophysiology studies have ruled out illusory signaling in V1, other reports suggest that V1 shows some illusory-specific response. Here, using optical imaging and single unit electrophysiology, we report that primate V1 does show an orientation-specific response to the 'abutting line grating' illusory contour. However, this response does not signal an illusory contour in the conventional sense. Rather, we find that illusory contour stimulation leads to an activation map that, after appropriate subtraction of real line signal, is inversely related to the real orientation map. The illusory contour orientation is thus negatively signaled or de-emphasized in V1. This 'activation reversal' is robust, is not due merely to presence of line ends, is not dependent on inducer orientation, and is not due to precise position of line end stimulation of V1 cells. These data suggest a resolution for previous apparently contradictory experimental findings. We propose that the de-emphasis of illusory contour orientation in V1 may be an important signal of contour identity and may, together with illusory signal from V2, provide a unique signature for illusory contour representation.

Gestalt perception modulates early visual processing

We examined whether early visual processing reflects perceptual properties of a stimulus in addition to physical features. We recorded event-related potentials (ERPs) of 13 subjects in a visual classification task. We used four different stimuli which were all composed of four identical elements. One of the stimuli constituted an illusory Kanizsa square, another was composed of the same number of collinear line segments but the elements did not form a Gestalt. In addition, a target and a control stimulus were used which were arranged differently. These stimuli allow us to differentiate the processing of colinear line elements (stimulus features) and illusory figures (perceptual properties). The visual N170 in response to the illusory figure was significantly larger as compared to the other collinear stimulus. This is taken to indicate that the visual N170 reflects cognitive processes of Gestalt perception in addition to attentional processes and physical stimulus properties.

Interaction between first- and second-order orientation channels revealed by the tilt illusion: psychophysics and computational modelling

This paper examines the interaction between first- and second-order contours in the orientation domain. Using the simultaneous tilt illusion (TI), we show that the apparent rotation of a vertical test grating away from that of a surrounding inducing grating (repulsion effect) occurs when both the inducing and test grating are either first- or second-order. Furthermore, a significant repulsion effect is obtained when a first-order inducing grating surrounds a second-order test. If lateral inhibitory interactions between populations of orientation selective neurons provides a plausible explanation for orientation repulsion effects [Blakemore, C. B. Carpenter, R. H. S. & Georgeson, M. A. (1970) Nature, 228, 37-39], it is likely that the cue-invariant mechanisms that encodes the orientation of first- and second-order contours also exhibit inhibitory interactions. A two-channel computational model of orientation encoding is presented where one channel encodes only first-order stimuli while the second channel encodes both first- and second-order contours. In addition to predicting the orientation repulsion effects we observed, the model also provides a functional account of orientation attraction effects in terms of the responses of populations of orientation-tuned neurons.

ERP time course of perceptual and post-perceptual mechanisms of spatial selection

Event-related potentials (ERPs) were recorded from volunteers performing a task requiring simple judgements about the spatial location of a single target that could appear with equal probability to the left or right of fixation. A robust finding in the ERP literature is a dichotomy between attentional selection for spatial and non-spatial features. Visual spatial selection is manifest as a modulation of early components (P1, N1) that reveal exogenous processes, while non-spatial selection is revealed by the presence of longer latency endogenous components (N2). We present an analysis of several conditions that require different degrees of visual analysis to confirm the location of the single target, and show that spatial selection can be manifest at early (N1) or later (N2) stages. Observers identified the location of targets that were more salient (2D line drawings with abrupt onset) or less salient (2D line drawings without abrupt onset or 3D objects embedded in random-dot stereograms). We examined differences in amplitude, latency, and topography of early ERP components (P1, N1, P2, N2), and compared responses measured over the left and right hemispheres in response to left and right targets. The results support the hypothesis that the processes involved in spatial selection can be manifest at early or late stages, dependent on the quality of the incoming data. Moreover, the iterative process by which the percept is established benefits from a change in the visual input that is specific to the target.

Role of motion integration in contour perception

Contours are believed to play a key role in the visual analysis of scenes by the primate brain. In dynamic scenes, the presence of contours is often signaled by discontinuities in motion fields. However, it is unclear whether the motion fields over which the visual system extracts discontinuities, correspond to the local optic-flow or the pattern motion fields obtained by integrating local estimates. A resolution of this issue would provide important clues about the organization of visual motion and form analysis processes. In this paper, we present experimental evidence which suggests that the perception of motion defined contours is strongly dependent on motion integration - an operation that is believed to take place relatively late in the visual stream.

Dynamics of subjective contour formation in the early visual cortex

To elucidate the roles of visual areas V1 and V2 and their interaction in early perceptual processing, we studied the responses of V1 and V2 neurons to statically displayed Kanizsa figures. We found evidence that V1 neurons respond to illusory contours of the Kanizsa figures. The illusory contour signals in V1 are weaker than in V2, but are significant, particularly in the superficial layers. The population averaged response to illusory contours emerged 100 msec after stimulus onset in the superficial layers of V1, and around 120--190 msec in the deep layers. The illusory contour response in V2 began earlier, occurring at 70 msec in the superficial layers and at 95 msec in the deep layers. The temporal sequence of the events suggests that the computation of illusory contours involves intercortical interaction, and that early perceptual organization is likely to be an interactive process.

Dynamics of subjective contour formation in the early visual cortex

To elucidate the roles of visual areas V1 and V2 and their interaction in early perceptual processing, we studied the responses of V1 and V2 neurons to statically displayed Kanizsa figures. We found evidence that V1 neurons respond to illusory contours of the Kanizsa figures. The illusory contour signals in V1 are weaker than in V2, but are significant, particularly in the superficial layers. The population averaged response to illusory contours emerged 100 msec after stimulus onset in the superficial layers of V1, and around 120--190 msec in the deep layers. The illusory contour response in V2 began earlier, occurring at 70 msec in the superficial layers and at 95 msec in the deep layers. The temporal sequence of the events suggests that the computation of illusory contours involves intercortical interaction, and that early perceptual organization is likely to be an interactive process.

A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual grouping and learning

A neural model suggests how horizontal and interlaminar connections in visual cortical areas V1 and V2 develop within a laminar cortical architecture and give rise to adult visual percepts. The model suggests how mechanisms that control cortical development in the infant lead to properties of adult cortical anatomy, neurophysiology and visual perception. The model clarifies how excitatory and inhibitory connections can develop stably by maintaining a balance between excitation and inhibition. The growth of long-range excitatory horizontal connections between layer 2/3 pyramidal cells is balanced against that of short-range disynaptic interneuronal connections. The growth of excitatory on-center connections from layer 6-to-4 is balanced against that of inhibitory interneuronal off-surround connections. These balanced connections interact via intracortical and intercortical feedback to realize properties of perceptual grouping, attention and perceptual learning in the adult, and help to explain the observed variability in the number and temporal distribution of spikes emitted by cortical neurons. The model replicates cortical point spread functions and psychophysical data on the strength of real and illusory contours. The on-center, off-surround layer 6-to-4 circuit enables top-down attentional signals from area V2 to modulate, or attentionally prime, layer 4 cells in area V1 without fully activating them. This modulatory circuit also enables adult perceptual learning within cortical area V1 and V2 to proceed in a stable way.

Processing of kinetically defined boundaries in areas V1 and V2 of the macaque monkey

We recorded responses in 107 cells in the primary visual area V1 and 113 cells in the extrastriate visual area V2 while presenting a kinetically defined edge or a luminance contrast edge. Cells meeting statistical criteria for responsiveness and orientation selectivity were classified as selective for the orientation of the kinetic edge if the preferred orientation for a kinetic boundary stimulus remained essentially the same even when the directions of the two motion components defining that boundary were changed by 90 degrees. In area V2, 13 of the 113 cells met all three requirements, whereas in V1, only 4 cells met the criteria of 107 that were tested, and even these demonstrated relatively weak selectivity. Correlation analysis showed that V1 and V2 populations differed greatly (P < 1.0 x 10(-6), Student's t-test) in their selectively for specific orientations of kinetic edge stimuli. Neurons in V2 that were selective for the orientation of a kinetic boundary were further distinguished from their counterparts in V1 in displaying a strong, sharply tuned response to a luminance edge of the same orientation. We concluded that selectivity for the orientation of kinetically defined boundaries first emerges in area V2 rather than in primary visual cortex. An analysis of response onset latencies in V2 revealed that cells selective for the orientation of the motion-defined boundary responded about 40 ms more slowly, on average, to the kinetic edge stimulus than to a luminance edge. In nonselective cells, that is, those presumably responding only to the local motion in the stimulus, this difference was only about 20 ms. Response latencies for the luminance edge were indistinguishable in KE-selective and -nonselective neurons. We infer that while responses to luminance edges or local motion are indigenous to V2, KE-selective responses may involve feedback entering the ventral stream at a point downstream with respect to V2.

Contrast-sensitive perceptual grouping and object-based attention in the laminar circuits of primary visual cortex

Recent neurophysiological studies have shown that primary visual cortex, or V1, does more than passively process image features using the feedforward filters suggested by Hubel and Wiesel. It also uses horizontal interactions to group features preattentively into object representations, and feedback interactions to selectively attend to these groupings. All neocortical areas, including V1, are organized into layered circuits. We present a neural model showing how the layered circuits in areas V1 and V2 enable feedforward, horizontal, and feedback interactions to complete perceptual groupings over positions that do not receive contrastive visual inputs, even while attention can only modulate or prime positions that do not receive such inputs. Recent neurophysiological data about how grouping and attention occur and interact in V1 are simulated and explained, and testable predictions are made. These simulations show how attention can selectively propagate along an object grouping and protect it from competitive masking, and how contextual stimuli can enhance or suppress groupings in a contrast-sensitive manner.

Human development of perceptual organization

Two relevant dimensions are revealed within which developmental patterns of perceptual organization might be investigated. Within the local-integrative dimension, employing a contour integration task, we found indications that spatial integration develops slowly. We also found reduced contextual modulation of a local target in children employing the Ebbinghaus illusion. Within the action-perception dimension, we hypothesize a relatively slow development of the perceptual system (mediated by the ventral visual stream), as compared to the development of the action system (mediated by the dorsal visual stream). Taken together, the data indicate that long-range neuronal connectivity supporting perceptual organization in the posterior pole of the brain, and in the ventral visual pathway is not fully developed in young children.

Visual cortical mechanisms of perceptual grouping: interacting layers, networks, columns, and maps

The visual cortex has a laminar organization whose circuits form functional columns in cortical maps. How this laminar architecture supports visual percepts is not well understood. A neural model proposes how the laminar circuits of V1 and V2 generate perceptual groupings that maintain sensitivity to the contrasts and spatial organization of scenic cues. The model can decisively choose which groupings cohere and survive, even while balanced excitatory and inhibitory interactions preserve contrast-sensitive measures of local boundary likelihood or strength. In the model, excitatory inputs from lateral geniculate nucleus (LGN) activate layers 4 and 6 of V1. Layer 6 activates an on-center off-surround network of inputs to layer 4. Together these layer 4 inputs preserve analog sensitivity to LGN input contrasts. Layer 4 cells excite pyramidal cells in layer 2/3, which activate monosynaptic long-range horizontal excitatory connections between layer 2/3 pyramidal cells, and short-range disynaptic inhibitory connections mediated by smooth stellate cells. These interactions support inward perceptual grouping between two or more boundary inducers, but not outward grouping from a single inducer. These boundary signals feed back to layer 4 via the layer 6-to-4 on-center off-surround network. This folded feedback joins cells in different layers into functional columns while selecting winning groupings. Layer 6 in V1 also sends top-down signals to LGN using an on-center off-surround network, which suppresses LGN cells that do not receive feedback, while selecting, enhancing, and synchronizing activity of those that do. The model is used to simulate psychophysical and neurophysiological data about perceptual grouping, including various Gestalt grouping laws.

Moving illusory contours activate primary visual cortex: an fMRI study

Identifying the cortical areas activated by illusory contours provides valuable information on the mechanisms of object perception. We applied functional magnetic resonance imaging to identify the visual areas of the human brain involved in the perception of a moving Kanizsa-type illusory contour. Our results indicate that, in addition to other cortical regions, areas V5 and V1 are activated. Activity in area V1 was particularly prominent.

Deriving behavioural receptive fields for visually completed contours

The visual system is constantly faced with the problem of identifying partially occluded objects from incomplete images cast on the retinae. Phenomenologically, the visual system seems to fill in missing information by interpolating illusory and occluded contours at points of occlusion, so that we perceive complete objects. Previous behavioural [1] [2] [3] [4] [5] [6] [7] and physiological [8] [9] [10] [11] [12] studies suggest that the visual system treats illusory and occluded contours like luminance-defined contours in many respects. None of these studies has, however, directly shown that illusory and occluded contours are actually used to perform perceptual tasks. Here, we use a response-classification technique [13] [14] [15] [16] [17] [18] [19] [20] to answer this question directly. This technique provides pictorial representations - 'classification images' - that show which parts of a stimulus observers use to make perceptual decisions, effectively deriving behavioural receptive fields. Here we show that illusory and occluded contours appear in observers' classification images, providing the first direct evidence that observers use perceptually interpolated contours to recognize objects. These results offer a compelling demonstration of how visual processing acts on completed representations, and illustrate a powerful new technique for constraining models of visual completion.

Texture segregation in the human visual cortex: A functional MRI study

The segregation of visual scenes based on contour information is a fundamental process of early vision. Contours can be defined by simple cues, such as luminance, as well as by more complex cues, such as texture. Single-cell recording studies in monkeys suggest that the neural processing of complex contours starts as early as primary visual cortex. Additionally, lesion studies in monkeys indicate an important contribution of higher order areas to these processes. Using functional MRI, we have investigated the level at which neural correlates of texture segregation can be found in the human visual cortex. Activity evoked by line textures, with and without texture-defined boundaries, was compared in five healthy subjects. Areas V1, V2/VP, V4, TEO, and V3A were activated by both kinds of line textures as compared with blank presentations. Textures with boundaries forming a checkerboard pattern, relative to uniform textures, evoked significantly more activity in areas V4, TEO, less reliably in V3A, but not in V1 or V2/VP. These results provide evidence that higher order areas with large receptive fields play an important role in the segregation of visual scenes based on texture-defined boundaries.

Development of illusory-contour perception in infants

We investigated whether infants from 8-22 weeks of age were sensitive to the illusory contour created by aligned line terminators. Previous reports of illusory-contour detection in infants under 4 months old could be due to infants' preference for the presence of terminators rather than their configuration. We generated preferential-looking stimuli containing sinusoidal lines whose oscillating, abutting terminators give a strong illusory contour in adult perception. Our experiments demonstrated a preference in infants 8 weeks old and above for an oscillating illusory contour compared with a stimulus containing equal terminator density and movement. Control experiments excluded local line density, or attention to alignment in general, as the basis for this result. In the youngest age group (8-10 weeks) stimulus velocity appears to be critical in determining the visibility of illusory contours, which is consistent with other data on motion processing at this age. We conclude that, by 2 months of age, the infant's visual system contains the nonlinear mechanisms necessary to extract an illusory contour from aligned terminators.

Neuronal correlates of real and illusory contour perception: functional anatomy with PET

Illusory contours provide a striking example of the visual system's ability to extract a meaningful representation of the surroundings from fragmented visual stimuli. Psychophysical and neurophysiological data suggest that illusory contours are processed in early visual cortical areas, and neuroimaging studies in humans have shown that Kanizsa-type illusory contours activate early retinotopic visual areas that are also activated by real contours. It is not known whether other types of illusory contours are processed by the same mechanisms, nor is it clear to what extent attentional effects may have influenced these results, as no attempt was made to match the salience of real and illusory stimuli in previous imaging studies. It therefore remains an open question whether there are any brain regions specifically involved in the perception of illusory contours. To address these questions, we have used 15O-butanol positron emission tomography (PET) and a novel kind of illusory contour stimulus that is induced only by aligned line ends. By employing a form discrimination task that was matched for attention and stimulus salience across conditions we were able to directly contrast perception of real and illusory contours. We found that the regions activated by illusory contour perception were the same as those activated by real contours. Only one region, located in the right fusiform gyrus, was significantly more strongly activated by perception of illusory contours than by real contours. In addition, a principal component analysis suggested that illusory contour perception is associated with a change in the correlation between V1 and V2. We conclude that different kinds of illusory contours are processed by the same cortical regions and that these regions overlap extensively with those involved in processing of real contours. At the regional level, perception of illusory contours thus appears to differ from perception of real contours by the degree of involvement of higher visual areas as well as by the nature of interaction between early visual areas.

The representation of illusory and real contours in human cortical visual areas revealed by functional magnetic resonance imaging

Illusory contours (perceived edges that exist in the absence of local stimulus borders) demonstrate that perception is an active process, creating features not present in the light patterns striking the retina. Illusory contours are thought to be processed using mechanisms that partially overlap with those of "real" contours, but questions about the neural substrate of these percepts remain. Here, we employed functional magnetic resonance imaging to obtain physiological signals from human visual cortex while subjects viewed different types of contours, both real and illusory. We sampled these signals independently from nine visual areas, each defined by retinotopic or other independent criteria. Using both within- and across-subject analysis, we found evidence for overlapping sites of processing; most areas responded to most types of contours. However, there were distinctive differences in the strength of activity across areas and contour types. Two types of illusory contours differed in the strength of activation of the retinotopic areas, but both types activated crudely retinotopic visual areas, including V3A, V4v, V7, and V8, bilaterally. The extent of activation was largely invariant across a range of stimulus sizes that produce illusory contours perceptually, but it was related to the spatial frequency of displaced-grating stimuli. Finally, there was a striking similarity in the pattern of results for the illusory contour-defined shape and a similar shape defined by stereoscopic depth. These and other results suggest a role in surface perception for this lateral occipital region that includes V3A, V4v, V7, and V8.

A computational model for visual selection

We propose a computational model for detecting and localizing instances from an object class in static gray-level images. We divide detection into visual selection and final classification, concentrating on the former: drastically reducing the number of candidate regions that require further, usually more intensive, processing, but with a minimum of computation and missed detections. Bottom-up processing is based on local groupings of edge fragments constrained by loose geometrical relationships. They have no a priori semantic or geometric interpretation. The role of training is to select special groupings that are moderately likely at certain places on the object but rate in the background. We show that the statistics in both populations are stable. The candidate regions are those that contain global arrangements of several local groupings. Whereas our model was not conceived to explain brain functions, it does cohere with evidence about the functions of neurons in V1 and V2, such as responses to coarse or incomplete patterns (e.g., illusory contours) and to scale and translation invariance in IT. Finally, the algorithm is applied to face and symbol detection.

Motion-based mechanisms of illusory contour synthesis

Neurophysiological studies and computational models of illusory contour formation have focused on contour orientation as the underlying determinant of illusory contour shape in both static and moving displays. Here, we report a class of motion-induced illusory contours that demonstrate the existence of novel mechanisms of illusory contour synthesis. In a series of experiments, we show that the velocity of contour terminations and the direction of motion of a partially occluded figure regulate the perceived shape and apparent movement of illusory contours formed from moving image sequences. These results demonstrate the existence of neural mechanisms that reconstruct occlusion relationships from both real and inferred image velocities, in contrast to the static geometric mechanisms that have been the focus of studies to date.

Grouping of image fragments in primary visual cortex

In the visual world, objects are partially occluded by nearer objects, separating them into image fragments. However, the image fragments of the object can easily be grouped and organized together by the visual system. Psychophysical data and theoretical analysis indicate that such perceptual grouping might be mediated in the early stages of visual processing. Here I show that some orientation-selective cells in the primary visual cortex (V1) have response properties that can mediate the grouping of image fragments. These cells stopped responding to a stimulus bar when it was partly occluded by a small patch. The cells also did not respond when the patch had uncrossed disparity so that it appeared to be behind the bar. However, the cells began responding again when the patch had crossed disparity so that it appeared to be in front of the bar. These results indicate that cells as early as V1 have the computational power to make inferences about the nature of partially invisible forms seen behind occluding structures.