Neuronal correlates of real and illusory contour perception: functional anatomy with PET

The object-based shift direction anisotropy is modulated by the horizontal visual field meridian

Reallocating object-based attention across the visual field meridians is significantly faster horizontally than vertically (termed the shift direction anisotropy; SDA), implicating the meridians in reorienting object-based attention. Here, we tested the modulatory role of the meridians in the emergence of the SDA by manipulating meridian local feature contrast. Considering the notion of separate pools of attentional resources in each cortical hemisphere, we hypothesised that manipulating the horizontal meridian would selectively modulate the SDA. In four experiments, participants were presented with an "L"-shaped object and detected a target that appeared at either a cued location or at one of two equidistant non-cued locations at the far end of the horizontal or vertical object arm. Meridian local feature contrast was manipulated with perceptually strong enhancements (visible lines and colour contrast borders) and perceptually weak enhancements (illusory borders from line texture patterns and inducers). Weak enhancements of the meridians did not significantly modulate SDA magnitude; however, during perceptually strong enhancements of the horizontal meridian, the SDA was significantly reduced compared with both vertical meridian enhancement and no-enhancement conditions. Moreover, horizontal and vertical shift RTs were statistically equivalent when the horizontal meridian was enhanced with a visible line, our strongest manipulation, indicating the SDA was eliminated. These results suggest that the SDA emerges due to reallocating object-based attention across the horizontal meridian. We interpret this finding as evidence in support of the theory by which anatomical segregations of the visual system determine how pools of attentional resources resolve competition between and within cortical hemispheres.

Perception of illusory contours in children and adults: An eye-tracking study

The eye-tracking study investigated the perception of subjective Kanizsa and Ehrenstein figures in adults and in children aged 3-4, 5-6, 7-8, and 9-11 years of age. More specifically, the distribution of looking at the inner stimulus part versus the inducing elements was measured for illusory figures, figures with real contours, and control displays. It was hypothesized that longer looking at the inner area of the illusory figures indicates global contour interpolation, whereas longer looking at the inducing elements indicates a local processing mode. According to the results, participants of all ages looked longer at the illusory Kanizsa and Ehrenstein contours than at the figures' inducing elements. However, performance was lowest in the children aged 3-4 years and increased during the preschool period. Moreover, the illusory contour displays elicited comparable visual responses as did the real contour displays. The use of the control displays that contained no contour information ensured that the participants' looking behavior was not driven by a spontaneous tendency to attend to the inner stimulus parts. The study confirms the view that sensitivity to illusory contours emerges very early in life.

Severely Attenuated Visual Feedback Processing in Children on the Autism Spectrum

Individuals on the autism spectrum often exhibit atypicality in their sensory perception, but the neural underpinnings of these perceptual differences remain incompletely understood. One proposed mechanism is an imbalance in higher-order feedback re-entrant inputs to early sensory cortices during sensory perception, leading to increased propensity to focus on local object features over global context. We explored this theory by measuring visual evoked potentials during contour integration as considerable work has revealed that these processes are largely driven by feedback inputs from higher-order ventral visual stream regions. We tested the hypothesis that autistic individuals would have attenuated evoked responses to illusory contours compared with neurotypical controls. Electrophysiology was acquired while 29 autistic and 31 neurotypical children (7-17 years old, inclusive of both males and females) passively viewed a random series of Kanizsa figure stimuli, each consisting of four inducers that were aligned either at random rotational angles or such that contour integration would form an illusory square. Autistic children demonstrated attenuated automatic contour integration over lateral occipital regions relative to neurotypical controls. The data are discussed in terms of the role of predictive feedback processes on perception of global stimulus features and the notion that weakened "priors" may play a role in the visual processing anomalies seen in autism.SIGNIFICANCE STATEMENT Children on the autism spectrum differ from typically developing children in many aspects of their processing of sensory stimuli. One proposed mechanism for these differences is an imbalance in higher-order feedback to primary sensory regions, leading to an increased focus on local object features rather than global context. However, systematic investigation of these feedback mechanisms remains limited. Using EEG and a visual illusion paradigm that is highly dependent on intact feedback processing, we demonstrated significant disruptions to visual feedback processing in children with autism. This provides much needed experimental evidence that advances our understanding of the contribution of feedback processing to visual perception in autism spectrum disorder.

Feedback from lateral occipital cortex to V1/V2 triggers object completion: Evidence from functional magnetic resonance imaging and dynamic causal modeling

Illusory figures demonstrate the visual system's ability to integrate disparate parts into coherent wholes. We probed this object integration process by either presenting an integrated diamond shape or a comparable ungrouped configuration that did not render a complete object. Two tasks were used that either required localization of a target dot (relative to the presented configuration) or discrimination of the dot's luminance. The results showed that only when the configuration was task relevant (in the localization task), performance benefited from the presentation of an integrated object. Concurrent functional magnetic resonance imaging was performed and analyzed using dynamic causal modeling to investigate the (causal) relationship between regions that are associated with illusory figure completion. We found object‐specific feedback connections between the lateral occipital cortex (LOC) and early visual cortex (V1/V2). These modulatory connections persisted across task demands and hemispheres. Our results thus provide direct evidence that interactions between mid‐level and early visual processing regions engage in illusory figure perception. These data suggest that LOC first integrates inputs from multiple neurons in lower‐level cortices, generating a global shape representation while more fine‐graded object details are then determined via feedback to early visual areas, independently of the current task demands.

Impaired perception of illusory contours and cortical hypometabolism in patients with Parkinson's disease

•

We assessed the perception of illusory contours in patients with PD.

•

PD patients showed difficulty in perceiving Kanizsa illusory figures.

•

Impaired perception of Kanizsa illusory figures was related to LOC hypometabolism.

Neuroimaging evidence suggests that areas of the higher-order visual cortex, including the lateral occipital complex (LOC), are engaged in the perception of illusory contours; however, these findings remain unsubstantiated by human lesion data. Therefore, we assessed the presentation time necessary to perceive two types of illusory contours formed by Kanizsa figures or aligned line ends in patients with Parkinson's disease (PD). Additionally, we used ¹⁸F-fluorodeoxyglucose positron emission tomography (FDG-PET) to measure regional cerebral glucose metabolism in PD patients. Although there were no significant differences in the stimulus durations required for perception of illusory contours formed by aligned line ends between PD patients and controls, PD patients required significantly longer stimulus durations for the perception of Kanizsa illusory figures. Difficulty in perceiving Kanizsa illusory figures was correlated with hypometabolism in the higher-order visual cortical areas, including the posterior inferior temporal gyrus. These findings indicate an association between dysfunction in the posterior inferior temporal gyrus, a region corresponding to a portion of the LOC, and impaired perception of Kanizsa illusory figures in PD patients.

Interference of Illusory Contour Perception by a Distractor

The visual system is capable of recognizing objects when object information is widely separated in space, as revealed by the Kanizsa-type illusory contours (ICs). Attentional involvement in perception of ICs is an important topic, and the present study examined whether and how the processing of ICs is interfered with by a distractor. Discrimination between thin and short deformations of an illusory circle was investigated in the absence or presence of a central dynamic patch, with difficulty of discrimination varied in three levels (easy, medium, and hard). Reaction time (RT) was significantly shorter in the absence compared to the presence of the distractor in the easy and medium conditions. Correct rate (CR) was significantly higher in the absence compared to the presence of the distractor in the easy condition, and the magnitude of the difference between CRs of distracted and non-distracted responses significantly reduced as task difficulty increased. These results suggested that perception of ICs is more likely to be vulnerable to distraction when more attentional resources remain available. The present finding supports that attention is engaged in perception of ICs and that distraction of IC processing is associated with perceptual load.

Brain network mechanisms of visual shape completion

Visual shape completion recovers object shape, size, and number from spatially segregated edges. Despite being extensively investigated, the process’s underlying brain regions, networks, and functional connections are still not well understood. To shed light on the topic, we scanned (fMRI) healthy adults during rest and during a task in which they discriminated pac-man configurations that formed or failed to form completed shapes (illusory and fragmented condition, respectively). Task activation differences (illusory-fragmented), resting-state functional connectivity, and multivariate patterns were identified on the cortical surface using 360 predefined parcels and 12 functional networks composed of such parcels. Brain activity flow mapping (ActFlow) was used to evaluate the likely involvement of resting-state connections for shape completion. We identified 36 differentially-active parcels including a posterior temporal region, PH, whose activity was consistent across 95% of observers. Significant task regions primarily occupied the secondary visual network but also incorporated the frontoparietal dorsal attention, default mode, and cingulo-opercular networks. Each parcel’s task activation difference could be modeled via its resting-state connections with the remaining parcels (r=.62, p<10⁻⁹), suggesting that such connections undergird shape completion. Functional connections from the dorsal attention network were key in modelling task activation differences in the secondary visual network. Dorsal attention and frontoparietal connections could also model activations in the remaining networks. Taken together, these results suggest that shape completion relies upon a sparsely distributed but densely interconnected network coalition that is centered in the secondary visual network, coordinated by the dorsal attention network, and inclusive of at least three other networks.

Tracking the completion of parts into whole objects: Retinotopic activation in response to illusory figures in the lateral occipital complex

Illusory figures demonstrate the visual system's ability to integrate separate parts into coherent, whole objects. The present study was performed to track the neuronal object construction process in human observers, by incrementally manipulating the grouping strength within a given configuration until the emergence of a whole-object representation. Two tasks were employed: First, in the spatial localization task, object completion could facilitate performance and was task-relevant, whereas it was irrelevant in the second, luminance discrimination task. Concurrent functional magnetic resonance imaging (fMRI) used spatial localizers to locate brain regions representing task-critical illusory-figure parts to investigate whether the step-wise object construction process would modulate neural activity in these localized brain regions. The results revealed that both V1 and the lateral occipital complex (LOC, with sub-regions LO1 and LO2) were involved in Kanizsa figure processing. However, completion-specific activations were found predominantly in LOC, where neural activity exhibited a modulation in accord with the configuration's grouping strength, whether or not the configuration was relevant to performing the task at hand. Moreover, right LOC activations were confined to LO2 and responded primarily to surface and shape completions, whereas left LOC exhibited activations in both LO1 and LO2 and was related to encoding shape structures with more detail. Together, these results demonstrate that various grouping properties within a visual scene are integrated automatically in LOC, with sub-regions located in different hemispheres specializing in the component sub-processes that render completed objects.

Evidence of top-down modulation of the Brentano illusion but not of the glare effect by transcranial direct current stimulation

Transcranial direct current stimulation (tDCS) has been widely used for modulating sensory, motor and cognitive functions, but there are only few attempts to induce and change illusory perception. Visual illusions have been the most traditional and effective way to investigate visual processing through the comparison between physical reality and subjective reports. Here we used tDCS to modulate two different visual illusions, namely the Brentano illusion and the glare effect, with the aim of uncovering the influence of top-down mechanisms on bottom-up visual perception in two experiments. In Experiment 1, to a first group of subjects, real and sham cathodal tDCS (2 mA, 10 min) were applied over the left and right posterior parietal cortices (PPC). In Experiment 2, real and sham cathodal tDCS were applied to the left and right occipital cortices (OC) to a second group of participants. Results showed that tDCS was effective in modulating only the Brentano illusion, but not the glare effect. tDCS increased the Brentano illusion but specifically for the stimulated cortical area (right PPC), illusion direction (leftward), visual hemispace (left), and illusion length (160 mm). These findings suggest the existence of an inhibitory modulation of top-down mechanisms on bottom-up visual processing specifically for the Brentano illusion, but not for the glare effect. The lack of effect of occipital tDCS should consider the possible role of ocular compensation or of the unstimulated hemisphere, which deserves further investigations.

Sounds enhance visual completion processes

Everyday vision includes the detection of stimuli, figure-ground segregation, as well as object localization and recognition. Such processes must often surmount impoverished or noisy conditions; borders are perceived despite occlusion or absent contrast gradients. These illusory contours (ICs) are an example of so-called mid-level vision, with an event-related potential (ERP) correlate at ∼100-150 ms post-stimulus onset and originating within lateral-occipital cortices (the IC_effect). Presently, visual completion processes supporting IC perception are considered exclusively visual; any influence from other sensory modalities is currently unknown. It is now well-established that multisensory processes can influence both low-level vision (e.g. detection) as well as higher-level object recognition. By contrast, it is unknown if mid-level vision exhibits multisensory benefits and, if so, through what mechanisms. We hypothesized that sounds would impact the IC_effect. We recorded 128-channel ERPs from 17 healthy, sighted participants who viewed ICs or no-contour (NC) counterparts either in the presence or absence of task-irrelevant sounds. The IC_effect was enhanced by sounds and resulted in the recruitment of a distinct configuration of active brain areas over the 70-170 ms post-stimulus period. IC-related source-level activity within the lateral occipital cortex (LOC), inferior parietal lobe (IPL), as well as primary visual cortex (V1) were enhanced by sounds. Moreover, the activity in these regions was correlated when sounds were present, but not when absent. Results from a control experiment, which employed amodal variants of the stimuli, suggested that sounds impact the perceived brightness of the IC rather than shape formation per se. We provide the first demonstration that multisensory processes augment mid-level vision and everyday visual completion processes, and that one of the mechanisms is brightness enhancement. These results have important implications for the design of treatments and/or visual aids for low-vision patients.

Global shape integration and illusory form perception in the absence of awareness

Previous research on perceptual organization operations still provides contradictory evidence on whether the integration of sparse local elements into coherently unified shapes and the construction of the illusory form are accomplished without the need of awareness. In the present study, three experiments were conducted in which participants were presented with masked (Experiment 1, SOA=27ms; Experiment 2; SOA=53ms) and unmasked (Experiment 3) primes consisting of geometric shapes (a square or a diamond) that could be congruent or incongruent with subsequent probe stimuli (square vs. diamond). Furthermore, the primes were divided into: a grouping condition (where local elements may group together into global shapes), an illusory condition (where the arrangement of local elements produced illusory shapes) and a hybrid condition (where both operations were presented simultaneously). While no priming effects were found for the shortest SOA (27ms), both grouping and illusory primes produced significant priming effects in the longer SOA (53ms). On the other hand, results in Experiment 3 (unmasked) showed strong priming effects for the grouping of the inducers in both the grouping and the hybrid conditions, and also a significant but weaker priming effect for the illusory condition. Overall, our results support the possibility of the integration of local visual features into a global shape in the absence of awareness and, likewise, they suggest an early -subliminal- construction of the illusory shape, implying that feedback projections from higher to lower visual areas are not crucial in the construction of the illusory form.

Early suppression effect in human primary visual cortex during Kanizsa illusion processing: A magnetoencephalographic evidence

Detection of illusory contours (ICs) such as Kanizsa figures is known to depend primarily upon the lateral occipital complex. Yet there is no universal agreement on the role of the primary visual cortex in this process; some existing evidence hints that an early stage of the visual response in V1 may involve relative suppression to Kanizsa figures compared with controls. Iso-oriented luminance borders, which are responsible for Kanizsa illusion, may evoke surround suppression in V1 and adjacent areas leading to the reduction in the initial response to Kanizsa figures. We attempted to test the existence, as well as to find localization and timing of the early suppression effect produced by Kanizsa figures in adult nonclinical human participants. We used two sizes of visual stimuli (4.5 and 9.0°) in order to probe the effect at two different levels of eccentricity; the stimuli were presented centrally in passive viewing conditions. We recorded magnetoencephalogram, which is more sensitive than electroencephalogram to activity originating from V1 and V2 areas. We restricted our analysis to the medial occipital area and the occipital pole, and to a 40-120 ms time window after the stimulus onset. By applying threshold-free cluster enhancement technique in combination with permutation statistics, we were able to detect the inverted IC effect-a relative suppression of the response to the Kanizsa figures compared with the control stimuli. The current finding is highly compatible with the explanation involving surround suppression evoked by iso-oriented collinear borders. The effect may be related to the principle of sparse coding, according to which V1 suppresses representations of inner parts of collinear assemblies as being informationally redundant. Such a mechanism is likely to be an important preliminary step preceding object contour detection.

Applying Transcranial Magnetic Stimulation (TMS) Over the Dorsal Visual Pathway Induces Schizophrenia-like Disruption of Perceptual Closure

Perceptual closure ability is postulated to depend upon rapid transmission of magnocellular information to prefrontal cortex via the dorsal stream. In contrast, illusory contour processing requires only local interactions within primary and ventral stream visual regions, such as lateral occipital complex. Schizophrenia is associated with deficits in perceptual closure versus illusory contours processing that is hypothesized to reflect impaired magnocellular/dorsal stream. Perceptual closure and illusory contours performance was evaluated in separate groups of 12 healthy volunteers during no TMS, and during repetitive 10 Hz rTMS stimulation over dorsal stream or vertex (TMS-vertex). Perceptual closure and illusory contours were performed in 11 schizophrenia patients, no TMS was applied in these patients. TMS effects were evaluated with repeated measures ANOVA across treatments. rTMS significantly increased perceptual closure identification thresholds, with significant difference between TMS-dorsal stream and no TMS. TMS-dorsal stream also significantly reduced perceptual closure but not illusory contours accuracy. Schizophrenia patients showed increased perceptual closure identification thresholds relative to controls in the no TMS condition, but similar to controls in the TMS-dorsal stream condition. Conclusions of this study are that magnocellular/dorsal stream input is critical for perceptual closure but not illusory contours performance, supporting both trickledown theories of normal perceptual closure function, and magnocellular/dorsal stream theories of visual dysfunction in schizophrenia.

The Poggendorff illusion driven by real and illusory contour: Behavioral and neural mechanisms

The Poggendorff illusion refers to the phenomenon that the human brain misperceives a diagonal line as being apparently misaligned once the diagonal line is interrupted by two parallel edges, and the size of illusion is negatively correlated with the angle of interception of the oblique, i.e. the sharper the oblique angle, the larger the illusion. This optical illusion can be produced by both real and illusory contour. In this fMRI study, by parametrically varying the oblique angle, we investigated the shared and specific neural mechanisms underlying the Poggendorff illusion induced by real and illusory contour. At the behavioral level, not only the real but also the illusory contours were capable of inducing significant Poggendorff illusion. The size of illusion induced by the real contour, however, was larger than that induced by the illusory contour. At the neural level, real and illusory contours commonly activated more dorsal visual areas, and the real contours specifically activated more ventral visual areas. More importantly, examinations on the parametric modulation effects of the size of illusion revealed the specific neural mechanisms underlying the Poggendorff illusion induced by the real and the illusory contours, respectively. Left precentral gyrus and right middle occipital cortex were specifically involved in the Poggendorff illusion induced by the real contour. On the other hand, bilateral intraparietal sulcus (IPS) and right lateral occipital complex (LOC) were specifically involved in the Poggendorff illusion induced by the illusory contour. Functional implications of the above findings were further discussed.

Neural representation of ambiguous visual objects in the inferior temporal cortex

Inferior temporal (IT) cortex as the final stage of the ventral visual pathway is involved in visual object recognition. In our everyday life we need to recognize visual objects that are degraded by noise. Psychophysical studies have shown that the accuracy and speed of the object recognition decreases as the amount of visual noise increases. However, the neural representation of ambiguous visual objects and the underlying neural mechanisms of such changes in the behavior are not known. Here, by recording the neuronal spiking activity of macaque monkeys’ IT we explored the relationship between stimulus ambiguity and the IT neural activity. We found smaller amplitude, later onset, earlier offset and shorter duration of the response as visual ambiguity increased. All of these modulations were gradual and correlated with the level of stimulus ambiguity. We found that while category selectivity of IT neurons decreased with noise, it was preserved for a large extent of visual ambiguity. This noise tolerance for category selectivity in IT was lost at 60% noise level. Interestingly, while the response of the IT neurons to visual stimuli at 60% noise level was significantly larger than their baseline activity and full (100%) noise, it was not category selective anymore. The latter finding shows a neural representation that signals the presence of visual stimulus without signaling what it is. In general these findings, in the context of a drift diffusion model, explain the neural mechanisms of perceptual accuracy and speed changes in the process of recognizing ambiguous objects.

Illusory contours: a window onto the neurophysiology of constructing perception

Seeing seems effortless, despite the need to segregate and integrate visual information that varies in quality, quantity, and location. The extent to which seeing passively recapitulates the external world is challenged by phenomena such as illusory contours, an example of visual completion whereby borders are perceived despite their physical absence in the image. Instead, visual completion and seeing are increasingly conceived as active processes, dependent on information exchange across neural populations. How this is instantiated in the brain remains controversial. Divergent models emanate from single-unit and population-level electrophysiology, neuroimaging, and neurostimulation studies. We reconcile discrepant findings from different methods and disciplines, and underscore the importance of taking into account spatiotemporal brain dynamics in generating models of brain function and perception.

The role of size constancy for the integration of local elements into a global shape

Visual perception depends on the visual context and is likely to be influenced by size constancy, which predicts a size and distance invariant perception of objects. However, size constancy can also result in optical illusions that allow the manipulation of the perceived size. We thus asked whether the integration of local elements into a global object can be influenced by manipulations of the visual context and size constancy? A set of stimuli was applied in healthy individuals that took advantage of the “Kanizsa” illusion, in which three circles with open wedges oriented toward a center point are placed to form an illusionary perception of a triangle. In addition, a 3D-perspective view was implemented in which the global target (“Kanizsa” triangle) was placed in combination with several distractor circles either in a close or a distant position. Subjects were engaged in a global recognition task on the location of the “Kanizsa” triangle. Global recognition of “Kanizsa” triangles improved with a decreasing length of the illusory contour. Interestingly, recognition of “Kanizsa” triangles decreased when they were perceived as if they were located further away. We conclude that the integration of local elements into a global object is dependent on the visual context and dominated by size constancy.

Perception of illusory contours forms intermodulation responses of steady state visual evoked potentials as a neural signature of spatial integration

Perception of illusory contours was shown to be a consequence of neural activity related to spatial integration in early visual areas. Candidates for such filling-in phenomena are long-range horizontal connections of neurons in V1/V2, and feedback from higher order visual areas. To get a direct measure of spatial integration in early visual cortex, we presented two differently flickering inducers, which evoked steady-state visual evoked potentials (SSVEPs) while manipulating the formation of an illusory rectangle. As a neural marker of integration we tested differences in amplitudes of intermodulation frequencies i.e. linear combinations of the driving frequencies. These were significantly increased when an illusory rectangle was perceived. Increases were neither due to changes of any of the two driving frequencies nor in the frequency that tagged the processing of the compound object, indicating that results are not a consequence of paying more attention to inducers when the illusory rectangle was visible.

Disambiguating the roles of area V1 and the lateral occipital complex (LOC) in contour integration

Contour integration, the linking of collinear but disconnected visual elements across space, is an essential facet of object and scene perception. Here, we set out to arbitrate between two previously advanced mechanisms of contour integration: serial facilitative interactions between collinear cells in the primary visual cortex (V1) versus pooling of inputs in higher-order visual areas. To this end, we used high-density electrophysiological recordings to assess the spatio-temporal dynamics of brain activity in response to Gabor contours embedded in Gabor noise (so-called "pathfinder displays") versus control stimuli. Special care was taken to elicit and detect early activity stemming from the primary visual cortex, as indexed by the C1 component of the visual evoked potential. Arguing against a purely early V1 account, there was no evidence for contour-related modulations within the C1 timeframe (50-100 ms). Rather, the earliest effects were observed within the timeframe of the N1 component (160-200 ms) and inverse source analysis pointed to principle generators in the lateral occipital complex (LOC) within the ventral visual stream. Source anlaysis also suggested that it was only during this relatively late processing period that contextual effects emerged in hierarchically early visual regions (i.e. V1/V2), consistent with a more distributed process involving recurrent feedback/feedforward interactions between LOC and early visual sensory regions. The distribution of effects uncovered here is consistent with pooling of information in higher order cortical areas as the initial step in contour integration, and that this pooling occurs relatively late in processing rather than during the initial sensory-processing period.

The "side" matters: how configurality is reflected in completion

The perception of figure-ground organization is a highly context-sensitive phenomenon. Accumulating evidence suggests that the so-called completion phenomenon is tightly linked to this figure-ground organization. While many computational models have applied borderline completion algorithms based on the detection of boundary alignments, we point out the problems of this approach. We hypothesize that completion is a result of computing the figure-ground organization. Specifically, the global interactions in the neural network activate the "border-ownership" sensitive neurons at the location where no luminance contrast is given and this activation corresponds to the perception of illusory contours. The implications of this result to the general property of emerging Gestalt percepts are discussed.

Equivalent representation of real and illusory contours in macaque V4

The cortical processing of illusory contours provides a unique window for exploring the brain mechanisms underlying visual perception. Previous electrophysiological single-cell recordings demonstrate that a subgroup of cells in macaque V1 and V2 signal the presence of illusory contours, whereas recent human brain imaging studies reveal higher-order visual cortices playing a central role in illusory figure processing. It seems that the processing of illusory contours/figures may engage multiple cortical interactions between hierarchically organized processing stages in the ventral visual pathway of primates. However, it is not yet known in which brain areas illusory contours are represented in the same manner as real contours at both the population and single-cell levels. Here, by combining intrinsic optical imaging in anesthetized rhesus macaques with single-cell recordings in awake ones, we found a complete overlap of orientation domains in visual cortical area V4 for processing real and illusory contours. In contrast, the orientation domains mapped in early visual areas V1 and V2 mainly encoded the local physical stimulus features inducing the subjective perception of global illusory contours. Our results indicate that real and illusory contours are encoded equivalently by the same functional domains in V4, suggesting that V4 is a key cortical locus for integration of local features into global contours.

Event-related potential study of illusory contour perception in schizophrenia

Schizophrenic patients and healthy controls participated in event-related potential experiments, in which illusory contour (IC) and control objects [no contour (NC), real contour (RC)] were passively presented. As a result, P100 latency for IC in schizophrenic patients was significantly prolonged (+10.6 ms) compared to those for RC. The present findings indicate that an abnormality of IC processing, including 'bottom-up' as well as 'top-down' processing, may reflect basal pathogenesis of various clinical representations of schizophrenia. However, the P100 latency difference between IC and RC was very small in the patient group. Rather, 'cognitive' in the Positive and Negative Syndrome Scale (PANSS) model of Bell et al. significantly correlated with P100 latencies for NC. Such an association between PANSS and NC processing, where the shape must be inferred with increased attentional demands and 'top-down' processing, indicates that the abnormality of schizophrenic patients' preattentive process might be a problem of 'top-down' processing rather than 'bottom-up' processing.

TDCS guided using fMRI significantly accelerates learning to identify concealed objects

The accurate identification of obscured and concealed objects in complex environments was an important skill required for survival during human evolution, and is required today for many forms of expertise. Here we used transcranial direct current stimulation (tDCS) guided using neuroimaging to increase learning rate in a novel, minimally guided discovery-learning paradigm. Ninety-six subjects identified threat-related objects concealed in naturalistic virtual surroundings used in real-world training. A variety of brain networks were found using functional magnetic resonance imaging (fMRI) data collected at different stages of learning, with two of these networks focused in right inferior frontal and right parietal cortex. Anodal 2.0 mA tDCS performed for 30 min over these regions in a series of single-blind, randomized studies resulted in significant improvements in learning and performance compared with 0.1 mA tDCS. This difference in performance increased to a factor of two after a one-hour delay. A dose-response effect of current strength on learning was also found. Taken together, these brain imaging and stimulation studies suggest that right frontal and parietal cortex are involved in learning to identify concealed objects in naturalistic surroundings. Furthermore, they suggest that the application of anodal tDCS over these regions can greatly increase learning, resulting in one of the largest effects on learning yet reported. The methods developed here may be useful to decrease the time required to attain expertise in a variety of settings.

Dissociable neural correlates of contour completion and contour representation in illusory contour perception

Object recognition occurs even when environmental information is incomplete. Illusory contours (ICs), in which a contour is perceived though the contour edges are incomplete, have been extensively studied as an example of such a visual completion phenomenon. Despite the neural activity in response to ICs in visual cortical areas from low (V1 and V2) to high (LOC: the lateral occipital cortex) levels, the details of the neural processing underlying IC perception are largely not clarified. For example, how do the visual areas function in IC perception and how do they interact to archive the coherent contour perception? IC perception involves the process of completing the local discrete contour edges (contour completion) and the process of representing the global completed contour information (contour representation). Here, functional magnetic resonance imaging was used to dissociate contour completion and contour representation by varying each in opposite directions. The results show that the neural activity was stronger to stimuli with more contour completion than to stimuli with more contour representation in V1 and V2, which was the reverse of that in the LOC. When inspecting the neural activity change across the visual pathway, the activation remained high for the stimuli with more contour completion and increased for the stimuli with more contour representation. These results suggest distinct neural correlates of contour completion and contour representation, and the possible collaboration between the two processes during IC perception, indicating a neural connection between the discrete retinal input and the coherent visual percept.

High-frequency oscillatory response to illusory contour in typically developing boys and boys with autism spectrum disorders

Illusory contour (IC) perception, a fruitful model for studying the automatic contextual integration of local image features, can be used to investigate the putative impairment of such integration in children with autism spectrum disorders (ASD). We used the illusory Kanizsa square to test how the phase-locked (PL) gamma and beta electroencephalogram (EEG) responses of typically developing (TD) children aged 3-7 years and those with ASD were modulated by the presence of IC in the image. The PL beta and gamma activity strongly differentiated between IC and control figures in both groups of children (IC effect). However, the timing, topography, and direction of the IC effect differed in TD and ASD children. Between 40 msec and 120 msec after stimulus onset, both groups demonstrated lower power of gamma oscillations at occipital areas in response to IC than in response to the control figure. In TD children, this relative gamma suppression was followed by relatively higher parieto-occipital gamma and beta responses to IC within 120-270 msec after stimulus onset. This second stage of IC processing was absent in children with ASD. Instead, their response to IC was characterized by protracted (40-270 msec) relative reduction of gamma and beta oscillations at occipital areas. We hypothesize that children with ASD rely more heavily on lower-order processing in the primary visual areas and have atypical later stage related to higher-order processes of contour integration.

A new taxonomy for perceptual filling-in

Perceptual filling-in occurs when structures of the visual system interpolate information across regions of visual space where that information is physically absent. It is a ubiquitous and heterogeneous phenomenon, which takes place in different forms almost every time we view the world around us, such as when objects are occluded by other objects or when they fall behind the blind spot. Yet, to date, there is no clear framework for relating these various forms of perceptual filling-in. Similarly, whether these and other forms of filling-in share common mechanisms is not yet known. Here we present a new taxonomy to categorize the different forms of perceptual filling-in. We then examine experimental evidence for the processes involved in each type of perceptual filling-in. Finally, we use established theories of general surface perception to show how contextualizing filling-in using this framework broadens our understanding of the possible shared mechanisms underlying perceptual filling-in. In particular, we consider the importance of the presence of boundaries in determining the phenomenal experience of perceptual filling-in.

Global visual processing in macaques studied using Kanizsa illusory shapes

The ability to extract form information from a visual scene, for object recognition or figure-ground segregation, is a fundamental visual system function. Many studies of nonhuman primates have addressed the neural mechanisms involved in global form processing, but few have sought to demonstrate this ability behaviorally. In this study, we probed global visual processing in macaque monkeys (Macaca nemestrina) using classical Kanizsa illusory shapes as an assay of global form perception. We trained three monkeys on a "similarity match-to-sample" form discrimination task, first with complete forms embedded in fields of noncontour-inducing "pacman" elements. We then tested them with classic Kanizsa illusory shapes embedded in fields of randomly oriented elements. Two of the three subjects reached our criterion performance level of 80% correct or better on four of five illusory test conditions, demonstrating clear evidence of Kanizsa illusory form perception; the third subject mastered three of five conditions. Performance limits for illusory form discrimination were obtained by manipulating support ratio and by measuring threshold for discriminating "fat" and "thin" illusory squares. Our results indicate that macaque monkeys are capable of global form processing similarly to humans and that the perceptual mechanisms for "filling-in" contour gaps exist in macaques as they do in humans.

The neural correlates of visuospatial perceptual and oculomotor extrapolation

The human visual system must perform complex visuospatial extrapolations (VSE) across space and time in order to extract shape and form from the retinal projection of a cluttered visual environment characterized by occluded surfaces and moving objects. Even if we exclude the temporal dimension, for instance when judging whether an extended finger is pointing towards one object or another, the mechanisms of VSE remain opaque. Here we investigated the neural correlates of VSE using functional magnetic resonance imaging in sixteen human observers while they judged the relative position of, or saccaded to, a (virtual) target defined by the extrapolated path of a pointer. Using whole brain and region of interest (ROI) analyses, we compared the brain activity evoked by these VSE tasks to similar control judgements or eye movements made to explicit (dot) targets that did not require extrapolation. The data show that activity in an occipitotemporal region that included the lateral occipital cortex (LOC) was significantly greater during VSE than during control tasks. A similar, though less pronounced, pattern was also evident in regions of the fronto-parietal cortex that included the frontal eye fields. However, none of the ROIs examined exhibited a significant interaction between target type (extrapolated/explicit) and response type (oculomotor/perceptual). These findings are consistent with a close association between visuoperceptual and oculomotor responses, and highlight a critical role for the LOC in the process of VSE.

Influence of parallel and orthogonal real lines on illusory contour perception

Real lines and illusory contours (ICs) have been reported to either interfere with or facilitate the perception of the other, depending on real line orientation and contrast. Here we investigate contextual effects of real lines on illusory contour perception. Curvature discrimination thresholds of Kanizsa-contours were measured for superimposed real lines of different sub- and suprathreshold contrasts. We find that parallel lines interfere with curvature discrimination at suprathreshold, whereas orthogonal lines interfere at subthreshold contrasts. We did not find stable facilitating effects of lines in any orientation or contrast. These results are discussed in relation to existing physiological and imaging data.

Early processing in the human lateral occipital complex is highly responsive to illusory contours but not to salient regions

Human electrophysiological studies support a model whereby sensitivity to so-called illusory contour stimuli is first seen within the lateral occipital complex. A challenge to this model posits that the lateral occipital complex is a general site for crude region-based segmentation, based on findings of equivalent hemodynamic activations in the lateral occipital complex to illusory contour and so-called salient region stimuli, a stimulus class that lacks the classic bounding contours of illusory contours. Using high-density electrical mapping of visual evoked potentials, we show that early lateral occipital cortex activity is substantially stronger to illusory contour than to salient region stimuli, whereas later lateral occipital complex activity is stronger to salient region than to illusory contour stimuli. Our results suggest that equivalent hemodynamic activity to illusory contour and salient region stimuli probably reflects temporally integrated responses, a result of the poor temporal resolution of hemodynamic imaging. The temporal precision of visual evoked potentials is critical for establishing viable models of completion processes and visual scene analysis. We propose that crude spatial segmentation analyses, which are insensitive to illusory contours, occur first within dorsal visual regions, not the lateral occipital complex, and that initial illusory contour sensitivity is a function of the lateral occipital complex.

Direct contrasts between experimental conditions may yield more focal oscillatory activations than comparing pre- versus post-stimulus responses

Contrasting electro- or magnetoencephalographic oscillatory responses to sensory stimuli with a pre-stimulation baseline commonly yields spectrally broad and topographically distributed activations. In contrast, comparisons between closely matched task conditions usually result in more focal differences. In the present study, we reanalyzed an existing set of MEG data recorded during stimulation with virtual Kanizsa figures and no-triangle control stimuli to contrast results yielded by the two approaches. Statistical analysis showed that visual stimulation compared to baseline gave rise to spectral amplitude reductions in lower frequencies including alpha and beta and amplitude enhancements in gamma frequencies above 55 Hz. These changes reached significance by about 100 ms post-stimulus onset, were topographically widespread over posterior cortex, and did not differ between stimuli. A second, more focal component over ventral occipital cortex peaked at about 300 ms in the gamma range at approximately 70 Hz. It was more pronounced for the Kanizsa triangle than for the no-triangle stimulus. A third gamma component over lateral occipito-temporal cortex showed an amplitude increase at around 450 ms for virtual figures and a concomitant decrease for the nongestalt-like control stimulus, and no overall task-related activity. Our findings illustrate that direct comparisons between conditions yield effects with a more focal spectral and topographical distribution than comparisons with a pre-stimulus baseline. Moreover, they exemplify that contrasts between conditions may reveal additional activations not captured by comparisons with a pre-stimulus baseline.

Retinotopic activation in response to subjective contours in primary visual cortex

Objects in our visual environment are arranged in depth and hence there is a considerable amount of overlap and occlusion in the image they generate on the retina. In order to properly segment the image into figure and background, boundary interpolation is required even across large distances. Here we study the cortical mechanisms involved in collinear contour interpolation using fMRI. Human observers were asked to discriminate the curvature of interpolated boundaries in Kanizsa figures and in control configurations, which contained identical physical information but did not generated subjective shapes. We measured a spatially precise spin-echo BOLD signal and found stronger responses to subjective shapes than non-shapes at the subjective boundary locations, but not at the inducer locations. The responses to subjective contours within primary visual cortex were retinotopically specific and analogous to that to real contours, which is intriguing given that subjective and luminance-defined contours are physically fundamentally different. We suggest that in the absence of retinal stimulation, the observed activation changes in primary visual cortex are driven by intracortical interactions and feedback, which are revealed in the absence of a physical stimulus.

Biases and sensitivities in the Poggendorff effect when driven by subjective contours

PURPOSE

A consensus in the existing literature suggests that the Poggendorff effect (a perceptual misalignment of two collinear transversal segments when separated by a pair of parallel contours) persists when the parallels are defined by Kanizsa-like subjective contours. However, previous studies have often been complicated by a lack of quantitative measures of effect size, statistical tests of significance, appropriate measures of baseline and control biases, or stringent definition of subjective contours. The aim of this study was thus to determine whether subjective contours are capable of driving the Poggendorff effect once other factors are accounted for.

METHODS

Twenty participants were tested on a number of test and control figures incorporating first-order (luminance-defined) and subjective parallels using the method of adjustment. All figures were tested at two different orientations, and observer sensitivities and observer biases were assessed.

RESULTS

A systematic response bias (in the direction of the classical effect) was found for Poggendorff figures that incorporated subjective parallels. The effect was highly significant and greater than for control figures. There was no concomitant change in judgment sensitivity (positional certainty). Finally, there was a positive correlation between the effect size for figures incorporating first-order and subjective parallels.

CONCLUSIONS

The findings reported demonstrate conclusively that true Kanizsa-like subjective contours are capable of driving the Poggendorff effect. Further, the data are consistent with a growing body of evidence that suggests both first-order and subjective contours are processed at early loci in the visual pathways when position is encoded.

Visual search of illusory contours: Shape and orientation effects

Illusory contours are specific class of visual stimuli that represent stimuli configurations perceived as integral irrespective of the fact that they are given in fragmented uncompleted wholes. Due to their specific features, illusory contours gained much attention in last decade representing prototype of stimuli used in investigations focused on binding problem. On the other side, investigations of illusory contours are related to problem of the level of their visual processing. Neurophysiologic studies show that processing of illusory contours proceed relatively early, on the V2 level, on the other hand most of experimental studies claim that illusory contours are perceived with engagement of visual attention, binding their elements to whole percept. This research is focused on two experiments in which visual search of illusory contours are based on shape and orientation. The main experimental procedure evolved the task proposed by Bravo and Nakayama where instead of detection, subjects were performing identification of one among two possible targets. In the first experiment subjects detected the presence of illusory square or illusory triangle, while in the second experiment subject were detecting two different orientations of illusory triangle. The results are interpreted in terms of visual search and feature integration theory. Beside the type of visual search task, search type proved to be dependent of specific features of illusory shapes which further complicate theoretical interpretation of the level of their perception.

Rotating dotted ellipses: motion perception driven by grouped figural rather than local dot motion signals

Unlike the motion of a continuous contour, the motion of a single dot is unambiguous and immune to the aperture problem. Here we exploit this fact to explore the conditions under which unambiguous local motion signals are used to drive global percepts of an ellipse undergoing rotation. In previous work, we have shown that a thin, high aspect ratio ellipse will appear to rotate faster than a lower aspect ratio ellipse even when the two in fact rotate at the same angular velocity [Caplovitz, G. P., Hsieh, P. -J., & Tse, P. U. (2006) Mechanisms underlying the perceived angular velocity of a rigidly rotating object. Vision Research, 46(18), 2877-2893]. In this study we examined the perceived speed of rotation of ellipses defined by a virtual contour made up of evenly spaced dots.

RESULTS

Ellipses defined by closely spaced dots exhibit the speed illusion observed with continuous contours. That is, thin dotted ellipses appear to rotate faster than fat dotted ellipses when both rotate at the same angular velocity. This illusion is not observed if the dots defining the ellipse are spaced too widely apart. A control experiment ruled out low spatial frequency "blurring" as the source of the illusory percept.

CONCLUSION

Even in the presence of local motion signals that are immune to the aperture problem, the global percept of an ellipse undergoing rotation can be driven by potentially ambiguous motion signals arising from the non-local form of the grouped ellipse itself. Here motion perception is driven by emergent motion signals such as those of virtual contours constructed by grouping procedures. Neither these contours nor their emergent motion signals are present in the image.

Illusory shape representation in the monkey inferior temporal cortex

Perceived boundaries without physical differences between shape and background are called illusory contours (ICs). ICs and real contours (RCs) activate the early processing stages of the macaque visual pathway and the occipitotemporal areas of the human visual system in a similar way. However, it is not known how these contours are processed further in the highest visual areas. We tested how the responses of inferior temporal cortical (IT) neurons of macaque monkeys change in relationship to figures with RCs or ICs. The same set of figures [coloured pictures, ICs and silhouettes (SILs)] was presented to awake, fixating rhesus monkeys while the single-cell activity was recorded in the anterior part of the IT. Most of the neurons responsive to RCs were also responsive to the same shapes presented as ICs. The average net firing rates, however, were significantly lower for the illusory stimuli than for the stimuli in the RC conditions, and the latency of the responses was significantly longer for the ICs than for the RCs. The shape selectivity was found to be different for coloured stimuli and ICs, and similar for SILs and ICs, suggesting the invariance of selectivity to shapes having the same contour but lacking internal surface information. These results suggest different modes of processing of RCs and ICs in the IT, which might explain the differences in their perception.

Assignment of functional activations to probabilistic cytoarchitectonic areas revisited

Probabilistic cytoarchitectonic maps in standard reference space provide a powerful tool for the analysis of structure-function relationships in the human brain. While these microstructurally defined maps have already been successfully used in the analysis of somatosensory, motor or language functions, several conceptual issues in the analysis of structure-function relationships still demand further clarification. In this paper, we demonstrate the principle approaches for anatomical localisation of functional activations based on probabilistic cytoarchitectonic maps by exemplary analysis of an anterior parietal activation evoked by visual presentation of hand gestures. After consideration of the conceptual basis and implementation of volume or local maxima labelling, we comment on some potential interpretational difficulties, limitations and caveats that could be encountered. Extending and supplementing these methods, we then propose a supplementary approach for quantification of structure-function correspondences based on distribution analysis. This approach relates the cytoarchitectonic probabilities observed at a particular functionally defined location to the areal specific null distribution of probabilities across the whole brain (i.e., the full probability map). Importantly, this method avoids the need for a unique classification of voxels to a single cortical area and may increase the comparability between results obtained for different areas. Moreover, as distribution-based labelling quantifies the "central tendency" of an activation with respect to anatomical areas, it will, in combination with the established methods, allow an advanced characterisation of the anatomical substrates of functional activations. Finally, the advantages and disadvantages of the various methods are discussed, focussing on the question of which approach is most appropriate for a particular situation.

Orientation-selective adaptation to illusory contours in human visual cortex

Humans can perceive illusory or subjective contours in the absence of any real physical boundaries. We used an adaptation protocol to look for orientation-selective neural responses to illusory contours defined by phase-shifted abutting line gratings in the human visual cortex. We measured functional magnetic resonance imaging (fMRI) responses to illusory-contour test stimuli after adapting to an illusory-contour adapter stimulus that was oriented parallel or orthogonal to the test stimulus. We found orientation-selective adaptation to illusory contours in early (V1 and V2) and higher-tier visual areas (V3, hV4, VO1, V3A/B, V7, LO1, and LO2). That is, fMRI responses were smaller for test stimuli parallel to the adapter than for test stimuli orthogonal to the adapter. In two control experiments using spatially jittered and phase-randomized stimuli, we demonstrated that this adaptation was not just in response to differences in the distribution of spectral power in the stimuli. Orientation-selective adaptation to illusory contours increased from early to higher-tier visual areas. Thus, both early and higher-tier visual areas contain neurons selective for the orientation of this type of illusory contour.

Towards multimodal atlases of the human brain

Atlases of the human brain have an important impact on neuroscience. The emergence of ever more sophisticated imaging techniques, brain mapping methods and analytical strategies has the potential to revolutionize the concept of the brain atlas. Atlases can now combine data describing multiple aspects of brain structure or function at different scales from different subjects, yielding a truly integrative and comprehensive description of this organ. These integrative approaches have provided significant impetus for the human brain mapping initiatives, and have important applications in health and disease.

Testing anatomically specified hypotheses in functional imaging using cytoarchitectonic maps

The statistical inference on functional imaging data is severely complicated by the embedded multiple testing problem. Defining a region of interest (ROI) where the activation is hypothesized a priori helps to circumvent this problem, since in this case the inference is restricted to fewer simultaneous tests, rendering it more sensitive. Cytoarchitectonic maps obtained from postmortem brains provide objective, a priori ROIs that can be used to test anatomically specified hypotheses about the localization of functional activations. We here analyzed three methods for the definition of ROIs based on probabilistic cytoarchitectonic maps. (1) ROIs defined by the volume assigned to a cytoarchitectonic area in the summary map of all areas (maximum probability map, MPM), (2) ROIs based on thresholding the individual probabilistic maps and (3) spherical ROIs build around the cytoarchitectonic center of gravity. The quality with which the thus defined ROIs represented the respective cytoarchitectonic areas as well as their sensitivity for detecting functional activations was subsequently statistically evaluated. Our data showed that the MPM method yields ROIs, which reflect most adequately the underlying anatomical hypotheses. These maps also show a high degree of sensitivity in the statistical analysis. We thus propose the use of MPMs for the definition of ROIs. In combination with thresholding based on the Gaussian random field theory, these ROIs can then be applied to test anatomically specified hypotheses in functional neuroimaging studies.

The Ferrier Lecture 1995 behind the seen: the functional specialization of the brain in space and time

The visual brain consists of many different visual areas, which are functionally specialized to process and perceive different attributes of the visual scene. However, the time taken to process different attributes varies; consequently, we see some attributes before others. It follows that there is a perceptual asynchrony and hierarchy in visual perception. Because perceiving an attribute is tantamount to becoming conscious of it, it follows that we become conscious of different attributes at different times. Visual consciousness is therefore distributed in time. Given that we become conscious of different visual attributes because of activity at different, functionally specialized, areas of the visual brain, it follows that visual consciousness is also distributed in space. Therefore, visual consciousness is not a single unified entity, but consists of many microconsciousnesses.

Functional neuroimaging findings on the human perception of illusory contours

Illusory contours (IC) have attracted a considerable interest in recent years to derive models of how sensory information is processed and integrated within the visual system. In addition to various findings from neuropsychology, neurophysiology, and psychophysics, several recent studies have used functional neuroimaging to identify the cerebral substrates underlying human perception of IC (in particular Kanizsa figures). In this paper, we review the results from more than 20 neuroimaging studies on IC perception and highlight the great diversity of findings across these studies. We then provide a detailed discussion about the localization ('where' debate) and the timing ('when' debate) of IC processing as suggested by functional neuroimaging. Cortical responses involving visual areas as early as V1/V2 and latencies as rapid as 100 ms have been reported in several studies. Particular issues concerning the role of the right hemisphere and the retinotopic encoding of IC are also discussed. These different findings are tentatively brought together to propose different hypothetical cortical mechanisms that might be responsible for the visual formation of IC. Several remaining questions on IC processing that could potentially be explored with functional neuroimaging techniques are finally emphasized.