Spatiotemporal dynamics of human object recognition processing: an integrated high-density electrical mapping and functional imaging study of "closure" processes

Perception of illusory contours in children and adults: An eye-tracking study

The eye-tracking study investigated the perception of subjective Kanizsa and Ehrenstein figures in adults and in children aged 3-4, 5-6, 7-8, and 9-11 years of age. More specifically, the distribution of looking at the inner stimulus part versus the inducing elements was measured for illusory figures, figures with real contours, and control displays. It was hypothesized that longer looking at the inner area of the illusory figures indicates global contour interpolation, whereas longer looking at the inducing elements indicates a local processing mode. According to the results, participants of all ages looked longer at the illusory Kanizsa and Ehrenstein contours than at the figures' inducing elements. However, performance was lowest in the children aged 3-4 years and increased during the preschool period. Moreover, the illusory contour displays elicited comparable visual responses as did the real contour displays. The use of the control displays that contained no contour information ensured that the participants' looking behavior was not driven by a spontaneous tendency to attend to the inner stimulus parts. The study confirms the view that sensitivity to illusory contours emerges very early in life.

Network-level mechanisms underlying effects of transcranial direct current stimulation (tDCS) on visuomotor learning in schizophrenia

Motor learning is a fundamental skill to our daily lives. Dysfunction in motor performance in schizophrenia (Sz) has been associated with poor social and functional outcomes. Transcranial direct current stimulation (tDCS), a non-invasive electrical brain stimulation approach, can influence underlying brain function with potential for improving motor learning in Sz. We used a well-established Serial Reaction Time Task (SRTT) to study motor learning, in combination with simultaneous tDCS and EEG recording, to investigate mechanisms of motor and procedural learning deficits in Sz, and to develop refined non-invasive brain stimulation approaches to improve neurocognitive dysfunction. We recruited 27 individuals with Sz and 21 healthy controls (HC). Individuals performed the SRTT task as they received sham and active tDCS with simultaneous EEG recording. Reaction time (RT), neuropsychological, and measures of global functioning were assessed. SRTT performance was significantly impaired in Sz and showed significant correlations with motor-related and working memory measures as well as global function. Source-space time-frequency decomposition of EEG showed beta-band coherence across supplementary-motor, primary-motor and visual cortex forming a network involved in SRTT performance. Motor-cathodal and visual-cathodal stimulations resulted in significant modulation in coherence particularly across the motor-visual nodes of the network accompanied by significant improvement in motor learning in both controls and patients. Here, we confirm earlier reports of SRTT impairment in Sz and demonstrate significant reversal of the deficits with tDCS. The findings support continued development of tDCS for enhancement of plasticity-based interventions in Sz, as well as source-space EEG analytic approaches for evaluating underlying neural mechanisms.

Network-level mechanisms underlying effects of transcranial direct current stimulation (tDCS) on visuomotor learning impairments in schizophrenia

Motor learning is a fundamental skill to our daily lives. Dysfunction in motor performance in schizophrenia (Sz) is associated with poor social and functional outcomes, but nevertheless remains understudied relative to other neurocognitive domains. Moreover, transcranial direct current stimulation (tDCS) can influence underlying brain function in Sz and may be especially useful in enhancing local cortical plasticity, but underlying neural mechanisms remain incompletely understood. Here, we evaluated performance of Sz individuals on the Serial Reaction Time Task (SRTT), which has been extensively used in prior tDCS research, in combination with concurrent tDCS and EEG source localization first to evaluate the integrity of visuomotor learning in Sz relative to other cognitive domains and second to investigate underlying neural mechanisms. Twenty-seven individuals with Sz and 21 healthy controls (HC) performed the SRTT task as they received sham or active tDCS and simultaneous EEG recording. Measures of motor, neuropsychological and global functioning were also assessed. Impaired SRTT performance correlated significantly with deficits in motor performance, working memory, and global functioning. Time-frequency ("Beamformer") EEG source localization showed beta-band coherence across supplementary-motor, primary-motor and visual cortex regions, with reduced visuomotor coherence in Sz relative to HC. Cathodal tDCS targeting both visual and motor regions resulted in significant modulation in coherence particularly across the motor-visual nodes of the network accompanied by significant improvement in motor learning in both controls and patients. Overall, these findings demonstrate the utility of the SRTT to study mechanisms of visuomotor impairment in Sz and demonstrate significant tDCS effects on both learning and connectivity when applied over either visual or motor regions. The findings support continued study of dysfunctional dorsal-stream visual connectivity and motor plasticity as components of cognitive impairment in Sz, of local tDCS administration for enhancement of plasticity, and of source-space EEG-based biomarkers for evaluation of underlying neural mechanisms.

Severely Attenuated Visual Feedback Processing in Children on the Autism Spectrum

Individuals on the autism spectrum often exhibit atypicality in their sensory perception, but the neural underpinnings of these perceptual differences remain incompletely understood. One proposed mechanism is an imbalance in higher-order feedback re-entrant inputs to early sensory cortices during sensory perception, leading to increased propensity to focus on local object features over global context. We explored this theory by measuring visual evoked potentials during contour integration as considerable work has revealed that these processes are largely driven by feedback inputs from higher-order ventral visual stream regions. We tested the hypothesis that autistic individuals would have attenuated evoked responses to illusory contours compared with neurotypical controls. Electrophysiology was acquired while 29 autistic and 31 neurotypical children (7-17 years old, inclusive of both males and females) passively viewed a random series of Kanizsa figure stimuli, each consisting of four inducers that were aligned either at random rotational angles or such that contour integration would form an illusory square. Autistic children demonstrated attenuated automatic contour integration over lateral occipital regions relative to neurotypical controls. The data are discussed in terms of the role of predictive feedback processes on perception of global stimulus features and the notion that weakened "priors" may play a role in the visual processing anomalies seen in autism.SIGNIFICANCE STATEMENT Children on the autism spectrum differ from typically developing children in many aspects of their processing of sensory stimuli. One proposed mechanism for these differences is an imbalance in higher-order feedback to primary sensory regions, leading to an increased focus on local object features rather than global context. However, systematic investigation of these feedback mechanisms remains limited. Using EEG and a visual illusion paradigm that is highly dependent on intact feedback processing, we demonstrated significant disruptions to visual feedback processing in children with autism. This provides much needed experimental evidence that advances our understanding of the contribution of feedback processing to visual perception in autism spectrum disorder.

Cognitive Impairment Associated with Schizophrenia: From Pathophysiology to Treatment

Cognitive impairment is a core feature of schizophrenia and a major contributor to poor functional outcomes. Methods for assessment of cognitive dysfunction in schizophrenia are now well established. In addition, there has been increasing appreciation in recent years of the additional role of social cognitive impairment in driving functional outcomes and of the contributions of sensory-level dysfunction to higher-order impairments. At the neurochemical level, acute administration of N-methyl-d-aspartate receptor (NMDAR) antagonists reproduces the pattern of neurocognitive dysfunction associated with schizophrenia, encouraging the development of treatments targeted at both NMDAR and its interactome. At the local-circuit level, an auditory neurophysiological measure, mismatch negativity, has emerged both as a veridical index of NMDAR dysfunction and excitatory/inhibitory imbalance in schizophrenia and as a critical biomarker for early-stage translational drug development. Although no compounds have yet been approved for treatment of cognitive impairment associated with schizophrenia, several candidates are showing promise in early-phase testing.

Detrending Moving Average, Power Spectral Density, and Coherence: Three EEG-Based Methods to Assess Emotion Irradiation during Facial Perception

Understanding brain reactions to facial expressions can help in explaining emotion-processing and memory mechanisms. The purpose of this research is to examine the dynamics of electrical brain activity caused by visual emotional stimuli. The focus is on detecting changes in cognitive mechanisms produced by negative, positive, and neutral expressions on human faces. Three methods were used to study brain reactions: power spectral density, detrending moving average (DMA), and coherence analysis. Using electroencephalogram (EEG) recordings from 48 subjects while presenting facial image stimuli from the International Affective Picture System, the topographic representation of the evoked responses was acquired and evaluated to disclose the specific EEG-based activity patterns in the cortex. The theta and beta systems are two key cognitive systems of the brain that are activated differently on the basis of gender. The obtained results also demonstrate that the DMA method can provide information about the cortical networks’ functioning stability, so it can be coupled with more prevalent methods of EEG analysis.

Neural mechanisms associated with semantic and basic self-oriented memory processes interact moderating self-esteem

Individuals constantly encounter feedback from others and process this feedback in various ways to maintain positive situational state self-esteem in relation to semantic-based or trait self-esteem. Individuals may utilize episodic or semantic-driven processes that modulate feedback in two different ways to maintain general self-esteem levels. To date, it is unclear how these processes work while individuals receive social feedback to modulate state self-esteem. Utilizing neural regions associated with semantic self-oriented and basic encoding processes (medial prefrontal cortex (mPFC) and posterior cingulate cortex (PCC), respectively), in addition to time-frequency and Granger causality analyses to assess mPFC and PCC interactions, this study examined how the encoding of social feedback modulated individuals' (N = 45) post-task state self-esteem in relation to their trait self-esteem. Findings highlight the dynamic interplay between mPFC and PCC that modulate state self-esteem in relation to trait self-esteem, to maintain high self-esteem in general in the moment and over time.

Neural responses to rapidly selecting color names with different novelty

It is well known that different names of color can lead to distinct attractions to people. To study the neural mechanism underlying this phenomenon, an implicit association test task was designed for color names, in which participants were required to select the possible meanings of a Greek phrase from two color names (in Chinese). The behavioral results showed that the participants were more likely to select novel names for long Greek phrases and dates names for short Greek phrases. The EEG results showed that the mean amplitude of N1 was greater for selections of novel color names than selections of dates names for Greek phrases. Meanwhile, the mean amplitude of N3 for novel color names was more negative than that of dates color names. Significant interaction effect of N3 was also found for the four kinds of selections between Greek phrases and Chinese color names. Moreover, a frontal-positive and occipital-negative distribution for scalp topography of N1 was found, while the scalp topography of N3 was opposite as frontal-negative and occipital-positive distribution, suggesting the importance of visual cortex for perception of the color names and prefrontal cortex for integration and decision of selection. In summary, the results here indicated that colors with novel names could easily attract people's attention than colors with dates names, which might shed light on the usage of color names in real life.

The N300: An Index for Predictive Coding of Complex Visual Objects and Scenes

Predictive coding models can simulate known perceptual or neuronal phenomena, but there have been fewer attempts to identify a reliable neural signature of predictive coding for complex stimuli. In a pair of studies, we test whether the N300 component of the event-related potential, occurring 250–350-ms poststimulus-onset, has the response properties expected for such a signature of perceptual hypothesis testing at the level of whole objects and scenes. We show that N300 amplitudes are smaller to representative (“good exemplars”) compared with less representative (“bad exemplars”) items from natural scene categories. Integrating these results with patterns observed for objects, we establish that, across a variety of visual stimuli, the N300 is responsive to statistical regularity, or the degree to which the input is “expected” (either explicitly or implicitly) based on prior knowledge, with statistically regular images evoking a reduced response. Moreover, we show that the measure exhibits context-dependency; that is, we find the N300 sensitivity to category representativeness when stimuli are congruent with, but not when they are incongruent with, a category pre-cue. Thus, we argue that the N300 is the best candidate to date for an index of perceptual hypotheses testing for complex visual objects and scenes.

The Time Course of Perceptual Closure of Incomplete Visual Objects: An Event-Related Potential Study

Perceptual organization is an important part of visual and auditory information processing. In the case of visual occlusion, whether the loss of information in images could be recovered and thus perceptually closed affects object recognition. In particular, many elderly subjects have defects in object recognition ability, which may be closely related to the abnormalities of perceptual functions. This phenomenon even can be observed in the early stage of dementia. Therefore, studying the neural mechanism of perceptual closure and its relationship with sensory and cognitive processing is important for understanding how the human brain recognizes objects, inspiring the development of neuromorphic intelligent algorithms of object recognition. In this study, a new experiment was designed to explore the realistic process of perceptual closure under occlusion and intact conditions of faces and building. The analysis of the differences in ERP components P1, N1, and Ncl indicated that the subjective awareness of perceptual closure mainly occurs in Ncl, but incomplete information has been processed and showed different manners compared to complete stimuli in N170 for facial materials. Although occluded, faces, but not buildings, still maintain the specificity of perceptual processing. The Ncl by faces and buildings did not show significant differences in both amplitude and latency, suggesting a “completing” process regardless of categorical features.

Network-level mechanisms underlying effects of transcranial direct current stimulation (tDCS) on visuomotor learning

Transcranial direct current stimulation (tDCS) is a non-invasive brain stimulation approach in which low level currents are administered over the scalp to influence underlying brain function. Prevailing theories of tDCS focus on modulation of excitation-inhibition balance at the local stimulation location. However, network level effects are reported as well, and appear to depend upon differential underlying mechanisms. Here, we evaluated potential network-level effects of tDCS during the Serial Reaction Time Task (SRTT) using convergent EEG- and fMRI-based connectivity approaches. Motor learning manifested as a significant (p <.0001) shift from slow to fast responses and corresponded to a significant increase in beta-coherence (p <.0001) and fMRI connectivity (p <.01) particularly within the visual-motor pathway. Differential patterns of tDCS effect were observed within different parametric task versions, consistent with network models. Overall, these findings demonstrate objective physiological effects of tDCS at the network level that result in effective behavioral modulation when tDCS parameters are matched to network-level requirements of the underlying task.

ERP and MEG correlates of visual consciousness: The second decade

The first decade of event-related potential (ERP) research had established that the most consistent correlates of the onset of visual consciousness are the early visual awareness negativity (VAN), a posterior negative component in the N2 time range, and the late positivity (LP), an anterior positive component in the P3 time range. Two earlier extensive reviews ten years ago had concluded that VAN is the earliest and most reliable correlate of visual phenomenal consciousness, whereas LP probably reflects later processes associated with reflective/access consciousness. This article provides an update to those earlier reviews. ERP and MEG studies that have appeared since 2010 and directly compared ERPs between aware and unaware conditions are reviewed, and important new developments in the field are discussed. The result corroborates VAN as the earliest and most consistent signature of visual phenomenal consciousness, and casts further doubt on LP as an ERP correlate of phenomenal consciousness.

Electrophysiological responses to regularity show specificity to global form: The case of Glass patterns

The holographic weight of evidence model (van der Helm & Leeuwenberg, J Math Psychol, 35, 1991, 151; van der Helm & Leeuwenberg, Psychol Rev, 103, 1996, 429) estimates that the perceptual goodness of moiré structures (Glass patterns), irrespective of their global form, is comparable to that of reflection symmetry. However, both behavioural and neuroscience evidences suggest that certain Glass forms (i.e. circular and radial structures) are perceptually more salient than others (i.e. translation structures) and may recruit different perceptual mechanisms. In this study, we tested whether brain responses for circular, radial and translation Glass patterns are comparable to the response for onefold bilateral reflection symmetry. We recorded an event‐related potential (ERP), called the sustained posterior negativity (SPN), which has been shown to index perceptual goodness of a range of regularities. We found that circular and radial Glass patterns generated a comparable SPN amplitude to onefold reflection symmetry (in line with the prediction of the holographic model), starting approx. 180 ms after stimulus onset. Conversely, the SPN response to translation Glass patterns had a longer latency (approx. 400 ms). These results show that Glass patterns are a special case of visual regularity, and perceptual goodness may not be fully explained by the holographic identities that constitute it. Specialised processing mechanisms might exist in the regularity‐sensitive extrastriate areas, which are tuned to global form configurations.

Multimodal Computational Modeling of Visual Object Recognition Deficits but Intact Repetition Priming in Schizophrenia

The term perceptual closure refers to the neural processes responsible for "filling-in" missing information in the visual image under highly adverse viewing conditions such as fog or camouflage. Here we used a closure task that required the participants to identify barely recognizable fragmented line-drawings of common objects. Patients with schizophrenia have been shown to perform poorly on this task. Following priming, controls and importantly patients can complete the line-drawings at greater levels of fragmentation behaviorally, suggesting an improvement in their ability to perform the task. Closure phenomena have been shown to involve a distributed network of cortical regions, notably the lateral occipital complex (LOC) of the ventral visual stream, dorsal visual stream (DS), hippocampal formation (HIPP) and the prefrontal cortex (PFC). We have previously demonstrated the failure of closure processes in schizophrenia and shown that the dysregulation in the sensory information transmitted to the prefrontal cortex plays a critical role in this failure. Here, using a multimodal imaging approach in patients, combining event related electrophysiological recordings (ERP) and functional magnetic resonance imaging (fMRI), we characterize the spatiotemporal dynamics of priming in perceptual closure. Using directed functional connectivity measures we demonstrate that priming modifies the network-level interactions between the nodes of closure processing in a manner that is functionally advantageous to patients resulting in the mitigation of their deficit in perceptual closure.

Evidence for intact stimulus-specific neural adaptation for visual objects in schizophrenia and bipolar disorder: An ERP study

People with schizophrenia (SZ) or bipolar disorder (BD) experience dysfunction in visual processing. Dysfunctional neural tuning, in which neurons and neuronal populations are selectively activated by specific features of visual stimuli, may contribute to these deficits. Few studies have examined this possibility and there are inconsistent findings of tuning deficits in the literature. We utilized an event-related potential (ERP) paradigm to examine neural adaptation for visual objects, a measure of neural tuning whereby neurons respond less strongly to the repeated presentation of the same stimulus. Seventy-seven SZ, 53 BD, and 49 healthy comparison participants (HC) were examined. In three separate conditions, pictures of objects were presented repeatedly: the same object (SS), different objects from the same category (e.g., two different vases; SD), or different objects from different categories (e.g., a barrel and a clock, DD). Mass-univariate cluster-based permutation analyses identified electrodes and time-windows in which there were significant differences between the SS vs. DD and the SD vs. DD conditions. Mean ERP amplitudes were extracted from these clusters and analyzed for group differences. Results revealed a significant condition difference over parieto-occipital electrodes for the SS-DD comparison between 109–164 ms and for the SD-DD comparison between 78–203 ms, with larger amplitudes in the DD compared to either SS or SD condition. However, there were no significant differences in the pattern of results between groups. Thus, while we found neural adaptation effects using this ERP paradigm, we did not find evidence of group differences. Our results suggest that people with SZ or BD may not exhibit deficits in neural tuning for processing of visual objects using this EEG task with rapidly presented stimuli. However, the results are inconsistent with other studies using different methodologies (e.g., fMRI, behavioral tasks) that have found tuning deficits in people with schizophrenia.

Fragmented ambiguous objects: Stimuli with stable low-level features for object recognition tasks

Visual object recognition is a complex skill that relies on the interaction of many spatially distinct and specialized visual areas in the human brain. One tool that can help us better understand these specializations and interactions is a set of visual stimuli that do not differ along low-level dimensions (e.g., orientation, contrast) but do differ along high-level dimensions, such as whether a real-world object can be detected. The present work creates a set of line segment-based images that are matched for luminance, contrast, and orientation distribution (both for single elements and for pair-wise combinations) but result in a range of object and non-object percepts. Image generation started with images of isolated objects taken from publicly available databases and then progressed through 3-stages: a computer algorithm generating 718 candidate images, expert observers selecting 217 for further consideration, and naïve observers performing final ratings. This process identified a set of 100 images that all have the same low-level properties but cover a range of recognizability (proportion of naïve observers (N = 120) who indicated that the stimulus "contained a known object") and semantic stability (consistency across the categories of living, non-living/manipulable, and non-living/non-manipulable when the same observers named "known" objects). Stimuli are available at https://github.com/caolman/FAOT.git.

Sustained response to symmetry in extrastriate areas after stimulus offset: An EEG study

Electrophysiological (EEG) studies of human perception have found that amplitude at posterior electrodes is more negative for symmetrical patterns compared to asymmetrical patterns. This negativity lasts for hundreds of milliseconds and it has been called sustained posterior negativity (SPN). Symmetry activates a network of visual areas, including the lateral occipital complex (LOC). The SPN is a response to presence of symmetry in the image. Given the sustained nature of this activation, in this study we tested the persistence of the SPN after stimulus offset. Two shapes were presented (for 0.5 s each) with a 1 s blank interval in between. We observed a sustained response after stimulus offset, irrespective of whether the task required processing of shape information. This supports the idea that the response to symmetry is generated by information in the image, independently of task, and that it is sustained over approximately one second post stimulus onset.

Early sensitivity of evoked potentials to surface and volumetric structure during the visual perception of three-dimensional object shape

This study used event-related potentials (ERPs) to elucidate how the human visual system processes three-dimensional (3-D) object shape structure. In particular, we examined whether the perceptual mechanisms that support the analysis of 3-D shape are differentially sensitive to higher order surface and volumetric part structure. Observers performed a whole-part novel object matching task in which part stimuli comprised sub-regions of closed edge contour, surfaces or volumetric parts. Behavioural response latency data showed an advantage in matching surfaces and volumetric parts to whole objects over contours, but no difference between surfaces and volumes. ERPs were analysed using a convergence of approaches based on stimulus dependent amplitude modulations of evoked potentials, topographic segmentation, and spatial frequency oscillations. The results showed early differential perceptual processing of contours, surfaces, and volumetric part stimuli. This was first reliably observed over occipitoparietal electrodes during the N1 (140-200 ms) with a mean peak latency of 170 ms, and continued on subsequent P2 (220-260 ms) and N2 (260-320 ms) components. The differential sensitivity in perceptual processing during the N1 was accompanied by distinct microstate patterns that distinguished among contours, surfaces and volumes, and predominant theta band activity around 4-7 Hz over right occipitoparietal and orbitofrontal sites. These results provide the first evidence of early differential perceptual processing of higher order surface and volumetric shape structure within the first 200 ms of stimulus processing. The findings challenge theoretical models of object recognition that do not attribute functional significance to surface and volumetric object structure during visual perception.

Brain mechanisms for perceiving illusory lines in humans

Illusory contours (ICs) are perceptions of visual borders despite absent contrast gradients. The psychophysical and neurobiological mechanisms of IC processes have been studied across species and diverse brain imaging/mapping techniques. Nonetheless, debate continues regarding whether IC sensitivity results from a (presumably) feedforward process within low-level visual cortices (V1/V2) or instead are processed first within higher-order brain regions, such as lateral occipital cortices (LOC). Studies in animal models, which generally favour a feedforward mechanism within V1/V2, have typically involved stimuli inducing IC lines. By contrast, studies in humans generally favour a mechanism where IC sensitivity is mediated by LOC and have typically involved stimuli inducing IC forms or shapes. Thus, the particular stimulus features used may strongly contribute to the model of IC sensitivity supported. To address this, we recorded visual evoked potentials (VEPs) while presenting human observers with an array of 10 inducers within the central 5°, two of which could be oriented to induce an IC line on a given trial. VEPs were analysed using an electrical neuroimaging framework. Sensitivity to the presence vs. absence of centrally-presented IC lines was first apparent at ∼200 ms post-stimulus onset and was evident as topographic differences across conditions. We also localized these differences to the LOC. The timing and localization of these effects are consistent with a model of IC sensitivity commencing within higher-level visual cortices. We propose that prior observations of effects within lower-tier cortices (V1/V2) are the result of feedback from IC sensitivity that originates instead within higher-tier cortices (LOC).

Contour interpolation: A case study in Modularity of Mind

In his monograph Modularity of Mind (1983), philosopher Jerry Fodor argued that mental architecture can be partly decomposed into computational organs termed modules, which were characterized as having nine co-occurring features such as automaticity, domain specificity, and informational encapsulation. Do modules exist? Debates thus far have been framed very generally with few, if any, detailed case studies. The topic is important because it has direct implications on current debates in cognitive science and because it potentially provides a viable framework from which to further understand and make hypotheses about the mind's structure and function. Here, the case is made for the modularity of contour interpolation, which is a perceptual process that represents non-visible edges on the basis of how surrounding visible edges are spatiotemporally configured. There is substantial evidence that interpolation is domain specific, mandatory, fast, and developmentally well-sequenced; that it produces representationally impoverished outputs; that it relies upon a relatively fixed neural architecture that can be selectively impaired; that it is encapsulated from belief and expectation; and that its inner workings cannot be fathomed through conscious introspection. Upon differentiating contour interpolation from a higher-order contour representational ability ("contour abstraction") and upon accommodating seemingly inconsistent experimental results, it is argued that interpolation is modular to the extent that the initiating conditions for interpolation are strong. As interpolated contours become more salient, the modularity features emerge. The empirical data, taken as a whole, show that at least certain parts of the mind are modularly organized.

Perceptual Grouping of Closed Contours Is Disrupted by the Interpretation of the Scene Layout

Closure is one of the grouping principles in perceptual organization. Studies have shown that closure can be affected by several factors, specifically by low-level image features. However, the effects of high-level non-image factors on grouping by closure are unknown. In two experiments we investigated how closure is affected when depth information is introduced to the 2D closed contours, whilst the other 2D features remain intact. The first experiment showed that the grouping of closed contours was disrupted by the manipulation in 3D layout. The second experiment showed that thus disruption resulted in the impairment of searching efficiency. These findings suggest that closure is not only determined by the image features, but also affected by the interpretation of the contextual scene layout.

Reduced intrinsic visual cortical connectivity is associated with impaired perceptual closure in schizophrenia

Sensory perceptual processing deficits, such as impaired visual object identification and perceptual closure, have been reported in schizophrenia. These perceptual impairments may be associated with neural deficits in visual association areas, including lateral occipital cortex and inferior temporal areas. However, it remains unknown if such deficits can be found in the intrinsic architecture of the visual system.

In the current study, we measured perceptual closure performance and resting-state functional connectivity using functional magnetic resonance imaging (FMRI) in 16 schizophrenia patients and 16 matched healthy controls. We estimated intrinsic functional connectivity using self-organized grouping spatial ICA, which clusters component maps in the subject space according to spatial similarity. Patients performed worse than controls in the perceptual closure task. This impaired closure performance of patients was correlated with increased severity of psychotic symptoms. We also found that intrinsic connectivity of the visual processing system was diminished in patients compared to controls. Lower perceptual closure performance was correlated to lower visual cortical intrinsic connectivity overall.

We suggest that schizophrenia is associated with impaired intrinsic connectivity of the visual system, and that it is a potential mechanism leading to impaired visual object perception. These findings contribute to increasing evidence for impairments of higher visual functions in schizophrenia.

•

We found reduced visual resting-state network connectivity in schizophrenia.

•

Reduced connectivity correlated with impaired perceptual closure performance

•

Schizophrenia is associated with impaired intrinsic connectivity of the visual system.

Involvement of the visual change detection process in facilitating perceptual alternation in the bistable image

A bistable image induces one of two perceptual alternatives. When the bistable visual image is continuously viewed, the percept of the image alternates from one possible percept to the other. Perceptual alternation was previously reported to be induced by an exogenous perturbation in the bistable image, and this perturbation was theoretically interpreted to cause neural noise, prompting a transition between two stable perceptual states. However, little is known experimentally about the visual processing of exogenously driven perceptual alternation. Based on the findings of a previous behavioral study (Urakawa et al. in Perception 45:474-482, 2016), the present study hypothesized that the automatic visual change detection process, which is relevant to the detection of a visual change in a sequence of visual events, has an enhancing effect on the induction of perceptual alternation, similar to neural noise. In order to clarify this issue, we developed a novel experimental paradigm in which visual mismatch negativity (vMMN), an electroencephalographic brain response that reflects visual change detection, was evoked while participants continuously viewed the bistable image. In terms of inter-individual differences in neural and behavioral data, we found that enhancements in the peak amplitude of vMMN1, early vMMN at a latency of approximately 150 ms, correlated with increases in the proportion of perceptual alternation across participants. Our results indicate the involvement of automatic visual change detection in the induction of perceptual alternation, similar to neural noise, thereby providing a deeper insight into the neural mechanisms underlying exogenously driven perceptual alternation in the bistable image.

Applying Transcranial Magnetic Stimulation (TMS) Over the Dorsal Visual Pathway Induces Schizophrenia-like Disruption of Perceptual Closure

Perceptual closure ability is postulated to depend upon rapid transmission of magnocellular information to prefrontal cortex via the dorsal stream. In contrast, illusory contour processing requires only local interactions within primary and ventral stream visual regions, such as lateral occipital complex. Schizophrenia is associated with deficits in perceptual closure versus illusory contours processing that is hypothesized to reflect impaired magnocellular/dorsal stream. Perceptual closure and illusory contours performance was evaluated in separate groups of 12 healthy volunteers during no TMS, and during repetitive 10 Hz rTMS stimulation over dorsal stream or vertex (TMS-vertex). Perceptual closure and illusory contours were performed in 11 schizophrenia patients, no TMS was applied in these patients. TMS effects were evaluated with repeated measures ANOVA across treatments. rTMS significantly increased perceptual closure identification thresholds, with significant difference between TMS-dorsal stream and no TMS. TMS-dorsal stream also significantly reduced perceptual closure but not illusory contours accuracy. Schizophrenia patients showed increased perceptual closure identification thresholds relative to controls in the no TMS condition, but similar to controls in the TMS-dorsal stream condition. Conclusions of this study are that magnocellular/dorsal stream input is critical for perceptual closure but not illusory contours performance, supporting both trickledown theories of normal perceptual closure function, and magnocellular/dorsal stream theories of visual dysfunction in schizophrenia.

Neural Substrates of Auditory Emotion Recognition Deficits in Schizophrenia

Deficits in auditory emotion recognition (AER) are a core feature of schizophrenia and a key component of social cognitive impairment. AER deficits are tied behaviorally to impaired ability to interpret tonal ("prosodic") features of speech that normally convey emotion, such as modulations in base pitch (F0M) and pitch variability (F0SD). These modulations can be recreated using synthetic frequency modulated (FM) tones that mimic the prosodic contours of specific emotional stimuli. The present study investigates neural mechanisms underlying impaired AER using a combined event-related potential/resting-state functional connectivity (rsfMRI) approach in 84 schizophrenia/schizoaffective disorder patients and 66 healthy comparison subjects. Mismatch negativity (MMN) to FM tones was assessed in 43 patients/36 controls. rsfMRI between auditory cortex and medial temporal (insula) regions was assessed in 55 patients/51 controls. The relationship between AER, MMN to FM tones, and rsfMRI was assessed in the subset who performed all assessments (14 patients, 21 controls). As predicted, patients showed robust reductions in MMN across FM stimulus type (p = 0.005), particularly to modulations in F0M, along with impairments in AER and FM tone discrimination. MMN source analysis indicated dipoles in both auditory cortex and anterior insula, whereas rsfMRI analyses showed reduced auditory-insula connectivity. MMN to FM tones and functional connectivity together accounted for ∼50% of the variance in AER performance across individuals. These findings demonstrate that impaired preattentive processing of tonal information and reduced auditory-insula connectivity are critical determinants of social cognitive dysfunction in schizophrenia, and thus represent key targets for future research and clinical intervention.

SIGNIFICANCE STATEMENT

Schizophrenia patients show deficits in the ability to infer emotion based upon tone of voice [auditory emotion recognition (AER)] that drive impairments in social cognition and global functional outcome. This study evaluated neural substrates of impaired AER in schizophrenia using a combined event-related potential/resting-state fMRI approach. Patients showed impaired mismatch negativity response to emotionally relevant frequency modulated tones along with impaired functional connectivity between auditory and medial temporal (anterior insula) cortex. These deficits contributed in parallel to impaired AER and accounted for ∼50% of variance in AER performance. Overall, these findings demonstrate the importance of both auditory-level dysfunction and impaired auditory/insula connectivity in the pathophysiology of social cognitive dysfunction in schizophrenia.

The neural dynamics of somatosensory processing and adaptation across childhood: a high-density electrical mapping study

Young children are often hyperreactive to somatosensory inputs hardly noticed by adults, as exemplified by irritation to seams or labels in clothing. The neurodevelopmental mechanisms underlying changes in sensory reactivity are not well understood. Based on the idea that neurodevelopmental changes in somatosensory processing and/or changes in sensory adaptation might underlie developmental differences in somatosensory reactivity, high-density electroencephalography was used to examine how the nervous system responds and adapts to repeated vibrotactile stimulation over childhood. Participants aged 6-18 yr old were presented with 50-ms vibrotactile stimuli to the right wrist over the median nerve at 5 blocked interstimulus intervals (ranging from ∼7 to ∼1 stimulus per second). Somatosensory evoked potentials (SEPs) revealed three major phases of activation within the first 200 ms, with scalp topographies suggestive of neural generators in contralateral somatosensory cortex. Although overall SEPs were highly similar for younger, middle, and older age groups (6.1-9.8, 10.0-12.9, and 13.0-17.8 yr old), there were significant age-related amplitude differences in initial and later phases of the SEP. In contrast, robust adaptation effects for fast vs. slow presentation rates were observed that did not differ as a function of age. A greater amplitude response in the later portion of the SEP was observed for the youngest group and may be related to developmental changes in responsivity to somatosensory stimuli. These data suggest the protracted development of the somatosensory system over childhood, whereas adaptation, as assayed in this study, is largely in place by ∼7 yr of age.

Top-down modulation of visual processing and knowledge after 250 ms supports object constancy of category decisions

People categorize objects more slowly when visual input is highly impoverished instead of optimal. While bottom-up models may explain a decision with optimal input, perceptual hypothesis testing (PHT) theories implicate top-down processes with impoverished input. Brain mechanisms and the time course of PHT are largely unknown. This event-related potential study used a neuroimaging paradigm that implicated prefrontal cortex in top-down modulation of occipitotemporal cortex. Subjects categorized more impoverished and less impoverished real and pseudo objects. PHT theories predict larger impoverishment effects for real than pseudo objects because top-down processes modulate knowledge only for real objects, but different PHT variants predict different timing. Consistent with parietal-prefrontal PHT variants, around 250 ms, the earliest impoverished real object interaction started on an N3 complex, which reflects interactive cortical activity for object cognition. N3 impoverishment effects localized to both prefrontal and occipitotemporal cortex for real objects only. The N3 also showed knowledge effects by 230 ms that localized to occipitotemporal cortex. Later effects reflected (a) word meaning in temporal cortex during the N400, (b) internal evaluation of prior decision and memory processes and secondary higher-order memory involving anterotemporal parts of a default mode network during posterior positivity (P600), and (c) response related activity in posterior cingulate during an anterior slow wave (SW) after 700 ms. Finally, response activity in supplementary motor area during a posterior SW after 900 ms showed impoverishment effects that correlated with RTs. Convergent evidence from studies of vision, memory, and mental imagery which reflects purely top-down inputs, indicates that the N3 reflects the critical top-down processes of PHT. A hybrid multiple-state interactive, PHT and decision theory best explains the visual constancy of object cognition.

Cortical contributions to impaired contour integration in schizophrenia

OBJECTIVES

Visual perceptual organization impairments in schizophrenia (SCZ) are well established, but their neurobiological bases are not. The current study used the previously validated Jittered Orientation Visual Integration (JOVI) task, along with fMRI, to examine the neural basis of contour integration (CI), and its impairment in SCZ. CI is an aspect of perceptual organization in which multiple distinct oriented elements are grouped into a single continuous boundary or shape.

METHODS

On the JOVI, five levels of orientational jitter were added to non-contiguous closed contour elements embedded in background noise to progressively increase the difficulty in perceiving contour elements as left- or right-pointing ovals. Multi-site fMRI data were analyzed for 56 healthy control subjects and 47 people with SCZ.

RESULTS

SCZ patients demonstrated poorer CI, and this was associated with increased activation in regions involved in global shape processing and visual attention, namely the lateral occipital complex and superior parietal lobules. There were no brain regions where controls demonstrated more activation than patients.

CONCLUSIONS

CI impairment in this sample of outpatients with SCZ was related to excessive activation in regions associated with object processing and allocation of visual-spatial attention. There was no evidence for basic impairments in contour element linking in the fMRI data. The latter may be limited to poor outcome patients, where more extensive structural and functional changes in the occipital lobe have been observed.

Neurophysiological models for new treatment development in schizophrenia: early sensory approaches

Schizophrenia is a major mental disorder associated with core neurocognitive impairments. The ability to recreate these deficits in animal models is limited, hampering ongoing translational drug development efforts. This paper reviews the use of electroencephalography (EEG)-based neurophysiological measures, such as event-related potentials (ERPs) or event-related spectral perturbations (ERSPs), as novel translational biomarkers for both etiological and treatment development research in neuropsychiatry. In schizophrenia, cognitive impairments manifest as deficits not only in high-level processes, such as working memory or executive processing, but also as deficits in neurophysiological responses to simple auditory and visual stimuli. Moreover, neurophysiological responses can be assessed even in untrained animals and are therefore particularly amenable to translational, cross-species investigation. To date, several sensory-level ERP measures, including auditory mismatch negativity and N1, and visual P1 and steady-state responses, have been validated in both human clinical investigations and animal models. Deficits have been tied to impaired neurotransmission at N-methyl-d-aspartate-type glutamate receptors (NMDARs). Time-frequency analysis of ERSP permits further extension of these findings from physiological to circuit/cellular levels of analysis.

Attentional modulations of the early and later stages of the neural processing of visual completion

The brain effortlessly recognizes objects even when the visual information belonging to an object is widely separated, as well demonstrated by the Kanizsa-type illusory contours (ICs), in which a contour is perceived despite the fragments of the contour being separated by gaps. Such large-range visual completion has long been thought to be preattentive, whereas its dependence on top-down influences remains unclear. Here, we report separate modulations by spatial attention and task relevance on the neural activities in response to the ICs. IC-sensitive event-related potentials that were localized to the lateral occipital cortex were modulated by spatial attention at an early processing stage (130–166 ms after stimulus onset) and modulated by task relevance at a later processing stage (234–290 ms). These results not only demonstrate top-down attentional influences on the neural processing of ICs but also elucidate the characteristics of the attentional modulations that occur in different phases of IC processing.

Sensory processing dysfunction in the personal experience and neuronal machinery of schizophrenia

Sensory processing deficits, first investigated by Kraepelin and Bleuler as possible pathophysiological mechanisms in schizophrenia, are now being recharacterized in the context of our current understanding of the molecular and neurobiological brain mechanisms involved. The National Institute of Mental Health Research Domain Criteria position these deficits as intermediaries between molecular and cellular mechanisms and clinical symptoms of schizophrenia, such as hallucinations. The prepulse inhibition of startle responses by a weaker preceding tone, the inhibitory gating of response to paired sensory stimuli characterized using the auditory P50 evoked response, and the detection of slight deviations in patterns of sensory stimulation eliciting the cortical mismatch negativity potential demonstrate deficits in early sensory processing mechanisms, whose molecular and neurobiological bases are increasingly well understood. Deficits in sensory processing underlie more complex cognitive dysfunction and are in turn affected by higher-level cognitive difficulties. These deficits are now being used to identify genes involved in familial transmission of schizophrenia and to monitor potentially therapeutic drug effects for both treatment and prevention. This research also provides a clinical reminder that patients' sensory perception of the surrounding world, even during treatment sessions, may differ considerably from others' perceptions. A person's ability to understand and interact effectively with the surrounding world ultimately depends on an underlying sensory experience of it.

Temporal dynamics of the knowledge-mediated visual disambiguation process in humans: a magnetoencephalography study

Disambiguation of a noisy visual scene with prior knowledge is an indispensable task of the visual system. To adequately adapt to a dynamically changing visual environment full of noisy visual scenes, the implementation of knowledge-mediated disambiguation in the brain is imperative and essential for proceeding as fast as possible under the limited capacity of visual image processing. However, the temporal profile of the disambiguation process has not yet been fully elucidated in the brain. The present study attempted to determine how quickly knowledge-mediated disambiguation began to proceed along visual areas after the onset of a two-tone ambiguous image using magnetoencephalography with high temporal resolution. Using the predictive coding framework, we focused on activity reduction for the two-tone ambiguous image as an index of the implementation of disambiguation. Source analysis revealed that a significant activity reduction was observed in the lateral occipital area at approximately 120 ms after the onset of the ambiguous image, but not in preceding activity (about 115 ms) in the cuneus when participants perceptually disambiguated the ambiguous image with prior knowledge. These results suggested that knowledge-mediated disambiguation may be implemented as early as approximately 120 ms following an ambiguous visual scene, at least in the lateral occipital area, and provided an insight into the temporal profile of the disambiguation process of a noisy visual scene with prior knowledge.

Do deficits in the magnocellular priming underlie visual derealization phenomena? Preliminary neurophysiological and self-report results in first-episode schizophrenia patients

BACKGROUND

Early visual impairments probably partially caused by impaired interactions between magnocellular (M) and parvocellular (P) pathways (M priming deficit), and disturbances of basic self-awareness or self-disorders (SDs) are core features of schizophrenia. The relationships between these features have not yet been studied. We hypothesized that the M priming was impaired in first-episode patients and that this deficit was associated with visual aspects of SDs.

AIM

To investigate early visual processing in a sample of first-episode schizophrenia patients and to explore the relationships between M and P functioning and visual aspects of SDs addressed by the Examination of Anomalous Self-Experience (EASE) interview.

METHOD

Nine stimulating conditions were used to investigate M and P pathways and their interaction in a pattern reversal visually evoked potential (VEP) paradigm. N80 at mixed M- and P-conditions was used to investigate magnocellular priming. Generators were analyzed using source localization (Brain Electrical Source Analysis software: BESA). VEPs of nineteen first-episode schizophrenia patients were compared to those of twenty matched healthy controls by a bootstrap resample procedure. Visual aspects of SDs were analyzed through a factor analysis to separate symptom clusters of derealization phenomena. Thereafter, the associations between the main factors and the N80 component were explored using linear mixed models.

RESULTS

Factor analyses separated two EASE factors ("distance to the world", and "intrusive world"). The N80 component was represented by a single dipole located in the occipital visual cortex. The bootstrap analysis yielded significant amplitude reductions and prolonged latencies in first-episode patients relative to controls in response to mixed M-P conditions, and normal amplitudes and latencies in response to isolated P- and M-biased stimulation. Exploratory analyses showed significant negative correlations between the N80 amplitude values at mixed M-P conditions and the EASE factor "distance to the world", i.e. relatively higher amplitudes in the patient group were associated with higher subjective perceived derealization ("distance to the world").

CONCLUSIONS

The early VEP component N80 evoked by mixed M-P conditions is assumed to be a correlate of M priming, and showed reduced amplitudes and longer latencies in first-episode patients. It probably reflects a hypoactivation of the M-pathway. The negative association between visual SDs (derealization phenomena characterized by visual experiences of being more distant to the world), and the M priming deficit was counterintuitive. It might indicate a dysregulated activity of the M-pathway in patients with SDs. Further research is needed to better understand this preliminary finding.

Early recurrent feedback facilitates visual object recognition under challenging conditions

Standard models of the visual object recognition pathway hold that a largely feedforward process from the retina through inferotemporal cortex leads to object identification. A subsequent feedback process originating in frontoparietal areas through reciprocal connections to striate cortex provides attentional support to salient or behaviorally-relevant features. Here, we review mounting evidence that feedback signals also originate within extrastriate regions and begin during the initial feedforward process. This feedback process is temporally dissociable from attention and provides important functions such as grouping, associational reinforcement, and filling-in of features. Local feedback signals operating concurrently with feedforward processing are important for object identification in noisy real-world situations, particularly when objects are partially occluded, unclear, or otherwise ambiguous. Altogether, the dissociation of early and late feedback processes presented here expands on current models of object identification, and suggests a dual role for descending feedback projections.

Source-reconstruction of event-related fields reveals hyperfunction and hypofunction of cortical circuits in antipsychotic-naive, first-episode schizophrenia patients during Mooney face processing

Schizophrenia is characterized by dysfunctions in neural circuits that can be investigated with electrophysiological methods, such as EEG and MEG. In the present human study, we examined event-related fields (ERFs), in a sample of medication-naive, first-episode schizophrenia (FE-ScZ) patients (n = 14) and healthy control participants (n = 17) during perception of Mooney faces to investigate the integrity of neuromagnetic responses and their experience-dependent modification. ERF responses were analyzed for M100, M170, and M250 components at the sensor and source levels. In addition, we analyzed peak latency and adaptation effects due to stimulus repetition. FE-ScZ patients were characterized by significantly impaired sensory processing, as indicated by a reduced discrimination index (A'). At the sensor level, M100 and M170 responses in FE-ScZ were within the normal range, whereas the M250 response was impaired. However, source localization revealed widespread elevated activity for M100 and M170 in FE-ScZ and delayed peak latencies for the M100 and M250 responses. In addition, M170 source activity in FE-ScZ was not modulated by stimulus repetitions. The present findings suggest that neural circuits in FE-ScZ may be characterized by a disturbed balance between excitation and inhibition that could lead to a failure to gate information flow and abnormal spreading of activity, which is compatible with dysfunctional glutamatergic neurotransmission.

Beta, but not gamma, band oscillations index visual form-motion integration

Electrophysiological oscillations in different frequency bands co-occur with perceptual, motor and cognitive processes but their function and respective contributions to these processes need further investigations. Here, we recorded MEG signals and seek for percept related modulations of alpha, beta and gamma band activity during a perceptual form/motion integration task. Participants reported their bound or unbound perception of ambiguously moving displays that could either be seen as a whole square-like shape moving along a Lissajou's figure (bound percept) or as pairs of bars oscillating independently along cardinal axes (unbound percept). We found that beta (15–25 Hz), but not gamma (55–85 Hz) oscillations, index perceptual states at the individual and group level. The gamma band activity found in the occipital lobe, although significantly higher during visual stimulation than during base line, is similar in all perceptual states. Similarly, decreased alpha activity during visual stimulation is not different for the different percepts. Trial-by-trial classification of perceptual reports based on beta band oscillations was significant in most observers, further supporting the view that modulation of beta power reliably index perceptual integration of form/motion stimuli, even at the individual level.

Self-enhancement influences medial frontal cortex alpha power to social rejection feedback

Although previous research has demonstrated that individuals are motivated to self-enhance, the neurocognitive mechanisms and temporal dynamics of self-enhancement are poorly understood. The current research examined whether self-enhancing motivations affect the perceptual processing of social feedback. Participants who varied in self-enhancement motivations received accept and reject feedback while EEG was recorded. Following this task, we measured perceptions of feedback by asking participants to estimate the number of times they were rejected. Source localization and time-frequency analyses revealed that alpha power in the medial frontal cortex (MFC) completely mediated the relationship between self-enhancement motivations and rejection estimates. Specifically, greater self-enhancement motivations predicted decreased MFC alpha power to reject compared to accept feedback, which predicted decreased rejection estimates. These findings suggest that self-enhancement motivations decrease perception of social rejection by influencing how the MFC processes social feedback.

The effort to close the gap: tracking the development of illusory contour processing from childhood to adulthood with high-density electrical mapping

The adult human visual system can efficiently fill-in missing object boundaries when low-level information from the retina is incomplete, but little is known about how these processes develop across childhood. A decade of visual-evoked potential (VEP) studies has produced a theoretical model identifying distinct phases of contour completion in adults. The first, termed a perceptual phase, occurs from approximately 100-200 ms and is associated with automatic boundary completion. The second is termed a conceptual phase occurring between 230 and 400 ms. The latter has been associated with the analysis of ambiguous objects which seem to require more effort to complete. The electrophysiological markers of these phases have both been localized to the lateral occipital complex, a cluster of ventral visual stream brain regions associated with object-processing. We presented Kanizsa-type illusory contour stimuli, often used for exploring contour completion processes, to neurotypical persons ages 6-31 (N=63), while parametrically varying the spatial extent of these induced contours, in order to better understand how filling-in processes develop across childhood and adolescence. Our results suggest that, while adults complete contour boundaries in a single discrete period during the automatic perceptual phase, children display an immature response pattern-engaging in more protracted processing across both timeframes and appearing to recruit more widely distributed regions which resemble those evoked during adult processing of higher-order ambiguous figures. However, children older than 5years of age were remarkably like adults in that the effects of contour processing were invariant to manipulation of contour extent.

Object recognition deficit in early- and adult-onset schizophrenia regardless of age at disease onset

Perceptual closure is the ability of the brain to recognize a complete object based on fragmentary information and has been known to be impaired in schizophrenia. Here, the neural integrity of perceptual closure in schizophrenia with different disease onsets was evaluated by examining the generation of event-related potential (ERP) components (P₁₀₀, N₁₈₀, and N(cl)). ERPs were recorded from 40 patients (19 early-onset schizophrenia, "EOS" and 21 adult-onset schizophrenia, "AOS") and 40 age-matched healthy volunteers. Brain electric source analysis (BESA) was applied to localize the cerebral generators underlying perceptual closure. Patients showed an impaired generation of N(cl) and P₁₀₀ components. P₁₀₀ and N(cl) amplitudes were significantly reduced in both AOS and EOS (P<0.01). Moreover, N180 and N(cl) amplitudes were significantly increased with age in controls and patients (P<0.01). In the case of the N(cl), there was also a significant interaction (P<0.001) between age and group, indicating a greater age-dependent N(cl) increase in controls compared to patients. Visual information processing during perceptual closure is impaired in schizophrenia, regardless of age at disease onset. The combined influence of age and group on the amplitude of the N(cl) might support the idea of neurodevelopmental deficits in schizophrenia.

Neural substrates of perceptual integration during bistable object perception

The way we perceive an object depends both on feedforward, bottom-up processing of its physical stimulus properties and on top-down factors such as attention, context, expectation, and task relevance. Here we compared neural activity elicited by varying perceptions of the same physical image--a bistable moving image in which perception spontaneously alternates between dissociated fragments and a single, unified object. A time-frequency analysis of EEG changes associated with the perceptual switch from object to fragment and vice versa revealed a greater decrease in alpha (8-12 Hz) accompanying the switch to object percept than to fragment percept. Recordings of event-related potentials elicited by irrelevant probes superimposed on the moving image revealed an enhanced positivity between 184 and 212 ms when the probes were contained within the boundaries of the perceived unitary object. The topography of the positivity (P2) in this latency range elicited by probes during object perception was distinct from the topography elicited by probes during fragment perception, suggesting that the neural processing of probes differed as a function of perceptual state. Two source localization algorithms estimated the neural generator of this object-related difference to lie in the lateral occipital cortex, a region long associated with object perception. These data suggest that perceived objects attract attention, incorporate visual elements occurring within their boundaries into unified object representations, and enhance the visual processing of elements occurring within their boundaries. Importantly, the perceived object in this case emerged as a function of the fluctuating perceptual state of the viewer.

Dynamic gamma frequency feedback coupling between higher and lower order visual cortices underlies perceptual completion in humans

To perceive a coherent environment, incomplete or overlapping visual forms must be integrated into meaningful coherent percepts, a process referred to as "Gestalt" formation or perceptual completion. Increasing evidence suggests that this process engages oscillatory neuronal activity in a distributed neuronal assembly. A separate line of evidence suggests that Gestalt formation requires top-down feedback from higher order brain regions to early visual cortex. Here we combine magnetoencephalography (MEG) and effective connectivity analysis in the frequency domain to specifically address the effective coupling between sources of oscillatory brain activity during Gestalt formation. We demonstrate that perceptual completion of two-tone "Mooney" faces induces increased gamma frequency band power (55-71Hz) in human early visual, fusiform and parietal cortices. Within this distributed neuronal assembly fusiform and parietal gamma oscillators are coupled by forward and backward connectivity during Mooney face perception, indicating reciprocal influences of gamma activity between these higher order visual brain regions. Critically, gamma band oscillations in early visual cortex are modulated by top-down feedback connectivity from both fusiform and parietal cortices. Thus, we provide a mechanistic account of Gestalt perception in which gamma oscillations in feature sensitive and spatial attention-relevant brain regions reciprocally drive one another and convey global stimulus aspects to local processing units at low levels of the sensory hierarchy by top-down feedback. Our data therefore support the notion of inverse hierarchical processing within the visual system underlying awareness of coherent percepts.

An event-related potential examination of contour integration deficits in schizophrenia

Perceptual organization, which refers to the ability to integrate fragments of stimuli to form a representation of a whole edge, part, or object, is impaired in schizophrenia. A contour integration paradigm, involving detection of a set of Gabor patches forming an oval contour pointing to the right or left embedded in a field of randomly oriented Gabors, has been developed for use in clinical trials of schizophrenia. The purpose of the present study was to assess contributions of early and later stages of processing to deficits in contour integration, as well as to develop an event-related potential (ERP) analog of this task. Twenty-one patients with schizophrenia and 28 controls participated. The Gabor elements forming the contours were given a low or high degree of orientational jitter, making it either easy or difficult to identify the direction in which the contour was pointing. ERP results showed greater negative peaks at ~165 (N1 component) and ~270 ms for the low-jitter versus the high-jitter contours, with a much greater difference between jitter conditions at 270 ms. This later ERP component was previously termed N_cl for closure negativity. Source localization identified the N_cl in the lateral occipital object recognition area. Patients showed a significant decrease in the N_cl, but not N1, compared to controls, and this was associated with impaired behavioral ability to identify contours. In addition, an earlier negative peak was found at ~120 ms (termed N120) that differentiated jitter conditions, had a dorsal stream source, and differed between patients and controls. Patients also showed a deficit in the dorsal stream sensory P1 component. These results are in accord with impairments in distributed circuitry contributing to perceptual organization deficits and provide an ERP analog to the behavioral contour integration task.

Induced gamma-band response to fragmented images: An intracranial EEG study

Induced gamma-band response (iGBR) has been linked to coherent perception of images and is thought to represent the synchronisation of neuronal populations mediating binding of elements composing the image and the comparisons with memory for proper recognition. This study uses fragmented images with intracranial electroencephalography to investigate the precise spatio-temporal dynamic of iGBR elicited by the recognition of objects presented for the first time and 24h later. Results show an increased iGBR at recognition in regions involved in bottom-up processes such as the cuneus and the lateral occipital complex. Top-down facilitation involved the lingual gyrus, the precuneus and the superior parietal lobule when images were presented for the first time. Twenty-four hours later, top-down facilitation was mediated by frontal areas involved in retrieval from episodic memory. This study showed that the classically reported iGBR is related to object recognition and that top-down processes vary according to task demand.

Disambiguating the roles of area V1 and the lateral occipital complex (LOC) in contour integration

Contour integration, the linking of collinear but disconnected visual elements across space, is an essential facet of object and scene perception. Here, we set out to arbitrate between two previously advanced mechanisms of contour integration: serial facilitative interactions between collinear cells in the primary visual cortex (V1) versus pooling of inputs in higher-order visual areas. To this end, we used high-density electrophysiological recordings to assess the spatio-temporal dynamics of brain activity in response to Gabor contours embedded in Gabor noise (so-called "pathfinder displays") versus control stimuli. Special care was taken to elicit and detect early activity stemming from the primary visual cortex, as indexed by the C1 component of the visual evoked potential. Arguing against a purely early V1 account, there was no evidence for contour-related modulations within the C1 timeframe (50-100 ms). Rather, the earliest effects were observed within the timeframe of the N1 component (160-200 ms) and inverse source analysis pointed to principle generators in the lateral occipital complex (LOC) within the ventral visual stream. Source anlaysis also suggested that it was only during this relatively late processing period that contextual effects emerged in hierarchically early visual regions (i.e. V1/V2), consistent with a more distributed process involving recurrent feedback/feedforward interactions between LOC and early visual sensory regions. The distribution of effects uncovered here is consistent with pooling of information in higher order cortical areas as the initial step in contour integration, and that this pooling occurs relatively late in processing rather than during the initial sensory-processing period.