Tracking the completion of parts into whole objects: Retinotopic activation in response to illusory figures in the lateral occipital complex

ERPs and alpha oscillations track the encoding and maintenance of object-based representations in visual working memory

When memorizing an integrated object such as a Kanizsa figure, the completion of parts into a coherent whole is attained by grouping processes which render a whole-object representation in visual working memory (VWM). The present study measured event-related potentials (ERPs) and oscillatory amplitudes to track these processes of encoding and representing multiple features of an object in VWM. To this end, a change detection task was performed, which required observers to memorize both the orientations and colors of six "pacman" items while inducing configurations of the pacmen that systematically varied in terms of their grouping strength. The results revealed an effect of object configuration in VWM despite physically constant visual input: change detection for both orientation and color features was more accurate with increased grouping strength. At the electrophysiological level, the lateralized ERPs and alpha activity mirrored this behavioral pattern. Perception of the orientation features gave rise to the encoding of a grouped object as reflected by the amplitudes of the Ppc. The grouped object structure, in turn, modulated attention to both orientation and color features as indicated by the enhanced N1pc and N2pc. Finally, during item retention, the representation of individual objects and the concurrent allocation of attention to these memorized objects were modulated by grouping, as reflected by variations in the CDA amplitude and a concurrent lateralized alpha suppression, respectively. These results indicate that memorizing multiple features of grouped, to-be-integrated objects involves multiple, sequential stages of processing, providing support for a hierarchical model of object representations in VWM.

Dorsal attention network activity during perceptual organization is distinct in schizophrenia and predictive of cognitive disorganization

Visual shape completion is a canonical perceptual organization process that integrates spatially distributed edge information into unified representations of objects. People with schizophrenia show difficulty in discriminating completed shapes, but the brain networks and functional connections underlying this perceptual difference remain poorly understood. Also unclear is whether brain network differences in schizophrenia occur in related illnesses or vary with illness features transdiagnostically. To address these topics, we scanned (functional magnetic resonance imaging, fMRI) people with schizophrenia, bipolar disorder, or no psychiatric illness during rest and during a task in which they discriminated configurations that formed or failed to form completed shapes (illusory and fragmented condition, respectively). Multivariate pattern differences were identified on the cortical surface using 360 predefined parcels and 12 functional networks composed of such parcels. Brain activity flow mapping was used to evaluate the likely involvement of resting-state connections for shape completion. Illusory/fragmented task activation differences ('modulations') in the dorsal attention network (DAN) could distinguish people with schizophrenia from the other groups (AUCs > .85) and could transdiagnostically predict cognitive disorganization severity. Activity flow over functional connections from the DAN could predict secondary visual network modulations in each group, except in schizophrenia. The secondary visual network was strongly and similarly modulated in each group. Task modulations were dispersed over more networks in patients compared to controls. In summary, DAN activity during visual perceptual organization is distinct in schizophrenia, symptomatically relevant, and potentially related to improper attention-related feedback into secondary visual areas.

Information Exchange between Cortical Areas: The Visual System as a Model

As nearly all brain functions, perception, motion, and higher-order cognitive functions require coordinated neural information processing within distributed cortical networks. Over the past decades, new theories and techniques emerged that advanced our understanding of how information is transferred between cortical areas. This review surveys critical aspects of interareal information exchange. We begin by examining the brain’s structural connectivity, which provides the basic framework for interareal communication. We then illustrate information exchange between cortical areas using the visual system as an example. Next, well-studied and newly proposed theories that may underlie principles of neural communication are reviewed, highlighting recent work that offers new perspectives on interareal information exchange. We finally discuss open questions in the study of the neural mechanisms underlying interareal information exchange.

Feedback from lateral occipital cortex to V1/V2 triggers object completion: Evidence from functional magnetic resonance imaging and dynamic causal modeling

Illusory figures demonstrate the visual system's ability to integrate disparate parts into coherent wholes. We probed this object integration process by either presenting an integrated diamond shape or a comparable ungrouped configuration that did not render a complete object. Two tasks were used that either required localization of a target dot (relative to the presented configuration) or discrimination of the dot's luminance. The results showed that only when the configuration was task relevant (in the localization task), performance benefited from the presentation of an integrated object. Concurrent functional magnetic resonance imaging was performed and analyzed using dynamic causal modeling to investigate the (causal) relationship between regions that are associated with illusory figure completion. We found object‐specific feedback connections between the lateral occipital cortex (LOC) and early visual cortex (V1/V2). These modulatory connections persisted across task demands and hemispheres. Our results thus provide direct evidence that interactions between mid‐level and early visual processing regions engage in illusory figure perception. These data suggest that LOC first integrates inputs from multiple neurons in lower‐level cortices, generating a global shape representation while more fine‐graded object details are then determined via feedback to early visual areas, independently of the current task demands.

Object-based grouping benefits without integrated feature representations in visual working memory

Visual working memory (VWM) is typically considered to represent complete objects—that is, separate parts of an object are maintained as bound objects. Yet it remains unclear whether and how the features of disparate parts are integrated into a whole-object memory representation. Using a change detection paradigm, the present study investigated whether VWM performance varies as a function of grouping strength for features that either determine the grouped object (orientation) or that are not directly grouping relevant (color). Our results showed a large grouping benefit for grouping-relevant orientation features and, additionally, a much smaller, albeit reliable, benefit for grouping-irrelevant color features when both were potentially task relevant. By contrast, when color was the only task-relevant feature, no grouping benefit from the orientation feature was revealed both under lower or relatively high demands for precision. Together, these results indicate that different features of an object are stored independently in VWM; and an emerging, higher-order grouping structure does not automatically lead to an integrated representation of all available features of an object. Instead, an object benefit depends on the specific task demands, which may generate a linked, task-dependent representation of independent features.