What does visual agnosia tell us about perceptual organization and its relationship to object perception?

Holistic processing and face expertise after pediatric resection of occipitotemporal cortex

The nature and extent of hemispheric lateralization and its potential for reorganization continues to be debated, although there is general agreement that there is a right hemisphere (RH) advantage for face processing in human adults. Here, we examined face processing and its lateralization in individuals with a single preserved occipitotemporal cortex (OTC), either in the RH or left hemisphere (LH), following early childhood resection for the management of drug-resistant epilepsy. The matched controls and those with a lesion outside of OTC evinced the standard superiority in processing upright over inverted faces and the reverse sensitivity to a nonface category (bicycles). In contrast, the LH and the RH patient groups were significantly less accurate than the controls and showed mild orientation sensitivities at best (and not always in the predicted directions). For the two patient groups, the accuracies of face and bicycle processing did not differ from each other and were not obviously related to performance on intermediate level global form tasks with, again, poorer thresholds for both patient groups than controls and no difference between the patient groups. These findings shed light on the complexity of hemispheric lateralization and face and nonface object processing in individuals following surgical resection of OTC. Overall, this study highlights the unique dynamics and potential for plasticity in those with childhood cortical resection.

Standardised images of novel objects created with generative adversarial networks

An enduring question in cognitive science is how perceptually novel objects are processed. Addressing this issue has been limited by the absence of a standardised set of object-like stimuli that appear realistic, but cannot possibly have been previously encountered. To this end, we created a dataset, at the core of which are images of 400 perceptually novel objects. These stimuli were created using Generative Adversarial Networks that integrated features of everyday stimuli to produce a set of synthetic objects that appear entirely plausible, yet do not in fact exist. We curated an accompanying dataset of 400 familiar stimuli, which were matched in terms of size, contrast, luminance, and colourfulness. For each object, we quantified their key visual properties (edge density, entropy, symmetry, complexity, and spectral signatures). We also confirmed that adult observers (N = 390) perceive the novel objects to be less familiar, yet similarly engaging, relative to the familiar objects. This dataset serves as an open resource to facilitate future studies on visual perception.

Perceptual organization and visual awareness: the case of amodal completion

We investigated the involvement of visual awareness in amodal completion, and specifically, whether visual awareness plays a differential role in local versus global completion, using a primed shape discrimination paradigm and the color-opponent flicker technique to render the prime invisible. In four experiments, participants discriminated the shape of a target preceded by a partly occluded or a neutral prime. All primes were divergent occlusion patterns in which the local completion is based on good continuation of the contours at the point of occlusion and the global completion is based on maximum symmetry. The target corresponded to the shape that could arise as a result of local or global completion of the occluded prime. For each experiment with an invisible prime we conducted a version with a visible prime. Our results suggest that local completion, but not global completion, of a partly occluded shape can take place in the absence of visual awareness, but apparently only when the visible occluded shape generates a single, local completion. No completion, either local or global, appears to take place in the absence of visual awareness when the visible occluded shape generates multiple completions. The implications of these results to the differential role of visual awareness in local and global completions and to the relationship between multiple completions and unconscious amodal completions are discussed.

From cognitive maps to spatial schemas

A schema refers to a structured body of prior knowledge that captures common patterns across related experiences. Schemas have been studied separately in the realms of episodic memory and spatial navigation across different species and have been grounded in theories of memory consolidation, but there has been little attempt to integrate our understanding across domains, particularly in humans. We propose that experiences during navigation with many similarly structured environments give rise to the formation of spatial schemas (for example, the expected layout of modern cities) that share properties with but are distinct from cognitive maps (for example, the memory of a modern city) and event schemas (such as expected events in a modern city) at both cognitive and neural levels. We describe earlier theoretical frameworks and empirical findings relevant to spatial schemas, along with more targeted investigations of spatial schemas in human and non-human animals. Consideration of architecture and urban analytics, including the influence of scale and regionalization, on different properties of spatial schemas may provide a powerful approach to advance our understanding of spatial schemas.

Does the brain's ventral visual pathway compute object shape?

A rich behavioral literature has shown that human object recognition is supported by a representation of shape that is tolerant to variations in an object's appearance. Such 'global' shape representations are achieved by describing objects via the spatial arrangement of their local features, or structure, rather than by the appearance of the features themselves. However, accumulating evidence suggests that the ventral visual pathway - the primary substrate underlying object recognition - may not represent global shape. Instead, ventral representations may be better described as a basis set of local image features. We suggest that this evidence forces a reevaluation of the role of the ventral pathway in object perception and posits a broader network for shape perception that encompasses contributions from the dorsal pathway.

From Action to Cognition: Neural Reuse, Network Theory and the Emergence of Higher Cognitive Functions

The aim of this article is to discuss the logic and assumptions behind the concept of neural reuse, to explore its biological advantages and to discuss the implications for the cognition of a brain that reuses existing circuits and resources. We first address the requirements that must be fulfilled for neural reuse to be a biologically plausible mechanism. Neural reuse theories generally take a developmental approach and model the brain as a dynamic system composed of highly flexible neural networks. They often argue against domain-specificity and for a distributed, embodied representation of knowledge, which sets them apart from modular theories of mental processes. We provide an example of reuse by proposing how a phylogenetically more modern mental capacity (mental rotation) may appear through the reuse and recombination of existing resources from an older capacity (motor planning). We conclude by putting arguments into context regarding functional modularity, embodied representation, and the current ontology of mental processes.

Patterns of perceptual performance in developmental prosopagnosia: An in-depth case series

Developmental prosopagnosia (DP) is a syndrome characterized by lifelong impairment in face recognition in the absence of brain damage. A key question regarding DP concerns which process(es) might be affected to selectively/disproportionally impair face recognition. We present evidence from a group of DPs, combining an overview of previous results with additional analyses important for understanding their pattern of preserved and impaired perceptual abilities. We argue that for most of these individuals, the common denominator is a deficit in (rapid) processing of global shape information. We conclude that the deficit in this group of DPs is not face-selective, but that it may appear so because faces are more visually similar-and recognized at a more fine-grained level-than objects. Indeed, when the demand on perceptual differentiation and visual similarity are held constant for faces and objects, we find no evidence for a disproportionate deficit for faces in this group of DPs.

Object recognition and visual object agnosia

The term visual agnosia is used to refer to recognition disorders that are confined to the visual modality, that are not due to an impairment in sensory functions, and that cannot be explained by other cognitive deficits or by general reduction in intellectual ability. Here, we describe the different types of visual agnosia that have been reported (form agnosia, integrative agnosia, associative agnosia, transformational and orientation agnosia as well as category-specific impairments such as pure alexia and prosopagnosia) and how they relate to the current understanding of visual object recognition. Together with related disorders such as simultanagnosia, texture agnosia, aphantasia, and optic aphasia, these visual perceptual impairments can have severe consequences for those affected. We suggest how in-depth assessment can be carried out to determine the type and the extent of these impairments. In the context of clinical assessment, a step-by-step approach reflecting a posterior to anterior gradient in visual object recognition, from more perceptual to more memory-related processes, is suggested. Individually tailored interventions targeting the identified impairments can be initiated based on the results of the assessment.

Visual Awareness Is Essential for Grouping Based on Mirror Symmetry

We examined whether symmetry-based grouping can take place in the absence of visual awareness. To this end, we used a priming paradigm, sandwich masking as an invisibility-inducing method, and primes and targets composed of two vertical symmetric or asymmetric lines. The target could be congruent or incongruent with the prime in symmetry. In Experiment 1, participants were presented with masked primes and clearly visible targets. In each trial, the participants performed a two-alternative discrimination task on the target, and then rated the visibility of the prime on a subjective visibility four-point scale (used to assess prime awareness). Subjectively invisible primes failed to produce response priming, suggesting that symmetry processing might depend on visual awareness. However, participants barely saw the prime, and the results for the visible primes were inconclusive, even when we used a conservative criterion for awareness. To rule out the possibility that our prime stimuli could not produce priming per se, we conducted a control visibility experiment (Experiment 2), in which participants were presented with unmasked, clearly visible primes and performed a target task. The results showed that our primes could elicit significant response priming when visible. Taken together, our findings indicate that symmetry-based grouping requires visual awareness.

Global precedence effects account for individual differences in both face and object recognition performance

There has been an increase in studies adopting an individual difference approach to examine visual cognition and in particular in studies trying to relate face recognition performance with measures of holistic processing (the face composite effect and the part-whole effect). In the present study we examine whether global precedence effects, measured by means of non-face stimuli in Navon's paradigm, can also account for individual differences in face recognition and, if so, whether the effect is of similar magnitude for faces and objects. We find evidence that global precedence effects facilitate both face and object recognition, and to a similar extent. Our results suggest that both face and object recognition are characterized by a coarse-to-fine temporal dynamic, where global shape information is derived prior to local shape information, and that the efficiency of face and object recognition is related to the magnitude of the global precedence effect.

Perceptual organization of line configurations: Is visual awareness necessary?

We examined whether configuring, which determines the appearance of grouped elements as a global shape, requires visual awareness, using a priming paradigm and two invisibility-inducing methods, CFS and sandwich masking. The primes were organized into configurations based on closure, collinearity, and symmetry (collinear primes), or on closure and symmetry (noncollinear primes). The prime-target congruency could be in configuration or in elements. During CFS, no significant response-priming was observed for invisible primes. When masking induced invisibility, a significant configuration response-priming was found for collinear and noncollinear primes, visible and invisible, with larger magnitude for the former. An element response-priming of equal magnitude was evident for visible and invisible noncollinear primes. Our results suggest that configuring can be accomplished in the absence of visual awareness when stimuli are rendered invisible by sandwich masking, but it benefits from visual awareness. Our results also suggest sensitivity to the available grouping cues in unconscious processing.

Attention enhances apparent perceptual organization

Perceptual organization and selective attention are two crucial processes that influence how we perceive visual information. The former structures complex visual inputs into coherent units, whereas the later selects relevant information. Attention and perceptual organization can modulate each other, affecting visual processing and performance in various tasks and conditions. Here, we tested whether attention can alter the way multiple elements appear to be perceptually organized. We manipulated covert spatial attention using a rapid serial visual presentation task, and measured perceptual organization of two multielements arrays organized by luminance similarity as rows or columns, at both the attended and unattended locations. We found that the apparent perceptual organization of the multielement arrays is intensified when attended and attenuated when unattended. We ruled out response bias as an alternative explanation. These findings reveal that attention enhances the appearance of perceptual organization, a midlevel vision process, altering the way we perceive our visual environment.

Differentiation of Types of Visual Agnosia Using EEG

Visual recognition deficits are the hallmark symptom of visual agnosia, a neuropsychological disorder typically associated with damage to the visual system. Most research into visual agnosia focuses on characterizing the deficits through detailed behavioral testing, and structural and functional brain scans are used to determine the spatial extent of any cortical damage. Although the hierarchical nature of the visual system leads to clear predictions about the temporal dynamics of cortical deficits, there has been little research on the use of neuroimaging methods with high temporal resolution to characterize the temporal profile of agnosia deficits. Here, we employed high-density electroencephalography (EEG) to investigate alterations in the temporal dynamics of the visual system in two individuals with visual agnosia. In the context of a steady state visual evoked potential paradigm (SSVEP), individuals viewed pattern-reversing checkerboards of differing spatial frequency, and we assessed the responses of the visual system in the frequency and temporal domain. JW, a patient with early visual cortex damage, showed impaired SSVEP response relative to a control group and to the second patient (SM) who had right temporal lobe damage. JW also showed lower decoding accuracy for early visual responses (around 100 ms). SM, whose lesion is more anterior in the visual system, showed good decoding accuracy initially but low decoding after 500 ms. Overall, EEG and multivariate decoding methods can yield important insights into the temporal dynamics of visual responses in individuals with visual agnosia.

Sex Differences in Categorical Adaptation for Faces and Chinese Characters during Early Perceptual Processing

Previous event-related potential studies support sex differences in the N170 response during face and word processing; however, it remains unclear whether N170 categorical adaptation for faces and words is different between women and men. Using an adaptation paradigm, in which an adaptor and subsequent test stimulus are presented during each trial, the present study investigated N170 categorical adaptation for faces and Chinese characters in both women and men. The results demonstrated that the N170 amplitude elicited by test stimuli in within-category condition was lower than in control category condition, and this was observed during both face and Chinese character processing in women and men. In addition, we found that men have greater N170 categorical adaptation for face and word processing than women. There was also a significant correlation between N170 categorical adaptation indices for face and Chinese character processing in men, which did not occur in women. These findings suggest that men and women process repeated faces or words differently.

Navon's classical paradigm concerning local and global processing relates systematically to visual object classification performance

Forty years ago David Navon tried to tackle a central problem in psychology concerning the time course of perceptual processing: Do we first see the details (local level) followed by the overall outlay (global level) or is it rather the other way around? He did this by developing a now classical paradigm involving the presentation of compound stimuli; large letters composed of smaller letters. Despite the usefulness of this paradigm it remains uncertain whether effects found with compound stimuli relate directly to visual object recognition. It does so because compound stimuli are not actual objects but rather formations of elements and because the elements that form the global shape of compound stimuli are not features of the global shape but rather objects in their own right. To examine the relationship between performance on Navon’s paradigm and visual object processing we derived two indexes from Navon’s paradigm that reflect different aspects of the relationship between global and local processing. We find that individual differences on these indexes can explain a considerable amount of variance in two standard object classification paradigms; object decision and superordinate categorization, suggesting that Navon’s paradigm does relate to visual object processing.

Three-Dimensional Representations of Objects in Dorsal Cortex are Dissociable from Those in Ventral Cortex

An established conceptualization of visual cortical function is one in which ventral regions mediate object perception while dorsal regions support spatial information processing and visually guided action. This division has been contested by evidence showing that dorsal regions are also engaged in the representation of object shape, even when actions are not required. The critical question is whether these dorsal, object-based representations are dissociable from ventral representations, and whether they play a functional role in object recognition. We examined the neural and behavioral profile of patients with impairments in object recognition following ventral cortex damage. In a functional magnetic resonanace imaging experiment, the blood oxygen level-dependent response in the ventral, but not dorsal, cortex of the patients evinced less sensitivity to object 3D structure compared with that of healthy controls. Consistently, in psychophysics experiments, the patients exhibited significant impairments in object perception, but still revealed residual sensitivity to object-based structural information. Together, these findings suggest that, although in the intact system there is considerable crosstalk between dorsal and ventral cortices, object representations in dorsal cortex can be computed independently from those in ventral cortex. While dorsal representations alone are unable to support normal object perception, they can, nevertheless, support a coarse description of object structural information.

Effects of stereoscopic disparity on early ERP components during classification of three-dimensional objects

This study investigates the effects of stereo disparity on the perception of three-dimensional (3D) object shape. We tested the hypothesis that stereo input modulates the brain activity related to perceptual analyses of 3D shape configuration during image classification. High-density (256-channel) electroencephalogram (EEG) was used to record the temporal dynamics of visual shape processing under conditions of two-dimensional (2D) and 3D visual presentation. On each trial, observers made image classification judgements ('Same'/'Different') to two briefly presented, multi-part, novel objects. On different-object trials, stimuli could either share volumetric parts but not the global 3D shape configuration and have different parts but the same global 3D shape configuration or differ on both aspects. Analyses using mass univariate contrasts showed that the earliest sensitivity to 2D versus 3D viewing appeared as a negative deflection over posterior locations on the N1 component between 160 and 220 ms post-stimulus onset. Subsequently, event-related potential (ERP) modulations during the N2 time window between 240 and 370 ms were linked to image classification. N2 activity reflected two distinct components - an early N2 (240-290 ms) and a late N2 (290-370 ms) - that showed different patterns of responses to 2D and 3D input and differential sensitivity to 3D object structure. The results revealed that stereo input modulates the neural correlates of 3D object shape. We suggest that this reflects differential perceptual processing of object shape under conditions of stereo or mono input. These findings challenge current theories that attribute no functional role for stereo input during 3D shape perception.

Perceptual integration rapidly activates dorsal visual pathway to guide local processing in early visual areas

Rapidly grouping local elements into an organized object (i.e., perceptual integration) is a fundamental yet challenging task, especially in noisy contexts. Previous studies demonstrate that ventral visual pathway, which is widely known to mediate object recognition, engages in the process by conveying object-level information processed in high-level areas to modulate low-level sensory areas. Meanwhile, recent evidence suggests that the dorsal visual pathway, which is not typically attributable to object recognition, is also involved in the process. However, the underlying whole-brain fine spatiotemporal neuronal dynamics remains unknown. Here we used magnetoencephalography (MEG) recordings in combination with a temporal response function (TRF) approach to dissociate the time-resolved neuronal response that specifically tracks the perceptual grouping course. We demonstrate that perceptual integration initiates robust and rapid responses along the dorsal visual pathway in a reversed hierarchical manner, faster than the ventral pathway. Specifically, the anterior intraparietal sulcus (IPS) responds first (i.e., within 100 ms), followed by activities backpropagating along the dorsal pathway to early visual areas (EVAs). The IPS activity causally modulates the EVA response, even when the global form information is task-irrelevant. The IPS-to-EVA response profile fails to appear when the global form could not be perceived. Our results support the crucial function of the dorsal visual pathway in perceptual integration, by quickly extracting a coarse global template (i.e., an initial object representation) within first 100 ms to guide subsequent local sensory processing so that the ambiguities in the visual inputs can be efficiently resolved.

How the brain integrates local elements into a global object (i.e., perceptual integration) in noisy contexts constitutes a fundamental yet challenging question in cognitive neuroscience. Here, we recorded brain activity by using magnetoencephalography from human subjects watching glass-pattern stimuli to examine the fine spatiotemporal neuronal responses during perceptual integration. We demonstrate that high-level brain regions initially extract a coarse global form of the inputs, which is then relayed along the dorsal visual pathway in a reversed hierarchical manner to low-level areas to modulate local analysis. This global-to-local modulation mechanism is especially beneficial in noisy environments by rapidly making an “initial guess” to guide detail analysis so that the ambiguities in inputs can be efficiently resolved.

Face and Word Recognition Can Be Selectively Affected by Brain Injury or Developmental Disorders

Face and word recognition have traditionally been thought to rely on highly specialised and relatively independent cognitive processes. Some of the strongest evidence for this has come from patients with seemingly category-specific visual perceptual deficits such as pure prosopagnosia, a selective face recognition deficit, and pure alexia, a selective word recognition deficit. Together, the patterns of impaired reading with preserved face recognition and impaired face recognition with preserved reading constitute a double dissociation. The existence of these selective deficits has been questioned over the past decade. It has been suggested that studies describing patients with these pure deficits have failed to measure the supposedly preserved functions using sensitive enough measures, and that if tested using sensitive measurements, all patients with deficits in one visual category would also have deficits in the other. The implications of this would be immense, with most textbooks in cognitive neuropsychology requiring drastic revisions. In order to evaluate the evidence for dissociations, we review studies that specifically investigate whether face or word recognition can be selectively affected by acquired brain injury or developmental disorders. We only include studies published since 2004, as comprehensive reviews of earlier studies are available. Most of the studies assess the supposedly preserved functions using sensitive measurements. We found convincing evidence that reading can be preserved in acquired and developmental prosopagnosia and also evidence (though weaker) that face recognition can be preserved in acquired or developmental dyslexia, suggesting that face and word recognition are at least in part supported by independent processes.

Word and text processing in developmental prosopagnosia

The "many-to-many" hypothesis proposes that visual object processing is supported by distributed circuits that overlap for different object categories. For faces and words the hypothesis posits that both posterior fusiform regions contribute to both face and visual word perception and predicts that unilateral lesions impairing one will affect the other. However, studies testing this hypothesis have produced mixed results. We evaluated visual word processing in subjects with developmental prosopagnosia, a condition linked to right posterior fusiform abnormalities. Ten developmental prosopagnosic subjects performed a word-length effect task and a task evaluating the recognition of word content across variations in text style, and the recognition of style across variations in word content. All subjects had normal word-length effects. One had prolonged sorting time for word recognition in handwritten stimuli. These results suggest that the deficit in developmental prosopagnosia is unlikely to affect visual word processing, contrary to predictions of the many-to-many hypothesis.

The Enigma of Poor Performance by Adults With Cochlear Implants

OBJECTIVE

Considerable unexplained variability and large individual differences exist in speech recognition outcomes for postlingually deaf adults who use cochlear implants (CIs), and a sizeable fraction of CI users can be considered "poor performers." This article summarizes our current knowledge of poor CI performance, and provides suggestions to clinicians managing these patients.

METHOD

Studies are reviewed pertaining to speech recognition variability in adults with hearing loss. Findings are augmented by recent studies in our laboratories examining outcomes in postlingually deaf adults with CIs.

RESULTS

In addition to conventional clinical predictors of CI performance (e.g., amount of residual hearing, duration of deafness), factors pertaining to both "bottom-up" auditory sensitivity to the spectro-temporal details of speech, and "top-down" linguistic knowledge and neurocognitive functions contribute to CI outcomes.

CONCLUSIONS

The broad array of factors that contribute to speech recognition performance in adult CI users suggests the potential both for novel diagnostic assessment batteries to explain poor performance, and also new rehabilitation strategies for patients who exhibit poor outcomes. Moreover, this broad array of factors determining outcome performance suggests the need to treat individual CI patients using a personalized rehabilitation approach.

Perception of Elliptic Biological Motion

We tested the ability of the mature visual system for discrimination between types of elliptic biological motion on the basis of event kinematics. Healthy adult volunteers were presented with point-light displays depicting elliptic motion when only a single dot, a moving point-light arm, or a whole point-light human figure was visible. The displays were created in accordance with the two-thirds power kinematic law ( natural motion), whereas the control displays violated this principle ( unnatural motion). On each trial, participants judged whether the display represented natural or unnatural motion. The findings indicate that adults are highly sensitive to violation of the two-thirds power kinematic law. Notably, participants can easily discriminate between natural and unnatural motions without recognising the stimuli, which suggests that people implicitly use kinematic information. Most intriguing, event recognition seems to diminish the capacity to judge whether event kinematics is unnatural. We discuss possible ways for a cross-talk between perception and production of biological movement, and the brain mechanisms involved in biological motion processing.

A Neural Basis for Developmental Topographic Disorientation

Developmental topographic disorientation (DTD) is a life-long condition in which affected individuals are severely impaired in navigating around their environment. Individuals with DTD have no apparent structural brain damage on conventional imaging and the neural mechanisms underlying DTD are currently unknown. Using functional and diffusion tensor imaging, we present a comprehensive neuroimaging study of an individual, J.N., with well defined DTD. J.N. has intact scene-selective responses in the parahippocampal place area (PPA), transverse occipital sulcus, and retrosplenial cortex (RSC), key regions associated with scene perception and navigation. However, detailed fMRI studies probing selective tuning properties of these regions, as well as functional connectivity, suggest that J.N.'s RSC has an atypical response profile and an atypical functional coupling to PPA compared with human controls. This deviant functional profile of RSC is not due to compromised structural connectivity. This comprehensive examination suggests that the RSC may play a key role in navigation-related processing and that an alteration of the RSC's functional properties may serve as the neural basis for DTD.

SIGNIFICANCE STATEMENT

Individuals with developmental topographic disorientation (DTD) have a life-long impairment in spatial navigation in the absence of brain damage, neurological conditions, or basic perceptual or memory deficits. Although progress has been made in identifying brain regions that subserve normal navigation, the neural basis of DTD is unknown. Using functional and structural neuroimaging and detailed statistical analyses, we investigated the brain regions typically involved in navigation and scene processing in a representative DTD individual, J.N. Although scene-selective regions were identified, closer scrutiny indicated that these areas, specifically the retrosplenial cortex (RSC), were functionally disrupted in J.N. This comprehensive examination of a representative DTD individual provides insight into the neural basis of DTD and the role of the RSC in navigation-related processing.

Emotional Arousal and Memory Binding: An Object-Based Framework

Binding various features of an event together and maintaining these connections in memory is an essential component of episodic memories. Previous theories make contradictory predictions about the effects of emotional arousal on memory binding. In this article, I review evidence for both arousal-impaired and arousal-enhanced memory binding and explain these contradictory findings using an object-based framework. According to this framework, emotionally arousing objects attract attention that enhances binding of their constituent features. In contrast, the emotional arousal associated with one object either impairs or has no effect on the associations between that object and other distinct objects or background contextual information. After initial encoding, the attention-grabbing nature of emotionally arousing objects can lead to interference in working memory, making it more difficult to maintain other bound representations. These contrasting effects of arousal on memory binding should help predict which aspects of emotional memories are likely to be accurate and which aspects are likely to be misremembered.

Word and text processing in acquired prosopagnosia

OBJECTIVE

A novel hypothesis of object recognition asserts that multiple regions are engaged in processing an object type, and that cerebral regions participate in processing multiple types of objects. In particular, for high-level expert processing, it proposes shared rather than dedicated resources for word and face perception, and predicts that prosopagnosic subjects would have minor deficits in visual word processing, and alexic subjects would have subtle impairments in face perception. In this study, we evaluated whether prosopagnosic subjects had deficits in processing either the word content or the style of visual text.

METHODS

Eleven prosopagnosic subjects, 6 with unilateral right lesions and 5 with bilateral lesions, participated. In the first study, we evaluated their word length effect in reading single words. In the second study, we assessed their time and accuracy for sorting text by word content independent of style, and for sorting text by handwriting or font style independent of word content.

RESULTS

Only subjects with bilateral lesions showed mildly elevated word length effects. Subjects were not slowed in sorting text by word content, but were nearly uniformly impaired in accuracy for sorting text by style.

INTERPRETATION

Our results show that prosopagnosic subjects are impaired not only in face recognition but also in perceiving stylistic aspects of text. This supports a modified version of the many-to-many hypothesis that incorporates hemispheric specialization for processing different aspects of visual text.

Ventral aspect of the visual form pathway is not critical for the perception of biological motion

Identifying the movements of those around us is fundamental for many daily activities, such as recognizing actions, detecting predators, and interacting with others socially. A key question concerns the neurobiological substrates underlying biological motion perception. Although the ventral "form" visual cortex is standardly activated by biologically moving stimuli, whether these activations are functionally critical for biological motion perception or are epiphenomenal remains unknown. To address this question, we examined whether focal damage to regions of the ventral visual cortex, resulting in significant deficits in form perception, adversely affects biological motion perception. Six patients with damage to the ventral cortex were tested with sensitive point-light display paradigms. All patients were able to recognize unmasked point-light displays and their perceptual thresholds were not significantly different from those of three different control groups, one of which comprised brain-damaged patients with spared ventral cortex (n > 50). Importantly, these six patients performed significantly better than patients with damage to regions critical for biological motion perception. To assess the necessary contribution of different regions in the ventral pathway to biological motion perception, we complement the behavioral findings with a fine-grained comparison between the lesion location and extent, and the cortical regions standardly implicated in biological motion processing. This analysis revealed that the ventral aspects of the form pathway (e.g., fusiform regions, ventral extrastriate body area) are not critical for biological motion perception. We hypothesize that the role of these ventral regions is to provide enhanced multiview/posture representations of the moving person rather than to represent biological motion perception per se.

Decomposition and extraction: a new framework for visual classification

In this paper, we present a novel framework for visual classification based on hierarchical image decomposition and hybrid midlevel feature extraction. Unlike most midlevel feature learning methods, which focus on the process of coding or pooling, we emphasize that the mechanism of image composition also strongly influences the feature extraction. To effectively explore the image content for the feature extraction, we model a multiplicity feature representation mechanism through meaningful hierarchical image decomposition followed by a fusion step. In particularly, we first propose a new hierarchical image decomposition approach in which each image is decomposed into a series of hierarchical semantical components, i.e, the structure and texture images. Then, different feature extraction schemes can be adopted to match the decomposed structure and texture processes in a dissociative manner. Here, two schemes are explored to produce property related feature representations. One is based on a single-stage network over hand-crafted features and the other is based on a multistage network, which can learn features from raw pixels automatically. Finally, those multiple midlevel features are incorporated by solving a multiple kernel learning task. Extensive experiments are conducted on several challenging data sets for visual classification, and experimental results demonstrate the effectiveness of the proposed method.

Neural correlates of language and non-language visuospatial processing in adolescents with reading disability

Despite anecdotal evidence of relative visuospatial processing strengths in individuals with reading disability (RD), only a few studies have assessed the presence or the extent of these putative strengths. The current study examined the cognitive and neural bases of visuospatial processing abilities in adolescents with RD relative to typically developing (TD) peers. Using both cognitive tasks and functional magnetic resonance imaging (fMRI) we contrasted printed word recognition with non-language visuospatial processing tasks. Behaviorally, lower reading skill was related to a visuospatial processing advantage (shorter latencies and equivalent accuracy) on a geometric figure processing task, similar to findings shown in two published studies. FMRI analyses revealed key group by task interactions in patterns of cortical and subcortical activation, particularly in frontostriatal networks, and in the distributions of right and left hemisphere activation on the two tasks. The results are discussed in terms of a possible neural tradeoff in visuospatial processing in RD.

Spatially rearranged object parts can facilitate perception of intact whole objects

The familiarity of an object depends on the spatial arrangement of its parts; when the parts are spatially rearranged, they form a novel, unrecognizable configuration. Yet the same collection of parts comprises both the familiar and novel configuration. Is it possible that the collection of familiar parts activates a representation of the intact familiar configuration even when they are spatially rearranged? We presented novel configurations as primes before test displays that assayed effects on figure-ground perception from memories of intact familiar objects. In our test displays, two equal-area regions shared a central border; one region depicted a portion of a familiar object. Previous research with such displays has shown that participants are more likely to perceive the region depicting a familiar object as the figure and the abutting region as its ground when the familiar object is depicted in its upright orientation rather than upside down. The novel primes comprised either the same or a different collection of parts as the familiar object in the test display (part-rearranged and control primes, respectively). We found that participants were more likely to perceive the familiar region as figure in upright vs. inverted displays following part-rearranged primes but not control primes. Thus, priming with a novel configuration comprising the same familiar parts as the upcoming figure-ground display facilitated orientation-dependent effects of object memories on figure assignment. Similar results were obtained when the spatially rearranged collection of parts was suggested on the groundside of the prime's border, suggesting that familiar parts in novel configurations access the representation of their corresponding intact whole object before figure assignment. These data demonstrate that familiar parts access memories of familiar objects even when they are arranged in a novel configuration.

The role of human ventral visual cortex in motion perception

Visual motion perception is fundamental to many aspects of visual perception. Visual motion perception has long been associated with the dorsal (parietal) pathway and the involvement of the ventral 'form' (temporal) visual pathway has not been considered critical for normal motion perception. Here, we evaluated this view by examining whether circumscribed damage to ventral visual cortex impaired motion perception. The perception of motion in basic, non-form tasks (motion coherence and motion detection) and complex structure-from-motion, for a wide range of motion speeds, all centrally displayed, was assessed in five patients with a circumscribed lesion to either the right or left ventral visual pathway. Patients with a right, but not with a left, ventral visual lesion displayed widespread impairments in central motion perception even for non-form motion, for both slow and for fast speeds, and this held true independent of the integrity of areas MT/V5, V3A or parietal regions. In contrast with the traditional view in which only the dorsal visual stream is critical for motion perception, these novel findings implicate a more distributed circuit in which the integrity of the right ventral visual pathway is also necessary even for the perception of non-form motion.

Functional characterization and differential coactivation patterns of two cytoarchitectonic visual areas on the human posterior fusiform gyrus

The ventral stream of the human extrastriate visual cortex shows a considerable functional heterogeneity from early visual processing (posterior) to higher, domain-specific processing (anterior). The fusiform gyrus hosts several of those "high-level" functional areas. We recently found a subdivision of the posterior fusiform gyrus on the microstructural level, that is, two distinct cytoarchitectonic areas, FG1 and FG2 (Caspers et al., Brain Structure & Function, 2013). To gain a first insight in the function of these two areas, here we studied their behavioral involvement and coactivation patterns by means of meta-analytic connectivity modeling based on the BrainMap database (www.brainmap.org), using probabilistic maps of these areas as seed regions. The coactivation patterns of the areas support the concept of a common involvement in a core network subserving different cognitive tasks, that is, object recognition, visual language perception, or visual attention. In addition, the analysis supports the previous cytoarchitectonic parcellation, indicating that FG1 appears as a transitional area between early and higher visual cortex and FG2 as a higher-order one. The latter area is furthermore lateralized, as it shows strong relations to the visual language processing system in the left hemisphere, while its right side is stronger associated with face selective regions. These findings indicate that functional lateralization of area FG2 relies on a different pattern of connectivity rather than side-specific cytoarchitectonic features.

Right fusiform response patterns reflect visual object identity rather than semantic similarity

We previously reported the neuropsychological consequences of a lesion confined to the middle and posterior part of the right fusiform gyrus (case JA) causing a partial loss of knowledge of visual attributes of concrete entities in the absence of category-selectivity (animate versus inanimate). We interpreted this in the context of a two-step model that distinguishes structural description knowledge from associative-semantic processing and implicated the lesioned area in the former process. To test this hypothesis in the intact brain, multi-voxel pattern analysis was used in a series of event-related fMRI studies in a total of 46 healthy subjects. We predicted that activity patterns in this region would be determined by the identity of rather than the conceptual similarity between concrete entities. In a prior behavioral experiment features were generated for each entity by more than 1000 subjects. Based on a hierarchical clustering analysis the entities were organised into 3 semantic clusters (musical instruments, vehicles, tools). Entities were presented as words or pictures. With foveal presentation of pictures, cosine similarity between fMRI response patterns in right fusiform cortex appeared to reflect both the identity of and the semantic similarity between the entities. No such effects were found for words in this region. The effect of object identity was invariant for location, scaling, orientation axis and color (grayscale versus color). It also persisted for different exemplars referring to a same concrete entity. The apparent semantic similarity effect however was not invariant. This study provides further support for a neurobiological distinction between structural description knowledge and processing of semantic relationships and confirms the role of right mid-posterior fusiform cortex in the former process, in accordance with previous lesion evidence.

Acquired prosopagnosia with spared within-class object recognition but impaired recognition of degraded basic-level objects

We present a new case of acquired prosopagnosia resulting from extensive lesions predominantly in the right occipitotemporal cortex. Functional brain imaging revealed atypical activation of all core face areas in the right hemisphere, with reduced signal difference between faces and objects compared to controls. In contrast, Herschel's lateral occipital complex showed normal activation to objects. Behaviourally, Herschel is severely impaired with the recognition of familiar faces, discrimination between unfamiliar identities, and the perception of facial expression and gender. Notably, his visual recognition deficits are largely restricted to faces, suggesting that the damaged mechanisms are face-specific. He showed normal recognition memory for a wide variety of object classes in several paradigms, normal ability to discriminate between highly similar items within a novel object category, and intact ability to name basic objects (except four-legged animals). Furthermore, Herschel displayed a normal face composite effect and typical global advantage and global interference effects in the Navon task, suggesting spared integration of both face and nonface information. Nevertheless, he failed visual closure tests requiring recognition of basic objects from degraded images. This abnormality in basic object recognition is at odds with his spared within-class recognition and presents a challenge to hierarchical models of object perception.

Complementary neural representations for faces and words: a computational exploration

A key issue that continues to generate controversy concerns the nature of the psychological, computational, and neural mechanisms that support the visual recognition of objects such as faces and words. While some researchers claim that visual recognition is accomplished by category-specific modules dedicated to processing distinct object classes, other researchers have argued for a more distributed system with only partially specialized cortical regions. Considerable evidence from both functional neuroimaging and neuropsychology would seem to favour the modular view, and yet close examination of those data reveals rather graded patterns of specialization that support a more distributed account. This paper explores a theoretical middle ground in which the functional specialization of brain regions arises from general principles and constraints on neural representation and learning that operate throughout cortex but that nonetheless have distinct implications for different classes of stimuli. The account is supported by a computational simulation, in the form of an artificial neural network, that illustrates how cooperative and competitive interactions in the formation of neural representations for faces and words account for both their shared and distinctive properties. We set out a series of empirical predictions, which are also examined, and consider the further implications of this account.

The functional neuroanatomy of object agnosia: a case study

Cortical reorganization of visual and object representations following neural injury was examined using fMRI and behavioral investigations. We probed the visual responsivity of the ventral visual cortex of an agnosic patient who was impaired at object recognition following a lesion to the right lateral fusiform gyrus. In both hemispheres, retinotopic mapping revealed typical topographic organization and visual activation of early visual cortex. However, visual responses, object-related, and -selective responses were reduced in regions immediately surrounding the lesion in the right hemisphere, and also, surprisingly, in corresponding locations in the structurally intact left hemisphere. In contrast, hV4 of the right hemisphere showed expanded response properties. These findings indicate that the right lateral fusiform gyrus is critically involved in object recognition and that an impairment to this region has widespread consequences for remote parts of cortex. Finally, functional neural plasticity is possible even when a cortical lesion is sustained in adulthood.

Disorders of color and object recognition: syndromes of the ventral occipitotemporal pathway

Although lesions of the striate cortex are associated with hemifield defects, lesions of the inferior and medial occipitotemporal cortex often are associated with disorders of more high-level and complex visual processing. These disorders of the ventral processing stream can be considered as impairing the perception of color and recognition of objects, in contrast to the problems with motion and spatial localization seen with lesions of the dorsal occipitoparietal stream. Dysfunction in the ventral stream leads to the prototypic syndromes of achromatopsia, general visual agnosia, prosopagnosia, alexia without agraphia, and some forms of topographagnosia. Most of these are not single entities but families of disorders in which dysfunction in different cognitive and perceptual processes can lead to the same symptom. Continuum Lifelong Learning Neurol 2010;16(4):111-127.

Perceiving parts and shapes from concave surfaces

"A hole is nothing at all, but it can break your neck." In a similar fashion to the danger illustrated by this folk paradox, concave regions pose difficulties to theories of visual shape perception. We can readily identify their shapes, but according to principles of how observers determine part boundaries, concavities in a planar surface should have very different figural shapes from the ones that we perceive. In three experiments, we tested the hypothesis that observers perceive local image features differently in simulated 3-D concave and convex regions but use them to arrive at similar shape percepts. Stimuli were shape-from-shading images containing regions that appeared either concave or convex in depth, depending on their orientation in the picture plane. The results show that concavities did not benefit from the same global object-based attention or holistic shape encoding as convexities and that the participants relied on separable spatial dimensions to judge figural shape in concavities. Concavities may exploit a secondary process for shape perception that allows regions composed of perceptually independent features to ultimately be perceived as gestalts.

Perceptual organization and visual attention

Perceptual organization--the processes structuring visual information into coherent units--and visual attention--the processes by which some visual information in a scene is selected--are crucial for the perception of our visual environment and to visuomotor behavior. Recent research points to important relations between attentional and organizational processes. Several studies demonstrated that perceptual organization constrains attentional selectivity, and other studies suggest that attention can also constrain perceptual organization. In this chapter I focus on two aspects of the relationship between perceptual organization and attention. The first addresses the question of whether or not perceptual organization can take place without attention. I present findings demonstrating that some forms of grouping and figure-ground segmentation can occur without attention, whereas others require controlled attentional processing, depending on the processes involved and the conditions prevailing for each process. These findings challenge the traditional view, which assumes that perceptual organization is a unitary entity that operates preattentively. The second issue addresses the question of whether perceptual organization can affect the automatic deployment of attention. I present findings showing that the mere organization of some elements in the visual field by Gestalt factors into a coherent perceptual unit (an "object"), with no abrupt onset or any other unique transient, can capture attention automatically in a stimulus-driven manner. Taken together, the findings discussed in this chapter demonstrate the multifaceted, interactive relations between perceptual organization and visual attention.

What is Meant by Impaired Configural Processing in Acquired Prosopagnosia?

Apperceptive prosopagnosia is supposedly characterised by impaired configural processing, which could refer to either perception of spatial structure or holistic mechanisms. Ten prosopagnosic patients were tested with (i) dot patterns, to determine if manipulations of complexity, size, orientation, or the regularity of global structure generated effects consistent with the holistic hypothesis; and (ii) hierarchical letters, to probe for a global ‘whole-object’ processing deficit. With dot patterns (experiment 1) patients were impaired even for simple two-dot stimuli, but did better with more complex patterns, when size or orientation varied, or with a regular global structure. In experiment 2, they demonstrated normal latency effects of global-level processing. Apperceptive prosopagnosia, including that from lesions encompassing the right fusiform gyrus, is thus associated with a ‘configural deficit’ that impairs perception of spatial structure, not just for faces but also for non-facial patterns. While it cannot be concluded that holistic processing is entirely normal in these subjects, their performance shows significant modulation by whole-object structure, indicating that some whole-object processing is occurring in these patients.