Face-Specific Perceptual Distortions Reveal A View- and Orientation-Independent Face Template

Unilateral prosopometamorphopsia caused by infarction of the splenium of the corpus callosum: 4 case report and review of the literature

BACKGROUND

Prosopometamorphopsia (PM) is a high-level visual-perceptual disorder characterized by facial distortion. Unilateral PM caused by splenium lesions in the corpus callosum (CC) is rare.

OBJECTIVE

To investigate the role of CC splenium lesions in unilateral PM and explore their implications for facial information processing and rehabilitation.

METHODS

We reported four cases of PM due to splenium lesions in the CC and conducted a retrospective analysis of 17 previously reported cases. A comprehensive evaluation framework was developed to assess primary, intermediate, and advanced visual processing in PM patients. Additionally, individualized rehabilitation strategies incorporating avoidance and compensatory methods were implemented.

RESULTS

CC splenium lesions were identified as the most common cause of unilateral PM, with a tendency toward bottom-up processing. Disconnection syndromes associated with CC splenium lesions were also observed. Patients showed a relatively favorable recovery rate, suggesting dynamic compensatory mechanisms in bilateral facial processing, with stronger compensatory functions in the right hemisphere.

CONCLUSION

The splenium of the corpus callosum plays a crucial role in bilateral facial information processing, exerting a lateralized influence on the right hemisphere. Further studies are needed to confirm these findings and elucidate the underlying pathophysiological mechanisms.

Characterizing the discriminability of visual categorical information in strongly connected voxels

Functional brain responses are strongly influenced by connectivity. Recently, we demonstrated a major example of this: category discriminability within occipitotemporal cortex (OTC) is enhanced for voxel sets that share strong functional connectivity to distal brain areas, relative to those that share lesser connectivity. That is, within OTC regions, sets of 'most-connected' voxels show improved multivoxel pattern discriminability for tool-, face-, and place stimuli relative to voxels with weaker connectivity to the wider brain. However, understanding whether these effects generalize to other domains (e.g. body perception network), and across different levels of the visual processing streams (e.g. dorsal as well as ventral stream areas) is an important extension of this work. Here, we show that this so-called connectivity-guided decoding (CGD) effect broadly generalizes across a wide range of categories (tools, faces, bodies, hands, places). This effect is robust across dorsal stream areas, but less consistent in earlier ventral stream areas. In the latter regions, category discriminability is generally very high, suggesting that extraction of category-relevant visual properties is less reliant on connectivity to downstream areas. Further, CGD effects are primarily expressed in a category-specific manner: For example, within the network of tool regions, discriminability of tool information is greater than non-tool information. The connectivity-guided decoding approach shown here provides a novel demonstration of the crucial relationship between wider brain connectivity and complex local-level functional responses at different levels of the visual processing streams. Further, this approach generates testable new hypotheses about the relationships between connectivity and local selectivity.

Neural and behavioral signatures of the multidimensionality of manipulable object processing

Understanding how we recognize objects requires unravelling the variables that govern the way we think about objects and the neural organization of object representations. A tenable hypothesis is that the organization of object knowledge follows key object-related dimensions. Here, we explored, behaviorally and neurally, the multidimensionality of object processing. We focused on within-domain object information as a proxy for the decisions we typically engage in our daily lives - e.g., identifying a hammer in the context of other tools. We extracted object-related dimensions from subjective human judgments on a set of manipulable objects. We show that the extracted dimensions are cognitively interpretable and relevant - i.e., participants are able to consistently label them, and these dimensions can guide object categorization; and are important for the neural organization of knowledge - i.e., they predict neural signals elicited by manipulable objects. This shows that multidimensionality is a hallmark of the organization of manipulable object knowledge.

Construction and validation of the Dalian emotional movement open-source set (DEMOS)

Human body movements are important for emotion recognition and social communication and have received extensive attention from researchers. In this field, emotional biological motion stimuli, as depicted by point-light displays, are widely used. However, the number of stimuli in the existing material library is small, and there is a lack of standardized indicators, which subsequently limits experimental design and conduction. Therefore, based on our prior kinematic dataset, we constructed the Dalian Emotional Movement Open-source Set (DEMOS) using computational modeling. The DEMOS has three views (i.e., frontal 0°, left 45°, and left 90°) and in total comprises 2664 high-quality videos of emotional biological motion, each displaying happiness, sadness, anger, fear, disgust, and neutral. All stimuli were validated in terms of recognition accuracy, emotional intensity, and subjective movement. The objective movement for each expression was also calculated. The DEMOS can be downloaded for free from https://osf.io/83fst/ . To our knowledge, this is the largest multi-view emotional biological motion set based on the whole body. The DEMOS can be applied in many fields, including affective computing, social cognition, and psychiatry.

From intermediate shape-centered representations to the perception of oriented shapes: response to commentaries

In this response paper, we start by addressing the main points made by the commentators on the target article's main theoretical conclusions: the existence and characteristics of the intermediate shape-centered representations (ISCRs) in the visual system, their emergence from edge detection mechanisms operating on different types of visual properties, and how they are eventually reunited in higher order frames of reference underlying conscious visual perception. We also address the much-commented issue of the possible neural mechanisms of the ISCRs. In the final section, we address more specific and general comments, questions, and suggestions which, albeit very interesting, were less directly focused on the main conclusions of the target paper.

Exploring pattern recognition: what is the relationship between the recognition of words, faces and other objects?

Debate surrounds processes of visual recognition, with no consensus as to whether recognition of distinct object categories (faces, bodies, cars, and words) is domain specific or subserved by domain-general visual recognition mechanisms. Here, we investigated correlations between the performance of 74 participants on recognition tasks for words, faces and other object categories. Participants completed a counter-balanced test battery of the Cambridge Face, Car and Body Parts Memory tests, as well as a standard four category lexical decision task, with response time and recognition accuracy as dependent variables. Results revealed significant correlations across domains for both recognition accuracy and response time, providing some support for domain-general pattern recognition. Further exploration of the data using principal component analysis (PCA) revealed a two-component model for both the response time and accuracy data. However, how the various word and object recognition tasks fitted these components varied considerably but did hint at familiarity/expertise as a common factor. In sum, we argue a complex relationship exists between domain-specific processing and domain-general processing, but that this is shaped by expertise. To further our understanding of pattern recognition, research investigating the recognition of words, faces and other objects in dyslexic individuals is recommended, as is research exploiting neuroimaging methodologies, with excellent temporal resolution, to chart the temporal specifics of different forms of visual pattern recognition.

One object, two networks? Assessing the relationship between the face and body-selective regions in the primate visual system

Faces and bodies are often treated as distinct categories that are processed separately by face- and body-selective brain regions in the primate visual system. These regions occupy distinct regions of visual cortex and are often thought to constitute independent functional networks. Yet faces and bodies are part of the same object and their presence inevitably covary in naturalistic settings. Here, we re-evaluate both the evidence supporting the independent processing of faces and bodies and the organizational principles that have been invoked to explain this distinction. We outline four hypotheses ranging from completely separate networks to a single network supporting the perception of whole people or animals. The current evidence, especially in humans, is compatible with all of these hypotheses, making it presently unclear how the representation of faces and bodies is organized in the cortex.

The form of reference frames in vision: The case of intermediate shape-centered representations

Although a great deal is known about the early sensory and the later, perceptual, stages of visual processing, far less is known about the nature of intermediate representational units and reference frames. Progress in understanding intermediate levels of representations in vision is hindered by the complexity of interactions among multiple levels of representation in the visual system, making it difficult to isolate and study the nature of each particular level. Nature occasionally provides the opportunity to peer inside complex systems by isolating components of a system through accidental damage or genetic modification of neural components. We have recently reported the case of a young woman who perceives 2D bounded regions of space as if they were plane-rotated by 90, 180 or 270° around their center, mirrored across their own axes, or both. This suggested that an intermediate stage of processing consists in representing mutually exclusive 2D bounded regions extracted from the retinal image in their own "shape-centered" perceptual frame. We proposed to refer to this level of representation as "intermediate shape-centered representation" (ISCR). Here, we used Davida's pattern of errors across 9 experiments as a tool for specifying in greater detail the geometrical properties of the reference frame in which elongated and/or symmetrical shapes are represented at the level of the ISCR. The nature of Davida's errors in these experiments suggests that ISCRs are represented in reference frames composed of orthogonal axes aligned with and centered on the most elongated segment of elongated shapes and, for symmetrical shapes deprived of a straight segment, aligned with their axis of symmetry, and centered on their centroid.

Holistic face recognition is an emergent phenomenon of spatial processing in face-selective regions

Spatial processing by receptive fields is a core property of the visual system. However, it is unknown how spatial processing in high-level regions contributes to recognition behavior. As face inversion is thought to disrupt typical holistic processing of information in faces, we mapped population receptive fields (pRFs) with upright and inverted faces in the human visual system. Here we show that in face-selective regions, but not primary visual cortex, pRFs and overall visual field coverage are smaller and shifted downward in response to face inversion. From these measurements, we successfully predict the relative behavioral detriment of face inversion at different positions in the visual field. This correspondence between neural measurements and behavior demonstrates how spatial processing in face-selective regions may enable holistic perception. These results not only show that spatial processing in high-level visual regions is dynamically used towards recognition, but also suggest a powerful approach for bridging neural computations by receptive fields to behavior.

A century of prosopometamorphopsia studies

Prosopometamorphopsia is an extremely rare disorder of visual perception characterised by facial distortions. We here review 81 cases (eight new ones and 73 cases published over the past century) to shed light on the perception of face gestalts. Our analysis indicates that the brain systems underlying the perception of face gestalts have genuine network properties, in the sense that they are widely disseminated and built such that spatially normal perception of faces can be maintained even when large parts of the network are compromised. We found that bilateral facial distortions were primarily associated with right-sided and bilateral occipital lesions, and unilateral facial distortions with lesions ipsilateral to the distorted hemifield and with the splenium of the corpus callosum. We also found tentative evidence for the involvement of the left frontal regions in the fusing of vertical hemi-images of faces, and of right parietal regions in the fusing of horizontal hemi-images. Evidence supporting the remarkable adaptability of the network comes from the relatively high recovery rates that we found, from the ipsilateral hemifield predominance of hemi-prosopometamorphopsia, and from a phenomenon called cerebral asthenopia (heightened visual fatigability) which points to the dynamic nature of compensatory mechanisms maintaining normal face perception, even in chronic cases of prosopometamorphopsia. Finally, our analysis suggests that specialised networks for the representation of face gestalts in familiar-versus-unfamiliar faces and for own-versus-other face may be present, although this is in need of further study.

Within-category representational stability through the lens of manipulable objects

Our ability to recognize an object amongst many exemplars is one of our most important features, and one that putatively distinguishes humans from non-human animals and potentially from (current) computational and artificial intelligence models. We can recognize objects consistently regardless of when we see them suggesting that we have stable representations across time and different contexts. Importantly, little is known about how humans can replicate within-category object representations across time. Here, we investigate neural stability of within-category object representations by computing the similarity between representational geometries of activity patterns for 80 images of tools obtained on different functional magnetic resonance imaging (fMRI) scanning days. We show that within-category representational stability is observable in regions that span lateral and ventral temporal cortex, inferior and superior parietal cortex, and premotor cortex - regions typically associated with tool processing and visuospatial processing. We then focus on what kinds of representations best explain the representational geometries within these regions. We test the similarity of these geometries with those coming from the different layers of a convolutional neural network, and those coming from perceived and veridical visual similarity models. We find that regions supporting within-category representational stability show stronger relationship with higher-level visual/semantic features, suggesting that neural replicability is derived from perceived and higher-level visual information. Within category representational stability may thus originate from long-range cross talk between category-specific regions (and in this case strongly within ventral and lateral temporal cortex) over more abstract, rather than veridical/lower-level, visual (sensorial) representations, and perhaps in the service of object-centered representations.

Vision: Face-Centered Representations in the Brain

A longstanding debate in the face recognition field concerns the format of face representations in the brain. New face research clarifies some of this mystery by revealing a face-centered format in a patient with a left splenium lesion of the corpus callosum who perceives the right side of faces as 'melted'.