Does my face FIT?: a face image task reveals structure and distortions of facial feature representation

Similar tactile distance anisotropy across segments of the arm

A substantial literature has described anisotropy of tactile distance perception across many body parts. In general, the distance between two touches is felt as larger when the touches are oriented with the mediolateral axis of the limbs than when oriented with the proximodistal axis. In this study, we investigated tactile distance perception across the arm, measuring anisotropy on the upper arm, forearm, and hand dorsum. Participants made forced-choice judgments of which of two pairs of tactile distances felt larger and anisotropy was measured using the method of constant stimuli. Clear anisotropy was found on all three regions of the arm. There was no apparent difference in the magnitude of anisotropy across segments of the arm. We further measured the physical curvature of the arm and show that this cannot account of the perceptual anisotropy observed.

Distortion of mental body representations

Our body is central to our sense of self, and distorted body representations are found in several serious medical conditions. This paper reviews evidence that distortions of body representations are also common in healthy individuals, and occur in domains including tactile spatial perception, proprioception, and the conscious body image. Across domains, there is a general tendency for body width to be overestimated compared to body length. Intriguingly, distortions in both eating disorders and chronic pain appear to be exaggerations of this baseline pattern of distortions, suggesting that these conditions may relate to dysfunction of mechanisms for body perception. Distortions of body representations provide a revealing window into basic aspects of self-perception.

No evidence for sex differences in tactile distance anisotropy

Perceptual illusions of the distance between two touches have been used to study mental representations of the body since E. H. Weber's classic studies in the nineteenth century. For example, on many body parts tactile distance is anisotropic, with distances aligned with body width being perceived as larger than distances aligned with body length on several skin regions. Recent work has demonstrated sex differences in other distortions of mental body representations, such as proprioceptive hand maps. Given such findings, I analysed the results of 24 experiments, conducted by myself and my colleagues, measuring tactile distance anisotropy on the hand dorsum in both women and men. The results showed clear, and highly consistent anisotropy in both women and men, with no evidence for any sex difference.

The upside-down self: One's own face recognition is affected by inversion

One's own face is recognized more efficiently than any other face, although the neural mechanisms underlying this phenomenon remain poorly understood. Considering the extensive visual experience that we have with our own face, some authors have proposed that self-face recognition involves a more analytical perceptual strategy (i.e., based on face features) than other familiar faces, which are commonly processed holistically (i.e., as a whole). However, this hypothesis has not yet been tested with brain activity data. In the present study, we employed an inversion paradigm combined with event-related potential (ERP) recordings to investigate whether the self-face is processed more analytically. Sixteen healthy participants were asked to identify their own face and a familiar face regardless of its orientation, which could either be upright or inverted. ERP analysis revealed an enhanced amplitude and a delayed latency for the N170 component when faces were presented in an inverted orientation. Critically, both the self and a familiar face were equally vulnerable to the inversion effect, suggesting that the self-face is not processed more analytically than a familiar face. In addition, we replicated the recent finding that the attention-related P200 component is a specific neural index of self-face recognition. Overall, our results suggest that the advantage for self-face processing might be better explained by the engagement of self-related attentional mechanisms than by the use of a more analytical visuoperceptual strategy.

Tactile distance anisotropy on the feet

Perception of distance between two touches varies with orientation on the hand, with distances aligned with hand width perceived as larger than those aligned with hand length. Similar anisotropies are found on other body parts (e.g., the face), suggesting they may reflect a general feature of tactile organization, but appear absent on other body parts (e.g., the belly). Here, we investigated tactile-distance anisotropy on the foot, a body part structurally and embryologically similar to the hand, but with very different patterns of functional usage in humans. In three experiments, we compared the perceived distance between pairs of touches aligned with the medio-lateral and proximal-distal foot axes. On the hairy skin of the foot dorsum, anisotropy was consistently found, with distances aligned with the medio-lateral foot axis perceived as larger than those in the proximo-distal axis. In contrast, on the glabrous skin of the sole, inconsistent results were found across experiments, with no overall evidence for anisotropy. This shows a pattern of anisotropy on the foot broadly similar to that on the hand, adding to the list of body parts showing tactile-distance anisotropy, and providing further evidence that such biases are a general aspect of tactile spatial organization across the body. Significance: The perception of tactile distance has been widely used to understand the spatial structure of touch. On the hand, anisotropy of tactile distance perception is well established, with distances oriented across hand width perceived larger than those oriented along hand length. We investigated tactile-distance anisotropy on the feet, a body part structurally, genetically, and developmentally homologous to the hands, but with strikingly different patterns of functional usage. We report highly similar patterns of anisotropy on the hairy skin of the hand dorsum and foot dorsum. This suggests that anisotropy arises from the general organization of touch across the body.

The signing body: extensive sign language practice shapes the size of hands and face

The representation of the metrics of the hands is distorted, but is susceptible to malleability due to expert dexterity (magicians) and long-term tool use (baseball players). However, it remains unclear whether modulation leads to a stable representation of the hand that is adopted in every circumstance, or whether the modulation is closely linked to the spatial context where the expertise occurs. To this aim, a group of 10 experienced Sign Language (SL) interpreters were recruited to study the selective influence of expertise and space localisation in the metric representation of hands. Experiment 1 explored differences in hands’ size representation between the SL interpreters and 10 age-matched controls in near-reaching (Condition 1) and far-reaching space (Condition 2), using the localisation task. SL interpreters presented reduced hand size in near-reaching condition, with characteristic underestimation of finger lengths, and reduced overestimation of hands and wrists widths in comparison with controls. This difference was lost in far-reaching space, confirming the effect of expertise on hand representations is closely linked to the spatial context where an action is performed. As SL interpreters are also experts in the use of their face with communication purposes, the effects of expertise in the metrics of the face were also studied (Experiment 2). SL interpreters were more accurate than controls, with overall reduction of width overestimation. Overall, expertise modifies the representation of relevant body parts in a specific and context-dependent manner. Hence, different representations of the same body part can coexist simultaneously.

Proprioceptive errors in the localization of hand landmarks: What can be learnt about the hand metric representation?

Proprioception acquires a crucial role in estimating the configuration of our body segments in space when visual information is not available. Proprioceptive accuracy is assessed by asking participants to match the perceived position of an unseen body landmark through reaching movements. This task was also adopted to study the perceived hand structure by computing the relative distances between averaged proprioceptive judgments (hand Localization Task). However, the pattern of proprioceptive errors leading to the misperceived hand structure is unexplored. Here, we aimed to characterize this pattern across different hand landmarks, having different anatomo-physiological properties and cortical representations. Furthermore, we sought to describe the error consistency and its stability over time. To this purpose, we analyzed the proprioceptive errors of 43 healthy participants during the hand Localization Task. We found larger but more consistent errors for the fingertips compared to the knuckles, possibly due to poorer proprioceptive signal, compensated by other sources of spatial information. Furthermore, we found a shift (overlap effect) and a temporal drift of the hand perceived position towards the shoulder of origin, which was consistent within and between subjects. The overlap effect had a greater influence on lateral compared to medial landmarks, leading to the hand width overestimation. Our results are compatible with domain-general and body-specific spatial biases affecting the proprioceptive localization of the hand landmarks, thus the apparent hand structure misperception.

Distorted perceptual face maps

Recent research has shown that proprioception relies on distorted representations of body size and shape. By asking participants to localise multiple landmarks in space, perceptual body maps can be constructed. Such maps of the hand and forearm is highly distorted, with large overestimation of limb width compared to length. Here, we investigated perceptual maps of the face, a body part central to our sense of self and personal identity. Participants localised 19 facial landmarks by pointing on a board covering their face. By comparing the relative location of judgments, we constructed perceptual face maps and compared them to actual face structure. These maps were massively distorted, with large overestimation of face width, but not length. This shows that distortions in perceptual body maps are not unique to the hand, but widespread on the body, including parts like the face at the core of our personal identity.

Using Facial Animation to Increase the Enfacement Illusion and Avatar Self-Identification

Through avatar embodiment in Virtual Reality (VR) we can achieve the illusion that an avatar is substituting our body: the avatar moves as we move and we see it from a first person perspective. However, self-identification, the process of identifying a representation as being oneself, poses new challenges because a key determinant is that we see and have agency in our own face. Providing control over the face is hard with current HMD technologies because face tracking is either cumbersome or error prone. However, limited animation is easily achieved based on speaking. We investigate the level of avatar enfacement, that is believing that a picture of a face is one's own face, with three levels of facial animation: (i) one in which the facial expressions of the avatars are static, (ii) one in which we implement lip-sync motion and (iii) one in which the avatar presents lip-sync plus additional facial animations, with blinks, designed by a professional animator. We measure self-identification using a face morphing tool that morphs from the face of the participant to the face of a gender matched avatar. We find that self-identification on avatars can be increased through pre-baked animations even when these are not photorealistic nor look like the participant.

Touching! An Augmented Reality System for Unveiling Face Topography in Very Young Children

Developmental body topography, particularly of the face, is a fundamental research topic in the current decade. However, empirical investigation of this topic for very young children faces a number of difficulties related to the task requirements and technical procedures. In this study, we developed a new task to study the spatially-sensed position of facial parts in a self-face recognition task for 2.5- and 3.5-year-old children. Using the technique of augmented reality (AR) and 3D face tracking technology, we presented participants with their projected self-image on a screen, accompanied by a digital mark located on parts of their face. We prepared a cheerful visual and auditory reward on the screen when participants showed correct localization of the mark. We then tested whether they could indicate the position of the mark on their own faces and remain motivated for task repetition. To assess the efficacy of this task, 31 2.5- and 11 3.5-year-old children participated in this study. About half of the 2.5-year-olds and 80% of the 3.5-year-olds could perform more than 30 trials. Our new task, then, was to maintain young children’s motivation for task repetition using the cheerful visual and auditory reward. The analysis of localization errors suggested the uniqueness of spatial knowledge of self-face in young children. The efficacy of this new task for studying the development of body image has been confirmed.

Sex differences in perceptual hand maps: A meta-analysis

A large body of research has suggested that localisation of the hand in external space relies on distorted representations of the hand. We developed a paradigm for measuring implicit perceptual maps of the hand (Longo & Haggard, 2010, Proc Natl Acad Sci USA, 107, 11727-11732), which show systematic deviation from actual hand shape, including overestimation of hand width and underestimation of finger length. Recently, Coelho and Gonzalez (in press, Psychol Res) reported sex differences in these perceptual hand maps, with women showing greater overestimation of hand width, but less underestimation of finger length than men. In the current study, I conducted a meta-analysis of 19 experiments using this paradigm by myself and my colleagues. The results replicated the sex differences reported by Coelho and Gonzalez. Importantly, however, these sex differences were not apparent when actual hand size was included as a covariate in analyses, suggesting that they may, at least in part, be due to women having smaller hands on average than men.

No evidence of tactile distance anisotropy on the belly

The perceived distance between two touches has been found to be larger for pairs of stimuli oriented across the width of the body than along the length of the body, for several body parts. Nevertheless, the magnitude of such biases varies from place to place, suggesting systematically different distortions of tactile space across the body. Several recent studies have investigated perceived tactile distance on the belly as an implicit measure of body perception in clinical conditions including anorexia nervosa and obesity. In this study, we investigated whether there is an anisotropy of perceived tactile distance on the belly in a sample of adult women. Participants made verbal estimates of the perceived distance between pairs of touches oriented either across body width or along body length on the belly and the dorsum of the left hand. Consistent with previous results, a large anisotropy was apparent on the hand, with across stimuli perceived as larger than along stimuli. In contrast, no such bias was apparent on the belly. These results provide further evidence that anisotropies of perceived tactile distance vary systematically across the body and suggest that there is no anisotropy at all on the belly in healthy women.

My true face: Unmasking one's own face representation

Face recognition has been the focus of multiple studies, but little is still known on how we represent the structure of one's own face. Most of the studies have focused on the topic of visual and haptic face recognition, but the metric representation of different features of one's own face is relatively unknown. We investigated the metric representation of the face in young adults by developing a proprioceptive pointing task to locate face landmarks in the first-person perspective. Our data revealed a large overestimation of width for all face features which resembles, in part, the size in somatosensory cortical representation. In contrast, face length was compartmentalised in two different regions: upper (underestimated) and bottom (overestimated); indicating size differences possibly due to functionality. We also identified shifts of the location judgments, with all face areas perceived closer to the body than they really were, due to a potential influence of the self-frame of reference. More importantly, the representation of the face appeared asymmetrical, with an overrepresentation of right side of the face, due to the influence of lateralization biases for strong right-handers. We suggest that these effects may be due to functionality influences and experience that affect the construction of face structural representation, going beyond the parallel of the somatosensory homunculus.

Perceived face size in healthy adults

Perceptual body size distortions have traditionally been studied using subjective, qualitative measures that assess only one type of body representation-the conscious body image. Previous research on perceived body size has typically focused on measuring distortions of the entire body and has tended to overlook the face. Here, we present a novel psychophysical method for determining perceived body size that taps into implicit body representation. Using a two-alternative forced choice (2AFC), participants were sequentially shown two life-size images of their own face, viewed upright, upside down, or tilted 90°. In one interval, the width or length dimension was varied, while the other interval contained an undistorted image. Participants reported which image most closely matched their own face. An adaptive staircase adjusted the distorted image to hone in on the image that was equally likely to be judged as matching their perceived face as the accurate image. When viewed upright or upside down, face width was overestimated and length underestimated, whereas perception was accurate for the on-side views. These results provide the first psychophysically robust measurements of how accurately healthy participants perceive the size of their face, revealing distortions of the implicit body representation independent of the conscious body image.

Distorted body representations in healthy cognition

Delusions and misperceptions about the body are a conspicuous feature of numerous neurological and psychiatric conditions. In stark contrast to such pathological cases, the immediacy and familiarity of our ordinary experience of our body can make it seem as if our representation of our body is highly accurate, even infallible. Recent research has begun to demonstrate, however, that large and systematic distortions of body representation are a normal part of healthy cognition. Here, I describe this research, focusing on distortions of body representations underlying tactile distance perception and position sense. I also discuss evidence for distortions of higher-order body representations, such as the conscious body image. Finally, I will end with a discussion of the potential relations among different body representations and their distortions.

Perceptual and Conceptual Distortions of Implicit Hand Maps

Recent studies have revealed that human position sense relies on a massively distorted representation of hand size and shape. By comparing the judged location of landmarks on an occluded hand, Longo and Haggard (2010) constructed implicit perceptual maps of represented hand structure, showing large underestimation of finger length and overestimation of hand width. Here, we investigated the contribution of two potential sources of distortions to such effects: perceptual distortions reflecting spatial warping of the representation of bodily tissue itself, perhaps reflecting distortions of somatotopic cortical maps, and conceptual distortions reflecting mistaken beliefs about the locations of different landmarks within the body. In Experiment 1 we compared distorted hand maps to a task in which participants explicitly judged the location of their knuckles in a hand silhouette. The results revealed the conceptual distortions are responsible for at least part of the underestimation of finger length, but cannot explain overestimation of hand width. Experiment 2 compared distortions of the participant’s own hand based on position sense with a prosthetic hand based on visual memory. Underestimation of finger length was found for both hands, providing further evidence that it reflects a conceptual distortion. In contrast, overestimation of hand width was specific to representation of the participant’s own hand, confirming it reflects a perceptual distortion. Together, these results suggest that distorted body representations do not reflect a single underlying cause. Rather, both perceptual and conceptual distortions contribute to the overall configuration of the hand representation.

Bilateral Symmetry of Distortions of Tactile Size Perception

The perceived distance between touches on the limbs is generally bigger for distances oriented across the width of the limb than for distances oriented along the length of the limb. The present study aimed to investigate the coherence of such distortions of tactile size perception across different skin surfaces. We investigated distortions of tactile size perception on the dorsal and palmar surfaces of both the left and right hands as well as the forehead. Participants judged which of two tactile distances felt larger. One distance was aligned with the proximodistal axis (along the body), the other with the mediolateral axis (across the body). Clear distortions were found on all five skin surfaces, with stimuli oriented across the width of the body being perceived as farther apart than those oriented along the length of the body. Consistent with previous results, distortions were smaller on the palmar than on the dorsal hand surface. Distortion on the forehead was intermediate between the dorsal and palmar surfaces. There were clear correlations between distortion on the left and right hands, for both the dorsal and palmar skin surfaces. In contrast, within each hand, there was no significant correlation between the two skin surfaces. Distortion on the forehead was not significantly correlated with that on any of the other skin surfaces. These results provide evidence for bilaterally symmetric representations underlying tactile size perception.