Bodies adapt orientation-independent face representations

Did you skip leg day? The neural mechanisms of muscle perception for body parts

While the neural mechanisms underpinning the perception of muscularity are poorly understood, recent progress has been made using the psychophysical technique of visual adaptation. Prolonged visual exposure to high (low) muscularity bodies causes subsequently viewed bodies to appear less (more) muscular, revealing a recalibration of the neural populations encoding muscularity. Here, we use visual adaptation to further elucidate the tuning properties of the neural processes underpinning muscle perception for the upper and lower halves of the body. Participants manipulated the apparent muscularity of upper and lower bodies until they appeared 'normal', prior to and following exposure to a series of top/bottom halves of bodies that were either high or low in muscularity. In Experiment 1, participants were adapted to isolated own-gender body halves from one of four conditions; increased (muscularity) upper (body half), increased lower, decreased upper, or decreased lower. Despite the presence of muscle aftereffects when the body halves the participants viewed and manipulated were congruent, there was only weak evidence of muscle aftereffect transfer between the upper and lower halves of the body. Aftereffects were significantly weaker when body halves were incongruent, implying minimal overlap in the neural mechanisms encoding muscularity for body half. Experiment 2 examined the generalisability of Experiment 1's findings in a more ecologically valid context using whole-body stimuli, producing a similar pattern of results as Experiment 1, but with no evidence of cross-adaptation. Taken together, the findings are most consistent with muscle-encoding neural populations that are body-half selective. As visual adaptation has been implicated in cases of body size and shape misperception, the present study furthers our current understanding of how these perceptual inaccuracies, particularly those involving muscularity, are developed, maintained, and may potentially be treated.

Perceptual aftereffects of adiposity transfer from hands to whole bodies

Adaptation aftereffects for features such as identity and gender have been shown to transfer between faces and bodies, and faces and body parts, i.e. hands. However, no studies have investigated transfer of adaptation aftereffects between whole bodies and body parts. The present study investigated whether visual adaptation aftereffects transfer between hands and whole bodies in the context of adiposity judgements (i.e. how thin or fat a body is). On each trial, participants had to decide whether the body they saw was thinner or fatter than average. Participants performed the task before and after exposure to a thin/fat hand. Consistent with body adaptation studies, after exposure to a slim hand participants judged subsequently presented bodies to be fatter than after adaptation to a fat hand. These results suggest that there may be links between visual representations of body adiposity for whole bodies and body parts.

Looking more masculine among females: Spatial context modulates gender perception of face and biological motion

Perception of visual information highly depends on spatial context. For instance, perception of a low-level visual feature, such as orientation, can be shifted away from its surrounding context, exhibiting a simultaneous contrast effect. Although previous studies have demonstrated the adaptation aftereffect of gender, a high-level visual feature, it remains largely unknown whether gender perception can also be shaped by a simultaneously presented context. In the present study, we found that the gender perception of a central face or a point-light walker was repelled away from the gender of its surrounding faces or walkers. A norm-based opponent model of lateral inhibition, which accounts for the adaptation aftereffect of high-level features, can also excellently fit the simultaneous contrast effect. But different from the reported contextual effect of low-level features, the simultaneous contrast effect of gender cannot be observed when the centre and the surrounding stimuli are from different categories, or when the surrounding stimuli are suppressed from awareness. These findings on one hand reveal a resemblance between the simultaneous contrast effect and the adaptation aftereffect of high-level features, on the other hand highlight different biological mechanisms underlying the contextual effects of low- and high-level visual features.

Keep the head in the right place: Face-body interactions in inferior temporal cortex

In primates, faces and bodies activate distinct regions in the inferior temporal (IT) cortex and are typically studied separately. Yet, primates interact with whole agents and not with random concatenations of faces and bodies. Despite its social importance, it is still poorly understood how faces and bodies interact in IT. Here, we addressed this gap by measuring fMRI activations to whole agents and to unnatural face-body configurations in which the head was mislocated with respect to the body, and examined how these relate to the sum of the activations to their corresponding faces and bodies. First, we mapped patches in the IT of awake macaques that were activated more by images of whole monkeys compared to objects and found that these mostly overlapped with body and face patches. In a second fMRI experiment, we obtained no evidence for superadditive responses in these "monkey patches", with the activation to the monkeys being less or equal to the summed face-body activations. However, monkey patches in the anterior IT were activated more by natural compared to unnatural configurations. The stronger activations to natural configurations could not be explained by the summed face-body activations. These univariate results were supported by regression analyses in which we modeled the activations to both configurations as a weighted linear combination of the activations to the faces and bodies, showing higher regression coefficients for the natural compared to the unnatural configurations. Deeper layers of trained convolutional neural networks also contained units that responded more to natural compared to unnatural monkey configurations. Unlike the monkey fMRI patches, these units showed substantial superadditive responses to the natural configurations. Our monkey fMRI data suggest configuration-sensitive face-body interactions in anterior IT, adding to the evidence for an integrated face-body processing in the primate ventral visual stream, and open the way for mechanistic studies using single unit recordings in these patches.

Experience-dependent reshaping of body gender perception

Protracted exposure to specific stimuli causes biased visual aftereffects at both low- and high-level dimensions of a stimulus. Recently, it has been proposed that alterations of these aftereffects could play a role in body misperceptions. However, since previous studies have mainly addressed manipulations of body size, the relative contribution of low-level retinotopic and/or high-level object-based mechanisms is yet to be understood. In three experiments, we investigated visual aftereffects for body-gender perception, testing for the tuning of visual aftereffects across different characters and orientation. We found that exposure to a distinctively female (or male) body makes androgynous bodies appear as more masculine (or feminine) and that these aftereffects were not specific for the individual characteristics of the adapting body (Exp.1). Furthermore, exposure to only upright bodies (Exp.2) biased the perception of upright, but not of inverted bodies, while exposure to both upright and inverted bodies (Exp.3) biased perception for both. Finally, participants' sensitivity to body aftereffects was lower in individuals with greater communication deficits and deeper internalization of a male gender role. Overall, our data reveals the orientation-, but not identity-tuning of body-gender aftereffects and points to the association between alterations of the malleability of body gender perception and social deficits.

Visual adaptation selective for individual limbs reveals hierarchical human body representation

The spatial relationships between body parts are a rich source of information for person perception, with even simple pairs of parts providing highly valuable information. Computation of these relationships would benefit from a hierarchical representation, where body parts are represented individually. We hypothesized that the human visual system makes use of such representations. To test this hypothesis, we used adaptation to determine whether observers were sensitive to changes in the length of one body part relative to another. Observers viewed forearm/upper arm pairs where the forearm had been either lengthened or shortened, judging the perceived length of the forearm. Observers then adapted to a variety of different stimuli (e.g., arms, objects, etc.) in different orientations and visual field locations. We found that following adaptation to distorted limbs, but not non-limb objects, observers experienced a shift in perceived forearm length. Furthermore, this effect partially transferred across different orientations and visual field locations. Taken together, these results suggest the effect arises in high level mechanisms specialized for specific body parts, providing evidence for a representation of bodies based on parts and their relationships.

'Not only faces': specialized visual representation of human hands revealed by adaptation

Classical neurophysiological studies demonstrated that the monkey brain is equipped with neurons selectively representing the visual shape of the primate hand. Neuroimaging in humans provided data suggesting that a similar representation can be found in humans. Here, we investigated the selectivity of hand representation in humans by means of the visual adaptation technique. Results showed that participants' judgement of human-likeness of a visual probe representing a human hand was specifically reduced by a visual adaptation procedure when using a human hand adaptor but not when using an anthropoid robotic hand or a non-primate animal paw adaptor. Instead, human-likeness of the anthropoid robotic hand was affected by both human and robotic adaptors. No effect was found when using a non-primate animal paw as adaptor or probe. These results support the existence of specific neural mechanisms encoding human hand in the human's visual system.

Adaptation to Complex Pictures: Exposure to Emotional Valence Induces Assimilative Aftereffects

Aftereffects have been documented for a variety of perceptual categories spanning from body gender to facial emotion, thus becoming an important tool in the study of high-level vision and its neural bases. We examined whether the perceived valence of a complex scene is subject to aftereffects, by observing the participants’ evaluation of the valence of a test picture preceded by a different picture. For this study, we employed an adaptation paradigm with positive and negative images used as adapters, and positive, negative, and neutral images used as tests. Our results show that adaptation to complex emotional pictures induces assimilative aftereffects: participants judged neutral tests more positively following positive adapters and more negatively following negative adapters. This depended on the prolonged adaptation phase (10 s), as the results of a second experiment, in which adapters lasted for 500 ms, did not show aftereffects. In addition, the results show that assimilative aftereffects of negative and positive adapters also manifested themselves on non-neutral (negative and positive) targets, providing evidence that the global emotional content of complex pictures is suitable to induce assimilative aftereffects.

Point Me in the Right Direction: Same and Cross Category Visual Aftereffects to Directional Cues

Of the many hand gestures that we use in communication pointing is one of the most common and powerful in its role as a visual referent that directs joint attention. While numerous studies have examined the developmental trajectory of pointing production and comprehension, very little consideration has been given to adult visual perception of hand pointing gestures. Across two studies, we use a visual adaptation paradigm to explore the mechanisms underlying the perception of proto-declarative hand pointing. Twenty eight participants judged whether 3D modeled hands pointed, in depth, at or to the left or right of a target (test angles of 0°, 0.75° and 1.5° left and right) before and after adapting to either hands or arrows which pointed 10° to the right or left of the target. After adaptation, the perception of the pointing direction of the test hands shifted with respect to the adapted direction, revealing separate mechanisms for coding right and leftward pointing directions. While there were subtle yet significant differences in the strength of adaptation to hands and arrows, both cues gave rise to a similar pattern of aftereffects. The considerable cross category adaptation found when arrows were used as adapting stimuli and the asymmetry in aftereffects to left and right hands suggests that the adaptation aftereffects are likely driven by simple orientation cues, inherent in the morphological structure of the hand, and not dependent on the biological status of the hand pointing cue. This finding provides evidence in support of a common neural mechanism that processes these directional social cues, a mechanism that may be blind to the biological status of the stimulus category.

Heads First: Visual Aftereffects Reveal Hierarchical Integration of Cues to Social Attention

Determining where another person is attending is an important skill for social interaction that relies on various visual cues, including the turning direction of the head and body. This study reports a novel high-level visual aftereffect that addresses the important question of how these sources of information are combined in gauging social attention. We show that adapting to images of heads turned 25° to the right or left produces a perceptual bias in judging the turning direction of subsequently presented bodies. In contrast, little to no change in the judgment of head orientation occurs after adapting to extremely oriented bodies. The unidirectional nature of the aftereffect suggests that cues from the human body signaling social attention are combined in a hierarchical fashion and is consistent with evidence from single-cell recording studies in nonhuman primates showing that information about head orientation can override information about body posture when both are visible.

Disturbed spatial cognitive processing of body-related stimuli in a case of a lesion to the right fusiform gyrus

The fusiform gyrus (FG) is well known as one of the main neural sites of human face and body processing. We report the case of a young male patient with epilepsy and a circumscribed lesion in the right FG who presented with isolated impairments in spatial cognitive processing of body-related stimuli. However, he did not show any clinical signs of prosopagnosia. In particular, handling/processing of body and face stimuli was impaired, when stimuli were presented in unconventional views and orientations, thus requiring additional spatial cognitive operations. In this case study, we discuss the patient's selective impairment from the view of current empirical and theoretical work on the segregation of functions in the FG.

Cross-category adaptation: exposure to faces produces gender aftereffects in body perception

Prolonged exposure to a stimulus results in a subsequent perceptual bias. This perceptual adaptation aftereffect occurs not only for simple stimulus features but also for high-level stimulus properties (e.g., faces' gender, identity and emotional expressions). Recent studies on aftereffects demonstrate that adaptation to human bodies can modulate face perception because these stimuli share common properties. Those findings suggest that the aftereffect is not related to the physical property of the stimulus but to the great number of semantic attributes shared by the adapter and the test. Here, we report a novel cross-category adaptation paradigm with both silhouette face profiles (Experiment 1.1) and frontal view faces (Experiment 2) as adapters, testing the aftereffects when viewing an androgynous test body. The results indicate that adaptation to both silhouette face profiles and frontal view faces produces gender aftereffects (e.g., after visual exposure to a female face, the androgynous body appears as more male and vice versa). These findings confirm that high-level perceptual aftereffects can occur between cross-categorical stimuli that share common properties.