Holistic processing of human body postures: evidence from the composite effect

The Relative Contribution of Facial and Body Information to the Perception of Cuteness

Faces and bodies both provide cues to age and cuteness, but little work has explored their interaction in cuteness perception. This study examines the interplay of facial and bodily cues in the perception of cuteness, particularly when these cues convey conflicting age information. Participants rated the cuteness of face-body composites that combined either a child or adult face with an age-congruent or incongruent body alongside manipulations of the head-to-body height ratio (HBR). The findings from two experiments indicated that child-like facial features enhanced the perceived cuteness of adult bodies, while child-like bodily features generally had negative impacts. Furthermore, the results showed that an increased head size significantly boosted the perceived cuteness for child faces more than for adult faces. Lastly, the influence of the HBR was more pronounced when the outline of a body's silhouette was the only available information compared to when detailed facial and bodily features were presented. This study suggests that body proportion information, derived from the body's outline, and facial and bodily features, derived from the interior surface, are integrated to form a unitary representation of a whole person in cuteness perception. Our findings highlight the dominance of facial features over bodily information in cuteness perception, with facial attributes serving as key references for evaluating face-body relationships and body proportions. This research offers significant insights into social cognition and character design, particularly in how people perceive entities with mixed features of different social categories, underlining the importance of congruency in perceptual elements.

Putting people in context: ERP responses to bodies in natural scenes

The N190 is a body-sensitive ERP component that responds to images of human bodies in different poses. In natural settings, bodies vary in posture and appear within complex, cluttered environments, frequently with other people. In many studies, however, such variability is absent. How does the N190 response change when observers see images that incorporate these sources of variability? In two experiments (N = 16 each), we varied the natural appearance of upright and inverted bodies to examine how the N190 amplitude, latency, and the Body-Inversion Effect (BIE) were affected by natural variability. In Experiment 1, we varied the number of people present in upright and inverted naturalistic scenes such that only one body, a subitizable number of bodies, or a "crowd" was present. In Experiment 2, we varied the natural body appearance by presenting bodies either as silhouettes or with photographic detail. Further, we varied the natural background appearance by either removing it or presenting individual bodies within a rich environment. Using component-based analyses of the N190, we found that the number of bodies in a scene reduced the N190 amplitude, but didn't affect the BIE (Experiment 1). Naturalistic body and background appearance (Experiment 2) also affected the N190, such that component amplitude was dramatically reduced by naturalistic appearance. To complement this analysis, we examined the contribution of spatiotemporal features (i.e., electrode × time point amplitude) via SVM decoding. This technique allows us to examine which timepoints across the entire waveform contribute the most to successful decoding of body orientation in each condition. This analysis revealed that later timepoints (after 300ms) contribute most to successful orientation decoding. These results demonstrate that natural appearance variability affects body processing at the N190 and that later ERP components may make important contributions to body processing in natural scenes.

Sensitivity to orientation is not unique to social attention cueing

It is well-established that faces and bodies cue observers’ visuospatial attention; for example, target items are found faster when their location is cued by the directionality of a task-irrelevant face or body. Previous results suggest that these cueing effects are greatly reduced when the orientation of the task-irrelevant stimulus is inverted. It remains unclear, however, whether sensitivity to orientation is a unique hallmark of “social” attention cueing or a more general phenomenon. In the present study, we sought to determine whether the cueing effects produced by common objects (power drills, desk lamps, desk fans, cameras, bicycles, and cars) are also attenuated by inversion. When cueing stimuli were shown upright, all six object classes produced highly significant cueing effects. When shown upside-down, however, the results were mixed. Some of the cueing effects (e.g., those induced by bicycles and cameras) behaved liked faces and bodies: they were greatly reduced by orientation inversion. However, other cueing effects (e.g., those induced by cars and power drills) were insensitive to orientation: upright and inverted exemplars produced significant cueing effects of comparable strength. We speculate that (i) cueing effects depend on the rapid identification of stimulus directionality, and (ii) some cueing effects are sensitive to orientation because upright exemplars of those categories afford faster processing of directionality, than inverted exemplars. Contrary to the view that attenuation-by-inversion is a unique hallmark of social attention, our findings indicate that some non-social cueing effects also exhibit sensitivity to orientation.

Body-Posture Recognition by Undergraduate Students Majoring in Physical Education and Other Disciplines

Humans are more proficient at processing visual display of body posture when the body is in upright orientation, compared to when inverted (inversion effect). Here we investigated whether extensive exposure or expertise on body posture recognition would affect the efficiency with which body-posture is processed. Using whole-body and piecemeal-body postures as stimuli, we performed two experiments to investigate whether body-posture recognition differed between two groups of participants: undergraduates majoring in physical education (PE) and those in other subjects (non-PE), respectively. These two groups differed significantly in the frequency and intensity of exercise per day and/or accumulated exercise time. In our experiments, following initial presentation of an image of a body posture, participants were shown the same or a different stimulus and were asked to report whether or not they had been previously shown the same image. The orientations of the body postures were also varied between trials. Our results showed that, in Experiment 1, for whole-body posture recognition, both the PE and non-PE groups showed a robust body-inversion effect in terms of both error rate and reaction time (RT), but the magnitude of the body-inversion effect in the RT measure was greater in the PE than the non-PE group. In Experiment 2, for piecemeal-body postures, both groups showed the inversion effect in terms of both error rate and RT measures and the PE group made fewer overall errors than the non-PE group. These cumulative results suggest that a superiority effect exists for PE participants compared with non-PE participants. Our results are generally consistent with the expertise hypothesis.

Flexible Orientation Tuning of Visual Representations of Human Body Postures: Evidence From Long-Term Priming

The proficiency of human observers to identify body postures is examined in three experiments. We use a posture decision task in which participants are primed with either anatomically possible or impossible postures (in the latter case the upper and lower body face in opposite directions). In a long-term priming paradigm (i.e., in an initial priming block of trials and a subsequent test phase several minutes later), we manipulate the relation between priming and test postures with respect to the identity of the person in the body postures (Experiment 1), the prototypicality of the depth orientations (Experiment 2), and the variability of the priming orientations (Experiment 3). Reaction time to the test postures is the main dependent variable. In Experiment 1 it is found that priming of postures does not depend on the exact visual appearance of the actor (either same priming and test female or male figure or different figures), supporting the hypothesis that posture priming primarily is determined by the spatial relations between the body parts and much less by characteristics of the person involved. Long-term priming in our paradigm apparently is based on the reactivation of high-level posture representations that make abstraction of the identity of the human figure. In Experiment 2 we observe that privileged or prototypical orientations (e.g., 3/4 views) do not affect long-term priming of body postures. In Experiment 3, we find that increasing or decreasing the variability between the priming and test figures influences reaction time performance. Collectively, these results provide a better understanding of the flexibility (e.g., invariant to identity) and limits (e.g., depending on depth orientation) of the processes supporting human posture recognition.

Body Inversion Effects With Photographic Images of Body Postures: Is It About Faces?

As with faces, participants are better at discriminating upright bodies than inverted bodies. This inversion effect is reliable for whole figures, namely, bodies with heads, but it is less reliable for headless bodies. This suggests that removal of the head disrupts typical processing of human figures, and raises questions about the role of faces in efficient body discrimination. In most studies, faces are occluded, but the aim here was to exclude faces in a more ecologically valid way by presenting photographic images of human figures from behind (about-facing), as well as measuring gaze to different parts of the figures. Participants determined whether pairs of sequentially presented body postures were the same or different for whole and headless figures. Presenting about-facing figures (heads seen from behind) and forward-facing figures with faces enabled a comparison of the effect of the presence or absence of faces. Replicating previous findings, there were inversion effects for forward-facing whole figures, but less reliable effects for headless images. There were also inversion effects for about-facing whole figures, but not about-facing headless figures. Accuracy was higher in the forward- compared to the about-facing conditions, but proportional dwell time was greater to bodies in about-facing images. Likewise, despite better discrimination of forward-facing upright compared to inverted whole figures, participants focused more on the heads and less on the bodies in upright compared to inverted images. However, there was no clear relationship between performance and dwell time proportions to heads. Body inversion effects (BIEs) were found with about-facing whole figures and headless forward-facing figures, despite the absence of faces. With inverted whole figures, there was a significant relationship between performance and greater looking at bodies, and less at heads suggesting that in more difficult conditions a focus on bodies is associated with better discrimination. Overall, the findings suggest that the visual system has greater sensitivity to bodies in their most experienced form, which is typically upright and with a head. Otherwise, the more a face is implied by the context, as in whole figures or forward- rather than about-facing headless bodies, the better the performance as holistic/configural processing is likely stronger.

Early Brain Damage Affects Body Schema and Person Perception Abilities in Children and Adolescents with Spastic Diplegia

Early brain damage leading to cerebral palsy is associated to core motor impairments and also affects cognitive and social abilities. In particular, previous studies have documented specific alterations of perceptual body processing and motor cognition that are associated to unilateral motor deficits in hemiplegic patients. However, little is known about spastic diplegia (SpD), which is characterized by motorial deficits involving both sides of the body and is often associated to visuospatial, attentional, and social perception impairments. Here, we compared the performance of a sample of 30 children and adolescents with SpD (aged 7-18 years) and of a group of age-matched controls with typical development (TD) at two different tasks tapping on body representations. In the first task, we tested visual and motor imagery abilities as assessed, respectively, by the object-based mental rotation of letters and by the first-person transformations for whole-body stimuli. In the second task, we administered an inversion effect/composite illusion task to evaluate the use of configural/holistic processing of others' body. Additionally, we assessed social perception abilities in the SpD sample using the NEPSY-II battery. In line with previously reported visuospatial deficits, a general mental imagery impairment was found in SpD patients when they were engaged in both object-centered and first-person mental transformations. Nevertheless, a specific deficit in operating an own-body transformation emerged. As concerns body perception, while more basic configural processing (i.e., inversion effect) was spared, no evidence for holistic (i.e., composite illusion) body processing was found in the SpD group. NEPSY-II assessment revealed that SpD children were impaired in both the theory of mind and affect recognition subtests. Overall, these findings suggested that early brain lesions and biased embodied experience could affect higher-level motor cognition and perceptual body processing, thus pointing to a strict link between motor deficits, body schema alterations, and person processing difficulties.

Visual perception and spatial transformation of the body in children and adolescents with brain tumor

Representations of own and others' body play a crucial role in social interaction. While extensive knowledge has been gathered on the neuropsychological deficits affecting body representation in adult brain lesion patients, little is known on how acquired damage to a developing brain may affect this process. We tested it on pediatric brain tumor survivors, comparing the abilities of 30 children and adolescents (aged 8-16 years) surviving from a supratentorial tumor (STT) or an infratentorial tumor (ITT) in two different tasks of body representation. Thirty children with typical development (TD) served as control group. In the first task, we tested configural (body inversion effect) and holistic (composite illusion effect) processing of others' bodies. In the second task, we tested the ability to perform first-person and object-based mental spatial transformations of own body and external objects, respectively. Configural processing was spared in all patients. Conversely, ITT, but not STT patients, were impaired in the holistic processing of body stimuli. STT patients performed overall worse than both controls and ITT patients at mental spatial transformations of both own body and external objects. ITT children presented selective alteration in using the first-person transformation strategies with body stimuli. Results suggest that body-representation abilities may be heavily affected in pediatric brain tumor survivors. STTs may be associated to greater difficulties in mental visuo-spatial transformation abilities, likely reflecting damage to fronto-parietal circuits. Conversely, ITTs may be associated to specific disturbances of visual body perception abilities that require motor simulation processes, reflecting direct or indirect damage to cerebellar areas.

Body inversion effect in monkeys

Humans visually process human body images depending on the configuration of the parts. However, little is known about whether this function is evolutionarily shared with nonhuman animals. In this study, we examined the body posture discrimination performance of capuchin monkeys, a highly social platyrrhine primate, in comparison to humans. We demonstrate that, like humans, monkeys exhibit a body inversion effect: body posture discrimination is impaired by inversion, which disrupts the configural relationships of body parts. The inversion effect in monkeys was observed when human body images were used, but not when the body parts were replaced with cubic and cylindrical figures, the positions of the parts were scrambled, or only part of a body was presented. Results in human participants showed similar patterns, though they also showed the inversion effect when the cubic/cylindrical body images were used. These results provide the first evidence for configural processing of body forms in monkeys and suggest that the visual attunement to social signals mediated by body postures is conserved through the evolution of primate vision.

It's Not All About the Face: Variability Reveals Asymmetric Obligatory Processing of Faces and Bodies in Whole-Body Contexts

Researchers have sought to understand the specialized processing of faces and bodies in isolation, but recently they have considered how face and body information interact within the context of the whole body. Although studies suggest that face and body information can be integrated, it remains an open question whether this integration is obligatory and whether contributions of face and body information are symmetrical. In a selective attention task with whole-body stimuli, we focused attention on either the face or body and tested whether variation in the irrelevant part could be ignored. We manipulated orientation to determine the extent to which inversion disrupted obligatory face and body processing. Obligatory processing was evidenced as performance changes in discrimination that depended on stimulus orientation when the irrelevant region varied. For upright but not inverted face discrimination, participants could not ignore body posture variation, even when it was not diagnostic to the task. However, participants could ignore face variation for upright body posture discrimination but not for inverted posture discrimination. The extent to which face and body information necessarily influence each other in whole-body contexts appears to depend on both domain-general attentional and face- or body-specific holistic processing mechanisms.

The perception of (naked only) bodies and faceless heads relies on holistic processing: Evidence from the inversion effect

Faces and bodies are more difficult to perceive when presented inverted than when presented upright (i.e., stimulus inversion effect), an effect that has been attributed to the disruption of holistic processing. The features that can trigger holistic processing in faces and bodies, however, still remain elusive. In this study, using a sequential matching task, we tested whether stimulus inversion affects various categories of visual stimuli: faces, faceless heads, faceless heads in body context, headless bodies naked, whole bodies naked, headless bodies clothed, and whole bodies clothed. Both accuracy and inversion efficiency score results show inversion effects for all categories but for clothed bodies (with and without heads). In addition, the magnitude of the inversion effect for face, naked body, and faceless heads was similar. Our findings demonstrate that the perception of faces, faceless heads, and naked bodies relies on holistic processing. Clothed bodies (with and without heads), on the other side, may trigger clothes-sensitive rather than body-sensitive perceptual mechanisms.

The importance of trunk perception during brace treatment in moderate juvenile idiopathic scoliosis: What is the impact on self-image?

BACKGROUND

The perception of body image and the deformity of the trunk in patients with adolescent idiopathic scoliosis (AIS) are a silver lining that has yet to be discussed in the relevant literature during brace rehabilitation treatment.

OBJECTIVE

To determine whether and how the use of the brace changes perception of the trunk in patients with AIS by the drawing test.

METHODS

We observed 32 subjects with AIS from our Rehabilitation outpatient clinic and divided them into the brace treatment (BG-16 subjects) and the non-brace treatment (CG-16 subjects). Trunk perception and quality of life were evaluated using the Trunk Appearance Perception Scale and Scoliosis Research Society-22 questionnaire, and the perception of one's back was measured by the drawing test.

RESULTS

Pain was lower in BG versus CG (p= 0.095). Satisfaction with the treatment was higher in BG than in CG (p= 0.002). Self-image did not differ significantly between the groups in terms of TAPS. Drawings of the most severe cases of scoliosis were made by the group without the brace.

CONCLUSIONS

The use of the brace corrects the function of the trunk and has a positive influence on its perception.

Modulation of the composite face effect by unintended emotion cues

When upper and lower regions from different emotionless faces are aligned to form a facial composite, observers 'fuse' the two halves together, perceptually. The illusory distortion induced by task-irrelevant ('distractor') halves hinders participants' judgements about task-relevant ('target') halves. This composite-face effect reveals a tendency to integrate feature information from disparate regions of intact upright faces, consistent with theories of holistic face processing. However, observers frequently perceive emotion in ostensibly neutral faces, contrary to the intentions of experimenters. This study sought to determine whether this 'perceived emotion' influences the composite-face effect. In our first experiment, we confirmed that the composite effect grows stronger as the strength of distractor emotion increased. Critically, effects of distractor emotion were induced by weak emotion intensities, and were incidental insofar as emotion cues hindered image matching, not emotion labelling per se. In Experiment 2, we found a correlation between the presence of perceived emotion in a set of ostensibly neutral distractor regions sourced from commonly used face databases, and the strength of illusory distortion they induced. In Experiment 3, participants completed a sequential matching composite task in which half of the distractor regions were rated high and low for perceived emotion, respectively. Significantly stronger composite effects were induced by the high-emotion distractor halves. These convergent results suggest that perceived emotion increases the strength of the composite-face effect induced by supposedly emotionless faces. These findings have important implications for the study of holistic face processing in typical and atypical populations.

Behavioural responses to facial and postural expressions of emotion: An interpersonal circumplex approach

While the recognition of emotional expressions has been extensively studied, the behavioural response to these expressions has not. In the interpersonal circumplex, behaviour is defined in terms of communion and agency. In this study, we examined behavioural responses to both facial and postural expressions of emotion. We presented 101 Romanian students with facial and postural stimuli involving individuals ('targets') expressing happiness, sadness, anger, or fear. Using an interpersonal grid, participants simultaneously indicated how communal (i.e., quarrelsome or agreeable) and agentic (i.e., dominant or submissive) they would be towards people displaying these expressions. Participants were agreeable-dominant towards targets showing happy facial expressions and primarily quarrelsome towards targets with angry or fearful facial expressions. Responses to targets showing sad facial expressions were neutral on both dimensions of interpersonal behaviour. Postural versus facial expressions of happiness and anger elicited similar behavioural responses. Participants responded in a quarrelsome-submissive way to fearful postural expressions and in an agreeable way to sad postural expressions. Behavioural responses to the various facial expressions were largely comparable to those previously observed in Dutch students. Observed differences may be explained from participants' cultural background. Responses to the postural expressions largely matched responses to the facial expressions.

The electrophysiological correlates of integrated face and body-part perception

Previous studies have suggested that the human visual system processes faces and bodies holistically-that is, the different body parts are integrated into a unified representation. However, the time course of this integrative process is less known. In the present study, we investigated this issue by recording event-related potentials evoked by a face and two hands presented simultaneously and in different configurations. When the hands were rotated to obtain a biologically implausible configuration, a reduction of the P2 amplitude was observed relative to the condition in which the face and hands were retained in their veridical configuration and were supplemented with visual cues to highlight further the overall body posture. Our results show that the P2 component is sensitive to manipulations affecting the configuration of face and hand stimuli and suggest that the P2 reflects the operation of perceptual mechanisms responsible for the integrated processing of visually presented body parts.

The whole picture: Holistic body posture recognition in infancy

Holistic processing is tied to expertise and is characteristic of face and body perception by adults. Infants process faces holistically, but it is unknown whether they process body information holistically. In the present study, infants were tested for discrimination between body postures that differed in limb orientations in three conditions: in the context of the whole body, with just the isolated limbs that changed orientation, or with the limbs in the context of scrambled body parts. Five- and 9-month-olds discriminated between whole-body postures, but failed in the isolated-part and scrambled-body conditions, demonstrating holistic processing of information from bodies. These results indicate that at least some level of expertise in body processing develops quite early in life.

Holistic processing for bodies and body parts: New evidence from stereoscopic depth manipulations

Although holistic processing has been documented extensively for upright faces, it is unclear whether it occurs for other visual categories with more extensive substructure, such as body postures. Like faces, body postures have high social relevance, but they differ in having fine-grain organization not only of basic parts (e.g., arm) but also subparts (e.g., elbow, wrist, hand). To compare holistic processing for whole bodies and body parts, we employed a novel stereoscopic depth manipulation that creates either the percept of a whole body occluded by a set of bars, or of segments of a body floating in front of a background. Despite sharing low-level visual properties, only the stimulus perceived as being behind bars should be holistically "filled in" via amodal completion. In two experiments, we tested for better identification of individual body parts within the context of a body versus in isolation. Consistent with previous findings, recognition of body parts was better in the context of a whole body when the body was amodally completed behind occluders. However, when the same bodies were perceived as floating in strips, performance was significantly worse, and not significantly different, from that for amodally completed parts, supporting holistic processing of body postures. Intriguingly, performance was worst for parts in the frontal depth condition, suggesting that these effects may extend from gross body organization to a more local level. These results provide suggestive evidence that holistic representations may not be "all-or-none," but rather also operate on body regions of more limited spatial extent.

Processing emotional body expressions: state-of-the-art

Processing emotional body expressions has become recently an important topic in affective and social neuroscience along with the investigation of facial expressions. The objective of the study is to review the literature on emotional body expressions in order to discuss the current state of knowledge on this topic and identify directions for future research. The following electronic databases were searched: PsychINFO, Ebsco, ERIC, ProQuest, Sagepub, and SCOPUS using terms such as "body," "bodily expression," "body perception," "emotions," "posture," "body recognition" and combinations of them. The synthesis revealed several research questions that were addressed in neuroimaging, electrophysiological and behavioral studies. Among them, one important question targeted the neural mechanisms of emotional processing of body expressions to specific subsections regarding the time course for the integration of emotional signals from face and body, as well as the role of context in the perception of emotional signals. Processing bodily expression of emotion is similar to processing facial expressions, and the holistic processing is extended to the whole person. The current state-of-the-art in processing emotional body expressions may lead to a better understanding of the underlying neural mechanisms of social behavior. At the end of the review, suggestions for future research directions are presented.

Multi-voxel pattern analysis (MVPA) reveals abnormal fMRI activity in both the "core" and "extended" face network in congenital prosopagnosia

The ability to identify faces is mediated by a network of cortical and subcortical brain regions in humans. It is still a matter of debate which regions represent the functional substrate of congenital prosopagnosia (CP), a condition characterized by a lifelong impairment in face recognition, and affecting around 2.5% of the general population. Here, we used functional Magnetic Resonance Imaging (fMRI) to measure neural responses to faces, objects, bodies, and body-parts in a group of seven CPs and ten healthy control participants. Using multi-voxel pattern analysis (MVPA) of the fMRI data we demonstrate that neural activity within the “core” (i.e., occipital face area and fusiform face area) and “extended” (i.e., anterior temporal cortex) face regions in CPs showed reduced discriminability between faces and objects. Reduced differentiation between faces and objects in CP was also seen in the right parahippocampal cortex. In contrast, discriminability between faces and bodies/body-parts and objects and bodies/body-parts across the ventral visual system was typical in CPs. In addition to MVPA analysis, we also ran traditional mass-univariate analysis, which failed to show any group differences in face and object discriminability. In sum, these findings demonstrate (i) face-object representations impairments in CP which encompass both the “core” and “extended” face regions, and (ii) superior power of MVPA in detecting group differences.