Even subtle cultural differences affect face tuning

Do subtle cultural differences sculpt face pareidolia?

Face tuning to non-face images such as shadows or grilled toasts is termed face pareidolia. Face-pareidolia images represent a valuable tool for investigation of social cognition in mental disorders. Here we examined (i) whether, and, if so, how face pareidolia is affected by subtle cultural differences; and (ii) whether this impact is modulated by gender. With this purpose in mind, females and males from Northern Italy were administered a set of Face-n-Thing images, photographs of objects such as houses or waves to a varying degree resembling a face. Participants were presented with pareidolia images with canonical upright orientation and display inversion that heavily affects face pareidolia. In a two-alternative forced-choice paradigm, beholders had to indicate whether each image resembled a face. The outcome was compared with the findings obtained in the Southwest of Germany. With upright orientation, neither cultural background nor gender affected face pareidolia. As expected, display inversion generally mired face pareidolia. Yet, while display inversion led to a drastic reduction of face impression in German males as compared to females, in Italians, no gender differences were found. In a nutshell, subtle cultural differences do not sculpt face pareidolia, but instead affect face impression in a gender-specific way under unusual viewing conditions. Clarification of the origins of these effects requires tailored brain imaging work. Implications for transcultural psychiatry, in particular, for schizophrenia research, are highlighted and discussed.

Face pareidolia in male schizophrenia

Faces are valuable signals for efficient social interaction. Yet, social cognition including the sensitivity to a coarse face scheme may be deviant in schizophrenia (SZ). Tuning to faces in non-face images such as shadows, grilled toasts, or ink blots is termed face pareidolia. This phenomenon is poorly investigated in SZ. Here face tuning was assessed in 44 male participants with SZ and person-by-person matched controls by using recently created Face-n-Thing images (photographs of non-face objects to a varying degree resembling a face). The advantage of these images is that single components do not automatically trigger face processing. Participants were administered a set of images with upright and inverted (180° in the image plane) orientation. In a two-alternative forced-choice paradigm, they had to indicate whether an image resembled a face. The findings showed that: (i) With upright orientation, SZ patients exhibited deficits in face tuning: they provided much fewer face responses than controls. (ii) Inversion generally hindered face pareidolia. However, while in neurotypical males, inversion led to a drastic drop in face impression, in SZ, the impact of orientation was reduced. (iii) Finally, in accord with the signal detection theory analysis, the sensitivity index (d-prime) was lower in SZ, whereas no difference occurred in decision criterion. The outcome suggests altered face pareidolia in SZ is caused by lower face sensitivity rather than by alterations in cognitive bias. Comparison of these findings with earlier evidence confirms that tuning to social signals is lower in SZ, and warrants tailored brain imaging research.

Neural circuits underpinning face tuning in male depression

Reading bodies and faces is essential for efficient social interactions, though it may be thought-provoking for individuals with depression. Yet aberrations in the face sensitivity and underwriting neural circuits are not well understood, in particular, in male depression. Here, we use cutting-edge analyses of time course and dynamic topography of gamma oscillatory neuromagnetic cortical activity during administration of a task with Arcimboldo-like images. No difference in face tuning was found between individuals with depression and their neurotypical peers. Furthermore, this behavioral outcome nicely dovetails with magnetoencephalographic data: at early processing stages, the gamma oscillatory response to images resembling a face was rather similar in patients and controls. These bursts originated primarily from the right medioventral occipital cortex and lateral occipital cortex. At later processing stages, however, its topography altered remarkably in depression with profound engagement of the frontal circuits. Yet the primary difference in depressive individuals as compared with their neurotypical peers occurred over the left middle temporal cortices, a part of the social brain, engaged in feature integration and meaning retrieval. The outcome suggests compensatory recruitment of neural resources in male depression.

Acquired Prosopagnosia with Structurally Intact and Functional Fusiform Face Area and with Face Identity-Specific Configuration Processing Deficits

Prosopagnosia or loss of face perception and recognition is still poorly understood and rare single cases of acquired prosopagnosia can provide a unique window on the behavioural and brain basis of normal face perception. The present study of a new case of acquired prosopagnosia with bilateral occipito-temporal lesions but a structurally intact FFA and OFA investigated whether the lesion overlapped with the face network and whether the structurally intact FFA showed a face selective response. We also investigated the behavioral correlates of the neural findings and assessed configural processing in the context of facial and non-facial identity recognition, expression recognition and memory, also focusing on the face-selectivity of each specific deficit. The findings reveal a face-selective response in the FFA, despite lesions in the face perception network. At the behavioural level, the results showed impaired configural processing for facial identity, but not for other stimulus categories and not for facial expression recognition. These findings challenge a critical role of the FFA for face identity processing and support a domain-specific account of configural processing.

Social cognition in individuals born preterm

Faces hold a substantial value for effective social interactions and sharing. Covering faces with masks, due to COVID-19 regulations, may lead to difficulties in using social signals, in particular, in individuals with neurodevelopmental conditions. Daily-life social participation of individuals who were born preterm is of immense importance for their quality of life. Here we examined face tuning in individuals (aged 12.79 ± 1.89 years) who were born preterm and exhibited signs of periventricular leukomalacia (PVL), a dominant form of brain injury in preterm birth survivors. For assessing the face sensitivity in this population, we implemented a recently developed experimental tool, a set of Face-n-Food images bordering on the style of Giuseppe Arcimboldo. The key benefit of these images is that single components do not trigger face processing. Although a coarse face schema is thought to be hardwired in the brain, former preterms exhibit substantial shortages in the face tuning not only compared with typically developing controls but also with individuals with autistic spectrum disorders. The lack of correlations between the face sensitivity and other cognitive abilities indicates that these deficits are domain-specific. This underscores impact of preterm birth sequelae for social functioning at large. Comparison of the findings with data in individuals with other neurodevelopmental and neuropsychiatric conditions provides novel insights into the origins of deficient face processing.

Face Tuning in Depression

The latest COVID-19 pandemic reveals that unexpected changes elevate depression bringing people apart, but also calling for social sharing. Yet the impact of depression on social cognition and functioning is not well understood. Assessment of social cognition is crucial not only for a better understanding of major depressive disorder (MDD), but also for screening, intervention, and remediation. Here by applying a novel experimental tool, a Face-n-Food task comprising a set of images bordering on the Giuseppe Arcimboldo style, we assessed the face tuning in patients with MDD and person-by-person matched controls. The key benefit of these images is that single components do not trigger face processing. Contrary to common beliefs, the outcome indicates that individuals with depression express intact face responsiveness. Yet, while in depression face sensitivity is tied with perceptual organization, in typical development, it is knotted with social cognition capabilities. Face tuning in depression, therefore, may rely upon altered behavioral strategies and underwriting brain mechanisms. To exclude a possible camouflaging effect of female social skills, we examined gender impact. Neither in depression nor in typical individuals had females excelled in face tuning. The outcome sheds light on the origins of the face sensitivity and alterations in social functioning in depression and mental well-being at large. Aberrant social functioning in depression is likely to be the result of deeply-rooted maladaptive strategies rather than of poor sensitivity to social signals. This has implications for mental well-being under the current pandemic conditions.

Do you see the “face”? Individual differences in face pareidolia

People tend to see faces from non-face objects or meaningless patterns. Such illusory face perception is called face pareidolia. Previous studies have revealed an interesting fact that there are huge individual differences in face pareidolia experience among the population. Here, we review previous findings on individual differences in face pareidolia experience from four categories: sex differences, developmental factors, personality traits and neurodevelopmental factors. We further discuss underlying cognitive or neural mechanisms to explain why some perceive the objects as faces while others do not. The individual differences in face pareidolia could not only offer scientific insights on how the brain works to process face information, but also suggest potential clinical applications.

Face pareidolia in the brain: Impact of gender and orientation

Research on face sensitivity is of particular relevance during the rapidly evolving Covid-19 pandemic leading to social isolation, but also calling for intact interaction and sharing. Humans possess high sensitivity even to a coarse face scheme, seeing faces in non-face images where real faces do not exist. The advantage of non-face images is that single components do not trigger face processing. Here by implementing a novel set of Face-n-Thing images, we examined (i) how face tuning alters with changing display orientation, and (ii) whether it is affected by observers’ gender. Young females and males were presented with a set of Face-n-Thing images either with canonical upright orientation or inverted 180° in the image plane. Face impression was substantially impeded by display inversion. Furthermore, whereas with upright display orientation, no gender differences were found, with inversion, Face-n-Thing images elicited face impression in females significantly more often. The outcome sheds light on the origins of the face inversion effect in general. Moreover, the findings open a way for examination of face sensitivity and underwriting brain networks in neuropsychiatric conditions related to the current pandemic (such as depression and anxiety), most of which are gender/sex-specific.

Do I trust you when you smile? Effects of sex and emotional expression on facial trustworthiness appraisal

Background

Trust is a prerequisite for successful social relations. People tend to form a first impression of people‘s trustworthiness based on their facial appearance. The sex of the judging person and its congruency with the sex of the judged people influence these appraisals. Moreover, trustworthiness and happiness share some facial features, which has led to studies investigating the interplay between both social judgments. Studies revealed high correlation in judging happiness and trustworthiness across different facial identities. However, studies are missing that investigate whether this relationship exists on a within-subject level and whether in-group biases such as the congruency between the sex of the judging and judged individual influence this relationship. In the present study, we addressed these questions.

Methods

Data were collected in an online-survey in two separate samples (N = 30, German sample, N = 107 Dutch sample). Subjects assessed the intensity of happiness and trustworthiness expressed in neutral and calm facial expression of the same characters (50% males, 50% females). Statistical analyses comprised rm-Anova designs based on rating scores and estimates of within-subject associations between both judgments.

Results

Our findings replicate high correlations between happiness and trustworthiness ratings across facial identities based on average scores across participants. However, the strength of this association was strongly dependent on the methodological approach and inter-subject variability was high. Our data revealed an in-group advantage for trustworthiness in women. Moreover, the faces’ sex and emotional expressions differentially influenced the within-subject correlation between both judgments in men and women.

Conclusion

Our findings replicate previous studies on the association between happiness and trustworthiness judgments. We extend our understanding of the link between both social judgments by uncovering that within-subject variability is high and influenced by sex and the availability and appraisal of positive emotional facial cues.

Face pareidolia in schizophrenia

BACKGROUND

Faces convey valuable daily life social signals. As in most psychiatric conditions, non-verbal social cognition or its components including face processing may be aberrant in schizophrenia (SZ). Social participation of individuals with SZ is vital for their quality of life, and remediation of social abilities in this population is of high relevance both for society and clinical care.

METHOD

Tuning to faces in non-face images such as shadows, grilled toasts, or ink blots is called face pareidolia. Humans possess high sensitivity to facial signals: even fetuses and infants are well tuned to coarse face cues. Here we assessed face tuning in individuals with SZ and person-by-person matched controls by using a new experimental tool, a set of food-plate images bordering on the Giuseppe Arcimboldo style. The key benefit of these images is that single components do not trigger face processing.

RESULTS AND CONCLUSIONS

The outcome indicates that individuals with SZ exhibit aberrant face tuning in face-like non-face images (χ²(1) = 17.44, p = 0.0001) that can hamper adaptive interaction with peers and social participation hindering, in turn, clinical remediation. Face response rate in SZ patients was related to the scores on the event arrangement task tapping social cognition (Pearson product-moment correlation, r = 0.602, p = 0.01) and on picture completion task assessing visual perceptual organization (Spearman's rho = 0.614, p = 0.009). Therefore, poor performance on the face tuning task is unlikely to be accounted for by deviant general cognitive abilities, but rather by impairments in perceptual integration and social cognition. Comparison of these findings with data in autism and other neuropsychiatric conditions provides novel insights on the origins of face tuning in SZ and triggers brain imaging research.

Social Cognition in Down Syndrome: Face Tuning in Face-Like Non-Face Images

Individuals with Down syndrome (DS) are widely believed to possess considerable socialization strengths. However, the findings on social cognition capabilities are controversial. In the present study, we investigated whether individuals with DS exhibit shortage in face tuning, one of the indispensable components of social cognition. For this purpose, we implemented a recently developed Face-n-Food paradigm with food-plate images composed of food ingredients such as fruits and vegetables. The key benefit of such face-like non-face images is that single elements do not facilitate face processing. In a spontaneous recognition task, 25 children with DS aged 9 to 18 years were presented with a set of Face-n-Food images bordering on the Giuseppe Arcimboldo style. The set of images was administered in a predetermined order from the least to most resembling a face. In DS individuals, thresholds for recognition of the Face-n-Food images as a face were drastically higher as compared not only with typically developing controls, but also with individuals with autistic spectrum disorders and Williams-Beuren syndrome. This outcome represents a significant step toward better conceptualization of the visual social world in DS and neurodevelopmental disorders in general.