Validating the Radboud faces database from a child's perspective

HEADSET: Human Emotion Awareness under Partial Occlusions Multimodal DataSET

The volumetric representation of human interactions is one of the fundamental domains in the development of immersive media productions and telecommunication applications. Particularly in the context of the rapid advancement of Extended Reality (XR) applications, this volumetric data has proven to be an essential technology for future XR elaboration. In this work, we present a new multimodal database to help advance the development of immersive technologies. Our proposed database provides ethically compliant and diverse volumetric data, in particular 27 participants displaying posed facial expressions and subtle body movements while speaking, plus 11 participants wearing head-mounted displays (HMDs). The recording system consists of a volumetric capture (VoCap) studio, including 31 synchronized modules with 62 RGB cameras and 31 depth cameras. In addition to textured meshes, point clouds, and multi-view RGB-D data, we use one Lytro Illum camera for providing light field (LF) data simultaneously. Finally, we also provide an evaluation of our dataset employment with regard to the tasks of facial expression classification, HMDs removal, and point cloud reconstruction. The dataset can be helpful in the evaluation and performance testing of various XR algorithms, including but not limited to facial expression recognition and reconstruction, facial reenactment, and volumetric video. HEADSET and its all associated raw data and license agreement will be publicly available for research purposes.

Implicit assumptions and interpretation bias in youth with severe, chronic social phobia

Interpretation bias and dysfunctional social assumptions are proposed to play a pivotal role in the development and maintenance of social phobia (SP), especially in youth. In this study, we aimed to investigate disorder-specific implicit assumptions of rejection and implicit interpretation bias in youth with severe, chronic SP and healthy controls (CG). Twenty-seven youth with SP in inpatient/day-care treatment (M age = 15.6 years, 74% female) and 24 healthy controls (M age = 15.7 years, 54% female) were included. The Implicit Association Test (IAT) and the Affect Misattribution Procedure (AMP) were completed to assess implicit assumptions and interpretation bias related to the processing of social and affective stimuli. No group differences were observed for the IAT controlling for depressive symptoms in the analyses. However, group differences were found regarding interpretation bias (p = .017, η²_p = .137). Correlations between implicit scores and explicit questionnaire results were medium to large in the SP group (r =|.28| to |.54|, p_all ≤ .05), but lower in the control group (r =|.04| to |.46|, p_all ≤ .05). Our results confirm the finding of an interpretation bias in youth SP, especially regarding the implicit processing of faces, whereas implicit dysfunctional social assumptions of being rejected do not seem to be specific for SP. Future research should investigate the causal relationship of assumptions/interpretation bias and SP.

The impact of briefly observing faces in opaque facial masks on emotion recognition and empathic concern

Since the outbreak of SARS-CoV-2 in 2019, there have been global public health initiatives that have advocated for the community use of face masks to reduce spread of the virus. Although the community use of facial coverings has been deemed essential for public health, there have been calls for enquiries to ascertain how face masks may impact non-verbal methods of communication. This study aimed to ascertain how the brief observations of faces in opaque facial coverings could impact facial emotion recognition. It was also an aim to ascertain if there was an association between the levels of empathic concern and facial emotion recognition when viewing masked faces. An opportunity sample of 199 participants, who resided in the United Kingdom, were randomly assigned to briefly observe either masked (n = 102) or unmasked (n = 97) faces. Participants in both conditions were required to view a series of facial expressions, from the Radboud Faces Database, with models conveying the emotional states of anger, disgust, fear, happiness, sadness, and surprised. Each face was presented to participants for a period of 250 ms in the masked and unmasked conditions. A 6 (emotion type) x 2 (masked/unmasked condition) mixed ANOVA revealed that viewing masked faces significantly reduced facial emotion recognition of disgust, fear, happiness, sadness, and surprised. However, there were no differences in the success rate of recognising the emotional state of anger between the masked and unmasked conditions. Furthermore, higher levels of empathic concern were associated with greater success in facially recognising the emotional state of disgust. The results of this study suggest that significant reductions in emotion recognition, when viewing faces in opaque masks, can still be observed when people are exposed to facial stimuli for a brief period of time.

Face masks impair facial emotion recognition and induce specific emotion confusions

Face masks are now worn frequently to reduce the spreading of the SARS-CoV-2 virus. Their health benefits are undisputable, but covering the lower half of one's face also makes it harder for others to recognize facial expressions of emotions. Three experiments were conducted to determine how strongly the recognition of different facial expressions is impaired by masks, and which emotions are confused with each other. In each experiment, participants had to recognize facial expressions of happiness, sadness, anger, surprise, fear, and disgust, as well as a neutral expression, displayed by male and female actors of the Radboud Faces Database. On half of the 168 trials, the lower part of the face was covered by a face mask. In all experiments, facial emotion recognition (FER) was about 20% worse for masked faces than for unmasked ones (68% correct vs. 88%). The impairment was largest for disgust, followed by fear, surprise, sadness, and happiness. It was not significant for anger and the neutral expression. As predicted, participants frequently confused emotions that share activation of the visible muscles in the upper half of the face. In addition, they displayed response biases in these confusions: They frequently misinterpreted disgust as anger, fear as surprise, and sadness as neutral, whereas the opposite confusions were less frequent. We conclude that face masks do indeed cause a marked impairment of FER and that a person perceived as angry, surprised, or neutral may actually be disgusted, fearful, or sad, respectively. This may lead to misunderstandings, confusions, and inadequate reactions by the perceivers.

We studied how facial masks impair facial emotion recognition.

We used validated actors and facial expressions from the Radboud Faces Database.

Masks impaired recognition of disgust, fear, surprise, sadness, and happiness.

With masks, disgust was often misinterpreted as anger, and fear as surprise.

These results were replicated twice in large samples.

Facial expressions of Asian people exposed to constructed urban forests: Accuracy validation and variation assessment

An outcome of building sustainable urban forests is that people's well-being is improved when they are exposed to trees. Facial expressions directly represents one's inner emotions, and can be used to assess real-time perception. The emergence and change in the facial expressions of forest visitors are an implicit process. As such, the reserved character of Asians requires an instrument rating to accurately recognize expressions. In this study, a dataset was established with 2,886 randomly photographed faces from visitors at a constructed urban forest park and at a promenade during summertime in Shenyang City, Northeast China. Six experts were invited to choose 160 photos in total with 20 images representing one of eight typical expressions: angry, contempt, disgusted, happy, neutral, sad, scared, and surprised. The FireFACE ver. 3.0 software was used to test hit-ratio validation as an accuracy measurement (ac.) to match machine-recognized photos with those identified by experts. According to the Kruskal-Wallis test on the difference from averaged scores in 20 recently published papers, contempt (ac. = 0.40%, P = 0.0038) and scared (ac. = 25.23%, P = 0.0018) expressions do not pass the validation test. Both happy and sad expression scores were higher in forests than in promenades, but there were no difference in net positive response (happy minus sad) between locations. Men had a higher happy score but lower disgusted score in forests than in promenades. Men also had a higher angry score in forests. We conclude that FireFACE can be used for analyzing facial expressions in Asian people within urban forests. Women are encouraged to visit urban forests rather than promenades to elicit more positive emotions.

Recognizing Emotions through Facial Expressions: A Largescale Experimental Study

Experimental research examining emotional processes is typically based on the observation of images with affective content, including facial expressions. Future studies will benefit from databases with emotion-inducing stimuli in which characteristics of the stimuli potentially influencing results can be controlled. This study presents Portuguese normative data for the identification of seven facial expressions of emotions (plus a neutral face), on the Radboud Faces Database (RaFD). The effect of participants’ gender and models’ sex on emotion recognition was also examined. Participants (N = 1249) were exposed to 312 pictures of white adults displaying emotional and neutral faces with a frontal gaze. Recognition agreement between the displayed and participants’ chosen expressions ranged from 69% (for anger) to 97% (for happiness). Recognition levels were significantly higher among women than among men only for anger and contempt. The emotion recognition was higher either in female models or in male models depending on the emotion. Overall, the results show high recognition levels of the facial expressions presented, indicating that the RaFD provides adequate stimuli for studies examining the recognition of facial expressions of emotion among college students. Participants’ gender had a limited influence on emotion recognition, but the sex of the model requires additional consideration.

Social anxiety and perceptions of likeability by peers in children

The current study aimed to investigate the discrepancy between self-reported and peer-reported likeability among children, and the relation with social anxiety, depression, and social support. In total, 532 children between 7 and 12 years completed questionnaires about social anxiety symptoms, depressive symptoms, and social support, estimated their own likeability, and indicated how much they liked their classmates. Children with higher levels of social anxiety or depression overestimated their likeability less or even underestimated their likeability. Social anxiety symptoms, but not depressive symptoms, were significant predictors of the discrepancy. Social support was positively related to likeability and negatively related to social anxiety, but did not moderate the association between social anxiety symptoms and perception accuracy of likeability. These results are in line with cognitive theories of childhood social anxiety, and they stress the importance of using multi-informant measures when studying the relation between social anxiety and social functioning in children.

Content-Specific Interpretation Bias in Children with Varying Levels of Anxiety: The Role of Gender and Age

The current study examined whether children varying in their levels of social anxiety, separation anxiety and spider fear exhibit a negative interpretation bias specific for their fears. Furthermore, age and gender were assessed as moderators of this relation. Children (N = 603) of the age of 7-12 years were asked to solve ambiguous scenarios reflecting social threat, separation threat or spider threat. Children's levels of anxiety were assessed with self-report questionnaires. Results indicated that children scoring higher on self-reported social anxiety, separation anxiety or spider fear, displayed a negative interpretation bias for the threat-scenarios pertaining to their specific anxiety or fear, even after controlling for comorbidity with other anxiety subtypes. Contrary to our hypotheses, we did not find moderating effects of age or gender. These results indicate that even in a community sample, content-specificity of negative interpretation biases is present.