The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers

Reading language of the eyes in female depression

Aberrations in non-verbal social cognition have been reported to coincide with major depressive disorder. Yet little is known about the role of the eyes. To fill this gap, the present study explores whether and, if so, how reading language of the eyes is altered in depression. For this purpose, patients and person-by-person matched typically developing individuals were administered the Emotions in Masked Faces task and Reading the Mind in the Eyes Test, modified, both of which contained a comparable amount of visual information available. For achieving group homogeneity, we set a focus on females as major depressive disorder displays a gender-specific profile. The findings show that facial masks selectively affect inferring emotions: recognition of sadness and anger are more heavily compromised in major depressive disorder as compared with typically developing controls, whereas the recognition of fear, happiness, and neutral expressions remains unhindered. Disgust, the forgotten emotion of psychiatry, is the least recognizable emotion in both groups. On the Reading the Mind in the Eyes Test patients exhibit lower accuracy on positive expressions than their typically developing peers, but do not differ on negative items. In both depressive and typically developing individuals, the ability to recognize emotions behind a mask and performance on the Reading the Mind in the Eyes Test are linked to each other in processing speed, but not recognition accuracy. The outcome provides a blueprint for understanding the complexities of reading language of the eyes within and beyond the COVID-19 pandemic.

Herpertz S, Fuchs T. Emotion recognition in autism spectrum condition during the COVID-19 pandemic

LAY ABSTRACT

In the COVID-19 pandemic, wearing face masks became mandatory to prevent the spread of the virus. However, they restrict the ability to recognize emotions to the upper part of the face. Since individuals with autism spectrum condition often tend to look at the lower half of the face, they may be particularly restricted in emotion recognition by people wearing masks, since they are now forced to look at the upper half of the face. The current study compared the recognition of facially expressed emotions between individuals with and without autism spectrum condition. Each photo was shown in three types, once uncovered, once with face mask, and once with sunglasses. Our results revealed a reduction in accuracy of individuals with autism spectrum condition at recognizing emotions in all three stimulus types and exhibited more difficulties distinguishing anger, fear, pride, and embarrassment. During the emotion recognition task, there was no difference in which facial areas the groups looked at. We did not find evidence that the disadvantages of individuals with autism spectrum condition in emotion recognition were due to looking at different areas of the face.

Masked emotions: does children's affective state influence emotion recognition?

Introduction

Facial emotion recognition abilities of children have been the focus of attention across various fields, with implications for communication, social interaction, and human behavior. In response to the COVID-19 pandemic, wearing a face mask in public became mandatory in many countries, hindering social information perception and emotion recognition. Given the importance of visual communication for children's social-emotional development, concerns have been raised on whether face masks could impair their ability to recognize emotions and thereby possibly impact their social-emotional development.

Methods

To this extent, a quasiexperimental study was designed with a two-fold objective: firstly, to identify children's accuracy in recognizing basic emotions (anger, happiness, fear, disgust, sadness) and emotional neutrality when presented with faces under two conditions: one with no-masks and another with faces partially covered by various types of masks (medical, nonmedical, surgical, or cloth); secondly, to explore any correlation between children's emotion recognition accuracy and their affective state. Sixty-nine (69) elementary school students aged 6-7 years old from Greece were recruited for this purpose. Following specific requirements of the second phase of the experiment students were assigned to one of three (3) distinct affective condition groups: Group A-Happiness, Group B-Sadness, and Group C-Emotional Neutrality. Image stimuli were drawn from the FACES Dataset, and students' affective state was registered using the self-reporting emotions-registration tool, AffectLecture app.

Results

The study's findings indicate that children can accurately recognize emotions even with masks, although recognizing disgust is more challenging. Additionally, following both positive and negative affective state priming promoted systematic inaccuracies in emotion recognition. Most significantly, results showed a negative bias for children in negative affective state and a positive bias for those in positive affective state.

Discussion

Children's affective state significantly influenced their emotion recognition abilities; sad affective states led to lower recognition overall and a bias toward recognizing sad expressions, while happy affective states resulted in a positive bias, improving recognition of happiness, and affecting how emotional neutrality and sadness were actually perceived. In conclusion, this study sheds light on the intriguing dynamics of how face masks affect children's emotion recognition, but also underlines the profound influence of their affective state.

Face Feature Change Detection Ability in Developmental Prosopagnosia and Super-Recognisers

In non-clinical populations, facial features (eyes, nose, mouth) may vary in their contribution to face identity perception. Changes to whole faces are easier to detect than changes to individual features, and eye changes are typically easier to detect than mouth changes, which in turn are easier to detect than nose changes. However, how this differs for people with face recognition difficulties (developmental prosopagnosia; DP) and for individuals with superior face recognition abilities (super-recognisers; SR) is not clear; although findings from previous studies have suggested differences, the nature of this difference is not understood. The aim of this study was to examine whether differences in the ability to detect feature changes in DPs and SRs were (a) quantitative, meaning that the pattern across feature changes remained the same but there was an overall upwards or downwards shift in performance, or (b) qualitative, meaning that the pattern across feature changes was different. Using a change detection task in which individual face features (eyes, nose, mouth) changed between sequentially presented faces, we found that while prosopagnosics showed a quantitative difference in performance with a downwards shift across all conditions, super-recognisers only showed qualitative differences: they were better able to detect when the face was the same and were marginally (but not non-significantly) worse at detecting when the eyes changed. Further, the only condition which distinguished between the three groups was the ability to identify when the same face was presented, with SRs being better than controls, and controls being better than DPs. Our findings suggest that, in feature-matching tasks, differences for DPs are due to them being overall worse at the task, while SRs use a qualitatively different strategy.

Does wearing a mask promote consumer uniqueness seeking?

As a motivational factor, uniqueness drives individuals to seek and choose unique goods or experiences. The act of wearing masks obscures individuals' facial features and influences their desire for uniqueness. This study aims to explore how wearing masks promotes individual uniqueness- seeking behavior. Three experiments were performed using various product categories (Starbucks coffee cups, sweatshirts, suitcases, and baseball caps) and sample types (college student and adult samples). Experiment results show that wearing masks obscures individuals' facial features and weakens their self- perceived uniqueness, thereby increasing their willingness to actively purchase unique products. This study is the first to examine the effect of wearing masks on individuals' choice of unique products. Practically, the results suggest that customized products can compensate for the lack of self-perceived uniqueness brought about by facial occlusion, thus providing valuable guidance for companies and retailers that offer customized services in formulating and designing marketing strategies.

Decoding face recognition abilities in the human brain

Why are some individuals better at recognizing faces? Uncovering the neural mechanisms supporting face recognition ability has proven elusive. To tackle this challenge, we used a multimodal data-driven approach combining neuroimaging, computational modeling, and behavioral tests. We recorded the high-density electroencephalographic brain activity of individuals with extraordinary face recognition abilities-super-recognizers-and typical recognizers in response to diverse visual stimuli. Using multivariate pattern analyses, we decoded face recognition abilities from 1 s of brain activity with up to 80% accuracy. To better understand the mechanisms subtending this decoding, we compared representations in the brains of our participants with those in artificial neural network models of vision and semantics, as well as with those involved in human judgments of shape and meaning similarity. Compared to typical recognizers, we found stronger associations between early brain representations of super-recognizers and midlevel representations of vision models as well as shape similarity judgments. Moreover, we found stronger associations between late brain representations of super-recognizers and representations of the artificial semantic model as well as meaning similarity judgments. Overall, these results indicate that important individual variations in brain processing, including neural computations extending beyond purely visual processes, support differences in face recognition abilities. They provide the first empirical evidence for an association between semantic computations and face recognition abilities. We believe that such multimodal data-driven approaches will likely play a critical role in further revealing the complex nature of idiosyncratic face recognition in the human brain.

Face masks and fake masks: the effect of real and superimposed masks on face matching with super-recognisers, typical observers, and algorithms

Mask wearing has been required in various settings since the outbreak of COVID-19, and research has shown that identity judgements are difficult for faces wearing masks. To date, however, the majority of experiments on face identification with masked faces tested humans and computer algorithms using images with superimposed masks rather than images of people wearing real face coverings. In three experiments we test humans (control participants and super-recognisers) and algorithms with images showing different types of face coverings. In all experiments we tested matching concealed or unconcealed faces to an unconcealed reference image, and we found a consistent decrease in face matching accuracy with masked compared to unconcealed faces. In Experiment 1, typical human observers were most accurate at face matching with unconcealed images, and poorer for three different types of superimposed mask conditions. In Experiment 2, we tested both typical observers and super-recognisers with superimposed and real face masks, and found that performance was poorer for real compared to superimposed masks. The same pattern was observed in Experiment 3 with algorithms. Our results highlight the importance of testing both humans and algorithms with real face masks, as using only superimposed masks may underestimate their detrimental effect on face identification.

Accuracy and Speed of Emotion Recognition With Face Masks

Wearing face masks is one of the important actions to prevent the spread of COVID-19 among people around the world. Nevertheless, social interaction is limited via masks, and this impacts the accuracy and speed of emotional perception. In the present study, we assess the impact of mask-wearing on the accuracy and speed of emotion recognition. Fifty people (female n = 39, male n = 11) aged 19-28 participated in the study (M = 21.1 years). We used frontal photos of a Kosova woman who belonged to the same participants' age group, with a grey background. Twelve different pictures were used that showed the emotional states of fear, joy, sadness, anger, neutrality, and disgust, in masked and unmasked conditions. The experiment was conducted in a controlled laboratory setting. Participants were faster for identifying emotions like joy (1.507 ms) and neutral (1.971 ms). The participants were more accurate (emotions identification) in unmasked faces (M = 85.7%) than in masked faces (M = 73.8%), F(1,98) = 20.73, MSE = 1027.66, p ≤ .001, partial η² = 0.17. Masks make confusion and reduce the accuracy and speediness of emotional detection. This may have a notable impact on social interactions among peoples.

A positive side effect of wearing face coverings for socially anxious females: Findings from a speech task

Background

Wearing face masks has become more common due to the COVID-19 pandemic. Until now, it has not been investigated whether socially anxious individuals can reduce their acute anxiety symptoms by wearing face masks during a speech task.

Method

Fifty-nine socially anxious females were asked to prepare and give an oral presentation. Participants were randomly allocated either to a group that was asked to wear a face mask during the task, or to a group that was not asked to wear a face mask during the task. Dependent variables included physiological parameters (systolic/diastolic blood pressure, heart rate) and self-reports (valence and arousal at baseline, as well as directly before and after the presentation).

Results

The analyses showed that the group without face masks had a higher systolic blood pressure than the group with face masks, directly before as well as after the presentation. The two groups did not differ in the other measures.

Conclusion

Wearing face masks has a small stress-reducing effect on socially anxious females.

The semantics of gaze in person perception: a novel qualitative-quantitative approach

Interpreting gaze behavior is essential in evaluating interaction partners, yet the 'semantics of gaze' in dynamic interactions are still poorly understood. We aimed to comprehensively investigate effects of gaze behavior patterns in different conversation contexts, using a two-step, qualitative-quantitative procedure. Participants watched video clips of single persons listening to autobiographic narrations by another (invisible) person. The listener's gaze behavior was manipulated in terms of gaze direction, frequency and direction of gaze shifts, and blink frequency; emotional context was manipulated through the valence of the narration (neutral/negative). In Experiment 1 (qualitative-exploratory), participants freely described which states and traits they attributed to the listener in each condition, allowing us to identify relevant aspects of person perception and to construct distinct rating scales that were implemented in Experiment 2 (quantitative-confirmatory). Results revealed systematic and differential meanings ascribed to the listener's gaze behavior. For example, rapid blinking and fast gaze shifts were rated more negatively (e.g., restless and unnatural) than slower gaze behavior; downward gaze was evaluated more favorably (e.g., empathetic) than other gaze aversion types, especially in the emotionally negative context. Overall, our study contributes to a more systematic understanding of flexible gaze semantics in social interaction.

Face coverings increase apparent honesty and cooperativeness

People readily make inferences about trait-like characteristics of another person's face. Since the recent global COVID-19 pandemic, the widespread use of hygienic face masks has led to large proportions of the face being covered. We investigated the effect of face masks on the inference of prosocially relevant characteristics, namely cooperativeness and honesty. Portraits of participants of previous studies from which we knew their "true" prosocial tendencies served as stimuli. These facial stimuli were presented once with and once without a hygienic face mask to 60 naïve participants who rated the faces for cooperativeness and honesty. Results revealed that wearing face masks made people generally appear more cooperative and more honest than without a mask, but that these ratings were unrelated to the true prosocial tendencies of these people. Together, these findings have important implications for social interactions, particularly in contexts where nonverbal communication is essential, such as in healthcare settings, job interviews, and social gatherings.

Recognition of facial expressions in autism: Effects of face masks and alexithymia

It is often assumed that the recognition of facial expressions is impaired in autism. However, recent evidence suggests that reports of expression recognition difficulties in autistic participants may be attributable to co-occurring alexithymia-a trait associated with difficulties interpreting interoceptive and emotional states-not autism per se. Due to problems fixating on the eye-region, autistic individuals may be more reliant on information from the mouth region when judging facial expressions. As such, it may be easier to detect expression recognition deficits attributable to autism, not alexithymia, when participants are forced to base expression judgements on the eye-region alone. To test this possibility, we compared the ability of autistic participants (with and without high levels of alexithymia) and non-autistic controls to categorise facial expressions (a) when the whole face was visible, and (b) when the lower portion of the face was covered with a surgical mask. High-alexithymic autistic participants showed clear evidence of expression recognition difficulties: they correctly categorised fewer expressions than non-autistic controls. In contrast, low-alexithymic autistic participants were unimpaired relative to non-autistic controls. The same pattern of results was seen when judging masked and unmasked expression stimuli. In sum, we find no evidence for an expression recognition deficit attributable to autism, in the absence of high levels of co-occurring alexithymia, either when participants judge whole-face stimuli or just the eye-region. These findings underscore the influence of co-occurring alexithymia on expression recognition in autism.

The impact of stability in appearance on the development of facial representations

The way faces become familiar and what information is represented as familiarity develops has puzzled researchers in the field of human face recognition for decades. In this paper, we present three experiments serving as proof of concept for a cost-efficient mechanism of face learning describing how facial representations form over time and accounting for recognition errors. We propose that the encoding of facial information is dynamic and modulated by the intrinsic stability in individual faces' appearance. We drew on a robust and ecological method using a proxy of exposure to famous faces in the real world and manipulated test images to assess the prediction that recognition of famous faces is affected by their relative stability in appearance. We consistently show that stable facial appearances (like Tom Cruise's) facilitate recognition in early stages of familiarisation but that performance does not improve much over time. In contrast, variations in appearance (like Jared Leto's) hinder recognition at first but improve performance with further media exposure. This pattern of results is consistent with the proposed cost-efficient face learning mechanism whereby facial representations build on a foundation of large-scale diagnostic information and refine over time if needed. When coarse information loses its diagnostic value through the experience of variations in appearance across encounters, diagnostic facial details and/or their spatial relationships must receive more weights, leading to refined representations that are more discriminative and reliable than representations of stable faces.

Emotions behind a mask: the value of disgust

The impact of face masks on social cognition and interaction became a popular topic due to the long-lasting COVID-19 pandemic. This theme persists in the focus of attention beyond the pandemic, since face covering not only reduces the overall amount of face information available but also introduces biases and prejudices affecting social perception at large. Many questions are still open. One of them is whether gender of beholders affects inferring of emotions covered by face masks. Reading covered faces may be particularly challenging for individuals with mental disorders, most of which are gender-specific. Previous findings are not only sparse, but inconclusive because most research had been conducted online with resulting samples heavily dominated by females. Here in a face-to-face study, females and males were presented with a randomized set of faces covered by masks. In a two-alternative forced-choice paradigm, participants had to indicate facial emotions displayed by posers. In general, the outcome dovetails with earlier findings that face masks affect emotion recognition in a dissimilar way: Inferring some emotions suffers more severely than others, with the most pronounced influence of mask wearing on disgust and close to ceiling recognition of fear and neutral expressions. Contrary to our expectations, however, males were on overall more proficient in emotion recognition. In particular, males substantially excelled in inferring disgust. The findings help to understand gender differences in recognition of disgust, the forgotten emotion of psychiatry, that is of substantial value for a wide range of mental disorders including schizophrenia. Watch Prof. Marina Pavlova discussing this her work and this article: https://vimeo.com/860126397/5966610f49?share=copy .

Robust holistic face processing in early childhood during the COVID-19 pandemic

The timing of the developmental emergence of holistic face processing and its sensitivity to experience in early childhood are somewhat controversial topics. To investigate holistic face perception in early childhood, we used an online testing platform and administered a two-alternative forced-choice task to 4-, 5-, and 6-year-old children. The children saw pairs of composite faces and needed to decide whether the faces were the same or different. To determine whether experience with masked faces may have negatively affected holistic processing, we also administered a parental questionnaire to assess the children's exposure to masked faces during the COVID-19 pandemic. We found that all three age groups performed holistic face processing when the faces were upright (Experiment 1) but not when the faces were inverted (Experiment 2), that response accuracy increased with age, and that response accuracy was not related to degree of exposure to masked faces. These results indicate that holistic face processing is relatively robust in early childhood and that short-term exposure to partially visible faces does not negatively affect young children's holistic face perception.

Hidden faces, altered perceptions: the impact of face masks on interpersonal perception

The pandemic has made wearing masks commonplace, prompting researchers to investigate their effects on interpersonal perception. Findings indicate masks obstruct face identification and expression recognition, with lower face cues being most affected. When judging attractiveness, masks can enhance the appeal of less attractive faces, but reduce the appeal of more attractive faces. Trust and speech perception outcomes are inconclusive. Future studies could focus on individual differences in how masks influence our perception of others.

Face coverings differentially alter valence judgments of emotional expressions

Face masks that prevent disease transmission obscure facial expressions, impairing nonverbal communication. We assessed the impact of lower (masks) and upper (sunglasses) face coverings on emotional valence judgments of clearly valenced (fearful, happy) and ambiguously valenced (surprised) expressions, the latter of which have both positive and negative meaning. Masks, but not sunglasses, impaired judgments of clearly valenced expressions compared to faces without coverings. Drift diffusion models revealed that lower, but not upper, face coverings slowed evidence accumulation and affected differences in non-judgment processes (i.e., stimulus encoding, response execution time) for all expressions. Our results confirm mask-interference effects in nonverbal communication. The findings have implications for nonverbal and intergroup communication, and we propose guidance for implementing strategies to overcome mask-related interference.

Face masks are less effective than sunglasses in masking face identity

The effect of covering faces on face identification is recently garnering interest amid the COVID-19 pandemic. Here, we investigated how face identification performance was affected by two types of face disguise: sunglasses and face masks. Observers studied a series of faces; then judged whether a series of test faces, comprising studied and novel faces, had been studied before or not. Face stimuli were presented either without coverings (full faces), wearing sunglasses covering the upper region (eyes, eyebrows), or wearing surgical masks covering the lower region (nose, mouth, chin). We found that sunglasses led to larger reductions in sensitivity (d') to face identity than face masks did, while both disguises increased the tendency to report faces as studied before, a bias that was absent for full faces. In addition, faces disguised during either study or test only (i.e. study disguised faces, test with full faces; and vice versa) led to further reductions in sensitivity from both studying and testing with disguised faces, suggesting that congruence between study and test is crucial for memory retrieval. These findings implied that the upper region of the face, including the eye-region features, is more diagnostic for holistic face-identity processing than the lower face region.

Facemasks selectively impair the recognition of facial expressions that stimulate empathy: An ERP study

Previous research suggests that masks disrupt expression recognition, but the neurophysiological implications of this phenomenon are poorly understood. In this study, 26 participants underwent EEG/ERP recording during the recognition of six masked/unmasked facial expressions. An emotion/word congruence paradigm was used. Face-specific N170 was significantly larger to masked than unmasked faces. The N400 component was larger for incongruent faces, but differences were more substantial for positive emotions (especially happiness). Anterior P300 (reflecting workload) was larger to masked than unmasked faces, while posterior P300 (reflecting categorization certainty) was larger to unmasked than masked faces, and to angry faces. Face masking was more detrimental to sadness, fear, and disgust than positive emotions, such as happiness. In addition, mask covering did not impair the recognition of angry faces, as the wrinkled forehead and frowning eyebrows remained visible. Overall, facial masking polarized nonverbal communication toward the happiness/anger dimension, while minimizing emotions that stimulate an empathic response.

Facial expression modifies female body perception

The judgment of female body appearance has been reported to be affected by a range of internal (e.g., viewers' sexual cognition) and external factors (e.g., viewed clothing type and colour). This eye-tracking study aimed to complement previous research by examining the effect of facial expression on female body perception and associated body-viewing gaze behaviour. We presented female body images of Caucasian avatars in a continuum of common dress sizes posing seven basic facial expressions (neutral, happiness, sadness, anger, fear, surprise, and disgust), and asked both male and female participants to rate the perceived body attractiveness and body size. The analysis revealed an evident modulatory role of avatar facial expressions on body attractiveness and body size ratings, but not on the amount of viewing time directed at individual body features. Specifically, happy and angry avatars attracted the highest and lowest body attractiveness ratings, respectively, and fearful and surprised avatars tended to be rated slimmer. Interestingly, the impact of facial expression on female body assessment was not further influenced by viewers' gender, suggesting a 'universal' role of common facial expressions in modifying the perception of female body appearance.

Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People

Current artificial intelligence systems for determining a person's emotions rely heavily on lip and mouth movement and other facial features such as eyebrows, eyes, and the forehead. Furthermore, low-light images are typically classified incorrectly because of the dark region around the eyes and eyebrows. In this work, we propose a facial emotion recognition method for masked facial images using low-light image enhancement and feature analysis of the upper features of the face with a convolutional neural network. The proposed approach employs the AffectNet image dataset, which includes eight types of facial expressions and 420,299 images. Initially, the facial input image's lower parts are covered behind a synthetic mask. Boundary and regional representation methods are used to indicate the head and upper features of the face. Secondly, we effectively adopt a facial landmark detection method-based feature extraction strategy using the partially covered masked face's features. Finally, the features, the coordinates of the landmarks that have been identified, and the histograms of the oriented gradients are then incorporated into the classification procedure using a convolutional neural network. An experimental evaluation shows that the proposed method surpasses others by achieving an accuracy of 69.3% on the AffectNet dataset.

Effect of mask coverage on face identification in Taiwanese men and women

Mask wearing is the easiest and most effective way to avoid COVID-19 infection; however, it affects interpersonal activities, especially face identification. This study examined the effects of three mask coverage levels (full coverage, FC; coverage up to the middle [MB] or bottom of the nose bridge [BB]) on face identification accuracy and time. A total of 115 university students (60 men and 55 women) were recruited to conduct a computer-based simulation test consisting of 30 questions (10 questions [five face images each of men and women] for the three mask coverage levels). One unmasked target face and four face images with a specified mask coverage level were designed for each question, and the participants were requested to select the same face from the four covered face images on the basis of the target face. The ANOVA results indicated that identification accuracy was significantly affected by sex (p < 0.01) and the mask coverage level (p < 0.001), whereas identification time was only influenced by sex (p < 0.05). The multiple comparison results indicated that the identification accuracy rate for faces wearing a mask with FC (90.3%) was significantly lower than for those wearing masks with coverage up to the MB (93.7%) and BB (94.9%) positions; however, no difference in identification accuracy rate was observed between the MB and BB levels. Women exhibited a higher identification accuracy rate than men (94.1% vs. 91.9%) in identifying unfamiliar faces, even though they may spend less time identifying the images. A smaller mask coverage level (i.e., the BB level) does not facilitate face identification. The findings can be served as a reference for people to trade-off between wearing a mask and interpersonal interaction in their daily activities.

Occlusion of faces by sanitary masks improves facial attractiveness of other races

Recent studies provide mixed results regarding whether the perception of facial attractiveness is increased or decreased by partial occlusion with a sanitary mask. One set of studies demonstrated that occluding the bottom half of a face increased facial attractiveness. This effect is thought to occur because the occluded area is interpolated by an average facial representation that is perceived as attractive. However, several groups of studies showed that partial occlusion can increase or decrease perceived attractiveness depending on the attractiveness of the original (unoccluded) face, due to regression to the mean. To reconcile this inconsistency, we propose that the occluded area is interpolated not by an average facial representation, but by a template of moderate attractiveness, shaped by the distribution of each viewer's experience. This hypothesis predicts an interaction between occlusion and the attractiveness of the original face so that occluded attractive faces are rated as less attractive, while occluded unattractive faces are rated as more attractive. To examine this hypothesis, the present study used attractiveness-rating tasks with mask-free versus masked faces in own-race and other-races categories. Viewers were familiar with own-race faces and unfamiliar with other-races faces. If moderate-attractiveness interpolation were the explanatory factor, the interaction between the occlusion and the attractiveness of the original face should be found only in the rating of own-race faces. Consistent with this hypothesis, the interaction between the occlusion and the attractiveness of the original faces was significant only for the own-race faces. Specifically, wearing a sanitary mask decreased the facial attractiveness of attractive faces in the own-race, while it increased the attractiveness regardless of the level of facial attractiveness in other-races. These findings suggest that the occluded area of own-race faces is interpolated by a facial template of moderate attractiveness. The other-races template could be developed using familiar exemplars such as celebrities. Thus, interpolation by such a template should result in elevated attractiveness relative to that by an own-race template. Accordingly, the apparent inconsistency in the literature regarding the effect of partial occlusion on physical attractiveness can be explained in terms of differences in the template involving interpolation of the occluded area.

The impact of face masks on infants' learning of faces: An eye tracking study

This preregistered study examined how face masks influenced face memory in a North American sample of 6- to 9-month-old infants (N = 58) born during the COVID-19 pandemic. Infants' memory was tested using a standard visual paired comparison (VPC) task. We crossed whether or not the faces were masked during familiarization and test, yielding four trial types (masked-familiarization/masked-test, unmasked-familiarization/masked-test, masked-familiarization/unmasked-test, and unmasked-familiarization/unmasked-test). Infants showed memory for the faces if the faces were unmasked at test, regardless of whether or not the face was masked during familiarization. However, infants did not show robust evidence of memory when test faces were masked, regardless of the familiarization condition. In addition, infants' bias for looking at the upper (eye) region was greater for masked than unmasked faces, although this difference was unrelated to memory performance. In summary, although the presence of face masks does appear to influence infants' processing of and memory for faces, they can form memories of masked faces and recognize those familiar faces even when unmasked.

Wearing face masks impairs dyadic micro-activities in nonverbal social encounter: A mixed-methods first-person study on the sense of I and Thou

The COVID-19 pandemic has manifold negative consequences for people around the world, of which the psychosocial ones have been rather underrepresented in the public eye. Regarding social distancing measures, there is already some experimental work demonstrating that the use of face masks has detrimental effects on various aspects of social cognition such as emotion reading, face identification, and perceived closeness of persons. However, while these findings provide important clues, they do not shed light on what people experience when interacting in real life in a masked society. Therefore, in critical distance to cognitivist accounts and taking Direct Social Perception (DSP) approaches seriously, we developed a first-person experimental design and conducted a study with thirty-four participants in a dyadic setting with two conditions (without vs. with face mask). Data were analyzed with mixed methods including in-depth qualitative coding at three levels, code relations analyses, and various statistical tests. Results yielded significant differences across conditions at all qualitative levels, comprising, for example, expressive behavior, and, in particular, significant decreases of content-independent, complimentary mental micro-activities. In the context of DSP, we argue in the paper that these activities suggest the constitution of a quasi-sensory modality - conceived as I-Thou sense - that oscillates between strongly and weakly embodied mental activities, as the analyses show. In sum, this study suggests that mask-wearing impairs both functional directions of mental activity in relation to more or less embodied experience and thus intervenes deeply in fundamental processes of social perception and interaction.

Two face masks are better than one: congruency effects in face matching

Although the positive effects of congruency between stimuli are well replicated in face memory paradigms, mixed findings have been found in face matching. Due to the current COVID-19 pandemic, face masks are now very common during daily life outdoor activities. Thus, the present study aims to further explore congruency effects in matching faces partially occluded by surgical masks. Observers performed a face matching task consisting of pairs of faces presented in full view (i.e., full-view condition), pairs of faces in which only one of the faces had a mask (i.e., one-mask condition), and pairs of faces in which both faces had a mask (i.e., two-mask condition). Although face masks disrupted performance in identity match and identity mismatch trials, in match trials, we found better performance in the two-mask condition compared to the one-mask condition. This finding highlights the importance of congruency between stimuli on face matching when telling faces together.

Face masks have a limited effect on the feeling of being looked at

Introduction

Wearing face masks has been promoted as an effective measure to reduce the spread of COVID-19. Because face masks cover a major part of the face, they have detrimental effects on various aspects of social cognition. Yet, a highly important feature of the face is not occluded by face masks: the eyes. The eyes play an important role in social interactions: knowing where another person is looking is of central importance when interacting with others. Recent research has reported an attentional shift toward the eye region as a consequence of the widespread exposure to face masks. However, no study has yet investigated the influence of face masks on the perception of eye gaze direction. Here we investigated whether face masks have an effect on the feeling of being looked at. Assuming an attentional shift toward the eyes, we might expect more accurate gaze perception in faces wearing face masks.

Methods

Sixty-five participants decided for a series of realistic avatar faces whether each face was making eye contact or not. Half of the faces wore face masks, the other half did not. For each participant and separately for each condition (mask vs. no mask), we calculated the cone of direct gaze (CoDG), a commonly used measure to quantify the range of gaze angles within which an observer assumes mutual gaze.

Results

Contrary to our expectations, results show that mutual gaze is not recognized more accurately in masked faces. Rather, the CoDG was, on average, slightly wider for faces wearing masks compared to faces without masks.

Discussion

Notwithstanding the relatively small effect of face mask, these findings potentially have implications on our social interactions. If we inadvertently feel looked at by an onlooker, we may react inappropriately by reciprocating the alleged approach orientation.

Masked face is looking at me: Face mask increases the feeling of being looked at during the COVID-19 pandemic

Background

As the COVID-19 global pandemic unfolded, governments recommended wearing face masks as a protective measure. Recent studies have found that a face mask influences perception; but how it affects social perception, especially the judgment of being looked at, is still unknown. This study investigated how wearing a mask influences the judgment of gaze direction by conducting a cone of direct gaze (CoDG) task.

Methods

In Experiment 1, three types of masked faces were considered to investigate whether the effect of masks on CoDG is modulated by mask types. Experiment 2 was to further validate the results of Experiment 1 by adding a learning phase to help participants better distinguish N95 and surgical masks. Furthermore, to investigate whether the effect of masks derives from its social significance, a face with only the eye-region (a mouth-cut face) was used as the stimuli in Experiment 3.

Results

The results of Experiment 1 found that wearing masks widens the CoDG, irrespective of the mask type. Experiment 2 replicated the results of Experiment 1. Experiment 3 found that the CoDG of N95-masked faces was wider than the mouth-cut and non-masked faces, while no significant difference existed between the CoDG of mouth-cut and non-masked faces, illustrating that the influence of wearing masks on CoDG was due to high-level social significance rather than low-level facial feature information.

Conclusion

The results show that face mask increases the feeling of being looked at during the COVID-19 Pandemic. The present findings are of significance for understanding the impact of wearing masks on human social cognition in the context of COVID-19.

Facial mask disturbs ocular exploration but not pupil reactivity

Introduction

The COVID-19 pandemic has imposed to wear a face mask that may have negative consequences for social interactions despite its health benefits. A lot of recent studies focused on emotion recognition of masked faces, as the mouth is, with the eyes, essential to convey emotional content. However, none have studied neurobehavioral and neurophysiological markers of masked faces perception, such as ocular exploration and pupil reactivity. The purpose of this eye tracking study was to quantify how wearing a facial accessory, and in particular a face mask, affected the ocular and pupillary response to a face, emotional or not.

Methods

We used videos of actors wearing a facial accessory to characterize the visual exploration and pupillary response in several occlusion (no accessory, sunglasses, scarf, and mask) and emotional conditions (neutral, happy, and sad) in a population of 44 adults.

Results

We showed that ocular exploration differed for face covered with an accessory, and in particular a mask, compared to the classical visual scanning pattern of a non-covered face. The covered areas of the face were less explored. Pupil reactivity seemed only slightly affected by the mask, while its sensitivity to emotions was observed even in the presence of a facial accessory.

Discussion

These results suggest a mixed impact of the mask on attentional capture and physiological adjustment, which does not seem to be reconcilable with its strong effect on behavioral emotional recognition previously described.

The influence of face mask on social spaces depends on the behavioral immune system

Interacting with objects and people requires specifying localized spaces where these interactions can take place. Previous studies suggest that the space for interacting with objects (i.e., the peripersonal space) contributes to defining the space for interacting with people (i.e., personal and interpersonal spaces). Furthermore, situational factors, such as wearing a face mask, have been shown to influence social spaces, but how they influence the relation between action and social spaces and are modulated by individual factors is still not well understood. In this context, the present study investigated the relationship between action peripersonal and social personal and interpersonal spaces in participants approached by male and female virtual characters wearing or not wearing a face mask. We also measured individual factors related to the behavioral immune system, namely willingness to take risks, perceived infectability and germ aversion. The results showed that compared to peripersonal space, personal space was smaller and interpersonal space was larger, but the three spaces were positively correlated. All spaces were altered by gender, being shorter when participants faced female characters. Personal and interpersonal spaces were reduced with virtual characters wearing a face mask, especially in participants highly aversive to risks and germs. Altogether, these findings suggest that the regulation of the social spaces depends on the representation of action peripersonal space, but with an extra margin that is modulated by situational and personal factors in relation to the behavioral immune system.

Face masks drive increased rational decision-making

Face masks play a pivotal role in the control of respiratory diseases, such as the novel coronavirus (COVID-19). Despite their widespread use, little is known about how face masks affect human social interaction. Using unique experimental data collected early on in the pandemic, we investigate how facial occlusion by face masks alters socio-economic exchange. In a behavioral economics study (N = 481), individuals accepted more monetary offers and lower offer amounts when interacting with a masked versus unmasked opponent. Importantly, this effect was mainly driven by faces covered with surgical masks relative to bandana-type masks. In the first weeks of mask use during the COVID-19 pandemic, motive attributions further moderated this effect: Participants who believed that mask wearers were seeking to protect others showed the highest acceptance rates. Overall, we describe a new phenomenon, the face-mask effect on socio-economic exchange, and show that it is modulated by contextual factors.

Face mask use as a categorical dimension in social perception

Prevention measures aimed at combating COVID-19 pandemic strongly impact several aspects of social life. In particular, interpersonal perception is affected as a function of whether the persons perceived wear or not face masks. In two experimental studies, we here explored whether people rely on the presence vs. absence of face masks when encoding information in memory about other individuals. In a memory confusion paradigm, participants were initially presented with individuals either wearing a face mask or not, each conveying a series of sentences. Next, participants were probed about the identity of the speaker of each sentence. Results showed that it was more likely to erroneously attribute a sentence to a speaker who also was wearing a face mask (or not) as the original speaker, demonstrating that the cue about wearing or not a face mask was spontaneously used to encode information. Study 2 ruled out an alternative explanation based on perceptual processes, suggesting that face masks represent meaningful social objects. Overall, it emerged that participants spontaneously categorize others as a function of whether they wear a mask or not. Findings also confirmed previous research evidence about the more positive evaluation of mask wearers as compared to non-wearers, and the overall detrimental impact that face masks may have on the correct identification of social targets.

Preferential looking studies of trustworthiness detection confound structural and expressive cues to facial trustworthiness

On encountering a stranger, we spontaneously attribute to them character traits (e.g., trustworthiness, intelligence) based on their facial appearance. Participants can base impressions on structural face cues-the stable aspects of facial appearance that support identity recognition-or expression cues, such as the presence of a smile. It has been reported that 6- to 8-month-old infants attend to faces that adults judge to be trustworthy in preference to faces judged untrustworthy. These results are striking because the face stimuli employed were ostensibly emotion neutral. Consequently, these preferential looking effects have been taken as evidence for innate sensitivity to structural face cues to trustworthiness. However, scrutiny of the emotion rating procedure used with adults suggests that the face stimuli employed may have been judged emotion neutral only when interleaved with more obvious examples of facial affect. This means that the faces may vary in emotional expression when compared to each other. Here, we report new evidence obtained from adult raters that the stimuli used in these studies confound trustworthiness and untrustworthiness with the presence of happiness and anger, respectively. These findings suggest that the preferential looking effects described in infants are compatible with a preference for positive facial affect and may not reflect early sensitivity to structural face cues to trustworthiness.

Face masks affect emotion categorisation, age estimation, recognition, and gender classification from faces

Although putting on a mask over our nose and mouth is a simple but powerful way to protect ourselves and others during a pandemic, face masks may interfere with how we perceive and recognize one another, and hence, may have far-reaching impacts on communication and social interactions. To date, it remains relatively unknown the extent to which wearing a face mask that conceals the bottom part of the face affects the extraction of different facial information. To address this question, we compared young adults' performance between masked and unmasked faces in four different tasks: (1) emotion recognition task, (2) famous face recognition and naming test, (3) age estimation task, and (4) gender classification task. Results revealed that the presence of face mask has a negative impact on famous face recognition and emotion recognition, but to a smaller extent on age estimation and gender classification tasks. More interestingly, we observed a female advantage in the famous face recognition and emotion recognition tasks and a female own-gender bias in gender categorisation and age estimation tasks. Overall, these findings allude to the lack of malleability of the adulthood face recognition and perceptual systems.

Detecting a familiar person behind the surgical mask: recognition without identification among masked versus sunglasses-covered faces

Previous research has shown that even when famous people’s identities cannot be discerned from faces that have been filtered with monochromatic noise, these unidentifiable famous faces still tend to receive higher familiarity ratings than similarly filtered non-famous faces. Experiment 1 investigated whether a similar face recognition without identification effect would occur among faces whose identification was hindered through the wearing of a surgical mask. Among a mixture of famous and non-famous faces wearing surgical masks and hoods, participants rated how familiar each person seemed then attempted to identify the person. Though surgical masks significantly impaired identification of the famous faces, unidentified masked famous faces received higher familiarity ratings on average than the non-famous masked faces, suggesting that a sense of familiarity could still occur even when identification was impaired by the mask. Experiment 2 compared faces covered by surgical masks with faces covered by sunglasses. Though sunglasses impaired face identification more than surgical masks, the magnitude of the face recognition without identification effect was the same in both cases. This pattern suggests that holistic face processing is not a requirement for the sense of familiarity with a face, and that different facial feature types can contribute.

I looked at you, you looked at me, I smiled at you, you smiled at me—The impact of eye contact on emotional mimicry

Eye contact is an essential element of human interaction and direct eye gaze has been shown to have effects on a range of attentional and cognitive processes. Specifically, direct eye contact evokes a positive affective reaction. As such, it has been proposed that obstructed eye contact reduces emotional mimicry (i.e., the imitation of our counterpart’s emotions). So far, emotional mimicry research has used averted-gaze faces or unnaturally covered eyes (with black censor bars) to analyze the effect of eye contact on emotional mimicry. However, averted gaze can also signal disinterest/ disengagement and censor bars obscure eye-adjacent areas as well and hence impede emotion recognition. In the present study (N = 44), we used a more ecological valid approach by showing photos of actors who expressed either happiness, sadness, anger, or disgust while either wearing mirroring sunglasses that obstruct eye contact or clear glasses. The glasses covered only the direct eye region but not the brows, nose ridge, and cheeks. Our results confirm that participants were equally accurate in recognizing the emotions of their counterparts in both conditions (sunglasses vs. glasses). Further, in line with our hypotheses, participants felt closer to the targets and mimicked affiliative emotions more intensely when their counterparts wore glasses instead of sunglasses. For antagonistic emotions, we found the opposite pattern: Disgust mimicry, which was interpreted as an affective reaction rather than genuine mimicry, could be only found in the sunglasses condition. It may be that obstructed eye contact increased the negative impression of disgusted facial expressions and hence the negative feelings disgust faces evoked. The present study provides further evidence for the notion that eye contact is an important prerequisite for emotional mimicry and hence for smooth and satisfying social interactions.

COVID-19 masks: A barrier to facial and vocal information

With the COVID-19 pandemic, we have become used to wearing masks and have experienced how masks seem to impair emotion and speech recognition. While several studies have focused on facial emotion recognition by adding images of masks on photographs of emotional faces, we have created a video database with actors really wearing masks to test its effect in more ecological conditions. After validating the emotions displayed by the actors, we found that surgical mask impaired happiness and sadness recognition but not neutrality. Moreover, for happiness, this effect was specific to the mask and not to covering the lower part of the face, possibly due to a cognitive bias associated with the surgical mask. We also created videos with speech and tested the effect of mask on emotion and speech recognition when displayed in auditory, visual, or audiovisual modalities. In visual and audiovisual modalities, mask impaired happiness and sadness but improved neutrality recognition. Mask impaired the recognition of bilabial syllables regardless of modality. In addition, it altered speech recognition only in the audiovisual modality for participants above 70 years old. Overall, COVID-19 masks mainly impair emotion recognition, except for older participants for whom it also impacts speech recognition, probably because they rely more on visual information to compensate age-related hearing loss.

How facial masks alter the interaction of gaze direction, head orientation, and emotion recognition

The COVID-19 pandemic has altered the way we interact with each other: mandatory mask-wearing obscures facial information that is crucial for emotion recognition. Whereas the influence of wearing a mask on emotion recognition has been repeatedly investigated, little is known about the impact on interaction effects among emotional signals and other social signals. Therefore, the current study sought to explore how gaze direction, head orientation, and emotional expression interact with respect to emotion perception, and how these interactions are altered by wearing a face mask. In two online experiments, we presented face stimuli from the Radboud Faces Database displaying different facial expressions (anger, fear, happiness, neutral, and sadness), gaze directions (−13°, 0°, and 13°), and head orientations (−45°, 0°, and 45°) – either without (Experiment 1) or with mask (Experiment 2). Participants categorized the displayed emotional expressions. Not surprisingly, masks impaired emotion recognition. Surprisingly, without the mask, emotion recognition was unaffected by averted head orientations and only slightly affected by gaze direction. The mask strongly interfered with this ability. The mask increased the influence of head orientation and gaze direction, in particular for the emotions that were poorly recognized with mask. The results suggest that in case of uncertainty due to ambiguity or absence of signals, we seem to unconsciously factor in extraneous information.

Mapping the perception-space of facial expressions in the era of face masks

With the advent of the severe acute respiratory syndrome-Corona Virus type 2 (SARS-CoV-2) pandemic, the theme of emotion recognition from facial expressions has become highly relevant due to the widespread use of face masks as one of the main devices imposed to counter the spread of the virus. Unsurprisingly, several studies published in the last 2 years have shown that accuracy in the recognition of basic emotions expressed by faces wearing masks is reduced. However, less is known about the impact that wearing face masks has on the ability to recognize emotions from subtle expressions. Furthermore, even less is known regarding the role of interindividual differences (such as alexithymic and autistic traits) in emotion processing. This study investigated the perception of all the six basic emotions (anger, disgust, fear, happiness, sadness, and surprise), both as a function of the face mask and as a function of the facial expressions’ intensity (full vs. subtle) in terms of participants’ uncertainty in their responses, misattribution errors, and perceived intensity. The experiment was conducted online on a large sample of participants (N = 129). Participants completed the 20-item Toronto Alexithymia Scale and the Autistic Spectrum Quotient and then performed an emotion-recognition task that involved face stimuli wearing a mask or not, and displaying full or subtle expressions. Each face stimulus was presented alongside the Geneva Emotion Wheel (GEW), and participants had to indicate what emotion they believed the other person was feeling and its intensity using the GEW. For each combination of our variables, we computed the indices of ‘uncertainty’ (i.e., the spread of responses around the correct emotion category), ‘bias’ (i.e., the systematic errors in recognition), and ‘perceived intensity’ (i.e., the distance from the center of the GEW). We found that face masks increase uncertainty for all facial expressions of emotion, except for fear when intense, and that disgust was systematically confused with anger (i.e., response bias). Furthermore, when faces were covered by the mask, all the emotions were perceived as less intense, and this was particularly evident for subtle expressions. Finally, we did not find any evidence of a relationship between these indices and alexithymic/autistic traits.

Smiling makes you look older, even when you wear a mask: the effect of face masks on age perception

The widespread use of face masks in the era of the Covid-19 pandemic has promoted research on their effect on the perception and recognition of faces. There is growing evidence that masks hinder the recognition of identity and expression, as well as the interpretation of speech from facial cues. It is less clear whether and in what manner masks affect the perception of age from facial cues. Recent research has emphasized the role of the upper region of the face, a part not covered by a mask, in the evaluation of age. For example, smile-related wrinkles in the region of the eyes make smiling faces appear older than neutral faces of the same individuals (the aging effect of smiling, AES). In two experiments, we tested the effect of face masks on age evaluations of neutral and smiling faces in a range of different age groups from 20 to 80 years. The results showed that smiling faces were perceived as older than neutral faces even when individuals were wearing a face mask—and there was no effect of masks on bias in age evaluations. Additional analyses showed reduced accuracy in age evaluations for smiling compared to neutral faces and for masked compared to unmasked faces. The results converge on previous studies emphasizing the importance of the upper region of the face in evaluations of age.

Face masks impair facial emotion recognition and induce specific emotion confusions

Face masks are now worn frequently to reduce the spreading of the SARS-CoV-2 virus. Their health benefits are undisputable, but covering the lower half of one's face also makes it harder for others to recognize facial expressions of emotions. Three experiments were conducted to determine how strongly the recognition of different facial expressions is impaired by masks, and which emotions are confused with each other. In each experiment, participants had to recognize facial expressions of happiness, sadness, anger, surprise, fear, and disgust, as well as a neutral expression, displayed by male and female actors of the Radboud Faces Database. On half of the 168 trials, the lower part of the face was covered by a face mask. In all experiments, facial emotion recognition (FER) was about 20% worse for masked faces than for unmasked ones (68% correct vs. 88%). The impairment was largest for disgust, followed by fear, surprise, sadness, and happiness. It was not significant for anger and the neutral expression. As predicted, participants frequently confused emotions that share activation of the visible muscles in the upper half of the face. In addition, they displayed response biases in these confusions: They frequently misinterpreted disgust as anger, fear as surprise, and sadness as neutral, whereas the opposite confusions were less frequent. We conclude that face masks do indeed cause a marked impairment of FER and that a person perceived as angry, surprised, or neutral may actually be disgusted, fearful, or sad, respectively. This may lead to misunderstandings, confusions, and inadequate reactions by the perceivers.

We studied how facial masks impair facial emotion recognition.

We used validated actors and facial expressions from the Radboud Faces Database.

Masks impaired recognition of disgust, fear, surprise, sadness, and happiness.

With masks, disgust was often misinterpreted as anger, and fear as surprise.

These results were replicated twice in large samples.

Adult Age Differences in Using Information From the Eyes and Mouth to Make Decisions About Others' Emotions

OBJECTIVES

Older adults are often less accurate than younger counterparts at identifying emotions such as anger, sadness, and fear from faces. They also look less at the eyes and more at the mouth during emotion perception. The current studies advance understanding of the nature of these age effects on emotional processing.

METHODS

Younger and older participants identified emotions from pictures of eyes or mouths (Experiment 1) and incongruent mouth-eyes emotion combinations (Experiment 2). In Experiment 3, participants categorized emotions from pictures in which face masks covered the mouth region.

RESULTS

Older adults were worse than young at identifying anger and sadness from eyes, but better at identifying the same emotions from the mouth region (Experiment 1) and they were more likely than young to use information from the mouth to classify anger, fear, and disgust (Experiment 2). In Experiment 3, face masks impaired perception of anger, sadness, and fear more for older compared to younger adults.

DISCUSSION

These studies indicate that older people are more able than young to interpret emotional information from the mouth, they are more biased to use information from the mouth, and suffer more difficulty in emotion perception when the mouth is covered with a face mask. This has implications for social communication in different age groups.

Wearing the face mask affects our social attention over space

Recent studies suggest that covering the face inhibits the recognition of identity and emotional expressions. However, it might also make the eyes more salient, since they are a reliable index to orient our social and spatial attention. This study investigates (1) whether the pervasive interaction with people with face masks fostered by the COVID-19 pandemic modulates the processing of spatial information essential to shift attention according to other’s eye-gaze direction (i.e., gaze-cueing effect: GCE), and (2) whether this potential modulation interacts with motor responses (i.e., Simon effect). Participants were presented with face cues orienting their gaze to a congruent or incongruent target letter location (gaze-cueing paradigm) while wearing a surgical mask (Mask), a patch (Control), or nothing (No-Mask). The task required to discriminate the identity of the lateralized target letters by pressing one of two lateralized response keys, in a corresponding or a non-corresponding position with respect to the target. Results showed that GCE was not modulated by the presence of the Mask, but it occurred in the No-Mask condition, confirming previous studies. Crucially, the GCE interacted with Simon effect in the Mask and Control conditions, though in different ways. While in the Mask condition the GCE emerged only when target and response positions corresponded (i.e., Simon-corresponding trials), in the Control condition it emerged only when they did not correspond (i.e., Simon-non-corresponding trials). These results indicate that people with face masks induce us to jointly orient our visual attention in the direction of the seen gaze (GCE) in those conditions resembling (or associated with) a general approaching behavior (Simon-corresponding trials). This is likely promoted by the fact that we tend to perceive wearing the mask as a personal safety measure and, thus, someone wearing the face mask is perceived as a trustworthy person. In contrast, people with a patch on their face can be perceived as more threatening, therefore inducing a GCE in those conditions associated with a general avoidance behavior (Simon-non-corresponding trials).

Are Face Masks a Problem for Emotion Recognition? Not When the Whole Body Is Visible

The rise of the novel COVID-19 virus has made face masks commonplace items around the globe. Recent research found that face masks significantly impair emotion recognition on isolated faces. However, faces are rarely seen in isolation and the body is also a key cue for emotional portrayal. Here, therefore, we investigated the impact of face masks on emotion recognition when surveying the full body. Stimuli expressing anger, happiness, sadness, and fear were selected from the BEAST stimuli set. Masks were added to these images and participants were asked to recognize the emotion and give a confidence level for that decision for both the masked and unmasked stimuli. We found that, contrary to some work viewing faces in isolation, emotion recognition was generally not impaired by face masks when the whole body is present. We did, however, find that when viewing masked faces, only the recognition of happiness significantly decreased when the whole body was present. In contrast to actual performance, confidence levels were found to decline during the Mask condition across all emotional conditions. This research suggests that the impact of masks on emotion recognition may not be as pronounced as previously thought, as long as the whole body is also visible.

Surgical face masks do not impair the decoding of facial expressions of negative affect more severely in older than in younger adults

Surgical face masks reduce the spread of airborne pathogens but also disturb the flow of information between individuals. The risk of getting seriously ill after infection with SARS-COV-2 during the present COVID-19 pandemic amplifies with age, suggesting that face masks should be worn especially during face-to-face contact with and between older people. However, the ability to accurately perceive and understand communication signals decreases with age, and it is currently unknown whether face masks impair facial communication more severely in older people. We compared the impact of surgical face masks on dynamic facial emotion recognition in younger (18–30 years) and older (65–85 years) adults (N = 96) in an online study. Participants watched short video clips of young women who facially expressed anger, fear, contempt or sadness. Faces of half of the women were covered by a digitally added surgical face mask. As expected, emotion recognition accuracy declined with age, and face masks reduced emotion recognition accuracy in both younger and older participants. Unexpectedly, the effect of face masks did not differ between age groups. Further analyses showed that masks also reduced the participants’ overall confidence in their emotion judgements, but not their performance awareness (the difference between their confidence ratings for correct and incorrect responses). Again, there were no mask-by-age interactions. Finally, data obtained with a newly developed questionnaire (attitudes towards face masks, atom) suggest that younger and older people do not differ in how much they feel impaired in their understanding of other people’s emotions by face masks or how useful they find face masks in confining the COVID-19 pandemic. In sum, these findings do not provide evidence that the impact of face masks on the decoding of facial signals is disproportionally larger in older people.

A neural signature of exposure to masked faces after 18 months of COVID-19

In the last two years, face-to-face interactions have drastically changed worldwide, because of the COVID-19 pandemic: the persistent use of masks has had the advantage of reducing viral transmission, but it has also had the cost of impacting on the perception and recognition of social information from faces, especially emotions. To assess the cerebral counterpart to this condition, we carried out an EEG experiment, extracting Event-Related Potentials (ERPs) evoked by emotional faces with and without surgical masks. Besides the expected impairment in emotion recognition in both accuracy and response times, also the classical face-related ERPs (N170 and P2) are altered by the presence of surgical masks. Importantly, the effect is stronger in individuals with a lower daily exposure to masks, suggesting that the brain must adapt to an extra constraint in decoding social input, due to masks hiding crucial facial information.