The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers

Transparent masks reduce the negative impact of opaque masks on understanding emotional states but not on sharing them

While face masks provide necessary protection against disease spread, they occlude the lower face parts (chin, mouth, nose) and consequently impair the ability to accurately perceive facial emotions. Here we examined how wearing face masks impacted making inferences about emotional states of others (i.e., affective theory of mind; Experiment 1) and sharing of emotions with others (i.e., affective empathy; Experiment 2). We also investigated whether wearing transparent masks ameliorated the occlusion impact of opaque masks. Participants viewed emotional faces presented within matching positive (happy), negative (sad), or neutral contexts. The faces wore opaque masks, transparent masks, or no masks. In Experiment 1, participants rated the protagonists’ emotional valence and intensity. In Experiment 2, they indicated their empathy for the protagonist and the valence of their emotion. Wearing opaque masks impacted both affective theory of mind and affective empathy ratings. Compared to no masks, wearing opaque masks resulted in assumptions that the protagonist was feeling less intense and more neutral emotions. Wearing opaque masks also reduced positive empathy for the protagonist and resulted in more neutral shared valence ratings. Wearing transparent masks restored the affective theory of mind ratings but did not restore empathy ratings. Thus, wearing face masks impairs nonverbal social communication, with transparent masks able to restore some of the negative effects brought about by opaque masks. Implications for the theoretical understanding of socioemotional processing as well as for educational and professional settings are discussed.

The effects of face coverings, own-ethnicity biases, and attitudes on emotion recognition

As a result of the COVID-19 pandemic, face coverings were introduced as a safety measure in certain environments in England and some research suggests that they can affect emotion recognition. Factors such as own-ethnicity bias (e.g. whether people perceiving and expressing emotions are of the same ethnicity) and social biases are also known to influence emotion recognition. However, it is unclear whether these factors interact with face coverings to affect emotion recognition. Therefore, this study examined the effects of face coverings, own-ethnicity biases, and attitudes on emotion recognition accuracy. In this study, 131 participants viewed masked and unmasked emotional faces varying in ethnicity and completed a questionnaire on their attitudes towards face masks. We found that emotion recognition was associated with masks and attitudes: accuracy was lower in masked than unmasked conditions and attitudes towards masks Inside and Outside were associated with emotion recognition. However, a match between perceiver and stimulus ethnicity did not have a significant effect on emotion recognition. Ultimately, our results suggest that masks, and negative attitudes towards them, were associated with poorer emotion recognition. Future research should explore different mask-wearing behaviours and possible in-group/out-group biases and their interaction with other social cues (e.g. in-group biases).

Mask wearing affects emotion perception

To reduce the spread of COVID-19, mask wearing has become ubiquitous in much of the world. We studied the extent to which masks impair emotion recognition and dampen the perceived intensity of facial expressions by naturalistically inducing positive, neutral, and negative emotions in individuals while they were masked and unmasked. Two groups of online participants rated the emotional intensity of each presented image. One group rated full faces (N=104); the other (N=102) rated cropped images where only the upper face was visible. We found that masks impaired the recognition of and rated intensity of positive emotions. This happened even when the faces were cropped and the lower part of the face was not visible. Masks may thus reduce positive emotion and/or expressivity of positive emotion. However, perception of negativity was unaffected by masking, perhaps because unlike positive emotions like happiness which are signaled more in the mouth, negative emotions like anger rely more on the upper face.

The Recognition of Facial Expressions Under Surgical Masks: The Primacy of Anger

Background

The need to wear surgical masks in everyday life has drawn the attention of psychologists to the negative effects of face covering on social processing. A recent but not homogeneous literature has highlighted large costs in the ability to recognize emotions.

Methods

Here it was investigated how mask covering impaired the recognition of facial mimicry in a large group of 220 undergraduate students. Sex differences in emotion recognition were also analyzed in two subgroups of 94 age-matched participants. Subjects were presented with 112 pictures displaying the faces of eight actors (4 women and 4 men) wearing or not wearing real facemasks, and expressing seven emotional states (neutrality, surprise, happiness, sadness, disgust, anger and fear). The task consisted in categorizing facial expressions while indicating the emotion recognizability with a 3-point Likert scale. Scores underwent repeated measures ANOVAs.

Results

Overall, face masking reduced emotion recognition by 31%. All emotions were affected by mask covering except for anger. Face covering was most detrimental to sadness and disgust, both relying on mouth and nose expressiveness. Women showed a better performance for subtle expressions such as surprise and sadness, both in masked and natural conditions, and men for fear recognition (in natural but especially masked conditions).

Conclusion

Anger display was unaffected by masking, also because corrugated forehead and frowning eyebrows were clearly exposed. Overall, facial masking seems to polarize non-verbal communication toward the happiness/anger dimension, while minimizing emotions that stimulate an empathic response in the observer.

New evidence of impaired expression recognition in developmental prosopagnosia

Developmental prosopagnosia (DP) is a neurodevelopmental condition characterized by lifelong face recognition difficulties. To date, it remains unclear whether or not individuals with DP experience impaired recognition of facial expressions. It has been proposed that DPs may have sufficient perceptual ability to correctly interpret facial expressions when tasks are relatively easy (e.g., the stimuli are unambiguous and viewing conditions are optimal), but exhibit subtle impairments when tested under more challenging conditions. In the present study, we sought to take advantage of the COVID-19 pandemic to test this view. It is well-established that the surgical-type masks worn during the pandemic hinder the recognition and interpretation of facial emotion in typical participants. Relative to typical participants, we hypothesized that DPs may be disproportionately impaired when asked to interpret the facial emotion of people wearing face masks. We compared the ability of 34 DPs and 60 age-matched typical controls to recognize facial emotions i) when the whole face is visible, and ii) when the lower portion of the face is covered with a surgical mask. When expression stimuli were viewed without a mask, the DPs and typical controls exhibited similar levels of performance. However, when expression stimuli were shown with a mask, the DPs showed signs of subtle expression recognition deficits. The DPs were particularly prone to mislabeling masked expressions of happiness as emotion neutral. These results add to a growing body of evidence that under some conditions, DPs do exhibit subtle deficits of expression recognition.

The influence of familiarity on memory for faces and mask wearing

During the COVID-19 pandemic, the wearing of face masks became mandatory in public areas or at workplaces in many countries. While offering protection, the coverage of large parts of our face (nose, mouth and chin) may have consequences for face recognition. This seems especially important in the context of contact tracing which can require memory of familiar and unfamiliar contacts and whether they were wearing a mask. In this study, we tested how well participants perform at remembering faces and whether they wore a mask, and if this depends on familiarity. Our results show that: (a) Participants remembered familiar faces better than unfamiliar ones, regardless of mask wearing. (b) Participants remembered unmasked faces better than masked faces, regardless of familiarity. (c) Participants were significantly worse at remembering whether an unfamiliar face was wearing a mask or not-even if they indicated remembering the face. (d) Participants showed a bias to indicate no memory of unfamiliar faces. (e) Participants showed a bias to indicate that unfamiliar faces wore a mask, even if they did not. In sum, it was harder to remember both, the identity of unfamiliar faces and whether they wore a mask. These findings have practical relevance for contact tracing and epidemic control.

Effects of wearing a transparent face mask on perception of facial expressions

Wearing face masks in public has become the norm in many countries post-2020. Although mask-wearing is effective in controlling infection, it has the negative side effect of occluding the mask wearer's facial expressions. The purpose of this study was to investigate the effects of wearing transparent masks on the perception of facial expressions. Participants were required to categorize the perceived facial emotion of female (Experiment 1) and male (Experiment 2) faces with different facial expressions and to rate the perceived emotion intensity of the faces. Based on the group, the participants were assigned to, the faces were presented with a surgical mask, a transparent mask, or without a mask. The results showed that wearing a surgical mask impaired the performance of reading facial expressions, both with respect to recognition and perceived intensity of facial emotions. Specifically, the impairments were robustly observed in fear and happy faces for emotion recognition, and in happy faces for perceived intensity of emotion in Experiments 1 and 2. However, the impairments were moderated by wearing a transparent mask instead of a surgical mask. During the coronavirus disease 2019 (COVID-19) pandemic, the transparent mask can be used in a range of situations where face-to-face communication is important.

Face masks have a limited influence on first impressions: evidence from three experiments

Considering the widespread use of face masks during the COVID-19 pandemic, the goal of the current study was to examine how occlusion of the lower half of the face may impact first impression formation. We conducted three experiments, each building on previous research, investigating the effect of face masks on first impressions of faces across the lifespan (children, young and older adults). Experiment 1 examined whether the mandatory influence of happy facial expressions on perceived trustworthiness in young adult faces is influenced by face masks. Experiment 2 examined behavioural consequences of adults' first impressions of child faces to determine whether masks reduce the effect of facial niceness on interpretations of ambiguous behaviour. Experiment 3 investigated consensus for first impressions of trustworthiness and competence in older adult faces with and without masks, as well as consensus on underlying facial cues. The results of all three experiments present converging evidence that masks do not have a significant impact on first impressions and their behavioural consequences.

Impact of mask use on face recognition: an eye-tracking study

We examined how mask use affects performance and eye movements in face recognition and whether strategy change reflected in eye movements is associated with performance change. Eighty-eight participants performed face recognition with masked faces either during learning only, during recognition only, or during both learning and recognition. As compared with the baseline condition where faces were unmasked during both learning and recognition, participants had impaired performance in all three scenarios, with larger impairment when mask conditions during learning and recognition did not match. When recognizing unmasked faces, whether the faces were learned with or without a mask on did not change eye movement behavior. Nevertheless, when recognizing unmasked faces that were learned with a mask on, participants who adopted more eyes-focused patterns had less performance impairment as compared with the baseline condition. When recognizing masked faces, participants had more eyes-focused patterns and more consistent gaze transition behavior than recognizing unmasked faces regardless of whether the faces were learned with or without a mask on. Nevertheless, when recognizing masked faces that were learned without a mask, participants whose gaze transition behavior was more consistent had less performance impairment as compared with the baseline condition. Thus, although eye movements during recognition were mainly driven by the mask condition during recognition but not that during learning, those who adjusted their strategy according to the mask condition difference between learning and recognition had better performance. This finding has important implications for identifying populations vulnerable to the impact of mask use and potential remedial strategies.

Masked face identification is improved by diagnostic feature training

To slow the spread of COVID-19, many people now wear face masks in public. Face masks impair our ability to identify faces, which can cause problems for professional staff who identify offenders or members of the public. Here, we investigate whether performance on a masked face matching task can be improved by training participants to compare diagnostic facial features (the ears and facial marks)-a validated training method that improves matching performance for unmasked faces. We show this brief diagnostic feature training, which takes less than two minutes to complete, improves matching performance for masked faces by approximately 5%. A control training course, which was unrelated to face identification, had no effect on matching performance. Our findings demonstrate that comparing the ears and facial marks is an effective means of improving face matching performance for masked faces. These findings have implications for professions that regularly perform face identification.

The impact of face masks on emotion recognition performance and perception of threat

Facial emotion recognition is crucial for social interaction. However, in times of a global pandemic, where wearing a face mask covering mouth and nose is widely encouraged to prevent the spread of disease, successful emotion recognition may be challenging. In the current study, we investigated whether emotion recognition, assessed by a validated emotion recognition task, is impaired for faces wearing a mask compared to uncovered faces, in a sample of 790 participants between 18 and 89 years (condition mask vs. original). In two more samples of 395 and 388 participants between 18 and 70 years, we assessed emotion recognition performance for faces that are occluded by something other than a mask, i.e., a bubble as well as only showing the upper part of the faces (condition half vs. bubble). Additionally, perception of threat for faces with and without occlusion was assessed. We found impaired emotion recognition for faces wearing a mask compared to faces without mask, for all emotions tested (anger, fear, happiness, sadness, disgust, neutral). Further, we observed that perception of threat was altered for faces wearing a mask. Upon comparison of the different types of occlusion, we found that, for most emotions and especially for disgust, there seems to be an effect that can be ascribed to the face mask specifically, both for emotion recognition performance and perception of threat. Methodological constraints as well as the importance of wearing a mask despite temporarily compromised social interaction are discussed.

Face Processing in Early Development: A Systematic Review of Behavioral Studies and Considerations in Times of COVID-19 Pandemic

Human faces are one of the most prominent stimuli in the visual environment of young infants and convey critical information for the development of social cognition. During the COVID-19 pandemic, mask wearing has become a common practice outside the home environment. With masks covering nose and mouth regions, the facial cues available to the infant are impoverished. The impact of these changes on development is unknown but is critical to debates around mask mandates in early childhood settings. As infants grow, they increasingly interact with a broader range of familiar and unfamiliar people outside the home; in these settings, mask wearing could possibly influence social development. In order to generate hypotheses about the effects of mask wearing on infant social development, in the present work, we systematically review N = 129 studies selected based on the most recent PRISMA guidelines providing a state-of-the-art framework of behavioral studies investigating face processing in early infancy. We focused on identifying sensitive periods during which being exposed to specific facial features or to the entire face configuration has been found to be important for the development of perceptive and socio-communicative skills. For perceptive skills, infants gradually learn to analyze the eyes or the gaze direction within the context of the entire face configuration. This contributes to identity recognition as well as emotional expression discrimination. For socio-communicative skills, direct gaze and emotional facial expressions are crucial for attention engagement while eye-gaze cuing is important for joint attention. Moreover, attention to the mouth is particularly relevant for speech learning. We discuss possible implications of the exposure to masked faces for developmental needs and functions. Providing groundwork for further research, we encourage the investigation of the consequences of mask wearing for infants' perceptive and socio-communicative development, suggesting new directions within the research field.

Are estimates of faces' ages less accurate when they wear sunglasses or face masks and do these disguises make it harder to later recognise the faces when undisguised?

This study examined whether our ability to accurately estimate unfamiliar faces' ages declines when they are wearing sunglasses or surgical-style face masks and whether these disguises make it harder to later recognise those faces when undisguised. In theory, both disguises should harm age estimation accuracy and later face recognition as they occlude facial information that is used to determine a face's age and identity. To establish whether this is the case, we had participants estimate the age of unfamiliar faces that were pictured wearing no disguises, sunglasses, or face masks. The participants then completed a face recognition test where they had to distinguish between the previously seen faces and new faces. Importantly, none of faces wore disguises in this latter test. Participants' estimates of the undisguised faces' ages were inaccurate by a Median of 5.15 years. Their accuracy barely changed when the faces wore sunglasses but declined by a Median of 1.30 years when they wore face masks. Moreover, subsequent undisguised face recognition was less likely to occur when the faces previously wore sunglasses or face masks, with large effects observed. These findings demonstrate the relative importance of different facial areas when estimating faces' ages and later recognising them. They also have implications for policing as they suggest it may be harder for eyewitnesses to accurately estimate the age of criminals who wear face masks during offences, and it may be harder for them to later recognise criminals in line-ups if the criminals wear sunglasses or face masks during offences.

Face masks versus sunglasses: limited effects of time and individual differences in the ability to judge facial identity and social traits

Some research indicates that face masks impair identification and other judgements such as trustworthiness. However, it is unclear whether those effects have abated over time as individuals adjust to widespread use of masks, or whether performance is related to individual differences in face recognition ability. This study examined the effect of masks and sunglasses on face matching and social judgements (trustworthiness, competence, attractiveness). In Experiment 1, 135 participants across three different time points (June 2020-July 2021) viewed unedited faces and faces with masks, sunglasses, or both. Both masks and sunglasses similarly decreased matching performance. The effect of masks on social judgements varied depending on the judgement and whether the face was depicted with sunglasses. There was no effect of timepoint on any measure, suggesting that the effects of masks have not diminished. In Experiment 2, 12 individuals with developmental prosopagnosia (DP) and 10 super-recognisers (SRs) completed the same tasks. The effect of masks on identity matching was reduced in SRs, whereas the effects of masks and sunglasses for the DP group did not differ from controls. These findings indicate that face masks significantly affect face perception, depending on the availability of other facial information, and are not modified by exposure.

Impact of face masks and sunglasses on emotion recognition in South Koreans

Due to the prolonged COVID-19 pandemic, wearing masks has become essential for social interaction, disturbing emotion recognition in daily life. In the present study, a total of 39 Korean participants (female = 20, mean age = 24.2 years) inferred seven emotions (happiness, surprise, fear, sadness, disgust, anger, surprise, and neutral) from uncovered, mask-covered, sunglasses-covered faces. The recognition rates were the lowest under mask conditions, followed by the sunglasses and uncovered conditions. In identifying emotions, different emotion types were associated with different areas of the face. Specifically, the mouth was the most critical area for happiness, surprise, sadness, disgust, and anger recognition, but fear was most recognized from the eyes. By simultaneously comparing faces with different parts covered, we were able to more accurately examine the impact of different facial areas on emotion recognition. We discuss the potential cultural differences and the ways in which individuals can cope with communication in which facial expressions are paramount.

Face masks have emotion-dependent dissociable effects on accuracy and confidence in identifying facial expressions of emotion

The coronavirus pandemic has resulted in increased use of face masks worldwide. Here, we examined the effect of wearing a face mask on the ability to recognise facial expressions of emotion. In a within-subjects design, 100 UK-based undergraduate students were shown facial expressions of anger, disgust, fear, happiness, sadness, and neutral expression; these were either posed with or without a face mask, or with a face mask artificially imposed onto them. Participants identified the emotion portrayed in the photographs from a fixed choice array of answers and rated their confidence in their selection. While overall accuracy was higher without than with masks, the effect varied across emotions, with a clear advantage without masks in disgust, happiness, and sadness; no effect for neutral, and lower accuracy without masks for anger and fear. In contrast, confidence was generally higher without masks, with the effect clear for all emotions other than anger. These results confirm that emotion recognition is affected by face mask wearing, but reveal that the effect depends on the emotion being displayed—with this emotion-dependence not reflected in subjects’ confidence. The disparity between the effects of mask wearing on different emotions and the failure of this to be reflected in confidence ratings suggests that mask wearing not only effects emotion recognition, but may also create biases in the perception of facial expressions of emotion of which perceivers are unaware. In addition, the similarity of results between the Imposed Mask and Posed Mask conditions suggests that prior research using artificially imposed masks has not been deleteriously affected by the use of this manipulation.

Are covered faces eye-catching for us? The impact of masks on attentional processing of self and other faces during the COVID-19 pandemic

During the COVID-19 pandemic, we have been confronted with faces covered by surgical-like masks. This raises a question about how our brains process this kind of visual information. Thus, the aims of the current study were twofold: (1) to investigate the role of attention in the processing of different types of faces with masks, and (2) to test whether such partial information about faces is treated similarly to fully visible faces. Participants were tasked with the simple detection of self-, close-other's, and unknown faces with and without a mask; this task relies on attentional processes. Event-related potential (ERP) findings revealed a similar impact of surgical-like masks for all faces: the amplitudes of early (P100) and late (P300, LPP) attention-related components were higher for faces with masks than for fully visible faces. Amplitudes of N170 were similar for covered and fully visible faces, and sources of brain activity were located in the fusiform gyri in both cases. Linear Discriminant Analysis (LDA) revealed that irrespective of whether the algorithm was trained to discriminate three types of faces either with or without masks, it was able to effectively discriminate faces that were not presented in the training phase.

How does the presence of a surgical face mask impair the perceived intensity of facial emotions?

The use of surgical-type face masks has become increasingly common during the COVID-19 pandemic. Recent findings suggest that it is harder to categorise the facial expressions of masked faces, than of unmasked faces. To date, studies of the effects of mask-wearing on emotion recognition have used categorisation paradigms: authors have presented facial expression stimuli and examined participants’ ability to attach the correct label (e.g., happiness, disgust). While the ability to categorise particular expressions is important, this approach overlooks the fact that expression intensity is also informative during social interaction. For example, when predicting an interactant’s future behaviour, it is useful to know whether they are slightly fearful or terrified, contented or very happy, slightly annoyed or angry. Moreover, because categorisation paradigms force observers to pick a single label to describe their percept, any additional dimensionality within observers’ interpretation is lost. In the present study, we adopted a complementary emotion-intensity rating paradigm to study the effects of mask-wearing on expression interpretation. In an online experiment with 120 participants (82 female), we investigated how the presence of face masks affects the perceived emotional profile of prototypical expressions of happiness, sadness, anger, fear, disgust, and surprise. For each of these facial expressions, we measured the perceived intensity of all six emotions. We found that the perceived intensity of intended emotions (i.e., the emotion that the actor intended to convey) was reduced by the presence of a mask for all expressions except for anger. Additionally, when viewing all expressions except surprise, masks increased the perceived intensity of non-intended emotions (i.e., emotions that the actor did not intend to convey). Intensity ratings were unaffected by presentation duration (500ms vs 3000ms), or attitudes towards mask wearing. These findings shed light on the ambiguity that arises when interpreting the facial expressions of masked faces.

Forensic facial examiners versus super-recognizers: Evaluating behavior beyond accuracy

We evaluated the detailed, behavioral properties of face matching performance in two specialist groups: forensic facial examiners and super-recognizers. Both groups compare faces to determine identity with high accuracy and outperform the general population. Typically, facial examiners are highly trained; super-recognizers rely on natural ability. We found distinct behaviors between these two groups. Examiners used the full 7-point identity judgment scale (-3: "different"; +3: "same"). Super-recognizers' judgments clustered toward highly confident decisions. Examiners' judgments for same- and different-identities were symmetric across the scale midpoint (0); super-recognizers' judgments were not. Examiners showed higher identity judgment agreement than super-recognizers. Despite these qualitative differences, both groups showed insight into their own accuracy: more confident people and those who rated the task to be easier tended to be more accurate. Altogether, we show to better understand and interpret judgments according to the nature of someone's facial expertise, evaluations should assess more than accuracy.

COVID-19 and psychiatric disorders: The impact of face masks in emotion recognition face masks and emotion recognition in psychiatry

Since the outbreak of the COVID-19 pandemic, reading facial expressions has become more complex due to face masks covering the lower part of people's faces. A history of psychiatric illness has been associated with higher rates of complications, hospitalization, and mortality due to COVID-19. Psychiatric patients have well-documented difficulties reading emotions from facial expressions; accordingly, this study assesses how using face masks, such as those worn for preventing COVID-19 transmission, impacts the emotion recognition skills of patients with psychiatric disorders. To this end, the current study asked patients with bipolar disorder, major depressive disorder, schizophrenia, and healthy individuals to identify facial emotions on face images with and without facial masks. Results demonstrate that the emotion recognition skills of all participants were negatively influenced by face masks. Moreover, the main insight of the study is that the impairment is crucially significant when patients with major depressive disorder and schizophrenia had to identify happiness at a low-intensity level. These findings have important implications for satisfactory social relationships and well-being. If emotions with positive valence are hardly understood by specific psychiatric patients, there is an even greater requirement for doctor-patient interactions in public primary care.

Impact of Face Masks and Viewers' Anxiety on Ratings of First Impressions from Faces

Face mask is now a common feature in our social environment. Although face covering reduces our ability to recognize other's face identity and facial expressions, little is known about its impact on the formation of first impressions from faces. In two online experiments, we presented unfamiliar faces displaying neutral expressions with and without face masks, and participants rated the perceived approachableness, trustworthiness, attractiveness, and dominance from each face on a 9-point scale. Their anxiety levels were measured by the State-Trait Anxiety Inventory and Social Interaction Anxiety Scale. In comparison with mask-off condition, wearing face masks (mask-on) significantly increased the perceived approachableness and trustworthiness ratings, but showed little impact on increasing attractiveness or decreasing dominance ratings. Furthermore, both trait and state anxiety scores were negatively correlated with approachableness and trustworthiness ratings in both mask-off and mask-on conditions. Social anxiety scores, on the other hand, were negatively correlated with approachableness but not with trustworthiness ratings. It seems that the presence of a face mask can alter our first impressions of strangers. Although the ratings for approachableness, trustworthiness, attractiveness, and dominance were positively correlated, they appeared to be distinct constructs that were differentially influenced by face coverings and participants’ anxiety types and levels.

Impact of Face Masks on Female Body Perception is Modulated by Facial Expressions

People routinely wear face masks during the pandemic, but little is known about their impact on body perception. In this online study, we presented female body images of Caucasian avatars in common dress sizes displaying happy, angry, and neutral facial expressions with and without face masks, and asked women to rate the perceived body attractiveness and body size. In comparison with mask-off condition, mask-on decreased body attractiveness ratings for happy avatars but did not affect ratings for neutral avatars irrespective of avatar dress sizes. For avatars displaying angry expressions, mask-on increased body attractiveness ratings for slimmer avatars but did not affect ratings for larger avatars. On the other hand, body size estimation was not systematically affected by face masks and facial expressions. It appears that face masks mainly show an expression-dependent influence on body attractiveness judgement, possibly through suppressing the perceived facial expressions.

Understanding the Impact of Face Masks on the Processing of Facial Identity, Emotion, Age, and Gender

The COVID-19 pandemic has introduced new challenges for governments and individuals. Unprecedented efforts at reducing virus transmission launched a novel arena for human face recognition in which faces are partially occluded with masks. Previous studies have shown that masks decrease accuracy of face identity and emotion recognition. The current study focuses on the impact of masks on the speed of processing of these and other important social dimensions. Here we provide a systematic assessment of the impact of COVID-19 masks on facial identity, emotion, gender, and age. Four experiments (N = 116) were conducted in which participants categorized faces on a predefined dimension (e.g., emotion). Both speed and accuracy were measured. The results revealed that masks hindered the perception of virtually all tested facial dimensions (i.e., emotion, gender, age, and identity), interfering with normal speed and accuracy of categorization. We also found that the unwarranted effects of masks were not due to holistic processes, because the Face Inversion Effect (FIE) was generally not larger with unmasked compared with masked faces. Moreover, we found that the impact of masks is not automatic and that under some contexts observers can control at least part of their detrimental effects.

Face Masks Do Not Alter Gaze Cueing of Attention: Evidence From the COVID-19 Pandemic

Interacting with others wearing a face mask has become a regular worldwide practice since the beginning of the COVID-19 pandemic. However, the impact of face masks on cognitive mechanisms supporting social interaction is still largely unexplored. In the present work, we focused on gaze cueing of attention, a phenomenon tapping the essential ability which allows individuals to orient their attentional resources in response to eye gaze signals coming from others. Participants from both a European (i.e., Italy; Experiment 1) and an Asian (i.e., China; Experiment 2) country were involved, namely two countries in which the daily use of face masks before COVID-19 pandemic was either extremely uncommon or frequently adopted, respectively. Both samples completed a task in which a peripheral target had to be discriminated while a task irrelevant averted gaze face, wearing a mask or not, acted as a central cueing stimulus. Overall, a reliable and comparable gaze cueing emerged in both experiments, independent of the mask condition. These findings suggest that gaze cueing of attention is preserved even when the person perceived is wearing a face mask.

Facial masks affect emotion recognition in the general population and individuals with autistic traits

Facial expressions, and the ability to recognize these expressions, have evolved in humans to communicate information to one another. Face masks are equipment used in healthcare by health professionals to prevent the transmission of airborne infections. As part of the social distancing efforts related to COVID-19, wearing facial masks has been practiced globally. Such practice might influence affective information communication among humans. Previous research suggests that masks disrupt expression recognition of some emotions (e.g., fear, sadness or neutrality) and lower the confidence in their identification. To extend the previous research, in the current study we tested a larger and more diverse sample of individuals and also investigated the effect of masks on perceived intensity of expressions. Moreover, for the first time in the literature we examined these questions using individuals with autistic traits. Specifically, across three experiments using different populations (college students and general population), and the 10-item Autism Spectrum Quotient (AQ-10; lower and higher scorers), we tested the effect of facial masks on facial emotion recognition of anger, disgust, fear, happiness, sadness, and neutrality. Results showed that the ability to identify all facial expressions decreased when faces were masked, a finding observed across all three studies, contradicting previous research on fear, sad, and neutral expressions. Participants were also less confident in their judgements for all emotions, supporting previous research; and participants perceived emotions as less expressive in the mask condition compared to the unmasked condition, a finding novel to the literature. An additional novel finding was that participants with higher scores on the AQ-10 were less accurate and less confident overall in facial expression recognition, as well as perceiving expressions as less intense. Our findings reveal that wearing face masks decreases facial expression recognition, confidence in expression identification, as well as the perception of intensity for all expressions, affecting high-scoring AQ-10 individuals more than low-scoring individuals.

Visual search performance in 'CCTV' and mobile phone-like video footage

Finding an unfamiliar person in a crowd of others is an integral task for police officers, CCTV-operators, and security staff who may be looking for a suspect or missing person; however, research suggests that it is difficult and accuracy in such tasks is low. In two real-world visual-search experiments, we examined whether being provided with four images versus one image of an unfamiliar target person would help improve accuracy when searching for that person through video footage. In Experiment 1, videos were taken from above and at a distance to simulate CCTV, and images of the target showed their face and torso. In Experiment 2, videos were taken from approximately shoulder height, such as one would expect from body-camera or mobile phone recordings, and target images included only the face. Our findings suggest that having four images as exemplars leads to higher accuracy in the visual search tasks, but this only reached significance in Experiment 2. There also appears to be a conservative bias whereby participants are more likely to respond that the target is not in the video when presented with only one image as opposed to 4. These results point to there being an advantage for providing multiple images of targets for use in video visual-search.

Effects of Face Masks on Person Perception

As face masks have become more commonplace in many regions due to COVID-19, concerns have been raised about their effects on the perception of mask wearers and social cohesion more broadly, including racial profiling. In two studies we examined the effects of masks on social judgments of mask wearers, and whether masks have different effects on judgments of Black and White faces. Participants rated 20 Black and 20 White faces with and without masks on trustworthiness/approachability (Studies 1 and 2) and on dominance/competence and attractiveness (Study 2). In both studies masks increased perceived trustworthiness and reduced the effect of face race on judgments. Masks also increased perceived attractiveness, but had no effect on the perception of dominance/competence. Overall, this study found no negative effects of face masks on judgments of mask wearers, though further research is needed.

Reading Covered Faces

Covering faces with masks, due to mandatory pandemic safety regulations, we can no longer rely on the habitual daily-life information. This may be thought-provoking for healthy people, but particularly challenging for individuals with neuropsychiatric and neurodevelopmental conditions. Au fait research on reading covered faces reveals that: 1) wearing masks hampers facial affect recognition, though it leaves reliable inferring basic emotional expressions; 2) by buffering facial affect, masks lead to narrowing of emotional spectrum and dampen veridical evaluation of counterparts; 3) masks may affect perceived face attractiveness; 4) covered (either by masks or other veils) faces have a certain signal function introducing perceptual biases and prejudices; 5) reading covered faces is gender- and age-specific, being more challenging for males and more variable even in healthy aging; 6) the hampering effects of masks on social cognition occur over the globe; and 7) reading covered faces is likely to be supported by the large-scale assemblies of the neural circuits far beyond the social brain. Challenges and limitations of ongoing research and parallels to the Reading the Mind in the Eyes Test are assessed. Clarification of how masks affect face reading in the real world, where we deal with dynamic faces and have entrée to additional valuable social signals such as body language, as well as the specificity of neural networks underlying reading covered faces calls for further tailored research.

Low prevalence match and mismatch detection in simultaneous face matching: Influence of face recognition ability and feature focus guidance

Simultaneous face matching to verify identity is key to security and policing. However, matching is error-prone, particularly when target-item prevalence is low. Two experiments examined whether superior face recognition ability and the use of internal or external facial feature guidance scales would reduce low prevalence effects. In Experiment 1, super-recognisers (n = 317) significantly outperformed typical-ability controls (n = 452), while internal feature guidance enhanced accuracy across all prevalence conditions. However, an unexpected effect in controls revealed higher accuracy in low prevalence conditions, probably because no low-match or low-mismatch prevalence information was provided. In Experiment 2, top-end-of-typical range ability participants (n = 841) were informed of their low prevalence condition and demonstrated the expected low-prevalence effects. Findings and implications are discussed.

Face processing in police service: the relationship between laboratory-based assessment of face processing abilities and performance in a real-world identity matching task

In the present study, we investigated whether police officers’ performance in searching for unfamiliar faces in a video-based real-world task is predicted by laboratory-based face processing tests that are typically used to assess individual differences in face processing abilities. Specifically, perceptual performance in the field was operationalized via the identification of target individuals in self-made close-circuit television (CCTV) video tapes. Police officers’ abilities in the laboratory were measured by the Cambridge Face Memory Test long form (CFMT+). We hypothesized that the CFMT+ predicts individual differences in the CCTV task performance. A total of N = 186 police officers of the Rhineland-Palatinate State Police participated in the study (i.e., N = 139 novice and advanced cadets with either 3 months, 15 months or 24 months of pre-service experience; N = 47 experienced police officers with three years of pre-service experience and at least two years of full-service experience, who participated in the assessment center of the special police forces, specifically the surveillance and technical unit). Results revealed that the CFMT+ explained variance in the CCTV task. In sample 1, CFMT+ scores predicted hits, but not false alarms. In contrast, in sample 2, CFMT+ scores were correlated with both hits and false alarms. From a theoretical perspective, we discuss factors that might explain CCTV task performance. From a practical perspective, we recommend that personnel selection processes investigating individual differences of police officers’ face processing abilities should comprise of two steps. At first, laboratory-based tests of face processing abilities should be applied. Subsequently, to validate laboratory-based individual differences in face processing abilities, we recommend that work samples such as CCTV tasks from the field should be added.

Effects of Masks Worn to Protect Against COVID-19 on the Perception of Facial Attractiveness

Wearing a sanitary mask tended, in the main, to reduce the wearer's sense of perceived facial attractiveness before the COVID-19 epidemic. This phenomenon, termed the sanitary-mask effect, was explained using a two-factor model involving the occlusion of cues used for the judgment of attractiveness and unhealthiness priming (e.g., presumed illness). However, these data were collected during the pre-COVID-19 period. Thus, in this study, we examined whether the COVID-19 epidemic changed the perceived attractiveness and healthiness when viewing faces with and without sanitary masks. We also used questionnaires to evaluate beliefs regarding mask wearers. We found that the perception of mask-worn faces differed before versus after the onset of the COVID-19 epidemic. Specifically, mask-wearing improved wearers' sense of the attractiveness of faces, which were rated as less attractive when a mask was not worn after the onset of the COVID-19 epidemic. Furthermore, mask-worn faces were rated as healthier after the onset of the COVID-19. The proportion of respondents with negative associations regarding mask-wearing (e.g., unhealthiness) decreased relative to before the epidemic. We suggest that the weakening of this association altered the sanitary-mask effect with a relative emphasis on the occlusion component, reflecting the temporal impact of a global social incident (the COVID-19 epidemic) on the perception of facial attractiveness.