In the Blink of an Eye: Reading Mental States From Briefly Presented Eye Regions

Development and testing of a questionnaire on the expectations and experiences with wearing face masks in inpatient and day hospitals

BACKGROUND

The Covid-19 pandemic made wearing of face masks mandatory in the psychotherapeutic context. Against this background, the present study aimed to compare the expectations of patients undergoing day-hospital or inpatient treatment regarding wearing a mask in psychotherapy before the start of therapy with the final experience after the end of therapy. The study also investigated the extent to which expectations and experiences were influenced by other factors such as socio-demographic characteristics, patients' general attitudes towards wearing a mask, duration of treatment, or mental health diagnoses.

METHODS

Patients' expectations and experiences were recorded using two versions of a self-developed questionnaire: the pre-version, which was administered before the start of therapy and recorded expectations, and the post-version, which was administered after the end of therapy and recorded the final experiences. An exploratory factor analysis was conducted for the questionnaire's pre- and post-version. T-tests for paired samples were calculated to compare the patients' expectations regarding the extracted factors with the final experiences. Bivariate correlations were calculated to explore the association of other potential factors with expectations and experiences.

RESULTS

The exploratory factor analysis revealed a three-factor structure: communication barriers, self-confidence, and infection protection. The communication barriers expected by the patients before the start of the therapy turned out to be significantly higher than ultimately experienced after the therapy. Higher age correlated significantly negatively with expectations and experiences, with less self-confidence expected and experienced in therapy with a mask by older patients. There was a significant positive correlation between the expectations and the duration of treatment. Patients' general attitudes correlated significantly with their expectations and experiences.

CONCLUSION

Based on the results, wearing a mask does not appear to negatively impact the success of psychotherapy from the patient's perspective. However, patient-specific characteristics also appear to play a role in this context.

Face masks negatively skew theory of mind judgements

Face masks obscure a significant portion of the face, reducing the amount of information available to gauge the mental states of others-that is, to exercise the Theory of Mind (ToM) capacity. In three experiments, we assessed the effect of face masks on ToM judgements, measuring recognition accuracy, perceived valence, and perceived arousal in various sets of facial expressions comprising 45 different mental states. Significant effects of face masks were found in all three variables. Judgements of all expressions are less accurate when masked, but, while judgements of negative expressions do not show consistent changes in valence or arousal, positive expressions are perceived to be less positive and less intense. In addition, we identified face muscles associated with changes in perceived valence and arousal, shedding light on the mechanisms through which masks impact ToM judgements, which might be relevant for mitigation strategies. We discuss the implications of these findings in the context of the recent pandemic.

The moderating role of spirituality and gender in Canadian and Iranian emerging adolescents’ theory of mind and prosocial behavior

Introduction

While research has found a link between ToM and prosociality in terms of caring and helping others which may also vary across cultures, the moderating role of spirituality and culture of this association in emerging adolescence has received little attention.

Methods

The current study empirically “examined” the role of spirituality and gender in relation to ToM and prosocial behavior in Canadian and Iranian emerging adolescents. A total of 300 (153 girls) emerging adolescents (M = 11.502, SD = 2.228) were recruited from Montreal, Canada and Karaj, Iran. A series of double moderation analysis and ANOVA was conducted.

Results and discussion

Results indicated the difference between direct and indirect influences of ToM and its interactions with culture, gender, and spirituality on prosocial behavior. This implies an emerging complex framework which suggests the dynamic nonlinear interactions between these factors. Implications for youth’s social-emotional understanding will be discussed.

The impact of briefly observing faces in opaque facial masks on emotion recognition and empathic concern

Since the outbreak of SARS-CoV-2 in 2019, there have been global public health initiatives that have advocated for the community use of face masks to reduce spread of the virus. Although the community use of facial coverings has been deemed essential for public health, there have been calls for enquiries to ascertain how face masks may impact non-verbal methods of communication. This study aimed to ascertain how the brief observations of faces in opaque facial coverings could impact facial emotion recognition. It was also an aim to ascertain if there was an association between the levels of empathic concern and facial emotion recognition when viewing masked faces. An opportunity sample of 199 participants, who resided in the United Kingdom, were randomly assigned to briefly observe either masked (n = 102) or unmasked (n = 97) faces. Participants in both conditions were required to view a series of facial expressions, from the Radboud Faces Database, with models conveying the emotional states of anger, disgust, fear, happiness, sadness, and surprised. Each face was presented to participants for a period of 250 ms in the masked and unmasked conditions. A 6 (emotion type) x 2 (masked/unmasked condition) mixed ANOVA revealed that viewing masked faces significantly reduced facial emotion recognition of disgust, fear, happiness, sadness, and surprised. However, there were no differences in the success rate of recognising the emotional state of anger between the masked and unmasked conditions. Furthermore, higher levels of empathic concern were associated with greater success in facially recognising the emotional state of disgust. The results of this study suggest that significant reductions in emotion recognition, when viewing faces in opaque masks, can still be observed when people are exposed to facial stimuli for a brief period of time.

Communicating and reading emotion with masked faces in the Covid era: A short review of the literature

Face masks have proven to be key to slowing down the SARS-Cov2 virus spread in the COVID-19 pandemic context. However, wearing face masks is not devoid of "side-effects", at both the physical and psychosocial levels. In particular, masks hinder emotion reading from facial expressions as they hide a significant part of the face. This disturbs both holistic and featural processing of facial expressions and, therefore, impairs emotion recognition, and influences many aspects of human social behavior. Communication in general is disrupted by face masks, as they modify the wearer's voice and prevent the audience from using lip reading or other non-verbal cues for speech comprehension. Individuals suffering from psychiatric conditions with impairment of communication, are at higher risk of distress because masks increase their difficulties to read emotions from faces. The identification and acknowledgement of these "side-effects" on communication are necessary because they warrant further work on adaptive solutions that will help foster the use of face masks by the greatest number.

The effects of face coverings, own-ethnicity biases, and attitudes on emotion recognition

As a result of the COVID-19 pandemic, face coverings were introduced as a safety measure in certain environments in England and some research suggests that they can affect emotion recognition. Factors such as own-ethnicity bias (e.g. whether people perceiving and expressing emotions are of the same ethnicity) and social biases are also known to influence emotion recognition. However, it is unclear whether these factors interact with face coverings to affect emotion recognition. Therefore, this study examined the effects of face coverings, own-ethnicity biases, and attitudes on emotion recognition accuracy. In this study, 131 participants viewed masked and unmasked emotional faces varying in ethnicity and completed a questionnaire on their attitudes towards face masks. We found that emotion recognition was associated with masks and attitudes: accuracy was lower in masked than unmasked conditions and attitudes towards masks Inside and Outside were associated with emotion recognition. However, a match between perceiver and stimulus ethnicity did not have a significant effect on emotion recognition. Ultimately, our results suggest that masks, and negative attitudes towards them, were associated with poorer emotion recognition. Future research should explore different mask-wearing behaviours and possible in-group/out-group biases and their interaction with other social cues (e.g. in-group biases).

Reading Emotions in Faces With and Without Masks Is Relatively Independent of Extended Exposure and Individual Difference Variables

The ability to read emotions in faces helps humans efficiently assess social situations. We tested how this ability is affected by aspects of familiarization with face masks and personality, with a focus on emotional intelligence (measured with an ability test, the MSCEIT, and a self-report scale, the SREIS). To address aspects of the current pandemic situation, we used photos of not only faces per se but also of faces that were partially covered with face masks. The sample (N = 49), the size of which was determined by an a priori power test, was recruited in Germany and consisted of healthy individuals of different ages [M = 24.8 (18-64) years]. Participants assessed the emotional expressions displayed by six different faces determined by a 2 (sex) × 3 (age group: young, medium, and old) design. Each person was presented with six different emotional displays (angry, disgusted, fearful, happy, neutral, and sad) with or without a face mask. Accuracy and confidence were lower with masks-in particular for the emotion disgust (very often misinterpreted as anger) but also for happiness, anger, and sadness. When comparing the present data collected in July 2021 with data from a different sample collected in May 2020, when people first started to familiarize themselves with face masks in Western countries during the first wave of the COVID-19 pandemic, we did not detect an improvement in performance. There were no effects of participants' emotional intelligence, sex, or age regarding their accuracy in assessing emotional states in faces for unmasked or masked faces.

Impact of face masks and sunglasses on emotion recognition in South Koreans

Due to the prolonged COVID-19 pandemic, wearing masks has become essential for social interaction, disturbing emotion recognition in daily life. In the present study, a total of 39 Korean participants (female = 20, mean age = 24.2 years) inferred seven emotions (happiness, surprise, fear, sadness, disgust, anger, surprise, and neutral) from uncovered, mask-covered, sunglasses-covered faces. The recognition rates were the lowest under mask conditions, followed by the sunglasses and uncovered conditions. In identifying emotions, different emotion types were associated with different areas of the face. Specifically, the mouth was the most critical area for happiness, surprise, sadness, disgust, and anger recognition, but fear was most recognized from the eyes. By simultaneously comparing faces with different parts covered, we were able to more accurately examine the impact of different facial areas on emotion recognition. We discuss the potential cultural differences and the ways in which individuals can cope with communication in which facial expressions are paramount.

Wearing N95, Surgical, and Cloth Face Masks Compromises the Perception of Emotion

According to the familiar axiom, the eyes are the window to the soul. However, wearing masks to prevent the spread of viruses such as COVID-19 involves obscuring a large portion of the face. Do the eyes carry sufficient information to allow for the accurate perception of emotions in dynamic expressions obscured by masks? What about the perception of the meanings of specific smiles? We addressed these questions in two studies. In the first, participants saw dynamic expressions of happiness, disgust, anger, and surprise that were covered by N95, surgical, or cloth masks or were uncovered and rated the extent to which the expressions conveyed each of the same four emotions. Across conditions, participants perceived significantly lower levels of the expressed (target) emotion in masked faces, and this was particularly true for expressions composed of more facial action in the lower part of the face. Higher levels of other (non-target) emotions were also perceived in masked expressions. In the second study, participants rated the extent to which three categories of smiles (reward, affiliation, and dominance) conveyed positive feelings, reassurance, and superiority, respectively. Masked smiles communicated less of the target signal than unmasked smiles, but not more of other possible signals. The present work extends recent studies of the effects of masked faces on the perception of emotion in its novel use of dynamic facial expressions (as opposed to still images) and the investigation of different types of smiles.

Face Masks Do Not Alter Gaze Cueing of Attention: Evidence From the COVID-19 Pandemic

Interacting with others wearing a face mask has become a regular worldwide practice since the beginning of the COVID-19 pandemic. However, the impact of face masks on cognitive mechanisms supporting social interaction is still largely unexplored. In the present work, we focused on gaze cueing of attention, a phenomenon tapping the essential ability which allows individuals to orient their attentional resources in response to eye gaze signals coming from others. Participants from both a European (i.e., Italy; Experiment 1) and an Asian (i.e., China; Experiment 2) country were involved, namely two countries in which the daily use of face masks before COVID-19 pandemic was either extremely uncommon or frequently adopted, respectively. Both samples completed a task in which a peripheral target had to be discriminated while a task irrelevant averted gaze face, wearing a mask or not, acted as a central cueing stimulus. Overall, a reliable and comparable gaze cueing emerged in both experiments, independent of the mask condition. These findings suggest that gaze cueing of attention is preserved even when the person perceived is wearing a face mask.

(Un)mask yourself! Effects of face masks on facial mimicry and emotion perception during the COVID-19 pandemic

Face masks have been said to impact face-to-face interaction negatively. Yet, there is limited evidence on the degree to which partial face occlusion is detrimental to empathic processes such as emotion perception and facial mimicry. To address this question, we conducted an online experiment (N=200, U.K. sample) that assessed subjective ratings and facial expressions (mimicry) in response to masked and unmasked faces. Perceivers were able to recognise happiness and sadness in dynamic emotion expressions independent of (surgical) face masks. However, perceived emotion intensity and interpersonal closeness were reduced for masked faces. Facial mimicry, the perceiver's imitation of the expresser's emotional display, was reduced or absent in response to happy but preserved for sad mask-covered expressions. For happy target expressions, the face-mimicry link was partially mediated by perceived emotion intensity, supporting the idea that mimicry is influenced by context effects. Thus, these findings suggest that whether face masks impede emotion communication depends on the emotion expressed and the emotion-communication aspect of interest. With unprecedented changes in nonverbal communication brought about by the COVID-19 pandemic, this research marks a first contribution to our understanding of facial mimicry as an important social regulator during these times.

The Impact of Face Masks on the Emotional Reading Abilities of Children-A Lesson From a Joint School-University Project

Wearing face masks has become a usual practice in acute infection events inducing the problem of misinterpreting the emotions of others. Empirical evidence about face masks mainly relies on adult data, neglecting, for example, school kids who firmly are dependent on effective nonverbal communication. Here we offer insights from a joint school-university project. Data indicate that emotional reading of 9 to 10 years old pupils (N = 57) was similarly impaired as adults on an overall performance level, but that their selective performance on specific emotions was quite different. Kids showed extreme problems in reading the emotion disgust, strong effects on fear and sadness, and only mild effects on happiness, but also even better performances for emotional states anger and neutral when faces were masked. This project did gain not only relevant data about children's perception but also made clear how fruitful seriously conducted school projects can be to encourage the interest and commitment for Science, Technology, Engineering, and Mathematics (STEM)-relevant topics.

About the Acceptance of Wearing Face Masks in Times of a Pandemic

Wearing face masks in times of COVID-19 is one of the essential keystones for effectively decreasing the rate of new infections and thus for mitigating the negative consequences for individuals as well as for society. Acceptance of wearing masks is still low in many countries, making it extremely difficult to keep the pandemic at bay. In an experimental study, participants (N = 88) had to assess how strange they felt when wearing a face mask while being exposed to displays of groups of varying numbers of mask wearers. Three different types of face masks were shown: simple homemade masks, FFP2 masks, and loop scarfs. The higher the frequency of people wearing masks in the displayed social group, the less strange the participants felt about themselves, an essential precondition for accepting wearing masks. This effect of a descriptive social norm was particularly effective when people saw others wearing less intrusive masks, here, simple homemade masks.