1
|
Bani M, Russo S, Ardenghi S, Rampoldi G, Wickline V, Nowicki S, Strepparava MG. Behind the mask: What the eyes can't tell: Facial emotion recognition in a sample of Italian health care students. Q J Exp Psychol (Hove) 2024; 77:1430-1442. [PMID: 37599379 DOI: 10.1177/17470218231198145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/22/2023]
Abstract
Wearing a facemask remains a pivotal strategy to prevent severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection even after vaccination, but one of the possible costs of this protection is that it may interfere with the ability to read emotion in facial expressions. We explored the extent to which it may be more difficult for participants to read emotions in faces when faces are covered with masks than when they are not, and whether participants' empathy, attachment style, and patient-centred orientation would affect their performance. Medical and nursing students (N = 429) were administered either a masked or unmasked set of 24 adult faces depicting anger, sadness, fear, or happiness. Participants also completed self-report measures of empathy, patient-centredness, and attachment style. As predicted, participants made more errors to the masked than the unmasked faces with the exception of the identification of fear. Of note, when participants missed happiness, they were most likely to see it as sadness, and when they missed anger, they were most likely to see it as happiness. A multiple linear regression analysis showed that more errors identifying emotions in faces was associated with faces being masked as opposed to unmasked, lower scores on the empathy fantasy scale, and higher scores on the fearful attachment style. The findings suggest that wearing facemasks is associated with a variety of negative outcomes that might interfere with the building of positive relationships between health care workers and patients. Those who teach student health care workers would benefit from bringing this finding into their curriculum and training.
Collapse
Affiliation(s)
- Marco Bani
- School of Medicine and Surgery, University of Milano - Bicocca, Milan, Italy
| | - Selena Russo
- School of Medicine and Surgery, University of Milano - Bicocca, Milan, Italy
| | - Stefano Ardenghi
- School of Medicine and Surgery, University of Milano - Bicocca, Milan, Italy
- Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | - Giulia Rampoldi
- School of Medicine and Surgery, University of Milano - Bicocca, Milan, Italy
| | - Virginia Wickline
- Department of Psychology, Georgia Southern University, Savannah, GA, USA
| | - Stephen Nowicki
- Department of Psychology, Emory University, Atlanta, GA, USA
| | - Maria Grazia Strepparava
- School of Medicine and Surgery, University of Milano - Bicocca, Milan, Italy
- Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| |
Collapse
|
2
|
Mastorogianni ME, Konstanti S, Dratsiou I, Bamidis PD. Masked emotions: does children's affective state influence emotion recognition? Front Psychol 2024; 15:1329070. [PMID: 38962230 PMCID: PMC11220387 DOI: 10.3389/fpsyg.2024.1329070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 04/22/2024] [Indexed: 07/05/2024] Open
Abstract
Introduction Facial emotion recognition abilities of children have been the focus of attention across various fields, with implications for communication, social interaction, and human behavior. In response to the COVID-19 pandemic, wearing a face mask in public became mandatory in many countries, hindering social information perception and emotion recognition. Given the importance of visual communication for children's social-emotional development, concerns have been raised on whether face masks could impair their ability to recognize emotions and thereby possibly impact their social-emotional development. Methods To this extent, a quasiexperimental study was designed with a two-fold objective: firstly, to identify children's accuracy in recognizing basic emotions (anger, happiness, fear, disgust, sadness) and emotional neutrality when presented with faces under two conditions: one with no-masks and another with faces partially covered by various types of masks (medical, nonmedical, surgical, or cloth); secondly, to explore any correlation between children's emotion recognition accuracy and their affective state. Sixty-nine (69) elementary school students aged 6-7 years old from Greece were recruited for this purpose. Following specific requirements of the second phase of the experiment students were assigned to one of three (3) distinct affective condition groups: Group A-Happiness, Group B-Sadness, and Group C-Emotional Neutrality. Image stimuli were drawn from the FACES Dataset, and students' affective state was registered using the self-reporting emotions-registration tool, AffectLecture app. Results The study's findings indicate that children can accurately recognize emotions even with masks, although recognizing disgust is more challenging. Additionally, following both positive and negative affective state priming promoted systematic inaccuracies in emotion recognition. Most significantly, results showed a negative bias for children in negative affective state and a positive bias for those in positive affective state. Discussion Children's affective state significantly influenced their emotion recognition abilities; sad affective states led to lower recognition overall and a bias toward recognizing sad expressions, while happy affective states resulted in a positive bias, improving recognition of happiness, and affecting how emotional neutrality and sadness were actually perceived. In conclusion, this study sheds light on the intriguing dynamics of how face masks affect children's emotion recognition, but also underlines the profound influence of their affective state.
Collapse
Affiliation(s)
- Maria Eirini Mastorogianni
- MSc in Learning Technologies-Education Sciences, School of Early Childhood Education, School of Electrical and Computer Engineering, School of Medicine, Aristotle University of Thessaloniki (AUTH), Thessaloniki, Greece
| | - Styliani Konstanti
- MSc in Learning Technologies-Education Sciences, School of Early Childhood Education, School of Electrical and Computer Engineering, School of Medicine, Aristotle University of Thessaloniki (AUTH), Thessaloniki, Greece
| | - Ioanna Dratsiou
- Medical Physics and Digital Innovation Laboratory, School of Medicine, Faculty of Health Sciences, Aristotle University of Thessaloniki (AUTH), Thessaloniki, Greece
| | - Panagiotis D. Bamidis
- Medical Physics and Digital Innovation Laboratory, School of Medicine, Faculty of Health Sciences, Aristotle University of Thessaloniki (AUTH), Thessaloniki, Greece
| |
Collapse
|
3
|
Hodge A, Sutherland R, Ong N, Chan E, Barnett D, Bennett B, Boulton K, Francis D, Guastella A, Papanicolaou A, Tomsic G, Williamsz M, Silove N. Telehealth assessment of autism in preschoolers using the TELE-ASD-PEDS: A pilot clinical investigation. INTERNATIONAL JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2023:1-17. [PMID: 38105699 DOI: 10.1080/17549507.2023.2270187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
PURPOSE Appropriate early intervention is beneficial but dependent on accurate and timely diagnoses. This has been affected by long waiting lists for face-to-face clinical services, in part due to pandemic lockdowns, with telehealth introduced in many services to continue clinical services. This pilot clinical study investigated the feasibility of integrating a specially-designed telepractice autism assessment tool into a tertiary diagnostic service. METHOD Eighteen boys (2;4-5;1) participated in the study. Assessment was undertaken as per standard practice (parent interview, questionnaires, review of reports), with an additional telepractice assessment, included in place of face-to-face assessment, to provide clinicians with an observation of the children's communication, behaviours, and interests. Ten parents provided feedback via semi-structured interviews. RESULT The TELE-ASD-PEDS was a feasible assessment tool in terms of administration, clinical experience, and information gained through the assessment process. Parents reported mostly positive experiences of the TELE-ASD-PEDS and made suggestions for improvements for future use of this tool. CONCLUSION It is possible to obtain useful information about a child's autism-specific behaviours using the activities in the TELE-ASD-PEDS. This information can be combined with clinical history from parents using the DSM-5 framework to provide a gold standard assessment for autism.
Collapse
Affiliation(s)
- Antoinette Hodge
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
| | - Rebecca Sutherland
- Discipline of Speech Pathology, Faculty of Medicine and Health, Univeristy of Sydney, Sydney, Australia
| | - Natalie Ong
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
- Discipline of Speech Pathology, Faculty of Medicine and Health, Univeristy of Sydney, Sydney, Australia
- The School of Women's and Children's Health, University of New South Wales, Sydney, Australia
| | - Esther Chan
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
| | - Diana Barnett
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
| | - Beverley Bennett
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
| | - Kelsie Boulton
- Discipline of Speech Pathology, Faculty of Medicine and Health, Univeristy of Sydney, Sydney, Australia
| | - Deanna Francis
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
- Black Dog Institute, University of New South Wales, Sydney, Australia, and
- School of Psychological Sciences, Macquarie University, Sydney, Australia
| | - Adam Guastella
- Discipline of Speech Pathology, Faculty of Medicine and Health, Univeristy of Sydney, Sydney, Australia
| | - Angela Papanicolaou
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
| | - Gail Tomsic
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
| | - Marcia Williamsz
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
| | - Natalie Silove
- Child Development Unit, The Children's Hospital at Westmead, Westmead, Australia
- Discipline of Speech Pathology, Faculty of Medicine and Health, Univeristy of Sydney, Sydney, Australia
| |
Collapse
|
4
|
Huc M, Bush K, Atias G, Berrigan L, Cox S, Jaworska N. Recognition of masked and unmasked facial expressions in males and females and relations with mental wellness. Front Psychol 2023; 14:1217736. [PMID: 38023041 PMCID: PMC10643509 DOI: 10.3389/fpsyg.2023.1217736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 09/12/2023] [Indexed: 12/01/2023] Open
Abstract
Background While the effects of mask wearing/facial occlusion are known to impair facial expression recognition, little is known about the role of mental wellness on facial expression recognition, as well as the influence of sex on misattribution errors (i.e., confusions between emotions). In this large study, we aimed to address the relation between facial expression recognition and loneliness, perceived stress, anxiety, and depression symptoms in male and female adults. Methods We assessed the influence of mask-wearing on facial expression recognition [i.e., accuracy and response time (RT)] via an online study in N = 469 adult males and females across Canada. Results Expectedly, recognition was impaired under masked conditions (i.e., lower accuracy, longer RTs, more misattribution errors). Females were faster and more accurate than males, with less misattribution errors. A novel finding was that people with higher perceived stress were less accurate at identifying masked fearful faces. Perceived stress influenced the relation between sex and RT to masked happy faces; males with high stress scores were slower to recognize masked happy faces, the opposite was true for females. Finally, this study was among the first to show that higher loneliness predicted shorter RT to unmasked faces. Impact Our results show that facial expression recognition is impaired by mask-wearing, and that sex and mental health features are important predictors of performance. Such insight could be detrimental in certain sectors of the population (e.g., health care or education), and inform policies being adopted in future pandemics.
Collapse
Affiliation(s)
- Marie Huc
- University of Ottawa Institute of Mental Health Research, Ottawa, ON, Canada
- Department of Neuroscience, Carleton University, Ottawa, ON, Canada
| | - Katie Bush
- University of Ottawa Institute of Mental Health Research, Ottawa, ON, Canada
| | - Gali Atias
- University of Ottawa Institute of Mental Health Research, Ottawa, ON, Canada
| | - Lindsay Berrigan
- Department of Psychology, St Francis Xavier University, Antigonish, NS, Canada
- Department of Psychiatry, Dalhousie University, Halifax, NS, Canada
| | - Sylvia Cox
- Department of Psychiatry, McGill University, Montreal, QC, Canada
- Department of Psychology, Dawson College, Montreal, QC, Canada
| | - Natalia Jaworska
- University of Ottawa Institute of Mental Health Research, Ottawa, ON, Canada
- Department of Neuroscience, Carleton University, Ottawa, ON, Canada
- Department of Psychiatry, Dalhousie University, Halifax, NS, Canada
- Department of Cellular & Molecular Medicine, University of Ottawa, Ottawa, ON, Canada
| |
Collapse
|
5
|
Kastendieck T, Dippel N, Asbrand J, Hess U. Influence of child and adult faces with face masks on emotion perception and facial mimicry. Sci Rep 2023; 13:14848. [PMID: 37684246 PMCID: PMC10491609 DOI: 10.1038/s41598-023-40007-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Accepted: 08/03/2023] [Indexed: 09/10/2023] Open
Abstract
Emotional mimicry, the imitation of others' emotion expressions, is related to increased interpersonal closeness and better interaction quality. Yet, little research has focused on the effect of face masks on emotional mimicry and none on (masked) child faces. To address this gap, we conducted an online experiment (N = 235, German sample, adult perceivers). Masks reduced emotion recognition accuracy for all expressions, except in the case of anger in masked child faces, where perceived anger was even increased. Perceived interpersonal closeness was reduced for masked happy and sad faces. For both child and adult expressers, masks reduced facial mimicry of happy expressions, with no mask effects for sadness and anger expression. A stronger mask effect on facial happiness mimicry of child faces was mediated by the degree of emotion recognition accuracy. Smiles shown by masked children were not recognized well, likely due to the absence of wrinkles around the eyes in child faces. Independent of masks, sadness shown by children was mimicked even more strongly than when shown by adults. These results provide evidence for facial mimicry of child expressions by adult perceivers and show that the effects of face masks on emotion communication may vary when children wear them.
Collapse
Affiliation(s)
- Till Kastendieck
- Department of Psychology, Social and Organizational Psychology, Humboldt-Universität zu Berlin, Berlin, Germany.
| | - Nele Dippel
- Clinic for Psychiatry, Psychosomatics, and Psychotherapy of Childhood and Adolescence, Charité Universitätsmedizin Berlin, Berlin, Germany
| | - Julia Asbrand
- Department of Psychology, Clinical Psychology of Childhood and Adolescence, Friedrich-Schiller-University Jena, Jena, Germany
| | - Ursula Hess
- Department of Psychology, Social and Organizational Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
6
|
Ikeda S. Social sensitivity predicts accurate emotion inference from facial expressions in a face mask: a study in Japan. CURRENT PSYCHOLOGY 2023; 43:1-10. [PMID: 36819755 PMCID: PMC9926429 DOI: 10.1007/s12144-023-04344-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 01/19/2023] [Accepted: 01/27/2023] [Indexed: 02/16/2023]
Abstract
Most prior research examining whether emotions can be accurately inferred from facial expressions with masks have been conducted with Western samples. Thus, there is a current lack of studies on this topic, as well as on factors affecting individual differences in the accuracy of emotion inference, among non-Western samples. This study examined the effects of social anxiety and social sensitivity on the accuracy of emotion inference from masked facial expressions in a Japanese sample. The results showed that wearing a mask made it difficult to identify the emotions of sadness and fear, happy and neutral expressions remained unaffected, and angry expressions were read more accurately. Further, while the findings show that a general higher ability to infer emotions from facial expressions may help ensure the accuracy of emotion inference from facial expressions with a mask, social sensitivity directly predicted the accuracy of emotion inference from facial expressions with a mask. These findings suggest that people who can infer complex mental states of others from subtle cues may be less susceptible to the effects of face masks.
Collapse
Affiliation(s)
- Shinnosuke Ikeda
- Faculty of Humanities, Kyoto University of Advanced Science, Gotanda-chou, Yamanouchi, Ukyo-ku, 18, Kyoto, Japan
| |
Collapse
|
7
|
Davis JD, Coulson S, Blaison C, Hess U, Winkielman P. Mimicry of partially occluded emotional faces: do we mimic what we see or what we know? Cogn Emot 2022; 36:1555-1575. [PMID: 36300446 DOI: 10.1080/02699931.2022.2135490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Facial electromyography (EMG) was used to investigate patterns of facial mimicry in response to partial facial expressions in two contexts that differ in how naturalistic and socially significant the faces are. Experiment 1 presented participants with either the upper- or lower-half of facial expressions and used a forced-choice emotion categorisation task. This task emphasises cognition at the expense of ecological and social validity. Experiment 2 presented whole heads and expressions were occluded by clothing. Additionally, the emotion recognition task is more open-ended. This context has greater social validity. We found mimicry in both experiments, however mimicry differed in terms of which emotions were mimicked and the extent to which the mimicry involved muscle sites that were not observed. In the more cognitive context, there was relatively more motor matching (i.e. mimicking only what was seen). In the more socially valid context, participants were less likely to mimic only what they saw - and instead mimicked what they knew. Additionally, participants mimicked anger in the cognitive context but not the social context. These findings suggest that mimicry involves multiple mechanisms and that the more social the context, the more likely it is to reflect a mechanism of social regulation.
Collapse
Affiliation(s)
- Joshua D Davis
- Cognitive Science Department, University of California, San Diego, San Diego, USA
- Social and Behavioral Sciences Department, Southwestern College, Chula Vista, CA, USA
| | - Seana Coulson
- Cognitive Science Department, University of California, San Diego, San Diego, USA
| | | | - Ursula Hess
- Psychology Department, Humboldt University, Berlin, Germany
| | - Piotr Winkielman
- Psychology Department, University of California, San Diego, San Diego, USA
- Psychology Department, SWPS University of Social Sciences and Humanities, Warsaw, Poland
| |
Collapse
|
8
|
Geers L, Coello Y. The influence of face mask on social spaces depends on the behavioral immune system. Front Neurosci 2022; 16:991578. [PMID: 36440271 PMCID: PMC9691846 DOI: 10.3389/fnins.2022.991578] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Accepted: 10/26/2022] [Indexed: 02/18/2024] Open
Abstract
Interacting with objects and people requires specifying localized spaces where these interactions can take place. Previous studies suggest that the space for interacting with objects (i.e., the peripersonal space) contributes to defining the space for interacting with people (i.e., personal and interpersonal spaces). Furthermore, situational factors, such as wearing a face mask, have been shown to influence social spaces, but how they influence the relation between action and social spaces and are modulated by individual factors is still not well understood. In this context, the present study investigated the relationship between action peripersonal and social personal and interpersonal spaces in participants approached by male and female virtual characters wearing or not wearing a face mask. We also measured individual factors related to the behavioral immune system, namely willingness to take risks, perceived infectability and germ aversion. The results showed that compared to peripersonal space, personal space was smaller and interpersonal space was larger, but the three spaces were positively correlated. All spaces were altered by gender, being shorter when participants faced female characters. Personal and interpersonal spaces were reduced with virtual characters wearing a face mask, especially in participants highly aversive to risks and germs. Altogether, these findings suggest that the regulation of the social spaces depends on the representation of action peripersonal space, but with an extra margin that is modulated by situational and personal factors in relation to the behavioral immune system.
Collapse
Affiliation(s)
| | - Yann Coello
- Univ. Lille, CNRS, UMR 9193 - SCALab - Sciences Cognitives et Sciences Affectives, Lille, France
| |
Collapse
|
9
|
Castellano G, De Carolis B, Macchiarulo N. Automatic facial emotion recognition at the COVID-19 pandemic time. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:12751-12769. [PMID: 36313484 PMCID: PMC9589699 DOI: 10.1007/s11042-022-14050-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Revised: 09/23/2022] [Accepted: 10/06/2022] [Indexed: 06/16/2023]
Abstract
People use various nonverbal communicative channels to convey emotions, among which facial expressions are considered the most important ones. Thus, automatic Facial Expression Recognition (FER) is a fundamental task to increase the perceptive skills of computers, especially in human-computer interaction. Like humans, state-of-art FER systems are able to recognize emotions from the entire face of a person. However, the COVID-19 pandemic has imposed a massive use of face masks that help in preventing infection but may hamper social communication and make the recognition of facial expressions a very challenging task due to facial occlusion. In this paper we propose a FER system capable to recognize emotions from masked faces. The system checks for the presence of a mask on the face image and, in case of mask detection, it extracts the eyes region and recognizes the emotion only considering that portion of the face. The effectiveness of the developed FER system was tested in recognizing emotions and their valence only from the eyes region and comparing the results when considering the entire face. As it was expected, emotions that are related mainly to the mouth region (e.g., disgust) are barely recognized, while positive emotions are better identified by considering only the eyes region. Moreover, we compared the results of our FER system to the human annotation of emotions on masked faces. We found out that the FER system outperforms the human annotation, thus showing that the model is able to learn proper features for each emotion leveraging only the eyes region.
Collapse
Affiliation(s)
| | | | - Nicola Macchiarulo
- Department of Computer Science, University of Bari, Bari, Italy
- Exprivia S.p.A., Molfetta, Italy
| |
Collapse
|
10
|
Verroca A, de Rienzo CM, Gambarota F, Sessa P. Mapping the perception-space of facial expressions in the era of face masks. Front Psychol 2022; 13:956832. [PMID: 36176786 PMCID: PMC9514388 DOI: 10.3389/fpsyg.2022.956832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Accepted: 08/05/2022] [Indexed: 11/28/2022] Open
Abstract
With the advent of the severe acute respiratory syndrome-Corona Virus type 2 (SARS-CoV-2) pandemic, the theme of emotion recognition from facial expressions has become highly relevant due to the widespread use of face masks as one of the main devices imposed to counter the spread of the virus. Unsurprisingly, several studies published in the last 2 years have shown that accuracy in the recognition of basic emotions expressed by faces wearing masks is reduced. However, less is known about the impact that wearing face masks has on the ability to recognize emotions from subtle expressions. Furthermore, even less is known regarding the role of interindividual differences (such as alexithymic and autistic traits) in emotion processing. This study investigated the perception of all the six basic emotions (anger, disgust, fear, happiness, sadness, and surprise), both as a function of the face mask and as a function of the facial expressions’ intensity (full vs. subtle) in terms of participants’ uncertainty in their responses, misattribution errors, and perceived intensity. The experiment was conducted online on a large sample of participants (N = 129). Participants completed the 20-item Toronto Alexithymia Scale and the Autistic Spectrum Quotient and then performed an emotion-recognition task that involved face stimuli wearing a mask or not, and displaying full or subtle expressions. Each face stimulus was presented alongside the Geneva Emotion Wheel (GEW), and participants had to indicate what emotion they believed the other person was feeling and its intensity using the GEW. For each combination of our variables, we computed the indices of ‘uncertainty’ (i.e., the spread of responses around the correct emotion category), ‘bias’ (i.e., the systematic errors in recognition), and ‘perceived intensity’ (i.e., the distance from the center of the GEW). We found that face masks increase uncertainty for all facial expressions of emotion, except for fear when intense, and that disgust was systematically confused with anger (i.e., response bias). Furthermore, when faces were covered by the mask, all the emotions were perceived as less intense, and this was particularly evident for subtle expressions. Finally, we did not find any evidence of a relationship between these indices and alexithymic/autistic traits.
Collapse
Affiliation(s)
- Alessia Verroca
- Department of Developmental and Social Psychology, University of Padova, Padova, Italy
| | | | - Filippo Gambarota
- Department of Developmental and Social Psychology, University of Padova, Padova, Italy
- Padova Neuroscience Center (PNC), University of Padova, Padova, Italy
| | - Paola Sessa
- Department of Developmental and Social Psychology, University of Padova, Padova, Italy
- Padova Neuroscience Center (PNC), University of Padova, Padova, Italy
- *Correspondence: Paola Sessa,
| |
Collapse
|
11
|
Miyazaki Y, Kamatani M, Suda T, Wakasugi K, Matsunaga K, Kawahara JI. Effects of wearing a transparent face mask on perception of facial expressions. Iperception 2022; 13:20416695221105910. [PMID: 35782828 PMCID: PMC9243485 DOI: 10.1177/20416695221105910] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Accepted: 05/22/2022] [Indexed: 11/17/2022] Open
Abstract
Wearing face masks in public has become the norm in many countries post-2020. Although mask-wearing is effective in controlling infection, it has the negative side effect of occluding the mask wearer’s facial expressions. The purpose of this study was to investigate the effects of wearing transparent masks on the perception of facial expressions. Participants were required to categorize the perceived facial emotion of female (Experiment 1) and male (Experiment 2) faces with different facial expressions and to rate the perceived emotion intensity of the faces. Based on the group, the participants were assigned to, the faces were presented with a surgical mask, a transparent mask, or without a mask. The results showed that wearing a surgical mask impaired the performance of reading facial expressions, both with respect to recognition and perceived intensity of facial emotions. Specifically, the impairments were robustly observed in fear and happy faces for emotion recognition, and in happy faces for perceived intensity of emotion in Experiments 1 and 2. However, the impairments were moderated by wearing a transparent mask instead of a surgical mask. During the coronavirus disease 2019 (COVID-19) pandemic, the transparent mask can be used in a range of situations where face-to-face communication is important.
Collapse
Affiliation(s)
- Yuki Miyazaki
- Department of Psychology, Fukuyama University, Fukuyama, Japan
| | - Miki Kamatani
- Graduate School of Letters, Hokkaido University, Sapporo, Japan
| | - Tomokazu Suda
- Global Research & Development Division, Unicharm Corporation, Kanonji, Japan
| | - Kei Wakasugi
- Global Research & Development Division, Unicharm Corporation, Kanonji, Japan
| | - Kaori Matsunaga
- Global Research & Development Division, Unicharm Corporation, Kanonji, Japan
| | - Jun I. Kawahara
- Graduate School of Letters, Hokkaido University, Sapporo, Japan
| |
Collapse
|
12
|
Anthropomorphic Robotic Eyes: Structural Design and Non-Verbal Communication Effectiveness. SENSORS 2022; 22:s22083060. [PMID: 35459046 PMCID: PMC9024502 DOI: 10.3390/s22083060] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 04/05/2022] [Accepted: 04/12/2022] [Indexed: 02/04/2023]
Abstract
This paper shows the structure of a mechanical system with 9 DOFs for driving robot eyes, as well as the system’s ability to produce facial expressions. It consists of three subsystems which enable the motion of the eyeballs, eyelids, and eyebrows independently to the rest of the face. Due to its structure, the mechanical system of the eyeballs is able to reproduce all of the motions human eyes are capable of, which is an important condition for the realization of binocular function of the artificial robot eyes, as well as stereovision. From a kinematic standpoint, the mechanical systems of the eyeballs, eyelids, and eyebrows are highly capable of generating the movements of the human eye. The structure of a control system is proposed with the goal of realizing the desired motion of the output links of the mechanical systems. The success of the mechanical system is also rated on how well it enables the robot to generate non-verbal emotional content, which is why an experiment was conducted. Due to this, the face of the human-like robot MARKO was used, covered with a face mask to aid in focusing the participants on the eye region. The participants evaluated the efficiency of the robot’s non-verbal communication, with certain emotions achieving a high rate of recognition.
Collapse
|
13
|
Blazhenkova O, Dogerlioglu-Demir K, Booth RW. Masked emotions: Do face mask patterns and colors affect the recognition of emotions? Cogn Res Princ Implic 2022; 7:33. [PMID: 35394218 PMCID: PMC8990494 DOI: 10.1186/s41235-022-00380-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 03/13/2022] [Indexed: 12/30/2022] Open
Abstract
Previous research has shown that face masks impair the ability to perceive social information and the readability of emotions. These studies mostly explored the effect of standard medical, often white, masks on emotion recognition. However, in reality, many individuals prefer masks with different styles. We investigated whether the appearance of the mask (pattern: angular vs. curvy and color: black vs. white) affected the recognition of emotional states. Participants were asked to identify the emotions on faces covered by masks with different designs. The presence of masks resulted in decreasing accuracy and confidence and increasing reaction times, indicating that masks impair emotion recognition. There were no significant effects of angularity versus curvature or color on emotion recognition, which suggests that mask design may not impair the recognition beyond the effect of mere mask wearing. Besides, we found relationships between individual difference variables such as mask wearing attitudes, mask design preferences, individual traits and emotion recognition. The majority of participants demonstrated positive attitudes toward mask wearing and preferred non-patterned black and white masks. Preferences for white masks were associated with better emotion recognition of masked faces. In contrast, those with negative attitudes toward masks showed marginally poorer performance in emotion recognition for masked faces, and preferred patterned more than plain masks, perhaps viewing masks as a fashion item rather than a necessity. Moreover, preferences to wear patterned masks were negatively related to actual wearing of masks indoors and perceived risks of COVID.
Collapse
Affiliation(s)
- Olesya Blazhenkova
- Faculty of Arts and Social Sciences, Sabanci University, Orta Mahalle, Üniversite Caddesi No:27, 34956, Tuzla-Istanbul, Turkey.
| | - Kivilcim Dogerlioglu-Demir
- Sabanci Business School, Sabanci University, Orta Mahalle, Üniversite Caddesi No:27, 34956, Tuzla-Istanbul, Turkey
| | - Robert W Booth
- Faculty of Arts and Social Sciences, Sabanci University, Orta Mahalle, Üniversite Caddesi No:27, 34956, Tuzla-Istanbul, Turkey
| |
Collapse
|
14
|
Carbon CC, Held MJ, Schütz A. Reading Emotions in Faces With and Without Masks Is Relatively Independent of Extended Exposure and Individual Difference Variables. Front Psychol 2022; 13:856971. [PMID: 35369259 PMCID: PMC8967961 DOI: 10.3389/fpsyg.2022.856971] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 02/23/2022] [Indexed: 12/30/2022] Open
Abstract
The ability to read emotions in faces helps humans efficiently assess social situations. We tested how this ability is affected by aspects of familiarization with face masks and personality, with a focus on emotional intelligence (measured with an ability test, the MSCEIT, and a self-report scale, the SREIS). To address aspects of the current pandemic situation, we used photos of not only faces per se but also of faces that were partially covered with face masks. The sample (N = 49), the size of which was determined by an a priori power test, was recruited in Germany and consisted of healthy individuals of different ages [M = 24.8 (18-64) years]. Participants assessed the emotional expressions displayed by six different faces determined by a 2 (sex) × 3 (age group: young, medium, and old) design. Each person was presented with six different emotional displays (angry, disgusted, fearful, happy, neutral, and sad) with or without a face mask. Accuracy and confidence were lower with masks-in particular for the emotion disgust (very often misinterpreted as anger) but also for happiness, anger, and sadness. When comparing the present data collected in July 2021 with data from a different sample collected in May 2020, when people first started to familiarize themselves with face masks in Western countries during the first wave of the COVID-19 pandemic, we did not detect an improvement in performance. There were no effects of participants' emotional intelligence, sex, or age regarding their accuracy in assessing emotional states in faces for unmasked or masked faces.
Collapse
Affiliation(s)
- Claus-Christian Carbon
- Department of Psychology, University of Bamberg, Bamberg, Germany
- Bamberg Graduate School of Affective and Cognitive Sciences (BaGrACS), Bamberg, Germany
| | - Marco Jürgen Held
- Department of Psychology, University of Bamberg, Bamberg, Germany
- Bamberg Graduate School of Affective and Cognitive Sciences (BaGrACS), Bamberg, Germany
| | - Astrid Schütz
- Department of Psychology, University of Bamberg, Bamberg, Germany
- Bamberg Graduate School of Affective and Cognitive Sciences (BaGrACS), Bamberg, Germany
| |
Collapse
|