The Human Face as a Dynamic Tool for Social Communication

Sensitivity to trustworthiness cues in own- and other-race faces: The role of spatial frequency information

Research has shown that adults are better at processing faces of the most represented ethnic group in their social environment compared to faces from other ethnicities, and that they rely more on holistic/configural information for identity discrimination in own-race than other-race faces. Here, we applied a spatial filtering approach to the investigation of trustworthiness perception to explore whether the information on which trustworthiness judgments are based differs according to face race. European participants (N = 165) performed an online-delivered pairwise preference task in which they were asked to select the face they would trust more within pairs randomly selected from validated White and Asian broad spectrum, low-pass filter and high-pass filter trustworthiness continua. Results confirmed earlier demonstrations that trustworthiness perception generalizes across face ethnicity, but discrimination of trustworthiness intensity relied more heavily on the LSF content of the images for own-race faces compared to other-race faces. Results are discussed in light of previous work on emotion discrimination and the hypothesis of overlapping perceptual mechanisms subtending social perception of faces.

Stratifying the autistic phenotype using electrophysiological indices of social perception

Autism spectrum disorder (ASD) is a neurodevelopmental condition characterized by difficulties in social communication, but also great heterogeneity. To offer individualized medicine approaches, we need to better target interventions by stratifying autistic people into subgroups with different biological profiles and/or prognoses. We sought to validate neural responses to faces as a potential stratification factor in ASD by measuring neural (electroencephalography) responses to faces (critical in social interaction) in N = 436 children and adults with and without ASD. The speed of early-stage face processing (N170 latency) was on average slower in ASD than in age-matched controls. In addition, N170 latency was associated with responses to faces in the fusiform gyrus, measured with functional magnetic resonance imaging, and polygenic scores for ASD. Within the ASD group, N170 latency predicted change in adaptive socialization skills over an 18-month follow-up period; data-driven clustering identified a subgroup with slower brain responses and poor social prognosis. Use of a distributional data-driven cutoff was associated with predicted improvements of power in simulated clinical trials targeting social functioning. Together, the data provide converging evidence for the utility of the N170 as a stratification factor to identify biologically and prognostically defined subgroups in ASD.

An Exploratory Analysis of the Neural Correlates of Human-Robot Interactions With Functional Near Infrared Spectroscopy

Functional near infrared spectroscopy (fNIRS) has been gaining increasing interest as a practical mobile functional brain imaging technology for understanding the neural correlates of social cognition and emotional processing in the human prefrontal cortex (PFC). Considering the cognitive complexity of human-robot interactions, the aim of this study was to explore the neural correlates of emotional processing of congruent and incongruent pairs of human and robot audio-visual stimuli in the human PFC with fNIRS methodology. Hemodynamic responses from the PFC region of 29 subjects were recorded with fNIRS during an experimental paradigm which consisted of auditory and visual presentation of human and robot stimuli. Distinct neural responses to human and robot stimuli were detected at the dorsolateral prefrontal cortex (DLPFC) and orbitofrontal cortex (OFC) regions. Presentation of robot voice elicited significantly less hemodynamic response than presentation of human voice in a left OFC channel. Meanwhile, processing of human faces elicited significantly higher hemodynamic activity when compared to processing of robot faces in two left DLPFC channels and a left OFC channel. Significant correlation between the hemodynamic and behavioral responses for the face-voice mismatch effect was found in the left OFC. Our results highlight the potential of fNIRS for unraveling the neural processing of human and robot audio-visual stimuli, which might enable optimization of social robot designs and contribute to elucidation of the neural processing of human and robot stimuli in the PFC in naturalistic conditions.

Are Face Masks a Problem for Emotion Recognition? Not When the Whole Body Is Visible

The rise of the novel COVID-19 virus has made face masks commonplace items around the globe. Recent research found that face masks significantly impair emotion recognition on isolated faces. However, faces are rarely seen in isolation and the body is also a key cue for emotional portrayal. Here, therefore, we investigated the impact of face masks on emotion recognition when surveying the full body. Stimuli expressing anger, happiness, sadness, and fear were selected from the BEAST stimuli set. Masks were added to these images and participants were asked to recognize the emotion and give a confidence level for that decision for both the masked and unmasked stimuli. We found that, contrary to some work viewing faces in isolation, emotion recognition was generally not impaired by face masks when the whole body is present. We did, however, find that when viewing masked faces, only the recognition of happiness significantly decreased when the whole body was present. In contrast to actual performance, confidence levels were found to decline during the Mask condition across all emotional conditions. This research suggests that the impact of masks on emotion recognition may not be as pronounced as previously thought, as long as the whole body is also visible.

Don't look now! Emotion-induced blindness: The interplay between emotion and attention

Scientists have long been interested in understanding the influence of emotionally salient stimuli on attention and perception. One experimental paradigm that has shown great promise in demonstrating the effect of such stimuli is emotion-induced blindness. That is, when emotionally salient stimuli are presented in a rapid stream of stimuli, they produce impairments in the perception of task-relevant stimuli, even though they themselves are task irrelevant. This is known as emotion-induced blindness, and it is a profound and robust form of attentional bias. Here, we review the literature on emotion-induced blindness, such as identifying the types of stimuli that elicit it, and its temporal dynamics. We discuss the role of dimensional versus categorical approaches to emotion in relation to emotion-induced blindness. We also synthesize the work examining whether certain individuals, such as those high in anxiety versus psychopathy, succumb to emotion-induced blindness to different extents, and we discuss whether the deficit can be reduced or even abolished. We review the theoretical models that have been proposed to explain the phenomenon. Finally, we identify exciting questions for future research, and elucidate useful frameworks to guide future investigations.

High-definition transcranial direct current stimulation modulates eye gaze on emotional faces in college students with alexithymia: An eye-tracking study

BACKGROUND

Atypical eye gaze on emotional faces is a core feature of alexithymia. The inferior frontal gyrus (IFG) is considered to be the neurophysiological basis of alexithymia-related emotional face fixation. Our aim was to examine whether anodal high-definition transcranial direct current stimulation (HD-tDCS) administered to the right (r)IFG would facilitate eye gaze of emotional faces in alexithymia individuals.

METHOD

Forty individuals with alexithymia were equally assigned to anodal or sham HD-tDCS of the rIFG according to the principle of randomization. The individuals then completed a free-viewing eye tracking task (including happy, sad, and neutral faces) before and after 5 consecutive days of stimulation (twice a day).

RESULTS

The results showed that twice a day anodal HD-tDCS of the rIFG significantly increased the fixation time and fixation count of the eye area on happy and neutral faces, but there was no significant effect on sad faces. According to the temporal-course analysis, after the intervention, the fixation time on neutral faces increased significantly at almost all time points of the eye tracking task. For happy faces, the improvement was demonstrated between 500 and 1000 ms and between 2500 and 3500 ms. For sad faces, the fixation time improved but not significantly.

CONCLUSIONS

Applying high-dose anodal HD-tDCS to the rIFG selectively facilitated eye gaze in the eye area of neutral and happy faces in individuals with alexithymia, which may improve their face processing patterns.

Representation of expression and identity by ventral prefrontal neurons

Evidence has suggested that the ventrolateral prefrontal cortex (VLPFC) processes social stimuli, including faces and vocalizations, which are essential for communication. Features embedded within audiovisual stimuli, including emotional expression and caller identity, provide abundant information about an individual's intention, emotional state, motivation, and social status, which are important to encode in a social exchange. However, it is unknown to what extent the VLPFC encodes such features. To investigate the role of VLPFC during social communication, we recorded single-unit activity while rhesus macaques (Macaca mulatta) performed a nonmatch-to-sample task using species-specific face-vocalization stimuli that differed in emotional expression or caller identity. 75% of recorded cells were task-related and of these >70% were responsive during the nonmatch period. A larger proportion of nonmatch cells encoded the stimulus rather than the context of the trial type. A subset of responsive neurons were most commonly modulated by the identity of the nonmatch stimulus and less by the emotional expression, or both features within the face-vocalization stimuli presented during the nonmatch period. Neurons encoding identity were found in VLPFC across a broader region than expression related cells which were confined to only the anterolateral portion of the recording chamber in VLPFC. These findings suggest that, within a working memory paradigm, VLPFC processes features of face and vocal stimuli, such as emotional expression and identity, in addition to task and contextual information. Thus, stimulus and contextual information may be integrated by VLPFC during social communication.

Relative tuning of holistic face processing towards the fovea

Humans quickly detect and gaze at faces in the world, which reflects their importance in cognition and may lead to tuning of face recognition toward the central visual field. Although sometimes reported, foveal selectivity in face processing is debated: brain imaging studies have found evidence for a central field bias specific to faces, but behavioral studies have found little foveal selectivity in face recognition. These conflicting results are difficult to reconcile, but they could arise from stimulus-specific differences. Recent studies, for example, suggest that individual faces vary in the degree to which they require holistic processing. Holistic processing is the perception of faces as a whole rather than as a set of separate features. We hypothesized that the dissociation between behavioral and neuroimaging studies arises because of this stimulus-specific dependence on holistic processing. Specifically, the central bias found in neuroimaging studies may be specific to holistic processing. Here, we tested whether the eccentricity-dependence of face perception is determined by the degree to which faces require holistic processing. We first measured the holistic-ness of individual Mooney faces (two-tone shadow images readily perceived as faces). In a group of independent observers, we then used a gender discrimination task to measured recognition of these Mooney faces as a function of their eccentricity. Face gender was recognized across the visual field, even at substantial eccentricities, replicating prior work. Importantly, however, holistic face gender recognition was relatively tuned-slightly, but reliably stronger in the central visual field. Our results may reconcile the debate on the eccentricity-dependance of face perception and reveal a spatial inhomogeneity specifically in the holistic representations of faces.

Atypical Functional Connectivity During Unfamiliar Music Listening in Children With Autism

Background

Atypical processing of unfamiliar, but less so familiar, stimuli has been described in Autism Spectrum Disorder (ASD), in particular in relation to face processing. We examined the construct of familiarity in ASD using familiar and unfamiliar songs, to investigate the link between familiarity and autism symptoms, such as repetitive behavior.

Methods

Forty-eight children, 24 with ASD (21 males, mean age = 9.96 years ± 1.54) and 24 typically developing (TD) controls (21 males, mean age = 10.17 ± 1.90) completed a music familiarity task using individually identified familiar compared to unfamiliar songs, while magnetoencephalography (MEG) was recorded. Each song was presented for 30 s. We used both amplitude envelope correlation (AEC) and the weighted phase lag index (wPLI) to assess functional connectivity between specific regions of interest (ROI) and non-ROI parcels, as well as at the whole brain level, to understand what is preserved and what is impaired in familiar music listening in this population.

Results

Increased wPLI synchronization for familiar vs. unfamiliar music was found for typically developing children in the gamma frequency. There were no significant differences within the ASD group for this comparison. During the processing of unfamiliar music, we demonstrated left lateralized increased theta and beta band connectivity in children with ASD compared to controls. An interaction effect found greater alpha band connectivity in the TD group compared to ASD to unfamiliar music only, anchored in the left insula.

Conclusion

Our results revealed atypical processing of unfamiliar songs in children with ASD, consistent with previous studies in other modalities reporting that processing novelty is a challenge for ASD. Relatively typical processing of familiar stimuli may represent a strength and may be of interest to strength-based intervention planning.

Caricatured facial movements enhance perception of emotional facial expressions

Although faces “in the wild” constantly undergo complicated movements, humans adeptly perceive facial identity and expression. Previous studies, focusing mainly on identity, used photographic caricature to show that distinctive form increases perceived dissimilarity. We tested whether distinctive facial movements showed similar effects, and we focussed on both perception of expression and identity. We caricatured the movements of an animated computer head, using physical motion metrics extracted from videos. We verified that these “ground truth” metrics showed the expected effects: Caricature increased physical dissimilarity between faces differing in expression and those differing in identity. Like the ground truth dissimilarity, participants’ dissimilarity perception was increased by caricature when faces differed in expression. We found these perceived dissimilarities to reflect the “representational geometry” of the ground truth. However, neither of these findings held for faces differing in identity. These findings replicated across two paradigms: pairwise ratings and multiarrangement. In a final study, motion caricature did not improve recognition memory for identity, whether manipulated at study or test. We report several forms of converging evidence for spatiotemporal caricature effects on dissimilarity perception of different expressions. However, more work needs to be done to discover what identity-specific movements can enhance face identification.

How Can Research on Artificial Empathy Be Enhanced by Applying Deepfakes?

We propose the idea of using an open data set of doctor-patient interactions to develop artificial empathy based on facial emotion recognition. Facial emotion recognition allows a doctor to analyze patients' emotions, so that they can reach out to their patients through empathic care. However, face recognition data sets are often difficult to acquire; many researchers struggle with small samples of face recognition data sets. Further, sharing medical images or videos has not been possible, as this approach may violate patient privacy. The use of deepfake technology is a promising approach to deidentifying video recordings of patients’ clinical encounters. Such technology can revolutionize the implementation of facial emotion recognition by replacing a patient's face in an image or video with an unrecognizable face—one with a facial expression that is similar to that of the original. This technology will further enhance the potential use of artificial empathy in helping doctors provide empathic care to achieve good doctor-patient therapeutic relationships, and this may result in better patient satisfaction and adherence to treatment.

Wearing N95, Surgical, and Cloth Face Masks Compromises the Perception of Emotion

According to the familiar axiom, the eyes are the window to the soul. However, wearing masks to prevent the spread of viruses such as COVID-19 involves obscuring a large portion of the face. Do the eyes carry sufficient information to allow for the accurate perception of emotions in dynamic expressions obscured by masks? What about the perception of the meanings of specific smiles? We addressed these questions in two studies. In the first, participants saw dynamic expressions of happiness, disgust, anger, and surprise that were covered by N95, surgical, or cloth masks or were uncovered and rated the extent to which the expressions conveyed each of the same four emotions. Across conditions, participants perceived significantly lower levels of the expressed (target) emotion in masked faces, and this was particularly true for expressions composed of more facial action in the lower part of the face. Higher levels of other (non-target) emotions were also perceived in masked expressions. In the second study, participants rated the extent to which three categories of smiles (reward, affiliation, and dominance) conveyed positive feelings, reassurance, and superiority, respectively. Masked smiles communicated less of the target signal than unmasked smiles, but not more of other possible signals. The present work extends recent studies of the effects of masked faces on the perception of emotion in its novel use of dynamic facial expressions (as opposed to still images) and the investigation of different types of smiles.

A Systematic Review of the Role of Oxytocin, Cortisol, and Testosterone in Facial Emotional Processing

A topic of interest is the way decoding and interpreting facial emotional expressions can lead to mutual understanding. Facial emotional expression is a basic source of information that guarantees the functioning of other higher cognitive processes (e.g., empathy, cooperativity, prosociality, or decision-making, among others). In this regard, hormones such as oxytocin, cortisol, and/or testosterone have been found to be important in modifying facial emotion processing. In fact, brain structures that participate in facial emotion processing have been shown to be rich in receptors for these hormones. Nonetheless, much of this research has been based on correlational designs. In recent years, a growing number of researchers have tried to carry out controlled laboratory manipulation of these hormones by administering synthetic forms of these hormones. The main objective of this study was to carry out a systematic review of studies that assess whether manipulation of these three hormones effectively promotes significant alterations in facial emotional processing. To carry out this review, PRISMA quality criteria for reviews were followed, using the following digital databases: PsycINFO, PubMed, Dialnet, Psicodoc, Web of Knowledge, and the Cochrane Library, and focusing on manuscripts with a robust research design (e.g., randomized, single- or double-blind, and/or placebo-controlled) to increase the value of this systematic review. An initial identification of 6340 abstracts and retrieval of 910 full texts led to the final inclusion of 101 papers that met all the inclusion criteria. Only about 18% of the manuscripts included reported a direct effect of hormone manipulation. In fact, emotional accuracy seemed to be enhanced after oxytocin increases, but it diminished when cortisol and/or testosterone increased. Nonetheless, when emotional valence and participants' gender were included, hormonal manipulation reached significance (in around 53% of the articles). In fact, these studies offered a heterogeneous pattern in the way these hormones altered speed processing, attention, and memory. This study reinforces the idea that these hormones are important, but not the main modulators of facial emotion processing. As our comprehension of hormonal effects on emotional processing improves, the potential to design good treatments to improve this ability will be greater.

Three-Dimensional Quantification of Facial Asymmetry in Children with Positional Cranial Deformity

BACKGROUND

The extent of facial involvement in positional plagiocephaly is only little investigated so far. Investigation methods that take into account the challenging anatomical conditions and growth of infants' faces are desirable. In this study, the authors established a new three-dimensional photogrammetry quantification method evaluating pretherapeutic and posttherapeutic facial asymmetry in positional plagiocephaly. Furthermore, a facial asymmetry index was established and evaluated.

METHODS

Three-dimensional photographs of 100 children undergoing treatment with head orthoses were analyzed by constructing a standardized interindividual coordinate system. Defining landmarks, section planes, and point coordinates with a computer-aided design software, both sides of the faces were compared. Facial asymmetry was quantified by measuring differences between left and right sides and pretherapeutic and posttherapeutic changes in each patient. The facial asymmetry index was calculated by putting the absolute differences in relation with the coordinates of the nonaffected side.

RESULTS

Present results indicate that positional plagiocephaly results in a distinct facial asymmetry (range, -3.8 to 9.6 mm) in nearly all spatial directions and facial regions. Helmet therapy led to a significant reduction (p < 0.05) of intraindividual facial asymmetry (median change in facial asymmetry index, -1.9 to 3.1 percent). However, no correlation of the Cranial Vault Asymmetry Index and facial asymmetry (Spearman rank correlation coefficient, ρ = -0.09 to 0.47) has been seen. According to these results, severe occipital deformation does not necessarily provoke distinct facial asymmetry.

CONCLUSIONS

Present three-dimensional photogrammetry method allows the longitudinal quantification of facial involvement in positional plagiocephaly. Asymmetry has been determined in all facial regions. The facial asymmetry decreased through helmet therapy but was not eliminated completely.

Comparing internal representations of facial expression kinematics between autistic and non-autistic adults

Recent developments suggest that autistic individuals require dynamic angry expressions to have a higher speed in order for them to be successfully identified. Therefore, it is plausible that autistic individuals do not have a 'deficit' in angry expression recognition, but rather their internal representation of these expressions is characterised by very high-speed movement. In this study, matched groups of autistic and non-autistic adults completed a novel emotion-based task which employed dynamic displays of happy, angry and sad point light facial (PLF) expressions. On each trial, participants moved a slider to manipulate the speed of a PLF stimulus until it moved at a speed that, in their 'mind's eye', was typical of happy, angry or sad expressions. Participants were shown three different types of PLFs-those showing the full-face, only the eye region, and only the mouth region, wherein the latter two were included to test whether differences in facial information sampling underpinned any dissimilarities in speed attributions. Across both groups, participants attributed the highest speeds to angry, then happy, then sad, facial motion. Participants increased the speed of angry and happy expressions by 41% and 27% respectively and decreased the speed of sad expressions by 18%. This suggests that participants have 'caricatured' internal representations of emotion, wherein emotion-related kinematic cues are over-emphasised. There were no differences between autistic and non-autistic individuals in the speeds attributed to full-face and partial-face angry, happy and sad expressions respectively. Consequently, we find no evidence that autistic adults possess atypically fast internal representations of anger.

One object, two networks? Assessing the relationship between the face and body-selective regions in the primate visual system

Faces and bodies are often treated as distinct categories that are processed separately by face- and body-selective brain regions in the primate visual system. These regions occupy distinct regions of visual cortex and are often thought to constitute independent functional networks. Yet faces and bodies are part of the same object and their presence inevitably covary in naturalistic settings. Here, we re-evaluate both the evidence supporting the independent processing of faces and bodies and the organizational principles that have been invoked to explain this distinction. We outline four hypotheses ranging from completely separate networks to a single network supporting the perception of whole people or animals. The current evidence, especially in humans, is compatible with all of these hypotheses, making it presently unclear how the representation of faces and bodies is organized in the cortex.

The autistic brain can process local but not global emotion regularities in facial and musical sequences

Whether autism spectrum disorder (ASD) is associated with a global processing deficit remains controversial. Global integration requires extraction of regularity across various timescales, yet little is known about how individuals with ASD process regularity at local (short timescale) versus global (long timescale) levels. To this end, we used event-related potentials to investigate whether individuals with ASD would show different neural responses to local (within trial) versus global (across trials) emotion regularities extracted from sequential facial expressions; and if so, whether this visual abnormality would generalize to the music (auditory) domain. Twenty individuals with ASD and 21 age- and IQ-matched individuals with typical development participated in this study. At an early processing stage, ASD participants exhibited preserved neural responses to violations of local emotion regularity for both faces and music. At a later stage, however, there was an absence of neural responses in ASD to violations of global emotion regularity for both faces and music. These findings suggest that the autistic brain responses to emotion regularity are modulated by the timescale of sequential stimuli, and provide insight into the neural mechanisms underlying emotional processing in ASD.

NetFACS: Using network science to understand facial communication systems

Understanding facial signals in humans and other species is crucial for understanding the evolution, complexity, and function of the face as a communication tool. The Facial Action Coding System (FACS) enables researchers to measure facial movements accurately, but we currently lack tools to reliably analyse data and efficiently communicate results. Network analysis can provide a way to use the information encoded in FACS datasets: by treating individual AUs (the smallest units of facial movements) as nodes in a network and their co-occurrence as connections, we can analyse and visualise differences in the use of combinations of AUs in different conditions. Here, we present ‘NetFACS’, a statistical package that uses occurrence probabilities and resampling methods to answer questions about the use of AUs, AU combinations, and the facial communication system as a whole in humans and non-human animals. Using highly stereotyped facial signals as an example, we illustrate some of the current functionalities of NetFACS. We show that very few AUs are specific to certain stereotypical contexts; that AUs are not used independently from each other; that graph-level properties of stereotypical signals differ; and that clusters of AUs allow us to reconstruct facial signals, even when blind to the underlying conditions. The flexibility and widespread use of network analysis allows us to move away from studying facial signals as stereotyped expressions, and towards a dynamic and differentiated approach to facial communication.

Using genetic algorithms to uncover individual differences in how humans represent facial emotion

Emotional facial expressions critically impact social interactions and cognition. However, emotion research to date has generally relied on the assumption that people represent categorical emotions in the same way, using standardized stimulus sets and overlooking important individual differences. To resolve this problem, we developed and tested a task using genetic algorithms to derive assumption-free, participant-generated emotional expressions. One hundred and five participants generated a subjective representation of happy, angry, fearful and sad faces. Population-level consistency was observed for happy faces, but fearful and sad faces showed a high degree of variability. High test-retest reliability was observed across all emotions. A separate group of 108 individuals accurately identified happy and angry faces from the first study, while fearful and sad faces were commonly misidentified. These findings are an important first step towards understanding individual differences in emotion representation, with the potential to reconceptualize the way we study atypical emotion processing in future research.

Impaired social perception from eyes and face visual cues: evidence from prefrontal cortex damage

Despite the key role that decoding of social-perceptual cues from faces plays in interpersonal communication, it is only recently that the potential of prefrontal cortex damage to disrupt this ability has been recognized. In fact, few studies to date had assessed whether the ability to identify the state of mind of others from the whole or part of the face is disrupted after prefrontal cortex damage and whether these two abilities are associated and share overlapped neural systems. In the present study, 30 patients with focal prefrontal lesions and 30 matched control subjects were assessed on their ability to recognize six basic emotions from facial expressions of the whole face and to identify states of mind of others from photographs of only the eyes using the "Reading the Mind in the Eyes Task". Results showed that frontal patients were significantly impaired compared with control subjects on both tasks. Moreover, regression analyses showed that these two abilities are associated and reciprocally predictive of one another. Finally, using voxel-based lesion analysis; we identified a partially common bilaterally distributed prefrontal network in the decoding of both emotional cues from both the whole face and eyes centered within the dorsomedial and ventral regions with extension to the lateral frontal pole.

Neural sensitivity to trustworthiness cues from realistic face images is associated with temperament: An electrophysiological study with 6-month-old infants

Discriminating facial cues to trustworthiness is a fundamental social skill whose developmental origins are still debated. Prior investigations used computer-generated faces, which might fail to reflect infants' face processing expertise. Here, Event-Related Potentials (ERPs) were recorded in Caucasian adults (N = 20, 7 males, M age = 25.25 years) and 6-month-old infants (N = 21, 10 males) in response to variations in trustworthiness intensity expressed by morphed images of realistic female faces associated with explicit trustworthiness judgments (Study 1). Preferential looking behavior in response to the same faces was also investigated in infants (N = 27, 11 males) (Study 2). ERP results showed that both age groups distinguished subtle stimulus differences, and that interindividual variability in neural sensitivity to these differences were associated with infants' temperament. No signs of stimulus differentiation emerged from infants' looking behavior. These findings contribute to the understanding of the developmental origins of human sensitivity to social cues from faces by extending prior evidence to more ecological stimuli and by unraveling the mediating role of temperament.

Angry facial expressions bias towards aversive actions

Social interaction requires fast and efficient processing of another person's intentions. In face-to-face interactions, aversive or appetitive actions typically co-occur with emotional expressions, allowing an observer to anticipate action intentions. In the present study, we investigated the influence of facial emotions on the processing of action intentions. Thirty-two participants were presented with video clips showing virtual agents displaying a facial emotion (angry vs. happy) while performing an action (punch vs. fist-bump) directed towards the observer. During each trial, video clips stopped at varying durations of the unfolding action, and participants had to recognize the presented action. Naturally, participants' recognition accuracy improved with increasing duration of the unfolding actions. Interestingly, while facial emotions did not influence accuracy, there was a significant influence on participants' action judgements. Participants were more likely to judge a presented action as a punch when agents showed an angry compared to a happy facial emotion. This effect was more pronounced in short video clips, showing only the beginning of an unfolding action, than in long video clips, showing near-complete actions. These results suggest that facial emotions influence anticipatory processing of action intentions allowing for fast and adaptive responses in social interactions.

Deep Multimodal Emotion Recognition on Human Speech: A Review

This work reviews the state of the art in multimodal speech emotion recognition methodologies, focusing on audio, text and visual information. We provide a new, descriptive categorization of methods, based on the way they handle the inter-modality and intra-modality dynamics in the temporal dimension: (i) non-temporal architectures (NTA), which do not significantly model the temporal dimension in both unimodal and multimodal interaction; (ii) pseudo-temporal architectures (PTA), which also assume an oversimplification of the temporal dimension, although in one of the unimodal or multimodal interactions; and (iii) temporal architectures (TA), which try to capture both unimodal and cross-modal temporal dependencies. In addition, we review the basic feature representation methods for each modality, and we present aggregated evaluation results on the reported methodologies. Finally, we conclude this work with an in-depth analysis of the future challenges related to validation procedures, representation learning and method robustness.

Taking a Computational Cultural Neuroscience Approach to Study Parent-Child Similarities in Diverse Cultural Contexts

Parent-child similarities and discrepancies at multiple levels provide a window to understand the cultural transmission process. Although prior research has examined parent-child similarities at the belief, behavioral, and physiological levels across cultures, little is known about parent-child similarities at the neural level. The current review introduces an interdisciplinary computational cultural neuroscience approach, which utilizes computational methods to understand neural and psychological processes being involved during parent-child interactions at intra- and inter-personal level. This review provides three examples, including the application of intersubject representational similarity analysis to analyze naturalistic neuroimaging data, the usage of computer vision to capture non-verbal social signals during parent-child interactions, and unraveling the psychological complexities involved during real-time parent-child interactions based on their simultaneous recorded brain response patterns. We hope that this computational cultural neuroscience approach can provide researchers an alternative way to examine parent-child similarities and discrepancies across different cultural contexts and gain a better understanding of cultural transmission processes.

Face-viewing patterns predict audiovisual speech integration in autistic children

Autistic children show audiovisual speech integration deficits, though the underlying mechanisms remain unclear. The present study examined how audiovisual speech integration deficits in autistic children could be affected by their looking patterns. We measured audiovisual speech integration in 26 autistic children and 26 typically developing (TD) children (4- to 7-year-old) employing the McGurk task (a videotaped speaker uttering phonemes with her eyes open or closed) and tracked their eye movements. We found that, compared with TD children, autistic children showed weaker audiovisual speech integration (i.e., the McGurk effect) in the open-eyes condition and similar audiovisual speech integration in the closed-eyes condition. Autistic children viewed the speaker's mouth less in non-McGurk trials than in McGurk trials in both conditions. Importantly, autistic children's weaker audiovisual speech integration could be predicted by their reduced mouth-looking time. The present study indicated that atypical face-viewing patterns could serve as one of the cognitive mechanisms of audiovisual speech integration deficits in autistic children. LAY SUMMARY: McGurk effect occurs when the visual part of a phoneme (e.g., "ga") and the auditory part of another phoneme (e.g., "ba") uttered by a speaker were integrated into a fused perception (e.g., "da"). The present study examined how McGurk effect in autistic children could be affected by their looking patterns for the speaker's face. We found that less looking time for the speaker's mouth in autistic children could predict weaker McGurk effect. As McGurk effect manifests audiovisual speech integration, our findings imply that we could improve audiovisual speech integration in autistic children by directing them to look at the speaker's mouth in future intervention.

A Randomized, Single-Blind, Crossover Study Evaluating the Impact of OnabotulinumtoxinA Treatment on Mood and Appearance During the COVID-19 Pandemic

Background

The emergence of Coronavirus disease of 2019 (COVID-19), quickly became one of the most severe disease outbreaks in modern history. This caused many aesthetic practices around the country to close temporarily and led to a unique time period to evaluate the impact neurotoxin has in the setting of an ongoing pandemic.

Objectives

To examine whether the administration of onabotulinumtoxinA (BOTOX Cosmetic, Allergan plc, Coolock, Ireland), in regular users, synergistically amplifies the elevation in mood/happiness, self-satisfaction with appearance and overall satisfaction, in the context of the ongoing pandemic.

Methods

A randomized single-blind cross-over study was designed to evaluate the impact of neurotoxin treatment in the upper third of the face on mood, self-satisfaction with appearance, and overall satisfaction. The placebo group crossed over to treatment after 1 month. Surveys evaluating patient happiness, self-satisfaction with appearance and overall efficacy were completed among both groups, and again to the placebo group again following crossover to treatment.

Results

Forty-five subjects were enrolled with 30 in the treatment and 15 in the control/cross-over group. The placebo group demonstrated no change in happiness or self-satisfaction in appearance until cross-over to the treatment group. Both groups, once receiving, onabotulinumtoxinA reported increased happiness, self-satisfaction with appearance and overall treatment satisfaction.

Conclusions

OnabotulinumtoxinA treatment to the upper face in the midst of the COVID-19 pandemic was found to increase patient happiness, self-satisfaction with appearance, and overall treatment satisfaction.

Face processing in police service: the relationship between laboratory-based assessment of face processing abilities and performance in a real-world identity matching task

In the present study, we investigated whether police officers’ performance in searching for unfamiliar faces in a video-based real-world task is predicted by laboratory-based face processing tests that are typically used to assess individual differences in face processing abilities. Specifically, perceptual performance in the field was operationalized via the identification of target individuals in self-made close-circuit television (CCTV) video tapes. Police officers’ abilities in the laboratory were measured by the Cambridge Face Memory Test long form (CFMT+). We hypothesized that the CFMT+ predicts individual differences in the CCTV task performance. A total of N = 186 police officers of the Rhineland-Palatinate State Police participated in the study (i.e., N = 139 novice and advanced cadets with either 3 months, 15 months or 24 months of pre-service experience; N = 47 experienced police officers with three years of pre-service experience and at least two years of full-service experience, who participated in the assessment center of the special police forces, specifically the surveillance and technical unit). Results revealed that the CFMT+ explained variance in the CCTV task. In sample 1, CFMT+ scores predicted hits, but not false alarms. In contrast, in sample 2, CFMT+ scores were correlated with both hits and false alarms. From a theoretical perspective, we discuss factors that might explain CCTV task performance. From a practical perspective, we recommend that personnel selection processes investigating individual differences of police officers’ face processing abilities should comprise of two steps. At first, laboratory-based tests of face processing abilities should be applied. Subsequently, to validate laboratory-based individual differences in face processing abilities, we recommend that work samples such as CCTV tasks from the field should be added.

The face value of feedback: facial behaviour is shaped by goals and punishments during interaction with dynamic faces

Responding appropriately to others' facial expressions is key to successful social functioning. Despite the large body of work on face perception and spontaneous responses to static faces, little is known about responses to faces in dynamic, naturalistic situations, and no study has investigated how goal directed responses to faces are influenced by learning during dyadic interactions. To experimentally model such situations, we developed a novel method based on online integration of electromyography signals from the participants' face (corrugator supercilii and zygomaticus major) during facial expression exchange with dynamic faces displaying happy and angry facial expressions. Fifty-eight participants learned by trial-and-error to avoid receiving aversive stimulation by either reciprocate (congruently) or respond opposite (incongruently) to the expression of the target face. Our results validated our method, showing that participants learned to optimize their facial behaviour, and replicated earlier findings of faster and more accurate responses in congruent versus incongruent conditions. Moreover, participants performed better on trials when confronted with smiling, when compared with frowning, faces, suggesting it might be easier to adapt facial responses to positively associated expressions. Finally, we applied drift diffusion and reinforcement learning models to provide a mechanistic explanation for our findings which helped clarifying the underlying decision-making processes of our experimental manipulation. Our results introduce a new method to study learning and decision-making in facial expression exchange, in which there is a need to gradually adapt facial expression selection to both social and non-social reinforcements.

Seeing things differently: Gaze shapes neural signal during mentalizing according to emotional awareness

Studies on social cognition often use complex visual stimuli to asses neural processes attributed to abilities like "mentalizing" or "Theory of Mind" (ToM). During the processing of these stimuli, eye gaze, however, shapes neural signal patterns. Individual differences in neural operations on social cognition may therefore be obscured if individuals' gaze behavior differs systematically. These obstacles can be overcome by the combined analysis of neural signal and natural viewing behavior. Here, we combined functional magnetic resonance imaging (fMRI) with eye-tracking to examine effects of unconstrained gaze on neural ToM processes in healthy individuals with differing levels of emotional awareness, i.e. alexithymia. First, as previously described for emotional tasks, people with higher alexithymia levels look less at eyes in both ToM and task-free viewing contexts. Further, we find that neural ToM processes are not affected by individual differences in alexithymia per se. Instead, depending on alexithymia levels, gaze on critical stimulus aspects reversely shapes the signal in medial prefrontal cortex (MPFC) and anterior temporoparietal junction (TPJ) as distinct nodes of the ToM system. These results emphasize that natural selective attention affects fMRI patterns well beyond the visual system. Our study implies that, whenever using a task with multiple degrees of freedom in scan paths, ignoring the latter might obscure important conclusions.

The recognition of facial expressions of emotion in deaf and hearing individuals

During real-life interactions, facial expressions of emotion are perceived dynamically with multimodal sensory information. In the absence of auditory sensory channel inputs, it is unclear how facial expressions are recognised and internally represented by deaf individuals. Few studies have investigated facial expression recognition in deaf signers using dynamic stimuli, and none have included all six basic facial expressions of emotion (anger, disgust, fear, happiness, sadness, and surprise) with stimuli fully controlled for their low-level visual properties, leaving the question of whether or not a dynamic advantage for deaf observers exists unresolved. We hypothesised, in line with the enhancement hypothesis, that the absence of auditory sensory information might have forced the visual system to better process visual (unimodal) signals, and predicted that this greater sensitivity to visual stimuli would result in better recognition performance for dynamic compared to static stimuli, and for deaf-signers compared to hearing non-signers in the dynamic condition. To this end, we performed a series of psychophysical studies with deaf signers with early-onset severe-to-profound deafness (dB loss >70) and hearing controls to estimate their ability to recognize the six basic facial expressions of emotion. Using static, dynamic, and shuffled (randomly permuted video frames of an expression) stimuli, we found that deaf observers showed similar categorization profiles and confusions across expressions compared to hearing controls (e.g., confusing surprise with fear). In contrast to our hypothesis, we found no recognition advantage for dynamic compared to static facial expressions for deaf observers. This observation shows that the decoding of dynamic facial expression emotional signals is not superior even in the deaf expert visual system, suggesting the existence of optimal signals in static facial expressions of emotion at the apex. Deaf individuals match hearing individuals in the recognition of facial expressions of emotion.

An Objective, Quantitative Assessment of Flexible Hyaluronic Acid Fillers in Lip and Perioral Enhancement

BACKGROUND

HARK is an FDA-approved flexible filler designed for lips.

OBJECTIVE

To quantitatively evaluate subject outcomes by measuring the change in lip texture, color (redness), lip fullness, and lip and perioral surface stretch (dynamic strain) after treatment.

METHODS AND MATERIALS

In this 8-week open-label, Phase IV multicenter study, subjects were treated with HARK in the lips and HARR and/or HARD in perioral wrinkles and folds as add-on treatment. Assessments included 2D photographic analyses of lip texture and color, and 3D photographic assessments of lip enhancement and dynamic strain.

RESULTS

HARK significantly improved lip texture (p ≤ .002), lip redness (p < .001), and added fullness to the lips (lip enhancement measurements; p < .001), at Week 8 after treatment. In addition, lower lip wrinkles were significantly reduced (p = .007) and there was a reduction in upper lip wrinkles (not statistically significant). Surface stretch (dynamic strain) in the lip and perioral region was significantly increased after treatment (p < .001).

CONCLUSION

This analysis provides an objective measure of the beneficial effects of flexible hyaluronic acid fillers in lip augmentation and perioral enhancement and demonstrates a significantly improved lip texture, red color, and fullness. A significant increase in surface stretch (dynamic strain) is indicative of tissue expansion and improvement in lip smoothness.

Facial coloration influences social approach-avoidance through social perception

Perceptions of others' social characteristics are essential for guiding social behaviour and decision making. Recent research has demonstrated that increased facial redness facilitates both positive (e.g. health, attractiveness, happiness) and negative (e.g. dominance, anger) social evaluations. Given that similar facial colouration can lead to diverging evaluations, it is unclear how people integrate these cues to inform social decisions (e.g. approach-avoidance). We suggest that the influence of facial redness on social perceptions and decisions depends on contextual information, including facial-muscular emotion expressions. We test this hypothesis across two studies where participants view faces either increasing or decreasing redness, evaluate them on a range of social characteristics (i.e. aggressiveness, attractiveness, health, friendliness, dominance) and decide whether to approach or avoid them. Increased facial redness facilitated, and decreased redness impeded (to a greater extent), perceptions of each social characteristic. However, the extent of this influence was moderated by the muscular expression (i.e. neutral, happy, angry). Further, we found that the influence of facial redness on approach-avoidance was largely mediated by evaluations of attractiveness and health. Altogether, the current work provides nuanced insights into facial colouration's role as a social signal that informs social perception and decision making.

Alexithymia explains atypical spatiotemporal dynamics of eye gaze in autism

Recognition of emotional facial expressions is considered to be atypical in autism. This difficulty is thought to be due to the way that facial expressions are visually explored. Evidence for atypical visual exploration of emotional faces in autism is, however, equivocal. We propose that, where observed, atypical visual exploration of emotional facial expressions is due to alexithymia, a distinct but frequently co-occurring condition. In this eye-tracking study we tested the alexithymia hypothesis using a number of recent methodological advances to study eye gaze during several emotion processing tasks (emotion recognition, intensity judgements, free gaze), in 25 adults with, and 45 without, autism. A multilevel polynomial modelling strategy was used to describe the spatiotemporal dynamics of eye gaze to emotional facial expressions. Converging evidence from traditional and novel analysis methods revealed that atypical gaze to the eyes is best predicted by alexithymia in both autistic and non-autistic individuals. Information theoretic analyses also revealed differential effects of task on gaze patterns as a function of alexithymia, but not autism. These findings highlight factors underlying atypical emotion processing in autistic individuals, with wide-ranging implications for emotion research.

ADOS-Eye-Tracking: The Archimedean Point of View and Its Absence in Autism Spectrum Conditions

Face perception and emotion categorization are widely investigated under laboratory conditions that are devoid of real social interaction. Using mobile eye-tracking glasses in a standardized diagnostic setting while applying the Autism Diagnostic Observation Schedule (ADOS-2), we had the opportunity to record gaze behavior of children and adolescents with and without Autism Spectrum Conditions (ASCs) during social interaction. The objective was to investigate differences in eye-gaze behavior between three groups of children and adolescents either (1) with ASC or (2) with unconfirmed diagnosis of ASC or (3) with neurotypical development (NTD) during social interaction with an adult interviewer in a diagnostic standard situation using the ADOS-2. In a case control study, we used mobile eye-tracking glasses in an ecologically valid and highly standardized diagnostic interview to investigate suspected cases of ASC. After completion of the ASC diagnostic gold standard including the ADOS-2, the participants were assigned to two groups based on their diagnosis (ASC vs. non-ASC) and compared with a matched group of neurotypically developed controls. The primary outcome measure is the percentage of total dwell times assessed for different areas of interest (AOI) with regard to the face and body of a diagnostic interviewer and the surrounding space. Overall, 65 children and adolescents within an age range of 8.3-17.9 years were included in the study. The data revealed significant group differences, especially in the central-face area. Previous investigations under laboratory conditions gave preferential attention to the eye region during face perception to describe differences between ASC and NTD. In this study - using an ecologically valid setting within a standard diagnostic procedure - the results indicate that neurotypically developed controls seem to process faces and facial expressions in a holistic manner originating from the central-face region. Conversely, participants on the Autism Spectrum (tAS) seem to avoid the central-face region and show unsystematic gaze behavior, not using the preferred landing position in the central-face region as the Archimedean point of face perception. This study uses a new approach, and it will be important to replicate these preliminary findings in future research.

Changes in visual attentional behavior in complex regional pain syndrome: A preliminary study

Purpose

The purpose of the present study was to investigate the visual attentional behavior towards a pain-affected area and face/body images using eye tracking in complex regional pain syndrome (CRPS) patients. Moreover, we investigated the relationship between visual attentional behavior and clinical symptoms.

Patients and methods

Eight female patients with CRPS type 1 in their upper limbs and 8 healthy adult women participated in this study. First, the participants were asked to watch videoclips in a relaxed manner (Videoclip 1 featured young adults who introduced themselves; Videoclip 2 featured young adults touching the hand of the other person sitting across from them with their hand.) Eye movement data were tracked with eye-tracking glasses.

Results

In video clip 1, the fixation duration (FD) and fixation count (FC) on faces tended to be lower in CRPS patients than in healthy controls. This tendency was found in patients with low body cognitive distortions. In video clip 2, CRPS patients displayed significantly lower FD and FC on the unaffected hand while watching a video of the unaffected hand being touched compared with healthy controls. Moreover, patients with low body cognitive distortion displayed significantly longer FD on the affected hand.

Conclusion

Some CRPS patients differed in visual attentional behavior toward the face and body compared with healthy controls. In addition, our findings suggest that patients with lower body cognitive distortion may have a high visual attention for the affected hand, while patients with higher distortion may be neglecting the affected hand.

Review and Challenges of Technologies for Real-Time Human Behavior Monitoring

A person's behavior significantly influences their health and well-being. It also contributes to the social environment in which humans interact, with cascading impacts to the health and behaviors of others. During social interactions, our understanding and awareness of vital nonverbal messages expressing beliefs, emotions, and intentions can be obstructed by a variety of factors including greatly flawed self-awareness. For these reasons, human behavior is a very important topic to study using the most advanced technology. Moreover, technology offers a breakthrough opportunity to improve people's social awareness and self-awareness through machine-enhanced recognition and interpretation of human behaviors. This paper reviews (1) the social psychology theories that have established the framework to study human behaviors and their manifestations during social interactions and (2) the technologies that have contributed to the monitoring of human behaviors. State-of-the-art in sensors, signal features, and computational models are categorized, summarized, and evaluated from a comprehensive transdisciplinary perspective. This review focuses on assessing technologies most suitable for real-time monitoring while highlighting their challenges and opportunities in near-future applications. Although social behavior monitoring has been highly reported in psychology and engineering literature, this paper uniquely aims to serve as a disciplinary convergence bridge and a guide for engineers capable of bringing new technologies to bear against the current challenges in real-time human behavior monitoring.

Self-face perception in 12-month-old infants: A study using the morphing technique

The present study investigated self-face perception in 12-month-old infants using the morphing technique. Twenty-four 12-month-old infants participated in both the main and control experiments. In the main experiment, we used the participant's own face, an unfamiliar infant's face (age- and gender-matched), and a morphed face comprising 50 % each of the self and unfamiliar faces as stimuli. The control experiment followed the same procedure, except that the self-face was replaced with another unfamiliar face. In both experiments, two of these stimuli were presented side by side on a monitor in each trial, and infants' fixation duration was measured. Results showed that shorter fixation durations were found for the morphed face compared with the self-face and the unfamiliar face in the main experiment, but there were no significant preferences for any comparisons in the control experiment. The results suggest that 12-month-old infants could detect subtle differences in facial features between the self-face and the other faces, and infants might show less preference for the self-resembling morphed face due to increased processing costs, which can be interpreted using the uncanny valley hypothesis. Overall, representations of the self-face seem to a certain extent to be formed by the end of the first year of life through daily visual experience.

Personalized quantification of facial normality: a machine learning approach

What is a normal face? A fundamental task for the facial reconstructive surgeon is to answer that question as it pertains to any given individual. Accordingly, it would be important to be able to place the facial appearance of a patient with congenital or acquired deformity numerically along their own continuum of normality, and to measure any surgical changes against such a personalized benchmark. This has not previously been possible. We have solved this problem by designing a computerized model that produces realistic, normalized versions of any given facial image, and objectively measures the perceptual distance between the raw and normalized facial image pair. The model is able to faithfully predict human scoring of facial normality. We believe this work represents a paradigm shift in the assessment of the human face, holding great promise for development as an objective tool for surgical planning, patient education, and as a means for clinical outcome measurement.

How are attention, learning, and social cognition related on the non-clinical autistic spectrum?

Autism spectrum disorder (ASD) - and autistic traits more generally - are associated with a heterogeneous pattern of differences in cognitive function. These include differences in associative learning, attention, and processing of social information. All three cognitive functions have importance in clinical, educational, and research contexts. The present study investigates the relationships between these functions in the context of autistic traits in the neurotypical population. In an online study, we asked a group of over 400 people to complete the Autism Spectrum Quotient questionnaire. We also asked participants to complete one of two standard attentional learning paradigms - either a Kamin blocking or an attentional highlighting task. To investigate the relation of attention and learning to social information processing, we incorporated social cues in one of each kind of paradigm. We found Kamin blocking increased with increasing number of autistic traits, in particular the sub-trait attention switching, but only for non-social cues. We found that highlighting decreased with increasing number of traits, in particular the sub-trait communication, but only for social cues. We interpret these findings as evidence of a crucial role for attention in other characteristics of the broader autistic phenotype, and discuss the relevance of these results for cognitive explanations of autistic traits and symptoms.

How does gaze to faces support face-to-face interaction? A review and perspective

Gaze-where one looks, how long, and when-plays an essential part in human social behavior. While many aspects of social gaze have been reviewed, there is no comprehensive review or theoretical framework that describes how gaze to faces supports face-to-face interaction. In this review, I address the following questions: (1) When does gaze need to be allocated to a particular region of a face in order to provide the relevant information for successful interaction; (2) How do humans look at other people, and faces in particular, regardless of whether gaze needs to be directed at a particular region to acquire the relevant visual information; (3) How does gaze support the regulation of interaction? The work reviewed spans psychophysical research, observational research, and eye-tracking research in both lab-based and interactive contexts. Based on the literature overview, I sketch a framework for future research based on dynamic systems theory. The framework holds that gaze should be investigated in relation to sub-states of the interaction, encompassing sub-states of the interactors, the content of the interaction as well as the interactive context. The relevant sub-states for understanding gaze in interaction vary over different timescales from microgenesis to ontogenesis and phylogenesis. The framework has important implications for vision science, psychopathology, developmental science, and social robotics.

Developmental Prosopagnosia and Elastic Versus Static Face Recognition in an Incidental Learning Task

Previous research on the beneficial effect of motion has postulated that learning a face in motion provides additional cues to recognition. Surprisingly, however, few studies have examined the beneficial effect of motion in an incidental learning task and developmental prosopagnosia (DP) even though such studies could provide more valuable information about everyday face recognition compared to the perception of static faces. In the current study, 18 young adults (Experiment 1) and five DPs and 10 age-matched controls (Experiment 2) participated in an incidental learning task during which both static and elastically moving unfamiliar faces were sequentially presented and were to be recognized in a delayed visual search task during which the faces could either keep their original presentation or switch (from static to elastically moving or vice versa). In Experiment 1, performance in the elastic-elastic condition reached a significant improvement relative to the elastic-static and static-elastic condition, however, no significant difference could be detected relative to the static-static condition. Except for higher scores in the elastic-elastic compared to the static-elastic condition in the age-matched group, no other significant differences were detected between conditions for both the DPs and the age-matched controls. The current study could not provide compelling evidence for a general beneficial effect of motion. Age-matched controls performed generally worse than DPs, which may potentially be explained by their higher rates of false alarms. Factors that could have influenced the results are discussed.

Masked education? The benefits and burdens of wearing face masks in schools during the current Corona pandemic

Face masks can prevent the spread of the virus SARS-CoV-2, in particular as this spread can occur from people with no symptoms. However, covering the lower half of the face reduces the ability to communicate, interpret, and mimic the expressions of those with whom we interact. Positive emotions become less recognizable, and negative emotions are amplified. Emotional mimicry, contagion, and emotionality in general are reduced and (thereby) bonding between teachers and learners, group cohesion, and learning - of which emotions are a major driver. The benefits and burdens of face masks in schools should be seriously considered and made obvious and clear to teachers and students. The school's specific situation must also inform any decision regarding face mask use.