Perception of face and body expressions using electromyography, pupillometry and gaze measures

Optimal processing of surface facial EMG to identify emotional expressions: A data-driven approach

Surface facial electromyography (EMG) is commonly used to detect emotions from subtle facial expressions. Although there are established procedures for collecting EMG data and some aspects of their processing, there is little agreement among researchers about the optimal way to process the EMG signal, so that the study-unrelated variability (noise) is removed, and the emotion-related variability is best detected. The aim of the current paper was to establish an optimal processing pipeline for EMG data for identifying emotional expressions in facial muscles. We identified the most common processing steps from existing literature and created 72 processing pipelines that represented all the different processing choices. We applied these pipelines to a previously published dataset from a facial mimicry experiment, where 100 adult participants observed happy and sad facial expressions, whilst the activity of their facial muscles, zygomaticus major and corrugator supercilii, was recorded with EMG. We used a resampling approach and subsets of the original data to investigate the effect and robustness of different processing choices on the performance of a logistic regression model that predicted the mimicked emotion (happy/sad) from the EMG signal. In addition, we used a random forest model to identify the most important processing steps for the sensitivity of the logistic regression model. Three processing steps were found to be most impactful: baseline correction, standardisation within muscles, and standardisation within subjects. The chosen feature of interest and the signal averaging had little influence on the sensitivity to the effect. We recommend an optimal processing pipeline, share our code and data, and provide a step-by-step walkthrough for researchers.

Pupillary Responses to Dynamic Negative Versus Positive Facial Expressions of Emotion in Children and Parents: Links to Depression and Anxiety

Witnessing emotional expressions in others triggers physiological arousal in humans. The current study focused on pupil responses to emotional expressions in a community sample as a physiological index of arousal and attention. We explored the associations between parents' and offspring's responses to dynamic facial expressions of emotion, as well as the links between pupil responses and anxiety/depression. Children (N = 90, MAge = 10.13, range = 7.21-12.94, 47 girls) participated in this lab study with one of their parents (47 mothers). Pupil responses were assessed in a computer task with dynamic happy, angry, fearful, and sad expressions, while participants verbally labeled the emotion displayed on the screen as quickly as possible. Parents and children reported anxiety and depression symptoms in questionnaires. Both parents and children showed stronger pupillary responses to negative versus positive expressions, and children's responses were overall stronger than those of parents. We also found links between the pupil responses of parents and children to negative, especially to angry faces. Child pupil responses were related to their own and their parents' anxiety levels and to their parents' (but not their own) depression. We conclude that child pupils are sensitive to individual differences in parents' pupils and emotional dispositions in community samples.

Early modulations of neural oscillations during the processing of emotional body language

The processing of threat-related emotional body language (EBL) has been shown to engage sensorimotor cortical areas early on and induce freezing in the observers' motor system, particularly when observing fearful EBL. To provide insights into the interplay between somatosensory and motor areas during observation of EBL, here, we used high-density electroencephalography (hd-EEG) in healthy humans while they observed EBL stimuli involving fearful and neutral expressions. To capture early sensorimotor brain response, we focused on P100 fronto-central event-related potentials (ERPs) and event-related desynchronization/synchronization (ERD/ERS) in the mu-alpha (8-13 Hz) and lower beta (13-20 Hz) bands over the primary motor (M1) and somatosensory (S1) cortices. Source-level ERP and ERD/ERS analyses were conducted using eLORETA. Results revealed higher P100 amplitudes in motor and premotor channels for 'Neutral' compared with 'Fear'. Additionally, analysis of ERD/ERS showed increased beta band desynchronization in M1 for 'Neutral', and the opposite pattern in S1. Source-level estimation showed significant differences between conditions mainly observed in the beta band over sensorimotor areas. These findings provide high-temporal resolution evidence suggesting that seeing fearful EBL induces early activation of somatosensory areas, which in turn could suppress M1 activity. These findings highlight early dynamics within the observer's sensorimotor system and hint at a sensorimotor mechanism supporting freezing during the processing of EBL.

The reciprocal relationship between smiles and situational contexts

ABSTRACTSmiles provide information about a social partner's affect and intentions during social interaction. Although always encountered within a specific situation, the influence of contextual information on smile evaluation has not been widely investigated. Moreover, little is known about the reciprocal effect of smiles on evaluations of their accompanying situations. In this research, we assessed how different smile types and situational contexts affected participants' social evaluations. In Study 1, 85 participants rated reward, affiliation, and dominance smiles embedded within either enjoyable, polite, or negative (unpleasant) situations. Context had a strong effect on smile ratings, such that smiles in enjoyable situations were rated as more genuine and joyful, as well as indicating less superiority than those in negative situations. In Study 2, 200 participants evaluated the situations that these smiles were perceived within (rather than the smiles themselves). Although situations paired with reward (vs. affiliation) smiles tended to be rated more positively, this effect was absent for negative situations. Ultimately, the findings point toward a reciprocal relationship between smiles and contexts, whereby the face influences evaluations of the situation and vice versa.

Architectural experience influences the processing of others' body expressions

The interplay between space and cognition is a crucial issue in Neuroscience leading to the development of multiple research fields. However, the relationship between architectural space and the movement of the inhabitants and their interactions has been too often neglected, failing to provide a unifying view of architecture's capacity to modulate social cognition broadly. We bridge this gap by requesting participants to judge avatars' emotional expression (high vs. low arousal) at the end of their promenade inside high- or low-arousing architectures. Stimuli were presented in virtual reality to ensure a dynamic, naturalistic experience. High-density electroencephalography (EEG) was recorded to assess the neural responses to the avatar's presentation. Observing highly aroused avatars increased Late Positive Potentials (LPP), in line with previous evidence. Strikingly, 250 ms before the occurrence of the LPP, P200 amplitude increased due to the experience of low-arousing architectures, reflecting an early greater attention during the processing of body expressions. In addition, participants stared longer at the avatar's head and judged the observed posture as more arousing. Source localization highlighted a contribution of the dorsal premotor cortex to both P200 and LPP. In conclusion, the immersive and dynamic architectural experience modulates human social cognition. In addition, the motor system plays a role in processing architecture and body expressions suggesting that the space and social cognition interplay is rooted in overlapping neural substrates. This study demonstrates that the manipulation of mere architectural space is sufficient to influence human social cognition.

Drift-diffusion modeling reveals that masked faces are preconceived as unfriendly

During the COVID-19 pandemic, the use of face masks has become a daily routine. Studies have shown that face masks increase the ambiguity of facial expressions which not only affects (the development of) emotion recognition, but also interferes with social interaction and judgement. To disambiguate facial expressions, we rely on perceptual (stimulus-driven) as well as preconceptual (top-down) processes. However, it is unknown which of these two mechanisms accounts for the misinterpretation of masked expressions. To investigate this, we asked participants (N = 136) to decide whether ambiguous (morphed) facial expressions, with or without a mask, were perceived as friendly or unfriendly. To test for the independent effects of perceptual and preconceptual biases we fitted a drift-diffusion model (DDM) to the behavioral data of each participant. Results show that face masks induce a clear loss of information leading to a slight perceptual bias towards friendly choices, but also a clear preconceptual bias towards unfriendly choices for masked faces. These results suggest that, although face masks can increase the perceptual friendliness of faces, people have the prior preconception to interpret masked faces as unfriendly.

Fading boundaries between the physical and the social world: Insights and novel techniques from the intersection of these two fields

This review focuses on the subtle interactions between sensory input and social cognition in visual perception. We suggest that body indices, such as gait and posture, can mediate such interactions. Recent trends in cognitive research are trying to overcome approaches that define perception as stimulus-centered and are pointing toward a more embodied agent-dependent perspective. According to this view, perception is a constructive process in which sensory inputs and motivational systems contribute to building an image of the external world. A key notion emerging from new theories on perception is that the body plays a critical role in shaping our perception. Depending on our arm's length, height and capacity of movement, we create our own image of the world based on a continuous compromise between sensory inputs and expected behavior. We use our bodies as natural "rulers" to measure both the physical and the social world around us. We point out the necessity of an integrative approach in cognitive research that takes into account the interplay between social and perceptual dimensions. To this end, we review long-established and novel techniques aimed at measuring bodily states and movements, and their perception, with the assumption that only by combining the study of visual perception and social cognition can we deepen our understanding of both fields.

Domestic Violence From a Child Perspective: Impact of an Immersive Virtual Reality Experience on Men With a History of Intimate Partner Violent Behavior

Domestic violence has long-term negative consequences on children. In this study, men with a history of partner aggression and a control group of non-offenders were embodied in a child's body from a first-person perspective in virtual reality (VR). From this perspective, participants witnessed a scene of domestic violence where a male avatar assaulted a female avatar. We evaluated the impact of the experience on emotion recognition skills and heart rate deceleration responses. We found that the experience mainly impacted the recognition of angry facial expressions. The results also indicate that males with a history of partner aggression had larger physiological responses during an explicit violent event (when the virtual abuser threw a telephone) compared with controls, while their physiological reactions were less pronounced when the virtual abuser invaded the victim's personal space. We show that embodiment from a child's perspective during a conflict situation in VR impacts emotion recognition, physiological reactions, and attitudes towards violence. We provide initial evidence of the potential of VR in the rehabilitation and neuropsychological assessment of males with a history of domestic violence, especially in relation to children.

Attention Towards Pupil Size in Humans and Bonobos (Pan paniscus)

Previous work has established that humans have an attentional bias towards emotional signals, and there is some evidence that this phenomenon is shared with bonobos, our closest relatives. Although many emotional signals are explicit and overt, implicit cues such as pupil size also contain emotional information for observers. Pupil size can impact social judgment and foster trust and social support, and is automatically mimicked, suggesting a communicative role. While an attentional bias towards more obvious emotional expressions has been shown, it is unclear whether this also extends to a more subtle implicit cue, like changes in pupil size. Therefore, the current study investigated whether attention is biased towards pupils of differing sizes in humans and bonobos. A total of 150 human participants (141 female), with a mean age of 19.13 (ranging from 18 to 32 years old), completed an online dot-probe task. Four female bonobos (6 to 17 years old) completed the dot-probe task presented via a touch screen. We used linear mixed multilevel models to examine the effect of pupil size on reaction times. In humans, our analysis showed a small but significant attentional bias towards dilated pupils compared to intermediate-sized pupils and intermediate-sized pupils when compared to small pupils. Our analysis did not show a significant effect in bonobos. These results suggest that the attentional bias towards emotions in humans can be extended to a subtle unconsciously produced signal, namely changes in pupil size. Due to methodological differences between the two experiments, more research is needed before drawing a conclusion regarding bonobos.

Supplementary Information

The online version contains supplementary material available at 10.1007/s42761-022-00146-1.

Emotional body postures affect inhibitory control only when task-relevant

A classical theoretical frame to interpret motor reactions to emotional stimuli is that such stimuli, particularly those threat-related, are processed preferentially, i.e., they are capable of capturing and grabbing attention automatically. Research has recently challenged this view, showing that the task relevance of emotional stimuli is crucial to having a reliable behavioral effect. Such evidence indicated that emotional facial expressions do not automatically influence motor responses in healthy young adults, but they do so only when intrinsically pertinent to the ongoing subject's goals. Given the theoretical relevance of these findings, it is essential to assess their generalizability to different, socially relevant emotional stimuli such as emotional body postures. To address this issue, we compared the performance of 36 right-handed participants in two different versions of a Go/No-go task. In the Emotional Discrimination task, participants were required to withhold their responses at the display of emotional body postures (fearful or happy) and to move at the presentation of neutral postures. Differently, in the control task, the same images were shown, but participants had to respond according to the color of the actor/actress' t-shirt, disregarding the emotional content. Results showed that participants made more commission errors (instances in which they moved even though the No-go signal was presented) for happy than fearful body postures in the Emotional Discrimination task. However, this difference disappeared in the control task. Such evidence indicates that, like facial emotion, emotional body expressions do not influence motor control automatically, but only when they are task-relevant.

The shared signal hypothesis: Facial and bodily expressions of emotion mutually inform one another

Decades of research show that contextual information from the body, visual scene, and voices can facilitate judgments of facial expressions of emotion. To date, most research suggests that bodily expressions of emotion offer context for interpreting facial expressions, but not vice versa. The present research aimed to investigate the conditions under which mutual processing of facial and bodily displays of emotion facilitate and/or interfere with emotion recognition. In the current two studies, we examined whether body and face emotion recognition are enhanced through integration of shared emotion cues, and/or hindered through mixed signals (i.e., interference). We tested whether faces and bodies facilitate or interfere with emotion processing by pairing briefly presented (33 ms), backward-masked presentations of faces with supraliminally presented bodies (Experiment 1) and vice versa (Experiment 2). Both studies revealed strong support for integration effects, but not interference. Integration effects are most pronounced for low-emotional clarity facial and bodily expressions, suggesting that when more information is needed in one channel, the other channel is recruited to disentangle any ambiguity. That this occurs for briefly presented, backward-masked presentations reveals low-level visual integration of shared emotional signal value.

Do we enjoy what we sense and perceive? A dissociation between aesthetic appreciation and basic perception of environmental objects or events

This integrative review rearticulates the notion of human aesthetics by critically appraising the conventional definitions, offerring a new, more comprehensive definition, and identifying the fundamental components associated with it. It intends to advance holistic understanding of the notion by differentiating aesthetic perception from basic perceptual recognition, and by characterizing these concepts from the perspective of information processing in both visual and nonvisual modalities. To this end, we analyze the dissociative nature of information processing in the brain, introducing a novel local-global integrative model that differentiates aesthetic processing from basic perceptual processing. This model builds on the current state of the art in visual aesthetics as well as newer propositions about nonvisual aesthetics. This model comprises two analytic channels: aesthetics-only channel and perception-to-aesthetics channel. The aesthetics-only channel primarily involves restricted local processing for quality or richness (e.g., attractiveness, beauty/prettiness, elegance, sublimeness, catchiness, hedonic value) analysis, whereas the perception-to-aesthetics channel involves global/extended local processing for basic feature analysis, followed by restricted local processing for quality or richness analysis. We contend that aesthetic processing operates independently of basic perceptual processing, but not independently of cognitive processing. We further conjecture that there might be a common faculty, labeled as aesthetic cognition faculty, in the human brain for all sensory aesthetics albeit other parts of the brain can also be activated because of basic sensory processing prior to aesthetic processing, particularly during the operation of the second channel. This generalized model can account not only for simple and pure aesthetic experiences but for partial and complex aesthetic experiences as well.

Reading Your Emotions in My Physiology? Reliable Emotion Interpretations in Absence of a Robust Physiological Resonance

Affective states are expressed in an individual’s physical appearance, ranging from facial expressions and body postures, to indicators of physiological arousal (e.g., a blush). Confirming the claimed communicative function of these markers, humans are capable of distinguishing between a variety of discrete emotion displays. In an attempt to explain the underlying mechanism, characteristic bodily changes within the observer, including physiological arousal and mimicry, have been suggested to facilitate the interpretation of an expression. The current study aims to create a holistic picture of emotion perception by (1) using three different sources of emotional information (prototypical facial expressions, bodily expressions, and subtle facial cues) and (2) measuring changes in multiple physiological signals (facial electromyography, skin conductance level, skin temperature, and pupil size). While participants clearly discriminated between perceived emotional expressions, there was no overall 1–1 correspondence with their physiological responses. Some specific but robust effects were observed. Angry facial expressions were consistently responded to with a peak in skin conductance level. Furthermore, sad body expressions were associated with a drop in skin temperature. In addition to being the best recognized expression, viewing happy faces elicited congruent facial muscle responses, which supports the potential role of embodied simulation in emotion recognition. Lastly, tears were not only rated as highly emotional intense but also evoked a peak in skin conductance level in the observer. The absence of distinct physiological responses to other expressions could be explained by the lacking functionality of affect sharing in a non-interactive experimental context. Consequentially, emotional alignment in body and mind might especially take place in real social situations, which should be considered in future research.

It Is Written in the Eyes: Inferences From Pupil Size and Gaze Orientation Shape Interpersonal Liking

Research has shown that pupil size shapes interpersonal impressions: Individuals with dilated pupils tend to be perceived more positively than those with constricted pupils. Untested so far is the role of cognitive processes in shaping the effects of pupil size. Two preregistered studies investigated whether the effect of pupil size was qualified by partner's attention allocation inferred from gaze orientation. In Experiment 1 (N = 50) partners with dilated pupils were more liked when gazing toward the participant, but less liked when gazing toward a disliked other. Experiment 2 (N = 50) unveiled the underlying mechanism of the pupil-gaze interplay. Pupillary changes led to inferences about the feelings held by the partner toward the gazed target: Larger pupils signaled positive feelings. Crucially, target identity moderated the response of the participants (i.e., liking toward the partner). This work shows the importance of considering the interplay of affective and cognitive eye-signals when studying person perception.

Multisensory integration of musical emotion perception in singing

We investigated how visual and auditory information contributes to emotion communication during singing. Classically trained singers applied two different facial expressions (expressive/suppressed) to pieces from their song and opera repertoire. Recordings of the singers were evaluated by laypersons or experts, presented to them in three different modes: auditory, visual, and audio–visual. A manipulation check confirmed that the singers succeeded in manipulating the face while keeping the sound highly expressive. Analyses focused on whether the visual difference or the auditory concordance between the two versions determined perception of the audio–visual stimuli. When evaluating expressive intensity or emotional content a clear effect of visual dominance showed. Experts made more use of the visual cues than laypersons. Consistency measures between uni-modal and multimodal presentations did not explain the visual dominance. The evaluation of seriousness was applied as a control. The uni-modal stimuli were rated as expected, but multisensory evaluations converged without visual dominance. Our study demonstrates that long-term knowledge and task context affect multisensory integration. Even though singers’ orofacial movements are dominated by sound production, their facial expressions can communicate emotions composed into the music, and observes do not rely on audio information instead. Studies such as ours are important to understand multisensory integration in applied settings.

Pupil responses to dynamic negative facial expressions of emotion in infants and parents

Observing others' emotions triggers physiological arousal in infants as well as in adults, reflected in dilated pupil sizes. This study is the first to examine parents' and infants' pupil responses to dynamic negative emotional facial expressions. Moreover, the links between pupil responses and negative emotional dispositions were explored among infants and parents. Infants' and one of their parent's pupil responses to negative versus neutral faces were measured via eye tracking in 222 infants (5- to 7-month-olds, n = 77, 11- to 13-month-olds, n = 78, and 17- to 19-month-olds, n = 67) and 229 parents. One parent contributed to the pupil data, whereas both parents were invited to fill in questionnaires on their own and their infant's negative emotional dispositions. Infants did not differentially respond to negative expressions, while parents showed stronger pupil responses to negative versus neutral expressions. There was a positive association between infants' and their parent's mean pupil responses and significant links between mothers' and fathers' stress levels and their infants' pupil responses. We conclude that a direct association between pupil responses in parents and offspring is observable already in infancy in typical development. Stress in parents is related to their infants' pupillary arousal to negative emotions.

Emotional Processing and Experience in Amyotrophic Lateral Sclerosis: A Systematic and Critical Review

Even though increasing literature describes changes in emotional processing in Amyotrophic Lateral Sclerosis (ALS), efforts to summarize relevant findings are lacking in the field. A systematic literature review was performed to provide a critical and up-to-date account of emotional abilities in ALS. References were identified by searches of PubMed, Web of Science and Scopus (1980–2021, English literature), with the following key terms: (“Amyotrophic Lateral Sclerosis” or “Primary Lateral Sclerosis” or “Motor Neuron”) and “Emotion*” and (“Processing” or “Attribution” or “Elaboration” or “Perception” or “Recognition”). Studies concerning only caregivers, pseudobulbar affect, and social cognition were excluded. Forty-one articles were included, all concerning ALS, and seven topics were identified: Emotion recognition, Emotional responsiveness, Emotional reactivity, Faces approachability rating, Valence rating, Memory for emotional materials and Alexithymia. The majority of these aspects have only been sparsely addressed. The evidence confirms altered emotional processing in ALS. The most consistent findings regard the recognition of facial expressions for negative emotions, but also alterations in the subjective responsiveness to emotional stimuli (arousal, valence and approachability), in psychophysiological and cerebral reactivity and in emotional memory, together with alexithymia traits, were reported. According to this evidence, emotional abilities should be included in the clinical assessment and therapeutic interventions.

Processing of facial expressions of same-race and other-race faces: distinct and shared neural underpinnings

People understand others’ emotions quickly from their facial expressions. However, facial expressions of ingroup and outgroup members may signal different social information and thus be mediated by distinct neural activities. We investigated whether there are distinct neuronal responses to fearful and happy expressions of same-race (SR) and other-race (OR) faces. We recorded electroencephalogram from Chinese adults when viewing an adaptor face (with fearful/neutral expressions in Experiment 1 but happy/neutral expressions in Experiment 2) and a target face (with fearful expressions in Experiment 1 but happy expressions in Experiment 2) presented in rapid succession. We found that both fearful and happy (vs neutral) adaptor faces increased the amplitude of a frontocentral positivity (P2). However, a fearful but not happy (vs neutral) adaptor face decreased the P2 amplitudes to target faces, and this repetition suppression (RS) effect occurred when adaptor and target faces were of the same race but not when of different races. RS was observed on two late parietal/central positive activities to fearful/happy target faces, which, however, occurred regardless of whether adaptor and target faces were of the same or different races. Our findings suggest that early affective processing of fearful expressions may engage distinct neural activities for SR and OR faces.

Recognition Characteristics of Facial and Bodily Expressions: Evidence From ERPs

In the natural environment, facial and bodily expressions influence each other. Previous research has shown that bodily expressions significantly influence the perception of facial expressions. However, little is known about the cognitive processing of facial and bodily emotional expressions and its temporal characteristics. Therefore, this study presented facial and bodily expressions, both separately and together, to examine the electrophysiological mechanism of emotional recognition using event-related potential (ERP). Participants assessed the emotions of facial and bodily expressions that varied by valence (positive/negative) and consistency (matching/non-matching emotions). The results showed that bodily expressions induced a more positive P1 component and a shortened latency, whereas facial expressions triggered a more negative N170 and prolonged latency. Among N2 and P3, N2 was more sensitive to inconsistent emotional information and P3 was more sensitive to consistent emotional information. The cognitive processing of facial and bodily expressions had distinctive integrating features, with the interaction occurring in the early stage (N170). The results of the study highlight the importance of facial and bodily expressions in the cognitive processing of emotion recognition.

Attentional Bias in Humans Toward Human and Bonobo Expressions of Emotion

Correctly recognizing and efficiently attending to emotional situations are highly valuable skills for social species such as humans and bonobos, humans' closest living relatives. In the current study, we investigated whether humans perceive a range of emotional situations differently when these involved other humans compared to bonobos. A large group of children and adults participated in an emotion perception task and rated scenes showing either bonobos or humans in situations depicting distressed or aggressive behavior, yawning, scratching, grooming, playing, sex scenes or neutral situations. A new group of people performed a dot-probe task to assess attentional biases toward these materials. The main finding is that humans perceive emotional scenes showing people similarly as emotional scenes of bonobos, a result reflecting a shared evolutionary origin of emotional expressions. Other results show that children interpreted bonobos' bared teeth displays as a positive signal. This signal is related to the human smile, but is frequently seen in distressed situations, as was the case in the current experiment. Children may still need to learn to use contextual cues when judging an ambiguous expression as positive or negative. Further, the sex scenes were rated very positively, especially by male participants. Even though they rated these more positively than women, their attention was captured similarly, surpassing all other emotion categories. Finally, humans' attention was captured more by human yawns than by bonobo yawns, which may be related to the highly contagious nature of yawns, especially when shown by close others. The current research adds to earlier work showing morphological, behavioral and genetic parallels between humans and bonobos by showing that their emotional expressions have a common origin too.

Interpreting Emotions From Women With Covered Faces: A Comparison Between a Middle Eastern and Western-European Sample

While new regulations obligate or recommend people to wear medical masks at public places to prevent further spread of the Covid-19 virus, there are still open questions as to what face coverage does to social emotional communication. Previous research on the effects of wearing veils or face-covering niqabs showed that covering of the mouth led to the attribution of negative emotions and to the perception of less intense positive emotions. The current study compares a sample from the Netherlands with a sample from the United Arab Emirates on their perception of emotions from faces covered by a niqab, censoring black bars, or uncovered faces. The results show that covering the mouth area leads to greater anxiety in participants in both countries. Furthermore, although participants did not report greater decoding difficulties for faces that were covered as compared to fully visible, results show that face coverage did influence emotion perception. Specifically, happiness and anger were perceived as being less intense. Further, face coverage by a niqab, as compared to black bars, yielded lower emotional intensity ratings. We conclude that face coverage in particular can modulate the perception of emotions, but that affective contextual cues may play a role as well.

Difficulties in Recognising Dynamic but not Static Emotional Body Movements in Autism Spectrum Disorder

In this study, we investigated whether the difficulties in body motion (BM) perception may led to deficit in emotion recognition in Autism spectrum disorder (ASD). To this aim, individuals with high-functioning ASD were asked to recognise fearful, happy, and neutral BM depicted as static images or dynamic point-light and full-light displays. Results showed slower response times in participants with ASD only in recognising dynamic stimuli, but no group differences in accuracy. This suggests that i) a deficit in action chaining mechanism in ASD may prevent the recognition of dynamic BM automatically and rapidly, ii) individuals with ASD and high cognitive resources can develop alternative—but equally successful—strategies to recognise emotional body expressions. Implications for treatment are discussed

Effects of age and mood on emotional face processing differ depending on the intensity of the facial expression

Research suggests that mood can moderate age differences in recognizing facial emotion. In this study, we examined how an anxious versus calm mood state affected younger and older adults' processing of emotional faces. Older adults had greater difficulty identifying negative emotions, particularly when emotions were displayed at a low intensity level. However, an anxious mood did not affect age differences in emotional face recognition. In contrast, age, emotional intensity, and current mood state all affected the perceived intensity of emotion. The effects of age and mood on perceived emotional intensity were only observed for low intensity facial expressions. When induced into an anxious mood, younger adults perceived threatening emotions (i.e., fear, anger) as more emotionally intense, whereas older adults perceived anger and happiness to be more intense. These findings emphasize the need to consider both internal and external factors when investigating the effects of age on emotional face processing.

Visual exploration of emotional body language: a behavioural and eye-tracking study

Bodily postures are essential to correctly comprehend others' emotions and intentions. Nonetheless, very few studies focused on the pattern of eye movements implicated in the recognition of emotional body language (EBL), demonstrating significant differences in relation to different emotions. A yet unanswered question regards the presence of the "left-gaze bias" (i.e. the tendency to look first, to make more fixations and to spend more looking time on the left side of centrally presented stimuli) while scanning bodies. Hence, the present study aims at exploring both the presence of a left-gaze bias and the modulation of EBL visual exploration mechanisms, by investigating the fixation patterns (number of fixations and latency of the first fixation) of participants while judging the emotional intensity of static bodily postures (Angry, Happy and Neutral, without head). While results on the latency of first fixations demonstrate for the first time the presence of the left-gaze bias while scanning bodies, suggesting that it could be related to the stronger expressiveness of the left hand (from the observer's point of view), results on fixations' number only partially fulfil our hypothesis. Moreover, an opposite viewing pattern between Angry and Happy bodily postures is showed. In sum, the present results, by integrating the spatial and temporal dimension of gaze exploration patterns, shed new light on EBL visual exploration mechanisms.

Time course of pupillary response to threat words before and after attention bias modification for transdiagnostic anxiety disorders: A randomized controlled trial

INTRODUCTION

Altered attention to threatening stimuli at initial and sustained stages of processing may be dissociable dimensions that influence the development and maintenance of transdiagnostic symptoms of anxiety, such as vigilance, and possibly require distinct intervention. Attention bias modification (ABM) interventions were created to implicitly train attention away from threatening stimuli and have shown efficacy in treating anxiety. ABM alters neurocognitive functioning during initial stages of threat processing, but less is known regarding effects of ABM on neural indices of threat processing at sustained (i.e., intermediate and late) stages, or if ABM-related neural changes relate to symptom response. The current study utilized pupillary response as a temporally sensitive and cost-effective peripheral marker of neurocognitive response to ABM.

MATERIALS AND METHODS

In a randomized controlled trial, 79 patients with transdiagnostic anxiety provided baseline data, 70 were randomized to receive eight sessions of twice-weekly ABM (n = 49) or sham training (n = 21), and 65 completed their assigned treatment condition and returned for post-training assessment.

RESULTS

Among ABM, but not sham, patients, pupillary response to threat words during initial and intermediate stages decreased from pre- to post-training. Pre- to post-training reductions in intermediate and late pupillary response to threat were positively correlated with reductions in patient-reported vigilance among ABM, but not sham, patients.

CONCLUSIONS

All measured stages of threat processing had relevance in understanding the neural mechanisms of ABM, with overlapping yet dissociable roles exhibited within a single neurophysiological marker across an initial-intermediate-late time continuum. Pupillometry may be well suited to measure both target engagement and treatment outcome following ABM.

A sensorimotor control framework for understanding emotional communication and regulation

Our research team was asked to consider the relationship of the neuroscience of sensorimotor control to the language of emotions and feelings. Actions are the principal means for the communication of emotions and feelings in both humans and other animals, and the allostatic mechanisms controlling action also apply to the regulation of emotional states by the self and others. We consider how motor control of hierarchically organised, feedback-based, goal-directed action has evolved in humans, within a context of consciousness, appraisal and cultural learning, to serve emotions and feelings. In our linguistic analysis, we found that many emotion and feelings words could be assigned to stages in the sensorimotor learning process, but the assignment was often arbitrary. The embodied nature of emotional communication means that action words are frequently used, but that the meanings or senses of the word depend on its contextual use, just as the relationship of an action to an emotion is also contextually dependent.

Expanding Simulation Models of Emotional Understanding: The Case for Different Modalities, Body-State Simulation Prominence, and Developmental Trajectories

Recent models of emotion recognition suggest that when people perceive an emotional expression, they partially activate the respective emotion in themselves, providing a basis for the recognition of that emotion. Much of the focus of these models and of their evidential basis has been on sensorimotor simulation as a basis for facial expression recognition - the idea, in short, that coming to know what another feels involves simulating in your brain the motor plans and associated sensory representations engaged by the other person's brain in producing the facial expression that you see. In this review article, we argue that simulation accounts of emotion recognition would benefit from three key extensions. First, that fuller consideration be given to simulation of bodily and vocal expressions, given that the body and voice are also important expressive channels for providing cues to another's emotional state. Second, that simulation of other aspects of the perceived emotional state, such as changes in the autonomic nervous system and viscera, might have a more prominent role in underpinning emotion recognition than is typically proposed. Sensorimotor simulation models tend to relegate such body-state simulation to a subsidiary role, despite the plausibility of body-state simulation being able to underpin emotion recognition in the absence of typical sensorimotor simulation. Third, that simulation models of emotion recognition be extended to address how embodied processes and emotion recognition abilities develop through the lifespan. It is not currently clear how this system of sensorimotor and body-state simulation develops and in particular how this affects the development of emotion recognition ability. We review recent findings from the emotional body recognition literature and integrate recent evidence regarding the development of mimicry and interoception to significantly expand simulation models of emotion recognition.

Implicit and explicit processing of bodily emotions in schizophrenia

INTRODUCTION

Disturbed emotion processing is well documented in schizophrenia, but the majority of studies evaluate processing of emotion only from facial expressions. Social cues are also communicated via body posture, and they are similarly relevant for successful social interactions. The aim of the current study was to thoroughly examine body perception abilities in individuals with schizophrenia.

METHODS

Fifty-nine patients with schizophrenia and 37 healthy controls completed two tasks of body processing. The first, which was based on the Affect Misattribution Procedure, evaluated implicit processing of bodily emotions, and the second utilised a traditional emotion identification paradigm to assess explicit emotion recognition.

RESULTS

Results revealed aberrant implicit processing, but more normative explicit processing, in individuals with schizophrenia. Moderate associations were found between processing of bodies and symptoms of paranoia. Performance on the tasks was not related to cognitive functioning but was associated with clinician-rated social functioning.

CONCLUSIONS

Collectively, these results provide information about disturbed processing of bodily emotions in schizophrenia and suggest that these disturbances are associated with the severity of positive symptoms and predict difficulties in everyday social activities and interpersonal relationships.

A Comparison of the Affectiva iMotions Facial Expression Analysis Software With EMG for Identifying Facial Expressions of Emotion

Human faces express emotions, informing others about their affective states. In order to measure expressions of emotion, facial Electromyography (EMG) has widely been used, requiring electrodes and technical equipment. More recently, emotion recognition software has been developed that detects emotions from video recordings of human faces. However, its validity and comparability to EMG measures is unclear. The aim of the current study was to compare the Affectiva Affdex emotion recognition software by iMotions with EMG measurements of the zygomaticus mayor and corrugator supercilii muscle, concerning its ability to identify happy, angry and neutral faces. Twenty participants imitated these facial expressions while videos and EMG were recorded. Happy and angry expressions were detected by both the software and by EMG above chance, while neutral expressions were more often falsely identified as negative by EMG compared to the software. Overall, EMG and software values correlated highly. In conclusion, Affectiva Affdex software can identify facial expressions and its results are comparable to EMG findings.

Blocking facial mimicry affects recognition of facial and body expressions

Facial mimicry is commonly defined as the tendency to imitate-at a sub-threshold level-facial expressions of other individuals. Numerous studies support a role of facial mimicry in recognizing others' emotions. However, the underlying functional mechanism is unclear. A prominent hypothesis considers facial mimicry as based on an action-perception loop, leading to the prediction that facial mimicry should be observed only when processing others' facial expressions. Nevertheless, previous studies have also detected facial mimicry during observation of emotional bodily expressions. An emergent alternative hypothesis is that facial mimicry overtly reflects the simulation of an "emotion", rather than the reproduction of a specific observed motor pattern. In the present study, we tested whether blocking mimicry ("Bite") on the lower face disrupted recognition of happy expressions conveyed by either facial or body expressions. In Experiment 1, we tested participants' ability to identify happy, fearful and neutral expressions in the Bite condition and in two control conditions. In Experiment 2, to ensure that such a manipulation selectively affects emotion recognition, we tested participants' ability to recognize emotional expressions, as well as the actors' gender, under the Bite condition and a control condition. Finally, we investigated the relationship between dispositional empathy and emotion recognition under the condition of blocked mimicry. Our findings demonstrated that blocking mimicry on the lower face hindered recognition of happy facial and body expressions, while the recognition of neutral and fearful expressions was not affected by the mimicry manipulation. The mimicry manipulation did not affect the gender discrimination task. Furthermore, the impairment of happy expression recognition correlated with empathic traits. These results support the role of facial mimicry in emotion recognition and suggest that facial mimicry reflects a global sensorimotor simulation of others' emotions rather than a muscle-specific reproduction of an observed motor expression.

Becoming sexy: Contrapposto pose increases attractiveness ratings and modulates observers' brain activity

Previous neurophysiological studies have revealed the neural correlates of human body form perception, as well as those related to the perception of attractive body sizes. In the current study we aimed to extend the neurophysiological studies regarding body perception by investigating the perception of human body posture to provide insights into the cognitive mechanisms responsive to bodily form, and the processing of its attractiveness. To achieve these aims, we used the contrapposto posture which creates an exaggeration of low waist to hip ratio (WHR), an indicator of women's attractiveness. Electroencephalogram (EEG) signals were recorded while participants completed both (i) an oddball task presenting female body forms differing in pose (contrapposto vs. standing) and viewing angle (anterior vs. posterior), and (ii) a subsequent active attractiveness judgement task. Behavioral results showed that a contrapposto pose is considered more attractive than a neutral standing pose. Results at the neural level showed that body posture modulates the visual information processing in early ERP components, indicating attentional variations depending on human body posture; as well as in late components, indicating further differences in attention and attractiveness judgement of stimuli varying in body pose. Furthermore, the LORETA results identified the middle temporal gyrus as well as angular gyrus as the key brain regions activated in association with the perception and attractiveness judgment of females' bodies with different body poses. Overall, the current paper suggests the evolutionary adaptive preference for lower WHRs as in the contrapposto pose activating brain regions associated with visual perception and attractiveness judgement.

Attention Dynamics During Emotion Recognition by Deaf and Hearing Individuals

The enhancement hypothesis suggests that deaf individuals are more vigilant to visual emotional cues than hearing individuals. The present eye-tracking study examined ambient-focal visual attention when encoding affect from dynamically changing emotional facial expressions. Deaf (n = 17) and hearing (n = 17) individuals watched emotional facial expressions that in 10-s animations morphed from a neutral expression to one of happiness, sadness, or anger. The task was to recognize emotion as quickly as possible. Deaf participants tended to be faster than hearing participants in affect recognition, but the groups did not differ in accuracy. In general, happy faces were more accurately and more quickly recognized than faces expressing anger or sadness. Both groups demonstrated longer average fixation duration when recognizing happiness in comparison to anger and sadness. Deaf individuals directed their first fixations less often to the mouth region than the hearing group. During the last stages of emotion recognition, deaf participants exhibited more focal viewing of happy faces than negative faces. This pattern was not observed among hearing individuals. The analysis of visual gaze dynamics, switching between ambient and focal attention, was useful in studying the depth of cognitive processing of emotional information among deaf and hearing individuals.

Preprocessing pupil size data: Guidelines and code

Pupillometry has been one of the most widely used response systems in psychophysiology. Changes in pupil size can reflect diverse cognitive and emotional states, ranging from arousal, interest and effort to social decisions, but they are also widely used in clinical practice to assess patients’ brain functioning. As a result, research involving pupil size measurements has been reported in practically all psychology, psychiatry, and psychophysiological research journals, and now it has found its way into the primatology literature as well as into more practical applications, such as using pupil size as a measure of fatigue or a safety index during driving. The different systems used for recording pupil size are almost as variable as its applications, and all yield, as with many measurement techniques, a substantial amount of noise in addition to the real pupillometry data. Before analyzing pupil size, it is therefore of crucial importance first to detect this noise and deal with it appropriately, even prior to (if need be) resampling and baseline-correcting the data. In this article we first provide a short review of the literature on pupil size measurements, then we highlight the most important sources of noise and show how these can be detected. Finally, we provide step-by-step guidelines that will help those interested in pupil size to preprocess their data correctly. These guidelines are accompanied by an open source MATLAB script (available at https://github.com/ElioS-S/pupil-size). Given that pupil diameter is easily measured by standard eyetracking technologies and can provide fundamental insights into cognitive and emotional processes, it is hoped that this article will further motivate scholars from different disciplines to study pupil size.

The asynchronous influence of facial expressions on bodily expressions

The ability to extract correct emotional information from facial and bodily expressions is fundamental for the development of social skills. Previous studies have shown that bodily expressions affect the recognition of basic facial expressions dramatically. However, few studies have considered the view that facial expressions may influence the recognition of bodily expressions. Further, previous studies have failed to consider a comprehensive set of emotional categories. The present study sought to examine whether facial expressions would impact the recognition of bodily expressions asynchronously, using four basic emotions. Participants performed an affective priming task, in which the priming stimuli included four facial expressions (happy, sad, fearful, and angry), and the target stimuli were bodily expressions matching the same emotions. The results indicated that the perception of affective facial expressions significantly influenced the accuracy and reaction time for body-based emotion categorization, particularly for bodily expression of happiness. The recognition accuracy of congruent expressions was higher, relative to that of incongruent expressions. The findings show that facial expressions influence the recognition of bodily expressions, despite the asynchrony.

Fear Odor Facilitates the Detection of Fear Expressions Over Other Negative Expressions

In a double-blind experiment, participants were exposed to facial images of anger, disgust, fear, and neutral expressions under 2 body odor conditions: fear and neutral sweat. They had to indicate the valence of the gradually emerging facial image. Two alternative hypotheses were tested, namely a "general negative evaluative state" hypothesis and a "discrete emotion" hypothesis. These hypotheses suggest 2 distinctive data patterns for muscle activation and classification speed of facial expressions. The pattern of results that would support a "discrete emotions perspective" would be expected to reveal significantly increased activity in the medial frontalis (eyebrow raiser) and corrugator supercilii (frown) muscles associated with fear, and significantly decreased reaction times (RTs) to "only" fear faces in the fear odor condition. Conversely, a pattern of results characterized by only a significantly increased corrugator supercilii activity together with decreased RTs for fear, disgust, and anger faces in the fear odor condition would support an interpretation in line with a general negative evaluative state perspective. The data support the discrete emotion account for facial affect perception primed with fear odor. This study provides a first demonstration of perception of discrete negative facial expressions using olfactory priming.

Sex-specific scanning in infancy: Developmental changes in the use of face/head and body information

The current investigation sought to differentiate between contrasting perspectives of body knowledge development by determining whether infants' adult-like scanning of male and female bodies is dependent on relevant information from the face/head alone, the body alone, or a combination of both sources. Scanning patterns of 3.5-, 6.5-, and 9-month-olds (N = 80) in response to images that contained information relevant to sex classification in either the face/head or the body were examined. The results indicate that sex-specific scanning in the presence of only one source of relevant information (i.e., face/head or body) is present only at 9 months. Thus, although sex-specific scanning of bodies emerges as early as 3.5 months, information from both faces/heads and bodies is required until sometime between 6.5 and 9 months of age. These findings constrain theories of the development of social perception by documenting the complex interplay between body and face/head processing early in life.

Cortical modulation of pupillary function: systematic review

BACKGROUND

The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex.

METHODOLOGY

We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included.

RESULTS

Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus.

CONCLUSIONS

Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.

Pupils say more than a thousand words: Pupil size reflects how observed actions are interpreted

Humans attend to others' facial expressions and body language to better understand their emotions and predict goals and intentions. The eyes and its pupils reveal important social information. Because pupil size is beyond voluntary control yet reflective of a range of cognitive and affective processes, pupils in principal have the potential to convey whether others' actions are interpreted correctly or not. Here, we measured pupil size while participants observed video-clips showing reach-to-grasp arm movements. Expressors in the video-clips were playing a board game and moved a dowel to a new position. Participants' task was to decide whether the dowel was repositioned with the intention to be followed up by another move of the same expressor (personal intention) or whether the arm movement carried the implicit message that expressor's turn was over (social intention). Replicating earlier findings, results showed that participants recognized expressors' intentions on the basis of their arm kinematics. Results further showed that participants' pupil size was larger when observing actions reflecting personal compared to social intentions. Most interestingly, before participants indicated how they interpreted the observed actions by choosing to press one of two keys (corresponding to the personal or social intention), their pupils within a split second, had already given away how they interpreted the expressor's movement. In sum, this study underscores the importance of nonverbal behavior in helping social messages get across quickly. Revealing how actions are interpreted, pupils may provide additional feedback for effective social interactions.

Emotional faces guide the eyes in the absence of awareness

The ability to act quickly to a threat is a key skill for survival. Under awareness, threat-related emotional information, such as an angry or fearful face, has not only perceptual advantages but also guides rapid actions such as eye movements. Emotional information that is suppressed from awareness still confers perceptual and attentional benefits. However, it is unknown whether suppressed emotional information can directly guide actions, or whether emotional information has to enter awareness to do so. We suppressed emotional faces from awareness using continuous flash suppression and tracked eye gaze position. Under successful suppression, as indicated by objective and subjective measures, gaze moved towards fearful faces, but away from angry faces. Our findings reveal that: (1) threat-related emotional stimuli can guide eye movements in the absence of visual awareness; (2) threat-related emotional face information guides distinct oculomotor actions depending on the type of threat conveyed by the emotional expression.

The representation and plasticity of body emotion expression

Emotions are expressed by the face, the voice and the whole body. Research on the face and the voice has not only demonstrated that emotions are perceived categorically, but that this perception can be manipulated. The purpose of this study was to investigate, via two separate experiments using adaptation and multisensory techniques, whether the perception of body emotion expressions also shows categorical effects and plasticity. We used an approach developed for studies investigating both face and voice emotion perception and created novel morphed affective body stimuli, which varied in small incremental steps between emotions. Participants were instructed to perform an emotion categorisation of these morphed bodies after adaptation to bodies conveying different expressions (Experiment 1), or while simultaneously hearing affective voices (Experiment 2). We show that not only is body expression perceived categorically, but that both adaptation to affective body expressions and concurrent presentation of vocal affective information can shift the categorical boundary between body expressions, specifically for the angry body expressions. Overall, our findings provide significant new insights into emotional body categorisation, which may prove important in gaining a deeper understanding of body expression perception in everyday social situations.

Suppression of Facial Mimicry of Negative Facial Expressions in an Incongruent Context

Abstract. People react with Rapid Facial Reactions (RFRs) when presented with human facial emotional expressions. Recent studies show that RFRs are not always congruent with emotional cues. The processes underlying RFRs are still being debated. In our study described herein, we manipulate the context of perception and its influence on RFRs. We use a subliminal affective priming task with emotional labels. Facial electromyography (EMG) (frontalis, corrugator, zygomaticus, and depressor) was recorded while participants observed static facial expressions (joy, fear, anger, sadness, and neutral expression) preceded/not preceded by a subliminal word (JOY, FEAR, ANGER, SADNESS, or NEUTRAL). For the negative facial expressions, when the priming word was congruent with the facial expression, participants displayed congruent RFRs (mimicry). When the priming word was incongruent, we observed a suppression of mimicry. Happiness was not affected by the priming word. RFRs thus appear to be modulated by the context and type of emotion that is presented via facial expressions.

Children with social anxiety disorder show blunted pupillary reactivity and altered eye contact processing in response to emotional faces: Insights from pupillometry and eye movements

Cognitive models and adult research associate social anxiety disorder (SAD) with hypervigilant-avoidant processing of social information, such as eye contact. However, processing biases in childhood SAD remain mostly unexplored. We examined 10- to 13-year-old children's eye contact processing and pupil dilation in response to happy, neutral, and angry faces in three groups: SAD (n = 31), mixed anxiety disorders (MAD; n = 30), and healthy controls (HC; n = 32). Compared to HC, SAD children showed faster first fixations on the eye region of neutral faces and shorter first fixation durations on the eye region of all faces. No differences between the two clinical groups emerged in eye movement results. SAD girls showed reduced pupil dilation in response to happy and angry faces compared to MAD and to happy faces compared to HC. SAD boys showed reduced pupil dilation in response to neutral faces compared to HC. Dimensionally, reduced pupil dilation was linked to social anxiety severity while eye movements were correlated with mixed anxiety and depressive severity. Results suggest that hypervigilant-avoidant eye contact processing and a blunted pupillary reactivity characterize children with SAD. Both transdiagnostic and disorder-specific processing biases are relevant for the understanding of childhood SAD.

The dot-probe task to measure emotional attention: A suitable measure in comparative studies?

For social animals, attending to and recognizing the emotional expressions of other individuals is of crucial importance for their survival and likely has a deep evolutionary origin. Gaining insight into how emotional expressions evolved as adaptations over the course of evolution can be achieved by making direct cross-species comparisons. To that extent, experimental paradigms that are suitable for investigating emotional processing across species need to be developed and evaluated. The emotional dot-probe task, which measures attention allocation toward emotional stimuli, has this potential. The task is implicit, and subjects need minimal training to perform the task successfully. Findings in nonhuman primates, although scarce, show that they, like humans, have an attentional bias toward emotional stimuli. However, the wide literature on human studies has shown that different factors can have important moderating effects on the results. Due to the large heterogeneity of this literature, these moderating effects often remain unnoticed. We here review this literature and show that subject characteristics and differences in experimental designs affect the results of the dot-probe task. We conclude with specific recommendations regarding these issues that are particularly relevant to take into consideration when applying this paradigm to study animals.

Coverage of Emotion Recognition for Common Wearable Biosensors

The present research proposes a novel emotion recognition framework for the computer prediction of human emotions using common wearable biosensors. Emotional perception promotes specific patterns of biological responses in the human body, and this can be sensed and used to predict emotions using only biomedical measurements. Based on theoretical and empirical psychophysiological research, the foundation of autonomic specificity facilitates the establishment of a strong background for recognising human emotions using machine learning on physiological patterning. However, a systematic way of choosing the physiological data covering the elicited emotional responses for recognising the target emotions is not obvious. The current study demonstrates through experimental measurements the coverage of emotion recognition using common off-the-shelf wearable biosensors based on the synchronisation between audiovisual stimuli and the corresponding physiological responses. The work forms the basis of validating the hypothesis for emotional state recognition in the literature and presents coverage of the use of common wearable biosensors coupled with a novel preprocessing algorithm to demonstrate the practical prediction of the emotional states of wearers.