Judging emotional congruency: Explicit attention to situational context modulates processing of facial expressions of emotion

Happy and angry facial expressions are processed independently of task demands and semantic context congruency in the first stages of vision - A mass univariate ERP analysis

Neural decoding of others' facial expressions is critical in social interactions and has been investigated using scalp event related potentials (ERPs). However, the impact of task and emotional context congruency on this neural decoding is unclear. Previous ERP studies employed classic statistical analyses that only focused on specific electrodes and time points, which inflates type I and type II errors. The present study re-analyzed the study by Aguado et al. (2019) using robust data-driven Mass Univariate Statistics across every time point and electrode and rejected trials with early reaction times to rule out motor-related activity on neural recordings. Participants viewed neutral faces paired with negative or positive situational sentences (e.g. "She catches her partner cheating on her with her best friend"), followed by the same individuals' faces expressing happiness or anger, such that the facial expressions were congruent or incongruent with the situation. Participants engaged in two tasks: an emotion discrimination task, and a situation-expression congruency discrimination task. We found significant effects of expression largest during the N170-P2 interval, and effects of congruency and task around an LPP-like component. However, the effect of congruency was significant only in the congruency task, suggesting a limited and task-dependant influence of semantic context. Importantly, emotion did not interact with any factor neurally, suggesting facial expressions were decoded automatically during the first 400 ms of vision, regardless of context congruency or task demands. The results and their discrepancies with the original findings are discussed in the context of ERP statistics and the replication crisis.

Competition modulates the effects of social comparison on ERP responses during face processing

Little is known about the effect of prior social performance feedback on face processing. Our previous study explored how equal and unequal social comparison-related outcomes modulate event-related potential (ERP) responses to subsequently presented faces, where interests between oneself and others were independent (noncompetitive situations). Here, we aimed to extend this investigation by assessing how different unequal social comparison-related outcomes affect face processing under noncompetitive and competitive situations (i.e. a conflict of interest exists between the self and others). To address this issue, 39 participants were exposed to self-related and social comparison-related outcomes, categorized as positive or negative, after performing an attentional task with peers. Rewards and punishments depended on social comparison-related outcomes in the competition condition and on self-related outcomes in the noncompetition condition. ERP results showed that social comparison-related outcomes influenced P100 responses to faces in the self-positive condition. More notably, the effects on N170 responses observed in the noncompetition condition were absent in the competition condition. There was an effect on late positive potential responses only in the competition and self-negative condition. These findings suggest that social comparison-related outcomes influence early face processing irrespective of competition, while competition subsequently disrupts this processing but, later, enhances depending on self-related outcomes.

Emotional Evaluations from Partners and Opponents Differentially Influence the Perception of Ambiguous Faces

The influence of contextual valence and interpersonal distance on facial expression perception remains unclear despite their significant role in shaping social perceptions. In this event-related potential (ERP) study, we investigated the temporal dynamics underlying the processing of surprised faces across different interpersonal distances (partner, opponent, or stranger) and contextual valence (positive, neutral, or negative) contexts. Thirty-five participants rated the valence of surprised faces. An advanced mass univariate statistical approach was utilized to analyze the ERP data. Behaviorally, surprised faces in partner-related negative contexts were rated more negatively than those in opponent- and stranger-related contexts. The ERP results revealed an increased P1 amplitude for surprised faces in negative relative to neutral contexts. Both the early posterior negativity (EPN) and late positive potentials (LPP) were also modulated by contextual valence, with larger amplitudes for faces in positive relative to neutral and negative contexts. Additionally, when compared to stranger-related contexts, faces in partner-related contexts exhibited enhanced P1 and EPN responses, while those in opponent-related contexts showed amplified LPP responses. Taken together, these findings elucidate the modulation of intricate social contexts on the perception and interpretation of ambiguous facial expressions, thereby enhancing our understanding of nonverbal communication and emotional cognition.

Emotional text messages affect the early processing of emoticons depending on their emotional congruence: evidence from the N170 and EPN event related potentials

Emoticons have been considered pragmatic cues that enhance emotional expressivity during computer-mediated communication. Yet, it is unclear how emoticons are processed in ambiguous text-based communication due to incongruences between the emoticon's emotional valence and its context. In this study, we investigated the electrophysiological correlates of contextual influence on the early emotional processing of emoticons, during an emotional congruence judgment task. Participants were instructed to judge the congruence between a text message expressing an emotional situation (positive or negative), and a subsequent emoticon expressing positive or negative emotions. We analyzed early event-related potentials elicited by emoticons related to face processing (N170) and emotional salience in visual perception processing (Early Posterior Negativity, EPN). Our results show that accuracy and Reaction Times depend on the interaction between the emotional valence of the context and the emoticon. Negative emoticons elicited a larger N170, suggesting that the emotional information of the emoticon is integrated at the early stages of the perceptual process. During emoticon processing, a valence effect was observed with enhanced EPN amplitudes in occipital areas for emoticons representing negative valences. Moreover, we observed a congruence effect in parieto-temporal sites within the same time-window, with larger amplitudes for the congruent condition. We conclude that, similar to face processing, emoticons are processed differently according to their emotional content and the context in which they are embedded. A congruent context might enhance the emotional salience of the emoticon (and therefore, its emotional expression) during the early stages of their processing.

You're Beautiful When You Smile: Event-Related Brain Potential (ERP) Evidence of Early Opposite-Gender Bias in Happy Faces

Studies of social cognition have shown gender differences regarding human face processing. One interesting finding is the enhanced processing of opposite-gender faces at different time stages, as revealed by event-related brain potentials. Crucially, from an evolutionary perspective, such a bias might interact with the emotional expression of the face. To investigate this, 100 participants (50 female, 50 male) completed an expression-detection task while their EEG was recorded. In three blocks, fearful, happy and neutral faces (female and male) were randomly presented, with participants instructed to respond to only one predefined target expression level in each block. Using linear mixed models, we observed both faster reaction times as well as larger P1 and late positive potential (LPP) amplitudes for women compared to men, supporting a generally greater female interest in faces. Highly interestingly, the analysis revealed an opposite-gender bias at P1 for happy target faces. This suggests that participants' attentional templates may include more opposite-gender facial features when selectively attending to happy faces. While N170 was influenced by neither the face nor the participant gender, LPP was modulated by the face gender and specific combinations of the target status, face gender and expression, which is interpreted in the context of gender-emotion stereotypes. Future research should further investigate this expression and attention dependency of early opposite-gender biases.

Expectancy and attention bias to spiders: Dissecting anticipation and allocation processes using ERPs

The current registered report focused on the temporal dynamics of the relationship between expectancy and attention toward threat, to better understand the mechanisms underlying the prioritization of threat detection over expectancy. In the current event-related potentials experiment, a-priori expectancy was manipulated, and attention bias was measured, using a well-validated paradigm. A visual search array was presented, with one of two targets: spiders (threatening) or birds (neutral). A verbal cue stating the likelihood of encountering a target preceded the array, creating congruent and incongruent trials. Following cue presentation, preparatory processes were examined using the contingent negative variation (CNV) component. Following target presentation, two components were measured: early posterior negativity (EPN) and late positive potential (LPP), reflecting early and late stages of natural selective attention toward emotional stimuli, respectively. Behaviorally, spiders were found faster than birds, and congruency effects emerged for both targets. For the CNV, a non-significant trend of more negative amplitudes following spider cues emerged. As expected, EPN and LPP amplitudes were larger for spider targets compared to bird targets. Data-driven, exploratory, topographical analyses revealed different patterns of activation for bird cues compared to spider cues. Furthermore, 400-500 ms post-target, a congruency effect was revealed only for bird targets. Together, these results demonstrate that while expectancy for spider appearance is evident in differential neural preparation, the actual appearance of spider target overrides this expectancy effect and only in later stages of processing does the cueing effect come again into play.

Comparison with others influences encoding and recognition of their faces: Behavioural and ERP evidence

In daily life, faces are often memorized within contexts involving interpersonal interactions. However, little is known about whether interpersonal interaction-related contexts influence face memory. The present study aimed to understand this question by investigating how social comparison-related context affects face encoding and recognition. To address this issue, 40 participants were informed that they and another player each played a monetary game and were then presented with both of their outcomes (either monetary gain or loss). Subsequently, participants were shown the face of the player whom they were just paired with. After all the faces had been encoded, participants were asked to perform a sudden old/new recognition task involving these faces. The results showed that, during the encoding phase, another player's monetary gain, compared to loss, resulted in more negative responses in the N170 and early posterior negativity (EPN)/N250 to relevant players' faces when participants encountered monetary loss and a smaller late positive potential (LPP) response irrespective of self-related outcomes. In the subsequent recognition phase, preceding another player's monetary gain as compared to loss led to better recognition performance and stronger EPN/N250 and LPP responses to the faces of relevant players when participants had lost some amount of money. These findings suggest that the social comparison-related context, particularly self-disadvantageous outcomes in the context, influences the memory of comparators' faces.

Alexithymia modulates emotion concept activation during facial expression processing

Alexithymia is characterized by difficulties in emotional information processing. However, the underlying reasons for emotional processing deficits in alexithymia are not fully understood. The present study aimed to investigate the mechanism underlying emotional deficits in alexithymia. Using the Toronto Alexithymia Scale-20, we recruited college students with high alexithymia (n = 24) or low alexithymia (n = 24) in this study. Participants judged the emotional consistency of facial expressions and contextual sentences while recording their event-related potentials. Behaviorally, the high alexithymia group showed longer response times versus the low alexithymia group in processing facial expressions. The event-related potential results showed that the high alexithymia group had more negative-going N400 amplitudes compared with the low alexithymia group in the incongruent condition. More negative N400 amplitudes are also associated with slower responses to facial expressions. Furthermore, machine learning analyses based on N400 amplitudes could distinguish the high alexithymia group from the low alexithymia group in the incongruent condition. Overall, these findings suggest worse facial emotion perception for the high alexithymia group, potentially due to difficulty in spontaneously activating emotion concepts. Our findings have important implications for the affective science and clinical intervention of alexithymia-related affective disorders.

Emotional congruency between faces and words benefits emotional judgments in women: An event-related potential study

The present study aimed to investigate the effects of emotional congruency between faces and words on word evaluation through event-related brain potentials (ERPs). To this end, 20 women performed a face-word congruency task in which an emotional face was presented simultaneously with an affective word in a non-superimposed format. Participants had to evaluate the emotional valence of the word in three different conditions: congruent, incongruent, and control. The emotionally congruent words were categorized faster and more accurately than the incongruent ones. In addition, the emotionally congruent words elicited higher P3/LPP amplitudes than the incongruent ones. These results indicate a beneficial effect of emotional face-word congruency on emotional judgments of words.

Event-related alpha power in early stage of facial expression processing in social anxiety: Influence of language context

Accurate interpretation of the emotional information conveyed by others' facial expressions is crucial for social interactions. Event-related alpha power, measured by time-frequency analysis, is a frequently used EEG index of emotional information processing. However, it is still unclear how event-related alpha power varies in emotional information processing in social anxiety groups. In the present study, we recorded event-related potentials (ERPs) while participants from the social anxiety and healthy control groups viewed facial expressions (angry, happy, neutral) preceded by contextual sentences conveying either a positive or negative evaluation of the subject. The impact of context on facial expression processing in both groups of participants was explored by assessing behavioral ratings and event-related alpha power (0-200 ms after expression presentation). In comparison to the healthy control group, the social anxiety group exhibited significantly lower occipital alpha power in response to angry facial expressions in negative contexts and neutral facial expressions in positive contexts. The influence of language context on facial expression processing in individuals with social anxiety may occur at an early stage of processing.

Electrophysiological correlates of semantic pain processing in the affective priming

Introduction

Pain plays a fundamental role in the well-being of the individual, and its semantic content may have specific properties compared to other negative domains (i.e., fear and anger) which allows the cognitive system to detect it with priority. Considering the influence of the affective context in which stimuli (targets) are evaluated, it is possible that their valence could be differentially processed if preceded by negative stimuli (primes) associated with pain than negative stimuli not associated with pain. Thus, the present study aims to investigate the electrophysiological correlates of the implicit processing of words with pain content by using an affective priming paradigm.

Methods

Event-related potentials (ERPs) were recorded while participants were presented with positive and negative word targets (not associated with pain) that were preceded by positive, negative (not associated with pain), and pain word primes. Participants were asked to judge the valence of the target word.

Results

Results showed faster reaction times (RTs) in congruent conditions, especially when the negative target was preceded by a pain prime rather than a positive one. ERPs analyses showed no effect of pain at an early-stage processing (N400), but a larger waveform when the pain prime preceded the positive prime on the LPP.

Discussion

These results reaffirm the importance that valence has in establishing the priority with which stimuli are encoded in the environment and highlight the role that pain has in the processing of stimuli, supporting the hypothesis according to which the valence and the semantics of a stimulus interact with each other generating a specific response for each type of emotion.

Exploring the Influence of Context on Emotional Mimicry and Intention: An Affirmation of the Correction Hypothesis

BACKGROUND

Emotional mimicry, a phenomenon frequently observed in our everyday interactions, is the act of replicating another individual's facial expression. The Emotion Mimicry in Context View and the Correction Hypothesis underscore the critical role of context and intention within emotional mimicry.

METHODS

In two distinct studies, participants were presented with facial expressions of models (happiness and anger) within various contexts (affiliative, distancing, and neutral). Concurrently, we recorded electromyography (EMG) to index emotional mimicry, while participants explicitly rated the models' intentions.

RESULTS

We observed context swiftly influences emotional mimicry within 500 ms, notably when the intentions of contexts are opposing to the intentions of facial expressions, leading to weakened muscle responses and diminished perceived intention. Furthermore, a notable correlation was discovered in the mimicry of angry faces; the more distancing the context, the stronger the corrugator supercilii (CS) muscle activity after context processing.

CONCLUSIONS

First, emotional mimicry should not be simply viewed as an output corresponding to the expresser's facial expressions but the dynamic process involving the active participation of the observer. Second, intention serves as a pivotal anchor, effectively integrating facial and contextual information. As such, we provided empirical support for the Correction Hypothesis.

Effects of emotion words activation and satiation on facial expression perception: evidence from behavioral and ERP investigations

Objective

The present study investigated the impact of emotion concepts obtained from external environmental experiences on the perception of facial expressions by manipulating the activation and satiation of emotion words, which was based on the argument between basic emotion theory and constructed emotion theory.

Methods

Experiment 1 explored the effects of emotion activation on happy, disgusted, emotion-label words and emotion-laden words in a facial expression judgment task through behavioral experimentation. Experiment 2 explored the effect of semantic satiation on emotion-label words and emotion-laden words using the event-related potential technique.

Results

Experiment 1 found that facial expression perception was influenced by both types of emotion words and showed a significant emotional consistency effect. Experiment 2 found that N170 exhibited a more negative amplitude in the consistent condition compared to the inconsistent condition in the right hemisphere. More importantly, in the later stage of facial expression processing, emotion-label words and emotion-laden words both obstructed the perception of disgusted facial expressions and elicited more negative N400 amplitude in the emotion consistency condition, showing a reversed N400 effect.

Conclusion

These results suggested that emotion concepts in the form of language influenced the perception of facial expressions, but there were differences between happy and disgusted faces. Disgusted faces were more dependent on emotion concept information and showed different performances in semantic activation and satiation conditions.

Neural response and representation: Facial expressions in scenes

Previous studies have shown that the brain generates expectations based on scenes, which affects facial expression recognition. However, although facial expressions are known to interact with perception, the mechanism underlying this interaction remains poorly understood. Here, we used frequency labeling and decoding techniques to reveal the effects of scene-based expectation on the amplitude and representational strength of neural activity. We also reduced the relative reliability between expectation and sensory input by blurring facial expressions to further investigate the effects of this relative reliability on the pattern of neural activation and representation. Participants viewed emotional changes in unblurred or blurred facial expressions, which flickered at a rate of 6 Hz within a scene. We found that facial expressions that were congruent with the emotional significance of the scene elicited a larger steady-state visual evoked potential amplitude than did facial expressions that were incongruent with the emotional significance of a scene, in both unblurred and blurred conditions. We also found that expected facial expression representations were stronger than unexpected representations during the unblurred condition. In the blurred condition, unexpected representations were stronger than expected representations. Taken together, these results suggested that facial expression processing in the visual cortex is modulated by top-down signals. The relative reliability of expectation and sensory input moderated the influence of a scene on facial expression representation. Furthermore, our study showed that neural activation amplitudes did not correspond to representational strength.

How do word valence and classes influence lexical processing? Evidence from virtual reality emotional contexts

The current study examines the influence of word class (i.e., noun vs. adjective) and valence (i.e., positive vs. negative vs. neutral) on the processing of emotional words under different virtual reality (VR) emotional contexts. To this end, 115 participants performed a modified affect labeling task after experiencing different VR scenarios. Their galvanic skin responses were also examined to further gauge the different effects of VR contexts. The results demonstrated significant main effect for word valence, indicating more processing of positive words relative to neutral words which are processed more than negative words. The results also demonstrated significant main effect for word class, indicating more processing of nouns in contrast to adjectives. Additionally, the results indicated that both positive and negative VR contexts could stimulate participants to select more positive words though negatively valenced words were processed more under negative VR context relative to positive VR context. However, the amplitude of galvanic skin responses in positive VR was lower than that in negative VR. The results were interpreted in line with the situation-consistency effects, the mood-consistency effects, the specific nature of VR context, and the different features of different word classes in terms of concreteness, imageability, arousal, and valence.

The priming effects of emotional vocal expressions on face encoding and recognition: An ERP study

Previous studies have suggested that emotional primes, presented as visual stimuli, influence face memory (e.g., encoding and recognition). However, due to stimulus-associated issues, whether emotional primes affect face encoding when the priming stimuli are presented in an auditory modality remains controversial. Moreover, no studies have investigated whether the effects of emotional auditory primes are maintained in later stages of face memory, such as face recognition. To address these issues, participants in the present study were asked to memorize angry and neutral faces. The faces were presented after a simple nonlinguistic interjection expressed with angry or neutral prosodies. Subsequently, participants completed an old/new recognition task in which only faces were presented. Event-related potential (ERP) results showed that during the encoding phase, all faces preceded by an angry vocal expression elicited larger N170 responses than faces preceded by a neutral vocal expression. Angry vocal expression also enhanced the late positive potential (LPP) responses specifically to angry faces. In the subsequent recognition phase, preceding angry vocal primes reduced early LPP responses to both angry and neutral faces and late LPP responses specifically to neutral faces. These findings suggest that the negative emotion of auditory primes influenced face encoding and recognition.

Therapist reactions to patient personality: A pilot study of clinicians’ emotional and neural responses using three clinical vignettes from in treatment series

Introduction

Therapists’ responses to patients play a crucial role in psychotherapy and are considered a key component of the patient–clinician relationship, which promotes successful treatment outcomes. To date, no empirical research has ever investigated therapist response patterns to patients with different personality disorders from a neuroscience perspective.

Methods

In the present study, psychodynamic therapists (N = 14) were asked to complete a battery of instruments (including the Therapist Response Questionnaire) after watching three videos showing clinical interactions between a therapist and three patients with narcissistic, histrionic/borderline, and depressive personality disorders, respectively. Subsequently, participants’ high-density electroencephalography (hdEEG) was recorded as they passively viewed pictures of the patients’ faces, which were selected from the still images of the previously shown videos. Supervised machine learning (ML) was used to evaluate whether: (1) therapists’ responses predicted which patient they observed during the EEG task and whether specific clinician reactions were involved in distinguishing between patients with different personality disorders (using pairwise comparisons); and (2) therapists’ event-related potentials (ERPs) predicted which patient they observed during the laboratory experiment and whether distinct ERP components allowed this forecast.

Results

The results indicated that therapists showed distinct patterns of criticized/devalued and sexualized reactions to visual depictions of patients with different personality disorders, at statistically systematic and clinically meaningful levels. Moreover, therapists’ late positive potentials (LPPs) in the hippocampus were able to determine which patient they observed during the EEG task, with high accuracy.

Discussion

These results, albeit preliminary, shed light on the role played by therapists’ memory processes in psychotherapy. Clinical and neuroscience implications of the empirical investigation of therapist responses are discussed.

Threat induction biases processing of emotional expressions

Threats can derive from our physical or social surroundings and bias the way we perceive and interpret a given situation. They can be signaled by peers through facial expressions, as expressed anger or fear can represent the source of perceived threat. The current study seeks to investigate enhanced attentional state and defensive reflexes associated with contextual threat induced through aversive sounds presented in an emotion recognition paradigm. In a sample of 120 healthy participants, response and gaze behavior revealed differences in perceiving emotional facial expressions between threat and safety conditions: Responses were slower under threat and less accurate. Happy and neutral facial expressions were classified correctly more often in a safety context and misclassified more often as fearful under threat. This unidirectional misclassification suggests that threat applies a negative filter to the perception of neutral and positive information. Eye movements were initiated later under threat, but fixation changes were more frequent and dwell times shorter compared to a safety context. These findings demonstrate that such experimental paradigms are capable of providing insight into how context alters emotion processing at cognitive, physiological, and behavioral levels. Such alterations may derive from evolutionary adaptations necessary for biasing cognitive processing to survive disadvantageous situations. This perspective sets up new testable hypotheses regarding how such levels of explanation may be dysfunctional in patient populations.

High Emotional Similarity Will Enhance the Face Memory and Face-Context Associative Memory

Previous research has explored how emotional valence (positive or negative) affected face-context associative memory, while little is known about how arousing stimuli that share the same valence but differ in emotionality are bound together and retained in memory. In this study, we manipulated the emotional similarity between the target face and the face associated with the context emotion (i.e., congruent, high similarity, and low similarity), and examined the effect of emotional similarity of negative emotion (i.e., disgust, anger, and fear) on face-context associative memory. Our results showed that the greater the emotional similarity between the faces, the better the face memory and face-context associative memory were. These findings suggest that the processing of facial expression and its associated context may benefit from taking into account the emotional similarity between the faces.

Research on Voice-Driven Facial Expression Film and Television Animation Based on Compromised Node Detection in Wireless Sensor Networks

With the continuous development of social economy, film and television animation, as the spiritual needs of ordinary people, is more and more popular. Especially for the development of emerging technologies, the corresponding voice can be used to change AI expression. But at the same time, how to ensure the synchronization of language sound and facial expression is one of the difficulties in animation transformation. Relying on the compromised node detection of wireless sensor networks, this paper combs the synchronous traffic flow between the speech signals and facial expressions, finds the pattern distribution of facial motion based on unsupervised classification, realizes training and learning through neural networks, and realizes one-to-one mapping to facial expressions by using the rhyme distribution of speech features. It avoids the defect of robustness of speech recognition, improves the learning ability of speech recognition, and realizes the driving analysis of facial expression film and television animation. The simulation results show that the compromised node detection in wireless sensor networks is effective and can support the analysis and research of speech-driven facial expression film and television animation.

Emotion, Gender and Gaze Discrimination Tasks do not Differentially Impact the Neural Processing of Angry or Happy Facial Expressions-a Mass Univariate ERP Analysis

Facial expression processing is a critical component of social cognition yet, whether it is influenced by task demands at the neural level remains controversial. Past ERP studies have found mixed results with classic statistical analyses, known to increase both Type I and Type II errors, which Mass Univariate statistics (MUS) control better. However, MUS open-access toolboxes can use different fundamental statistics, which may lead to inconsistent results. Here, we compared the output of two MUS toolboxes, LIMO and FMUT, on the same data recorded during the processing of angry and happy facial expressions investigated under three tasks in a within-subjects design. Both toolboxes revealed main effects of emotion during the N170 timing and main effects of task during later time points typically associated with the LPP component. Neither toolbox yielded an interaction between the two factors at the group level, nor at the individual level in LIMO, confirming that the neural processing of these two face expressions is largely independent from task demands. Behavioural data revealed main effects of task on reaction time and accuracy, but no influence of expression or an interaction between the two. Expression processing and task demands are discussed in the context of the consistencies and discrepancies between the two toolboxes and existing literature.

Does gaze direction of fearful faces facilitate the processing of threat? An ERP study of spatial precuing effects

Eye gaze is very important for attentional orienting in social life. By adopting the event-related potential (ERP) technique, we explored whether attentional orienting of eye gaze is modulated by emotional congruency between facial expressions and the targets in a spatial cuing task. Faces with different emotional expressions (fearful/angry/happy/neutral) directing their eye gaze to the left or right were used as cues, indicating the possible location of subsequent targets. Targets were line drawings of animals, which could be either threatening or neutral. Participants indicated by choice responses whether the animal would fit inside a shoebox in real life or not. Reaction times to targets were faster after valid compared with invalid cues, showing the typical eye gaze cuing effect. Analyses of the late positive potential (LPP) elicited by targets revealed a significant modulation of the gaze cuing effect by emotional congruency. Threatening targets elicited larger LPPs when validly cued by gaze in faces with negative (fearful and angry) expressions. Similarly, neutral targets showed larger LPPs when validly cued by faces with neutral expressions. Such effects were not present after happy face cues. Source localization in the LPP time window revealed that for threatening targets, the activity of right medial frontal gyrus could be related to a larger gaze-orienting effect for the fearful than the angry condition. Our findings provide electrophysiological evidence for the modulation of gaze cuing effects by emotional congruency.

Gender differences in subliminal affective face priming: A high-density ERP study

INTRODUCTION

Subliminal affective priming effects (SAPEs) refer to the phenomenon by which the presentation of an affective prime stimulus influences the subsequent affective evaluation of a target stimulus. Previous studies have reported that unconsciously processed stimuli affect behavioral performance more than consciously processed stimuli. However, the impact of SAPEs on the face-specific N170 component is unclear. We studied how SAPEs for fearful faces affected the N170 for subsequent supraliminal target faces using event-related potentials (ERPs).

METHODS

Japanese adults (n = 44, 20 females) participated in this study. Subliminal prime faces (neutral or fearful) were presented for 17 ms, followed by a backward mask for 283 ms and 800 ms target faces (neutral, emotionally ambiguous, or fearful). 128-channel ERPs were recorded while participants judged the expression of target faces as neutral or fearful. Response rates and response times were also measured for assessing behavioral alterations.

RESULTS

Although the behavioral results revealed no evidence of SAPEs, we found gender-related SAPEs in right N170 amplitude. Specifically, female participants exhibited enhanced right N170 amplitude for emotionally neutral faces primed by fearful faces, while male participants exhibited decreased N170 amplitude in fearful prime trials with fearful target faces. Male participants exhibited significant correlations between N170 amplitude and behavioral response time in the fearful prime-neutral target condition.

CONCLUSIONS

Our ERP results suggest the existence of a gender difference in target-face processing preceded by subliminally presented face stimuli in the right occipito-temporal region.

Subliminal affective priming effect: Dissociated processes for intense versus normal facial expressions

Positive vs. negative intense-facial expressions are difficult to explicitly distinguish; yet, whether they dissociate when subliminally presented remains unclear. Through three experiments using affective priming paradigms, we assessed how intense facial expressions, when presented briefly (17 ms) and masked, influenced following neutral ambiguous words (Experiment 1) or visible facial expressions (Experiments 2&3). We also compared these results with those of using normal facial expressions as primes in each experiment. All experiments indicated masked affective priming effects (biasing valence judgement of neutral words or facilitating reaction time to faces with the same valence as the prime) in normal facial expression, but not those intense ones. Experiment 3 using event related potentials (ERPs) further revealed that two ERP components N250 and LPP were consistent with behavioral changes in the normal condition (larger when valences of primes and targets were different), but inconsistent in the intense condition. Taken together, our results provided behavioral and neural evidence for distinctive processing between normal and intense facial expressions under masked condition.

Feeling through another's eyes: Perceived gaze direction impacts ERP and behavioural measures of positive and negative affective empathy

Looking at the eyes informs us about the thoughts and emotions of those around us, and impacts our own emotional state. However, it is unknown how perceiving direct and averted gaze impacts our ability to share the gazer's positive and negative emotions, abilities referred to as positive and negative affective empathy. We presented 44 participants with contextual sentences describing positive, negative and neutral events happening to other people (e.g. "Her newborn was saved/killed/fed yesterday afternoon."). These were designed to elicit positive, negative, or little to no empathy, and were followed by direct or averted gaze images of the individuals described. Participants rated their affective empathy for the individual and their own emotional valence on each trial. Event-related potentials time-locked to face-onset and associated with empathy and emotional processing were recorded to investigate whether they were modulated by gaze direction. Relative to averted gaze, direct gaze was associated with increased positive valence in the positive and neutral conditions and with increased positive empathy ratings. A similar pattern was found at the neural level, using robust mass-univariate statistics. The N100, thought to reflect an automatic activation of emotion areas, was modulated by gaze in the affective empathy conditions, with opposite effect directions in positive and negative conditions.. The P200, an ERP component sensitive to positive stimuli, was modulated by gaze direction only in the positive empathy condition. Positive and negative trials were processed similarly at the early N200 processing stage, but later diverged, with only negative trials modulating the EPN, P300 and LPP components. These results suggest that positive and negative affective empathy are associated with distinct time-courses, and that perceived gaze direction uniquely modulates positive empathy, highlighting the importance of studying empathy with face stimuli.

Facing stereotypes: ERP responses to male and female faces after gender-stereotyped statements

Despite gender is a salient feature in face recognition, the question of whether stereotyping modulates face processing remains unexplored. Event-related potentials from 40 participants (20 female) was recorded as male and female faces matched or mismatched previous gender-stereotyped statements and were compared with those elicited by faces preceded by gender-unbiased statements. We conducted linear mixed-effects models to account for possible random effects from both participants and the strength of the gender bias. The amplitude of the N170 to faces was larger following stereotyped relative to gender-unbiased statements in both male and female participants, although the effect was larger for males. This result reveals that stereotyping exerts an early effect in face processing and that the impact is higher in men. In later time windows, male faces after female-stereotyped statements elicited large late positivity potential (LPP) responses in both men and women, indicating that the violation of male stereotypes induces a post-perceptual reevaluation of a salient or conflicting event. Besides, the largest LPP amplitude in women was elicited when they encountered a female face after a female-stereotyped statement. The later result is discussed from the perspective of recent claims on the evolution of women self-identification with traditionally held female roles.

Do you feel like me or not? This is the question: manipulation of emotional imagery modulates affective priming

Mood congruity and affective priming have been used to study the effects of affective phenomena on perception. Manipulation of mood is appropriate for investigations of long-term effects while affective priming is limited to short intervals (approximately 300 ms) between a prime and target. However, studying the influence of real-world rapidly changing emotional episodes on perception may fall between the cracks of these methods. This may be caused, inter alia, because emotional episodes are distinguished from mood experiences on one hand, but often last for longer than roughly 300 ms on the other. Thus, it is unclear what experimental approach should be taken to investigate congruency effects triggered by emotional episodes. The present study used a new variation of the evaluation decision task (EDT) combined with a script-driven imagery procedure to investigate a possible congruency relationship between the evaluator's emotional experience at a given time and observable emotional markers of others. We used 180 9-word script-driven imageries as varying valence primes (negative, positive, neutral) and asked participants to imagine themselves in the situation described in the scripts. At the last stage of a trial, all participants were asked to evaluate the mood-positive or negative-of a target face of a child in a photograph. We manipulated the reading interval (4000 ms and 1350 ms) and the subsequent blank interval (300 ms, 5000 ms, and unlimited) until target onset. Prime and target valence were congruent or incongruent. Significant congruency effects were found for both short and long reading intervals and blank intervals. However, in longer blank intervals only the interference effect reached significance. Furthermore, the interference effect was found to be significant mainly in trials beginning with a negative script.

Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces

The processing of fearful facial expressions is prioritized by the human brain. This priority is maintained across various information processing stages as evident in early, intermediate and late components of event-related potentials (ERPs). However, emotional modulations are inconsistently reported for these different processing stages. In this pre-registered study, we investigated how feature-based attention differentially affects ERPs to fearful and neutral faces in 40 participants. The tasks required the participants to discriminate either the orientation of lines overlaid onto the face, the sex of the face or the face's emotional expression, increasing attention to emotion-related features. We found main effects of emotion for the N170, early posterior negativity (EPN) and late positive potential (LPP). While N170 emotional modulations were task-independent, interactions of emotion and task were observed for the EPN and LPP. While EPN emotion effects were found in the sex and emotion tasks, the LPP emotion effect was mainly driven by the emotion task. This study shows that early responses to fearful faces are task-independent (N170) and likely based on low-level and configural information while during later processing stages, attention to the face (EPN) or-more specifically-to the face's emotional expression (LPP) is crucial for reliable amplified processing of emotional faces.

The effect of empathy and context on face-processing ERPs

The investigation of emotional face processing has largely used faces devoid of context, and does not account for within-perceiver differences in empathy. The importance of context in face perception has become apparent in recent years. This study examined the interaction of the contextual factors of facial expression, knowledge of a person's character, and within-perceiver empathy levels on face processing event-related potentials (ERPs). Forty-two adult participants learned background information about six individuals' character. Three types of character were described, in which the character was depicted as deliberately causing harm to others, accidently causing harm to others, or undertaking neutral actions. Subsequently, EEG was recorded while participants viewed the characters' faces displaying neutral or emotional expressions. Participants' empathy was assessed using the Empathy Quotient survey. Results showed a significant interaction of character type and empathy on the early posterior negativity (EPN) ERP component. These results suggested that for those with either low or high empathy, more attention was paid to the face stimuli, with more distinction between the different characters. In contrast, those in the middle range of empathy tended to produce smaller EPN with less distinction between character types. Findings highlight the importance of trait empathy in accounting for how faces in context are perceived.

Early integration of affectively contextual information when processing low-intensity fearful faces: Behavioral and electrophysiological evidence

In daily social situations, faces rarely appear in isolation and are often contextual. This study investigated individuals' behavioral and neural responses to facial expressions with different intensities embedded in emotional scenes. Participants were presented with neutral, low-intensity, and prototypical fearful expressions embedded in positive and negative scenes and instructed to categorize the facial expressions as neutral or fearful. The behavioral results showed that neutral and low-intensity fearful expressions embedded in negative scenes were rated as fearful significantly more frequently than the same faces embedded in positive scenes. Event-related potential analyses revealed the time course of the integration of contextual information when processing facial expressions. N170 modulation by scene valence was found for low-intensity and prototypical fearful expressions, showing greater N170 elicited by negative than positive scenes. The results suggest that affective information extracted from contextual scenes influences the processing of facial emotions in the early perceptual encoding stage. Furthermore, the pattern of effect varies for different intensities of expressions.

In context: emotional intent and temporal immediacy of contextual descriptions modulate affective ERP components to facial expressions

In this study, we explored how contextual information about threat dynamics affected the electrophysiological correlates of face perception. Forty-six healthy native Swedish speakers read verbal descriptions signaling an immediate vs delayed intent to escalate or deescalate an interpersonal conflict. Each verbal description was followed by a face with an angry or neutral expression, for which participants rated valence and arousal. Affective ratings confirmed that the emotional intent expressed in the descriptions modulated emotional reactivity to the facial stimuli in the expected direction. The electrophysiological data showed that compared to neutral faces, angry faces resulted in enhanced early and late event-related potentials (VPP, P300 and LPP). Additionally, emotional intent and temporal immediacy modulated the VPP and P300 similarly across angry and neutral faces, suggesting that they influence early face perception independently of facial affect. By contrast, the LPP amplitude to faces revealed an interaction between facial expression and emotional intent. Deescalating descriptions eliminated the LPP differences between angry and neutral faces. Together, our results suggest that information about a person’s intentions modulates the processing of facial expressions.

Attending to Eliza: rapid brain responses reflect competence attribution in virtual social feedback processing

In the age of virtual communication, the source of a message is often inferred rather than perceived, raising the question of how sender attributions affect content processing. We investigated this issue in an evaluative feedback scenario. Participants were told that an expert psychotherapist, a layperson or a randomly acting computer was going to give them online positive, neutral or negative personality feedback while high-density EEG was recorded. Sender attribution affected processing rapidly, even though the feedback was on average identical. Event-related potentials revealed a linear increase with attributed expertise beginning 150 ms after disclosure and most pronounced for N1, P2 and early posterior negativity components. P3 and late positive potential amplitudes were increased for both human senders and for emotionally significant (positive or negative) feedback. Strikingly, feedback from a putative expert prompted large P3 responses, even for inherently neutral content. Source analysis localized early enhancements due to attributed sender expertise in frontal and somatosensory regions and later responses in the posterior cingulate and extended visual and parietal areas, supporting involvement of mentalizing, embodied processing and socially motivated attention. These findings reveal how attributed sender expertise rapidly alters feedback processing in virtual interaction and have implications for virtual therapy and online communication.

Contextual information resolves uncertainty about ambiguous facial emotions: Behavioral and magnetoencephalographic correlates

Environmental conditions bias our perception of other peoples' facial emotions. This becomes quite relevant in potentially threatening situations, when a fellow's facial expression might indicate potential danger. The present study tested the prediction that a threatening environment biases the recognition of facial emotions. To this end, low- and medium-expressive happy and fearful faces (morphed to 10%, 20%, 30%, or 40% emotional) were presented within a context of instructed threat-of-shock or safety. Self-reported data revealed that instructed threat led to a biased recognition of fearful, but not happy facial expressions. Magnetoencephalographic correlates revealed spatio-temporal clusters of neural network activity associated with emotion recognition and contextual threat/safety in early to mid-latency time intervals in the left parietal cortex, bilateral prefrontal cortex, and the left temporal pole regions. Early parietal activity revealed a double dissociation of face-context information as a function of the expressive level of facial emotions: When facial expressions were difficult to recognize (low-expressive), contextual threat enhanced fear processing and contextual safety enhanced processing of subtle happy faces. However, for rather easily recognizable faces (medium-expressive) the left hemisphere (parietal cortex, PFC, and temporal pole) showed enhanced activity to happy faces during contextual threat and fearful faces during safety. Thus, contextual settings reduce the salience threshold and boost early face processing of low-expressive congruent facial emotions, whereas face-context incongruity or mismatch effects drive neural activity of easier recognizable facial emotions. These results elucidate how environmental settings help recognize facial emotions, and the brain mechanisms underlying the recognition of subtle nuances of fear.

Negative expectations influence behavioral and ERP responses in the subsequent recognition of expectancy-incongruent neutral events

Previous studies have shown that expectancy incongruence in emotional stimuli influences the encoding (i.e., the first stage of memory processing) of the stimuli. However, it is unknown about whether expectancy incongruence influences later stages of memory processing, such as recognition. To this end, expectancy cues were presented prior to emotional pictures. Most often, the cues accurately indicated the emotional consequences of the pictures, but in some cases the consequence was incongruent with the expectations, and a picture from another emotional category was presented. Afterward, participants completed an unexpected recognition task in which old and novel pictures were not preceded by expectancy cues. The results showed that, in the encoding phase, expectancy incongruence reduced response accuracy when categorizing pictorial emotions, and the effect was smaller for neutral pictures than for negative pictures. ERP results showed stronger and weaker responses to expectancy incongruent pictures compared to congruent pictures in time ranges related to the encoding-related early and middle late positive potential (LPP), respectively. In the subsequent recognition phase, d' scores were higher for incongruent neutral pictures than for congruent ones. Expectancy incongruence enlarged the P2 response but reduced the recognition-related early LPP response for neutral pictures. However, effects of expectancy incongruence were not seen for negative pictures. Therefore, the findings in the present study indicate that negative expectations influence the later recognition of expectancy incongruent neutral events, whereas negative events are more resistant to the effects of expectation incongruence.

Causal Information Over Facial Expression: Modulation of Facial Expression Processing by Congruency and Causal Factor of the Linguistic Cues in 5-Year-Old Japanese Children

It is unknown whether linguistic cues influence preschoolers' recognition of facial expression when the emotion of the face is incongruent with the linguistic cues and what type of linguistic cue is influential in the modulation of facial expression. In a priming task, we presented 5-year-old children three types of linguistic information conveying happy or sad emotion (simple label, label with rich causal explanation of emotion, and label with poor causal explanation of emotion) prior to the presentation of a happy or a sad face. We asked participants to recognize emotion of facial expression and examined whether they follow linguistic information than the facial expression when the emotions of linguistic information and face were incongruent. As a result, children who were presented the label with rich causal explanation judged emotion of face according to the linguistic information, whereas children who were presented the simple label or the label with poor causal explanation followed the emotions of facial expression. This result indicated that children's autonomic reliance on situational cues depends on the emotional causality and the concreteness of emotional state conveyed by the linguistic cues. This finding contributes to our understanding of the face inferiority effect on children's developing notion of emotions.

The language context effect in facial expressions processing and its mandatory characteristic

Background visual scenes in which faces are perceived provide contextual information for facial expression processing. One type of background information, the language context, has a vital influence on facial expression processing. The current study is aimed to investigate the effect of the language context on facial expression processing by recording event-related potentials (ERPs). Experiment one adopted the facial expression categorization task to investigate the effects of different language contexts on emotional and non-emotional facial processing. Experiment two adopted the task-irrelevant paradigm to investigate whether the language context effect on facial expression processing was mandatory. The results found that (1) the language context affected facial expression processing. Facial expression processing was promoted when the language context was emotionally congruent with faces. Moreover, the language context had an evoking effect on neutral faces. To be detailed, neutral facial expressions were evoked to be judged as positive in the positive language context while as negative in the negative language context. (2) The language context effect still affected facial expression processing in a task-irrelevant paradigm. When the language context was emotionally incongruent with facial expressions, larger N170 and LPP amplitudes were elicited, indicating the inhibition of incongruent emotions. These findings prove that the language context effect on facial expression processing is mandatory.

The effect of emotional and self-referential contexts on ERP responses towards surprised faces

The perception of surprised faces is demonstrably modulated by emotional context. However, the influence of self-relevance and its interaction with emotional context have not been explored. The present study investigated the effects of contextual valence and self-reference on the perception of surprised faces. Our results revealed that faces in a negative context elicited a larger N170 than those in a neutral context. The EPN was affected by the interaction between contextual valence and self-reference, with larger amplitudes for faces in self-related positive contexts and sender-related negative contexts. Additionally, LPP amplitudes were enhanced for faces in negative contexts relative to neutral and positive contexts, as well as for self-related contexts in comparison to sender-related contexts. Together, these findings help to elucidate the psychophysiological mechanisms underlying the effects of emotional and self-referential contexts on the perception of surprised faces, which are characterized by distinctive ERPs.

Double-checking emotions: Valence and emotion category in contextual integration of facial expressions of emotion

Faces showing happy, angry or fearful expressions were presented in emotionally congruent or incongruent situational contexts (short sentences describing events that would usually provoke happiness, anger or fear). The participants were assigned the task of judging whether the expression was appropriate or not to the context (congruency judgment task). Effects of emotional congruency were observed at both the behavioral and electrophysiological levels. Behavioral results showed evidence of congruency effects based on specific emotion content (e.g., less accurate and slower responses to fear faces in angry contexts). Event-related-potentials (ERP) results also showed emotional congruency effects at different post-stimulus onset latencies, beginning with the face-sensitive N170 component. An effect of emotional congruency was also shown on the N400 component that is typically sensitive to semantic congruency. Finally, a late positive potential (LPP), appearing at 450-650 ms post-stimulus onset showed a complex pattern of effects with modulations driven by the different combinations of contexts and target expressions. These results are interpreted in terms of a double process of valence and emotion checking that is supposed to underlie affective processing and contextual integration of facial expressions of emotions.

Joint Modulation of Facial Expression Processing by Contextual Congruency and Task Demands

Faces showing expressions of happiness or anger were presented together with sentences that described happiness-inducing or anger-inducing situations. Two main variables were manipulated: (i) congruency between contexts and expressions (congruent/incongruent) and (ii) the task assigned to the participant, discriminating the emotion shown by the target face (emotion task) or judging whether the expression shown by the face was congruent or not with the context (congruency task). Behavioral and electrophysiological results (event-related potentials (ERP)) showed that processing facial expressions was jointly influenced by congruency and task demands. ERP results revealed task effects at frontal sites, with larger positive amplitudes between 250–450 ms in the congruency task, reflecting the higher cognitive effort required by this task. Effects of congruency appeared at latencies and locations corresponding to the early posterior negativity (EPN) and late positive potential (LPP) components that have previously been found to be sensitive to emotion and affective congruency. The magnitude and spatial distribution of the congruency effects varied depending on the task and the target expression. These results are discussed in terms of the modulatory role of context on facial expression processing and the different mechanisms underlying the processing of expressions of positive and negative emotions.

Neural correlates of dynamic emotion perception in schizophrenia and the influence of prior expectations

Impaired emotion perception is a well-established and stable deficit in schizophrenia; however, there is limited knowledge about the underlying aberrant cognitive and brain processes that result in emotion perception deficits. Recent influential work has shown that perceptual deficits in schizophrenia may result from aberrant precision in prior expectations, associated with disrupted activity in frontal regions. In the present study, we investigated the perception of dynamic, multisensory emotion, the influence of prior expectations and the underlying aberrant brain processes in schizophrenia. During a functional Magnetic Resonance Imaging scan, participants completed the Dynamic Emotion Perception task, which induces prior expectations with emotion instruction cues. We delineated neural responses and functional connectivity in whole-brain large-scale networks underlying emotion perception. Compared to healthy individuals, schizophrenia patients had lower accuracy specifically for emotions that were congruent with prior expectations. At the neural level, schizophrenia patients had less engagement of right inferior frontal and parietal regions, as well as right amygdala dysconnectivity during discrimination of emotions congruent with prior expectations. The results indicate that individuals with schizophrenia may have aberrant prior expectations about emotional expressions, associated with under-activity in inferior frontoparietal regions and right amygdala dysconnectivity, which results in impaired perception of emotion.

Age-related decline in emotional perspective-taking: Its effect on the late positive potential

Aging is associated with changes in cognitive and affective functioning, which likely shape older adults' social cognition. As the neural and psychological mechanisms underlying age differences in social abilities remain poorly understood, the present study aims to extend the research in this field. To this purpose, younger (n = 30; M_age = 26.6), middle-aged (n = 30; M_age = 48.4), and older adults (n = 29; M_age = 64.5) performed a task designed to assess affective perspective-taking, during an EEG recording. In this task, participants decided whether a target facial expression of emotion (FEE) was congruent or incongruent with that of a masked intervener of a previous scenario, which portrayed a neutral or an emotional scene. Older adults showed worse performance in comparison to the other groups. Regarding electrophysiological results, while younger and middle-aged adults showed higher late positive potentials (LPPs) after FEEs congruent with previous scenarios than after incongruent FEEs, older adults had similar amplitudes after both. This insensitivity of older adults' LPPs in differentiating congruent from incongruent emotional context-target FEE may be related to their difficulty in generating information about others' inner states and using that information in social interactions.