Faces in context: Modulation of expression processing by situational information

Happy and angry facial expressions are processed independently of task demands and semantic context congruency in the first stages of vision - A mass univariate ERP analysis

Neural decoding of others' facial expressions is critical in social interactions and has been investigated using scalp event related potentials (ERPs). However, the impact of task and emotional context congruency on this neural decoding is unclear. Previous ERP studies employed classic statistical analyses that only focused on specific electrodes and time points, which inflates type I and type II errors. The present study re-analyzed the study by Aguado et al. (2019) using robust data-driven Mass Univariate Statistics across every time point and electrode and rejected trials with early reaction times to rule out motor-related activity on neural recordings. Participants viewed neutral faces paired with negative or positive situational sentences (e.g. "She catches her partner cheating on her with her best friend"), followed by the same individuals' faces expressing happiness or anger, such that the facial expressions were congruent or incongruent with the situation. Participants engaged in two tasks: an emotion discrimination task, and a situation-expression congruency discrimination task. We found significant effects of expression largest during the N170-P2 interval, and effects of congruency and task around an LPP-like component. However, the effect of congruency was significant only in the congruency task, suggesting a limited and task-dependant influence of semantic context. Importantly, emotion did not interact with any factor neurally, suggesting facial expressions were decoded automatically during the first 400 ms of vision, regardless of context congruency or task demands. The results and their discrepancies with the original findings are discussed in the context of ERP statistics and the replication crisis.

Scene effects on disgusted facial expression detection in individuals with social anxiety: The role of emotional intensity

Individuals exhibiting high social anxiety (HSA) typically encounter challenges in identifying threatening stimuli with varying levels of intensity in different social scenes, ultimately affecting their social interactions. However, it is not well understood how social scenes, emotional intensity, and interaction influence the recognition of threat stimuli among HSA individuals (HSAs). To address this issue, a face recognition task was administered to 20 HSA participants and 22 individuals exhibiting low social anxiety (LSA) in this study. Results indicated that during the social scene presentation stage, HSAs produced larger P2 amplitude than LSA individuals (LSAs) no matter the valence of the scenes. During the face recognition stage, HSAs had smaller N170 amplitude than LSAs and exhibited lower recognition time for 2 % disgusted faces compared to LSAs. Furthermore, the consistency between scenes and faces led to faster recognition of disgusted faces in HSAs, but not in LSAs. Consequently, our findings suggested that HSAs exhibited unique cognitive processing patterns in social scenes, manifested by increased attention to scenes and decreased attention to faces. In addition, the emotional congruence between the scene and the faces could facilitate the recognition of faces by HSAs.

You're Beautiful When You Smile: Event-Related Brain Potential (ERP) Evidence of Early Opposite-Gender Bias in Happy Faces

Studies of social cognition have shown gender differences regarding human face processing. One interesting finding is the enhanced processing of opposite-gender faces at different time stages, as revealed by event-related brain potentials. Crucially, from an evolutionary perspective, such a bias might interact with the emotional expression of the face. To investigate this, 100 participants (50 female, 50 male) completed an expression-detection task while their EEG was recorded. In three blocks, fearful, happy and neutral faces (female and male) were randomly presented, with participants instructed to respond to only one predefined target expression level in each block. Using linear mixed models, we observed both faster reaction times as well as larger P1 and late positive potential (LPP) amplitudes for women compared to men, supporting a generally greater female interest in faces. Highly interestingly, the analysis revealed an opposite-gender bias at P1 for happy target faces. This suggests that participants' attentional templates may include more opposite-gender facial features when selectively attending to happy faces. While N170 was influenced by neither the face nor the participant gender, LPP was modulated by the face gender and specific combinations of the target status, face gender and expression, which is interpreted in the context of gender-emotion stereotypes. Future research should further investigate this expression and attention dependency of early opposite-gender biases.

Contextualising facial expressions: The effect of temporal context and individual differences on classification

The influence of context on facial expression classification is most often investigated using simple cues in static faces portraying basic expressions with a fixed emotional intensity. We examined (1) whether a perceptually rich, dynamic audiovisual context, presented in the form of movie clips (to achieve closer resemblance to real life), affected the subsequent classification of dynamic basic (happy) and non-basic (sarcastic) facial expressions and (2) whether people's susceptibility to contextual cues was related to their ability to classify facial expressions viewed in isolation. Participants classified facial expressions-gradually progressing from neutral to happy/sarcastic in increasing intensity-that followed movie clips. Classification was relatively more accurate and faster when the preceding context predicted the upcoming expression, compared with when the context did not. Speeded classifications suggested that predictive contexts reduced the emotional intensity required to be accurately classified. More importantly, we show for the first time that participants' accuracy in classifying expressions without an informative context correlated with the magnitude of the contextual effects experienced by them-poor classifiers of isolated expressions were more susceptible to a predictive context. Our findings support the emerging view that contextual cues and individual differences must be considered when explaining mechanisms underlying facial expression classification.

Therapist reactions to patient personality: A pilot study of clinicians’ emotional and neural responses using three clinical vignettes from in treatment series

Introduction

Therapists’ responses to patients play a crucial role in psychotherapy and are considered a key component of the patient–clinician relationship, which promotes successful treatment outcomes. To date, no empirical research has ever investigated therapist response patterns to patients with different personality disorders from a neuroscience perspective.

Methods

In the present study, psychodynamic therapists (N = 14) were asked to complete a battery of instruments (including the Therapist Response Questionnaire) after watching three videos showing clinical interactions between a therapist and three patients with narcissistic, histrionic/borderline, and depressive personality disorders, respectively. Subsequently, participants’ high-density electroencephalography (hdEEG) was recorded as they passively viewed pictures of the patients’ faces, which were selected from the still images of the previously shown videos. Supervised machine learning (ML) was used to evaluate whether: (1) therapists’ responses predicted which patient they observed during the EEG task and whether specific clinician reactions were involved in distinguishing between patients with different personality disorders (using pairwise comparisons); and (2) therapists’ event-related potentials (ERPs) predicted which patient they observed during the laboratory experiment and whether distinct ERP components allowed this forecast.

Results

The results indicated that therapists showed distinct patterns of criticized/devalued and sexualized reactions to visual depictions of patients with different personality disorders, at statistically systematic and clinically meaningful levels. Moreover, therapists’ late positive potentials (LPPs) in the hippocampus were able to determine which patient they observed during the EEG task, with high accuracy.

Discussion

These results, albeit preliminary, shed light on the role played by therapists’ memory processes in psychotherapy. Clinical and neuroscience implications of the empirical investigation of therapist responses are discussed.

Threat induction biases processing of emotional expressions

Threats can derive from our physical or social surroundings and bias the way we perceive and interpret a given situation. They can be signaled by peers through facial expressions, as expressed anger or fear can represent the source of perceived threat. The current study seeks to investigate enhanced attentional state and defensive reflexes associated with contextual threat induced through aversive sounds presented in an emotion recognition paradigm. In a sample of 120 healthy participants, response and gaze behavior revealed differences in perceiving emotional facial expressions between threat and safety conditions: Responses were slower under threat and less accurate. Happy and neutral facial expressions were classified correctly more often in a safety context and misclassified more often as fearful under threat. This unidirectional misclassification suggests that threat applies a negative filter to the perception of neutral and positive information. Eye movements were initiated later under threat, but fixation changes were more frequent and dwell times shorter compared to a safety context. These findings demonstrate that such experimental paradigms are capable of providing insight into how context alters emotion processing at cognitive, physiological, and behavioral levels. Such alterations may derive from evolutionary adaptations necessary for biasing cognitive processing to survive disadvantageous situations. This perspective sets up new testable hypotheses regarding how such levels of explanation may be dysfunctional in patient populations.

How to do Better N400 Studies: Reproducibility, Consistency and Adherence to Research Standards in the Existing Literature

Given the complexity of ERP recording and processing pipeline, the resulting variability of methodological options, and the potential for these decisions to influence study outcomes, it is important to understand how ERP studies are conducted in practice and to what extent researchers are transparent about their data collection and analysis procedures. The review gives an overview of methodology reporting in a sample of 132 ERP papers, published between January 1980 - June 2018 in journals included in two large databases: Web of Science and PubMed. Because ERP methodology partly depends on the study design, we focused on a well-established component (the N400) in the most commonly assessed population (healthy neurotypical adults), in one of its most common modalities (visual images). The review provides insights into 73 properties of study design, data pre-processing, measurement, statistics, visualization of results, and references to supplemental information across studies within the same subfield. For each of the examined methodological decisions, the degree of consistency, clarity of reporting and deviations from the guidelines for best practice were examined. Overall, the results show that each study had a unique approach to ERP data recording, processing and analysis, and that at least some details were missing from all papers. In the review, we highlight the most common reporting omissions and deviations from established recommendations, as well as areas in which there was the least consistency. Additionally, we provide guidance for a priori selection of the N400 measurement window and electrode locations based on the results of previous studies.

High Emotional Similarity Will Enhance the Face Memory and Face-Context Associative Memory

Previous research has explored how emotional valence (positive or negative) affected face-context associative memory, while little is known about how arousing stimuli that share the same valence but differ in emotionality are bound together and retained in memory. In this study, we manipulated the emotional similarity between the target face and the face associated with the context emotion (i.e., congruent, high similarity, and low similarity), and examined the effect of emotional similarity of negative emotion (i.e., disgust, anger, and fear) on face-context associative memory. Our results showed that the greater the emotional similarity between the faces, the better the face memory and face-context associative memory were. These findings suggest that the processing of facial expression and its associated context may benefit from taking into account the emotional similarity between the faces.

Emotion, Gender and Gaze Discrimination Tasks do not Differentially Impact the Neural Processing of Angry or Happy Facial Expressions-a Mass Univariate ERP Analysis

Facial expression processing is a critical component of social cognition yet, whether it is influenced by task demands at the neural level remains controversial. Past ERP studies have found mixed results with classic statistical analyses, known to increase both Type I and Type II errors, which Mass Univariate statistics (MUS) control better. However, MUS open-access toolboxes can use different fundamental statistics, which may lead to inconsistent results. Here, we compared the output of two MUS toolboxes, LIMO and FMUT, on the same data recorded during the processing of angry and happy facial expressions investigated under three tasks in a within-subjects design. Both toolboxes revealed main effects of emotion during the N170 timing and main effects of task during later time points typically associated with the LPP component. Neither toolbox yielded an interaction between the two factors at the group level, nor at the individual level in LIMO, confirming that the neural processing of these two face expressions is largely independent from task demands. Behavioural data revealed main effects of task on reaction time and accuracy, but no influence of expression or an interaction between the two. Expression processing and task demands are discussed in the context of the consistencies and discrepancies between the two toolboxes and existing literature.

The processing characteristics of bodily expressions under the odor context: An ERP study

The recognition of facial expressions has been shown to be influenced by contextual odors. The aims of this study were (1) to investigate whether odor has a similar effect on the recognition of bodily expressions, and (2) to analyze the time-course of such effects. Sixty-nine adults were randomized into three groups to identify bodily expressions (happy, fearful, and neutral) in three odor environments (pleasant odor, unpleasant odor, and no odor). Event-related potentials (ERPs) induced by the viewing bodily expressions were analyzed. Behaviorally, the unpleasant odor context promoted the recognition of bodily expressions. The ERP results showed odor influences on bodily expression recognition in two phases. In a middle stage phase (150-200 ms post-stimulus onset), VPP amplitudes induced by bodily expressions were greater in an unpleasant odor context than in a pleasant odor context. In a mid-late stage phase (beyond 200 ms), an interaction between contextual odor and bodily expression type was observed. When exposed to an unpleasant contextual odor, N2 and LPP amplitudes related to fearful bodily expressions were smaller than when exposed to other odor contexts, showing the promoting effect of mood coherence effect. Behavioral and ERP evidence confirmed that contextual odor can modulate the visual processing of bodily expressions, with an overall promoting effect of an unpleasant odor on bodily expression processing (phase one) and a specific modulating influence of odors on affectively congruent/incongruent bodily expressions (phase two).

Does gaze direction of fearful faces facilitate the processing of threat? An ERP study of spatial precuing effects

Eye gaze is very important for attentional orienting in social life. By adopting the event-related potential (ERP) technique, we explored whether attentional orienting of eye gaze is modulated by emotional congruency between facial expressions and the targets in a spatial cuing task. Faces with different emotional expressions (fearful/angry/happy/neutral) directing their eye gaze to the left or right were used as cues, indicating the possible location of subsequent targets. Targets were line drawings of animals, which could be either threatening or neutral. Participants indicated by choice responses whether the animal would fit inside a shoebox in real life or not. Reaction times to targets were faster after valid compared with invalid cues, showing the typical eye gaze cuing effect. Analyses of the late positive potential (LPP) elicited by targets revealed a significant modulation of the gaze cuing effect by emotional congruency. Threatening targets elicited larger LPPs when validly cued by gaze in faces with negative (fearful and angry) expressions. Similarly, neutral targets showed larger LPPs when validly cued by faces with neutral expressions. Such effects were not present after happy face cues. Source localization in the LPP time window revealed that for threatening targets, the activity of right medial frontal gyrus could be related to a larger gaze-orienting effect for the fearful than the angry condition. Our findings provide electrophysiological evidence for the modulation of gaze cuing effects by emotional congruency.

"She finds you abhorrent" - The impact of emotional context information on the cortical processing of neutral faces in depression

Depression is associated with abnormalities in patterns of information processing, particularly in the context of processing of interpersonal information. The present study was designed to investigate the differences in depressive individuals in cortical processing of facial stimuli when neutral faces were presented in a context that involved information about emotional valence as well as self-reference. In 21 depressive patients and 20 healthy controls, event-related potentials (ERPs) were recorded during the presentation of neutral facial expressions, which were accompanied by affective context information that was either self- or other-related. Across conditions, depressive patients showed larger mean P100 amplitudes than healthy controls. Furthermore, mean late positive potential (LPP) amplitudes of depressive patients were larger in response to faces in self-related than in other-related context. In addition, irrespective of self-reference, mean LPP responses of depressive patients to faces presented after socially threatening sentences were larger compared with faces presented after neutral sentences. Results regarding self-reference supported results of previous studies indicating larger mean amplitudes in self-related conditions. Findings suggest a general heightened initial responsiveness to emotional cues and a sustained emotion processing of socially threatening information in depressive patients.

Different influences of moral violation with and without physical impurity on face processing: An event-related potentials study

It has been widely accepted that moral violations that involve impurity (such as spitting in public) induce the emotion of disgust, but there has been a debate about whether moral violations that do not involve impurity (such as swearing in public) also induce the same emotion. The answer to this question may have implication for understanding where morality comes from and how people make moral judgments. This study aimed to compared the neural mechanisms underlying two kinds of moral violation by using an affective priming task to test the effect of sentences depicting moral violation behaviors with and without physical impurity on subsequent detection of disgusted faces in a visual search task. After reading each sentence, participants completed the face search task. Behavioral and electrophysiological (event-related potential, or ERP) indices of affective priming (P2, N400, LPP) and attention allocation (N2pc) were analyzed. Results of behavioral data and ERP data showed that moral violations both with and without impurity promoted the detection of disgusted faces (RT, N2pc); moral violations without impurity impeded the detection of neutral faces (N400). No priming effect was found on P2 and LPP. The results suggest both types of moral violation influenced the processing of disgusted faces and neutral faces, but the neural activity with temporal characteristics was different.

Feeling through another's eyes: Perceived gaze direction impacts ERP and behavioural measures of positive and negative affective empathy

Looking at the eyes informs us about the thoughts and emotions of those around us, and impacts our own emotional state. However, it is unknown how perceiving direct and averted gaze impacts our ability to share the gazer's positive and negative emotions, abilities referred to as positive and negative affective empathy. We presented 44 participants with contextual sentences describing positive, negative and neutral events happening to other people (e.g. "Her newborn was saved/killed/fed yesterday afternoon."). These were designed to elicit positive, negative, or little to no empathy, and were followed by direct or averted gaze images of the individuals described. Participants rated their affective empathy for the individual and their own emotional valence on each trial. Event-related potentials time-locked to face-onset and associated with empathy and emotional processing were recorded to investigate whether they were modulated by gaze direction. Relative to averted gaze, direct gaze was associated with increased positive valence in the positive and neutral conditions and with increased positive empathy ratings. A similar pattern was found at the neural level, using robust mass-univariate statistics. The N100, thought to reflect an automatic activation of emotion areas, was modulated by gaze in the affective empathy conditions, with opposite effect directions in positive and negative conditions.. The P200, an ERP component sensitive to positive stimuli, was modulated by gaze direction only in the positive empathy condition. Positive and negative trials were processed similarly at the early N200 processing stage, but later diverged, with only negative trials modulating the EPN, P300 and LPP components. These results suggest that positive and negative affective empathy are associated with distinct time-courses, and that perceived gaze direction uniquely modulates positive empathy, highlighting the importance of studying empathy with face stimuli.

Do you feel like me or not? This is the question: manipulation of emotional imagery modulates affective priming

Mood congruity and affective priming have been used to study the effects of affective phenomena on perception. Manipulation of mood is appropriate for investigations of long-term effects while affective priming is limited to short intervals (approximately 300 ms) between a prime and target. However, studying the influence of real-world rapidly changing emotional episodes on perception may fall between the cracks of these methods. This may be caused, inter alia, because emotional episodes are distinguished from mood experiences on one hand, but often last for longer than roughly 300 ms on the other. Thus, it is unclear what experimental approach should be taken to investigate congruency effects triggered by emotional episodes. The present study used a new variation of the evaluation decision task (EDT) combined with a script-driven imagery procedure to investigate a possible congruency relationship between the evaluator's emotional experience at a given time and observable emotional markers of others. We used 180 9-word script-driven imageries as varying valence primes (negative, positive, neutral) and asked participants to imagine themselves in the situation described in the scripts. At the last stage of a trial, all participants were asked to evaluate the mood-positive or negative-of a target face of a child in a photograph. We manipulated the reading interval (4000 ms and 1350 ms) and the subsequent blank interval (300 ms, 5000 ms, and unlimited) until target onset. Prime and target valence were congruent or incongruent. Significant congruency effects were found for both short and long reading intervals and blank intervals. However, in longer blank intervals only the interference effect reached significance. Furthermore, the interference effect was found to be significant mainly in trials beginning with a negative script.

The effect of empathy and context on face-processing ERPs

The investigation of emotional face processing has largely used faces devoid of context, and does not account for within-perceiver differences in empathy. The importance of context in face perception has become apparent in recent years. This study examined the interaction of the contextual factors of facial expression, knowledge of a person's character, and within-perceiver empathy levels on face processing event-related potentials (ERPs). Forty-two adult participants learned background information about six individuals' character. Three types of character were described, in which the character was depicted as deliberately causing harm to others, accidently causing harm to others, or undertaking neutral actions. Subsequently, EEG was recorded while participants viewed the characters' faces displaying neutral or emotional expressions. Participants' empathy was assessed using the Empathy Quotient survey. Results showed a significant interaction of character type and empathy on the early posterior negativity (EPN) ERP component. These results suggested that for those with either low or high empathy, more attention was paid to the face stimuli, with more distinction between the different characters. In contrast, those in the middle range of empathy tended to produce smaller EPN with less distinction between character types. Findings highlight the importance of trait empathy in accounting for how faces in context are perceived.

In context: emotional intent and temporal immediacy of contextual descriptions modulate affective ERP components to facial expressions

In this study, we explored how contextual information about threat dynamics affected the electrophysiological correlates of face perception. Forty-six healthy native Swedish speakers read verbal descriptions signaling an immediate vs delayed intent to escalate or deescalate an interpersonal conflict. Each verbal description was followed by a face with an angry or neutral expression, for which participants rated valence and arousal. Affective ratings confirmed that the emotional intent expressed in the descriptions modulated emotional reactivity to the facial stimuli in the expected direction. The electrophysiological data showed that compared to neutral faces, angry faces resulted in enhanced early and late event-related potentials (VPP, P300 and LPP). Additionally, emotional intent and temporal immediacy modulated the VPP and P300 similarly across angry and neutral faces, suggesting that they influence early face perception independently of facial affect. By contrast, the LPP amplitude to faces revealed an interaction between facial expression and emotional intent. Deescalating descriptions eliminated the LPP differences between angry and neutral faces. Together, our results suggest that information about a person’s intentions modulates the processing of facial expressions.

Attending to Eliza: rapid brain responses reflect competence attribution in virtual social feedback processing

In the age of virtual communication, the source of a message is often inferred rather than perceived, raising the question of how sender attributions affect content processing. We investigated this issue in an evaluative feedback scenario. Participants were told that an expert psychotherapist, a layperson or a randomly acting computer was going to give them online positive, neutral or negative personality feedback while high-density EEG was recorded. Sender attribution affected processing rapidly, even though the feedback was on average identical. Event-related potentials revealed a linear increase with attributed expertise beginning 150 ms after disclosure and most pronounced for N1, P2 and early posterior negativity components. P3 and late positive potential amplitudes were increased for both human senders and for emotionally significant (positive or negative) feedback. Strikingly, feedback from a putative expert prompted large P3 responses, even for inherently neutral content. Source analysis localized early enhancements due to attributed sender expertise in frontal and somatosensory regions and later responses in the posterior cingulate and extended visual and parietal areas, supporting involvement of mentalizing, embodied processing and socially motivated attention. These findings reveal how attributed sender expertise rapidly alters feedback processing in virtual interaction and have implications for virtual therapy and online communication.

Contextual information resolves uncertainty about ambiguous facial emotions: Behavioral and magnetoencephalographic correlates

Environmental conditions bias our perception of other peoples' facial emotions. This becomes quite relevant in potentially threatening situations, when a fellow's facial expression might indicate potential danger. The present study tested the prediction that a threatening environment biases the recognition of facial emotions. To this end, low- and medium-expressive happy and fearful faces (morphed to 10%, 20%, 30%, or 40% emotional) were presented within a context of instructed threat-of-shock or safety. Self-reported data revealed that instructed threat led to a biased recognition of fearful, but not happy facial expressions. Magnetoencephalographic correlates revealed spatio-temporal clusters of neural network activity associated with emotion recognition and contextual threat/safety in early to mid-latency time intervals in the left parietal cortex, bilateral prefrontal cortex, and the left temporal pole regions. Early parietal activity revealed a double dissociation of face-context information as a function of the expressive level of facial emotions: When facial expressions were difficult to recognize (low-expressive), contextual threat enhanced fear processing and contextual safety enhanced processing of subtle happy faces. However, for rather easily recognizable faces (medium-expressive) the left hemisphere (parietal cortex, PFC, and temporal pole) showed enhanced activity to happy faces during contextual threat and fearful faces during safety. Thus, contextual settings reduce the salience threshold and boost early face processing of low-expressive congruent facial emotions, whereas face-context incongruity or mismatch effects drive neural activity of easier recognizable facial emotions. These results elucidate how environmental settings help recognize facial emotions, and the brain mechanisms underlying the recognition of subtle nuances of fear.

Causal Information Over Facial Expression: Modulation of Facial Expression Processing by Congruency and Causal Factor of the Linguistic Cues in 5-Year-Old Japanese Children

It is unknown whether linguistic cues influence preschoolers' recognition of facial expression when the emotion of the face is incongruent with the linguistic cues and what type of linguistic cue is influential in the modulation of facial expression. In a priming task, we presented 5-year-old children three types of linguistic information conveying happy or sad emotion (simple label, label with rich causal explanation of emotion, and label with poor causal explanation of emotion) prior to the presentation of a happy or a sad face. We asked participants to recognize emotion of facial expression and examined whether they follow linguistic information than the facial expression when the emotions of linguistic information and face were incongruent. As a result, children who were presented the label with rich causal explanation judged emotion of face according to the linguistic information, whereas children who were presented the simple label or the label with poor causal explanation followed the emotions of facial expression. This result indicated that children's autonomic reliance on situational cues depends on the emotional causality and the concreteness of emotional state conveyed by the linguistic cues. This finding contributes to our understanding of the face inferiority effect on children's developing notion of emotions.

Double-checking emotions: Valence and emotion category in contextual integration of facial expressions of emotion

Faces showing happy, angry or fearful expressions were presented in emotionally congruent or incongruent situational contexts (short sentences describing events that would usually provoke happiness, anger or fear). The participants were assigned the task of judging whether the expression was appropriate or not to the context (congruency judgment task). Effects of emotional congruency were observed at both the behavioral and electrophysiological levels. Behavioral results showed evidence of congruency effects based on specific emotion content (e.g., less accurate and slower responses to fear faces in angry contexts). Event-related-potentials (ERP) results also showed emotional congruency effects at different post-stimulus onset latencies, beginning with the face-sensitive N170 component. An effect of emotional congruency was also shown on the N400 component that is typically sensitive to semantic congruency. Finally, a late positive potential (LPP), appearing at 450-650 ms post-stimulus onset showed a complex pattern of effects with modulations driven by the different combinations of contexts and target expressions. These results are interpreted in terms of a double process of valence and emotion checking that is supposed to underlie affective processing and contextual integration of facial expressions of emotions.

Joint Modulation of Facial Expression Processing by Contextual Congruency and Task Demands

Faces showing expressions of happiness or anger were presented together with sentences that described happiness-inducing or anger-inducing situations. Two main variables were manipulated: (i) congruency between contexts and expressions (congruent/incongruent) and (ii) the task assigned to the participant, discriminating the emotion shown by the target face (emotion task) or judging whether the expression shown by the face was congruent or not with the context (congruency task). Behavioral and electrophysiological results (event-related potentials (ERP)) showed that processing facial expressions was jointly influenced by congruency and task demands. ERP results revealed task effects at frontal sites, with larger positive amplitudes between 250–450 ms in the congruency task, reflecting the higher cognitive effort required by this task. Effects of congruency appeared at latencies and locations corresponding to the early posterior negativity (EPN) and late positive potential (LPP) components that have previously been found to be sensitive to emotion and affective congruency. The magnitude and spatial distribution of the congruency effects varied depending on the task and the target expression. These results are discussed in terms of the modulatory role of context on facial expression processing and the different mechanisms underlying the processing of expressions of positive and negative emotions.

How context influences the interpretation of facial expressions: a source localization high-density EEG study on the "Kuleshov effect"

Few studies have explored the specificities of contextual modulations of the processing of facial expressions at a neuronal level. This study fills this gap by employing an original paradigm, based on a version of the filmic “Kuleshov effect”. High-density EEG was recorded while participants watched film sequences consisting of three shots: the close-up of a target person’s neutral face (Face_1), the scene that the target person was looking at (happy, fearful, or neutral), and another close-up of the same target person’s neutral face (Face_2). The participants’ task was to rate both valence and arousal, and subsequently to categorize the target person’s emotional state. The results indicate that despite a significant behavioural ‘context’ effect, the electrophysiological indexes still indicate that the face is evaluated as neutral. Specifically, Face_2 elicited a high amplitude N170 when preceded by neutral contexts, and a high amplitude Late Positive Potential (LPP) when preceded by emotional contexts, thus showing sensitivity to the evaluative congruence (N170) and incongruence (LPP) between context and Face_2. The LPP activity was mainly underpinned by brain regions involved in facial expressions and emotion recognition processing. Our results shed new light on temporal and neural correlates of context-sensitivity in the interpretation of facial expressions.

Influence of emotional contexts on facial emotion attribution in schizophrenia

Recent emotion recognition studies in schizophrenia have reported misattribution of emotional content to emotionally neutral faces. While in these studies faces are presented in the absence of any contextual reference, in daily life facial expressions are typically perceived within a specific situational context. However, there is no evidence on the possible modulatory role of contextual aids on emotion attribution to neutral faces. We address this issue in the present study. Thirty schizophrenia patients and thirty paired controls performed an emotion categorization task (by choosing one among six labels of emotions) with neutral target faces that were superimposed on affectively positive, negative or neutral scenes. In presence of positive contexts, patients categorized neutral faces as happy and fearful more frequently than controls. When negative contexts were present, patients also categorized neutral faces as fearful more frequently than controls. However, in the presence of neutral contexts patients and controls did not differ in their categorization pattern. These results suggest that explicit presence of a neutral context seems to compensate for the bias showed by patients. With the purpose of correcting emotion misattribution in schizophrenia, emotionally neutral contexts might be incorporated to treatments aimed at improving social cognition performance in this patient population.

Age-related decline in emotional perspective-taking: Its effect on the late positive potential

Aging is associated with changes in cognitive and affective functioning, which likely shape older adults' social cognition. As the neural and psychological mechanisms underlying age differences in social abilities remain poorly understood, the present study aims to extend the research in this field. To this purpose, younger (n = 30; M_age = 26.6), middle-aged (n = 30; M_age = 48.4), and older adults (n = 29; M_age = 64.5) performed a task designed to assess affective perspective-taking, during an EEG recording. In this task, participants decided whether a target facial expression of emotion (FEE) was congruent or incongruent with that of a masked intervener of a previous scenario, which portrayed a neutral or an emotional scene. Older adults showed worse performance in comparison to the other groups. Regarding electrophysiological results, while younger and middle-aged adults showed higher late positive potentials (LPPs) after FEEs congruent with previous scenarios than after incongruent FEEs, older adults had similar amplitudes after both. This insensitivity of older adults' LPPs in differentiating congruent from incongruent emotional context-target FEE may be related to their difficulty in generating information about others' inner states and using that information in social interactions.

Reappraising faces: effects on accountability appraisals, self-reported valence, and pupil diameter

Many of our emotions arise in social contexts, as we interact with and learn about others. What is not yet clear, however, is how such emotions unfold when we either react to others or attempt to regulate our emotions. To address this issue, 30 healthy volunteers reacted to or reappraised positive or negative information that was paired with neutral faces. While they were doing this task, we assessed pupillary responses. We also asked participants to provide ratings of accountability and experienced emotion. Findings indicated that appraised accountability increased in response to emotional information, and changes in accountability were associated with commensurate changes in valence reports and increased pupil diameter. During reappraisal, accountability and emotion decreased, but pupil diameter increased. The findings highlight the importance of accountability appraisals during the generation and regulation of emotional reactions to others, while also documenting pupillary increases during emotional reactivity and regulation.

The right touch: Stroking of CT-innervated skin promotes vocal emotion processing

Research has revealed a special mechanoreceptor, called C-tactile (CT) afferent, that is situated in hairy skin and that seems relevant for the processing of social touch. We pursued a possible role of this receptor in the perception of other social signals such as a person’s voice. Participants completed three sessions in which they heard surprised and neutral vocal and nonvocal sounds and detected rare sound repetitions. In a given session, participants received no touch or soft brushstrokes to the arm (CT innervated) or palm (CT free). Event-related potentials elicited to sounds revealed that stroking to the arm facilitated the integration of vocal and emotional information. The late positive potential was greater for surprised vocal relative to neutral vocal and nonvocal sounds, and this effect was greater for arm touch relative to both palm touch and no touch. Together, these results indicate that stroking to the arm facilitates the allocation of processing resources to emotional voices, thus supporting the possibility that CT stimulation benefits social perception cross-modally.

Effects of affective and emotional congruency on facial expression processing under different task demands

Contextual influences on responses to facial expressions of emotion were studied using a context-target paradigm that allowed distinguishing the effects of affective congruency (context and target of same/different valence: positive or negative) and emotional congruency (context and target representing the same/different emotion: anger, fear, happiness). Sentences describing anger, fear or happiness-inducing events and faces expressing each of these emotions were used as contexts and targets, respectively. While between-valence comparisons (context and target of similar/different valence) revealed affective congruency effects, within-valence comparisons (context and target of similar valence and same/different emotion) revealed emotional congruency effects. In Experiment 1 no evidence of emotional congruency and limited evidence of affective congruency were found with an evaluative task. In Experiment 2 effects of both affective and emotional congruency were observed with an emotion recognition task. In this case, angry and fearful faces were recognized faster in emotionally congruent contexts. In Experiment 3 the participants were asked explicitly to judge the emotional congruency of the target faces. Emotional congruency effects were again found, with faster judgments of angry and fearful faces in the corresponding emotional contexts. Moreover, judgments of angry expressions were faster and more accurate in happy than in anger contexts. Thus, participants found easier to decide that angry faces did not match a happy context than to judge that they did match an anger context. These results suggest that there are differences in the way that facial expressions of positive and negative emotions are discriminated and integrated with their contexts. Specifically, compared to positive expressions, contextual integration of negative expressions seems to require a double check of the valence and the specific emotion category of the expression and the context.

Facial Expressions in Context: Electrophysiological Correlates of the Emotional Congruency of Facial Expressions and Background Scenes

Facial expressions can display personal emotions and indicate an individual’s intentions within a social situation. They are extremely important to the social interaction of individuals. Background scenes in which faces are perceived provide important contextual information for facial expression processing. The purpose of this study was to explore the time course of emotional congruency effects in processing faces and scenes simultaneously by recording event-related potentials (ERPs). The behavioral results found that the categorization of facial expression was faster and more accurate when the face was emotionally congruent than incongruent with the emotion displayed by the scene. In ERPs the late positive potential (LPP) amplitudes were modulated by the emotional congruency between faces and scenes. Specifically, happy faces elicited larger LPP amplitudes within positive than within negative scenes and fearful faces within negative scenes elicited larger LPP amplitudes than within positive scenes. The results did not find the scene effects on the P1 and N170 components. These findings indicate that emotional congruency effects could occur in late stages of facial expression processing, reflecting motivated attention allocation.

Odor-induced mood state modulates language comprehension by affecting processing strategies

It is controversial whether mood affects cognition by triggering specific processing strategies or by limiting processing resources. The current event-related potential (ERP) study pursued this issue by examining how mood modulates the processing of task relevant/irrelevant information. In question-answer pairs, a question context marked a critical word in the answer sentence as focus (and thus relevant) or non-focus (thereby irrelevant). At the same time, participants were exposed to either a pleasant or unpleasant odor to elicit different mood states. Overall, we observed larger N400s when the critical words in the answer sentences were semantically incongruent (rather than congruent) with the question context. However, such N400 effect was only found for focused words accompanied by a pleasant odor and for both focused and non-focused words accompanied by an unpleasant odor, but not for non-focused words accompanied by a pleasant odor. These results indicate top-down attentional shift to the focused information in a positive mood state and non-selective attention allocated to the focused and non-focused information in a less positive mood state, lending support to the "processing strategy" hypothesis. By using a novel approach to induce mood states, our study provides fresh insights into the mechanisms underlying mood modulation of language comprehension.

Contextual Valence and Sociality Jointly Influence the Early and Later Stages of Neutral Face Processing

Recent studies have demonstrated that face perception is influenced by emotional contextual information. However, because facial expressions are routinely decoded and understood during social communication, sociality should also be considered-that is, it seems necessary to explore whether emotional contextual effects are influenced by the sociality of contextual information. Furthermore, although one behavioral study has explored the effects of context on selective attention to faces, the exact underlying mechanisms remain unknown. Therefore, the current study investigated how valence and sociality of contextual information influenced the early and later stages of neutral face processing. We first employed an established affective learning procedure, wherein neutral faces were paired with verbal information that differed in valence (negative, neutral) and sociality (social, non-social), to manipulate contextual information. Then, to explore the effects of context on face perception, participants performed a face perception task, while the N170, early posterior negativity (EPN), and late positive potential (LPP) components were measured. Finally, to explore the effects of context on selective attention, participants performed a dot probe task while the N2pc was recorded. The results showed that, in the face perception task, faces paired with negative social information elicited greater EPN and LPP than did faces paired with neutral social information; no differences existed between faces paired with negative and neutral non-social information. In the dot probe task, faces paired with negative social information elicited a more negative N2pc amplitude (indicating attentional bias) than did faces paired with neutral social information; the N2pc did not differ between faces paired with negative and neutral non-social information. Together, these results suggest that contextual information influenced both face perception and selective attention, and these context effects were governed by the interaction between valence and sociality of contextual information.

Judging emotional congruency: Explicit attention to situational context modulates processing of facial expressions of emotion

The influence of explicit evaluative processes on the contextual integration of facial expressions of emotion was studied in a procedure that required the participants to judge the congruency of happy and angry faces with preceding sentences describing emotion-inducing situations. Judgments were faster on congruent trials in the case of happy faces and on incongruent trials in the case of angry faces. At the electrophysiological level, a congruency effect was observed in the face-sensitive N170 component that showed larger amplitudes on incongruent trials. An interactive effect of congruency and emotion appeared on the LPP (late positive potential), with larger amplitudes in response to happy faces that followed anger-inducing situations. These results show that the deliberate intention to judge the contextual congruency of facial expressions influences not only processes involved in affective evaluation such as those indexed by the LPP but also earlier processing stages that are involved in face perception.

Situational Context and Perceived Threat Modulate Approachability Judgements to Emotional Faces

Facial expressions of emotion play a key role in guiding social judgements, including deciding whether or not to approach another person. However, no research has examined how situational context modulates approachability judgements assigned to emotional faces, or the relationship between perceived threat and approachability judgements. Fifty-two participants provided approachability judgements to angry, disgusted, fearful, happy, neutral, and sad faces across three situational contexts: no context, when giving help, and when receiving help. Participants also rated the emotional faces for level of perceived threat and labelled the facial expressions. Results indicated that context modulated approachability judgements to faces depicting negative emotions. Specifically, faces depicting distress-related emotions (i.e., sadness and fear) were considered more approachable in the giving help context than both the receiving help and neutral context. Furthermore, higher ratings of threat were associated with the assessment of angry, happy and neutral faces as less approachable. These findings are the first to demonstrate the significant role that context plays in the evaluation of an individual's approachability and illustrate the important relationship between perceived threat and the evaluation of approachability.

Neuroelectric Correlates of Pragmatic Emotional Incongruence Processing: Empathy Matters

The emotions people feel can be simulated internally based on emotional situational contexts. In the present study, we assessed the behavioral and neuroelectric effects of seeing an unexpected emotional facial expression. We investigated the correct answer rate, response times and Event-Related Potential (ERP) effects during an incongruence paradigm between emotional faces and sentential contexts allowing emotional inferences. Most of the 36 healthy participants were recruited from a larger population (1 463 subjects), based on their scores on the Empathy Questionnaire (EQ). Regression analyses were conducted on these ratings using EQ factors as predictors (cognitive empathy, emotional reactivity and social skills). Recognition of pragmatic emotional incongruence was less accurate (P < .05) and slower (P < .05) than recognition of congruence. The incongruence effect on response times was inversely predicted by social skills. A significant N400 incongruence effect was found at the centro-parietal (P < .001) and centro-posterior midline (P < .01) electrodes. Cognitive empathy predicted the incongruence effect in the left occipital region, in the N400 time window. Finally, incongruence effects were also found on the LPP wave, in frontal midline and dorso-frontal regions, (P < .05), with no modulation by empathy. Processing pragmatic emotional incongruence is more cognitively demanding than congruence (as reflected by both behavioral and ERP data). This processing shows modulation by personality factors at the behavioral (through self-reported social skills) and neuroelectric levels (through self-reported cognitive empathy).