This person is saying bad things about you: The influence of physically and socially threatening context information on the processing of inherently neutral faces

Social anxiety prediction based on ERP features: A deep learning approach

BACKGROUND

Social Anxiety Disorder is traditionally diagnosed using subjective scales that may lack accuracy. Recently, EEG technology has gained importance for anxiety detection due to its ability to capture stable and objective neurophysiological activities. However, existing methods mainly focus on extracting EEG features during resting states, with limited use of psychologically features like Event-Related Potential (ERP) in task-related states for anxiety detection in deep learning frameworks.

METHODS

We collected EEG data from 63 participants exposed to four facial expressions and extracted task-relevant features. Using the EEGNet model, we predicted social anxiety and evaluated its performance using metrics such as accuracy, F1 score, sensitivity, and specificity. We compared EEGNet's performance with Deep Convolutional Neural Network (DeepConvNet), ShallowConvNet, Bi-directional Long Short-Term Memory (BiLSTM), and SVM. To assess the generalizability of the results, we carried out the same procedure on our prior dataset.

RESULTS

EEGNet outperformed other models, achieving 99.16 % accuracy with Late Positive Potential (LPP). ERP components yielded higher accuracy than time-domain and frequency-domain features for social anxiety recognition. Accuracy was better for neutral and negative facial stimuli. Consistency across two datasets indicates stability of findings.

LIMITATIONS

Due to limited publicly available task-state datasets, only our own were used. Future studies could assess generalizability on larger datasets from different sources.

CONCLUSIONS

We conducted the first test of ERP features in anxiety recognition tasks. Results show ERP features have greater potential in social anxiety recognition, with LPP exhibiting high stability and accuracy. Outcomes indicate recognizing social anxiety with negative or neutral facial stimuli is more useful.

Emotional Evaluations from Partners and Opponents Differentially Influence the Perception of Ambiguous Faces

The influence of contextual valence and interpersonal distance on facial expression perception remains unclear despite their significant role in shaping social perceptions. In this event-related potential (ERP) study, we investigated the temporal dynamics underlying the processing of surprised faces across different interpersonal distances (partner, opponent, or stranger) and contextual valence (positive, neutral, or negative) contexts. Thirty-five participants rated the valence of surprised faces. An advanced mass univariate statistical approach was utilized to analyze the ERP data. Behaviorally, surprised faces in partner-related negative contexts were rated more negatively than those in opponent- and stranger-related contexts. The ERP results revealed an increased P1 amplitude for surprised faces in negative relative to neutral contexts. Both the early posterior negativity (EPN) and late positive potentials (LPP) were also modulated by contextual valence, with larger amplitudes for faces in positive relative to neutral and negative contexts. Additionally, when compared to stranger-related contexts, faces in partner-related contexts exhibited enhanced P1 and EPN responses, while those in opponent-related contexts showed amplified LPP responses. Taken together, these findings elucidate the modulation of intricate social contexts on the perception and interpretation of ambiguous facial expressions, thereby enhancing our understanding of nonverbal communication and emotional cognition.

Emotional text messages affect the early processing of emoticons depending on their emotional congruence: evidence from the N170 and EPN event related potentials

Emoticons have been considered pragmatic cues that enhance emotional expressivity during computer-mediated communication. Yet, it is unclear how emoticons are processed in ambiguous text-based communication due to incongruences between the emoticon's emotional valence and its context. In this study, we investigated the electrophysiological correlates of contextual influence on the early emotional processing of emoticons, during an emotional congruence judgment task. Participants were instructed to judge the congruence between a text message expressing an emotional situation (positive or negative), and a subsequent emoticon expressing positive or negative emotions. We analyzed early event-related potentials elicited by emoticons related to face processing (N170) and emotional salience in visual perception processing (Early Posterior Negativity, EPN). Our results show that accuracy and Reaction Times depend on the interaction between the emotional valence of the context and the emoticon. Negative emoticons elicited a larger N170, suggesting that the emotional information of the emoticon is integrated at the early stages of the perceptual process. During emoticon processing, a valence effect was observed with enhanced EPN amplitudes in occipital areas for emoticons representing negative valences. Moreover, we observed a congruence effect in parieto-temporal sites within the same time-window, with larger amplitudes for the congruent condition. We conclude that, similar to face processing, emoticons are processed differently according to their emotional content and the context in which they are embedded. A congruent context might enhance the emotional salience of the emoticon (and therefore, its emotional expression) during the early stages of their processing.

Morality or competence is more important? The effect of evaluation dimensions on ERP responses to neutral faces depends on contextual valence and self-relevance

Recent studies have shown that the processing of neutral facial expressions could be modulated by the valence and self-relevance of preceding verbal evaluations. However, these studies have not distinguished the dimension (i.e., morality and competence) from verbal evaluations. In fact, there is a hot controversy about whether morality or competence receives more weight. Therefore, using the ERP technique, the current study aimed to address this issue by comparing the influence of morality and competence evaluations on behavioral and neural responses to neutral facial expressions when these evaluations varied with contextual valence and self-relevance. Our ERP results revealed that the early EPN amplitudes were larger for neutral faces after receiving evaluations about self relative to evaluations about senders. Moreover, the EPN was more negative after a competence evaluation relative to a morality evaluation when these evaluations were positive, while this effect was absent when these evaluations were negative. The late LPP was larger after a morality evaluation compared to a competence evaluation when these evaluations were negative and directed to self. However, no significant LPP effect between morality and competence evaluations was observed when these evaluations were positive. The present study extended previous studies by showing that early and late processing stages of faces are affected by the evaluation dimension in a top-down manner and further modulated by contextual valence and self-relevance.

Art perception is affected by negative knowledge about famous and unknown artists

The biographies of some celebrated artists are marked by accounts that paint a far from beautiful portrait. Does this negative-social knowledge influence the aesthetic experience of an artwork? Does an artist's fame protect their paintings from such an influence? We present two preregistered experiments examining the effect of social-emotional biographical knowledge about famous and unknown artists on the reception and perception of their paintings, using aesthetic ratings and neurocognitive measures. In Experiment 1, paintings attributed to artists characterised by negative biographical information were liked less, evoked greater feelings of arousal and were judged lower in terms of quality, than paintings by artists associated with neutral information. No modulation of artist renown was found. Experiment 2 fully replicated these behavioural results and revealed that paintings by artists associated with negative social-emotional knowledge also elicited enhanced early brain activity related to visual perception (P1) and early emotional arousal (early posterior negativity; EPN). Together, the findings suggest that negative knowledge about famous artists can shape not only explicit aesthetic evaluations, but may also penetrate the perception of the artwork itself.

The cognitive tasks and event-related potentials associated childhood adversity: A systematic review

In this systematic review, 18 articles met inclusion criteria to be qualitatively analyzed for converging evidence of brain activity, measured using event-related potential (ERP), related to retrospectively reported childhood adversity/trauma. Using the PRISMA guidelines for systematic reviews, 917 articles were assessed for inclusion and were filtered using study parameters. The most common ERP components listed in the literature were P100, N170, N200, P200, P300, ERN, and LPP. We discuss levels of evidence for changed brain activity, each ERP component, and the tasks used to evoke them. The Childhood Trauma Questionnaire was found to be the most commonly cited measure. We note the need to assess the duration and intensity of childhood adversity/trauma measurements in the strengths and limitations of the reported childhood adversity/trauma measurements. No concrete converging evidence was found to support a relationship between ERP-measured brain activity and retrospectively reported childhood adversity/trauma. Thus, a discussion of limitations and future directions for this field of research is presented.

Distrust before first sight? Examining knowledge- and appearance-based effects of trustworthiness on the visual consciousness of faces

The present EEG study with 32 healthy participants investigated whether affective knowledge about a person influences the visual awareness of their face, additionally considering the impact of facial appearance. Faces differing in perceived trustworthiness based on appearance were associated with negative or neutral social information and shown as target stimuli in an attentional blink task. As expected, participants showed enhanced awareness of faces associated with negative compared to neutral social information. On the neurophysiological level, this effect was connected to differences in the time range of the early posterior negativity (EPN)-a component associated with enhanced attention and facilitated processing of emotional stimuli. The findings indicate that the social-affective relevance of a face based on emotional knowledge is accessed during a phase of attentional enhancement for conscious perception and can affect prioritization for awareness. In contrast, no clear evidence for influences of facial trustworthiness during the attentional blink was found.

Incidental learning of faces during threat: No evidence for enhanced physiological responses to former threat identities

Remembering an unfamiliar person and the contextual conditions of that encounter is important for adaptive future behavior, especially in a potentially dangerous situation. Initiating defensive behavior in the presence of former dangerous circumstances can be crucial. Recent studies showed selective electrocortical processing of faces that were previously seen in a threat context compared to a safety context, however, this was not reflected in conscious recognition performance. Here, we investigated whether previously seen threat-faces, that could not be remembered, were capable to activate defensive psychophysiological response systems. During an encoding phase, 50 participants with low to moderate levels of anxiety viewed 40 face pictures with neutral expressions (6 s each), without an explicit learning instruction (incidental learning task). Each half of the faces were presented with contextual background colors that signaled either threat-of-shock or safety. In the recognition phase, all old and additional new faces (total of 60) were presented intermixed without context information. Participants had to decide whether a face was new or had been presented previously in a threatening or a safe context. Results show moderate face recognition independent of context conditions. Startle reflex and skin conductance responses (SCR) were more pronounced for threat compared to safety during encoding. For SCR, this differentiation was enhanced with higher levels of depression and anxiety. There were no differential startle reflex or SCR effects during recognition. From a clinical perspective, these findings do not support the notion that perceptual biases and physiological arousal directly relate to threat-associated identity recognition deficits in healthy and clinical participants with anxiety and trauma-related disorders.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Electrophysiological, emotional and behavioural responses of female targets of sexual objectification

Sexual objectification and the interiorized objectifying gaze (self-objectification) are dangerous phenomena for women's psychological wellness. However, their specific effects on women's socio-affective reactions are still poorly understood, and their neural activity has never been explored before. In the present study, we investigated women's emotional and electrophysiological responses during simulated computer-based objectifying social interactions, and we examined consequent punishing behaviours towards the perpetrator using the ultimatum game. Behavioural results (N = 36) showed that during objectifying encounters women generally felt angrier/disgusted and tended to punish the perpetrator in later interactions. However, the more the women self-objectified, the more they felt ashamed (p = 0.011) and tended to punish the perpetrators less (p = 0.008). At a neural level (N = 32), objectifying interactions modulated female participants' neural signal elicited during the processing of the perpetrator, increasing early (N170) and later (EPN, LPP) ERP components. In addition, only the amplitude of the LPP positively correlated with shame (p = 0.006) and the level of self-objectification (p = 0.018). This finding provides first evidence for the specific time-course of sexual objectification, self-objectification and its associated shame response, and proves that emotional and social consequences of sexual objectification in women may depend on their tendency to self-objectify.

Influence of advisees' facial feedback on subsequent advice-giving by advisors: Evidence from the behavioral and neurophysiological approach

Previous work has demonstrated the interpersonal implications of advisees' decisions (acceptance or rejection) on advisors' advice-giving behavior in subsequent exchanges. Here, using an ERP technique, we investigated how advisees' facial feedback (smiling, neutral, or frowning) accompanying their decisions (acceptance or rejection) influenced advisors' feedback evaluation from advisees and their advice-giving in subsequent exchanges. Behaviorally, regardless of whether the advice was accepted or rejected, advisors who received smiling-expression feedback would show higher willingness rates in subsequent advice-giving decisions, while advisors who received frowning-expression feedback would show lower willingness rates. On the neural level, in the feedback evaluation stage, the FRN and P3 responses were not sensitive to facial feedback. In contrast, frowning-expression feedback elicited a larger LPC amplitude than neutral- and smiling-expression feedback, regardless of whether the advice was accepted or rejected. In the advice decision stage, advisors who received neutral-expression feedback showed a larger N2 in making decisions than advisors who received frowning-expression feedback only after the advice was rejected. Additionally, Advisors who received smiling- and neutral-expression feedback showed a larger P3 in making decisions than advisors who received frowning-expression feedback only after the advice was accepted. In sum, the current findings extended previous research findings by showing that the effect of advisees' facial expressions on the advisors' advice-giving existed in multiple stages, including both the feedback evaluation stage and the advice decision stage.

Separating art from the artist: The effect of negative affective knowledge on ERPs and aesthetic experience

Some artists do terrible things. But does knowing something bad about an artist affect the way we perceive the work? Despite increased public interest, this question has yet to be addressed empirically. In this pre-registered study, we used aesthetic ratings and electrophysiological brain responses to shed light on the issue. We found that paintings of artists associated with negative-social biographical knowledge were liked less and found more arousing than paintings of artists associated with neutral information. Such paintings also elicited an enhanced brain response associated with fast and reflexive processing of emotional stimuli (early posterior negativity; EPN). Evaluations of quality and later, more controlled brain responses (late positive potential; LPP) were not affected. Reflecting the complexity of aesthetic experience, this pattern of results became more differentiated when the visual relatedness between the contents of the painting and the artist-related information was taken into account. Overall, our findings suggest that emotional aspects involved in art reception are not spontaneously separated from the artist, whilst evaluative judgments and more elaborate processing may be.

Estimation Strategy Utilization Is Modulated by Implicit Emotion Regulation: Evidence from Behavioral and Event-Related Potentials Studies

A large number of studies have studied the influence of emotional experience on an individual's estimation performance, but the influence of implicit emotion regulation is still unknown. Participants were asked to complete the following tasks in order: idiom matching task, multiplication computational estimation task (MCE task), gender judgment task (GJ task), and emotional experience intensity assessment task. The words matching task was adopted to achieve the purpose of implicit emotion regulation (implicit reappraisal and implicit suppression). Behavioral results showed that implicit reappraisal and implicit suppression equally contributed to improving an individual's estimation speed (but not ACC (accuracy)). The MCE task related ERP (event-related potential) results showed that the influence of implicit emotion regulation on estimation consisted of two phases. In the first phase (encoding phase), implicit reappraisal both enhanced (larger P1 amplitudes) and weakened (smaller N170 amplitudes) an individual's encoding sensitivity, while implicit suppression enhanced an individual's encoding sensitivity (larger P1 amplitudes). In the second phase (estimation strategies retrieval phase), implicit reappraisal (but not implicit suppression) cost more attention resources (larger LPC2 and LPC3 amplitudes). The present study suggested that both implicit reappraisal and implicit suppression contributed to improving an individual's estimation performance, and the regulation effect of implicit suppression (vs. implicit reappraisal) was better.

Therapist reactions to patient personality: A pilot study of clinicians’ emotional and neural responses using three clinical vignettes from in treatment series

Introduction

Therapists’ responses to patients play a crucial role in psychotherapy and are considered a key component of the patient–clinician relationship, which promotes successful treatment outcomes. To date, no empirical research has ever investigated therapist response patterns to patients with different personality disorders from a neuroscience perspective.

Methods

In the present study, psychodynamic therapists (N = 14) were asked to complete a battery of instruments (including the Therapist Response Questionnaire) after watching three videos showing clinical interactions between a therapist and three patients with narcissistic, histrionic/borderline, and depressive personality disorders, respectively. Subsequently, participants’ high-density electroencephalography (hdEEG) was recorded as they passively viewed pictures of the patients’ faces, which were selected from the still images of the previously shown videos. Supervised machine learning (ML) was used to evaluate whether: (1) therapists’ responses predicted which patient they observed during the EEG task and whether specific clinician reactions were involved in distinguishing between patients with different personality disorders (using pairwise comparisons); and (2) therapists’ event-related potentials (ERPs) predicted which patient they observed during the laboratory experiment and whether distinct ERP components allowed this forecast.

Results

The results indicated that therapists showed distinct patterns of criticized/devalued and sexualized reactions to visual depictions of patients with different personality disorders, at statistically systematic and clinically meaningful levels. Moreover, therapists’ late positive potentials (LPPs) in the hippocampus were able to determine which patient they observed during the EEG task, with high accuracy.

Discussion

These results, albeit preliminary, shed light on the role played by therapists’ memory processes in psychotherapy. Clinical and neuroscience implications of the empirical investigation of therapist responses are discussed.

Self-reference processing of fat-face and sick-face in individuals with different disgust sensitivity: Evidence from behavioral and neuroelectrophysiology

Self-reference effect has been widely discussed. Previous scholars believed that self-related information can be processed faster is due to the positive attribute of self-concept which speeds up self-related information processing. When self-related information is given negative attributes, the self-reference effect will be weakened. In this study, fat and sick, two kinds of stimuli associated with disgust characteristics, were added to self- and other-faces. We found that disease stimuli, which are closely related to survival threats, eliminated the self-reference effect while the obesity stimuli only weakened the self-reference effect to a certain extent. Event-related potential (ERP) analysis demonstrated that sick-faces have a greater amplitude than standard-faces in the EPN and LPP components. We believe that this may be due to the urgency of the disease threat, which leads to the selective attention to the disease threat in the early perception stage and the allocation of more attention resources for rapid response in the later stage. In addition, we found that disgust sensitivity specifically maintains individuals' self-referential effects by dissociating individuals from others in disease contexts. These results further support the behavioral immune function of disgust as a gatekeeper of the self in potentially contaminated environments. In conclusion, our study showed that in the face of survival threat, the self-reference effect is eliminated, and disgust tried to slow down this elimination effect to protect self. This study extends the behavioral immunity theory to some extent and further deepens the understanding of the relationship between disgust and self.

Influence of affective verbal context on emotional facial expression perception of social anxiety

Previous studies have shown that the perception of ambiguous facial expressions for individuals with social anxiety was influenced by the affective verbal context. However, it is still unknown how emotional facial expressions are perceived by individuals with social anxiety in the context of the verbal context. In this study, we used event-related potentials (ERPs) technology to examine how individuals with social anxiety perceive emotional facial expressions in positive and negative contexts. The results showed that: (1) Within the negative verbal contexts, the amplitude of P1 induced by facial expressions in the social anxiety group was significantly higher than that induced by the healthy control group; The N170 amplitude induced by facial expressions in social anxiety group was less negative than that in the healthy control group, and was not affected by the context. (2) The social anxiety group had significantly higher LPP in negative contexts elicited by angry expressions than by happy expressions. This study proved that the perception of emotional facial expressions was influenced by top-down information in the early and late stages of visual perception for individuals with social anxiety.

A novel and effective item-source complex trial protocol: Discrimination of guilty from both knowledgeable and unknowledgeable innocent subjects

Innocent subjects who are knowledgeable of crime-related information will often be misclassified as "guilty" in P300-based complex trial protocol (CTP). Therefore, it is necessary to develop a more rigorous CTP that can effectively discriminate the guilty from both the knowledgeable and the unknowledgeable innocents. Sometimes the guilty and the knowledgeable innocents possess the same item memories but different source memories. The present study designed a novel item-source complex trial protocol based on the differences of source memory among the three kinds of individuals. Either the crime-related probe (e.g., the stolen ring) or one of the crime-unrelated stimuli (e.g., watch, earring, bracelet, or bangle) (item memory) was presented in the first part of each trail, and either a stealing-source word (e.g., stole) or other-source word (e.g., fetched) (source memory) was presented in the second part of each trail. The results showed that: (1) the P300 evoked by item memory could effectively discriminated the guilty from the unknowledgeable innocent (AUC = 0.76) but failed to effectively discriminate the guilty from the knowledgeable innocent (AUC = 0.60); (2) the late positive component evoked by source memory could effectively discriminated the guilty from both the knowledgeable innocent (AUC = 0.94) and the unknowledgeable innocent (AUC = 0.84) in one test.

Neural signatures of individual variability in context-dependent perception of ambiguous facial expression

How do we incorporate contextual information to infer others' emotional state? Here we employed a naturalistic context-dependent facial expression estimation task where participants estimated pleasantness levels of others' ambiguous expression faces when sniffing different contextual cues (e.g., urine, fish, water, and rose). Based on their pleasantness rating data, we placed participants on a context-dependency continuum and mapped the individual variability in the context-dependency onto the neural representation using a representational similarity analysis. We found that the individual variability in the context-dependency of facial expression estimation correlated with the activity level of the pregenual anterior cingulate cortex (pgACC) and the amygdala and was also decoded by the neural representation of the ventral anterior insula (vAI). A dynamic causal modeling revealed that those with higher context-dependency exhibited a greater degree of the modulation from vAI to the pgACC. These findings provide novel insights into the neural circuitry associated with the individual variability in context-dependent facial expression estimation and the first empirical evidence for individual variability in the predictive accounts of affective states.

Long-Term Influence of Incidental Emotions on the Emotional Judgment of Neutral Faces

Background: Evidence indicates that the processing of facial stimuli may be influenced by incidental factors, and these influences are particularly powerful when facial expressions are ambiguous, such as neutral faces. However, limited research investigated whether emotional contextual information presented in a preceding and unrelated experiment could be pervasively carried over to another experiment to modulate neutral face processing.

Objective: The present study aims to investigate whether an emotional text presented in a first experiment could generate negative emotion toward neutral faces in a second experiment unrelated to the previous experiment.

Methods: Ninety-nine students (all women) were randomly assigned to read and evaluate a negative text (negative context) or a neutral text (neutral text) in the first experiment. In the subsequent second experiment, the participants performed the following two tasks: (1) an attentional task in which neutral faces were presented as distractors and (2) a task involving the emotional judgment of neutral faces.

Results: The results show that compared to the neutral context, in the negative context, the participants rated more faces as negative. No significant result was found in the attentional task.

Conclusion: Our study demonstrates that incidental emotional information available in a previous experiment can increase participants’ propensity to interpret neutral faces as more negative when emotional information is directly evaluated. Therefore, the present study adds important evidence to the literature suggesting that our behavior and actions are modulated by previous information in an incidental or low perceived way similar to what occurs in everyday life, thereby modulating our judgments and emotions.

I can see it in your eyes: Perceived gaze direction impacts ERP and behavioural measures of affective theory of mind

Looking at someone's eyes is thought to be important for affective theory of mind (aTOM), our ability to infer their emotional state. However, it is unknown whether an individual's gaze direction influences our aTOM judgements and what the time course of this influence might be. We presented participants with sentences describing individuals in positive, negative or neutral scenarios, followed by direct or averted gaze neutral face pictures of those individuals. Participants made aTOM judgements about each person's mental state, including their affective valence and arousal, and we investigated whether the face gaze direction impacted those judgements. Participants rated that gazers were feeling more positive when they displayed direct gaze as opposed to averted gaze, and that they were feeling more aroused during negative contexts when gaze was averted as opposed to direct. Event-related potentials associated with face perception and affective processing were examined using mass-univariate analyses to track the time-course of this eye-gaze and affective processing interaction at a neural level. Both positive and negative trials were differentiated from neutral trials at many stages of processing. This included the early N200 and EPN components, believed to reflect automatic emotion areas activation and attentional selection respectively. This also included the later P300 and LPP components, thought to reflect elaborative cognitive appraisal of emotional content. Critically, sentence valence and gaze direction interacted over these later components, which may reflect the incorporation of eye-gaze in the cognitive evaluation of another's emotional state. The results suggest that gaze perception directly impacts aTOM processes, and that altered eye-gaze processing in clinical populations may contribute to associated aTOM impairments.

Charged With a Crime: The Neuronal Signature of Processing Negatively Evaluated Faces Under Different Attentional Conditions

Our brains rapidly respond to human faces and can differentiate between many identities, retrieving rich semantic emotional-knowledge information. Studies provide a mixed picture of how such information affects event-related potentials (ERPs). We systematically examined the effect of feature-based attention on ERP modulations to briefly presented faces of individuals associated with a crime. The tasks required participants ( N = 40 adults) to discriminate the orientation of lines overlaid onto the face, the age of the face, or emotional information associated with the face. Negative faces amplified the N170 ERP component during all tasks, whereas the early posterior negativity (EPN) and late positive potential (LPP) components were increased only when the emotional information was attended to. These findings suggest that during early configural analyses (N170), evaluative information potentiates face processing regardless of feature-based attention. During intermediate, only partially resource-dependent, processing stages (EPN) and late stages of elaborate stimulus processing (LPP), attention to the acquired emotional information is necessary for amplified processing of negatively evaluated faces.

"She finds you abhorrent" - The impact of emotional context information on the cortical processing of neutral faces in depression

Depression is associated with abnormalities in patterns of information processing, particularly in the context of processing of interpersonal information. The present study was designed to investigate the differences in depressive individuals in cortical processing of facial stimuli when neutral faces were presented in a context that involved information about emotional valence as well as self-reference. In 21 depressive patients and 20 healthy controls, event-related potentials (ERPs) were recorded during the presentation of neutral facial expressions, which were accompanied by affective context information that was either self- or other-related. Across conditions, depressive patients showed larger mean P100 amplitudes than healthy controls. Furthermore, mean late positive potential (LPP) amplitudes of depressive patients were larger in response to faces in self-related than in other-related context. In addition, irrespective of self-reference, mean LPP responses of depressive patients to faces presented after socially threatening sentences were larger compared with faces presented after neutral sentences. Results regarding self-reference supported results of previous studies indicating larger mean amplitudes in self-related conditions. Findings suggest a general heightened initial responsiveness to emotional cues and a sustained emotion processing of socially threatening information in depressive patients.

Different influences of moral violation with and without physical impurity on face processing: An event-related potentials study

It has been widely accepted that moral violations that involve impurity (such as spitting in public) induce the emotion of disgust, but there has been a debate about whether moral violations that do not involve impurity (such as swearing in public) also induce the same emotion. The answer to this question may have implication for understanding where morality comes from and how people make moral judgments. This study aimed to compared the neural mechanisms underlying two kinds of moral violation by using an affective priming task to test the effect of sentences depicting moral violation behaviors with and without physical impurity on subsequent detection of disgusted faces in a visual search task. After reading each sentence, participants completed the face search task. Behavioral and electrophysiological (event-related potential, or ERP) indices of affective priming (P2, N400, LPP) and attention allocation (N2pc) were analyzed. Results of behavioral data and ERP data showed that moral violations both with and without impurity promoted the detection of disgusted faces (RT, N2pc); moral violations without impurity impeded the detection of neutral faces (N400). No priming effect was found on P2 and LPP. The results suggest both types of moral violation influenced the processing of disgusted faces and neutral faces, but the neural activity with temporal characteristics was different.

Feeling through another's eyes: Perceived gaze direction impacts ERP and behavioural measures of positive and negative affective empathy

Looking at the eyes informs us about the thoughts and emotions of those around us, and impacts our own emotional state. However, it is unknown how perceiving direct and averted gaze impacts our ability to share the gazer's positive and negative emotions, abilities referred to as positive and negative affective empathy. We presented 44 participants with contextual sentences describing positive, negative and neutral events happening to other people (e.g. "Her newborn was saved/killed/fed yesterday afternoon."). These were designed to elicit positive, negative, or little to no empathy, and were followed by direct or averted gaze images of the individuals described. Participants rated their affective empathy for the individual and their own emotional valence on each trial. Event-related potentials time-locked to face-onset and associated with empathy and emotional processing were recorded to investigate whether they were modulated by gaze direction. Relative to averted gaze, direct gaze was associated with increased positive valence in the positive and neutral conditions and with increased positive empathy ratings. A similar pattern was found at the neural level, using robust mass-univariate statistics. The N100, thought to reflect an automatic activation of emotion areas, was modulated by gaze in the affective empathy conditions, with opposite effect directions in positive and negative conditions.. The P200, an ERP component sensitive to positive stimuli, was modulated by gaze direction only in the positive empathy condition. Positive and negative trials were processed similarly at the early N200 processing stage, but later diverged, with only negative trials modulating the EPN, P300 and LPP components. These results suggest that positive and negative affective empathy are associated with distinct time-courses, and that perceived gaze direction uniquely modulates positive empathy, highlighting the importance of studying empathy with face stimuli.

Meaningful faces: Self-relevance of semantic context in an initial social encounter improves later face recognition

Self-relevant stimuli (i.e. meaningful/important to the observer and related to the self) are typically remembered better than other-relevant stimuli. However, whether a self-relevance memory benefit could be conferred to a novel neutral face, remains to be seen. Recent studies have shown that emotional responses to neutral faces can be altered by using a preceding sentence as context that varies in terms of self-relevance (self/other-relevant) and valence (positive/negative; e.g. "S/he thinks your comment is dumb/smart"). We adapted this paradigm to investigate whether the context conferred by the preceding sentence also impacts memorability of the subsequently presented face. Participants saw faces primed with contextual sentences and rated how aroused, and how positive or negative, the faces made them feel. Later incidental recognition accuracy for the faces was greater when these had been preceded by self-relevant compared to other-relevant sentences. Faces preceded by self-relevant contexts were also rated as more arousing. There was no impact of sentence valence on arousal ratings or on recognition memory for faces. Sentence self-relevance and valence interacted to affect participants' ratings of how positive or negative the faces made them feel during encoding, but did not interact to impact later recognition. Our results indicate that initial social encounters can have a lasting effect on one's memory of another person, producing an enhanced memory trace of that individual. We propose that the effect is driven by an arousal-based mechanism, elicited by faces perceived to be self-relevant.

The effect of empathy and context on face-processing ERPs

The investigation of emotional face processing has largely used faces devoid of context, and does not account for within-perceiver differences in empathy. The importance of context in face perception has become apparent in recent years. This study examined the interaction of the contextual factors of facial expression, knowledge of a person's character, and within-perceiver empathy levels on face processing event-related potentials (ERPs). Forty-two adult participants learned background information about six individuals' character. Three types of character were described, in which the character was depicted as deliberately causing harm to others, accidently causing harm to others, or undertaking neutral actions. Subsequently, EEG was recorded while participants viewed the characters' faces displaying neutral or emotional expressions. Participants' empathy was assessed using the Empathy Quotient survey. Results showed a significant interaction of character type and empathy on the early posterior negativity (EPN) ERP component. These results suggested that for those with either low or high empathy, more attention was paid to the face stimuli, with more distinction between the different characters. In contrast, those in the middle range of empathy tended to produce smaller EPN with less distinction between character types. Findings highlight the importance of trait empathy in accounting for how faces in context are perceived.

In context: emotional intent and temporal immediacy of contextual descriptions modulate affective ERP components to facial expressions

In this study, we explored how contextual information about threat dynamics affected the electrophysiological correlates of face perception. Forty-six healthy native Swedish speakers read verbal descriptions signaling an immediate vs delayed intent to escalate or deescalate an interpersonal conflict. Each verbal description was followed by a face with an angry or neutral expression, for which participants rated valence and arousal. Affective ratings confirmed that the emotional intent expressed in the descriptions modulated emotional reactivity to the facial stimuli in the expected direction. The electrophysiological data showed that compared to neutral faces, angry faces resulted in enhanced early and late event-related potentials (VPP, P300 and LPP). Additionally, emotional intent and temporal immediacy modulated the VPP and P300 similarly across angry and neutral faces, suggesting that they influence early face perception independently of facial affect. By contrast, the LPP amplitude to faces revealed an interaction between facial expression and emotional intent. Deescalating descriptions eliminated the LPP differences between angry and neutral faces. Together, our results suggest that information about a person’s intentions modulates the processing of facial expressions.

Attending to Eliza: rapid brain responses reflect competence attribution in virtual social feedback processing

In the age of virtual communication, the source of a message is often inferred rather than perceived, raising the question of how sender attributions affect content processing. We investigated this issue in an evaluative feedback scenario. Participants were told that an expert psychotherapist, a layperson or a randomly acting computer was going to give them online positive, neutral or negative personality feedback while high-density EEG was recorded. Sender attribution affected processing rapidly, even though the feedback was on average identical. Event-related potentials revealed a linear increase with attributed expertise beginning 150 ms after disclosure and most pronounced for N1, P2 and early posterior negativity components. P3 and late positive potential amplitudes were increased for both human senders and for emotionally significant (positive or negative) feedback. Strikingly, feedback from a putative expert prompted large P3 responses, even for inherently neutral content. Source analysis localized early enhancements due to attributed sender expertise in frontal and somatosensory regions and later responses in the posterior cingulate and extended visual and parietal areas, supporting involvement of mentalizing, embodied processing and socially motivated attention. These findings reveal how attributed sender expertise rapidly alters feedback processing in virtual interaction and have implications for virtual therapy and online communication.

Significance?& Significance! Empirical, methodological, and theoretical connections between the late positive potential and P300 as neural responses to stimulus significance: An integrative review

Event-related potential studies of emotional processing have focused on the late positive potential (LPP), a sustained positive deflection in the ERP that is increased for emotionally arousing stimuli. A prominent theory suggests that modulation of the LPP is a response to stimulus significance, defined in terms of the activation of appetitive and aversive motivational systems. The current review incorporates experimental studies showing that manipulations that alter the significance of stimuli alter LPP amplitude. Complementing these within-person studies, also included is individual differences research on depression wherein the LPP has been used to study reduced neural sensitivity to emotional stimuli. Finally, the current review builds an existing framework that the LPP observed in studies in emotional processing and the P300 observed in classic oddball studies may reflect a common response to stimulus significance. This integrative account has implications for the functional interpretation of these ERPs, their neurobiological mechanisms, and clinical applications.

Processing of affective words in adolescent PTSD-Attentional bias toward social threat

Post-traumatic stress disorder (PTSD) is associated with a hypersensitivity to potential threat. This hypersensitivity manifests through differential patterns of emotional information processing and has been demonstrated in behavioral and neurophysiological experimental paradigms. However, the majority of research has been focused on adult patients with PTSD. To examine possible differences in underlying neurophysiological patterns for adolescent patients with PTSD after childhood sexual and/or physical abuse (CSA/CPA), ERP correlates of emotional word processing in 38 healthy participants and 40 adolescent participants with PTSD after experiencing CSA/CPA were studied. The experimental paradigm consisted of a passive reading task with neutral, positive (e.g., paradise), physically threatening (e.g., torment), and socially threatening (i.e., swearing, e.g., son of a bitch) words. A modulation of P3 amplitudes by emotional valence was found, with positive words inducing less elevated amplitudes over both groups. Interestingly, in later processing, the PTSD group showed augmented early late positive potential (LPP) amplitudes for socially threatening stimuli, while there were no modulations within the healthy control group. Also, region-specific emotional modulations for anterior and posterior electrode clusters were found. For the anterior LPP, highest activations have been found for positive words, while socially and physically threatening words led to strongest modulations in the posterior LPP cluster. There were no modulations by group or emotional valence at the P1 and EPN stage. The findings suggest an enhanced conscious processing of socially threatening words in adolescent patients with PTSD after CSA/CPA, pointing to the importance of a disjoined examination of threat words in emotional processing research.

The effect of emotional and self-referential contexts on ERP responses towards surprised faces

The perception of surprised faces is demonstrably modulated by emotional context. However, the influence of self-relevance and its interaction with emotional context have not been explored. The present study investigated the effects of contextual valence and self-reference on the perception of surprised faces. Our results revealed that faces in a negative context elicited a larger N170 than those in a neutral context. The EPN was affected by the interaction between contextual valence and self-reference, with larger amplitudes for faces in self-related positive contexts and sender-related negative contexts. Additionally, LPP amplitudes were enhanced for faces in negative contexts relative to neutral and positive contexts, as well as for self-related contexts in comparison to sender-related contexts. Together, these findings help to elucidate the psychophysiological mechanisms underlying the effects of emotional and self-referential contexts on the perception of surprised faces, which are characterized by distinctive ERPs.

Emotion in Context: How Sender Predictability and Identity Affect Processing of Words as Imminent Personality Feedback

Recent findings suggest that communicative context affects the timing and magnitude of emotion effects in word processing. In particular, social attributions seem to be one important source of plasticity for the processing of affectively charged language. Here, we investigate the timing and magnitude of ERP responses toward positive, neutral, and negative trait adjectives during the anticipation of putative socio-evaluative feedback from different senders (human and computer) varying in predictability. In the first experiment, during word presentation participants could not anticipate whether a human or a randomly acting computer sender was about to give feedback. Here, a main effect of emotion was observed only on the late positive potential (LPP), showing larger amplitudes for positive compared to neutral adjectives. In the second study the same stimuli and set-up were used, but a block-wise presentation was realized, resulting in fixed and fully predictable sender identity. Feedback was supposedly given by an expert (psychotherapist), a layperson (unknown human), and again by a randomly acting computer. Main effects of emotion started with an increased P1 for negative adjectives, followed by effects at the N1 and early posterior negativity (EPN), showing both largest amplitudes for positive words, as well as for the LPP, where positive and negative words elicited larger amplitudes than neutral words. An interaction revealed that emotional LPP modulations occurred only for a human sender. Finally, regardless of content, anticipating human feedback led to larger P1 and P3 components, being highest for the putative expert. These findings demonstrate the malleability of emotional language processing by social contexts. When clear predictions can be made, our brains rapidly differentiate between emotional and neutral information, as well as between different senders. Attributed human presence affects emotional language processing already during feedback anticipation, in line with a selective gating of attentional resources via anticipatory social significance attributions. By contrast, emotion effects occur much later, when crucial social context information is still missing. These findings demonstrate the context-dependence of emotion effects in word processing and are particularly relevant since virtual communication with unknown senders, whose identity is inferred rather than perceived, has become reality for millions of people.

Reappraising faces: effects on accountability appraisals, self-reported valence, and pupil diameter

Many of our emotions arise in social contexts, as we interact with and learn about others. What is not yet clear, however, is how such emotions unfold when we either react to others or attempt to regulate our emotions. To address this issue, 30 healthy volunteers reacted to or reappraised positive or negative information that was paired with neutral faces. While they were doing this task, we assessed pupillary responses. We also asked participants to provide ratings of accountability and experienced emotion. Findings indicated that appraised accountability increased in response to emotional information, and changes in accountability were associated with commensurate changes in valence reports and increased pupil diameter. During reappraisal, accountability and emotion decreased, but pupil diameter increased. The findings highlight the importance of accountability appraisals during the generation and regulation of emotional reactions to others, while also documenting pupillary increases during emotional reactivity and regulation.

The Positivity Bias Phenomenon in Face Perception Given Different Information on Ability

The negativity bias has been shown in many fields, including in face processing. We assume that this bias stems from the potential threat inlayed in the stimuli (e.g., negative moral behaviors) in previous studies. In the present study, we conducted one behavioral and one event-related potentials (ERPs) experiments to test whether the positivity bias rather than negativity bias will arise when participants process information whose negative aspect involves no threat, i.e., the ability information. In both experiments, participants first completed a valence rating (negative-to-positive) of neutral facial expressions. Further, in the learning period, participants associated the neutral faces with high-ability, low-ability, or control sentences. Finally, participants rated these facial expressions again. Results of the behavioral experiment showed that compared with pre-learning, the expressions of the faces associated with high ability sentences were classified as more positive in the post-learning expression rating task, and the faces associated with low ability sentences were evaluated as more negative. Meanwhile, the change in the high-ability group was greater than that of the low-ability group. The ERP data showed that the faces associated with high-ability sentences elicited a larger early posterior negativity, an ERP component considered to reflect early sensory processing of the emotional stimuli, than the faces associated with control sentences. However, no such effect was found in faces associated with low-ability sentences. To conclude, high ability sentences exerted stronger influence on expression perception than did low ability ones. Thus, we found a positivity bias in this ability-related facial perceptual task. Our findings demonstrate an effect of valenced ability information on face perception, thereby adding to the evidence on the opinion that person-related knowledge can influence face processing. What’s more, the positivity bias in non-threatening surroundings increases scope for studies on processing bias.

Contextual Valence and Sociality Jointly Influence the Early and Later Stages of Neutral Face Processing

Recent studies have demonstrated that face perception is influenced by emotional contextual information. However, because facial expressions are routinely decoded and understood during social communication, sociality should also be considered-that is, it seems necessary to explore whether emotional contextual effects are influenced by the sociality of contextual information. Furthermore, although one behavioral study has explored the effects of context on selective attention to faces, the exact underlying mechanisms remain unknown. Therefore, the current study investigated how valence and sociality of contextual information influenced the early and later stages of neutral face processing. We first employed an established affective learning procedure, wherein neutral faces were paired with verbal information that differed in valence (negative, neutral) and sociality (social, non-social), to manipulate contextual information. Then, to explore the effects of context on face perception, participants performed a face perception task, while the N170, early posterior negativity (EPN), and late positive potential (LPP) components were measured. Finally, to explore the effects of context on selective attention, participants performed a dot probe task while the N2pc was recorded. The results showed that, in the face perception task, faces paired with negative social information elicited greater EPN and LPP than did faces paired with neutral social information; no differences existed between faces paired with negative and neutral non-social information. In the dot probe task, faces paired with negative social information elicited a more negative N2pc amplitude (indicating attentional bias) than did faces paired with neutral social information; the N2pc did not differ between faces paired with negative and neutral non-social information. Together, these results suggest that contextual information influenced both face perception and selective attention, and these context effects were governed by the interaction between valence and sociality of contextual information.

Interactive effects between gaze direction and facial expression on attentional resources deployment: the task instruction and context matter

In three experiments, we tested whether the amount of attentional resources needed to process a face displaying neutral/angry/fearful facial expressions with direct or averted gaze depends on task instructions, and face presentation. To this end, we used a Rapid Serial Visual Presentation paradigm in which participants in Experiment 1 were first explicitly asked to discriminate whether the expression of a target face (T1) with direct or averted gaze was angry or neutral, and then to judge the orientation of a landscape (T2). Experiment 2 was identical to Experiment 1 except that participants had to discriminate the gender of the face of T1 and fearful faces were also presented randomly inter-mixed within each block of trials. Experiment 3 differed from Experiment 2 only because angry and fearful faces were never presented within the same block. The findings indicated that the presence of the attentional blink (AB) for face stimuli depends on specific combinations of gaze direction and emotional facial expressions and crucially revealed that the contextual factors (e.g., explicit instruction to process the facial expression and the presence of other emotional faces) can modify and even reverse the AB, suggesting a flexible and more contextualized deployment of attentional resources in face processing.

Cerebral Correlates of Automatic Associations Towards Performance Enhancing Substances

The direct assessment of explicit attitudes toward performance enhancing substances, for example Neuroenhancement or doping in sports, can be affected by social desirability biases and cheating attempts. According to Dual Process Theories of cognition, indirect measures like the Implicit Association Test (IAT) measure automatic associations toward a topic (as opposed to explicit attitudes measured by self-report measures). Such automatic associations are thought to occur rapidly and to evade voluntary control. However, whether or not such indirect tests actually reflect automatic associations is difficult to validate. Electroencephalography (EEG) has a superior time resolution which can differentiate between highly automatic compared to more elaborate processing stages. We therefore used EEG to examine on which processing stages cortical differences between negative or positive attitudes to doping occur, and whether or not these differences can be related to BIAT scores. We tested 42 university students (31 females, 24.43 ± 3.17 years old), who were requested to complete a brief doping IAT (BIAT) on attitudes toward doping. Cerebral activity during doping BIAT completion was assessed using high-density EEG. Behaviorally, participants D-scores exhibited negative attitudes toward doping, represented by faster reaction times in the doping + dislike pairing task. Event-related potentials (ERPs) revealed earliest effects between 200 and 300 ms. Here, a relatively larger occipital positivity was found for the doping + dislike pairing task. Further, in the LPP time range between 400 and 600 ms a larger late positive potential was found for the doping + dislike pairing task over central regions. These LPP amplitude differences were successfully predicting participants' BIAT D-scores. Results indicate that event-related potentials differentiate between positive and negative doping attitudes at stages of mid-latency. However, it seems that IAT scores can be predicted only by the later occurring LPP. Our study is the first to investigate the cerebral correlates that contribute to test scores obtained in the indirect testing of automatic associations toward doping. The implications of our results for the broader NE concept are discussed in light of the conceptual similarity of doping and NE.

The Effect of Affective Context on Visuocortical Processing of Neutral Faces in Social Anxiety

It has been demonstrated that verbal context information alters the neural processing of ambiguous faces such as faces with no apparent facial expression. In social anxiety, neutral faces may be implicitly threatening for socially anxious individuals due to their ambiguous nature, but even more so if these neutral faces are put in self-referential negative contexts. Therefore, we measured event-related brain potentials (ERPs) in response to neutral faces which were preceded by affective verbal information (negative, neutral, positive). Participants with low social anxiety (LSA; n = 23) and high social anxiety (HSA; n = 21) were asked to watch and rate valence and arousal of the respective faces while continuous EEG was recorded. ERP analysis revealed that HSA showed elevated P100 amplitudes in response to faces, but reduced structural encoding of faces as indexed by reduced N170 amplitudes. In general, affective context led to an enhanced early posterior negativity (EPN) for negative compared to neutral facial expressions. Moreover, HSA compared to LSA showed enhanced late positive potentials (LPP) to negatively contextualized faces, whereas in LSA this effect was found for faces in positive contexts. Also, HSA rated faces in negative contexts as more negative compared to LSA. These results point at enhanced vigilance for neutral faces regardless of context in HSA, while structural encoding seems to be diminished (avoidance). Interestingly, later components of sustained processing (LPP) indicate that LSA show enhanced visuocortical processing for faces in positive contexts (happy bias), whereas this seems to be the case for negatively contextualized faces in HSA (threat bias). Finally, our results add further new evidence that top-down information in interaction with individual anxiety levels can influence early-stage aspects of visual perception.

Differences in neural activity when processing emotional arousal and valence in autism spectrum disorders

Individuals with autism spectrum disorders (ASD) often have difficulty recognizing and interpreting facial expressions of emotion, which may impair their ability to navigate and communicate successfully in their social, interpersonal environments. Characterizing specific differences between individuals with ASD and their typically developing (TD) counterparts in the neural activity subserving their experience of emotional faces may provide distinct targets for ASD interventions. Thus we used functional magnetic resonance imaging (fMRI) and a parametric experimental design to identify brain regions in which neural activity correlated with ratings of arousal and valence for a broad range of emotional faces. Participants (51 ASD, 84 TD) were group-matched by age, sex, IQ, race, and socioeconomic status. Using task-related change in blood-oxygen-level-dependent (BOLD) fMRI signal as a measure, and covarying for age, sex, FSIQ, and ADOS scores, we detected significant differences across diagnostic groups in the neural activity subserving the dimension of arousal but not valence. BOLD-signal in TD participants correlated inversely with ratings of arousal in regions associated primarily with attentional functions, whereas BOLD-signal in ASD participants correlated positively with arousal ratings in regions commonly associated with impulse control and default-mode activity. Only minor differences were detected between groups in the BOLD signal correlates of valence ratings. Our findings provide unique insight into the emotional experiences of individuals with ASD. Although behavioral responses to face-stimuli were comparable across diagnostic groups, the corresponding neural activity for our ASD and TD groups differed dramatically. The near absence of group differences for valence correlates and the presence of strong group differences for arousal correlates suggest that individuals with ASD are not atypical in all aspects of emotion-processing. Studying these similarities and differences may help us to understand the origins of divergent interpersonal emotional experience in persons with ASD. Hum Brain Mapp 37:443-461, 2016. © 2015 Wiley Periodicals, Inc.