You don’t like me, do you? Enhanced ERP responses to averted eye gaze in social anxiety

Social anxiety prediction based on ERP features: A deep learning approach

BACKGROUND

Social Anxiety Disorder is traditionally diagnosed using subjective scales that may lack accuracy. Recently, EEG technology has gained importance for anxiety detection due to its ability to capture stable and objective neurophysiological activities. However, existing methods mainly focus on extracting EEG features during resting states, with limited use of psychologically features like Event-Related Potential (ERP) in task-related states for anxiety detection in deep learning frameworks.

METHODS

We collected EEG data from 63 participants exposed to four facial expressions and extracted task-relevant features. Using the EEGNet model, we predicted social anxiety and evaluated its performance using metrics such as accuracy, F1 score, sensitivity, and specificity. We compared EEGNet's performance with Deep Convolutional Neural Network (DeepConvNet), ShallowConvNet, Bi-directional Long Short-Term Memory (BiLSTM), and SVM. To assess the generalizability of the results, we carried out the same procedure on our prior dataset.

RESULTS

EEGNet outperformed other models, achieving 99.16 % accuracy with Late Positive Potential (LPP). ERP components yielded higher accuracy than time-domain and frequency-domain features for social anxiety recognition. Accuracy was better for neutral and negative facial stimuli. Consistency across two datasets indicates stability of findings.

LIMITATIONS

Due to limited publicly available task-state datasets, only our own were used. Future studies could assess generalizability on larger datasets from different sources.

CONCLUSIONS

We conducted the first test of ERP features in anxiety recognition tasks. Results show ERP features have greater potential in social anxiety recognition, with LPP exhibiting high stability and accuracy. Outcomes indicate recognizing social anxiety with negative or neutral facial stimuli is more useful.

Reduced early neural processing of faces in children and adolescents with social anxiety disorder

Social anxiety disorder (SAD) is one of the most common mental disorders during childhood and adolescence. Yet, little is known about its maintenance in youth. Cognitive models of SAD indicate that attentional biases play a key role in the dysfunctional processing of social information, such as emotional faces. However, previous research investigating neural correlates of childhood SAD has produced inconsistent findings. The current study aims to investigate neural face processing in children and adolescents with SAD, while taking into consideration methodological limitations of previous studies. We measured event-related potentials (P100, N170, EPN, LPP) in response to happy, neutral, and angry adult faces, and non-social household objects, in a sample of youth (aged 10-15 years) with SAD (n = 57), clinical controls with specific phobias (SP; n = 41), and healthy controls (HC; n = 61). Participants completed an emotion/object identification task while continuous EEG was recorded. Analyses revealed lower N170 amplitudes in the SAD group compared to HCs, irrespective of emotion. In addition, younger children (aged 10-12 years) with SAD showed lower EPN amplitudes and higher early LPP amplitudes (only trend level) in response to neutral and happy faces compared to younger HCs. These effects were specific to faces and were not evident in the neural processing of non-social household objects. Overall, the findings indicate that different neural response patterns are already present in youth with SAD. Group differences, particularly in younger children, suggest age-related differences in neural face processing in childhood SAD and underpin the necessity of developmental approaches.

Variations in the Appearance and Interpretation of Interpersonal Eye Contact in Social Categorizations and Psychiatric Populations Worldwide: A Scoping Review with a Critical Appraisal of the Literature

BACKGROUND

Eye contact is one of the most fundamental forms of interhuman communication. However, to date, there has been no comprehensive research comparing how eye contact is made and interpreted in all possible populations worldwide. This study presents a summary of the existing literature on these modalities stratified to social categorizations and psychiatric disorders.

METHOD

A scoping review with critical appraisal of the literature according to the Joanna Briggs Institute (JBI) methodology. Databases AnthroSource, Medline, CINAHL, the Psychology and Behavioral Sciences Collection (EBSCO) and PsychInfo were searched.

RESULTS

7068 articles were screened for both the grey literature and reference lists, of which 385 were included, 282 for social categorizations and 103 for psychiatric disorders. In total, 603 thematic clustered outcomes of variations were included. Methodological quality was generally moderate to good.

CONCLUSIONS

There is a great degree of variation in the presentation and interpretation of eye contact between and within populations. It remains unclear why specific variations occur in populations. Additionally, no gold standard for how eye contact should be used or interpreted emerged from the studies. Further research into the reason for differences in eye contact between and within populations is recommended.

Social anxiety modulating early processing for social threat words: an ERP study

Even though some recent research revealed individuals with HSA typically display enhanced processing in the early stages of emotional information processing due to hypervigilance and vulnerability to negative stimuli, it is still unclear whether social anxiety affects the time course underlying processing bias for emotional stimuli. Therefore, the present study aimed to explore the early stage of processing social threat stimuli in high social anxiety (HSA) individuals by recording RTs and EEG data in the emotional Stroop task. Behavioral data showed that the HSA group responded to the threat words faster than neutral words (i.e. negative bias), but no emotional effects in the low social anxiety (LSA) group. Although the P1 component did not show any early effects, ERP data exhibited an enhanced N170 for HSA than for LSA groups. Threat words elicited larger N170 than neutral words in the LSA group only; this emotion effect was not evident in the HSA group. These findings indicated that social anxiety modulates early processing for social threat words. This study revealed the neural mechanisms underlying early emotional processing in individuals with social anxiety, providing insights for the evaluation and intervention of social anxiety.

Neural evidence of face processing in social anxiety disorder: A systematic review with meta-analysis

Numerous previous studies have used event-related potentials (ERPs) to examine facial processing deficits in individuals with social anxiety disorder (SAD). However, researchers still need to determine whether the deficits are general or specific and what the dominant factors are behind different cognitive stages. Meta-analysis was performed to quantitatively identify face processing deficits in individuals with SAD. Ninety-seven results in 27 publications involving 1032 subjects were calculated using Hedges' g. The results suggest that the face itself elicits enlarged P1 amplitudes, threat-related facial expressions induce larger P2 amplitudes, and negative facial expressions lead to enhanced P3/LPP amplitudes in SAD individuals compared with controls. That is, there is face perception attentional bias in the early phase (P1), threat attentional bias in the mid-term phase (P2), and negative emotion attentional bias in the late phase (P3/LPP), which can be summarized into a three-phase SAD face processing deficit model. These findings provide an essential theoretical basis for cognitive behavioral therapy and have significant application value for the initial screening, intervention, and treatment of social anxiety.

Behavioral and ERP indices of self-schematic processing show differential associations with emerging symptoms of depression and social anxiety in late childhood: Evidence from a community-dwelling sample

Symptoms of depression and social anxiety elevate in late childhood. An identified cognitive risk to both depression and social anxiety is maladaptive self-schemas (or self-schematic processing). Beyond the behavioral indices of this construct, event-related potentials (ERPs) during self-schematic processing have also been observed to be associated with depression or depressive symptoms. However, no study has examined the ERPs underlying self-schematic processing in relation to social anxiety. More importantly, it was unclear to what extent behavioral and ERP indices of self-schematic processing were differentially associated with depression and social anxiety, especially in typical-risk youth with emerging symptoms. A hundred and fifteen community-dwelling children (66 girls; Mean age=10.91 years, SD=1.45) completed a self-referent encoding task (SRET) with EEG recorded. A Principal Component Analysis identified a late positive potential (LPP) component elicited in both the positive and negative SRET conditions. Multivariate multiple regression showed that in both conditions, behavioral SRET scores were associated with depressive symptoms while partialling out social anxiety symptoms, but not with social anxiety symptoms with depressive symptoms partialled out. The LPP amplitude elicited in both conditions showed marginally positive associations with social anxiety symptoms while partialling out depressive symptoms, but not with depressive symptoms while accounting for social anxiety. This study provides novel evidence concerning the ERP correlates of self-schematic processing in relation to social anxiety symptoms. More importantly, our findings for the first time speak to the differential associations between the behavioral SRET scores and SRET-elicited LPP and emerging symptoms of depression and social anxiety in late childhood.

Research on social attention in autism and the challenges of the research domain criteria (RDoC) framework

The fuzzy nature of categories of psychopathology, such as autism, leads to significant research challenges. Alternatively, focusing research on the study of a common set of important and well-defined psychological constructs across psychiatric conditions may make the fundamental etiological processes of psychopathology easier to discern and treat (Cuthbert, 2022). The development of the research domain criteria (RDoC) framework is designed to guide this new research approach (Insel et al., 2010). However, progress in research may be expected to continually refine and reorganize the understanding of the specifics of these mental processes (Cuthbert & Insel, 2013). Moreover, knowledge gleaned from the study of both normative and atypical development can be mutually informative in the evolution of our understanding of these fundamental processes. A case in point is the study of social attention. This Autism 101 commentary provides an educational summary of research over the last few decades indicates that social attention is major construct in the study of human social-cognitive development, autism and other forms of psychopathology. The commentary also describes how this research can inform the Social Process dimension of the RDoC framework.

Associations between the late positive potential and PTSD, anxiety, and depressive symptoms among trauma-exposed undergraduates

BACKGROUND

The late positive potential (LPP) is a neural marker of attention to emotional stimuli; dysregulations in those attentional processes might contribute to trauma-related psychopathology. Although higher LPP amplitudes to negative images have been found to be associated with anxiety symptoms, results have been mixed regarding depressive and PTSD symptoms, especially among trauma-exposed populations. Further, the relationships between the LPP to positive and neutral images and psychopathology symptoms have been underexamined. The purpose of the current study was to test the effects of image valence, and PTSD, anxiety, and depressive symptoms on LPP amplitude among trauma-exposed undergraduates.

METHOD

Seventy-three trauma-exposed undergraduates viewed a series of negative, positive, and neutral images while LPPs were recorded. Self-report measures were used to assess recent PTSD, anxiety, and depressive symptoms. Hierarchical linear modeling tested valence and symptom main effects, as well as Valence by Symptom interactions on LPP amplitude.

RESULTS

We found a main effect of valence such that individuals exhibited higher LPP amplitudes to negative images compared to neutral images. We also found a Valence by Depressive Symptoms interaction such that there was an inverse relationship between depressive symptoms and the LPP to neutral images but no associations between depressive symptoms and the LPP for positive or negative images. We found no main effects or interactions for anxiety and PTSD symptoms.

CONCLUSION

Depressive symptoms might be related to diminished attention to neutral stimuli among trauma-exposed undergraduates. Further investigation of the relationship between the LPP and psychopathology is needed.

I looked at you, you looked at me, I smiled at you, you smiled at me—The impact of eye contact on emotional mimicry

Eye contact is an essential element of human interaction and direct eye gaze has been shown to have effects on a range of attentional and cognitive processes. Specifically, direct eye contact evokes a positive affective reaction. As such, it has been proposed that obstructed eye contact reduces emotional mimicry (i.e., the imitation of our counterpart’s emotions). So far, emotional mimicry research has used averted-gaze faces or unnaturally covered eyes (with black censor bars) to analyze the effect of eye contact on emotional mimicry. However, averted gaze can also signal disinterest/ disengagement and censor bars obscure eye-adjacent areas as well and hence impede emotion recognition. In the present study (N = 44), we used a more ecological valid approach by showing photos of actors who expressed either happiness, sadness, anger, or disgust while either wearing mirroring sunglasses that obstruct eye contact or clear glasses. The glasses covered only the direct eye region but not the brows, nose ridge, and cheeks. Our results confirm that participants were equally accurate in recognizing the emotions of their counterparts in both conditions (sunglasses vs. glasses). Further, in line with our hypotheses, participants felt closer to the targets and mimicked affiliative emotions more intensely when their counterparts wore glasses instead of sunglasses. For antagonistic emotions, we found the opposite pattern: Disgust mimicry, which was interpreted as an affective reaction rather than genuine mimicry, could be only found in the sunglasses condition. It may be that obstructed eye contact increased the negative impression of disgusted facial expressions and hence the negative feelings disgust faces evoked. The present study provides further evidence for the notion that eye contact is an important prerequisite for emotional mimicry and hence for smooth and satisfying social interactions.

Dysfunctional temporal stages of eye-gaze perception in adults with ADHD: a high-density EEG study

ADHD has been associated with social cognitive impairments across the lifespan, but no studies have specifically addressed the presence of abnormalities in eye-gaze processing in the adult brain. This study investigated the neural basis of eye-gaze perception in adults with ADHD using event-related potentials (ERP). Twenty-three ADHD and 23 controls performed a delayed face-matching task with neutral faces that had either direct or averted gaze. ERPs were classified using microstate analyses. ADHD and controls displayed similar P100 and N170 microstates. ADHD was associated with cluster abnormalities in the attention-sensitive P200 to direct gaze, and in the N250 related to facial recognition. For direct gaze, source localization revealed reduced activity in ADHD for the P200 in the left/midline cerebellum, as well as in a cingulate-occipital network at the N250. These results suggest brain impairments involving eye-gaze decoding in adults with ADHD, suggestive of neural signatures associated with this disorder in adulthood.

Effects of Cognitive Reappraisal on Subjective and Neural Reactivity to Angry Faces in Children with Social Anxiety Disorder, Clinical Controls with Mixed Anxiety Disorders and Healthy Children

Cognitive models of social anxiety suggest that social anxiety disorder (SAD) is characterized by both enhanced emotional reactivity and deficits in emotion regulation. Emotional reactivity to socially threatening children's faces and their modulation through reappraisal were measured via subjective ratings and electrocortical responses in children (age 10-13) with SAD (n = 28), clinical controls with mixed anxiety disorders (n = 28), and healthy controls (n = 29). Children with SAD showed higher subjective reactivity to the images of angry children's faces while all children reported reduced reactivity in their subjective ratings following reappraisal. Reduced electrocortical reactivity after reappraisal was only evident in older children and boys and was unrelated to anxiety. The present study indicates that cognitive reappraisal may be beneficial in reducing subjective reactivity in children with anxiety disorders, while neural effects of reappraisal may emerge at older ages.

Direct feedback and social conformity promote behavioral change via mechanisms indexed by centroparietal positivity: Electrophysiological evidence from a role-swapping ultimatum game

Our behavior is shaped by multiple factors, including direct feedback (seeing the outcomes of our past actions) and social observation (in part, via a drive to conform to other peoples' behaviors). However, it remains unclear how these two processes are linked in the context of behavioral change. This is important to investigate, as behavioral change is associated with distinct neural correlates that reflect specific aspects of processing, such as information integration and rule updating. To clarify whether these processes characterize both direct learning and conformity, we elicited the two within the same task, using a role-swapping version of the Ultimatum Game-a fairness paradigm where subjects decide how to share a pot of money with other players-while electroencephalography (EEG) data were recorded. Behavioral results showed that subjects decided how to divide the pot based on both direct feedback (seeing whether their past proposals were accepted or rejected) and social observation (copying the splits that others just proposed). Converging EEG evidence revealed that increased centroparietal positivity (P2, P3b, and late positivity) indexed behavioral changes motivated by direct feedback and those motivated by drives to conform. However, exploratory analyses also suggest that these two motivating factors may also be dissociable, and that frontal midline theta oscillations may predict behavioral changes linked to direct feedback but not conformity. Overall, this study provides novel electrophysiological evidence regarding the different forms of behavioral change. These findings are also relevant for understanding the mechanisms of social information processing that underlie successful cooperation.

Neural Responses to Mandatory and Voluntary Donation Impact Charitable Giving Decisions: An Event-Related Potentials Study

The present study aimed to explore the influence of donation amounts on donation decisions in different donation contexts and to reveal the psychological mechanisms. Furthermore, we focused on how to enhance individuals' intention to donate voluntarily. We designed an experiment on donation decisions, employing event-related potentials (ERPs) to probe the effect of psychological mechanisms on donation decisions by detecting the neural basis of donation decision-making. Based on S-O-R (stimulus-organism-response) theory, we used donation contexts and donation amounts (stimuli) to induce psychological activity in the participants (organism) and then influence individual donation decision behaviors (response). Moreover, we applied psychological reactance (PR) theory to discuss the effect of donation context on decisions and the corresponding psychological process. The behavioral results showed that donation contexts (mandatory vs. voluntary) were significantly related to the donation amounts (i.e., less vs. more money that the charity received than money that the participants donated). At the ERP level, compared with mandatory donation, voluntary donation evoked a larger P2 amplitude when the charity received less money. In addition, a larger mean amplitude of LPP was elicited by voluntary donation compared to mandatory donation. This study provides practical implications for charity organizers to guide people to donate voluntarily.

The malfunction of domain-specific attentional process in social anxiety: attentional process of social and non-social stimuli

Socially anxious people have a malfunction in attentional systems. However, it is uncertain whether the malfunction of the attentional system is a domain-specific process to social stimuli or a domain-general process to non-social stimuli. Therefore, we investigated the effects of social anxiety on the domain specificity of the attentional process using a spatial Stroop paradigm. We conducted two identical experiments with a total of 153 university students including men and women (61 students in Experiment 1 and 92 students in Experiment 2), in which the levels of social anxiety were assessed using specific instruments. The results showed that social anxiety scores were negatively correlated with the reversed spatial Stroop effect for social stimuli, but not for non-social stimuli (Experiment 1). The findings of the first experiment were successfully replicated in Experiment 2. Our results suggested that the malfunction of the attentional system is a domain-specific process to socially threatening stimuli in socially anxious individuals.

Neural correlates of negative expectancy and impaired social feedback processing in social anxiety

Social anxiety has been associated with abnormalities in cognitive processing in the literature, manifesting as various cognitive biases. To what extent these biases interrupt social interactions remains largely unclear. This study used the Social Judgment Paradigm that could separate the expectation and experience stages of social feedback processing. Event-related potentials (ERPs) in these two stages were recorded to detect the effect of social anxiety that might not be reflected by behavioral data. Participants were divided into two groups according to their social anxiety level. Participants in the high social anxiety (HSA) group were more likely to predict that they would be socially rejected by peers than did their low social anxiety (LSA) counterparts (i.e. the control group). Compared to the ERP data of the LSA group, the HSA group showed: (a) a larger P1 component to social cues (peer faces) prior to social feedback presentation, possibly indicating an attention bias; (b) a difference in feedback-related negativity amplitude between unexpected social acceptance and unexpected social rejection, possibly indicating an expectancy bias; and (c) a diminished sensitivity of the P3 amplitude to social feedback valence (be accepted/be rejected), possibly indicating an experience bias. These results could help understand the cognitive mechanisms that comprise and maintain social anxiety.

Look at me: The relation between empathy and fixation on the emotional eye-region in low vs. high social anxiety

BACKGROUND AND OBJECTIVES

Fixation on another person's eye-region may be an effective measure of one's level of empathy. In the present study, we tested the hypothesis that this type of empathy measure may not be appropriate for individuals with high levels of social anxiety, since avoidance or hypervigilance attentional biases towards emotional faces are frequent in this condition.

METHODS

Using eye-tracking, we measured fixation time on the eye-region of another person in participants with low vs. high social anxiety, and we correlated this measure with empathy levels. In a second eye-tracking task, the two groups of participants were presented with pairs of emotional-neutral faces to determine the presence of attentional biases.

RESULTS

While participants with low social anxiety showed an association between empathy and fixation time on the other person's eyes, the association was null for participants with high social anxiety. Attentional biases towards emotional faces were absent in high social anxiety, but social anxiety correlated negatively with fixation on the eye region.

LIMITATIONS

Our sample was made up of Psychology undergraduates, and this may have had an influence on gaze behavior towards the eye region.

CONCLUSION

Fixation on the eye region is not a valid measure of empathy in high social anxiety, possibly due to systematic eye-region avoidance.

Effects of social information on duration perception by different mechanisms in sub- and supra-second range: Evidence from face features

Human faces convey abundant social information. The influence of social information on duration estimation was examined by comparing a cartoon face (CF; social) condition with geometric plane figures, or CFs with internal elements disturbed from their normal position (non-social) condition, and also by comparing a human portrait facing the front (more social interaction) condition with the portrait facing the back (less social interaction) condition. Results showed that in the supra-second range, both CFs and human portraits facing the front led to an underestimation compared with non-social or less social information conditions. In the sub-second range, only portraits facing the front were overestimated compared with those facing the back and with the CFs. These results suggest that in the millisecond range, the biological information conveyed by faces may lead to higher arousal, which may result in accelerated clock speed and overestimation. In the supra-second range, it is possible that attention was diverted by social information, resulting in duration underestimation. Taken together, our results suggest that the different mechanisms were involved in duration perception of social information conveyed by face feature in the sub- and supra-second range.

Social anxiety is related to impaired ability to filter out irrelevant information but not reduced storage capacity

Individuals with social anxiety have deficits in inhibiting task-irrelevant threatening information, but the mechanism is poorly understood. In this study, we instructed participants with high and low social anxiety to perform a variant change-detection task, recording their accuracy and electrophysiological data. The results indicated that individuals with high social anxiety showed impaired ability to filter out irrelevant information in disgust facial expression condition rather than neutral facial expression. While individuals with low social anxiety didn't show filter efficiency defects under both disgust and neutral facial expressions. Furthermore, we found high socially anxious individuals could hold more information in visual working memory than low socially anxious individuals. These results suggest that the abundance of cognitive resources in socially anxious individuals compensates the presumed weak performance in accuracy produced by impaired filter efficiency. These results provide support for the claims of efficiency and effectiveness in attentional control theory.

Feeling through another's eyes: Perceived gaze direction impacts ERP and behavioural measures of positive and negative affective empathy

Looking at the eyes informs us about the thoughts and emotions of those around us, and impacts our own emotional state. However, it is unknown how perceiving direct and averted gaze impacts our ability to share the gazer's positive and negative emotions, abilities referred to as positive and negative affective empathy. We presented 44 participants with contextual sentences describing positive, negative and neutral events happening to other people (e.g. "Her newborn was saved/killed/fed yesterday afternoon."). These were designed to elicit positive, negative, or little to no empathy, and were followed by direct or averted gaze images of the individuals described. Participants rated their affective empathy for the individual and their own emotional valence on each trial. Event-related potentials time-locked to face-onset and associated with empathy and emotional processing were recorded to investigate whether they were modulated by gaze direction. Relative to averted gaze, direct gaze was associated with increased positive valence in the positive and neutral conditions and with increased positive empathy ratings. A similar pattern was found at the neural level, using robust mass-univariate statistics. The N100, thought to reflect an automatic activation of emotion areas, was modulated by gaze in the affective empathy conditions, with opposite effect directions in positive and negative conditions.. The P200, an ERP component sensitive to positive stimuli, was modulated by gaze direction only in the positive empathy condition. Positive and negative trials were processed similarly at the early N200 processing stage, but later diverged, with only negative trials modulating the EPN, P300 and LPP components. These results suggest that positive and negative affective empathy are associated with distinct time-courses, and that perceived gaze direction uniquely modulates positive empathy, highlighting the importance of studying empathy with face stimuli.

Electrophysiological Correlates of Racial In-group Bias in Observing Nonverbal Social Encounters

Despite evidence identifying the role of group membership in social cognition, the neural mechanisms associated with the perception and evaluation of nonverbal behaviors displayed by in-group versus out-group members remain unclear. Here, 42 white participants underwent electroencephalographic recording while observing social encounters involving dynamic displays of nonverbal behaviors by racial in-group and out-group avatar characters. Dynamic behaviors included approach and avoidance poses and expressions, followed by the participants' ratings of the avatars displaying them. Behaviorally, participants showed longer RTs when evaluating in-group approach behavior compared with other behaviors, possibly suggesting increased interest and attention devoted to processing positive social encounters with their in-group members. Analyses of ERPs revealed differential sensitivity of the N450 and late positivity components to social cues, with the former showing initial sensitivity to the presence of a humanoid avatar character at the beginning of social encounters and the latter showing sensitivity to dynamic nonverbal behaviors displayed by the avatars. Moreover, time-frequency analysis of electroencephalography data also identified suppression of beta-range power linked to the observation of dynamic nonverbal behaviors. Notably, the magnitude of these responses was modulated by the degree of behavioral racial in-group bias. This suggests that differential neural sensitivity to nonverbal cues while observing social encounters is associated with subsequent in-group bias manifested in the evaluation of such encounters. Collectively, these findings shed light on the mechanisms of racial in-group bias in social cognition and have implications for understanding factors related to successful interactions with individuals from diverse racial backgrounds.

Perceived Gaze Direction Differentially Affects Discrimination of Facial Emotion, Attention, and Gender - An ERP Study

The perception of eye-gaze is thought to be a key component of our everyday social interactions. While the neural correlates of direct and averted gaze processing have been investigated, there is little consensus about how these gaze directions may be processed differently as a function of the task being performed. In a within-subject design, we examined how perception of direct and averted gaze affected performance on tasks requiring participants to use directly available facial cues to infer the individuals' emotional state (emotion discrimination), direction of attention (attention discrimination) and gender (gender discrimination). Neural activity was recorded throughout the three tasks using EEG, and ERPs time-locked to face onset were analyzed. Participants were most accurate at discriminating emotions with direct gaze faces, but most accurate at discriminating attention with averted gaze faces, while gender discrimination was not affected by gaze direction. At the neural level, direct and averted gaze elicited different patterns of activation depending on the task over frontal sites, from approximately 220-290 ms. More positive amplitudes were seen for direct than averted gaze in the emotion discrimination task. In contrast, more positive amplitudes were seen for averted gaze than for direct gaze in the gender discrimination task. These findings are among the first direct evidence that perceived gaze direction modulates neural activity differently depending on task demands, and that at the behavioral level, specific gaze directions functionally overlap with emotion and attention discrimination, precursors to more elaborated theory of mind processes.

Differential impact of trait, social, and attachment anxiety on the stare-in-the-crowd effect

Eye gaze conveys crucial information for social interactions, with straight versus averted gaze triggering distinct emotional and cognitive processes. The "stare-in-the-crowd" effect exemplifies such differential visual processing of gaze direction, in more recent reports also in interaction with head orientation. Besides aiming at replicating the "stare-in-the-crowd" effect by means of an eye gaze by head orientation interaction, the present study intended to for the first time testing its susceptibility to inter-individual differences in trait, social, and attachment anxiety. Our findings reveal a significant relation between the "stare-in-the-crowd" effect and social and attachment, but not trait anxiety, and therefore provide preliminary cues for personality influences on visual processing of eye gaze and head orientation.

Attention to faces and gaze-following in social anxiety: preliminary evidence from a naturalistic eye-tracking investigation

Social attentional biases are a core component of social anxiety disorder, but research has not yet determined their direction due to methodological limitations. Here we present preliminary findings from a novel, dynamic eye-tracking paradigm allowing spatial-temporal measurement of attention and gaze-following, a mechanism previously unexplored in social anxiety. 105 participants took part, with those high (N = 27) and low (N = 25) in social anxiety traits (HSA and LSA respectively) entered into the analyses. Participants watched a video of an emotionally-neutral social scene, where two actors periodically shifted their gaze towards the periphery. HSA participants looked more at the actors' faces during the initial 2s than the LSA group but there were no group differences in proportion of first fixations to the face or latency to first fixate the face, although HSA individuals' first fixations to the face were shorter. No further differences in eye movements were found, nor in gaze-following behaviour, although these null effects could potentially result from the relatively small sample. Findings suggest attention is biased towards faces in HSA individuals during initial scene inspection, but that overt gaze-following may be impervious to individual differences in social anxiety. Future research should seek to replicate these effects.

Early and late cortical responses to directly gazing faces are task dependent

Gender categorisation of human faces is facilitated when gaze is directed toward the observer (i.e., a direct gaze), compared with situations where gaze is averted or the eyes are closed (Macrae, Hood, Milne, Rowe, & Mason, Psychological Science, 13(5), 460-464, 2002). However, the temporal dynamics underlying this phenomenon remain to some extent unknown. Here, we used electroencephalography (EEG) to assess the neural correlates of this effect, focusing on the event-related potential (ERP) components known to be sensitive to gaze perception (i.e., P1, N170, and P3b). We first replicated the seminal findings of Macrae et al. (2002, Experiment 1) regarding facilitated gender discrimination, and subsequently measured the underlying neural responses. Our data revealed an early preferential processing of direct gaze as compared with averted gaze and closed eyes at the P1, which reverberated at the P3b (Experiment 2). Critically, using the same material, we failed to reproduce these effects when gender categorisation was not required (Experiment 3). Taken together, our data confirm that direct gaze enhances the early P1, as well as later cortical responses to face processing, although the effect appears to be task dependent.

Every look matters: appraisals of faces follow distinct rules of information integration under arousing versus non-arousing conditions

In this research, we investigated whether appraisals of faces follow distinct rules of information integration under arousing versus non-arousing conditions. Support for this prediction was found in four experiments in which participants observed angry (and fearful) faces that were presented with a direct versus an averted gaze (Experiments 1a, b), on a red versus a grey background (Experiment 2), and after performing a motor exercise versus no exercise (Experiment 3). Under arousing conditions, participants' appraisals of faces reflected summation (i.e. extremely negative encounters were strengthened by moderately negative encounters) whereas, under non-arousing conditions, appraisals did not reflect summation (i.e. extremely negative encounters were weakened by moderately negative encounters) and could instead be accounted for by three alternative rules of information integration based on averaging, mere exposure, or the number of strong stimuli.

Face-to-face: Perceived personal relevance amplifies face processing

The human face conveys emotional and social information, but it is not well understood how these two aspects influence face perception. In order to model a group situation, two faces displaying happy, neutral or angry expressions were presented. Importantly, faces were either facing the observer, or they were presented in profile view directed towards, or looking away from each other. In Experiment 1 (n = 64), face pairs were rated regarding perceived relevance, wish-to-interact, and displayed interactivity, as well as valence and arousal. All variables revealed main effects of facial expression (emotional > neutral), face orientation (facing observer > towards > away) and interactions showed that evaluation of emotional faces strongly varies with their orientation. Experiment 2 (n = 33) examined the temporal dynamics of perceptual-attentional processing of these face constellations with event-related potentials. Processing of emotional and neutral faces differed significantly in N170 amplitudes, early posterior negativity (EPN), and sustained positive potentials. Importantly, selective emotional face processing varied as a function of face orientation, indicating early emotion-specific (N170, EPN) and late threat-specific effects (LPP, sustained positivity). Taken together, perceived personal relevance to the observer-conveyed by facial expression and face direction-amplifies emotional face processing within triadic group situations.

Neural Temporal Dynamics of Social Exclusion Elicited by Averted Gaze: An Event-Related Potentials Study

Eye gaze plays a fundamental role in social communication. The averted eye gaze during social interaction, as the most common form of silent treatment, conveys a signal of social exclusion. In the present study, we examined the time course of brain response to social exclusion by using a modified version of Eye-gaze paradigm. The event-related potentials (ERPs) data and the subjective rating data showed that the frontocentral P200 was positively correlated with negative mood of excluded events, whereas, the centroparietal late positive potential (LPP) was positively correlated with the perceived ostracism intensity. Both the P200 and LPP were more positive-going for excluded events than for included events. These findings suggest that brain responses sensitive to social exclusion can be divided into the early affective processing stage, linking to the early pre-cognitive warning system; and the late higher-order processes stage, demanding attentional resources for elaborate stimuli evaluation and categorization generally not under specific situation.

Dysfunctional gaze processing in bipolar disorder

Gaze conveys emotional information, and humans present sensitivity to its direction from the earliest days of life. Bipolar disorder is a disease characterized by fluctuating states of emotional and cognitive dysregulation. To explore the role of attentional control on face processing in bipolar patients (BP) we used gaze direction as an emotion modulation parameter in a two-back Working Memory (WM) task while high-density EEG data were acquired. Since gaze direction influences emotional attributions to faces with neutral expressions as well, we presented neutral faces with direct and averted gaze. Nineteen euthymic BP and a sample of age- and gender-matched controls were examined.

In BP we observed diminished P200 and augmented P300 evoked responses, differentially modulated by non-repeated or repeated faces, as well as by gaze direction. BP showed a reduced P200 amplitude, significantly stronger for faces with direct gaze than averted gaze. Source localization of P200 indicated decreased activity in sensory-motor regions and frontal areas suggestive of abnormal affective processing of neutral faces.

The present study provides neurophysiological evidence for abnormal gaze processing in BP and suggests dysfunctional processing of direct eye contact as a prominent characteristic of bipolar disorder.

•

This ERP study identified abnormalities in gaze processing in bipolar patients.

•

We observed functional anomalies in the P200 and P300 evoked responses.

•

BP showed a strong suppression of the P200 for faces with direct gaze.

•

Source localization indicated decreased activity in sensory-motor regions.

The Impact of Top-Down Prediction on Emotional Face Processing in Social Anxiety

There is evidence that people with social anxiety show abnormal processing of emotional faces. To investigate the impact of top-down prediction on emotional face processing in social anxiety, brain responses of participants with high and low social anxiety (LSA) were recorded, while they performed a variation of the emotional task, using high temporal resolution event-related potential techniques. Behaviorally, we reported an effect of prediction with higher accuracy for predictable than unpredictable faces. Furthermore, we found that participants with high social anxiety (HSA), but not with LSA, recognized angry faces more accurately than happy faces. For the P100 and P200 components, HSA participants showed enhanced brain activity for angry faces compared to happy faces, suggesting a hypervigilance to angry faces. Importantly, HSA participants exhibited larger N170 amplitudes in the right hemisphere electrodes than LSA participants when they observed unpredictable angry faces, but not when the angry faces were predictable. This probably reflects the top-down prediction improving the deficiency at building a holistic face representation in HSA participants.

How does gaze direction affect facial processing in social anxiety? -An ERP study

Previous behavioral studies have demonstrated an effect of eye gaze direction on the processing of emotional expressions in adults with social anxiety. However, specific brain responses to the interaction between gaze direction and facial expressions in social anxiety remain unclear. The present study aimed to explore the time course of such interaction using event-related potentials (ERPs) in participants with social anxiety. High socially anxious individuals and low socially anxious individuals were asked to identify the gender of angry or neutral faces with direct or averted gaze while their behavioral performance and electrophysiological data were monitored. We found that identification of angry faces with direct but not averted gaze elicited larger N2 amplitude in high socially anxious individuals compared to low socially anxious individuals, while identification of neutral faces did not produce any gaze modulation effect. Moreover, the N2 was correlated with increased anxiety severity upon exposure to angry faces with direct gaze. Therefore, our results suggest that gaze direction modulates the processing of threatening faces in social anxiety. The N2 component elicited by angry faces with direct gaze could be a state-dependent biomarker of social anxiety and may be an important reference biomarker for social anxiety diagnosis and intervention.

Facing two faces: Defense activation varies as a function of personal relevance

It can be unsettling to be watched by a group of people, and when they express anger or hostility, this can prime defensive behavior. In contrast, when others smile at us, this may be comforting. This study tested to which degree the impact of facial expressions (happy, neutral, and angry) varies with the personal relevance of a social situation. Modelling a triadic situation, two faces looked either directly at the participant, faced each other, or they were back to back. Results confirmed that this variation constitutes a gradient of personal relevance (directed frontally > towards > away), as reflected by corresponding defensive startle modulation and autonomic nervous system activity. This gradient was particularly pronounced for angry faces and it was steeper in participants with higher levels of social anxiety. Thus, sender-recipient constellations modulate the processing of facial emotions in favor of adequate behavioral responding (e.g., avoidance) in group settings.

Direct gaze facilitates rapid orienting to faces: Evidence from express saccades and saccadic potentials

•

We investigated the role of direct gaze for rapid orienting to faces.

•

Faster express saccades towards faces occurred only when faces were with direct gaze.

•

Saccade-locked ERPs discriminated between gaze directions from the saccade onset.

Direct gaze is a crucial signal in human social communication, which is known to attract visual attention and modulate a wide range of behaviours. The present study investigated whether direct gaze facilitates rapid orienting to faces, which is important for adaptive on-line communication, and its neural correlates. Fifteen participants performed a rapid orienting task, in which they were instructed to saccade to peripherally presented buildings or faces containing direct or averted gaze as quickly as possible. Electroencephalographic recordings were made during the task. Shorter express saccade latencies were found for faces with direct gaze, compared to averted gaze or buildings, while no significant difference was found between faces with averted gaze and buildings. Furthermore, saccade-locked event-related potential (ERP) amplitudes in parieto-occipital areas discriminated faces with direct gaze from buildings and faces with averted gaze corroborating behavioural results. These results show that detection of direct gaze facilitates rapid orienting to faces.

Attentional mechanisms of social perception are biased in social phobia

Previous studies of social phobia have reported an increased vigilance to social threat cues but also an avoidance of socially relevant stimuli such as eye gaze. The primary aim of this study was to examine attentional mechanisms relevant for perceiving social cues by means of abnormalities in scanning of facial features in patients with social phobia. In two novel experimental paradigms, patients with social phobia and healthy controls matched on age, gender and education were compared regarding their gazing behavior towards facial cues. The first experiment was an emotion classification paradigm which allowed for differentiating reflexive attentional shifts from sustained attention towards diagnostically relevant facial features. In the second experiment, attentional orienting by gaze direction was assessed in a gaze-cueing paradigm in which non-predictive gaze cues shifted attention towards or away from subsequently presented targets. We found that patients as compared to controls reflexively oriented their attention more frequently towards the eyes of emotional faces in the emotion classification paradigm. This initial hypervigilance for the eye region was observed at very early attentional stages when faces were presented for 150ms, and persisted when facial stimuli were shown for 3s. Moreover, a delayed attentional orienting into the direction of eye gaze was observed in individuals with social phobia suggesting a differential time course of eye gaze processing in patients and controls. Our findings suggest that basic mechanisms of early attentional exploration of social cues are biased in social phobia and might contribute to the development and maintenance of the disorder.

Overestimation of the Subjective Experience of Time in Social Anxiety: Effects of Facial Expression, Gaze Direction, and Time Course

It is known that threatening stimuli increase emotional arousal, resulting in overestimating the subjective experience of passing time. Moreover, facial expressions and gaze direction interact to create socially threatening situations in people with social anxiety. The present study investigated the effect of social anxiety on the perceived duration of observing emotional faces with a direct or an averted gaze. Participants were divided into high, medium and low social anxiety groups based on social anxiety inventory scores. Participants then performed a temporal bisection task. Participants with high social anxiety provided larger overestimates for neutral faces with an averted gaze than those with low social anxiety in the second half of the task, whereas these differences were not found for angry face with direct and averted gaze. These results suggest that people with social anxiety perceive the duration of threatening situations as being longer than true durations based on objectively measured time.

Eyes Wide Open

Research from evolutionary psychology suggests that the mere presence of eye images can promote prosocial behavior. However, the “eye images effect” is a source of considerable debate, and findings across studies have yielded somewhat inconsistent support. We suggest that one critical factor may be whether the eyes really need to be watching to effectively enhance prosocial behavior. In three experiments, we investigated the impact of eye images on prosocial behavior, assessed in a laboratory setting. Participants were randomly assigned to view an image of watching eyes (eyes with direct gaze), an image of nonwatching eyes (i.e., eyes closed for Study 1 and averted eyes for Studies 2 and 3), or an image of flowers (control condition). Upon exposure to the stimuli, participants decided whether or not to help another participant by completing a dull cognitive task. Three independent studies produced somewhat mixed results. However, combined analysis of all three studies, with a total of 612 participants, showed that the watching component of the eyes is important for decision-making in this context. Images of watching eyes led to significantly greater inclination to offer help as compared to images of nonwatching eyes (i.e., eyes closed and averted eyes) or images of flowers. These findings suggest that eyes gazing at an individual, rather than any proxy to social presence (e.g., just the eyes), serve as a reminder of reputation. Taken together, we conclude that it is “eyes that pay attention” that can lift the veil of anonymity and potentially facilitate prosocial behavior.

The temporal unfolding of face processing in social anxiety disorder--a MEG study

The current study is the first to use magnetoencephalography (MEG) to examine how individuals with social anxiety disorder (SAD) process emotional facial expressions (EFEs). We expected that, compared to healthy controls (HCs), participants with SAD will show an early (<200 ms post-stimulus) over-activation in the insula and the fusiform gyrus (FG, associated with the N170/M170 component), and later (>200 ms post-stimulus) over-activation in the dorsolateral prefrontal cortex (DLPFC). Individuals with SAD (n = 12) and healthy controls (HCs, n = 12) were presented with photographs of facial displays during MEG recording. As compared to the HC group, the SAD group showed a reduced M170 (right FG under-activation around 130–200 ms); early reduced activation in the right insula, and lower insular sensitivity to the type of EFE displayed. In addition, the SAD group showed a late over-activation in the right DLPFC. This unique EFE processing pattern in SAD suggests an early under-activation of cortical areas, possibly related to reduced emphasis on high spatial frequency information and greater early emphasis on low spatial frequency information. The late DLPFC over-activation in the SAD group may correlate to failures of cognitive control in this disorder. The importance of a temporal perspective for the understanding of facial processing in psychopathology is underlined.

•

This study is the first to use MEG to study social anxiety disorder (SAD).

•

SADs and controls viewed emotional facial expressions during MEG.

•

Compared to controls, SADs showed reduced M170 (early fusiform gyrus activity).

•

SADs presented a late over-activation in the right dorsolateral prefrontal cortex.

•

The late frontal over-activity may correlate to failures of cognitive control in SAD.

More than a face: a unified theoretical perspective on nonverbal social cue processing in social anxiety

Processing of nonverbal social cues (NVSCs) is essential to interpersonal functioning and is particularly relevant to models of social anxiety. This article provides a review of the literature on NVSC processing from the perspective of social rank and affiliation biobehavioral systems (ABSs), based on functional analysis of human sociality. We examine the potential of this framework for integrating cognitive, interpersonal, and evolutionary accounts of social anxiety. We argue that NVSCs are uniquely suited to rapid and effective conveyance of emotional, motivational, and trait information and that various channels are differentially effective in transmitting such information. First, we review studies on perception of NVSCs through face, voice, and body. We begin with studies that utilized information processing or imaging paradigms to assess NVSC perception. This research demonstrated that social anxiety is associated with biased attention to, and interpretation of, emotional facial expressions (EFEs) and emotional prosody. Findings regarding body and posture remain scarce. Next, we review studies on NVSC expression, which pinpointed links between social anxiety and disturbances in eye gaze, facial expressivity, and vocal properties of spontaneous and planned speech. Again, links between social anxiety and posture were understudied. Although cognitive, interpersonal, and evolutionary theories have described different pathways to social anxiety, all three models focus on interrelations among cognition, subjective experience, and social behavior. NVSC processing and production comprise the juncture where these theories intersect. In light of the conceptualizations emerging from the review, we highlight several directions for future research including focus on NVSCs as indexing reactions to changes in belongingness and social rank, the moderating role of gender, and the therapeutic opportunities offered by embodied cognition to treat social anxiety.

Gaze perception in social anxiety and social anxiety disorder

Clinical observations suggest abnormal gaze perception to be an important indicator of social anxiety disorder (SAD). Experimental research has yet paid relatively little attention to the study of gaze perception in SAD. In this article we first discuss gaze perception in healthy human beings before reviewing self-referential and threat-related biases of gaze perception in clinical and non-clinical socially anxious samples. Relative to controls, socially anxious individuals exhibit an enhanced self-directed perception of gaze directions and demonstrate a pronounced fear of direct eye contact, though findings are less consistent regarding the avoidance of mutual gaze in SAD. Prospects for future research and clinical implications are discussed.

Ein Video-Set zur experimentellen Untersuchung von Emotionen bei sozialen Interaktionen: Validierung und erste Daten zu neuronalen Effekten

Soziale Interaktionen sind vielschichtig und stellen häufige Auslöser für positive aber auch negative Emotionen im Alltag dar. Viele Psychopathologien sind zudem von gestörter Sozialinteraktion gekennzeichnet. Laborexperimentelle Ansätze, welche neurowissenschaftliche Untersuchungen ermöglichen, verwenden häufig Bilder von emotionalen Gesichtern, die präzise Präsentationsbedingungen ermöglichen und die interne Validität solcher Experimente maximieren. Allerdings wird dadurch die Reichhaltigkeit sozialer Interaktion und damit auch die externe Validität reduziert. In der vorliegenden Studie wird ein Kompromiss zwischen interner und externer Validität bei der Untersuchung sozialer Interaktion gesucht. Wir stellen das Video-Set «E.Vids» vor, in dem zehn Darsteller jeweils acht kurze, auf den Betrachter bezogene positive und negative sowie neutrale Aussagen machen (240 Videos). In einer Internet-basierten Validierungsstudie (N = 310) wurden die Videos sowohl auf dimensionalen (Valenz, Arousal) als auch auf diskreten Emotionskategorien untersucht. Es zeigte sich eine klare Unterscheidung der Aussagekategorien in Bezug auf Valenz und Arousal. Spezifisch wurden sozialrelevante emotionsbezogene Zustände wie Stolz, Anerkennung, Ablehnung und Peinlichkeit sowie Grundemotionen wie Ärger und Freude ausgelöst. Eine EEG-Studie (N = 23) zeigte negativere rechts-frontotemporale langsame Potentiale für die negativen Sätze im Vergleich zu neutralen Sätzen. E.Vids könnte die verhaltensbasierte und neurowissenschaftliche Erforschung sozialer Interaktion im deutschsprachigen Raum bereichern und zur Untersuchung sozialrelevanter emotionaler Defizite bei verschiedenen psychischen Störungen beitragen.