Attention orienting by gaze and facial expressions across development

The emotion of sound target modulates the auditory gaze cueing effect

The auditory gaze cueing effect (auditory-GCE) is a faster response to auditory targets at an eye-gaze cue location than at a non-cue location. Previous research has found that auditory-GCE can be influenced by the integration of both gaze direction and emotion conveyed through facial expressions. However, it is unclear whether the emotional information of auditory targets can be cross-modally integrated with gaze direction to affect auditory-GCE. Here, we set neutral faces with different gaze directions as cues and three emotional sounds (fearful, happy, and neutral) as targets to investigate how the emotion of sound target modulates the auditory-GCE. Moreover, we conducted a controlled experiment using arrow cues. The results show that the emotional content of sound targets influences the auditory-GCE but only for those induced by facial cues. Specifically, fearful sounds elicit a significantly larger auditory-GCE compared to happy and neutral sounds, indicating that the emotional content of auditory targets plays a modulating role in the auditory-GCE. Furthermore, this modulation appears to occur only at a higher level of social meaning, involving the integration of emotional information from a sound with social gaze direction, rather than at a lower level, which involves the integration of direction and auditory emotion.

No Influence of Emotional Faces or Autistic Traits on Gaze-Cueing in General Population

The present study addressed the controversial issue of whether autistic traits in the general population are associated with the automatic and fundamental aspects of joint attention through eye gaze. Specifically, we examined whether the degree of autistic traits is associated with the magnitude of reflexive attention orienting in the direction of another's eye gaze embedded in neutral and emotional (angry, fearful, and happy) faces. The cue stimuli changed gaze direction and facial expressions simultaneously. Participants were asked to detect a target that appeared at the left or right of the cue stimuli. The results revealed a robust gaze-cueing effect, such that the reaction time to the target was shorter under the gazed-at-target condition than under the non-gazed-at-target condition. However, emotional expressions did not modulate the gaze-cueing effect. Furthermore, individual differences in autistic traits and emotional characteristics (social anxiety, alexithymia, and emotional disturbances) did not influence the magnitude of the gaze-cueing effect. Although the ability to orient attention in the direction of another's gaze is a fundamental function of social development, the gaze-cueing effect measured in a controlled experiment might not be an elaborate representation of the current social cognitive function, at least in typically developing adults.

Effects of facial expression and gaze interaction on brain dynamics during a working memory task in preschool children

Executive functioning in preschool children is important for building social relationships during the early stages of development. We investigated the brain dynamics of preschool children during an attention-shifting task involving congruent and incongruent gaze directions in emotional facial expressions (neutral, angry, and happy faces). Ignoring distracting stimuli (gaze direction and expression), participants (17 preschool children and 17 young adults) were required to detect and memorize the location (left or right) of a target symbol as a simple working memory task (i.e., no general priming paradigm in which a target appears after a cue stimulus). For the preschool children, the frontal late positive response and the central and parietal P3 responses increased for angry faces. In addition, a parietal midline α (Pmα) power to change attention levels decreased mainly during the encoding of a target for angry faces, possibly causing an association of no congruency effect on reaction times (i.e., no faster response in the congruent than incongruent gaze condition). For the adults, parietal P3 response and frontal midline θ (Fmθ) power increased mainly during the encoding period for incongruent gaze shifts in happy faces. The Pmα power for happy faces decreased for incongruent gaze during the encoding period and increased for congruent gaze during the first retention period. These results suggest that adults can quickly shift attention to a target in happy faces, sufficiently allocating attentional resources to ignore incongruent gazes and detect a target, which can attenuate a congruency effect on reaction times. By contrast, possibly because of underdeveloped brain activity, preschool children did not show the happy face superiority effect and they may be more responsive to angry faces. These observations imply a crucial key point to build better relationships between developing preschoolers and their parents and educators, incorporating nonverbal communication into social and emotional learning.

Reflective Functioning in Children and Adolescents With and Without an Anxiety Disorder

Reflective functioning (RF), meaning the capacity to interpret mental states (intentions, emotions, thoughts, desires, and beliefs) underlying one’s own and others’ behaviors, may help understand the dysfunctional self-regulation associated with anxiety disorders. However, research on anxiety and RF in clinical samples is scarce. This study aimed to assess whether mothers’ and youths’ RF was associated with youths’ (a) anxiety disorders and symptoms and (b) internalizing symptoms. Another goal was to explore whether RF predicted anxiety and internalizing symptoms beyond the more commonly established effect of attachment. Canadian children and adolescents aged between 8 and 16years, and their mothers were recruited in an outpatient psychiatric clinic (clinical group with a diagnosed anxiety disorder, n=30, mean age=11.5±2.8years) and in the general population (non-clinical group, n=23, mean age=11.5±2.1years). The Child Attachment Interview was used to assess youths’ attachment along with three dimensions of RF (global, regarding self, regarding others). Mothers’ attachment and RF were assessed with the Adult Attachment Interview. Children’s and adolescents’ anxiety and internalizing symptoms were measured with the Behavior Assessment Scale for Children, second version. The clinical and non-clinical groups did not differ in mothers’ or youths’ RF. However, in the overall sample, youths’ RF regarding themselves and maternal attachment preoccupation were associated with internalizing symptoms. Sequential regression analyses revealed that higher RF regarding self predicted a higher level of self-reported internalizing symptoms, beyond the effect of maternal attachment (β=0.43, p<0.05). This study’s finding suggests that clinically anxious children and adolescents have adequate RF. We propose that the sustained hypervigilance and apprehension associated with anxiety make anxious youths sensitive to their own and others’ mental states. Our findings suggest that psychotherapeutic treatments for anxiety should make use of patients’ RF abilities to help them make sense of their symptoms and thus reduce them.

Orienting of covert attention by neutral and emotional gaze cues appears to be unaffected by mild to moderate amblyopia

Amblyopia is a developmental disorder of vision associated with higher-order visual attention deficits. We explored whether amblyopia affects the orienting of covert spatial attention by measuring the magnitude of the gaze cueing effect from emotional faces. Gaze and emotion cues are key components of social attention. Participants with normal vision (n = 30), anisometropic (n = 7) or strabismic/mixed (n = 5) amblyopia performed a cued peripheral target detection task under monocular and binocular viewing conditions. The cue consisted of a centrally presented face with left or right gaze (50% validity to target location) and a fearful, happy, or neutral expression. The magnitude of spatial cueing was computed as the reaction time difference between congruent and incongruent trials for each expression. Fearful facial expressions oriented spatial attention significantly more than happy or neutral expressions. The magnitude of the gaze cueing effect in our cohort of mild-to-moderate amblyopia was comparable to that in normal vision and was not correlated with the severity of amblyopia. There were no statistical group or amblyopia subtype differences for reaction time in any viewing condition. These results place constraints on the range of attentional mechanisms affected by amblyopia and possibly suggest normal covert processing of emotional face stimuli in mild and moderate amblyopia.

Dynamic emotional messages differentially affect 6-month-old infants' attention to eyes and gaze cues

Infants often experience interactions in which caregivers use dynamic messages to convey their affective and communicative intent. These dynamic emotional messages may shape the development of emotion discrimination skills and shared attention by influencing infants' attention to internal facial features and their responses to eye gaze cues. However, past research examining infants' responses to emotional faces has predominantly focused on classic, stereotyped expressions (e.g., happy, sad, angry) that may not reflect the variability that infants experience in their daily interactions. The present study therefore examined forty-two 6-month-old infants' attention to eyes vs. mouth and gaze cueing responses across multiple dynamic emotional messages that are common to infant-directed interactions. Overall, infants looked more to the eyes during messages with negative affect, but this increased attention to the eyes during these message conditions did not directly facilitate gaze cueing. Infants instead showed reliable gaze cueing only after messages with positive and neutral affect. We additionally observed gender differences in infants' attention to internal face features and subsequent gaze cueing responses. Female infants spent more time looking at the eyes during the dynamic emotional messages and showed increased initial orienting and longer looking to gaze-cued objects following positive messages, whereas male infants showed these gaze cueing effects following neutral messages. These results suggest that variability in caregivers' communication can shape infants' attention to and processing of emotion and gaze information.

Does gaze direction of fearful faces facilitate the processing of threat? An ERP study of spatial precuing effects

Eye gaze is very important for attentional orienting in social life. By adopting the event-related potential (ERP) technique, we explored whether attentional orienting of eye gaze is modulated by emotional congruency between facial expressions and the targets in a spatial cuing task. Faces with different emotional expressions (fearful/angry/happy/neutral) directing their eye gaze to the left or right were used as cues, indicating the possible location of subsequent targets. Targets were line drawings of animals, which could be either threatening or neutral. Participants indicated by choice responses whether the animal would fit inside a shoebox in real life or not. Reaction times to targets were faster after valid compared with invalid cues, showing the typical eye gaze cuing effect. Analyses of the late positive potential (LPP) elicited by targets revealed a significant modulation of the gaze cuing effect by emotional congruency. Threatening targets elicited larger LPPs when validly cued by gaze in faces with negative (fearful and angry) expressions. Similarly, neutral targets showed larger LPPs when validly cued by faces with neutral expressions. Such effects were not present after happy face cues. Source localization in the LPP time window revealed that for threatening targets, the activity of right medial frontal gyrus could be related to a larger gaze-orienting effect for the fearful than the angry condition. Our findings provide electrophysiological evidence for the modulation of gaze cuing effects by emotional congruency.

Age-related Differences in Expression Recognition of Faces with Direct and Averted Gaze Using Dynamic Stimuli

Background: It is still an open to what extent the ecological validity of face stimuli modulates age-related differences in the recognition of facial expression; and to what extent eye gaze direction may play a role in this process. The present study tested whether age effects in facial expression recognition, also as a function of eye gaze direction, would be less pronounced in dynamic than static face displays.Method: Healthy younger and older adults were asked to recognize emotional expressions of faces with direct or averted eye gaze presented in static and dynamic format.Results: While there were no differences between the age groups in facial expression recognition ability across emotions, when considering individual expressions, age-related differences in the recognition of angry facial expressions were attenuated for dynamic compared to static stimuli.Conclusion: Our findings suggest a moderation effect of dynamic vs. static stimulus format on age-related deficits in the identification of angry facial expressions, suggesting that older adults may be less disadvantaged when recognizing angry facial expressions in more naturalistic displays. Eye gaze direction did not further modulate this effect. Findings from this study qualify and extend previous research and theory on age-related differences in facial expression recognition and have practical impact on study design by supporting the use of dynamic faces in aging research.

The Gaze Cueing Effect and Its Enhancement by Facial Expressions Are Impacted by Task Demands: Direct Comparison of Target Localization and Discrimination Tasks

The gaze cueing effect is characterized by faster attentional orienting to a gazed-at than a non-gazed-at target. This effect is often enhanced when the gazing face bears an emotional expression, though this finding is modulated by a number of factors. Here, we tested whether the type of task performed might be one such modulating factor. Target localization and target discrimination tasks are the two most commonly used gaze cueing tasks, and they arguably differ in cognitive resources, which could impact how emotional expression and gaze cues are integrated to orient attention. In a within-subjects design, participants performed both target localization and discrimination gaze cueing tasks with neutral, happy, and fearful faces. The gaze cueing effect for neutral faces was greatly reduced in the discrimination task relative to the localization task, and the emotional enhancement of the gaze cueing effect was only present in the localization task and only when this task was performed first. These results suggest that cognitive resources are needed for gaze cueing and for the integration of emotional expressions and gaze cues. We propose that a shift toward local processing may be the mechanism by which the discrimination task interferes with the emotional modulation of gaze cueing. The results support the idea that gaze cueing can be greatly modulated by top-down influences and cognitive resources and thus taps into endogenous attention. Results are discussed within the context of the recently proposed EyeTune model of social attention.

Neurocognitive Mechanisms Underlying Social Atypicalities in Autism: Weak Amygdala's Emotional Modulation Hypothesis

Autism spectrum disorder (ASD) is a neurodevelopmental condition associated with atypicalities in social interaction. Although psychological and neuroimaging studies have revealed divergent impairments in psychological processes (e.g., emotion and perception) and neural activity (e.g., amygdala, superior temporal sulcus, and inferior frontal gyrus) related to the processing of social stimuli, it remains difficult to integrate these findings. In an effort to resolve this issue, we review our psychological and functional magnetic resonance imaging (fMRI) findings and present a hypothetical neurocognitive model. Our psychological study showed that emotional modulation of reflexive joint attention is impaired in individuals with ASD. Our fMRI study showed that modulation from the amygdala to the neocortex during observation of dynamic facial expressions is reduced in the ASD group. Based on these findings and other evidence, we hypothesize that weak modulation from the amygdala to the neocortex-through which emotion rapidly modulates various types of perceptual, cognitive, and motor processing functions-underlies the social atypicalities in individuals with ASD.

Emotion first: children prioritize emotional faces in gaze-cued attentional orienting

Children shift their attention based on the gaze direction of another person but it is unclear whether they prioritize only the gaze of fearful faces over neutral ones or more generally, the gaze of emotional faces. School children performed a gaze-cueing task, in which central, non-predictive happy, angry, and neutral face-cues were briefly presented with averted gaze. Findings for 9-10-year-old children showed that the magnitude of gaze-cueing effects for happy and angry face-cues was similar and it was particularly larger with angry compared to neutral face-cues. In contrast, 6-7-year-old children showed gaze-cueing effects only with happy face-cues. The present findings clearly indicate that older children show emotion-enhanced gaze-cueing effects. In contrast, younger children did not show gaze-cueing effects with neutral and angry faces but they did with happy faces. The implications of age differences in the ability to prioritize emotional faces when shifting attention based on the observed gaze direction of a non-predictive face-cue are discussed in the context of the extant literature.

Environmental Learning of Social Cues: Evidence From Enhanced Gaze Cueing in Deaf Children

The susceptibility to gaze cueing in deaf children aged 7-14 years old (N = 16) was tested using a nonlinguistic task. Participants performed a peripheral shape-discrimination task, whereas uninformative central gaze cues validly or invalidly cued the location of the target. To assess the role of sign language experience and bilingualism in deaf participants, three groups of age-matched hearing children were recruited: bimodal bilinguals (vocal and sign-language, N = 19), unimodal bilinguals (two vocal languages, N = 17), and monolinguals (N = 14). Although all groups showed a gaze-cueing effect and were faster to respond to validly than invalidly cued targets, this effect was twice as large in deaf participants. This result shows that atypical sensory experience can tune the saliency of a fundamental social cue.

Abnormal alpha modulation in response to human eye gaze predicts inattention severity in children with ADHD

•

In response to the human eye gaze, compared with TD children, ADHD children showed a decreased alpha lateralization.

•

The attenuation of alpha modulation in ADHD children was mainly manifested in the left hemisphere.

•

The left hemisphere alpha modulation predicted higher inattentive severity and lower behavioural accuracy in ADHD children.

•

Classification analysis showed the left alpha modulation has a high capability to recognize ADHD from TD children.

Attention-deficit/hyperactivity disorder (ADHD) is characterized by problems in directing and sustaining attention. Recent behavioral studies indicated that children with ADHD are more likely to fail to show the orienting effect in response to human eye gaze. The present study aimed to identify the neurophysiological bases of attention deficits directed by social human eye gaze in children with ADHD, focusing on the relationship between alpha modulations and ADHD symptoms. The electroencephalography data were recorded from 8–13-year-old children (typically developing (TD): n = 24; ADHD: n = 21) while they performed a cued visuospatial covert attention task. The cues were designed as human eyes that might gaze to the left or right visual field. The results revealed that TD children showed a significant alpha lateralization in response to the gaze of human eyes, whereas children with ADHD showed an inverse pattern of alpha modulation in the left parieto-occipital area. Importantly, the abnormal alpha modulation in the left hemisphere predicted inattentive symptom severity and behavioral accuracy in children with ADHD. These results suggest that the dysfunction of alpha modulation in the left hemisphere in response to social cues might be a potential neurophysiologic marker of attention deficit in children with ADHD.

Spontaneous eye-movements in neutral and emotional gaze-cuing: An eye-tracking investigation

Our attention is spontaneously oriented in the direction where others are looking. This attention shift manifests as faster responses to peripheral targets when they are gazed at by a central face instead of gazed away from, and this effect is even more pronounced when the face expresses an emotion. This so called gaze-cuing effect, and its enhancement by emotion, is thought to reflect covert attention orienting. However, eye movements are typically not monitored in gaze-cuing paradigms, yet free viewing and saccadic reaction time research suggests individuals commonly and quickly look at gazed-at locations. Furthermore, in dynamic gaze-cuing studies, emotional faces differ from neutral faces in their affective content but also in their apparent facial motion, both of which could affect participants' eye-movements. We investigated the contribution of overt orienting to the gaze-cuing effect by monitoring eye-movements during emotional and neutral gaze-cuing trials. We found that eye-movements were infrequent, and when they occurred, they were directed toward the target, not toward the gazed-at location. Removing trials with eye-movements did not affect gaze-cuing much, confirming it reflects a covert attention process. However, participants were more likely to move their eyes during neutral trials, which lacked perceived face movement, than during emotion trials or neutral movement trials. Including these eye-movement contaminated trials in our analysis resulted in an impaired ability to detect the gaze-cuing variations with emotion. In contrast, removing trials with eye-movements, or including a neutral movement control such as a neutral tongue protrusion, revealed more subtle emotional modulation of gaze-cuing.

Large lateralized EDAN-like brain potentials in a gaze-shift detection task

Attentional cueing tasks using gaze direction as spatial cues have sometimes yielded an early directing attention negativity (EDAN) component in the ERP, presumably reflecting the initial orienting toward the cued location. However, other studies have failed to identify an EDAN component for gaze cues, yielding an inconsistent picture. In the present study, we re-examined the EDAN to gaze cueing, using a continuous task where the specific direction of the gaze changes was task irrelevant. Face stimuli changed gaze direction several times during each trial between direct, left-, and right-averted positions. Participants counted the number of gaze shifts during the trial. Results showed an unusually large EDAN-like ERP asymmetry at posterior scalp sites that was of similar amplitude for large and small gaze shifts into the periphery. Shifts from an averted position toward a direct gaze elicited a qualitatively similar but smaller effect than shifts into the periphery. Together, these findings shed new light on gaze-elicited spatial attention as they indicate a reflexive attention orienting, following the direction of gaze motion, even when the gaze direction itself is irrelevant for the task.

Rapid saccadic response with fearful gaze cue

It has been shown that an averted gaze with emotional expression guides our attention toward a gazed-at location, and the effect of a gaze with fearful expression has been well-investigated. However, the findings are not consistent, and most studies used the manual response measure. Recent studies suggest that examining eye movements is more suitable to capture the early stage of the effect of threat-related stimuli on attentional process. Therefore, in the present study, we investigated the effects of static neutral and fearful gaze on overt attention orienting by examining the saccadic responses in an unselected sample of people. Our results found the gaze congruency effects for both expressions, and importantly, enhanced attention orienting by fearful gaze at a short stimulus onset asynchrony (SOA): participants looked faster at the fearful gaze-cued target than the neutral gaze-cued one at the 300 ms SOA. These findings provide the first evidence that fearful averted gaze elicits rapid overt attention orienting toward the target, and suggest that the information of gaze direction and emotional expression are rapidly integrated and modulate the oculomotor system.

Controlling attention to gaze and arrows in attention deficit hyperactivity disorder

The aim of this research was to assess implicit processing of social and non-social distracting cues in children with ADHD. Young people with ADHD and matched controls were asked to classify target words (LEFT/RIGHT) which were accompanied by a distracter eye-gaze or arrow. Typically developing participants showed evidence of interference effects from both eye-gaze and arrow distracters. In contrast, the ADHD group showed evidence of interference effects from arrow but failed to show interference from eye-gaze. This absence of interference effects from eye-gaze observed in the participants with ADHD may reflect an attentional impairment in attending to socially relevant information.

The effect of acute social stress on the recognition of facial expression of emotions

This study investigates the effect of acute social stress on the recognition of facial expression of emotions in healthy young men. Participants underwent both a standardized psychosocial laboratory stressor (TSST-G) and a control condition. Then, they performed a homemade version of the facial expressions megamix. All six basic emotions were included in the task. First, our results show a systematic increase in the intensity threshold for disgust following stress, meaning that the participants' performance with this emotion was impaired. We suggest that this may reflect an adaptive coping mechanism where participants attempt to decrease their anxiety and protect themselves from a socio-evaluative threat. Second, our results show a systematic decrease in the intensity threshold for surprise, therefore positively affecting the participants' performance with that emotion. We suggest that the enhanced perception of surprise following the induction of social stress may be interpreted as an evolutionary adaptation, wherein being in a stressful environment increases the benefits of monitoring signals indicating the presence of a novel or threatening event. An alternative explanation may derive from the opposite nature of the facial expressions of disgust and surprise; the decreased recognition of disgust could therefore have fostered the propensity to perceive surprise.

The developmental trajectory of attentional orienting to socio-biological cues

It has been proposed that the orienting of attention in the same direction as another’s point of gaze relies on innate brain mechanisms which are present from birth, but direct evidence relating to the influence of eye gaze cues on attentional orienting in young children is limited. In two experiments, 137 children aged 3–10 years old performed an adapted pro-saccade task with centrally presented uninformative eye gaze, finger pointing and arrow pre-cues which were either congruent or incongruent with the direction of target presentations. When the central cue overlapped with presentation of the peripheral target (Experiment 1), children up to 5 years old had difficulty disengaging fixation from central fixation in order to saccade to the target. This effect was found to be particularly marked for eye gaze cues. When central cues were extinguished simultaneously with peripheral target onset (Experiment 2), this effect was greatly reduced. In both experiments finger pointing cues (image of pointing index finger presented at fixation) exerted a strong influence on saccade reaction time to the peripheral stimulus for the youngest group of children (<5 years). Overall the results suggest that although young children are strongly engaged by centrally presented eye gaze cues, the directional influence of such cues on overt attentional orienting is only present in older children, meaning that the effect is unlikely to be dependent upon an innate brain module. Instead, the results are consistent with the existence of stimulus–response associations which develop with age and environmental experience.

EMOTIONAL MODULATION OF ATTENTION ORIENTING BY GAZE VARIES WITH DYNAMIC CUE SEQUENCE

Recent gaze cueing studies using dynamic cue sequences have reported increased attention orienting by gaze with faces expressing fear, surprise or anger. Here, we investigated whether the type of dynamic cue sequence used impacted the magnitude of this effect. When the emotion was expressed before or concurrently with gaze shift, no modulation of gaze-oriented attention by emotion was seen. In contrast, when the face cue averted gaze before expressing an emotion (as if reacting to the object after first localizing it), the gaze orienting effect was clearly increased for fearful, surprised and angry faces compared to neutral faces. Thus, the type of dynamic sequence used, and in particular the order in which the gaze shift and the facial expression are presented, modulate gaze-oriented attention, with maximal modulation seen when the expression of emotion follows gaze shift.

Gaze cuing of attention in snake phobic women: the influence of facial expression

Only a few studies investigated whether animal phobics exhibit attentional biases in contexts where no phobic stimuli are present. Among these, recent studies provided evidence for a bias toward facial expressions of fear and disgust in animal phobics. Such findings may be due to the fact that these expressions could signal the presence of a phobic object in the surroundings. To test this hypothesis and further investigate attentional biases for emotional faces in animal phobics, we conducted an experiment using a gaze-cuing paradigm in which participants’ attention was driven by the task-irrelevant gaze of a centrally presented face. We employed dynamic negative facial expressions of disgust, fear and anger and found an enhanced gaze-cuing effect in snake phobics as compared to controls, irrespective of facial expression. These results provide evidence of a general hypervigilance in animal phobics in the absence of phobic stimuli, and indicate that research on specific phobias should not be limited to symptom provocation paradigms.

Autistic traits influence gaze-oriented attention to happy but not fearful faces

The relationship between autistic traits and gaze-oriented attention to fearful and happy faces was investigated at the behavioral and neuronal levels. Upright and inverted dynamic face stimuli were used in a gaze-cueing paradigm while event related potentials (ERPs) were recorded. Participants responded faster to gazed-at than to non-gazed-at targets, and this gaze orienting effect (GOE) diminished with inversion, suggesting it relies on facial configuration. It was also larger for fearful than happy faces but only in participants with high autism-spectrum quotient (AQ) scores. While the GOE to fearful faces was of similar magnitude regardless of AQ scores, a diminished GOE to happy faces was found in participants with high AQ scores. At the ERP level, a congruency effect on target-elicited P1 component reflected enhanced visual processing of gazed-at targets. In addition, cue-triggered early directing attention negativity and anterior directing attention negativity reflected, respectively, attention orienting and attention holding at gazed-at locations. These neural markers of spatial attention orienting were not modulated by emotion and were not found in participants with high AQ scores. Together, these findings suggest that autistic traits influence attention orienting to gaze and its modulation by social emotions such as happiness.

Fearful, surprised, happy, and angry facial expressions modulate gaze-oriented attention: behavioral and ERP evidence

The impact of emotions on gaze-oriented attention was investigated in non-anxious participants. A neutral face cue with straight gaze was presented, which then averted its gaze to the side while remaining neutral or expressing an emotion (fear/surprise in Exp.1 and anger/happiness in Exp.2). Localization of a subsequent target was faster at the gazed-at location (congruent condition) than at the non-gazed-at location (incongruent condition). This Gaze-Orienting Effect (GOE) was enhanced for fear, surprise, and anger, compared to neutral expressions which did not differ from happy expressions. In addition, Event Related Potentials (ERPs) to the target showed a congruency effect on P1 for fear and surprise and a left lateralized congruency effect on P1 for happy faces, suggesting that target visual processing was also influenced by attention to gaze and emotions. Finally, at cue presentation, early postero-lateral (Early Directing Attention Negativity (EDAN)) and later antero-lateral (Anterior Directing Attention Negativity (ADAN)) attention-related ERP components were observed, reflecting, respectively, the shift of attention and its holding at gazed-at locations. These two components were not modulated by emotions. Together, these findings show that the processing of social signals such as gaze and facial expression interact rather late and in a complex manner to modulate spatial attention.