Facial expressions modulate the gaze orienting effect on sound localization judgement

The emotion of sound target modulates the auditory gaze cueing effect

The auditory gaze cueing effect (auditory-GCE) is a faster response to auditory targets at an eye-gaze cue location than at a non-cue location. Previous research has found that auditory-GCE can be influenced by the integration of both gaze direction and emotion conveyed through facial expressions. However, it is unclear whether the emotional information of auditory targets can be cross-modally integrated with gaze direction to affect auditory-GCE. Here, we set neutral faces with different gaze directions as cues and three emotional sounds (fearful, happy, and neutral) as targets to investigate how the emotion of sound target modulates the auditory-GCE. Moreover, we conducted a controlled experiment using arrow cues. The results show that the emotional content of sound targets influences the auditory-GCE but only for those induced by facial cues. Specifically, fearful sounds elicit a significantly larger auditory-GCE compared to happy and neutral sounds, indicating that the emotional content of auditory targets plays a modulating role in the auditory-GCE. Furthermore, this modulation appears to occur only at a higher level of social meaning, involving the integration of emotional information from a sound with social gaze direction, rather than at a lower level, which involves the integration of direction and auditory emotion.

Does a look of fear prompt to act? The effects of gaze and face emotional expression on manipulable objects

Gaze direction is an important social cue for understanding the intentions of other people. Indeed, interacting with others requires the ability to encode their current focus of attention in order to predict their future actions. Previous studies have showed that when asked to detect or identify a target, people are faster if shown a gaze oriented toward rather than away from that target. Most importantly, there is evidence that the emotion conveyed by the face with the averted gaze matters. We further tested the interplay between gaze and face emotion in the context of manipulable objects to understand whether and to what extent other people's gaze influences our own actions toward objects. Participants judged whether a target graspable object was upright or inverted after viewing a face cue with a central or averted gaze. Importantly, the target's handle could be oriented toward the gazed-at location or the opposite side such that gaze and handle were corresponding or non-corresponding in space. Furthermore, we manipulated the expression of the cue by using neutral and fearful faces. Results showed a handle-response (H-R) compatibility effect (i.e., a facilitation when the response key is on the same side as the object's handle) only with fearful cues with a central gaze.

No Influence of Emotional Faces or Autistic Traits on Gaze-Cueing in General Population

The present study addressed the controversial issue of whether autistic traits in the general population are associated with the automatic and fundamental aspects of joint attention through eye gaze. Specifically, we examined whether the degree of autistic traits is associated with the magnitude of reflexive attention orienting in the direction of another's eye gaze embedded in neutral and emotional (angry, fearful, and happy) faces. The cue stimuli changed gaze direction and facial expressions simultaneously. Participants were asked to detect a target that appeared at the left or right of the cue stimuli. The results revealed a robust gaze-cueing effect, such that the reaction time to the target was shorter under the gazed-at-target condition than under the non-gazed-at-target condition. However, emotional expressions did not modulate the gaze-cueing effect. Furthermore, individual differences in autistic traits and emotional characteristics (social anxiety, alexithymia, and emotional disturbances) did not influence the magnitude of the gaze-cueing effect. Although the ability to orient attention in the direction of another's gaze is a fundamental function of social development, the gaze-cueing effect measured in a controlled experiment might not be an elaborate representation of the current social cognitive function, at least in typically developing adults.

Neurocognitive Mechanisms Underlying Social Atypicalities in Autism: Weak Amygdala's Emotional Modulation Hypothesis

Autism spectrum disorder (ASD) is a neurodevelopmental condition associated with atypicalities in social interaction. Although psychological and neuroimaging studies have revealed divergent impairments in psychological processes (e.g., emotion and perception) and neural activity (e.g., amygdala, superior temporal sulcus, and inferior frontal gyrus) related to the processing of social stimuli, it remains difficult to integrate these findings. In an effort to resolve this issue, we review our psychological and functional magnetic resonance imaging (fMRI) findings and present a hypothetical neurocognitive model. Our psychological study showed that emotional modulation of reflexive joint attention is impaired in individuals with ASD. Our fMRI study showed that modulation from the amygdala to the neocortex during observation of dynamic facial expressions is reduced in the ASD group. Based on these findings and other evidence, we hypothesize that weak modulation from the amygdala to the neocortex-through which emotion rapidly modulates various types of perceptual, cognitive, and motor processing functions-underlies the social atypicalities in individuals with ASD.