Attention Capture by Direct Gaze is Robust to Context and Task Demands

Autonomic and facial electromyographic responses to watching eyes

We measured participants' psychophysiological responses and gaze behavior while viewing a stimulus person's direct and averted gaze in three different conditions manipulating the participants' experience of being watched. The results showed that skin conductance responses and heart rate deceleration responses were greater to direct than averted gaze only in the condition in which the participants had the experience of being watched by the other individual. In contrast, gaze direction had no effects on these responses when the participants were manipulated to believe that the other individual could not watch them or when the stimulus person was presented in a pre-recorded video. Importantly, the eye tracking measures showed no differences in participants' looking behavior between these stimulus presentation conditions. The results of facial electromyography responses suggested that direct gaze elicited greater zygomatic and periocular responses than averted gaze did, independent of the presentation condition. It was concluded that the affective arousal and attention-orienting indexing autonomic responses to eye contact are driven by the experience of being watched. In contrast, the facial responses seem to reflect automatized affiliative responses which can be elicited even in conditions in which seeing another's direct gaze does not signal that the self is being watched.

Cultural differences in joint attention and engagement in mutual gaze with a robot face

Joint attention is a pivotal mechanism underlying human ability to interact with one another. The fundamental nature of joint attention in the context of social cognition has led researchers to develop tasks that address this mechanism and operationalize it in a laboratory setting, in the form of a gaze cueing paradigm. In the present study, we addressed the question of whether engaging in joint attention with a robot face is culture-specific. We adapted a classical gaze-cueing paradigm such that a robot avatar cued participants' gaze subsequent to either engaging participants in eye contact or not. Our critical question of interest was whether the gaze cueing effect (GCE) is stable across different cultures, especially if cognitive resources to exert top-down control are reduced. To achieve the latter, we introduced a mathematical stress task orthogonally to the gaze cueing protocol. Results showed larger GCE in the Singapore sample, relative to the Italian sample, independent of gaze type (eye contact vs. no eye contact) or amount of experienced stress, which translates to available cognitive resources. Moreover, since after each block, participants rated how engaged they felt with the robot avatar during the task, we observed that Italian participants rated as more engaging the avatar during the eye contact blocks, relative to no eye contact while Singaporean participants did not show any difference in engagement relative to the gaze. We discuss the results in terms of cultural differences in robot-induced joint attention, and engagement in eye contact, as well as the dissociation between implicit and explicit measures related to processing of gaze.

From eye to arrow: Attention capture by direct gaze requires more than just the eyes

Human attention is strongly attracted by direct gaze and sudden onset motion. The sudden direct-gaze effect refers to the processing advantage for targets appearing on peripheral faces that suddenly establish eye contact. Here, we investigate the necessity of social information for attention capture by (sudden onset) ostensive cues. Six experiments involving 204 participants applied (1) naturalistic faces, (2) arrows, (3) schematic eyes, (4) naturalistic eyes, or schematic facial configurations (5) without or (6) with head turn to an attention-capture paradigm. Trials started with two stimuli oriented towards the observer and two stimuli pointing into the periphery. Simultaneous to target presentation, one direct stimulus changed to averted and one averted stimulus changed to direct, yielding a 2 × 2 factorial design with direction and motion cues being absent or present. We replicated the (sudden) direct-gaze effect for photographic faces, but found no corresponding effects in Experiments 2-6. Hence, a holistic and socially meaningful facial context seems vital for attention capture by direct gaze. STATEMENT OF SIGNIFICANCE: The present study highlights the significance of context information for social attention. Our findings demonstrate that the direct-gaze effect, that is, the prioritization of direct gaze over averted gaze, critically relies on the presentation of a meaningful holistic and naturalistic facial context. This pattern of results is evidence in favor of early effects of surrounding social information on attention capture by direct gaze.

Eye contact during joint attention with a humanoid robot modulates oscillatory brain activity

Eye contact established by a human partner has been shown to affect various cognitive processes of the receiver. However, little is known about humans' responses to eye contact established by a humanoid robot. Here, we aimed at examining humans' oscillatory brain response to eye contact with a humanoid robot. Eye contact (or lack thereof) was embedded in a gaze-cueing task and preceded the phase of gaze-related attentional orienting. In addition to examining the effect of eye contact on the recipient, we also tested its impact on gaze-cueing effects (GCEs). Results showed that participants rated eye contact as more engaging and responded with higher desynchronization of alpha-band activity in left fronto-central and central electrode clusters when the robot established eye contact with them, compared to no eye contact condition. However, eye contact did not modulate GCEs. The results are interpreted in terms of the functional roles involved in alpha central rhythms (potentially interpretable also as mu rhythm), including joint attention and engagement in social interaction.

Interoception is associated with the impact of eye contact on spontaneous facial mimicry

Interoception (perception of one’s own physiological state) has been suggested to underpin social cognition, although the mechanisms underlying this association remain unclear. The current study aimed to elucidate the relationship between interoception and two factors underlying social cognition: self-other boundary and sensitivity to social cues. We measured performance in a heartbeat perception task as an index of interoceptive accuracy (IAc), the frequency of spontaneous facial mimicry (SFM) as an index of self-other boundary, and the degree of the effect of eye contact on SFM (difference in SFM between conditions in which models’ eyes were directed to and averted from participants) as an index of social-cue sensitivity, and tested correlations among these measures. The results revealed that IAc and SFM were positively correlated only in the direct gaze condition. The extent of the effect of eye contact on SFM (difference in frequency between direct vs. averted conditions) was positively correlated with IAc. These overall findings were also observed in separate analyses of male and female participant groups, supporting the robustness of the findings. The results suggest that interoception is related to sensitivity to social cues, and may also be related to the self-other boundary with modulation by social context.

How ubiquitous is the direct-gaze advantage? Evidence for an averted-gaze advantage in a gaze-discrimination task

Human eye gaze conveys an enormous amount of socially relevant information, and the rapid assessment of gaze direction is of particular relevance in order to adapt behavior accordingly. Specifically, previous research demonstrated evidence for an advantage of processing direct (vs. averted) gaze. The present study examined discrimination performance for gaze direction (direct vs. averted) under controlled presentation conditions: Using a backward-masking gaze-discrimination task, photographs of faces with direct and averted gaze were briefly presented, followed by a mask stimulus. Additionally, effects of facial context on gaze discrimination were assessed by either presenting gaze direction in isolation (i.e., by only showing the eye region) or in the context of an upright or inverted face. Across three experiments, we consistently observed a facial context effect with highest discrimination performance for faces presented in upright position, lower performance for inverted faces, and lowest performance for eyes presented in isolation. Additionally, averted gaze was generally responded to faster and with higher accuracy than direct gaze, indicating an averted-gaze advantage. Overall, the results suggest that direct gaze is not generally associated with processing advantages, thereby highlighting the important role of presentation conditions and task demands in gaze perception.

Social Inferences From Faces as a Function of the Left-to-Right Movement Continuum

We examined whether reading and writing habits known to drive agency perception also shape the attribution of other agency-related traits, particularly for faces oriented congruently with script direction (i.e., left-to-right). Participants rated front-oriented, left-oriented and right-oriented faces on 14 dimensions. These ratings were first reduced to two dimensions, which were further confirmed with a new sample: power and social-warmth. Both dimensions were systematically affected by head orientation. Right-oriented faces generated a stronger endorsement of the power dimension (e.g., agency, dominance), and, to a lesser extent, of the social-warmth dimension, relative to the left and frontal-oriented faces. A further interaction between the head orientation of the faces and their gender revealed that front-facing females, relative to front-facing males, were attributed higher social-warmth scores, or communal traits (e.g., valence, warmth). These results carry implications for the representation of people in space particularly in marketing and political contexts. Face stimuli and respective norming data are available at www.osf.io/v5jpd.

Eye contact boosts the reflexive component of overt gaze following

Establishing eye contact with an individual can subsequently lead to a stronger gaze-mediated orienting effect. However, studies exploring this phenomenon have, so far, only assessed manual responses and focused on covert attention - namely, without eye movements. Here, in two experiments, we explored for the first time whether eye contact can also impact on overt attention in an oculomotor task. This approach has two main advantages, in that it relies on more sensitive, online measures of attention allocation and it better mimics real life settings. Participants performed leftwards and rightwards eye movements in response to a central cue. Furthermore, a task-irrelevant central face established - or not - eye contact with the participant, and then averted its gaze either leftwards or rightwards. Hence, eye movement direction was either congruent or incongruent with that of the gaze stimulus. In both experiments, a gaze following behaviour emerged - specifically, smaller saccadic latencies and a greater accuracy emerged on congruent than on incongruent trials - but its magnitude was not modulated by eye contact. However, in Experiment 2 - in which the different eye contact conditions were presented intermixed rather than blocked, thus making eye contact contextually salient - eye contact led to an overall decrement of saccadic latencies and enhanced the reflexive component of gaze following. Taken together, these results provide novel evidence indicating that eye contact can impact on both eye movements programming and overt gaze following mechanisms, at least when eye contact is made contextually salient.

Turning Heads: The Effects of Face View and Eye Gaze Direction on the Perceived Attractiveness of Expressive Faces

We investigated whether the perceived attractiveness of expressive faces was influenced by head turn and eye gaze towards or away from the observer. In all experiments, happy faces were consistently rated as more attractive than angry faces. A head turn towards the observer, whereby a full-face view was shown, was associated with relatively higher attractiveness ratings when gaze direction was aligned with face view (Experiment 1). However, preference for full-face views of happy faces was not affected by gaze shifts towards or away from the observer (Experiment 2a). In Experiment 3, the relative duration of each face view (front-facing or averted at 15°) during a head turn away or towards the observer was manipulated. There was benefit on attractiveness ratings for happy faces shown for a longer duration from the front view, regardless of the direction of head turn. Our findings support previous studies indicating a preference for positive expressions on attractiveness judgements, which is further enhanced by the front views of faces, whether presented during a head turn or shown statically. In sum, our findings imply a complex interaction between cues of social attention, indicated by the view of the face shown, and reward on attractiveness judgements of unfamiliar faces.

The influence of top-down modulation on the processing of direct gaze

Gaze or eye contact is one of the most important nonverbal social cues, which is fundamental to human social interactions. To achieve real time and dynamic face-to-face communication, our brain needs to process another person's gaze direction rapidly and without explicit instruction. In order to explain the fast and spontaneous processing of direct gaze, the fast-track modulator model was proposed. Here, we review recent developments in gaze processing research in the last decade to extend the fast-track modulator model. In particular, we propose that task demand or top-down modulation could play a more crucial role at gaze processing than formerly assumed. We suggest that under different task demands, top-down modulation can facilitate or interfere with the direct gaze effects for early visual processing. The proposed modification of the model extends the role of task demand and its implication on the direct gaze effect, as well as the need to better control for top-down processing in order to better disentangle the role of top-down and bottom-up processing on the direct gaze effect. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Psychology > Perception and Psychophysics Neuroscience > Cognition.

Large lateralized EDAN-like brain potentials in a gaze-shift detection task

Attentional cueing tasks using gaze direction as spatial cues have sometimes yielded an early directing attention negativity (EDAN) component in the ERP, presumably reflecting the initial orienting toward the cued location. However, other studies have failed to identify an EDAN component for gaze cues, yielding an inconsistent picture. In the present study, we re-examined the EDAN to gaze cueing, using a continuous task where the specific direction of the gaze changes was task irrelevant. Face stimuli changed gaze direction several times during each trial between direct, left-, and right-averted positions. Participants counted the number of gaze shifts during the trial. Results showed an unusually large EDAN-like ERP asymmetry at posterior scalp sites that was of similar amplitude for large and small gaze shifts into the periphery. Shifts from an averted position toward a direct gaze elicited a qualitatively similar but smaller effect than shifts into the periphery. Together, these findings shed new light on gaze-elicited spatial attention as they indicate a reflexive attention orienting, following the direction of gaze motion, even when the gaze direction itself is irrelevant for the task.

Early and late cortical responses to directly gazing faces are task dependent

Gender categorisation of human faces is facilitated when gaze is directed toward the observer (i.e., a direct gaze), compared with situations where gaze is averted or the eyes are closed (Macrae, Hood, Milne, Rowe, & Mason, Psychological Science, 13(5), 460-464, 2002). However, the temporal dynamics underlying this phenomenon remain to some extent unknown. Here, we used electroencephalography (EEG) to assess the neural correlates of this effect, focusing on the event-related potential (ERP) components known to be sensitive to gaze perception (i.e., P1, N170, and P3b). We first replicated the seminal findings of Macrae et al. (2002, Experiment 1) regarding facilitated gender discrimination, and subsequently measured the underlying neural responses. Our data revealed an early preferential processing of direct gaze as compared with averted gaze and closed eyes at the P1, which reverberated at the P3b (Experiment 2). Critically, using the same material, we failed to reproduce these effects when gender categorisation was not required (Experiment 3). Taken together, our data confirm that direct gaze enhances the early P1, as well as later cortical responses to face processing, although the effect appears to be task dependent.

Genuine eye contact elicits self-referential processing

The effect of eye contact on self-awareness was investigated with implicit measures based on the use of first-person singular pronouns in sentences. The measures were proposed to tap into self-referential processing, that is, information processing associated with self-awareness. In addition, participants filled in a questionnaire measuring explicit self-awareness. In Experiment 1, the stimulus was a video clip showing another person and, in Experiment 2, the stimulus was a live person. In both experiments, participants were divided into two groups and presented with the stimulus person either making eye contact or gazing downward, depending on the group assignment. During the task, the gaze stimulus was presented before each trial of the pronoun-selection task. Eye contact was found to increase the use of first-person pronouns, but only when participants were facing a real person, not when they were looking at a video of a person. No difference in self-reported self-awareness was found between the two gaze direction groups in either experiment. The results indicate that eye contact elicits self-referential processing, but the effect may be stronger, or possibly limited to, live interaction.

Atypical physiological orienting to direct gaze in low-functioning children with autism spectrum disorder

Reduced use of eye contact is a prominent feature in individuals with autism spectrum disorder (ASD). It has been proposed that direct gaze does not capture the attention of individuals with ASD. Experimental evidence is, however, mainly restricted to relatively high-functioning school-aged children or adults with ASD. This study investigated whether 2-5-year-old low-functioning children with severe ASD differ from control children in orienting to gaze stimuli, as measured with the heart rate deceleration response. Responses were measured to computerized presentations of dynamic shifts of gaze direction either toward (direct) or away (averted) from the observing child. The results showed a significant group by gaze direction interaction effect on heart rate responses (permuted P = .004), reflecting a stronger orienting response to direct versus averted gaze in typically developing (N = 17) and developmentally delayed (N = 16) children but not in children with ASD (N = 12). The lack of enhanced orienting response to direct gaze in the ASD group was not caused by a lack of looking at the eye region, as confirmed by eye tracking. The results suggest that direct gaze is not a socially salient, attention-grabbing signal for low-functioning children with ASD. Autism Res 2017, 10: 810-820. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.

Gaze-cueing requires intact face processing - Insights from acquired prosopagnosia

Gaze-cueing is the automatic spatial orienting of attention in the direction of perceived gaze. Participants respond faster to targets located at positions congruent with the direction of gaze, compared to incongruent ones (gaze cueing effect, GCE). However, it still remains unclear whether its occurrence depends on intact integration of information from the entire eye region or face, rather than simply the presence of the eyes per se. To address this question, we investigated the GCE in PS, an extensively studied case of pure acquired prosopagnosia. In our gaze-cueing paradigm, we manipulated the duration at which cues were presented (70ms vs. 400ms) and the availability of facial information (full-face vs. eyes-only). For 70ms cue duration, we found a context-dependent dissociation between PS and controls: PS showed a GCE for eyes-only stimuli, whereas controls showed a GCE only for full-face stimuli. For 400ms cue duration, PS showed gaze-cueing independently of stimulus context, whereas in healthy controls a GCE again emerged only for full-face stimuli. Our findings suggest that attentional deployment based on the gaze direction of briefly presented faces requires intact processing of facial information, which affords salience to the eye region.

Asymmetry in Gaze Direction Discrimination Between the Upper and Lower Visual Fields

Previous research has shown that gaze direction can only be accurately discriminated within parafoveal limits (∼5° eccentricity) along the horizontal visual field. Beyond this eccentricity, head orientation seems to influence gaze discrimination more than iris cues. The present study examined gaze discrimination performance in the upper visual field (UVF) and lower visual field (LVF), and whether head orientation affects gaze judgments beyond parafoveal vision. Direct and averted gaze faces, in frontal and deviated head orientations, were presented for 150 ms along the vertical meridian while participants maintained central fixation during gaze discrimination judgments. Gaze discrimination was above chance level at all but one eccentricity for the two gaze-head congruent conditions. In contrast, for the incongruent conditions, gaze was discriminated above chance only from -1.5° to +3°, with an asymmetry between the UVF and LVF. Beyond foveal vision, response rates were biased toward head orientation rather than iris eccentricity, occurring in the LVF for both head orientations, and in the UVF for frontal head views. These findings suggest that covert processing of gaze direction involves the integration of eyes and head cues, with congruency of these two social cues driving response differences between the LVF and the UVF.

Eye gaze and head orientation modulate the inhibition of return for faces

The present study used an inhibition of return (IOR) spatial cueing paradigm to examine how gaze direction and head orientation modulate attention capture for human faces. Target response time (RT) was measured after the presentation of a peripheral cue, which was either a face (with front-facing or averted gaze, in either frontal head view or averted head view) or a house (control). Participants fixated on a centered cross at all times and responded via button press to a peripheral target after a variable stimulus onset asynchrony (SOA) from the stimulus cue. At the shortest SOA (150 ms), RTs were shorter for faces than houses, independent of an IOR response, suggesting a cue-based RT advantage elicited by faces. At the longest SOA (2,400 ms), a larger IOR magnitude was found for faces compared to houses. Both the cue-based RT advantage and later IOR responses were modulated by gaze-head congruency; these effects were strongest for frontal gaze faces in frontal head view, and for averted gaze faces in averted head view. Importantly, participants were not given any specific information regarding the stimuli, nor were they told the true purpose of the study. These findings indicate that the congruent combination of head and gaze direction influence the exogenous attention capture of faces during inhibition of return.

Emotional expressions beyond facial muscle actions. A call for studying autonomic signals and their impact on social perception

Humans are well adapted to quickly recognize and adequately respond to another’s emotions. Different theories propose that mimicry of emotional expressions (facial or otherwise) mechanistically underlies, or at least facilitates, these swift adaptive reactions. When people unconsciously mimic their interaction partner’s expressions of emotion, they come to feel reflections of those companions’ emotions, which in turn influence the observer’s own emotional and empathic behavior. The majority of research has focused on facial actions as expressions of emotion. However, the fact that emotions are not just expressed by facial muscles alone is often still ignored in emotion perception research. In this article, I therefore argue for a broader exploration of emotion signals from sources beyond the face muscles that are more automatic and difficult to control. Specifically, I will focus on the perception of implicit sources such as gaze and tears and autonomic responses such as pupil-dilation, eyeblinks and blushing that are subtle yet visible to observers and because they can hardly be controlled or regulated by the sender, provide important “veridical” information. Recently, more research is emerging about the mimicry of these subtle affective signals including pupil-mimicry. I will here review this literature and suggest avenues for future research that will eventually lead to a better comprehension of how these signals help in making social judgments and understand each other’s emotions.

Attention orienting by gaze and facial expressions across development

Processing of facial expressions has been shown to potentiate orienting of attention toward the direction signaled by gaze in adults, an important social-cognitive function. However, little is known about how this social attention skill develops. This study is the first to examine the developmental trajectory of the gaze orienting effect (GOE), its modulations by facial expressions, and its links with theory of mind (ToM) abilities. Dynamic emotional stimuli were presented to 222 participants (7-25 years old) with normal trait anxiety using a gaze-cuing paradigm. The GOE was found as early as 7 years of age and decreased linearly until 12-13 years, at which point adult levels were reached. Both fearful and surprised expressions enhanced the GOE compared with neutral expressions. The GOE for fearful faces was also larger than for joyful and angry expressions. These effects did not interact with age and were not driven by intertrial variance. Importantly, the GOE did not correlate with ToM abilities as assessed by the "Reading the Mind in the Eyes" test. The implication of these findings for clinical and typically developing populations is discussed.