Visuospatial attention shifts by gaze and arrow cues: An ERP study

The role of the oculomotor system in covert social attention

Observing a change in gaze direction triggers a reflexive shift of attention and appears to engage the eye-movement system. However, the functional relationship between social attention and this oculomotor activation is unclear. One extremely influential hypothesis is that the preparation of a saccadic eye movement is necessary and sufficient for a covert, reflexive shift of attention (the premotor theory of attention; Rizzolatti et al., 1994). Surprisingly, this theory has not been directly tested with respect to reflexive gaze cueing. In order to address this issue, gaze cueing, peripheral cueing, and arrow cueing were examined under conditions in which some stimuli appeared at locations that could not become the goal of a saccadic eye movement. It was observed that peripheral cues failed to elicit reflexive attentional orienting when targets appeared beyond the range of eye movements. Similarly, nonpredictive arrow cues were ineffective when targets could not become the goal of a saccade. In contrast, significant gaze-cueing effects were still observed when targets were beyond the range of eye movements. These data demonstrate that the mechanisms involved in gaze cueing are dissociated from those involved in exogenous orienting to peripheral or arrow cues. Furthermore, the findings suggest that, unlike peripheral cueing and reflexive arrow cueing, gaze cueing is independent of oculomotor control. We conclude that the premotor theory does not offer a compelling explanation for gaze cueing.

The impact of perceived social power and dangerous context on social attention

Past research has shown that position in a social hierarchy modulates one's social attention, as in the gaze cueing effect. While studies have manipulated the social status of others with whom the participants interact, we believe that a sense of one's own social power is also a crucial factor affecting gaze following. In two experiments, we primed the social power of participants, using different approaches, to investigate the participants' performance in a subsequent gaze cueing task. The results of Experiment 1 showed a stronger gaze cueing effect among participants who were primed with low social power, compared to those primed with high social power. Our predicted gender difference (i.e., women showing a stronger gaze cueing effect than men) was confirmed and this effect was found to be dominated by the lower social power condition. Experiment 2 manipulated the level of danger in the context and replicated the joint impact of gender and one's perceived social power on gaze cueing effect, especially in the low danger context, in comparison to the high danger context. These findings demonstrate that one's perceived social power has a concerted effect on social attention evoked by gaze, along with other factors such as gender and characteristics of the environment, and suggest the importance of further research on the complex relationship between an individual's position in the social hierarchy and social attention.

Autistic traits influence gaze-oriented attention to happy but not fearful faces

The relationship between autistic traits and gaze-oriented attention to fearful and happy faces was investigated at the behavioral and neuronal levels. Upright and inverted dynamic face stimuli were used in a gaze-cueing paradigm while event related potentials (ERPs) were recorded. Participants responded faster to gazed-at than to non-gazed-at targets, and this gaze orienting effect (GOE) diminished with inversion, suggesting it relies on facial configuration. It was also larger for fearful than happy faces but only in participants with high autism-spectrum quotient (AQ) scores. While the GOE to fearful faces was of similar magnitude regardless of AQ scores, a diminished GOE to happy faces was found in participants with high AQ scores. At the ERP level, a congruency effect on target-elicited P1 component reflected enhanced visual processing of gazed-at targets. In addition, cue-triggered early directing attention negativity and anterior directing attention negativity reflected, respectively, attention orienting and attention holding at gazed-at locations. These neural markers of spatial attention orienting were not modulated by emotion and were not found in participants with high AQ scores. Together, these findings suggest that autistic traits influence attention orienting to gaze and its modulation by social emotions such as happiness.

Reflexive orienting in response to short- and long-duration gaze cues in young, young-old, and old-old adults

Shifting visual focus on the basis of the perceived gaze direction of another person is one form of joint attention. In the present study, we investigated whether this socially relevant form of orienting is reflexive and whether it is influenced by age. Green and Woldorff (Cognition 122:96-101, 2012) argued that rapid cueing effects (i.e., faster responses to validly than to invalidly cued targets) were limited to conditions in which a cue overlapped in time with a target. They attributed slower responses following invalid cues to the time needed to resolve the incongruent spatial information provided by the concurrently presented cue and target. In the present study, we examined the orienting responses of young (18-31 years), young-old (60-74 years), and old-old (75-91 years) adults following uninformative central gaze cues that overlapped in time with the target (Exp. 1) or that were removed prior to target presentation (Exp. 2). When the cue and target overlapped, all three groups localized validly cued targets more quickly than invalidly cued targets, and validity effects emerged earlier for the two younger groups (at 100 ms post-cue-onset) than for the old-old group (at 300 ms post-cue-onset). With a short-duration cue (Exp. 2), validity effects developed rapidly (by 100 ms) for all three groups, suggesting that validity effects resulted from reflexive orienting based on the gaze cue information rather than from cue-target conflict. Thus, although old-old adults may be slow to disengage from persistent gaze cues, attention continues to be reflexively guided by gaze cues late in life.

Commonalities and differences in the spatiotemporal neural dynamics associated with automatic attentional shifts induced by gaze and arrows

Gaze and arrows automatically trigger attentional shifts. Neuroimaging studies have identified a commonality in the spatial distribution of the neural activation involved in such attentional shifts. However, it remains unknown whether these activations occur with common temporal profiles. To investigate this issue, magnetoencephalography (MEG) was used to evaluate neural activation involved in attentional shifts induced by gaze and arrows. MEG source reconstruction analyses revealed that the superior temporal sulcus and the inferior frontal gyrus were commonly activated after 200ms, in response to directional versus non-directional cues. Regression analyses further revealed that the magnitude of brain activity in these areas and in the bilateral occipital cortex was positively related to the effect of attentional shift on reaction times under both the gaze and the arrow conditions. The results also revealed that some brain regions were activated specifically in response to directional versus non-directional gaze or arrow cues at the 350-400ms time window. These results suggest that the neural mechanisms underlying attentional shifts induced by gaze and arrows share commonalities in their spatial distributions and temporal profiles, with some spatial differences at later time stages.

Does gaze cueing produce automatic response activation: a lateralized readiness potential (LRP) study

Previous research has shown that gaze cues facilitate responses to an upcoming target if the target location is compatible with the direction of the cue. Similar cueing effects have also been observed with central arrow cues. Both of these cueing effects have been attributed to a reflexive orienting of attention triggered by the cue. In addition, orienting of attention has been proposed to result in a partial response activation of the corresponding hand that, in turn, can be observed in the lateralized readiness potential (LRP), an electrophysiological indicator of automatic hand-motor response preparation. For instance, a central arrow cue has been observed to produce automatic hand-motor activation as indicated by the LRPs. The present study investigated whether gaze cues could also produce similar activation patterns in LRP. Although the standard gaze cueing effect was observed in the behavioural data, the LRP data did not reveal any consistent automatic hand-motor activation. The study suggests that motor processes associated with gaze cueing effect may operate exclusively at the level of oculomotor programming.

Fearful, surprised, happy, and angry facial expressions modulate gaze-oriented attention: behavioral and ERP evidence

The impact of emotions on gaze-oriented attention was investigated in non-anxious participants. A neutral face cue with straight gaze was presented, which then averted its gaze to the side while remaining neutral or expressing an emotion (fear/surprise in Exp.1 and anger/happiness in Exp.2). Localization of a subsequent target was faster at the gazed-at location (congruent condition) than at the non-gazed-at location (incongruent condition). This Gaze-Orienting Effect (GOE) was enhanced for fear, surprise, and anger, compared to neutral expressions which did not differ from happy expressions. In addition, Event Related Potentials (ERPs) to the target showed a congruency effect on P1 for fear and surprise and a left lateralized congruency effect on P1 for happy faces, suggesting that target visual processing was also influenced by attention to gaze and emotions. Finally, at cue presentation, early postero-lateral (Early Directing Attention Negativity (EDAN)) and later antero-lateral (Anterior Directing Attention Negativity (ADAN)) attention-related ERP components were observed, reflecting, respectively, the shift of attention and its holding at gazed-at locations. These two components were not modulated by emotions. Together, these findings show that the processing of social signals such as gaze and facial expression interact rather late and in a complex manner to modulate spatial attention.

Neural correlates of "social gaze" processing in high-functioning autism under systematic variation of gaze duration

Direct gaze is a salient nonverbal signal for social interest and the intention to communicate. In particular, the duration of another's direct gaze can modulate our perception of the social meaning of gaze cues. However, both poor eye contact and deficits in social cognitive processing of gaze are specific diagnostic features of autism. Therefore, investigating neural mechanisms of gaze may provide key insights into the neural mechanisms related to autistic symptoms. Employing functional magnetic resonance imaging (fMRI) and a parametric design, we investigated the neural correlates of the influence of gaze direction and gaze duration on person perception in individuals with high-functioning autism (HFA) and a matched control group. For this purpose, dynamically animated faces of virtual characters, displaying averted or direct gaze of different durations (1 s, 2.5 s and 4 s) were evaluated on a four-point likeability scale. Behavioral results revealed that HFA participants showed no significant difference in likeability ratings depending on gaze duration, while the control group rated the virtual characters as increasingly likeable with increasing gaze duration. On the neural level, direct gaze and increasing direct gaze duration recruit regions of the social neural network (SNN) in control participants, indicating the processing of social salience and a perceived communicative intent. In participants with HFA however, regions of the social neural network were more engaged by averted and decreasing amounts of gaze, while the neural response for processing direct gaze in HFA was not suggestive of any social information processing.

Bodily movement of approach is detected faster than that of receding

The human visual system is efficient at detecting an approaching object. In detecting approaching human beings, bodily movement serves as a cue for the visual system to compute moving direction. On the basis of this knowledge, we hypothesized that bodily movement implying approach is detected faster than receding bodily movement even when only bodily movement is available as a clue to discerning motion direction. To examine this hypothesis, we conducted a visual search experiment in which participants searched for a point-light figure with approaching or receding walking movement. Results showed that an approaching point-light figure was detected faster than a receding one. This search asymmetry was eliminated when the figures were presented upside-down. These findings indicate the potency of bodily movement that implies approach in effectively capturing visuospatial attention.

Watch out! Magnetoencephalographic evidence for early modulation of attention orienting by fearful gaze cueing

Others’ gaze and emotional facial expression are important cues for the process of attention orienting. Here, we investigated with magnetoencephalography (MEG) whether the combination of averted gaze and fearful expression may elicit a selectively early effect of attention orienting on the brain responses to targets. We used the direction of gaze of centrally presented fearful and happy faces as the spatial attention orienting cue in a Posner-like paradigm where the subjects had to detect a target checkerboard presented at gazed-at (valid trials) or non gazed-at (invalid trials) locations of the screen. We showed that the combination of averted gaze and fearful expression resulted in a very early attention orienting effect in the form of additional parietal activity between 55 and 70 ms for the valid versus invalid targets following fearful gaze cues. No such effect was obtained for the targets following happy gaze cues. This early cue-target validity effect selective of fearful gaze cues involved the left superior parietal region and the left lateral middle occipital region. These findings provide the first evidence for an effect of attention orienting induced by fearful gaze in the time range of C1. In doing so, they demonstrate the selective impact of combined gaze and fearful expression cues in the process of attention orienting.

Gaze-induced joint attention persists under high perceptual load and does not depend on awareness

The automaticity of gaze-induced joint attention is well known in relatively easy cognitive tasks; but its role in harder tasks had never been examined. This encouraged us to study automaticity in hard tasks, tasks presenting the subjects with high perceptual loads. The Rapid Serial Visual Presentation (RSVP) paradigm was used to present participants with two streams of bilaterally displayed digit-flows while they fixated at the center of a synthetic representation of a human face. The face was presented both above (Experiments 1 and 2) and below (Experiment 3) the face's visual threshold (henceforth called "supraliminal" and "subliminal", respectively). Interocular suppression was used to make the face stimulus invisible (subliminal). In the critical trials of all three experiments, the gaze direction shown on the face was randomly diverted to either the left or to the right. This directed the participant's gaze either towards or away from the location of a target in the RSVP. The perceptual load was always relatively high. It was either set (Experiments 1 and 3) or manipulated (Experiment 2) during the experiment. In all three experiments, an appreciably higher and significant level of target detection was found when an uninformative gaze-cue was congruent with the location of the target. This result, which had only been reported with relatively easy tasks previously, is called the "gaze-cueing effect". Our novel findings include showing that: (i) the attentional effect of gaze persists under high perceptual loads, and (ii) awareness of the gaze stimuli is not required to obtain the gaze-cueing effect. They also serve to validate prior support for an important role of automaticity in gaze-induced joint attention.

ERP evidence for selective drop in attentional costs in uncertain environments: challenging a purely premotor account of covert orienting of attention

Several studies have proved that the reliability of endogenous spatial cues linearly modulates the reaction time advantage in the processing of targets at validly cued vs. invalidly cued locations, i.e. the "validity effect". This would imply that with non-predictive cues, no "validity effect" should be observed. However, contrary to this prediction, one could hypothesize that attentional benefits by valid cuing (i.e. the RT advantage for validly vs. neutrally cued targets) can still be maintained with non-predictive cues, if the brain were endowed with mechanisms allowing the selective reduction in costs of reorienting from invalidly cued locations (i.e. the reduction of the RT disadvantage for invalidly vs. neutrally cued targets). This separated modulation of attentional benefits and costs would be adaptive in uncertain contexts where cues predict at chance level the location of targets. Through the joint recording of manual reaction times and event-related cerebral potentials (ERPs), we have found that this is the case and that relying on non-predictive endogenous cues results in abatement of attentional costs and the difference in the amplitude of the P1 brain responses evoked by invalidly vs. neutrally cued targets. In contrast, the use of non-predictive cues leaves unaffected attentional benefits and the difference in the amplitude of the N1 responses evoked by validly vs. neutrally cued targets. At the individual level, the drop in costs with non-predictive cues was matched with equivalent lateral biases in RTs to neutrally and invalidly cued targets presented in the left and right visual field. During the cue period, the drop in costs with non-predictive cues was preceded by reduction of the Early Directing Attention Negativity (EDAN) on posterior occipital sites and by enhancement of the frontal Anterior Directing Attention Negativity (ADAN) correlated to preparatory voluntary orienting. These findings demonstrate, for the first time, that the segregation of mechanisms regulating attentional benefits and costs helps efficiency of orienting in "uncertain" visual spatial contexts characterized by poor probabilistic association between cues and targets.

Mapping reflexive shifts of attention in eye-centered and hand-centered coordinate systems

Behavioral studies indicate that directional gaze and hand pointing are fundamental social signals that may capture spatial attention more powerfully than directional arrows. By using fMRI, we explored whether reflexive shifts of attention triggered by different distracters were influenced by the motor effector used for performing an overt response. In separate blocks, healthy participants performed a directional saccadic or a hand pointing movement. Color changes of a central black fixation point constituted the imperative instruction signal to make a leftward (red color) or a rightward (blue color) movement while ignoring distracting leftward or rightward oriented gaze, hand pointing, or arrow. Distracters that were directionally incongruent with the instruction cue impaired the saccadic and pointing-release RTs. The comparison of incongruent vs. congruent conditions showed an increase of BOLD signal in the frontal eye field (FEF), the intraparietal sulcus (IPS), and the posterior parietal cortex (PPC) bilaterally. Importantly, a specific relationship between distracter and effector used for the response was found in these frontal and parietal regions. In particular, higher activity in the FEF, for distracting gaze was found mainly during the saccadic response task. In the same vein, higher activity in the left and right IPS regions was found for the distracting hand mainly in the hand pointing task. The results suggest that reflexive shifts of attention triggered by social signals are coded in the fronto-parietal cortex according to effector-specific mapping rules.

Reorienting of spatial attention in gaze cuing is reflected in N2pc

Research has shown that gaze cuing of attention is reflected in the modulation of P1 and N1 components of ERPs time-locked to target onset. Studies focusing on cue-locked analyses have produced mixed results. The present study examined ERP reflections of gaze cuing in further detail by recording electric brain activity from the scalp of participants engaged in a spatial cuing paradigm with noninformative gaze cues embedded in fearful, disgusted, or neutral faces. Unlike previous work, we focused on N2pc, a recent ERP index of attention shifting over space. Behavioral data showed that gaze-driven orienting was not influenced by facial expression. Importantly, electrophysiological data showed a significant amplitude modulation of the N2pc time-locked to target onset as a function of cue--target spatial congruence. This pattern, however, was independent of facial expression. The results are interpreted as evidence that N2pc can be used as a marker of reorienting of attention in spatially incongruent trials due to gaze cuing. The overall findings support the idea that the effects of facial expression on gaze cuing are weak and likely context-dependent.

Differential activation of frontoparietal attention networks by social and symbolic spatial cues

Perception of both gaze-direction and symbolic directional cues (e.g. arrows) orient an observer's attention toward the indicated location. It is unclear, however, whether these similar behavioral effects are examples of the same attentional phenomenon and, therefore, subserved by the same neural substrate. It has been proposed that gaze, given its evolutionary significance, constitutes a 'special' category of spatial cue. As such, it is predicted that the neural systems supporting spatial reorienting will be different for gaze than for non-biological symbols. We tested this prediction using functional magnetic resonance imaging to measure the brain's response during target localization in which laterally presented targets were preceded by uninformative gaze or arrow cues. Reaction times were faster during valid than invalid trials for both arrow and gaze cues. However, differential patterns of activity were evoked in the brain. Trials including invalid rather than valid arrow cues resulted in a stronger hemodynamic response in the ventral attention network. No such difference was seen during trials including valid and invalid gaze cues. This differential engagement of the ventral reorienting network is consistent with the notion that the facilitation of target detection by gaze cues and arrow cues is subserved by different neural substrates.

Neural bases of eye and gaze processing: the core of social cognition

Eyes and gaze are very important stimuli for human social interactions. Recent studies suggest that impairments in recognizing face identity, facial emotions or in inferring attention and intentions of others could be linked to difficulties in extracting the relevant information from the eye region including gaze direction. In this review, we address the central role of eyes and gaze in social cognition. We start with behavioral data demonstrating the importance of the eye region and the impact of gaze on the most significant aspects of face processing. We review neuropsychological cases and data from various imaging techniques such as fMRI/PET and ERP/MEG, in an attempt to best describe the spatio-temporal networks underlying these processes. The existence of a neuronal eye detector mechanism is discussed as well as the links between eye gaze and social cognition impairments in autism. We suggest impairments in processing eyes and gaze may represent a core deficiency in several other brain pathologies and may be central to abnormal social cognition.

Mirroring of attention by neurons in macaque parietal cortex

Macaques, like humans, rapidly orient their attention in the direction other individuals are looking. Both cortical and subcortical pathways have been proposed as neural mediators of social gaze following, but neither pathway has been characterized electrophysiologically in behaving animals. To address this gap, we recorded the activity of single neurons in the lateral intraparietal area (LIP) of rhesus macaques to determine whether and how this area might contribute to gaze following. A subset of LIP neurons mirrored observed attention by firing both when the subject looked in the preferred direction of the neuron, and when observed monkeys looked in the preferred direction of the neuron, despite the irrelevance of the monkey images to the task. Importantly, the timing of these modulations matched the time course of gaze-following behavior. A second population of neurons was suppressed by social gaze cues, possibly subserving task demands by maintaining fixation on the observed face. These observations suggest that LIP contributes to sharing of observed attention and link mirror representations in parietal cortex to a well studied imitative behavior.