Neural correlates of the stare-in-the-crowd effect

The effect of gaze information associated with the search items on contextual cueing effect

Previous research on the mechanisms of contextual cueing effect has been inconsistent, with some researchers showing that the contextual benefit was derived from the attentional guidance whereas others argued that the former theory was not the source of contextual cueing effect. We brought the "stare-in-the-crowd" effect that used pictures of gaze with different orientations as stimuli into a traditional contextual cueing effect paradigm to investigate whether attentional guidance plays a part in this effect. We embedded the letters used in a traditional contextual cueing effect paradigm into the gaze pictures with direct and averted orientation. In Experiment 1, we found that there was a weak interaction between the contextual cueing effect and the "stare-in-the-crowd" effect. In Experiments 2 and 3, we found that the contextual cueing effect was influenced differently when the direct gaze was combined with the target or distractors. These results suggested that attentional guidance played an important role in the generation of a contextual cueing effect and the direct gaze had a special impact on visual search. To summarize the three findings, the direct gaze on target location facilitates the contextual cueing effect, and such an effect is even greater when we compared condition with the direct gaze on target location with condition with the direct gaze on distractor location (Experiments 2 and 3). Such an effect of gaze on a contextual cueing effect is manifested even when the effect of gaze ("stare-in-the-crowd" effect) was absent in the New configurations (search trials without learning).

Saliency affects attentional capture and suppression of abrupt-onset and color singleton distractors: Evidence from event-related potential studies

Attention is the process of selecting relevant information and suppressing irrelevant information. However, it is still controversial whether attentional capture by salient but task-irrelevant stimuli operates in a bottom-up fashion (stimulus-driven theory) or a top-down fashion (goal-driven theory) or if even salient distractors can be suppressed before capturing attention (signal suppression theory). In the present study, we investigated how saliency affects attentional capture (indexed by N2-posterior-contralateral [N2pc]) and suppression (indexed by distractor positivity [P_D ]) of abrupt-onset and color singleton distractors in a visual search task. Experiment 1 showed that an abrupt-onset distractor elicited both N2pc and P_D , while a color singleton distractor elicited only P_D . Moreover, the abrupt-onset distractor elicited a larger N2pc and a larger P_D relative to the color singleton distractor. In addition, both distractors elicited an early positive component, the positivity posterior contralateral (Ppc), which was also larger for abrupt onsets than for color singletons. Experiment 2 further demonstrated that when both the abrupt onset and color singleton were designed as targets, and thus required no attentional suppression, Ppc was elicited, but P_D was not. This corroborated the finding in Experiment 1 that the later P_D , not the early Ppc, reflected attentional suppression. Therefore, a more salient distractor demonstrates stronger early perceptual processing, can capture attention better and needs more attentional resources to be suppressed later. Based on these results, a three-stage hypothesis is proposed, in which the saliency of a distractor modulates processing at early perception, attentional capture, and suppression stages.

From eye to arrow: Attention capture by direct gaze requires more than just the eyes

Human attention is strongly attracted by direct gaze and sudden onset motion. The sudden direct-gaze effect refers to the processing advantage for targets appearing on peripheral faces that suddenly establish eye contact. Here, we investigate the necessity of social information for attention capture by (sudden onset) ostensive cues. Six experiments involving 204 participants applied (1) naturalistic faces, (2) arrows, (3) schematic eyes, (4) naturalistic eyes, or schematic facial configurations (5) without or (6) with head turn to an attention-capture paradigm. Trials started with two stimuli oriented towards the observer and two stimuli pointing into the periphery. Simultaneous to target presentation, one direct stimulus changed to averted and one averted stimulus changed to direct, yielding a 2 × 2 factorial design with direction and motion cues being absent or present. We replicated the (sudden) direct-gaze effect for photographic faces, but found no corresponding effects in Experiments 2-6. Hence, a holistic and socially meaningful facial context seems vital for attention capture by direct gaze. STATEMENT OF SIGNIFICANCE: The present study highlights the significance of context information for social attention. Our findings demonstrate that the direct-gaze effect, that is, the prioritization of direct gaze over averted gaze, critically relies on the presentation of a meaningful holistic and naturalistic facial context. This pattern of results is evidence in favor of early effects of surrounding social information on attention capture by direct gaze.

Meeting another's gaze shortens subjective time by capturing attention

Gaze directed at the observer (direct gaze) is an important and highly salient social signal with multiple effects on cognitive processes and behavior. It is disputed whether the effect of direct gaze is caused by attentional capture or increased arousal. Time estimation may provide an answer because attentional capture predicts an underestimation of time whereas arousal predicts an overestimation. In a temporal bisection task, observers were required to classify the duration of a stimulus as short or long. Stimulus duration was selected randomly between 988 and 1479 ms. When gaze was directed at the observer, participants underestimated stimulus duration, suggesting that effects of direct gaze are caused by attentional capture, not increased arousal. Critically, this effect was limited to dynamic stimuli where gaze appeared to move toward the participant. The underestimation was present with stimuli showing a full face, but also with stimuli showing only the eye region, inverted faces and high-contrast eye-like stimuli. However, it was absent with static pictures of full faces and dynamic nonfigurative stimuli. Because the effect of direct gaze depended on motion, which is common in naturalistic scenes, more consideration needs to be given to the ecological validity of stimuli in the study of social attention.

Making eye contact with a robot: Psychophysiological responses to eye contact with a human and with a humanoid robot

Previous research has shown that eye contact, in human-human interaction, elicits increased affective and attention related psychophysiological responses. In the present study, we investigated whether eye contact with a humanoid robot would elicit these responses. Participants were facing a humanoid robot (NAO) or a human partner, both physically present and looking at or away from the participant. The results showed that both in human-robot and human-human condition, eye contact versus averted gaze elicited greater skin conductance responses indexing autonomic arousal, greater facial zygomatic muscle responses (and smaller corrugator responses) associated with positive affect, and greater heart deceleration responses indexing attention allocation. With regard to the skin conductance and zygomatic responses, the human model's gaze direction had a greater effect on the responses as compared to the robot's gaze direction. In conclusion, eye contact elicits automatic affective and attentional reactions both when shared with a humanoid robot and with another human.

Gazing Without Eyes: A "Stare-in-the-Crowd" Effect Induced by Simple Geometric Shapes

Of the many effects that eye contact has, perhaps the most powerful is the stare-in-the-crowd effect, wherein faces are detected more readily when they look directly toward you. This is commonly attributed to others' eyes being especially salient visual stimuli, but here we ask whether stares-in-the-crowd might arise instead from a deeper property that the eyes (but not only the eyes) signify: the direction of others' attention and intentions. In fact, even simple geometric shapes can be seen as intentional, as when numerous randomly scattered cones are all consistently pointing at you. Accordingly, we show here that cones directed at the observer are detected faster (in fields of averted cones) than are cones averted away from the observer (in fields of directed cones). These results suggest that perceived intentionality itself captures attention-and that even in the absence of eyes, others' directed attention stands out in a crowd.

Socially Communicative Eye Contact and Gender Affect Memory

Because of their value as a socially communicative cue, researchers have strived to understand how the gaze of other people influences a variety of cognitive processes. Recent work in social attention suggests that the use of images of people in laboratory studies, as a substitute for real people, may not effectively test socially communicative aspects of eye gaze. As attention affects many other cognitive processes, it is likely that social attention between real individuals could also affect other cognitive processes, such as memory. However, from previous work alone, it is unclear whether, and if so how, socially communicative eye gaze affects memory. The present studies test the assumption that socially communicative aspects of eye gaze may impact memory by manipulating the eye gaze of a live speaker in the context of a traditional recognition paradigm used frequently in the laboratory. A female (Experiment 1) or male (Experiment 2) investigator read words aloud and varied whether eye contact was, or was not, made with a participant. With both female and male investigators, eye contact improved word recognition only for female participants and hindered word recognition in male participants. When a female investigator prolonged their eye contact (Experiment 3) to provide a longer opportunity to both observe and process the investigator’s eye gaze, the results replicated the findings from Experiments 1 and 2. The findings from Experiments 1–3 suggest that females interpret and use the investigator’s eye gaze differently than males. When key aspects from the previous experiments were replicated in a noncommunicative situation (i.e., when a video of a speaker is used instead of a live speaker; Experiment 4), the memory effects observed previously in response to eye gaze were eliminated. Together, these studies suggest that it is the socially communicative aspects of eye gaze from a real person that influence memory. The findings reveal the importance of using social cues that are communicative in nature (e.g., real people) when studying the relationship between social attention and memory.

Differential impact of trait, social, and attachment anxiety on the stare-in-the-crowd effect

Eye gaze conveys crucial information for social interactions, with straight versus averted gaze triggering distinct emotional and cognitive processes. The "stare-in-the-crowd" effect exemplifies such differential visual processing of gaze direction, in more recent reports also in interaction with head orientation. Besides aiming at replicating the "stare-in-the-crowd" effect by means of an eye gaze by head orientation interaction, the present study intended to for the first time testing its susceptibility to inter-individual differences in trait, social, and attachment anxiety. Our findings reveal a significant relation between the "stare-in-the-crowd" effect and social and attachment, but not trait anxiety, and therefore provide preliminary cues for personality influences on visual processing of eye gaze and head orientation.

Affective Eye Contact: An Integrative Review

In recent years, many studies have shown that perceiving other individuals' direct gaze has robust effects on various attentional and cognitive processes. However, considerably less attention has been devoted to investigating the affective effects triggered by eye contact. This article reviews research concerning the effects of others' gaze direction on observers' affective responses. The review focuses on studies in which affective reactions have been investigated in well-controlled laboratory experiments, and in which contextual factors possibly influencing perceivers' affects have been controlled. Two important themes emerged from this review. First, explicit affective evaluations of seeing another's direct versus averted gaze have resulted in rather inconsistent findings; some studies report more positive subjective feelings to direct compared to averted gaze, whereas others report the opposite pattern. These contradictory findings may be related, for example, to differences between studies in terms of the capability of direct-gaze stimuli to elicit feelings of self-involvement. Second, studies relying on various implicit measures have reported more consistent results; they indicate that direct gaze increases affective arousal, and more importantly, that eye contact automatically evokes a positively valenced affective reaction. Based on the review, possible psychological mechanisms for the positive affective reactions elicited by eye contact are described.

Early and late cortical responses to directly gazing faces are task dependent

Gender categorisation of human faces is facilitated when gaze is directed toward the observer (i.e., a direct gaze), compared with situations where gaze is averted or the eyes are closed (Macrae, Hood, Milne, Rowe, & Mason, Psychological Science, 13(5), 460-464, 2002). However, the temporal dynamics underlying this phenomenon remain to some extent unknown. Here, we used electroencephalography (EEG) to assess the neural correlates of this effect, focusing on the event-related potential (ERP) components known to be sensitive to gaze perception (i.e., P1, N170, and P3b). We first replicated the seminal findings of Macrae et al. (2002, Experiment 1) regarding facilitated gender discrimination, and subsequently measured the underlying neural responses. Our data revealed an early preferential processing of direct gaze as compared with averted gaze and closed eyes at the P1, which reverberated at the P3b (Experiment 2). Critically, using the same material, we failed to reproduce these effects when gender categorisation was not required (Experiment 3). Taken together, our data confirm that direct gaze enhances the early P1, as well as later cortical responses to face processing, although the effect appears to be task dependent.

Revealing the neural time-course of direct gaze processing via spatial frequency manipulation of faces

Direct gaze is a powerful social cue signalling the attention of another person toward oneself. Here we investigated the relevance of low spatial frequency (LSF) and high spatial frequency (HSF) in facial cues for direct gaze processing. We identified two distinct peaks in the ERP response, the N170 and N240 components. These two components were related to different stimulus conditions and influenced by different spatial frequencies. In particular, larger N170 and N240 amplitudes were observed for direct gaze than for averted gaze, but only in the N240 component was this effect modulated by spatial frequency, where it was reliant in LSF information. By contrast, larger N170 and N240 components were observed for faces than for non-facial stimuli, but this effect was only modulated by spatial frequency in the N170 component, where it relied on HSF information. The present study highlights the existence of two functionally distinct components related to direct gaze processing.

Atypical physiological orienting to direct gaze in low-functioning children with autism spectrum disorder

Reduced use of eye contact is a prominent feature in individuals with autism spectrum disorder (ASD). It has been proposed that direct gaze does not capture the attention of individuals with ASD. Experimental evidence is, however, mainly restricted to relatively high-functioning school-aged children or adults with ASD. This study investigated whether 2-5-year-old low-functioning children with severe ASD differ from control children in orienting to gaze stimuli, as measured with the heart rate deceleration response. Responses were measured to computerized presentations of dynamic shifts of gaze direction either toward (direct) or away (averted) from the observing child. The results showed a significant group by gaze direction interaction effect on heart rate responses (permuted P = .004), reflecting a stronger orienting response to direct versus averted gaze in typically developing (N = 17) and developmentally delayed (N = 16) children but not in children with ASD (N = 12). The lack of enhanced orienting response to direct gaze in the ASD group was not caused by a lack of looking at the eye region, as confirmed by eye tracking. The results suggest that direct gaze is not a socially salient, attention-grabbing signal for low-functioning children with ASD. Autism Res 2017, 10: 810-820. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.

Asymmetry in Gaze Direction Discrimination Between the Upper and Lower Visual Fields

Previous research has shown that gaze direction can only be accurately discriminated within parafoveal limits (∼5° eccentricity) along the horizontal visual field. Beyond this eccentricity, head orientation seems to influence gaze discrimination more than iris cues. The present study examined gaze discrimination performance in the upper visual field (UVF) and lower visual field (LVF), and whether head orientation affects gaze judgments beyond parafoveal vision. Direct and averted gaze faces, in frontal and deviated head orientations, were presented for 150 ms along the vertical meridian while participants maintained central fixation during gaze discrimination judgments. Gaze discrimination was above chance level at all but one eccentricity for the two gaze-head congruent conditions. In contrast, for the incongruent conditions, gaze was discriminated above chance only from -1.5° to +3°, with an asymmetry between the UVF and LVF. Beyond foveal vision, response rates were biased toward head orientation rather than iris eccentricity, occurring in the LVF for both head orientations, and in the UVF for frontal head views. These findings suggest that covert processing of gaze direction involves the integration of eyes and head cues, with congruency of these two social cues driving response differences between the LVF and the UVF.

Effects of Peripheral Eccentricity and Head Orientation on Gaze Discrimination

Visual search tasks support a special role for direct gaze in human cognition, while classic gaze judgment tasks suggest the congruency between head orientation and gaze direction plays a central role in gaze perception. Moreover, whether gaze direction can be accurately discriminated in the periphery using covert attention is unknown. In the present study, individual faces in frontal and in deviated head orientations with a direct or an averted gaze were flashed for 150 ms across the visual field; participants focused on a centred fixation while judging the gaze direction. Gaze discrimination speed and accuracy varied with head orientation and eccentricity. The limit of accurate gaze discrimination was less than ±6° eccentricity. Response times suggested a processing facilitation for direct gaze in fovea, irrespective of head orientation, however, by ±3° eccentricity, head orientation started biasing gaze judgments, and this bias increased with eccentricity. Results also suggested a special processing of frontal heads with direct gaze in central vision, rather than a general congruency effect between eye and head cues. Thus, while both head and eye cues contribute to gaze discrimination, their role differs with eccentricity.

Attention to eye contact in the West and East: autonomic responses and evaluative ratings

Eye contact has a fundamental role in human social interaction. The special appearance of the human eye (i.e., white sclera contrasted with a coloured iris) implies the importance of detecting another person's face through eye contact. Empirical studies have demonstrated that faces making eye contact are detected quickly and processed preferentially (i.e., the eye contact effect). Such sensitivity to eye contact seems to be innate and universal among humans; however, several studies suggest that cultural norms affect eye contact behaviours. For example, Japanese individuals exhibit less eye contact than do individuals from Western European or North American cultures. However, how culture modulates eye contact behaviour is unclear. The present study investigated cultural differences in autonomic correlates of attentional orienting (i.e., heart rate) and looking time. Additionally, we examined evaluative ratings of eye contact with another real person, displaying an emotionally neutral expression, between participants from Western European (Finnish) and East Asian (Japanese) cultures. Our results showed that eye contact elicited stronger heart rate deceleration responses (i.e., attentional orienting), shorter looking times, and higher ratings of subjective feelings of arousal as compared to averted gaze in both cultures. Instead, cultural differences in the eye contact effect were observed in various evaluative responses regarding the stimulus faces (e.g., facial emotion, approachability etc.). The rating results suggest that individuals from an East Asian culture perceive another's face as being angrier, unapproachable, and unpleasant when making eye contact as compared to individuals from a Western European culture. The rating results also revealed that gaze direction (direct vs. averted) could influence perceptions about another person's facial affect and disposition. These results suggest that cultural differences in eye contact behaviour emerge from differential display rules and cultural norms, as opposed to culture affecting eye contact behaviour directly at the physiological level.

Bodily movement of approach is detected faster than that of receding

The human visual system is efficient at detecting an approaching object. In detecting approaching human beings, bodily movement serves as a cue for the visual system to compute moving direction. On the basis of this knowledge, we hypothesized that bodily movement implying approach is detected faster than receding bodily movement even when only bodily movement is available as a clue to discerning motion direction. To examine this hypothesis, we conducted a visual search experiment in which participants searched for a point-light figure with approaching or receding walking movement. Results showed that an approaching point-light figure was detected faster than a receding one. This search asymmetry was eliminated when the figures were presented upside-down. These findings indicate the potency of bodily movement that implies approach in effectively capturing visuospatial attention.

Electrophysiological responses in mothers to their own and unfamiliar child's gaze information

An attachment bond between a mother and her child is one of the most intimate human relationships. It is important for a mother to be sensitive to her child's gaze direction because exchanging gaze information plays a vital role in their relationship. Furthermore, recent studies have revealed differential neural activation patterns in mothers when presented the faces of their own children or the unfamiliar child of other people. Based on these findings, in the present study, we investigated whether mothers show differential neural responses to gaze information of their own child compared to that of an unfamiliar child. To this end, event-related-potentials elicited by the faces of one's own or an unfamiliar child with straight or averted gaze directions were measured using an oddball-paradigm. The results showed that peak amplitudes of the N170 component were enlarged by viewing the straight gazes compared to the averted gazes of one's own child, but not of an unfamiliar child. When the gaze was directed straight, the P3 amplitude elicited by one's own child's face is smaller than that elicited by an unfamiliar child's face. P3s elicited in viewing one's own child's face with averted gaze and in viewing an unfamiliar child's face with straight gaze were positively correlated with state-anxiety. These results bolster the hypothesis that processing the gaze information of one's own child elicits differential neural activation compared to the gaze information of an other person's unfamiliar child at both perceptual and evaluative stages of face processing.

Attention Capture by Direct Gaze is Robust to Context and Task Demands

Eye-tracking was used to investigate whether gaze direction would influence the visual scanning of faces, when presented in the context of a full character, in different social settings, and with different task demands. Participants viewed individual computer agents against either a blank background or a bar scene setting, during both a free-viewing task and an attractiveness rating task for each character. Faces with a direct gaze were viewed longer than faces with an averted gaze regardless of body context, social settings, and task demands. Additionally, participants evaluated characters with a direct gaze as more attractive than characters with an averted gaze. These results, obtained with pictures of computer agents rather than real people, suggest that direct gaze is a powerful attention grabbing stimulus that is robust to background context or task demands.

Searching for a perceived gaze direction using eye tracking

The purpose of the current study was to use eye tracking to better understand the "stare-in-the-crowd effect"-the notion that direct gaze is more easily detected than averted gaze in a crowd of opposite-gaze distractors. Stimuli were displays of four full characters aligned across the monitor (one target and three distractors). Participants completed a visual search task in which they were asked to detect the location of either a direct gaze or an averted gaze target. Reaction time (RT) results indicated faster responses to direct than averted gaze only for characters situated in the far peripheral visual fields. Eye movements confirmed a serial search strategy (definitely ruling out any pop-out effects) and revealed different exploration patterns between hemifields. The latency before the first fixation on target strongly correlated with response RTs. In the LVF, that latency was also faster for direct than averted gaze targets, suggesting that the response asymmetry in favor of direct gaze stemmed from faster direct gaze target detection. In the RVF, however, the response bias to direct gaze seemed not due to a faster visual detection but rather to a different cognitive mechanism. Direct gaze targets were also responded to even faster when their position was congruent with the direction of gaze of distractors. These findings suggest that the detection asymmetry for direct gaze is highly dependent on target position and influenced by social contexts.