Trajectories of social vision: Eye contact increases saccadic curvature

Deviated Saccadic Trajectory as a Biometric Signature of Glaucoma

Purpose

To investigate whether the trajectories of saccadic eye movements (SEMs) significantly differ between glaucoma patients and controls.

Methods

SEMs were recorded by video-based infrared oculography in 53 patients with glaucoma and 41 age-matched controls. Participants were asked to bilaterally view 24°-horizontal, 14°-vertical, and 20°-diagonal eccentric Goldmann III-sized stimuli. SEMs were evaluated with respect to the saccadic reaction time (SRT), the mean velocity, amplitude, and two novel measures: departure angle (DA) and arrival angle (AA). These parameters were compared between the groups and the associations of SEM parameters with glaucoma parameters and integrated visual field defects were investigated.

Results

Glaucoma patients exhibited increased mean SRT, DA, and AA values compared with controls for 14°-vertical visual targets (P = 0.05, P < 0.01, and P < 0.01, respectively). The SRT, DA, and AA were significantly associated with the mean and pattern standard deviations of perimetry and with the mean RNFL thickness by OCT (all P < 0.001). Glaucoma was associated with the AA (P = 0.05) and both the SRT (P = 0.01) and DA (P = 0.04) were associated with integrated visual field defects.

Conclusions

The saccadic trajectories of glaucoma patients depart in an erroneous path and compensate the disparity by deviating the trajectory at arrival.

Translational Relevance

The initial deviation that we observed (despite continuous exposure to the stimulus) suggests the disoriented spatial perception of glaucoma patients which may be relevant to difficulties encountered daily.

Exploring the Social Environment with the Eyes: A Review of the Impact of Facial Stimuli on Saccadic Trajectories

Eye movement parameters can be highly informative regarding how people explore the social environment around them. This theoretical review examines how human faces and their features (e.g., eye-gaze direction, emotional expressions) can modulate saccadic trajectories. In the first part, studies in which facial stimuli were presented in a central location, such as during a face-to-face social interaction, are illustrated. The second part focuses on studies in which facial stimuli were placed in the periphery. Together, these works confirm the presence of an intriguing link between eye movements and facial processing, and invite consideration of saccadic trajectories as a useful (and still underused) opportunity to track ongoing mechanisms that support the social vision. Some directions for future research are also discussed.

Face masks inhibit facial cues for approachability and trustworthiness: an eyetracking study

Wearing face masks during the Covid-19 pandemic has undeniable benefits from our health perspective. However, the interpersonal costs on social interactions may have been underappreciated. Because masks obscure critical facial regions signaling approach/avoidance intent and social trust, this implies that facial inference of approachability and trustworthiness may be severely discounted. Here, in our eyetracking experiment, we show that people judged masked faces as less approachable and trustworthy. Further analyses showed that the attention directed towards the eye region relative to the mouth region mediated the effect on approachability, but not on trustworthiness. This is because for masked faces, with the mouth region obscured, visual attention is then automatically diverted away from the mouth and towards the eye region, which is an undiagnostic cue for judging a target's approachability. Together, these findings support that mask-wearing inhibits the critical facial cues needed for social judgements.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12144-022-03705-8.

Toward an Attentive Robotic Architecture: Learning-Based Mutual Gaze Estimation in Human–Robot Interaction

Social robotics is an emerging field that is expected to grow rapidly in the near future. In fact, it is increasingly more frequent to have robots that operate in close proximity with humans or even collaborate with them in joint tasks. In this context, the investigation of how to endow a humanoid robot with social behavioral skills typical of human–human interactions is still an open problem. Among the countless social cues needed to establish a natural social attunement, this article reports our research toward the implementation of a mechanism for estimating the gaze direction, focusing in particular on mutual gaze as a fundamental social cue in face-to-face interactions. We propose a learning-based framework to automatically detect eye contact events in online interactions with human partners. The proposed solution achieved high performance both in silico and in experimental scenarios. Our work is expected to be the first step toward an attentive architecture able to endorse scenarios in which the robots are perceived as social partners.

Direct Gaze Holds Attention, but Not in Individuals with Obsessive-Compulsive Disorder

The attentional response to eye-gaze stimuli is still largely unexplored in individuals with obsessive-compulsive disorder (OCD). Here, we focused on an attentional phenomenon according to which a direct-gaze face can hold attention in a perceiver. Individuals with OCD and a group of matched healthy controls were asked to discriminate, through a speeded manual response, a peripheral target. Meanwhile, a task-irrelevant face displaying either direct gaze (in the eye-contact condition) or averted gaze (in the no-eye-contact condition) was also presented at the centre of the screen. Overall, the latencies were slower for faces with direct gaze than for faces with averted gaze; however, this difference was reliable in the healthy control group but not in the OCD group. This suggests the presence of an unusual attentional response to direct gaze in this clinical population.

Cross-cultural asymmetries in oculomotor interference elicited by gaze distractors belonging to Asian and White faces

The averted gaze of others triggers reflexive attentional orienting in the corresponding direction. This phenomenon can be modulated by many social factors. Here, we used an eye-tracking technique to investigate the role of ethnic membership in a cross-cultural oculomotor interference study. Chinese and Italian participants were required to perform a saccade whose direction might be either congruent or incongruent with the averted-gaze of task-irrelevant faces belonging to Asian and White individuals. The results showed that, for Chinese participants, White faces elicited a larger oculomotor interference than Asian faces. By contrast, Italian participants exhibited a similar oculomotor interference effect for both Asian and White faces. Hence, Chinese participants found it more difficult to suppress eye-gaze processing of White rather than Asian faces. The findings provide converging evidence that social attention can be modulated by social factors characterizing both the face stimulus and the participants. The data are discussed with reference to possible cross-cultural differences in perceived social status.

Is Face Age Mapped Asymmetrically onto Space? Insights from a SNARC-like Task

The magnitude associated with a stimulus can be spatially connoted, with relatively smaller and larger magnitudes that would be represented on the left and on the right side of space, respectively. According to recent evidence, this space–magnitude association could reflect specific brain asymmetries. In this study, we explored whether such an association can also emerge for face age, assuming that responders should represent relatively younger and older adult faces on the left and on the right, respectively. A sample of young adults performed a speeded binary classification task aimed at categorising the age of a centrally placed adult face stimulus as either younger or older than the age of a reference face. A left-side and a right-side response key were used to collect manual responses. Overall, older faces were categorised faster than younger faces, and response latencies decreased with the absolute difference between the age of the target stimulus and the age of the reference, in line with a distance effect. However, no evidence of a left-to-right spatial representation of face age emerged. Taken together, these results suggest that face age is mapped onto space differently from other magnitudes.

Eye contact effect: The role of vagal regulation and reactivity, and self-regulation of attention

Eye contact is a crucial aspect of social interactions that may enhance an individual’s cognitive performance (i.e. the eye contact effect) or hinder it (i.e. face-to-face interference effect). In this paper, I focus on the influence of eye contact on cognitive performance in tasks engaging executive functions. I present a hypothesis as to why some individuals benefit from eye contact while others do not. I propose that the relations between eye contact and executive functioning are modulated by an individual’s autonomic regulation and reactivity and self-regulation of attention. In particular, I propose that individuals with more optimal autonomic regulation and reactivity, and more effective self-regulation of attention benefit from eye contact. Individuals who are less well regulated and over- or under-reactive and who do not employ effective strategies of self-regulation of attention may not benefit from eye contact and may perform better when eye contact is absent. I present some studies that justify the proposed hypothesis and point to a method that could be employed to test them. This approach could help to better understand the complex mechanisms underlying the individual differences in participant’s cognitive performance during tasks engaging executive functions.

Eye contact boosts the reflexive component of overt gaze following

Establishing eye contact with an individual can subsequently lead to a stronger gaze-mediated orienting effect. However, studies exploring this phenomenon have, so far, only assessed manual responses and focused on covert attention - namely, without eye movements. Here, in two experiments, we explored for the first time whether eye contact can also impact on overt attention in an oculomotor task. This approach has two main advantages, in that it relies on more sensitive, online measures of attention allocation and it better mimics real life settings. Participants performed leftwards and rightwards eye movements in response to a central cue. Furthermore, a task-irrelevant central face established - or not - eye contact with the participant, and then averted its gaze either leftwards or rightwards. Hence, eye movement direction was either congruent or incongruent with that of the gaze stimulus. In both experiments, a gaze following behaviour emerged - specifically, smaller saccadic latencies and a greater accuracy emerged on congruent than on incongruent trials - but its magnitude was not modulated by eye contact. However, in Experiment 2 - in which the different eye contact conditions were presented intermixed rather than blocked, thus making eye contact contextually salient - eye contact led to an overall decrement of saccadic latencies and enhanced the reflexive component of gaze following. Taken together, these results provide novel evidence indicating that eye contact can impact on both eye movements programming and overt gaze following mechanisms, at least when eye contact is made contextually salient.

Inferring Interactivity From Gaze Patterns During Triadic Person-Object-Agent Interactions

Observing others' gaze informs us about relevant matters in the environment. Humans' sensitivity to gaze cues and our ability to use this information to focus our own attention is crucial to learning, social coordination, and survival. Gaze can also be a deliberate social signal which captures and directs the gaze of others toward an object of interest. In the current study, we investigated whether the intention to actively communicate one's own attentional focus can be inferred from the dynamics of gaze alone. We used a triadic gaze interaction paradigm based on the recently proposed classification of attentional states and respective gaze patterns in person-object-person interactions, the so-called "social gaze space (SGS)." Twenty-eight participants interacted with a computer controlled virtual agent while they assumed to interact with a real human. During the experiment, the virtual agent engaged in various gaze patterns which were determined by the agent's attentional communicative state, as described by the concept of SGS. After each interaction, participants were asked to judge whether the other person was trying to deliberately interact with them. Results show that participants were able to infer the communicative intention solely from the agent's gaze behavior. The results substantiate claims about the pivotal role of gaze in social coordination and relationship formation. Our results further reveal that social expectations are reflected in differential responses to the displayed gaze patterns and may be crucial for impression formation during gaze-based interaction. To the best of our knowledge, this is the first study to document the experience of interactivity in continuous and contingent triadic gaze interactions.

On the role of eye contact in gaze cueing

Most experimental protocols examining joint attention with the gaze cueing paradigm are "observational" and "offline", thereby not involving social interaction. We examined whether within a naturalistic online interaction, real-time eye contact influences the gaze cueing effect (GCE). We embedded gaze cueing in an interactive protocol with the iCub humanoid robot. This has the advantage of ecological validity combined with excellent experimental control. Critically, before averting the gaze, iCub either established eye contact or not, a manipulation enabled by an algorithm detecting position of the human eyes. For non-predictive gaze cueing procedure (Experiment 1), only the eye contact condition elicited GCE, while for counter-predictive procedure (Experiment 2), only the condition with no eye contact induced GCE. These results reveal an interactive effect of strategic (gaze validity) and social (eye contact) top-down components on the reflexive orienting of attention induced by gaze cues. More generally, we propose that naturalistic protocols with an embodied presence of an agent can cast a new light on mechanisms of social cognition.

The "Social Gaze Space": A Taxonomy for Gaze-Based Communication in Triadic Interactions

Humans substantially rely on non-verbal cues in their communication and interaction with others. The eyes represent a “simultaneous input-output device”: While we observe others and obtain information about their mental states (including feelings, thoughts, and intentions-to-act), our gaze simultaneously provides information about our own attention and inner experiences. This substantiates its pivotal role for the coordination of communication. The communicative and coordinative capacities – and their phylogenetic and ontogenetic impacts – become fully apparent in triadic interactions constituted in its simplest form by two persons and an object. Technological advances have sparked renewed interest in social gaze and provide new methodological approaches. Here we introduce the ‘Social Gaze Space’ as a new conceptual framework for the systematic study of gaze behavior during social information processing. It covers all possible categorical states, namely ‘partner-oriented,’ ‘object-oriented,’ ‘introspective,’ ‘initiating joint attention,’ and ‘responding joint attention.’ Different combinations of these states explain several interpersonal phenomena. We argue that this taxonomy distinguishes the most relevant interactional states along their distinctive features, and will showcase the implications for prominent social gaze phenomena. The taxonomy allows to identify research desiderates that have been neglected so far. We argue for a systematic investigation of these phenomena and discuss some related methodological issues.