Mentalizing eye contact with a face on a video: Gaze direction does not influence autonomic arousal

Autonomic and facial electromyographic responses to watching eyes

We measured participants' psychophysiological responses and gaze behavior while viewing a stimulus person's direct and averted gaze in three different conditions manipulating the participants' experience of being watched. The results showed that skin conductance responses and heart rate deceleration responses were greater to direct than averted gaze only in the condition in which the participants had the experience of being watched by the other individual. In contrast, gaze direction had no effects on these responses when the participants were manipulated to believe that the other individual could not watch them or when the stimulus person was presented in a pre-recorded video. Importantly, the eye tracking measures showed no differences in participants' looking behavior between these stimulus presentation conditions. The results of facial electromyography responses suggested that direct gaze elicited greater zygomatic and periocular responses than averted gaze did, independent of the presentation condition. It was concluded that the affective arousal and attention-orienting indexing autonomic responses to eye contact are driven by the experience of being watched. In contrast, the facial responses seem to reflect automatized affiliative responses which can be elicited even in conditions in which seeing another's direct gaze does not signal that the self is being watched.

Psychophysiological responses to eye contact with a humanoid robot: Impact of perceived intentionality

Eye contact with a social robot has been shown to elicit similar psychophysiological responses to eye contact with another human. However, it is becoming increasingly clear that the attention- and affect-related psychophysiological responses differentiate between direct (toward the observer) and averted gaze mainly when viewing embodied faces that are capable of social interaction, whereas pictorial or pre-recorded stimuli have no such capability. It has been suggested that genuine eye contact, as indicated by the differential psychophysiological responses to direct and averted gaze, requires a feeling of being watched by another mind. Therefore, we measured event-related potentials (N170 and frontal P300) with EEG, facial electromyography, skin conductance, and heart rate deceleration responses to seeing a humanoid robot's direct versus averted gaze, while manipulating the impression of the robot's intentionality. The results showed that the N170 and the facial zygomatic responses were greater to direct than to averted gaze of the robot, and independent of the robot's intentionality, whereas the frontal P300 responses were more positive to direct than to averted gaze only when the robot appeared intentional. The study provides further evidence that the gaze behavior of a social robot elicits attentional and affective responses and adds that the robot's seemingly autonomous social behavior plays an important role in eliciting higher-level socio-cognitive processing.

Examination of gaze behaviour in social anxiety disorder using a virtual reality eye-tracking paradigm: protocol for a casecontrol study

INTRODUCTION

Social anxiety disorder (SAD) has an early onset, a high lifetime prevalence, and may be a risk factor for developing other mental disorders. Gaze behaviour is considered an aberrant feature of SAD. Eye-tracking, a novel technology device, enables recording eye movements in real time, making it a direct and objective measure of gaze behaviour. Virtual reality (VR) is a promising tool for assessment and diagnostic purposes. Developing an objective screening tool based on examination of gaze behaviour in SAD may potentially aid early detection. The objective of this current study is, therefore to examine gaze behaviour in SAD utilising VR.

METHODS AND ANALYSIS

A case-control study design is employed in which a clinical sample of 29 individuals with SAD will be compared with a matched healthy control group of 29 individuals. In the VR-based eye-tracking paradigm, participants will be presented to stimuli consisting of high-res 360° 3D stereoscopic videos of three social-evaluative tasks designed to elicit social anxiety. The study will investigate between-group gaze behaviour differences during stimuli presentation.

ETHICS AND DISSEMINATION

The study has been approved by the National Committee on Health Research Ethics for the Capital Region of Denmark (H-22041443). The study has been preregistered on OSF registries: https://doi.org/10.17605/OSF.IO/XCTAKAll participants will be provided with written and oral information. Informed consent is required for all the participants. Participation is voluntarily, and the participants can at any time terminate their participation without any consequences. Study results; positive, negative or inconclusive will be published in relevant scientific journals.

Skin conductance, facial EMG, and heart rate responses in multi-person gaze interactions

Previous literature has reported enhanced affective and attentional responses to faces with a direct vs. averted gaze. Typically, in these studies, only single faces were presented. However, daily social encounters often involve interaction with more than just one person. By employing an experimental set-up in which the participants believed they were interacting with two other persons, the present study, for the first time, investigated participants' skin conductance, facial electromyographic (EMG), and heart rate deceleration responses in multi-person eye contact situations. Responses were measured in two different social contexts; i) when the participants observed eye contact between two other persons ('vicarious eye contact effect'), and ii) when the participants themselves received direct gaze either from one or two persons. The results showed that the skin conductance, facial EMG, and heart rate deceleration responses elicited by observing two other persons making eye contact did not differ from those elicited by observing one person looking at the other while the other person was not reciprocating with their gaze. As a novel finding, the results showed that receiving direct gaze from two persons elicited greater affective arousal and zygomatic EMG, but smaller heart rate deceleration responses in participants than receiving direct gaze from one person only. The findings are thoroughly discussed and it is concluded that physiological responses in multi-person interaction contexts are influenced by many social effects between the interactors and can be markedly different from those observed in two-person interactions.

Attention to live eye contact in adolescents with autism spectrum disorder

A number of studies have reported diminished attention to the eyes in individuals with autism spectrum disorder (ASD). These studies predominantly used static images of faces as stimuli. Recent studies, however, have shown enhanced response to eye contact in typically developing (TD) individuals when they observe a person in a live interaction. We investigated physiological orienting to perceived eye contact in adolescents with ASD and TD adolescents when they observed a person in live interaction or viewed a photograph of the same person's face. We measured heart rate (HR) deceleration as an index of attentional orienting. Adolescents with ASD, as well as TD adolescents, showed significant HR deceleration for the direct gaze compared to an averted gaze in the live condition, but not in the photographic condition. The results suggest an intact response to perceived eye contact in individuals with ASD during a live face-to-face interaction. LAY SUMMARY: Individuals with autism spectrum disorder (ASD) have a different eye gaze pattern when observing photographic faces. However, little is known about how individuals with ASD process a real person's face. We measured heart rate (HR) and found that adolescents with ASD showed the typical decline in HR when they made eye contact with a real person, which suggests that both groups of individuals directed their attention to eye contact in a live face-to-face interaction.

Making eye contact with a robot: Psychophysiological responses to eye contact with a human and with a humanoid robot

Previous research has shown that eye contact, in human-human interaction, elicits increased affective and attention related psychophysiological responses. In the present study, we investigated whether eye contact with a humanoid robot would elicit these responses. Participants were facing a humanoid robot (NAO) or a human partner, both physically present and looking at or away from the participant. The results showed that both in human-robot and human-human condition, eye contact versus averted gaze elicited greater skin conductance responses indexing autonomic arousal, greater facial zygomatic muscle responses (and smaller corrugator responses) associated with positive affect, and greater heart deceleration responses indexing attention allocation. With regard to the skin conductance and zygomatic responses, the human model's gaze direction had a greater effect on the responses as compared to the robot's gaze direction. In conclusion, eye contact elicits automatic affective and attentional reactions both when shared with a humanoid robot and with another human.

Psychophysiological responses to eye contact in a live interaction and in video call

Another person's gaze directed to oneself elicits autonomic arousal and facial reactions indicating positive affect in its observer. These effects have only been found to occur with mutual, live eye contact and not in response to direct gaze pictures or when the observer believes that the live person cannot see them. The question remains whether the physical presence of the other person is necessary for these effects. We measured psychophysiological responses to another person's direct versus averted gaze in three conditions: live interaction, bidirectional video call, and watching a mere video. Autonomic arousal was measured with skin conductance responses and facial reactions with facial electromyography. In the live and video call conditions, but not in the mere video condition, direct gaze increased autonomic arousal in comparison to averted gaze. In all three conditions, however, direct gaze elicited positive affective facial reactions. Therefore, an experience of being seen is essential for the autonomic reactions but not for the facial responses that are elicited by another person's direct gaze. Most importantly, the results suggest that the physical presence or proximity of the other person is not necessary for these psychophysiological responses to eye contact.

The Role of Eye Gaze During Natural Social Interactions in Typical and Autistic People

Social interactions involve complex exchanges of a variety of social signals, such as gaze, facial expressions, speech and gestures. Focusing on the dual function of eye gaze, this review explores how the presence of an audience, communicative purpose and temporal dynamics of gaze allow interacting partners to achieve successful communication. First, we focus on how being watched modulates social cognition and behavior. We then show that the study of interpersonal gaze processing, particularly gaze temporal dynamics, can provide valuable understanding of social behavior in real interactions. We propose that the Interpersonal Gaze Processing model, which combines both sensing and signaling functions of eye gaze, provides a framework to make sense of gaze patterns in live interactions. Finally, we discuss how autistic individuals process the belief in being watched and interpersonal dynamics of gaze, and suggest that systematic manipulation of factors modulating gaze signaling can reveal which aspects of social eye gaze are challenging in autism.

Affective Eye Contact: An Integrative Review

In recent years, many studies have shown that perceiving other individuals' direct gaze has robust effects on various attentional and cognitive processes. However, considerably less attention has been devoted to investigating the affective effects triggered by eye contact. This article reviews research concerning the effects of others' gaze direction on observers' affective responses. The review focuses on studies in which affective reactions have been investigated in well-controlled laboratory experiments, and in which contextual factors possibly influencing perceivers' affects have been controlled. Two important themes emerged from this review. First, explicit affective evaluations of seeing another's direct versus averted gaze have resulted in rather inconsistent findings; some studies report more positive subjective feelings to direct compared to averted gaze, whereas others report the opposite pattern. These contradictory findings may be related, for example, to differences between studies in terms of the capability of direct-gaze stimuli to elicit feelings of self-involvement. Second, studies relying on various implicit measures have reported more consistent results; they indicate that direct gaze increases affective arousal, and more importantly, that eye contact automatically evokes a positively valenced affective reaction. Based on the review, possible psychological mechanisms for the positive affective reactions elicited by eye contact are described.