Quantifying the Wollaston Illusion

The Timing of Gaze Direction Perception: ERP Decoding and Task Modulation

Distinguishing the direction of another person's eye gaze is extremely important in everyday social interaction, as it provides critical information about people's attention and, therefore, intentions. The temporal dynamics of gaze processing have been investigated using event-related potentials (ERPs) recorded with electroencephalography (EEG). However, the moment at which our brain distinguishes the gaze direction (GD), irrespectively of other facial cues, remains unclear. To solve this question, the present study aimed to investigate the time course of gaze direction processing, using an ERP decoding approach, based on the combination of a support vector machine and error-correcting output codes. We recorded EEG in young healthy subjects, 32 of them performing GD detection and 34 conducting face orientation tasks. Both tasks presented 3D realistic faces with five different head and gaze orientations each: 30°, 15° to the left or right, and 0°. While the classical ERP analyses did not show clear GD effects, ERP decoding analyses revealed that discrimination of GD, irrespective of head orientation, started at 140 ms in the GD task and at 120 ms in the face orientation task. GD decoding accuracy was higher in the GD task than in the face orientation task and was the highest for the direct gaze in both tasks. These findings suggest that the decoding of brain patterns is modified by task relevance, which changes the latency and the accuracy of GD decoding.

Face masks have a limited effect on the feeling of being looked at

Introduction

Wearing face masks has been promoted as an effective measure to reduce the spread of COVID-19. Because face masks cover a major part of the face, they have detrimental effects on various aspects of social cognition. Yet, a highly important feature of the face is not occluded by face masks: the eyes. The eyes play an important role in social interactions: knowing where another person is looking is of central importance when interacting with others. Recent research has reported an attentional shift toward the eye region as a consequence of the widespread exposure to face masks. However, no study has yet investigated the influence of face masks on the perception of eye gaze direction. Here we investigated whether face masks have an effect on the feeling of being looked at. Assuming an attentional shift toward the eyes, we might expect more accurate gaze perception in faces wearing face masks.

Methods

Sixty-five participants decided for a series of realistic avatar faces whether each face was making eye contact or not. Half of the faces wore face masks, the other half did not. For each participant and separately for each condition (mask vs. no mask), we calculated the cone of direct gaze (CoDG), a commonly used measure to quantify the range of gaze angles within which an observer assumes mutual gaze.

Results

Contrary to our expectations, results show that mutual gaze is not recognized more accurately in masked faces. Rather, the CoDG was, on average, slightly wider for faces wearing masks compared to faces without masks.

Discussion

Notwithstanding the relatively small effect of face mask, these findings potentially have implications on our social interactions. If we inadvertently feel looked at by an onlooker, we may react inappropriately by reciprocating the alleged approach orientation.

Inverting the Wollaston Illusion: Gaze Direction Attracts Perceived Head Orientation

In the early 19th century, William H. Wollaston impressed the Royal Society of London with engravings of portraits. He manipulated facial features, such as the nose, and thereby dramatically changed the perceived gaze direction, although the eye region with iris and eye socket had remained unaltered. This Wollaston illusion can be thought of as head orientation attracting perceived gaze direction when the eye region is unchanged. In naturalistic viewing, the eye region changes with head orientation and typically produces a repulsion effect. Here we explore if there is a flip side to the illusion. Does the gaze direction also alter the perceived direction of the head? We used copies of the original drawings and a computer-rendered avatar as stimuli. Gaze direction does indeed alter perceived head orientation. Perceived head orientation is biased toward the direction of gaze.

The roles of gaze and head orientation in face categorization during rapid serial visual presentation

Little is known about how perceived gaze direction and head orientation may influence human categorization of visual stimuli as faces. To address this question, a sequence of unsegmented natural images, each containing a random face or a non-face object, was presented in rapid succession (stimulus duration: 91.7 ms per image) during which human observers were instructed to respond immediately to every face presentation. Faces differed in gaze and head orientation in 7 combinations - full-front views with perceived gaze (1) directed to the observer, (2) averted to the left, or (3) averted to the right, left ¾ side views with (4) direct gaze or (5) averted gaze, and right ¾ side views with (6) direct gaze or (7) averted gaze - were presented randomly throughout the sequence. We found highly accurate and rapid behavioural responses to all kinds of faces. Crucially, both perceived gaze direction and head orientation had comparable, non-interactive effects on response times, where direct gaze was responded faster than averted gaze by 48 ms and full-front view faster than ¾ side view also by 48 ms on average. Presentations of full-front faces with direct gaze led to an additive speed advantage of 96 ms to ¾ faces with averted gaze. The results reveal that the effects of perceived gaze direction and head orientation on the speed of face categorization probably depend on the degree of social relevance of the face to the viewer.