Gaze deflection reveals how gaze cueing is tuned to extract the mind behind the eyes

Unmasking social attention: The key distinction between social and non-social attention emerges in disengagement, not engagement

The debate surrounding whether social and non-social attention share the same mechanism has been contentious. While prior studies predominantly focused on engagement, we examined the potential disparity between social and non-social attention from both perspectives of engagement and disengagement, respectively. We developed a two-stage attention-shifting paradigm to capture both attention engagement and disengagement. Combining results from five eye-tracking experiments, we supported that the disengagement of social attention markedly outpaces that of non-social attention, while no significant discrepancy emerges in engagement. We uncovered that the faster disengagement of social attention came from its social nature by eliminating alternative explanations including broader fixation distribution width, reduced directional salience in the peripheral visual field, decreased cue-object categorical consistency, reduced perceived validity, and faster processing time. Our study supported that the distinction between social and non-social attention is rooted in attention disengagement, not engagement.

Perceived gaze dynamics in social interactions can alter (and even reverse) the perceived temporal order of events

Here's an all-too-familiar scenario: Person A is staring at person B, and then B turns toward A, and A immediately looks away (a phenomenon we call 'gaze deflection'). Beyond perceiving lower-level properties here - such as the timing of the eye/head turns - you can also readily perceive seemingly higher-level social dynamics: A got caught staring, and frantically looked away in embarrassment! It seems natural to assume that such social impressions are based on more fundamental representations of what happened when - but here we show that social gaze dynamics are unexpectedly powerful in that they can actually alter (and even reverse) the perceived temporal order of the underlying events. Across eight experiments, observers misperceived B as turning before A, when in fact they turned simultaneously - and even when B was turning after A. Additional controls confirmed that this illusion depends on visual processing (vs. being driven solely by higher-level interpretations), and that it is specific to the perception of social agents (vs. non-social objects). This demonstrates how social perception is tightly integrated into our perceptual experience of the world, and can have powerful consequences for one of the most basic properties that we can perceive: what happens when.

I prefer what you can see: The role of visual perspective-taking on the gaze-liking effect

Individuals' gaze on an object usually leads others to prefer that object, which is called the gaze-liking effect. However, it is still unclear whether this effect is driven by social factors (i.e., visual perspective-taking) or the domain-general processing (i.e., attention cueing). This research explored the mechanism of the gaze-liking effect by manipulating the objects' visibility to an avatar in six online one-shot experiments. The results showed that participants' affective evaluation for the object was modulated by the avatar's visual perspective. Specifically, the visible object to the avatar received a higher rating of liking degree. However, when the avatar was replaced with a non-social stimulus, the experimental effect was absent. Furthermore, the gaze-liking effect was robust while controlling for confounding factors such as the distance between the object and the avatar or type of stimuli. These findings provided convincing evidence that the gaze-liking effect involves a process of the other's visual experience and is not merely a by-product of the gaze-cueing effect.

What can evidence accumulation modelling tell us about human social cognition?

Evidence accumulation models are a series of computational models that provide an account for speeded decision-making. These models have been used extensively within the cognitive psychology literature to great success, allowing inferences to be drawn about the psychological processes that underlie cognition that are sometimes not available in a traditional analysis of accuracy or reaction time (RT). Despite this, there have been only a few applications of these models within the domain of social cognition. In this article, we explore several ways in which the study of human social information processing would benefit from application of evidence accumulation modelling. We begin first with a brief overview of the evidence accumulation modelling framework and their past success within the domain of cognitive psychology. We then highlight five ways in which social cognitive research would benefit from an evidence accumulation approach. This includes (1) greater specification of assumptions, (2) unambiguous comparisons across blocked task conditions, (3) quantifying and comparing the magnitude of effects in standardised measures, (4) a novel approach for studying individual differences, and (5) improved reproducibility and accessibility. These points are illustrated using examples from the domain of social attention. Finally, we outline several methodological and practical considerations, which should help researchers use evidence accumulation models productively. Ultimately, it will be seen that evidence accumulation modelling offers a well-developed, accessible, and commonly understood framework that can reveal inferences about cognition that may otherwise be out of reach in a traditional analysis of accuracy and RT. This approach, therefore, has the potential to substantially revise our understanding of social cognition.

Reduced gaze-cueing effect with neutral and emotional faces in adults with attention deficit/hyperactivity disorder

This study examined whether gaze shift of neutral and emotional faces triggers reflexive attention orienting in 45 adults with attention deficit/hyperactivity disorder (ADHD) and 45 age-, sex-, and intelligence quotient-matched typically developing (TD) adults. The cues changed from neutral to anger, fearful, or happy expressions under the emotional face condition. Participants were asked to detect a target that appeared to the left or right of the cue stimuli, as rapidly and accurately as possible. The results revealed a gaze-cueing effect, where the reaction time to the target was shorter under the "gaze-at-target" condition than under the "non-gaze-at-target" condition in both groups. Facial expressions did not modulate the gaze-cueing effect in either group. However, the magnitude of the gaze-cueing effect was smaller in the ADHD group than in the TD group. Contrary to our expectations, a larger gaze-cueing effect was observed in individuals with ADHD who exhibited more severe inattention. Our results suggest that adults with ADHD ineffectively orient their attention toward another's gaze. Moreover, difficulty with sustained and selective attention may be associated with a larger influence of gaze direction; this difficulty may play a role in social interaction problems.

Seeing social interactions

Seeing the interactions between other people is a critical part of our everyday visual experience, but recognizing the social interactions of others is often considered outside the scope of vision and grouped with higher-level social cognition like theory of mind. Recent work, however, has revealed that recognition of social interactions is efficient and automatic, is well modeled by bottom-up computational algorithms, and occurs in visually-selective regions of the brain. We review recent evidence from these three methodologies (behavioral, computational, and neural) that converge to suggest the core of social interaction perception is visual. We propose a computational framework for how this process is carried out in the brain and offer directions for future interdisciplinary investigations of social perception.

Aesthetic preferences for prototypical movements in human actions

A commonplace sight is seeing other people walk. Our visual system specializes in processing such actions. Notably, we are not only quick to recognize actions, but also quick to judge how elegantly (or not) people walk. What movements appear appealing, and why do we have such aesthetic experiences? Do aesthetic preferences for body movements arise simply from perceiving others' positive emotions? To answer these questions, we showed observers different point-light walkers who expressed neutral, happy, angry, or sad emotions through their movements and measured the observers' impressions of aesthetic appeal, emotion positivity, and naturalness of these movements. Three experiments were conducted. People showed consensus in aesthetic impressions even after controlling for emotion positivity, finding prototypical walks more aesthetically pleasing than atypical walks. This aesthetic prototype effect could be accounted for by a computational model in which walking actions are treated as a single category (as opposed to multiple emotion categories). The aesthetic impressions were affected both directly by the objective prototypicality of the movements, and indirectly through the mediation of perceived naturalness. These findings extend the boundary of category learning, and hint at possible functions for action aesthetics.

Effects of interpreting a dynamic geometric cue as gaze on attention allocation

Gaze is a powerful cue for directing attention. We investigate the interpretation of an abstract figure as gaze modulates its efficacy as an attentional cue. In each trial, two vertical lines on a central disk moved to one side (left or right). Independent of this "feature-cued" side, a target (black disk) subsequently appeared on one side. After 300 trials (phase 1), participants watched a video of a human avatar walking away. For one group, the avatar wore a helmet that visually matched the central disk and looked at black disks to either side. The other group's video was unrelated to the cueing task. After another 300 trials (phase 2), videos were swapped between groups; 300 further trials (phase 3) followed. In all phases, participants responded more quickly for targets appearing on the feature-cued side. There was a significant interaction between group and phase for reaction times: In phase 3, the group who had just watched the avatar with the helmet had a reduced advantage to the feature-cued side. Hence, interpreting the disk as a turning head seen from behind counteracts the cueing by the motion of the disk. This suggests that the mere perceptual interpretation of an abstract stimulus as gaze yields social cueing effects.

The influence of perceptual load on gaze-induced attentional orienting: The modulation of expectation

Humans tend to focus on others' gaze. Previous studies have shown that the gaze direction of others can induce corresponding attentional orienting. However, gaze cues have typically been presented alone in these studies. It is unclear how gaze cues induce observers' attention in complicated contexts with additional perceptual information. Therefore, the present study investigated gaze-induced attentional orienting at different levels of perceptual load. Results indicated that the attentional effect of the dynamic gaze cue (i.e., GCE: gaze cue effect) emerged under low perceptual load and disappeared under high perceptual load. The absence of GCE could not attribute to perceptual capacity exhaustion. Moreover, the influence of perceptual load on gaze-induced attentional orienting was modulated by individuals' expectation. Specifically, the GCE occurred under high perceptual load when the gaze cue was predictive (with individuals' expectation). These findings provide new evidence on the mode of gaze-induced attentional orienting under different perceptual load conditions.

Guilt-inducing interaction with others modulates subsequent attentional orienting via their gaze

Gaze direction can trigger social attentional orientation, characterised by a speeded reaction time in detecting targets appearing in a gazed-at location compared with those appearing in other locations. This is called the 'gaze-cueing effect' (GCE). Here, we investigated whether a feeling of guilt established through prior interaction with a cueing face could modulate the gaze-cueing effect. Participants first completed a guilt-induction task using a modified dot-estimation paradigm to associate the feeling of guilt with a specific face, after which the face that had established the binding relationship was used as the stimulus in a gaze-cueing task. The results showed that guilt-directed faces and control faces induce equal magnitudes of gaze-cueing effect in 200 ms of stimulus onset asynchrony (SOA), while guilt-directed faces induce a smaller gaze-cueing effect than control faces in 700 ms SOA. These findings provide preliminary evidence that guilt may modulate social attention triggered by eye gaze at a later stage of processing but not in the earlier stages.

Masked face is looking at me: Face mask increases the feeling of being looked at during the COVID-19 pandemic

Background

As the COVID-19 global pandemic unfolded, governments recommended wearing face masks as a protective measure. Recent studies have found that a face mask influences perception; but how it affects social perception, especially the judgment of being looked at, is still unknown. This study investigated how wearing a mask influences the judgment of gaze direction by conducting a cone of direct gaze (CoDG) task.

Methods

In Experiment 1, three types of masked faces were considered to investigate whether the effect of masks on CoDG is modulated by mask types. Experiment 2 was to further validate the results of Experiment 1 by adding a learning phase to help participants better distinguish N95 and surgical masks. Furthermore, to investigate whether the effect of masks derives from its social significance, a face with only the eye-region (a mouth-cut face) was used as the stimuli in Experiment 3.

Results

The results of Experiment 1 found that wearing masks widens the CoDG, irrespective of the mask type. Experiment 2 replicated the results of Experiment 1. Experiment 3 found that the CoDG of N95-masked faces was wider than the mouth-cut and non-masked faces, while no significant difference existed between the CoDG of mouth-cut and non-masked faces, illustrating that the influence of wearing masks on CoDG was due to high-level social significance rather than low-level facial feature information.

Conclusion

The results show that face mask increases the feeling of being looked at during the COVID-19 Pandemic. The present findings are of significance for understanding the impact of wearing masks on human social cognition in the context of COVID-19.

Evidence for a two-step model of social group influence

Social group influence plays an important role in societally relevant phenomena such as rioting and mass panic. One way through which groups influence individuals is by directing their gaze. Evidence that gaze following increases with group size has typically been explained in terms of strategic processes. Here, we tested the role of reflexive processes. In an ecologically valid virtual reality task, we found that participants were more likely to follow the group’s gaze when more people looked, even though they knew the group provided no relevant information. Interestingly, participants also sometimes changed their mind after starting to follow the gaze of the group, indicating that automatic imitation can be overruled by strategic processes. This suggests that social group influence is best explained by a two-step model in which bottom-up imitative processes first elicit a reflexive tendency to imitate, before top-down strategic processes determine whether to execute or inhibit this reflex.

•

Groups influence human behavior in two stages

•

First, groups elicit a reflexive tendency to imitate

•

Second, strategic processes decide to execute or inhibit this reflex

•

Social group conformity may be more automatic than previously thought

Rapid detection of social interactions is the result of domain general attentional processes

Using visual search displays of interacting and non-interacting pairs, it has been demonstrated that detection of social interactions is facilitated. For example, two people facing each other are found faster than two people with their backs turned: an effect that may reflect social binding. However, recent work has shown the same effects with non-social arrow stimuli, where towards facing arrows are detected faster than away facing arrows. This latter work suggests a primary mechanism is an attention orienting process driven by basic low-level direction cues. However, evidence for lower level attentional processes does not preclude a potential additional role of higher-level social processes. Therefore, in this series of experiments we test this idea further by directly comparing basic visual features that orient attention with representations of socially interacting individuals. Results confirm the potency of orienting of attention via low-level visual features in the detection of interacting objects. In contrast, there is little evidence for the representation of social interactions influencing initial search performance.

Increased gaze cueing of attention during COVID-19 lockdown

Affiliation with others is a basic human need. The lockdown implemented for counteracting the COVID-19 pandemic has determined an unprecedented situation of social deprivation, forcing individuals to dramatically reduce face-to-face interactions. This, in turn, has caused relevant consequences on psychological well-being. However, the impact of lockdown-related social isolation on basic cognitive processes is still largely unknown. Here, we focus on social attention and address gaze cueing, namely the ability to shift attention in response to the gaze of others. This is a hard-wired cognitive mechanism critically supporting the establishment of social interactions and pervasive relationships among individuals. Our results show a stronger gaze-cueing effect during, rather than after, the lockdown, whose magnitude was positively correlated with social isolation distress. These findings indicate that, in a condition of prolonged social deprivation, orienting of attention may be shaped by hypersensitivity to social cues, likely due to the strive to reconnect with others.

•

The impact of COVID-19 lockdown on cognitive processes is still largely unexplored

•

We focus on gaze cueing of attention as a building block of social interaction

•

Gaze cueing was larger during the lockdown than after the lockdown

•

Social deprivation is associated with increased sensitivity to the eyes of others

Face Masks Do Not Alter Gaze Cueing of Attention: Evidence From the COVID-19 Pandemic

Interacting with others wearing a face mask has become a regular worldwide practice since the beginning of the COVID-19 pandemic. However, the impact of face masks on cognitive mechanisms supporting social interaction is still largely unexplored. In the present work, we focused on gaze cueing of attention, a phenomenon tapping the essential ability which allows individuals to orient their attentional resources in response to eye gaze signals coming from others. Participants from both a European (i.e., Italy; Experiment 1) and an Asian (i.e., China; Experiment 2) country were involved, namely two countries in which the daily use of face masks before COVID-19 pandemic was either extremely uncommon or frequently adopted, respectively. Both samples completed a task in which a peripheral target had to be discriminated while a task irrelevant averted gaze face, wearing a mask or not, acted as a central cueing stimulus. Overall, a reliable and comparable gaze cueing emerged in both experiments, independent of the mask condition. These findings suggest that gaze cueing of attention is preserved even when the person perceived is wearing a face mask.

Cross-cultural asymmetries in oculomotor interference elicited by gaze distractors belonging to Asian and White faces

The averted gaze of others triggers reflexive attentional orienting in the corresponding direction. This phenomenon can be modulated by many social factors. Here, we used an eye-tracking technique to investigate the role of ethnic membership in a cross-cultural oculomotor interference study. Chinese and Italian participants were required to perform a saccade whose direction might be either congruent or incongruent with the averted-gaze of task-irrelevant faces belonging to Asian and White individuals. The results showed that, for Chinese participants, White faces elicited a larger oculomotor interference than Asian faces. By contrast, Italian participants exhibited a similar oculomotor interference effect for both Asian and White faces. Hence, Chinese participants found it more difficult to suppress eye-gaze processing of White rather than Asian faces. The findings provide converging evidence that social attention can be modulated by social factors characterizing both the face stimulus and the participants. The data are discussed with reference to possible cross-cultural differences in perceived social status.

Motive on the mind: Explanatory preferences at multiple stages of the legal-investigative process

Much work has investigated explanatory preferences for things like animals and artifacts, but how do explanation preferences manifest in everyday life? Here, we focus on the criminal justice system as a case study. In this domain, outcomes critically depend on how actors in the system (e.g., lawyers, jurors) generate and interpret explanations. We investigate lay preferences for two difference classes of information: information that appeals to opportunistic aspects of a crime (i.e., how the culprit could have committed the crime) vs. motivational aspects of that crime (i.e., the purpose for committing the crime). In two studies, we demonstrate that people prefer 'motive' accounts of crimes (analogous to a teleology preference) at different stages of the investigative process. In an additional two studies we demonstrate that these preferences are context-sensitive: namely, we find that 'motive' information tends to be more incriminating and less exculpatory. We discuss these findings in light of a broad literature on the cognitive basis of explanatory preferences; specifically, we draw analogy to preferences for teleological vs. mechanistic explanations. We also discuss implications for the criminal justice system.

Hidden intentions: Visual awareness prioritizes perceived attention even without eyes or faces

Eye contact is a powerful social signal, and it readily captures attention. Recent work has suggested that direct gaze is prioritized even unconsciously: faces rendered invisible via interocular suppression enter awareness faster when they look directly at (vs. away from) you. Such effects may be driven in a relatively low level way by the special visual properties of eyes, per se, but here we asked whether they might instead arise from the perception of a deeper property: being the focus of another agent's attention and/or intentions. We report five experiments which collectively explore whether visual awareness also prioritizes distinctly non-eye-like stimuli that nevertheless convey directedness. We first showed that directed (vs. averted) 'mouth' shapes also break through into awareness faster, after being rendered invisible by continuous flash suppression - a direct 'gaze' effect without any eyes. But such effects could still be specific to faces (if not eyes), so we next asked whether the prioritization of directed intentions would still occur even for stimuli that have no faces at all. In fact, even simple geometric shapes can be seen as intentional, as when numerous randomly scattered cones are all consistently pointing at you. And indeed, even such directed (vs. averted) cones entered awareness faster - a direct 'gaze' effect without any facial cues. Additional control experiments ruled out effects of both symmetry and response biases. We conclude that the perception of directed intentions is sufficient to boost objects into awareness, and that putative eye-contact effects might instead reflect more general phenomena of 'mind contact'.