Integration of Facial Expression and Gaze Direction in Individuals with a High Level of Autistic Traits

Exploring the spatial interference effects elicited by social and non-social targets: A conditional accuracy function approach

Recent studies employing the spatial interference paradigm reveal qualitative differences in congruency effects between gaze and arrow targets. Typically, arrows produce a standard congruency effect (SCE), with faster responses when target direction aligns with its location. Conversely, gaze targets often lead to a reversed congruency effect (RCE), where responses are slower in similar conditions. We explored this dissociation using the Conditional Accuracy Function (CAF) to assess accuracy across reaction time bins. Using a hierarchical linear mixed modelling approach to compare cropped eyes, and full faces as social stimuli, and arrows as non-social stimuli, we synthesized findings from 11 studies, which led to three distinct models. The results showed that with non-social targets, incongruent trials exhibited lower accuracy rates in the first bin than in subsequent bins, while congruent trials maintained stable accuracy throughout the distribution. Conversely, social targets revealed a dissociation within the fastest responses; alongside a general reduction in accuracy for both congruency conditions, congruent trials resulted in even lower accuracy rates than incongruent ones. These results suggest with gaze targets that additional information, perhaps social, in addition to the automatic capture by the irrelevant target location, is being processed during the earlier stages of processing.

Eye gaze is not unique: The reversed congruency effect on gaze and tongue targets

In the spatial Stroop task, an arrow target produces a spatial Stroop effect, whereas a gaze target elicits a reversed congruency effect. The reversed congruency effect has been explained by the unique attentional mechanisms of eye gaze. However, recent studies have shown that not only gaze but arrow targets produced a reversed congruency effect when embedded in a complex background. The present study investigated whether non-gaze targets produce a reversed congruency effect. In Experiments 1 and 2, we used the tongue, which is not commonly used to indicate spatial directions in daily life, as a target in the spatial Stroop task, in addition to the conventional gaze and arrows. In Experiment 3, we used arrow stimuli embedded in a complex background as a target. Participants judged the left/right direction of the target presented in the left or right visual field. Although arrow and gaze targets replicated previous findings (spatial Stroop and reversed congruency effect, respectively), the tongue target produced a reversed congruency effect (Experiments 1 and 2). The spatial Stroop effect of arrow targets disappeared when they were in a complex background (Experiment 3). These results are inconsistent with previous accounts emphasising the unique status of eye gaze. We propose that temporal decay of the location code and response inhibition are responsible for the reversal of spatial interference.

Reversing the reversed congruency effect: directional salience overrides social significance in a spatial Stroop task

In a spatial Stroop task, eye-gaze targets produce a reversed congruency effect (RCE) with faster responses when gaze direction and location are incongruent than congruent. On the other hand, non-social directional targets (e.g., arrows) elicit a spatial Stroop effect (SSE). The present study examined whether other social stimuli, such as head orientation, trigger the RCE. Participants judged the target direction of the head or the gaze while ignoring its location. While the gaze target replicated the RCE, the head target produced the SSE. Moreover, the head target facilitated the overall responses relative to the gaze target. These results suggest that the head, a salient directional feature, overrides the social significance. The RCE may be specific to gaze stimuli, not to social stimuli in general. The head and gaze information differentially affect our attentional mechanisms and enable us to bring about smooth social interactions.

Perceiving social gaze produces the reversed congruency effect

Numerous studies have shown that the gaze of others produces a special attentional process, such as the eye contact effect or joint attention. This study investigated the attentional process triggered by various types of gaze stimuli (i.e., human, cat, fish, koala, and robot gaze). A total of 300 university students participated in five experiments. They performed a spatial Stroop task in which five types of gaze stimuli were presented as targets. Participants were asked to judge the direction of the target (left or right) irrespective of its location (left or right). The results showed that the social gaze targets (i.e., human and cat gaze) produced a reversed congruency effect. In contrast to the social gaze targets, the non-social gaze (i.e., fish and robot) target did not produce the reversed congruency effect (Experiments 2, 2B, 3, and 4). These results suggest that attention to the gaze of socially communicable beings (i.e., humans and cats) is responsible for the reversed congruency effect. Our findings support the notion that the theory of mind or social interaction plays an important role in producing specific attentional processes in response to gaze stimuli.

Neural basis of social attention: common and distinct mechanisms for social and nonsocial orienting stimuli

Social and nonsocial directional stimuli (such as gaze and arrows, respectively) share their ability to trigger attentional processes, although the issue of whether social stimuli generate other additional (and unique) attentional effects is still under debate. In this study, we used the spatial interference paradigm to explore, using functional magnetic resonance imaging, shared and dissociable brain activations produced by gaze and arrows. Results showed a common set of regions (right parieto-temporo-occipital) similarly involved in conflict resolution for gaze and arrows stimuli, which showed stronger co-activation for incongruent than congruent trials. The frontal eye field showed stronger functional connectivity with occipital regions for congruent as compared with incongruent trials, and this effect was enhanced for gaze as compared with arrow stimuli in the right hemisphere. Moreover, spatial interference produced by incongruent (as compared with congruent) arrows was associated with increased functional coupling between the right frontal eye field and a set of regions in the left hemisphere. This result was not observed for incongruent (as compared with congruent) gaze stimuli. The right frontal eye field also showed greater coupling with left temporo-occipital regions for those conditions in which larger conflict was observed (arrow incongruent vs. gaze incongruent trials, and gaze congruent vs. arrow congruent trials). These findings support the view that social and nonsocial stimuli share some attentional mechanisms, while at the same time highlighting other differential effects. Highlights Attentional orienting triggered by social (gaze) and nonsocial (arrow) cues is comparable. When social and nonsocial stimuli are used as targets, qualitatively different behavioral effects are observed. This study explores the neural bases of shared and dissociable neural mechanisms for social and nonsocial stimuli. Shared mechanisms were found in the functional coupling between right parieto-temporo-occipital regions. Dissociable mechanisms were found in the functional coupling between right frontal eye field and ipsilateral and contralateral occipito-temporal regions.

Machine learning based approaches for clinical and non-clinical depression recognition and depression relapse prediction using audiovisual and EEG modalities: A comprehensive review

Mental disorders are rapidly increasing each year and have become a major challenge affecting the social and financial well-being of individuals. There is a need for phenotypic characterization of psychiatric disorders with biomarkers to provide a rich signature for Major Depressive Disorder, improving the understanding of the pathophysiological mechanisms underlying these mental disorders. This comprehensive review focuses on depression and relapse detection modalities such as self-questionnaires, audiovisuals, and EEG, highlighting noteworthy publications in the last ten years. The article concentrates on the literature that adopts machine learning by audiovisual and EEG signals. It also outlines preprocessing, feature extraction, and public datasets for depression detection. The review concludes with recommendations that will help improve the reliability of developed models and the determinism of computational intelligence-based systems in psychiatry. To the best of our knowledge, this survey is the first comprehensive review on depression and relapse prediction by self-questionnaires, audiovisual, and EEG-based approaches. The findings of this review will serve as a useful and structured starting point for researchers studying clinical and non-clinical depression recognition and relapse through machine learning-based approaches.

Are there quantitative differences between eye-gaze and arrow cues? A meta-analytic answer to the debate and a call for qualitative differences

Gaze acts from an early age as a cue to orient attention and, thereafter, to infer our social partners' intentions, thoughts, and emotions. Variants of the attentional orienting paradigm have been used to study the orienting capabilities associated to eye gaze. However, to date, it is still unclear whether this methodology truly assesses "social-specific" processes exclusively involved in attention to eye-gaze or the operation of domain-general attentional processes. The present study provides a comprehensive meta-analysis indicating that eye-gaze and non-social directional stimuli, such as arrows, produce equivalent attentional effects. This result casts doubt on the potential utility of the classic cueing task in revealing social-specific processes. On the other hand, we review behavioral evidence suggesting that eye-gaze stimuli may induce higher-order social processes when more specific experimental procedures that analyze qualitative rather than quantitative differences are used. These findings point to an integrated view in which domain-general and social specific processes both contribute to the attentional mechanisms induced by eye-gaze direction. Finally, some proposals about the social components specifically triggered by eye-gaze stimuli are discussed.

Gestalt Perception and the Experience of the Social Space in Autism: A Case Study

Phenomenological approaches suggest that the bodily presence of others has a profound influence on the experience of social spaces. This intimate relationship is particularly evident in mental disorders. Investigations into the nature of intersubjectivity in various pathologies indicate that modifications to the capacity for social perception play a key role in determining the manners in which the social space is experienced and felt. This paper aims to examine the interviewing relation of social perception and the experience of space and its consequences in autism spectrum disorder (ASD). This is done through a phenomenologically informed analysis of the functioning of social perception in ASD. Our account proposes that the atypical socio-perceptual patterns exhibited by people with autism significantly reduce the capacity to grasp the context of the situation, which facilitates and intensifies negative feelings that are intertwined with the experience of social spaces. This novel understanding draws on the idea that ASD involves a fundamental difficulty to establish a gestalt perception of social scenes. The evidence we discuss suggests that this anomaly in the operation of social perception also modulates the experience of the social space. Failing to perceive the wholeness of the situation means that people with autism often experience the social space as unfamiliar, confusing, uncertain, and unsafe, rather than feeling familiar and understood in the embodied presence of others. As a result, autistic subjects may experience difficulty evaluating the outcomes of hazardous circumstances, which poses a risk to their well-being, particularly in borderline situations. This suggestion is elaborated through the tragic occurrences that led to the killing of Eyad al-Hallaq, a 32-year-old Palestinian with autism.