The attenuated visual scanpaths of patients with schizophrenia whilst recognizing emotional facial expressions are worsened in natural social scenes

The Gaze of Schizophrenia Patients Captured by Bottom-up Saliency

Schizophrenia (SCHZ) notably impacts various human perceptual modalities, including vision. Prior research has identified marked abnormalities in perceptual organization in SCHZ, predominantly attributed to deficits in bottom-up processing. Our study introduces a novel paradigm to differentiate the roles of top-down and bottom-up processes in visual perception in SCHZ. We analysed eye-tracking fixation ground truth maps from 28 SCHZ patients and 25 healthy controls (HC), comparing these with two mathematical models of visual saliency: one bottom-up, based on the physical attributes of images, and the other top-down, incorporating machine learning. While the bottom-up (GBVS) model revealed no significant overall differences between groups (beta = 0.01, p = 0.281, with a marginal increase in SCHZ patients), it did show enhanced performance by SCHZ patients with highly salient images. Conversely, the top-down (EML-Net) model indicated no general group difference (beta = -0.03, p = 0.206, lower in SCHZ patients) but highlighted significantly reduced performance in SCHZ patients for images depicting social interactions (beta = -0.06, p < 0.001). Over time, the disparity between the groups diminished for both models. The previously reported bottom-up bias in SCHZ patients was apparent only during the initial stages of visual exploration and corresponded with progressively shorter fixation durations in this group. Our research proposes an innovative approach to understanding early visual information processing in SCHZ patients, shedding light on the interplay between bottom-up perception and top-down cognition.

Neural circuit disruptions of eye gaze processing in autism spectrum disorder and schizophrenia: An activation likelihood estimation meta-analysis

BACKGROUND

Impairment in social cognition, particularly eye gaze processing, is a shared feature common to autism spectrum disorder (ASD) and schizophrenia. However, it is unclear if a convergent neural mechanism also underlies gaze dysfunction in these conditions. The present study examined whether this shared eye gaze phenotype is reflected in a profile of convergent neurobiological dysfunction in ASD and schizophrenia.

METHODS

Activation likelihood estimation (ALE) meta-analyses were conducted on peak voxel coordinates across the whole brain to identify spatial convergence. Functional coactivation with regions emerging as significant was assessed using meta-analytic connectivity modeling. Functional decoding was also conducted.

RESULTS

Fifty-six experiments (n = 30 with schizophrenia and n = 26 with ASD) from 36 articles met inclusion criteria, which comprised 354 participants with ASD, 275 with schizophrenia and 613 healthy controls (1242 participants in total). In ASD, aberrant activation was found in the left amygdala relative to unaffected controls during gaze processing. In schizophrenia, aberrant activation was found in the right inferior frontal gyrus and supplementary motor area. Across ASD and schizophrenia, aberrant activation was found in the right inferior frontal gyrus and right fusiform gyrus during gaze processing. Functional decoding mapped the left amygdala to domains related to emotion processing and cognition, the right inferior frontal gyrus to cognition and perception, and the right fusiform gyrus to visual perception, spatial cognition, and emotion perception. These regions also showed meta-analytic connectivity to frontoparietal and frontotemporal circuitry.

CONCLUSION

Alterations in frontoparietal and frontotemporal circuitry emerged as neural markers of gaze impairments in ASD and schizophrenia. These findings have implications for advancing transdiagnostic biomarkers to inform targeted treatments for ASD and schizophrenia.

Altered attentive bias towards interpersonal communication information across phases of schizophrenia: an eye-tracking study

Background

Eye movement abnormality in schizophrenia has been studied for several decades. However, patient differences in eye movements across phases of schizophrenia from eye-tracking studies have not been well documented.

Aims

This pilot study used eye-tracking technology to investigate attentive bias towards interpersonal communication information across different clinical phases of schizophrenia.

Methods

This study included 78 persons at clinical high risk (CHR) for schizophrenia, 68 first-episode (FEZ) patients, and 39 chronically ill patients from the Shanghai At Risk for Psychosis Extending Project (SHARP Extending cohort) as well as 74 healthy controls (HCs). The experiment was an unguided-viewing task composed of 24 trials showing three types of pictures which varied in the degree of interpersonal communication. Type 1 was a scenery picture without people, type 2 was a picture with four people not communicating, and type 3 was a picture with four people communicating. We used two measures: (1) initial fixation duration and (2) total fixation duration.

Results

A ratio for both measures was calculated between measures for pictures with more or less interpersonal communication. The ratio of initial fixation duration for pictures with people communicating versus pictures with people not communicating was lowest in chronically ill patients (0.13 (0.34))compared with HCs (0.31 (0.36)), FEZ patients (0.31 (0.46)), and CHR patients (0.36 (0.42)). The difference in the ratios of initial fixation duration for type 2 and type 3 pictures was also significant for female participants (HCs vs chronically ill patients, t=2.706, p=0.009; CHR patients vs chronically ill patients, t=4.079, p<0.001). In addition, the ratio of initial fixation duration on pictures with people not communicating versus pictures without people negatively correlated with participants’ high-risk symptoms (r=−0.35, p=0.002) among the CHR group and also correlated with the negative symptom subscore on the Positive and Negative Syndrome Scale (PANSS) among chronically ill patients (r=−0.33, p=0.037). The ratio of initial fixation duration between type 1 and type 3 pictures was associated with PANSS negative symptoms only in female patients with schizophrenia (r=−0.46, p=0.004).

Conclusions

These findings suggest an altered attentive bias towards pictures with a high degree of interpersonal communication information across different clinical phases in schizophrenia. The ratio of initial attentive orienting was associated with negative symptoms in female patients.

Eye movement impairments in children with malnutrition

Malnutrition is characterised by deficient nutrient ingestion and absorption and is still one of the most important causes of morbidity and mortality in children worldwide. Our main rationale was that protein-energy malnutrition (PEM) may affect eye movement in children with malnutrition. Twenty children without PEM (mean age = 10.8; SD = 1.0 years) and 18 children with PEM (mean age = 10.9; SD = 1.2 years) were included in the present study. We applied three types of tests: one that consisted of a maze and two versions of the Spot the Seven Errors test using boats and elephants. Our results indicated that children with PEM exhibited performance deficits in the maze test (p < .001) and Spot the Seven Errors test for both boats (p < .001) and elephants (p < .001). These data suggest that nutritional impairments during the first year of life (i.e., a critical period) can directly impact eye movement. Eye tracking is a reliable technique to investigate higher-order processes, but our results should be interpreted with caution. Our findings highlight the relevance of cognitive development in malnourished children, which can negatively affect their development. Screening, assessment and rehabilitation strategies are essential in this at-risk population.

Evaluation of the correlation between gaze avoidance and schizophrenia psychopathology with deep learning-based emotional recognition

OBJECTIVE

To investigate the correlation between gaze avoidance and psychopathology in patients with schizophrenia through eye movement measurements in real-life interpersonal situations.

METHODS

We enrolled 52 clinically stable patients with schizophrenia. Psychopathology was evaluated using the Positive and Negative Syndrome Scale (PANSS), Hamilton Depression Rating Scale, and Hamilton Anxiety Rating Scale. After presenting a visual stimulus, eye movements were measured with Tobii Pro Wearable Glasses 2, and deep learning-based emotional recognition using the residual masking network was used for neutral stimulus verification. Statistical analyses were performed using Pearson's correlation and regression analyses.

RESULTS

Data of 45 participants with verified stimulus neutrality by deep learning image recognition were used for analysis. The first dwelling time was negatively correlated with the PANSS positive syndrome subscale (p = 0.028), general psychopathology subscale (p = 0.008), total score (p = 0.008), 5-factor positive symptoms (p = 0.035), and 5-factor depression/anxiety symptoms (p = 0.043). The baseline-area of interest (AOI) pupil diameter change was positively correlated with PANSS 5-factor positive symptom scores (p = 0.039). After adjusting for additional variables, the same items had a significant effect on the first dwelling time and baseline-AOI pupil diameter change.

CONCLUSIONS

Psychopathology, particularly positive symptoms, was associated with gaze avoidance and pupil diameter in patients with schizophrenia. Evaluating the characteristics of eye movements in patients with schizophrenia will enable better understanding of their symptoms.

Gender differences in attentive bias during social information processing in schizophrenia: An eye-tracking study

Interpersonal communication is a specific scenario in which patients with psychiatric symptoms may manifest different behavioral patterns due to psychopathology. This was a pilot study by eye-tracking technology to investigate attentive bias during social information processing in schizophrenia. We enrolled 39 patients with schizophrenia from Shanghai Mental Health Center and 42 age-, gender- and education-matched healthy controls. The experiment was a free-viewing task, in which pictures with three types of degree of interpersonal communication were shown. We used two measures: 1) initial fixation duration, 2) total gaze duration. The Positive and Negative Syndrome Scale (PANSS) was used to determine symptom severity. The ratio of first fixation duration for pictures of communicating vs. non-communicating persons was significantly lower in patients than in controls (Mann-Whitney U = 512, p = 0.004). We found that male patients showed a significantly lower ratio of first fixation duration than male controls (Mann-Whitney U = 190, p = 0.028), while it was marginally lower in female patients than female controls (Mann-Whitney U = 77, p = 0.057). The ratio of first fixation duration for pictures of communicating persons vs. no persons was negatively correlated with PANSS negative symptoms in male patients (rho = -0.458, p = 0.024). In contrast, it was negatively correlated with PANSS positive symptoms in female patients (-0.701, p = 0.004). These findings suggest altered attentive bias during social information processing with a pattern of avoidance at first sight towards pictures of communicating persons in schizophrenia. It is worthwhile to note that social functioning impairment is associated with the severity of symptoms.

Attentional processing biases to threat in schizophrenia: Evidence from a free-viewing task with emotional scenes

Attentional biases to threatening stimuli have been suggested to play a key role in the onset and course of schizophrenia. However, current research has not completely demonstrated this assumption. The aim of this eye-tracking study was to shed light on the underlying psychological mechanisms of schizophrenia by examining the attentional processing of socio-emotional information. Forty-four individuals with schizophrenia and 47 healthy controls were assessed in a 3-s free-viewing task with a social scene (i.e., happy, threatening, or neutral) in competition with a non-social one to determine the effects of emotional information on the different stages of the attentional processing. The location and latency of initial fixations (i.e., initial orienting), the firs-pass fixations and gaze duration (i.e., attentional engagement), and the percentage of total duration and total fixations (i.e., attentional maintenance) were analyzed. It was found that the schizophrenia group showed longer first-pass gaze duration, as well as higher percentage of total fixations and total duration toward threatening scenes in relation to the non-social ones, compared to controls. Therefore, an attentional bias toward threatening scenes in schizophrenia was found in the attentional maintenance and engagement, but not in the initial orienting of attention. Of note, the threat-related attentional bias was not associated with positive symptoms of schizophrenia. These findings offer empirical support to affective-information processing models stating that threatening information may confer psychological vulnerability to develop schizophrenia. Moreover, the results can improve psychological treatments, such as attentional bias modification paradigms or cognitive-behavior interventions managing maladaptive schemas related to threat.

Contribution of Eye-Tracking to Study Cognitive Impairments Among Clinical Populations

In the field of psychology, the merge of decision-theory and neuroscientific methods produces an array of scientifically recognized paradigms. For example, by exploring consumer’s eye-movement behavior, researchers aim to deepen the understanding of how patterns of retinal activation are being meaningfully transformed into visual experiences and connected with specific reactions (e.g., purchase). Notably, eye-movements provide knowledge of one’s homeostatic balance and gatekeep information that shape decisions. Hence, vision science investigates the quality of observed environments determined under various experimental conditions. Moreover, it answers questions on how human process visual stimuli and use gained information for a successful strategy to achieve certain goals. While capturing cognitive states with the support of the eye-trackers progresses at a relatively fast pace in decision-making research, measuring the visual performance of real-life tasks, which require complex cognitive skills, is tentatively translated into clinical experiments. Nevertheless, the potential of the human eye as a highly valuable source of biomarkers has been underlined. In this article, we aim to draw readers attention to decision-making experimental paradigms supported with eye-tracking technology among clinical populations. Such interdisciplinary approach may become an important component that will (i) help in objectively illustrating patient’s models of beliefs and values, (ii) support clinical interventions, and (iii) contribute to health services. It is possible that shortly, eye-movement data from decision-making experiments will grant the scientific community a greater understanding of mechanisms underlining mental states and consumption practices that medical professionals consider as obsessions, disorders or addiction.