Facial-affect recognition and visual scanning behaviour in the course of schizophrenia

Facial emotion impairment in multiple sclerosis is linked to modifying observation strategies of emotional faces

BACKGROUND

Facial emotion recognition (FER) may be impaired in patients with multiple sclerosis (MS). Nevertheless, the literature is heterogeneous, with studies not highlighting this kind of impairment. Moreover, most studies have not explored differences between MS spectrum disorders (radiologically isolated syndrome (RIS), clinically-isolated syndrome (CIS), relapsing-remitting (RRMS), and progressive (primary - (PPMS) and secondary - (SPMS)). One hypothesis would be that FER impairment results from an alteration of eye-gaze strategies while observing emotional faces. Consequently, a FER deficit would be found in MS patients for whom these observation strategies would be disturbed and more frequent in the progressive forms.

METHODS

We prospectively enroled 52 patients (10 RIS, 10 CIS, 12RRMS, 10 SPMS, 10 PPMS) and 23 healthy controls (HC) to assess FER using Ekman Faces Test. Eye movements (number and duration of fixations) were recorded with an eye-tracking device.

RESULTS

21% of the MS participants had significant FER impairment. This impairment was observed in all phenotypes. In progressive forms, FER impairment was more frequent, more severe, and associated with modified emotional face observation strategies. MS participants with significant FER impairment had significantly more modification of eye-gaze strategies during observation of expressive faces than MS participants without FER impairment.

CONCLUSION

FER impairment seems to be linked to a deficit of attention orientation in MS. Remediation of eye-gaze strategies during observation of emotional faces could be beneficial, as observed in other neurological diseases.

Attention for Emotion-How Young Adults With Neurodevelopmental Disorders Look at Facial Expressions of Affect

While Autism Spectrum Disorder (ASD), Attention-Deficit/Hyperactivity Disorder (ADHD) and Schizophrenia (SCZ) differ in many clinically relevant features such as symptomatology and course, they may also share genetic underpinnings, affective problems, deviancies in social interactions, and are all characterized by some kind of cognitive impairment. This situation calls for a joint investigation of the specifics of cognitive (dys-)functions of the three disorders. Such endeavor should focus, among other domains, on the inter-section of processing cognitive, affective and social information that is crucial in effective real-life interactions and can be accomplished when attentional preferences for human facial expressions of emotions is studied. To that end, attention to facial expressions of basic emotions was examined in young adults with ASD, ADHD, or SCZ in the present study. The three clinical groups were compared with an age-matched group of typically-developing participants (TD) during the free contemplation of five different facial emotions presented simultaneously, by varying identities, through the registration of eye movements. We showed, that dwell times and fixation counts differed for the different emotions in TD and in a highly similar way in ADHD. Patients with ASD differed from TD by showing a stronger differentiation between emotions and partially different attentional preferences. In contrast, the SCZ group showed an overall more restricted scanning behavior and a lack of differentiation between emotions. The ADHD group, showed an emotion-specific gazing pattern that was highly similar to that of controls. Thus, by analyzing eye movements, we were able to differentiate three different viewing patterns that allowed us to distinguish between the three clinical groups. This outcome suggests that attention for emotion may not tap into common pathophysiological processes and argues for a multi-dimensional approach to the grouping of disorders with neurodevelopmental etiology.

Eye-gaze Strategies During Facial Emotion Recognition in Neurodegenerative Diseases and Links With Neuropsychiatric Disorders

BACKGROUND

Facial emotion recognition (FER) is primarily and severely impaired in individuals with the behavioral variant of frontotemporal dementia (bvFTD) and is often mildy impaired in individuals with Alzheimer disease (AD) or Parkinson disease (PD). Such impairment is associated with inappropriate social behaviors.

OBJECTIVE

To determine whether FER impairment is linked to the use of inappropriate eye-gaze strategies to decode facial emotions, leading to misinterpretation of others' intentions and then to behavioral disorders.

METHOD

We assessed FER in 9 individuals with bvFTD, 23 with AD, and 20 with PD, as well as 22 healthy controls (HC), using the Reading the Mind in the Eyes (RME) Test and the Ekman Faces Test. Eye movements (number and duration of fixations) were recorded with an eye-tracking device. Behavior was assessed using the Neuropsychiatric Inventory.

RESULTS

FER was mildly impaired in the AD and PD groups and severely impaired in the bvFTD group. FER impairment was accompanied by an increase in the number of fixations and a more attracted gaze toward the lower part of one's face. FER impairment and an increase in the number of fixations were positively correlated with behavioral disorders.

CONCLUSION

Our study demonstrated a link between FER impairment, modification of eye-gaze strategies during the observation of emotional faces, and behavioral disorders in individuals with bvFTD and those with AD or PD. These results suggest that an eye-gaze strategy rehabilitation program could have beneficial effects on emotion recognition and behavioral disorders in individuals with these diseases.

Robust Multimodal Emotion Recognition from Conversation with Transformer-Based Crossmodality Fusion

Decades of scientific research have been conducted on developing and evaluating methods for automated emotion recognition. With exponentially growing technology, there is a wide range of emerging applications that require emotional state recognition of the user. This paper investigates a robust approach for multimodal emotion recognition during a conversation. Three separate models for audio, video and text modalities are structured and fine-tuned on the MELD. In this paper, a transformer-based crossmodality fusion with the EmbraceNet architecture is employed to estimate the emotion. The proposed multimodal network architecture can achieve up to 65% accuracy, which significantly surpasses any of the unimodal models. We provide multiple evaluation techniques applied to our work to show that our model is robust and can even outperform the state-of-the-art models on the MELD.

Recent updates of eye movement abnormalities in patients with schizophrenia: A scoping review

AIM

Although eye-tracking technology expands beyond capturing eye data just for the sole purpose of ensuring participants maintain their gaze at the presented fixation cross, gaze technology remains of less importance in clinical research. Recently, impairments in visual information encoding processes indexed by novel gaze metrics have been frequently reported in patients with schizophrenia. This work undertakes a scoping review of research on saccadic dysfunctions and exploratory eye movement deficits among patients with schizophrenia. It gathers promising pieces of evidence of eye movement abnormalities in attention-demanding tasks on the schizophrenia spectrum that have mounted in recent years and their outcomes as potential biological markers.

METHODS

The protocol was drafted based on PRISMA for scoping review guidelines. Electronic databases were systematically searched to identify articles published between 2010 and 2020 that examined visual processing in patients with schizophrenia and reported eye movement characteristics as potential biomarkers for this mental illness.

RESULTS

The use of modern eye-tracking instrumentation has been reported by numerous neuroscientific studies to successfully and non-invasively improve the detection of visual information processing impairments among the screened population at risk of and identified with schizophrenia.

CONCLUSIONS

Eye-tracking technology has the potential to contribute to the process of early intervention and more apparent separation of the diagnostic entities, being put together by the syndrome-based approach to the diagnosis of schizophrenia. However, context-processing paradigms should be conducted and reported in equally accessible publications to build comprehensive models.

Abnormal visual representations associated with confusion of perceived facial expression in schizophrenia with social anxiety disorder

Deficits in social functioning are especially severe amongst schizophrenia individuals with the prevalent comorbidity of social anxiety disorder (SZ&SAD). Yet, the mechanisms underlying the recognition of facial expression of emotions-a hallmark of social cognition-are practically unexplored in SZ&SAD. Here, we aim to reveal the visual representations SZ&SAD (n = 16) and controls (n = 14) rely on for facial expression recognition. We ran a total of 30,000 trials of a facial expression categorization task with Bubbles, a data-driven technique. Results showed that SZ&SAD's ability to categorize facial expression was impared compared to controls. More severe negative symptoms (flat affect, apathy, reduced social drive) was associated with more impaired emotion recognition ability, and with more biases in attributing neutral affect to faces. Higher social anxiety symptoms, on the other hand, was found to enhance the reaction speed to neutral and angry faces. Most importantly, Bubbles showed that these abnormalities could be explained by inefficient visual representations of emotions: compared to controls, SZ&SAD subjects relied less on fine facial cues (high spatial frequencies) and more on coarse facial cues (low spatial frequencies). SZ&SAD participants also never relied on the eye regions (only on the mouth) to categorize facial expressions. We discuss how possible interactions between early (low sensitivity to coarse information) and late stages of the visual system (overreliance on these coarse features) might disrupt SZ&SAD's recognition of facial expressions. Our findings offer perceptual mechanisms through which comorbid SZ&SAD impairs crucial aspects of social cognition, as well as functional psychopathology.

Altered P3a Modulations to Emotional Faces in Male Patients With Chronic Schizophrenia

Existing evidence suggests that patients with schizophrenia may have a deficit in processing facial expressions. However, the neural basis of this processing deficit remains unclear. A total of 20 men diagnosed with chronic schizophrenia and 13 age- and sex-matched controls participated in the study. We investigated visual N170 and P3a components evoked in response to fearful, happy, and sad faces during an emotion discrimination task. Compared with control subjects, patients showed significantly smaller N170 amplitudes bilaterally (P = .04). We found no significant main effect of emotion of the presented faces (fearful, happy, or sad) on N170 amplitude. Patients showed significantly smaller P3a amplitudes in response to fearful (P = .01) and happy (P = .02) faces, but no significant between-group differences were observed for sad faces (P = .22). Moreover, we found no significant P3a modulation effect in response to emotional faces in patients with schizophrenia. Our results suggest that altered P3a modulations to emotional faces may be associated with emotion recognition deficits in patients with schizophrenia.

The attenuated visual scanpaths of patients with schizophrenia whilst recognizing emotional facial expressions are worsened in natural social scenes

Alteration of visual scanpaths under emotional facial expression in schizophrenia patients has been described in recent years; however, it is not clear whether such results are different when they transfer to faces in natural social scenes. The present study was designed to investigate the effects of emotional faces in natural social scenes on the gaze patterns of patients with schizophrenia, compared to gaze at isolated faces. A novel theme identification task was used where participants selected a positive, neutral or negative word to describe an emotional picture. Participants were 29 patients with schizophrenia and 31 healthy controls. The Positive and Negative Syndrome Scale (PANSS) and the Scale of Social Function in Psychosis Inpatients (SSPI) were used to assess symptoms and social functioning. In total, patients with schizophrenia showed significantly fewer fixations, saccades numbers and decreased fixations in areas of interest. As expected, patients showed shorter scanpath length, but only in the pictures with social settings. Furthermore, the effect size of scanpaths parameters under social scene was all greater than isolated face. In addition, patients compared to controls showed more abnormal scanpath parameters processing negative and neutral faces than positive faces, especially in social scene. The present study suggests that scanpath length for social scene faces may be more sensitive than for isolated face pictures. Our findings further support restricted scanpath whilst recognizing emotional facial expressions in natural social scenes as a favorable topic for further investigation as a trait marker.

Free viewing exploration in schizophrenia: Review of evidence from laboratory settings to natural environment

Several studies have investigated visual processing impairment in schizophrenia. The literature on visual exploration has described restricted scanning in schizophrenia patients. This gaze behavior is characterized by increased fixation duration, a reduced scan path length and avoidance of salient features of the face with emotional content. The aim of this paper is to give an insight on the latest update on scan path deficit. Abnormal gaze exploration was replicated in various visual stimuli. This review describes gaze patterns with stimuli that imply minimal to high cognitive process: figures, objects, faces, and scenes. Interestingly, schizophrenia patients have shown cognitive flexibility by modulating gaze scanning when they are involved in an active assignment. We will also consider scanning abnormalities in real-life environment and discuss the potential therapeutic use of eye tracking in schizophrenia. The therapeutic application of eye tracking in schizophrenia is a young emerging field in psychiatry research. The recent remediation program is based on the reorientation of visual attention on the salient features of faces. For now, this program has shown encouraging results. Further studies are needed to explore behavior in real-world situations to complement laboratory measurements to move toward a full understanding of the mechanisms underlying atypical scanning in patients with schizophrenia.

In the eye of the beholder? Oxytocin effects on eye movements in schizophrenia

BACKGROUND

Individuals with schizophrenia have difficulty in extracting salient information from faces. Eye-tracking studies have reported that these individuals demonstrate reduced exploratory viewing behaviour (i.e. reduced number of fixations and shorter scan paths) compared to healthy controls. Oxytocin has previously been demonstrated to exert pro-social effects and modulate eye gaze during face exploration. In this study, we tested whether oxytocin has an effect on visual attention in patients with schizophrenia.

METHODS

Nineteen male participants with schizophrenia received intranasal oxytocin 40UI or placebo in a double-blind, placebo-controlled, crossover fashion during two visits separated by seven days. They engaged in a free-viewing eye-tracking task, exploring images of Caucasian men displaying angry, happy, and neutral emotional expressions; and control images of animate and inanimate stimuli. Eye-tracking parameters included: total number of fixations, mean duration of fixations, dispersion, and saccade amplitudes.

RESULTS

We found a main effect of treatment, whereby oxytocin increased the total number of fixations, dispersion, and saccade amplitudes, while decreasing the duration of fixations compared to placebo. This effect, however, was non-specific to facial stimuli. When restricting the analysis to facial images only, we found the same effect. In addition, oxytocin modulated fixation rates in the eye and nasion regions.

DISCUSSION

This is the first study to explore the effects of oxytocin on eye gaze in schizophrenia. Oxytocin had enhanced exploratory viewing behaviour in response to both facial and inanimate control stimuli. We suggest that the acute administration of intranasal oxytocin may have the potential to enhance visual attention in schizophrenia.

Oxytocin increases eye gaze in schizophrenia

Abnormal eye gaze is common in schizophrenia and linked to functional impairment. The hypothalamic neuropeptide oxytocin modulates visual attention to social stimuli, but its effects on eye gaze in schizophrenia are unknown. We examined visual scanning of faces in men with schizophrenia and neurotypical controls to quantify oxytocin effects on eye gaze. In a randomized, double-blind, crossover study, 33 men with schizophrenia and 39 matched controls received one dose of intranasal oxytocin (40 IU) and placebo on separate testing days. Participants viewed 20 color photographs of faces while their gaze patterns were recorded. We tested for differences in fixation time on the eyes between patients and controls as well as oxytocin effects using linear mixed-effects models. We also tested whether attachment style, symptom severity, and anti-dopaminergic medication dosage moderated oxytocin effects. In the placebo condition, patients showed reduced fixation time on the eyes compared to controls. Oxytocin was associated with an increase in fixation time among patients, but a decrease among controls. Higher attachment anxiety and greater symptom severity predicted increased fixation time on the eyes on oxytocin versus placebo. Anti-dopaminergic medication dosage and attachment avoidance did not impact response to oxytocin. Consistent with findings that oxytocin optimizes processing of social stimuli, intranasal oxytocin enhanced eye gaze in men with schizophrenia. Further work is needed to determine whether changes in eye gaze impact social cognition and functional outcomes. Both attachment anxiety and symptom severity predicted oxytocin response, highlighting the importance of examining potential moderators of oxytocin effects in future studies.

Visual exploration of emotional faces in schizophrenia using masks from the Japanese Noh theatre

Studying eye movements during visual exploration is widely used to investigate visual information processing in schizophrenia. Here, we used masks from the Japanese Noh theatre to study visual exploration behavior during an emotional face recognition task and a brightness evaluation control task using the same stimuli. Eye movements were recorded in 25 patients with schizophrenia and 25 age-matched healthy controls while participants explored seven photos of Japanese Noh masks tilted to seven different angles. Additionally, participants were assessed on seven upright binary black and white pictures of these Noh masks (Mooney-like pictures), seven Upside-down pictures (180° upside-down turned Mooneys), and seven Neutral pictures. Participants either had to indicate whether they had recognized a face and its emotional expression, or they had to evaluate the brightness of the picture (total N = 56 trials). We observed a clear effect of inclination angle of Noh masks on emotional ratings (p < 0.001) and visual exploration behavior in both groups. Controls made larger saccades than patients when not being able to recognize a face in upside-down Mooney pictures (p < 0.01). Patients also made smaller saccades when exploring pictures for brightness (p < 0.05). Exploration behavior in patients was related to depressive symptom expression during emotional face recognition but not during brightness evaluation. Our findings suggest that visual exploration behavior in patients with schizophrenia is less flexible than in controls depending on the specific task requirements, specifically when exploring physical aspects of the environment.

Ventromedial frontal lobe damage affects interpretation, not exploration, of emotional facial expressions

Recognizing and distinguishing the emotional states of those around us is crucial for adaptive social behavior. Previous work has shown that damage to the ventromedial frontal lobe (VMF) impairs recognition of subtle emotional facial expressions and affects fixation patterns to face stimuli. However, whether this relates to deficits in acquiring or interpreting facial expression information remains unclear. We tested 37 patients with frontal lobe damage, including 17 subjects with VMF lesions, in a series of emotion recognition tasks with different gaze manipulations. Subjects were asked to rate neutral, subtle and extreme emotional expressions while freely examining faces, while instructed to look only at the eyes, and in a gaze-contingent condition that required top-down direction of eye movements to reveal the stimulus. People with VMF damage were worse at detecting subtle disgust during free viewing and confused extreme emotional expressions more than healthy controls. However, fixation patterns did not differ systematically between groups during free or gaze-contingent viewing conditions. Moreover, instruction to fixate only the eyes did not improve the performance of VMF damaged subjects. These data argue that VMF is not necessary for normal fixations to emotional face stimuli, and that impairments in emotion recognition after VMF damage do not stem from impaired information gathering, as indexed by patterns of fixation.

A review of impaired visual processing and the daily visual world in patients with schizophrenia

Several studies have investigated perceptual processes in patients with schizophrenia. Research confirms that visual impairments are one of the most important features of schizophrenia. Many studies, using behavioral and psychological experiments, confirm that visual impairments can be used to determine illness severity, state, and best treatments. Herein, we review recent research pertaining to visual function in patients with schizophrenia and highlight the relationship between laboratory findings and subjective, real-life reports from patients themselves. The purpose of this review is to 1) describe visual impairments that manifest in patients with schizophrenia, 2) examine the relationship between visual dysfunction, assessed by laboratory tests, and the experiences of patients themselves, and 3) describe real-life experiences related to visual function in this population. In this review, the impairments of motion and color perception, perceptual organization, and scan paths are summarized, along with the relationship between laboratory findings and patients' real-world subjective experiences related to visual function.

Objective assessment of exploratory behaviour in schizophrenia using wireless motion capture

Motivation deficits are a prominent feature of schizophrenia and have substantial consequences for functional outcome. The impact of amotivation on exploratory behaviour has not been extensively assessed by entirely objective means. This study evaluated deficits in exploratory behaviour in an open-field setting using wireless motion capture. Twenty-one stable adult outpatients with schizophrenia and twenty matched healthy controls completed the Novelty Exploration Task, in which participants explored a novel environment containing familiar and uncommon objects. Objective motion data were used to index participants' locomotor activity and tendency for visual and tactile object exploration. Clinical assessments of positive and negative symptoms, apathy, cognition, depression, medication side-effects, and community functioning were also administered. Relationships between task performance and clinical measures were evaluated using Spearman correlations, and group differences were evaluated using multivariate analysis of covariance tests. Although locomotor activity and tactile exploration were similar between the schizophrenia and healthy control groups, schizophrenia participants exhibited reduced visual object exploration (F(2,35)=3.40, p=0.045). Further, schizophrenia participants' geometric pattern of locomotion, visual exploration, and tactile exploration were correlated with overall negative symptoms (|ρ|=0.46-0.64, p<=0.039) and apathy (|ρ|=0.49-0.62, p<=0.028), and both visual and tactile exploration were also correlated with community functioning (|ρ|=0.46-0.48, p<=0.043). The Novelty Exploration Task may be a valuable tool to quantify exploratory behaviour beyond what is captured through standard clinical instruments and human observer ratings. Findings from this initial study suggest that locomotor activity and object interaction tendencies are impacted by motivation, and reveal deficits specifically in visual exploration in schizophrenia.

Does differential visual exploration contribute to visual memory impairments in 22q11.2 microdeletion syndrome?

BACKGROUND

Chromosome 22q11.2 microdeletion syndrome (22q11.2DS) is a genetic syndrome characterised by a unique cognitive profile. Individuals with the syndrome present several non-verbal deficits, including visual memory impairments and atypical exploration of visual information. In this study, we seek to understand how visual attention may contribute to memory difficulties in 22q11.2DS by tracking eye movements during the encoding phase of a visual short-term memory task.

METHOD

Eye movements were recorded during a computerised version of the multiple-choice Benton Visual Retention Test, which consisted of exploring and then recognising complex visual stimuli. Seventy-four participants affected by 22q11.2DS were compared with 70 typically developing participants.

RESULTS

Participants with 22q11.2DS performed less well than healthy controls on the task and spent more time and fixations on the principal (larger central) figures and less time and fixations on the smaller peripheral figures within the stimuli.

CONCLUSIONS

This study is the first to investigate visual attention in 22q11.2DS during a memory task. The results delineate impaired processes during encoding that affect visual memory performance. The findings may be especially useful for informing interventions intended to boost visual learning in patients with 22q11.2DS.

Neural basis of altered earlier attention and higher order biological motion processing in schizophrenia

Schizophrenia patients have impairments of biological motion (BM) perception, which provides critical information about social cognition. Because social cognition is underpinned by attention, the impairments of BM perception in schizophrenia could be partially attributable to altered attention. To elucidate the impairments in attention and social perception in schizophrenia, we investigated the neural basis of impaired BM processing using MRI in respect to attention deficits by eye tracker. Voxel-based morphometry was performed to evaluate the relationship between BM perception and gray matter (GM) volume. The temporo-parietal junction (TPJ) and anterior superior temporal sulcus (aSTS) were related to task accuracy. However, when the effect of attention (i.e., eye movement) was controlled, the relationship in TPJ became non-significant, while aSTS showed a significant relationship with BM perception. Alteration in TPJ might be associated with inefficient attentional strategy, whereas dysfunctional aSTS might be correlated with deficit in higher order BM processing per se. Several cognitive levels as well as corresponding brain areas are possibly involved in the manifestation of social cognitive deficits in schizophrenia.

The categories, frequencies, and stability of idiosyncratic eye-movement patterns to faces

The spatial pattern of eye-movements to faces considered typical for neurologically healthy individuals is a roughly T-shaped distribution over the internal facial features with peak fixation density tending toward the left eye (observer's perspective). However, recent studies indicate that striking deviations from this classic pattern are common within the population and are highly stable over time. The classic pattern actually reflects the average of these various idiosyncratic eye-movement patterns across individuals. The natural categories and respective frequencies of different types of idiosyncratic eye-movement patterns have not been specifically investigated before, so here we analyzed the spatial patterns of eye-movements for 48 participants to estimate the frequency of different kinds of individual eye-movement patterns to faces in the normal healthy population. Four natural clusters were discovered such that approximately 25% of our participants' fixation density peaks clustered over the left eye region (observer's perspective), 23% over the right eye-region, 31% over the nasion/bridge region of the nose, and 20% over the region spanning the nose, philthrum, and upper lips. We did not find any relationship between particular idiosyncratic eye-movement patterns and recognition performance. Individuals' eye-movement patterns early in a trial were more stereotyped than later ones and idiosyncratic fixation patterns evolved with time into a trial. Finally, while face inversion strongly modulated eye-movement patterns, individual patterns did not become less distinct for inverted compared to upright faces. Group-averaged fixation patterns do not represent individual patterns well, so exploration of such individual patterns is of value for future studies of visual cognition.

Improving Facial Emotion Recognition in Schizophrenia: a Controlled Study Comparing Specific and Attentional Focused Cognitive Remediation

Cognitive impairments associated with schizophrenia are very frequent. They concern both neurocognition and social cognition, including facial emotion recognition. These impairments have a negative impact on the daily functioning, in particular the social and vocational rehabilitation of people with schizophrenia. Previous studies in this area clearly demonstrated the interest of cognitive remediation to improve neurocognitive and social cognitive functioning in schizophrenia. They also established clear links between facial emotion recognition skills and attentional processes. The present study compares the GAÏA s-face program (GAÏA arm), which focuses on facial emotion recognition processes, with the RECOS program (RECOS arm), a neurocognitive remediation therapy focusing on selective attention. Forty people with schizophrenia were randomly distributed between each study arm and assessed pre- (T1) and post- (T2) therapy. The single-blind assessment focused on facial emotion recognition (the main criteria), symptoms, social and subjective functioning, and neurocognitive and social cognitive performance. Both programs were conducted by nurses after a 3-day training session. The study showed a significant improvement in facial emotion recognition performance in both groups, with a significantly larger effect in the GAÏA arm. Symptoms and social functioning also improved in the GAÏA arm, and certain neurocognitive and social cognitive processes improved in both study arms. Further studies are recommended, with larger population samples and a follow-up assessing the long-term preservation of these improvements.

The Interpretation of Emotion from Facial Expression for Children with Visual Processing Problems

A significant proportion of people with learning difficulties have social problems, which are often considered to be the product of school failure. However, a number of studies have suggested that these social skill problems may relate to the inability to decode subtle visual cues of body language and facial expression. The majority of studies of facial expression, however, have viewed learning disability as a unitary condition, without taking account of specific sub‐types which may have more difficulty in processing visual cues, especially for facial emotion. This study investigated children aged 8 to 12 years who were divided into three learning disability sub‐groups: 1) a visual‐perceptual sub‐type called Irlen Syndrome (n=41); 2) a group with learning disabilities, but no indications of Irlen Syndrome (n=30); and 3) a normally achieving control group (n=31). The Irlen Syndrome sub‐group had significantly lower scores for interpreting emotion from facial expression than the two other groups. The learning disabled non‐lrlen sub‐group also had significantly lower scores than the control group, but with much smaller levels of significance than those between the Irlen and control groups.

Altered emotional modulation of associative memory in first episode schizophrenia: An fMRI study

Alterations of associative memory, resulting from perturbations within the medial temporal lobe, are well established in schizophrenia. So far, all the studies having examined associative memory in schizophrenia have limited ecological validity, as people experience various emotional stimuli in their life. As such, emotion must be taken into account in order to fully understand memory. Thus, we designed an fMRI study aimed at investigating neural correlates of the effects of emotions on associative memory in schizophrenia. Twenty-four first episode schizophrenia (FES) patients and 20 matched controls were instructed to memorize 90 pairs of standardized pictures during a scanned encoding phase. Each of the 90 pairs was composed of a scene and an unrelated object. Furthermore, trials were either neutral or emotional as a function of the emotional valence of the scene comprising each pair. FES patients exhibited lower performance for both conditions than controls, with greater deficits in regard to emotional versus neutral associations. fMRI analyses revealed that these deficits were related to lower activations in mnemonic and limbic regions. This study provides evidence of altered associative memory and emotional modulation in schizophrenia, resulting from dysfunctions in the cerebral networks underlying memory, emotion, and encoding strategies. Together, our results suggest that all these dysfunctions may be targets for new therapeutic interventions known to improve cognitive deficits in schizophrenia.

Facial affect recognition in body dysmorphic disorder versus obsessive-compulsive disorder: An eye-tracking study

BACKGROUND

Body dysmorphic disorder (BDD) is characterised by repetitive behaviours and/or mental acts occurring in response to preoccupations with perceived defects or flaws in physical appearance (American Psychiatric Association, 2013). This study aimed to investigate facial affect recognition in BDD using an integrated eye-tracking paradigm.

METHOD

Participants were 21 BDD patients, 19 obsessive-compulsive disorder (OCD) patients and 21 healthy controls (HC), who were age-, sex-, and IQ-matched. Stimuli were from the Pictures of Facial Affect (Ekman & Friesen, 1975), and outcome measures were affect recognition accuracy as well as spatial and temporal scanpath parameters.

RESULTS

Relative to OCD and HC groups, BDD patients demonstrated significantly poorer facial affect perception and an angry recognition bias. An atypical scanning strategy encompassing significantly more blinks, fewer fixations of extended mean durations, higher mean saccade amplitudes, and less visual attention devoted to salient facial features was found.

CONCLUSIONS

Patients with BDD were substantially impaired in the scanning of faces, and unable to extract affect-related information, likely indicating deficits in basic perceptual operations.

Oxytocin and social cognition in affective and psychotic disorders

Impairments in social cognition are now recognized as core illness features in psychotic and affective disorders. Despite the significant disability caused by social cognitive abnormalities, treatments for this symptom dimension are lacking. Here, we describe the evidence demonstrating abnormalities in social cognition in schizophrenia, major depressive disorder, and bipolar disorder, as well as the neurobiology of social cognition including the role of oxytocin. We then review clinical trials of oxytocin administration in psychotic and affective disorders and the impact of this agent on social cognition. To date, several studies have demonstrated that oxytocin may improve social cognition in schizophrenia; too few studies have been conducted in affective disorders to determine the effect of oxytocin on social cognition in these disorders. Future work is needed to clarify which aspects of social cognition may be improved with oxytocin treatment in psychotic and affective disorders.

Effects of Training of Affect Recognition on the recognition and visual exploration of emotional faces in schizophrenia

BACKGROUND

Schizophrenia patients have impairments in facial affect recognition and display scanpath abnormalities during the visual exploration of faces. These abnormalities are characterized by fewer fixations on salient feature areas and longer fixation durations. The present study investigated whether social-cognitive remediation not only improves performance in facial affect recognition but also normalizes patients' gaze behavior while looking at faces.

METHODS

Within a 2 × 2-design (group × time), 16 schizophrenia patients and 16 healthy controls performed a facial affect recognition task with concomitant infrared oculography at baseline (T0) and after six weeks (T1). Between the measurements, patients completed the Training of Affect Recognition (TAR) program. The influence of the training on facial affect recognition (percent of correct answers) and gaze behavior (number and mean duration of fixations into salient or non-salient facial areas) was assessed.

RESULTS

In line with former studies, at baseline patients showed poorer facial affect recognition than controls and aberrant scanpaths, and after TAR facial affect recognition was improved. Concomitant with improvements in performance, the number of fixations in feature areas ('mouth') increased while fixations in non-feature areas ('white space') decreased. However, the change in fixation behavior did not correlate with the improvement in performance.

CONCLUSIONS

After TAR, patients pay more attention to facial areas that contain information about a displayed emotion. Although this may contribute to the improved performance, the lack of a statistical correlation implies that this factor is not sufficient to explain the underlying mechanism of the treatment effect.

Visual processing and social cognition in schizophrenia: relationships among eye movements, biological motion perception, and empathy

Schizophrenia patients have impairments at several levels of cognition including visual attention (eye movements), perception, and social cognition. However, it remains unclear how lower-level cognitive deficits influence higher-level cognition. To elucidate the hierarchical path linking deficient cognitions, we focused on biological motion perception, which is involved in both the early stage of visual perception (attention) and higher social cognition, and is impaired in schizophrenia. Seventeen schizophrenia patients and 18 healthy controls participated in the study. Using point-light walker stimuli, we examined eye movements during biological motion perception in schizophrenia. We assessed relationships among eye movements, biological motion perception and empathy. In the biological motion detection task, schizophrenia patients showed lower accuracy and fixated longer than healthy controls. As opposed to controls, patients exhibiting longer fixation durations and fewer numbers of fixations demonstrated higher accuracy. Additionally, in the patient group, the correlations between accuracy and affective empathy index and between eye movement index and affective empathy index were significant. The altered gaze patterns in patients indicate that top-down attention compensates for impaired bottom-up attention. Furthermore, aberrant eye movements might lead to deficits in biological motion perception and finally link to social cognitive impairments. The current findings merit further investigation for understanding the mechanism of social cognitive training and its development.

Eye spy: the predictive value of fixation patterns in detecting subtle and extreme emotions from faces

Successful social interaction requires recognizing subtle changes in the mental states of others. Deficits in emotion recognition are found in several neurological and psychiatric illnesses, and are often marked by disturbances in gaze patterns to faces, typically interpreted as a failure to fixate on emotionally informative facial features. However, there has been very little research on how fixations inform emotion recognition in healthy people. Here, we asked whether fixations predicted detection of subtle and extreme emotions in faces. We used a simple model to predict emotion detection scores from participants' fixation patterns. The best fit of this model heavily weighted fixations to the eyes in detecting subtle fear, disgust and surprise, with less weight, or zero weight, given to mouth and nose fixations. However, this model could not successfully predict detection of subtle happiness, or extreme emotional expressions, with the exception of fear. These findings argue that detection of most subtle emotions is best served by fixations to the eyes, with some contribution from nose and mouth fixations. In contrast, detection of extreme emotions and subtle happiness appeared to be less dependent on fixation patterns. The results offer a new perspective on some puzzling dissociations in the neuropsychological literature, and a novel analytic approach for the study of eye gaze in social or emotional settings.

Facial emotion recognition in agenesis of the corpus callosum

BACKGROUND

Impaired social functioning is a common symptom of individuals with developmental disruptions in callosal connectivity. Among these developmental conditions, agenesis of the corpus callosum provides the most extreme and clearly identifiable example of callosal disconnection. To date, deficits in nonliteral language comprehension, humor, theory of mind, and social reasoning have been documented in agenesis of the corpus callosum. Here, we examined a basic social ability as yet not investigated in this population: recognition of facial emotion and its association with social gaze.

METHODS

Nine individuals with callosal agenesis and nine matched controls completed four tasks involving emotional faces: emotion recognition from upright and inverted faces, gender recognition, and passive viewing. Eye-tracking data were collected concurrently on all four tasks and analyzed according to designated facial regions of interest.

RESULTS

Individuals with callosal agenesis exhibited impairments in recognizing emotions from upright faces, in particular lower accuracy for fear and anger, and these impairments were directly associated with diminished attention to the eye region. The callosal agenesis group exhibited greater consistency in emotion recognition across conditions (upright vs. inverted), with poorest performance for fear identification in both conditions. The callosal agenesis group also had atypical facial scanning (lower fractional dwell time in the eye region) during gender naming and passive viewing of faces, but they did not differ from controls on gender naming performance. The pattern of results did not differ when taking into account full-scale intelligence quotient or presence of autism spectrum symptoms.

CONCLUSIONS

Agenesis of the corpus callosum results in a pattern of atypical facial scanning characterized by diminished attention to the eyes. This pattern suggests that reduced callosal connectivity may contribute to the development and maintenance of emotion processing deficits involving reduced attention to others' eyes.

Advanced analysis of free visual exploration patterns in schizophrenia

Background: Visual scanpath analyses provide important information about attention allocation and attention shifting during visual exploration of social situations. This study investigated whether patients with schizophrenia simply show restricted free visual exploration behavior reflected by reduced saccade frequency and increased fixation duration or whether patients use qualitatively different exploration strategies than healthy controls.

Methods: Scanpaths of 32 patients with schizophrenia and age-matched 33 healthy controls were assessed while participants freely explored six photos of daily life situations (20 s/photo) evaluated for cognitive complexity and emotional strain. Using fixation and saccade parameters, we compared temporal changes in exploration behavior, cluster analyses, attentional landscapes, and analyses of scanpath similarities between both groups.

Results: We found fewer fixation clusters, longer fixation durations within a cluster, fewer changes between clusters, and a greater increase of fixation duration over time in patients compared to controls. Scanpath patterns and attentional landscapes in patients also differed significantly from those of controls. Generally, cognitive complexity and emotional strain had significant effects on visual exploration behavior. This effect was similar in both groups as were physical properties of fixation locations.

Conclusions: Longer attention allocation to a given feature in a scene and less attention shifts in patients suggest a more focal processing mode compared to a more ambient exploration strategy in controls. These visual exploration alterations were present in patients independently of cognitive complexity, emotional strain or physical properties of visual cues implying that they represent a rather general deficit. Despite this impairment, patients were able to adapt their scanning behavior to changes in cognitive complexity and emotional strain similar to controls.

Eye movements during natural actions in patients with schizophrenia

BACKGROUND

Visual scanning and planning of actions are reported to be abnormal in patients with schizophrenia. Most studies that monitored eye movements in these patients were performed under free-viewing conditions and used 2- dimensional images. However, images differ from the natural world in several ways, including task demands and the dimensionality of the display. Our study was designed to assess whether abnormalities in visual exploration in patients with schizophrenia generalize to active-viewing tasks in realistic conditions of viewing and to examine whether disturbances in action sequencing in these patients are reflected in their visual scanning patterns while executing natural tasks.

METHODS

We monitored visual scan paths in patients with schizophrenia and healthy controls. Participants performed several tasks in which they were asked to look at a realistic scene on a table (free-viewing) and perform 2 active-viewing tasks: a familiar task (sandwich-making) and an unfamiliar task (model-building). The scenes contained both task-relevant and task-irrelevant objects.

RESULTS

We included 15 patients and 15 controls in our analysis. Patients exhibited abnormalities in the free-viewing condition. Their patterns of exploration were similar to those of controls in the familiar task, but they showed scanning differences in the unfamiliar task. Patients were also slower than controls to accomplish both tasks.

LIMITATIONS

Patients with schizophrenia were taking antipsychotic medications, so the presence of medication effects cannot be excluded.

CONCLUSION

People with schizophrenia present a basic psychomotor slowing and seem to establish a less efficient planning strategy in the case of more complex and unfamiliar tasks.

Visual scanning of emotional faces in schizophrenia

This study investigated eye movement differences during facial emotion recognition between 101 patients with chronic schizophrenia and 101 controls. Independent of facial emotion, patients with schizophrenia processed facial information inefficiently; they showed significantly more direct fixations that lasted longer to interest areas (IAs), such as the eyes, nose, mouth, and nasion. The total fixation number, mean fixation duration, and total fixation duration were significantly increased in schizophrenia. Additionally, the number of fixations per second to IAs (IA fixation number/s) was significantly lower in schizophrenia. However, no differences were found between the two groups in the proportion of number of fixations to IAs or total fixation number (IA fixation number %). Interestingly, the negative symptoms of patients with schizophrenia negatively correlated with IA fixation number %. Both groups showed significantly greater attention to positive faces. Compared to controls, patients with schizophrenia exhibited significantly more fixations directed to IAs, a higher total fixation number, and lower IA fixation number/s for negative faces. These results indicate that facial processing efficiency is significantly decreased in schizophrenia, but no difference was observed in processing strategy. Patients with schizophrenia may have special deficits in processing negative faces, and negative symptoms may affect visual scanning parameters.

Imagined motor action and eye movements in schizophrenia

Visual exploration and planning of actions are reported to be abnormal in schizophrenia. Most of the studies monitoring eye movements in patients with schizophrenia have been performed under free-viewing condition. The present study was designed to assess whether mentally performing an action modulates the visuomotor behavior in patients with schizophrenia and in healthy controls. Visual scan paths were monitored in eighteen patients with schizophrenia and in eighteen healthy controls. Participants performed two tasks in which they were asked either to (1) look at a scene on a computer screen (free viewing), or (2) picture themselves making a sandwich in front of a computer screen (active viewing). The scenes contained both task-relevant and task-irrelevant objects. Temporal and spatial characteristics of scan paths were compared for each group and each task. The results indicate that patients with schizophrenia exhibited longer fixation durations, and fewer fixations, than healthy controls in the free viewing condition. The patients' visual exploration improved in the active viewing condition. However, patients looked less at task-relevant objects and looked more at distractors than controls in the active viewing condition in which they were asked to picture themselves making a sandwich in moving their eyes to task-relevant objects on an image. These results are consistent with the literature on deficits in motor imagery in patients with schizophrenia and it extends the impairment to visual exploration in an action imagery task.

The Social Attribution Task-Multiple Choice (SAT-MC): A Psychometric and Equivalence Study of an Alternate Form

The Social Attribution Task-Multiple Choice (SAT-MC) uses a 64-second video of geometric shapes set in motion to portray themes of social relatedness and intentions. Considered a test of "Theory of Mind," the SAT-MC assesses implicit social attribution formation while reducing verbal and basic cognitive demands required of other common measures. We present a comparability analysis of the SAT-MC and the new SAT-MC-II, an alternate form created for repeat testing, in a university sample (n = 92). Score distributions and patterns of association with external validation measures were nearly identical between the two forms, with convergent and discriminant validity supported by association with affect recognition ability and lack of association with basic visual reasoning. Internal consistency of the SAT-MC-II was superior (alpha = .81) to the SAT-MC (alpha = .56). Results support the use of SAT-MC and new SAT-MC-II as equivalent test forms. Demonstrating relatively higher association to social cognitive than basic cognitive abilities, the SAT-MC may provide enhanced sensitivity as an outcome measure of social cognitive intervention trials.

Visual exploration and action processing in schizophrenia

INTRODUCTION

Visual scanning is widely reported to be abnormal in schizophrenia. The majority of eye movement studies in schizophrenic patients have used pictures of a face in isolation in free viewings. This study was designed to examine whether attentional control, through instructions, modulates the visuomotor behaviour in schizophrenia with pictures presenting a face accompanied by its body, and to investigate the ability of schizophrenic patients to recognise others' actions.

METHOD

Visual scan paths were monitored in 26 schizophrenic patients and 26 controls. Participants performed three tasks in which they were asked either to look at the picture in any way they liked, to determine the character's gender, or to recognise the action that the character was making with an object.

RESULTS

Patients explored less the pictures than controls in the free viewing. Their scan paths did not differ from that of controls in the active viewings, though patients tended to "avoid" looking at the character's face in the action recognition task.

CONCLUSION

The results show that patients are able to normalise their pattern of exploration as a function of task demands. The results are discussed in relation to attentional control, cognitive flexibility, dopamine, and processing of context information.

Symptom domains and neurocognitive functioning can help differentiate social cognitive processes in schizophrenia: a meta-analysis

BACKGROUND

The existence of deficits in several social cognitive domains has been established in schizophrenia, and those impairments are known to be a significant determinant of functional outcome. Both symptoms and neurocognition have been linked to social cognitive deficits, but the nature and the relative strength of these relationships have not been established.

METHODS

A meta-analysis of 154 studies (combined N = 7175) was conducted to determine the magnitude of the relationships between 3 symptom domains (reality distortion, disorganization, and negative symptoms) and 6 Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) domains of neurocognition with 4 domains of social cognition. Analyses were conducted to determine whether the strength of these relationships differed depending on the symptom type or neurocognitive domain under investigation.

RESULTS

The correlations between reality distortion and the domains of social cognition ranged from near zero to moderate (r's range from -.07 to -.22), as compared with the moderate association for disorganization (r's range from -.22 to -.32) and negative symptoms (r's range from -.20 to -.26). For each of the neurocognitive domains, the relationships to social cognitive domains were mostly moderate (r's range from .17 to .37), with no one neurocognitive domain being prominent.

CONCLUSIONS

The effect sizes of the correlations between disorganization and negative symptoms with social cognition were relatively larger and more consistent than reality distortion. The relationship between social cognition and 6 MATRICS domains of neurocognition were mostly moderate and relatively consistent. When considering disorganization and negative symptoms, the relationship to social cognitive processes was relatively as strong as for neurocognition.

The relationship between visual object exploration and action processing in schizophrenia

INTRODUCTION

Abnormalities in visual exploration and action processing are widely reported in schizophrenia. The aim of this study was to investigate whether object exploration (in order to recognise an action or the object) modulates visuomotor behaviour differently in schizophrenic patients and controls.

METHODS

Visual scan paths were monitored in 36 patients and 36 controls. Participants performed three tasks, in which they were asked to either (1) name the object (the object-naming task), (2) picture themselves interacting with the object and then name the action (the action-naming task), or (3) explore the object (the free-viewing task).

RESULTS

Patients explored objects less than controls did. Controls explored the part needed to identify an object in the object-naming task and the whole object in the action-naming and free-viewing tasks. In contrast, the patients maintained their gaze on the "identity" part of the object in all three tasks.

CONCLUSION

Our results were consistent with the literature findings on impaired action processing in schizophrenia but also extend the known impairment to implicit action processing when the subject is visually exploring an object. We discuss our results in terms of motivation, the effect of dopamine on eye movement, attentional capture, and frontal lobe dysfunction.

[Emotional valence of words in schizophrenia]

AIM OF THE STUDY

Emotion recognition is a domain in which deficits have been reported in schizophrenia. A number of emotion classification studies have indicated that emotion processing deficits in schizophrenia are more pronounced for negative affects. Given the difficulty of developing material suitable for the study of these emotional deficits, it would be interesting to examine whether patients suffering from schizophrenia are responsive to positively and negatively charged emotion-related words that could be used within the context of remediation strategies. The emotional perception of words was examined in a clinical experiment involving schizophrenia patients. This emotional perception was expressed by the patients in terms of the valence associated with the words. In the present study, we investigated whether schizophrenia patients would assign the same negative and positive valences to words as healthy individuals.

METHODS

Twenty volunteer, clinically stable, outpatients from the Psychiatric Service of the University Hospital of Clermont-Ferrand were recruited. Diagnoses were based on DSM-IV criteria. Global psychiatric symptoms were assessed using the Positive and Negative Symptoms Scale (PANSS). The patients had to evaluate the emotional valence of a set of 300 words on a 5-point scale ranging from "very unpleasant" to "very pleasant".

RESULTS

. The collected results were compared with those obtained by Bonin et al. (2003) [13] from 97 University students. Correlational analyses of the two studies revealed that the emotional valences were highly correlated, i.e. the schizophrenia patients estimated very similar emotional valences. More precisely, it was possible to examine three separate sets of 100 words each (positive words, neutral words and negative words). The positive words that were evaluated were the more positive words from the norms collected by Bonin et al. (2003) [13], and the negative words were the more negative examples taken from these norms. The neutral words reflected the more neutral emotional valences collected. The results suggested that the emotional valences for the negative words were significantly greater in the patients than is observed in the collected norms (P<0.001). Moreover, the emotional valence associated with positive words was significantly lower in the patients than in the collected norms (P<0.001). Nevertheless, only 16 words differed significantly in terms of evaluated emotional valence between patients and young adults.

CONCLUSIONS

Despite their overall emotional impairments, the patients with schizophrenia had a very similar perception of word valence as controls. This result suggests that the emotional perception of most emotional words is preserved. This research provides data important to consider during rehabilitation. Moreover, this study will make it possible to select stimuli for use in future studies of emotion in patients.

Effects of facial emotion recognition remediation on visual scanning of novel face stimuli

Previous research shows that emotion recognition in schizophrenia can be improved with targeted remediation that draws attention to important facial features (eyes, nose, mouth). Moreover, the effects of training have been shown to last for up to one month after training. The aim of this study was to investigate whether improved emotion recognition of novel faces is associated with concomitant changes in visual scanning of these same novel facial expressions. Thirty-nine participants with schizophrenia received emotion recognition training using Ekman's Micro-Expression Training Tool (METT), with emotion recognition and visual scanpath (VSP) recordings to face stimuli collected simultaneously. Baseline ratings of interpersonal and cognitive functioning were also collected from all participants. Post-METT training, participants showed changes in foveal attention to the features of facial expressions of emotion not used in METT training, which were generally consistent with the information about important features from the METT. In particular, there were changes in how participants looked at the features of facial expressions of emotion surprise, disgust, fear, happiness, and neutral, demonstrating that improved emotion recognition is paralleled by changes in the way participants with schizophrenia viewed novel facial expressions of emotion. However, there were overall decreases in foveal attention to sad and neutral faces that indicate more intensive instruction might be needed for these faces during training. Most importantly, the evidence shows that participant gender may affect training outcomes.

A comparison of facial emotion processing in neurological and psychiatric conditions

Patients suffering from various neurological and psychiatric disorders show different levels of facial emotion recognition (FER) impairment, sometimes from the early phases of the disease. Investigating the relative severity of deficits in FER across different clinical and high-risk populations has potential implications for the diagnosis and treatment of these diseases, and could also allow us to understand the neurobiological mechanisms of emotion perception itself. To investigate the role of the dopaminergic system and of the frontotemporal network in FER, we reanalyzed and compared data from four of our previous studies investigating FER performance in patients with frontotemporal dysfunctions and/or dopaminergic system abnormalities at different stages. The performance of patients was compared to the performance obtained by a specific group of matched healthy controls using Cohen’s d effect size. We thus compared emotion and gender recognition in patients with frontotemporal dementia (FTD), amnestic mild cognitive impairment (aMCI), Alzheimer’s disease (AD) at the mild dementia stage, major depressive disorder, Parkinson’s disease treated by l-DOPA (PD-ON) or not (PD-OFF), remitted schizophrenia (SCZ-rem), first-episode schizophrenia treated by antipsychotic medication (SCZ-ON), and drug-naïve first-episode schizophrenia (SCZ-OFF), as well as in unaffected siblings of patients with schizophrenia (SIB). The analyses revealed a pattern of differential impairment of emotion (but not gender) recognition across pathological conditions. On the one hand, dopaminergic medication seems not to modify the moderate deficits observed in SCZ and PD groups (ON vs. OFF), suggesting that the deficit is independent from the dopaminergic system. On the other hand, the observed increase in effect size of the deficit among the aMCI, AD, and FTD groups (and also among the SIB and SCZ-rem groups) suggests that the deficit is dependent on neurodegeneration of the frontotemporal neural networks. Our transnosographic approach combining clinical and high-risk populations with the impact of medication provides new information on the trajectory of impaired emotion perception in neuropsychiatric conditions, and on the role of the dopaminergic system and the frontotemporal network in emotion perception.

Smooth pursuit and visual scanpaths: Independence of two candidate oculomotor risk markers for schizophrenia

OBJECTIVES

Smooth pursuit and visual scanpath deficits are candidate trait markers for schizophrenia. It is not clear whether eye tracking dysfunction (ETD) and atypical scanpath behaviour are the product of the same underlying neurobiological processes. We have examined co-occurrence of ETD and scanpath disturbance in individuals with schizophrenia and healthy volunteers.

METHODS

Eye movements of individuals with schizophrenia (N = 96) and non-clinical age-matched comparison participants (N = 100) were recorded using non-invasive infrared oculography during smooth pursuit in both predictable (horizontal sinusoid) and less predictable (Lissajous sinusoid) conditions and a free viewing scanpath task.

RESULTS

Individuals with schizophrenia demonstrated scanning deficits in both tasks. There was no association between performance measures of smooth pursuit and scene scanpaths in patient or control groups. Odds ratios comparing the likelihood of scanpath dysfunction when ETD was present, and the likelihood of finding scanpath dysfunction when ETD was absent were not significant in patients or controls in either pursuit variant, suggesting that ETD and scanpath dysfunction are independent anomalies in schizophrenia.

CONCLUSION

ETD and scanpath disturbance appear to reflect independent oculomotor or neurocognitive deficits in schizophrenia. Each task may confer unique information about the pathophysiology of psychosis.

Left eye scanning deficit in schizophrenia patients under emotional loading task: comparison with healthy controls

The aim of the present study was to evaluate and characterize visual cognitive function and the effect of emotion in patients with schizophrenia.We recorded exploratory eye movements as biologic markers in 40 schizophrenic patients and 40 age-matched healthy controls. Total eye scanning length (TESL), total number of gaze points (TNGP), and TNGP in right (right TNGP) and left (left TNGP) visual fields on screen were calculated as subjects viewed affectively charged pictures (smiling and crying babies) with fitting sounds.TESL of patients was shorter than that of controls when viewing pictures of smiling babies while recalling pleasurable events, and significantly decreased under negative emotional loading when viewing crying babies while recalling sad events. TESL recovered to the original values after loading positive emotion again in the controls. However, TESL did not recover to the original values in schizophrenic patients. TNGP showed similar alterations in the emotional loading task. When TNGP was evaluated in left and right fields, in patients, the non-recovery of TNGP was only observed in the left side. TESL and left TNGP were negatively correlated with negative symptom scores on PANSS.Schizophrenic patients'eye movements in the left visual field screen during the emotional loading task were different from those of controls, which suggests that visual cognitive function is impaired in the right brain in schizophrenic patients. Exploratory eye movements are a useful marker of visual cognitive function, and are a useful tool to evaluate the influence of emotion in schizophrenic patients.

Inflexible information acquisition strategies mediate visuo-spatial reasoning in stabilized schizophrenia patients

OBJECTIVES

Cognitive deficits are of fundamental importance to the clinical picture of schizophrenia and are on the verge to be included as diagnostic criteria in the DSM-V. While focusing on information processing deficits, no emphasis has been put on whether patients' deficits can be accounted for by maladaptive information acquisition strategy deployment.

METHODS

We tested 24 stabilized patients with schizophrenia and 25 matched controls in a visuo-spatial analogy task with graded difficulty. Eye movement recordings served to identify information acquisition strategies.

RESULTS

Patients compared to healthy controls showed slower reaction times in the easiest condition and higher error rates in the more difficult conditions. Eye movement recordings illustrated that overall mean fixation duration increased with increasing task difficulty in healthy controls only. Further, patients deployed a more efficient strategy ("constructive matching") less often than healthy controls in the easier conditions.

CONCLUSIONS

These results suggest that information acquisition strategies mediate visuo-spatial cognitive performance in schizophrenia. Patients adopt a less efficient strategy independently of task difficulty indicated by a characteristic behavioural pattern. Our results point to a powerful tool of improving patients' performance in cognitively demanding tasks by training them in more flexible cognitive (e.g., information acquisition) strategy deployment.

Current visual scanpath research: a review of investigations into the psychotic, anxiety, and mood disorders

The human visual system is comprised of an array of complex organs, which jointly decode information from visible light to construct a meaningful representation of the surrounding environment. The study of visual scanpaths transpired in a bid to enhance our understanding of the role of eye movements underpinning adaptive functioning as well as psychopathology and was further aided by the advent of modern eye-tracking techniques. This review provides a background to the nature of visual scanpaths, followed by an overview and critique of eye movement studies in specific clinical populations involving the psychotic, anxiety, and mood disorders, and concludes with suggested directions for future research. We performed a Medline and PsycInfo literature search, based on variations of the terms "visual scanpath," "eye-tracking," and "eye movements," in relation to articles published from 1986 to the present. Eye-tracking studies in schizophrenia mostly concurred with the existence of a "restricted" scanning strategy, characterized by fewer number of fixations of increased durations, with shorter scanpath lengths, and a marked avoidance of salient features, especially in relation to facial emotion perception. This has been interpreted as likely reflecting dual impairments in configural processing as well as gestalt perception. Findings from the anxiety and mood disorders have conversely failed to yield coherent results, with further research warranted to provide corroborating evidence and overcome identified methodological limitations. Future studies should also look toward applying similar techniques to related disorders as well as conducting parallel neuroimaging investigations to elucidate potential neurobiological correlates.

Eye Movement during Facial Affect Recognition by Patients with Schizophrenia, Using Japanese Pictures of Facial Affect

A possible relationship between recognition of facial affect and aberrant eye movement was examined in patients with schizophrenia. A Japanese version of standard pictures of facial affect was prepared. These pictures of basic emotions (surprise, anger, happiness, disgust, fear, sadness) were shown to 19 schizophrenic patients and 20 healthy controls who identified emotions while their eye movements were measured. The proportion of correct identifications of ‘disgust’ was significantly lower for schizophrenic patients, their eye fixation time was significantly longer for all pictures of facial affect, and their eye movement speed was slower for some facial affects (surprise, fear, and sadness). One index, eye fixation time for “happiness,” showed a significant difference between the high- and low-dosage antipsychotic drug groups. Some expected facial affect recognition disorder was seen in schizophrenic patients responding to the Japanese version of affect pictures, but there was no correlation between facial affect recognition disorder and aberrant eye movement.

How do schizophrenia patients use visual information to decode facial emotion?

Impairment in recognizing facial emotions is a prominent feature of schizophrenia patients, but the underlying mechanism of this impairment remains unclear. This study investigated the specific aspects of visual information that are critical for schizophrenia patients to recognize emotional expression. Using the Bubbles technique, we probed the use of visual information during a facial emotion discrimination task (fear vs. happy) in 21 schizophrenia patients and 17 healthy controls. Visual information was sampled through randomly located Gaussian apertures (or "bubbles") at 5 spatial frequency scales. Online calibration of the amount of face exposed through bubbles was used to ensure 75% overall accuracy for each subject. Least-square multiple linear regression analyses between sampled information and accuracy were performed to identify critical visual information that was used to identify emotional expression. To accurately identify emotional expression, schizophrenia patients required more exposure of facial areas (i.e., more bubbles) compared with healthy controls. To identify fearful faces, schizophrenia patients relied less on bilateral eye regions at high-spatial frequency compared with healthy controls. For identification of happy faces, schizophrenia patients relied on the mouth and eye regions; healthy controls did not utilize eyes and used the mouth much less than patients did. Schizophrenia patients needed more facial information to recognize emotional expression of faces. In addition, patients differed from controls in their use of high-spatial frequency information from eye regions to identify fearful faces. This study provides direct evidence that schizophrenia patients employ an atypical strategy of using visual information to recognize emotional faces.

The benefit of directly comparing autism and schizophrenia for revealing mechanisms of social cognitive impairment

Autism and schizophrenia share a history of diagnostic conflation that was not definitively resolved until the publication of the DSM-III in 1980. Though now recognized as heterogeneous disorders with distinct developmental trajectories and dissociative features, much of the early nosological confusion stemmed from apparent overlap in certain areas of social dysfunction. In more recent years, separate but substantial literatures have accumulated for autism and schizophrenia demonstrating that abnormalities in social cognition directly contribute to the characteristic social deficits of both disorders. The current paper argues that direct comparison of social cognitive impairment can highlight shared and divergent mechanisms underlying pathways to social dysfunction, a process that can provide significant clinical benefit by informing the development of tailored treatment efforts. Thus, while the history of diagnostic conflation between autism and schizophrenia may have originated in similarities in social dysfunction, the goal of direct comparisons is not to conflate them once again but rather to reveal distinctions that illuminate disorder-specific mechanisms and pathways that contribute to social cognitive impairment.

Clair DM, Benson PJ. Atypical scanpaths in schizophrenia: evidence of a trait- or state-dependent phenomenon?

The development of trait markers of schizophrenia would represent an important advance in understanding the genetic architecture of the disease. To date, no candidate markers have satisfied all of the trait marker criteria, and many are not specific to the schizophrenia spectrum. Abnormalities in visual scanpaths are frequently reported in patients with schizophrenia and are emerging as a novel candidate for a schizophrenia biomarker. Here we review the suitability of scanpath measures as a target for trait marker research in schizophrenia. Papers reporting scanpath patterns in patients with schizophrenia were identified by PubMed and Google Scholar searches and by scanning reference lists in relevant articles. Search terms included "schizophrenia," "psychosis," "scanpath," "scan path," "fixation," "saccade" and "eye movement." Scanpath abnormalities afford impressive sensitivity and specificity and appear largely independent of psychotropic medications. Scanpaths may demonstrate some fluctuation with symptomatology and may be useful in illuminating illness state or subtypes. However, there is evidence that viewing behaviours remain atypical regardless of symptom remission and may be present in unaffected relatives of individuals with schizophrenia. This research is in its early stages, and further investigation regarding patterns of inheritance is required. Our findings support scanpath measures as a favourable topic for further investigation as a trait marker.