Abnormal Gesture Perception and Clinical High-Risk for Psychosis

Overlap between individual differences in cognition and symptoms of schizophrenia

BACKGROUND

Neurocognitive impairment is a core feature of schizophrenia spectrum disorders (SSDs), and the relationship between cognition and symptoms in SSDs has been widely researched. Negative symptoms are related to a wide range of cognitive impairments; however, the aspects of negative symptoms that underpin this relationship have yet to be specified.

STUDY DESIGN

We used iterative Constrained Principal Component Analysis (iCPCA) to explore the relationship between 18 cognitive measures (including processing speed, attention, working, spatial and verbal memory and executive functions) and 46 symptoms in schizophrenia at the individual item level while minimizing the risk of Type I errors. ICPCA was conducted on a sample of SSD patients in the early stages of psychiatric treatment (n = 121) to determine the components of cognition overlapping with symptoms measured by the Scale for the Assessment of Negative Symptoms (SANS) and the Scale for the Assessment of Positive Symptoms (SAPS).

RESULTS

We found that a verbal memory component was associated with items from SANS and SAPS related to impoverished and disorganized emotional communication, language, and thought. In contrast, a working memory component was associated with SANS items related to motor system impoverishment.

CONCLUSIONS

The iCPCA allowed us to explore the associations between individual items, optimized to understand the overlap between symptoms and cognition. The specific symptoms linked to verbal and working memory impairments imply distinct brain networks, which further investigation may lead to our deeper understanding of the illness and the development of treatment methods.

Speech-Gesture Matching and Schizotypal Traits: A Network Approach

BACKGROUND AND HYPOTHESIS

Impaired speech-gesture matching has repeatedly been shown in patients with schizophrenia spectrum disorders. Here, we tested the hypothesis that schizotypal traits in the general population are related to reduced speech-gesture matching performance and reduced self-reports about gesture perception. We further explored the relationships between facets of schizotypy and gesture processing in a network model.

STUDY DESIGN

Participants (1094 mainly healthy adults) were presented with concrete or abstract sentences accompanied with videos showing related or unrelated gestures. For each video, participants evaluated the alignment between speech and gesture. They also completed self-rating scales about the perception and production of gestures (Brief Assessment of Gesture scale) and schizotypal traits (Schizotypal Personality Questionnaire-Brief 22-item version). We analyzed bivariate associations and estimated a non-regularized partial Spearman correlation network. We characterized the network by analyzing bridge centrality and controllability metrics of nodes.

STUDY RESULTS

We found a negative relationship between both concrete and abstract gesture-speech matching performance and overall schizotypy. In the network, disorganization had the highest average controllability and it was negatively related to abstract speech-gesture matching. Bridge centralities indicated that self-reported production of gestures to enhance communication in social interactions connects self-reported gesture perception, schizotypal traits, and gesture processing task performance.

CONCLUSION

The association between impaired abstract speech-gesture matching and disorganization supports a continuum between schizophrenia and schizotypy. Using gestures to facilitate communication connects subjective and objective aspects of gesture processing and schizotypal traits. Future interventional studies in patients should test the potential causal pathways implied by this network model.

Identity recognition from faces and bodies in schizophrenia spectrum disorders

Deficits in facial identity recognition and its association with poor social functioning are well documented in schizophrenia, but none of these studies have assessed the role of the body in these processes. Recent research in healthy populations shows that the body is also an important source of information in identity recognition, and the current study aimed to thoroughly examine identity recognition from both faces and bodies in schizophrenia. Sixty-five individuals with schizophrenia and forty-nine healthy controls completed three conditions of an identity matching task in which they attempted to match unidentified persons in unedited photos of faces and bodies, edited photos showing faces only, or edited photos showing bodies only. Results revealed global deficits in identity recognition in individuals with schizophrenia (ηp2 = 0.068), but both groups showed better recognition from bodies alone as compared to faces alone (ηp2 = 0.573), suggesting that the ability to extract useful information from bodies when identifying persons may remain partially preserved in schizophrenia. Further research is necessary to understand the relationship between face/body processing, identity recognition, and functional outcomes in individuals with schizophrenia-spectrum disorders.

Attentional biases in facial emotion processing in individuals at clinical high risk for psychosis

Individuals at clinical high risk (CHR) for psychosis exhibit altered facial emotion processing (FEP) and poor social functioning. It is unclear whether FEP deficits result from attentional biases, and further, how these abnormalities are linked to symptomatology (e.g., negative symptoms) and highly comorbid disorders that are also tied to abnormal FEP (e.g., depression). In the present study, we employed an eye-tracking paradigm to assess attentional biases and clinical interviews to examine differences between CHR (N = 34) individuals and healthy controls (HC; N = 46), as well as how such biases relate to symptoms and functioning in CHR individuals. Although no CHR-HC differences emerged in attentional biases, within the CHR group, symptoms and functioning were related to biases. Depressive symptoms were related to some free-view attention switching biases (e.g., to and from fearful faces, r = .50). Negative symptoms were related to more slowly disengaging from happy faces (r = .44), spending less time looking at neutral faces (r =  - .42), and more time looking at no face (Avolition, r = .44). In addition, global social functioning was related to processes that overlapped with both depression and negative symptoms, including time looking at no face (r =  - .68) and free-view attention switching with fearful faces (r =  - .40). These findings are consistent with previous research, indicating that negative symptoms play a prominent role in the CHR syndrome, with distinct mechanisms relative to depression. Furthermore, the results suggest that attentional bias indices from eye-tracking paradigms may be predictive of social functioning.

Using virtual reality to assess gesture performance deficits in schizophrenia patients

Introduction

Gesture performance deficits are prevalent in schizophrenia patients and are strongly associated with poor social communication skills and community functioning, affecting their overall quality of life. Currently, video-recording technology is widely used in clinical settings to assess gesture production deficits in schizophrenia patients. Nevertheless, the subjective evaluation of video-recordings can encumber task assessment. The present study will aim to use virtual reality to examine its potential use as an alternative tool to objectively measure gesture performance accuracy in schizophrenia patients and healthy controls.

Methods

Gesture performance in the virtual reality setting will be based on the well-established Test of Upper Limb Apraxia. Participants will be immersed in a virtual environment where they will experience themselves being embodied in a collocated virtual body seen from a first-person perspective. Motion trackers will be placed on participants' hands and elbows to track upper body movements in real-time, and to record gesture movement for later analysis. Participants will see a virtual agent sitting across from them, with a virtual table in between. The agent will perform various types of gestures and the participants' task will be to imitate those gestures as accurately as possible. Measurements from the tracking devices will be stored and analyzed to address gesture performance accuracy across groups.

Discussion

This study aims to provide objective measurements of gesture performance accuracy in schizophrenia patients. If successful, the results will provide new knowledge to the gesture literature and offer the potential for novel therapeutic interventions using virtual reality technologies. Such interventions can improve gesturing and thus advance social communication skills in schizophrenia patients.

Gesticulation in individuals with at risk mental states for psychosis

Nonverbal communication (NVC) is a complex behavior that involves different modalities that are impaired in the schizophrenia spectrum, including gesticulation. However, there are few studies that evaluate it in individuals with at-risk mental states (ARMS) for psychosis, mostly in developed countries. Given our prior findings of reduced movement during speech seen in Brazilian individuals with ARMS, we now aim to determine if this can be accounted for by reduced gesticulation behavior. Fifty-six medication-naïve ARMS and 64 healthy controls were filmed during speech tasks. The frequency of specifically coded gestures across four categories (and self-stimulatory behaviors) were compared between groups and tested for correlations with prodromal symptoms of the Structured Interview for Prodromal Syndromes (SIPS) and with the variables previously published. ARMS individuals showed a reduction in one gesture category, but it did not survive Bonferroni's correction. Gesture frequency was negatively correlated with prodromal symptoms and positively correlated with the variables of the amount of movement previously analyzed. The lack of significant differences between ARMS and control contradicts literature findings in other cultural context, in which a reduction is usually seen in at-risk individuals. However, gesture frequency might be a visual proxy of prodromal symptoms, and of other movement abnormalities. Results show the importance of analyzing NVC in ARMS and of considering different cultural and sociodemographic contexts in the search for markers of these states.

Self-reported Gesture Interpretation and Performance Deficits in Individuals at Clinical High Risk for Psychosis

BACKGROUND AND HYPOTHESIS

Deficits in performing and interpreting communicative nonverbal behaviors, such as gesture, have been linked to varied psychopathology and dysfunction. Some evidence suggests that individuals at risk for psychosis have deficits in gesture interpretation and performance; however, individuals with internalizing disorders (eg, depression) may have similar deficits. No previous studies have examined whether gesture deficits in performance and interpretation are specific to those at risk for psychosis. Additionally, the underlying mechanisms (eg, cognition) and consequences (eg, functioning) of these deficits are poorly understood.

STUDY DESIGN

This study examined self-reported gesture interpretation (SRGI) and performance (SRGP) in those at clinical high risk for psychosis (CHR; N = 88), those with internalizing disorders (INT; N = 51), and healthy controls (HC; N = 53). Participants completed questionnaires, clinical interviews, and neurocognitive tasks.

STUDY RESULTS

Results indicated that the CHR group was characterized by significantly lower SRGI scores than the HC or INT groups (d = 0.41); there were no differences among groups in SRGP. Within CHR participants, greater deficits in SRGP were associated with lower verbal learning and memory (r = -.33), but not general intelligence or processing speed. Furthermore, gesture deficits were associated with higher cross-sectional risk for conversion to a full psychotic disorder in the CHR group.

CONCLUSIONS

Overall, these findings suggest that specific subdomains of gesture may reflect unique vulnerability for psychosis, self-report may be a viable assessment tool in understanding these phenomena, and gesture dysfunction may signal risk for transition to psychosis.

Language abnormalities in schizophrenia: binding core symptoms through contemporary empirical evidence

Both the ability to speak and to infer complex linguistic messages from sounds have been claimed as uniquely human phenomena. In schizophrenia, formal thought disorder (FTD) and auditory verbal hallucinations (AVHs) are manifestations respectively relating to concrete disruptions of those abilities. From an evolutionary perspective, Crow (1997) proposed that "schizophrenia is the price that Homo sapiens pays for the faculty of language". Epidemiological and experimental evidence points to an overlap between FTD and AVHs, yet a thorough investigation examining their shared neural mechanism in schizophrenia is lacking. In this review, we synthesize observations from three key domains. First, neuroanatomical evidence indicates substantial shared abnormalities in language-processing regions between FTD and AVHs, even in the early phases of schizophrenia. Second, neurochemical studies point to a glutamate-related dysfunction in these language-processing brain regions, contributing to verbal production deficits. Third, genetic findings further show how genes that overlap between schizophrenia and language disorders influence neurodevelopment and neurotransmission. We argue that these observations converge into the possibility that a glutamatergic dysfunction in language-processing brain regions might be a shared neural basis of both FTD and AVHs. Investigations of language pathology in schizophrenia could facilitate the development of diagnostic tools and treatments, so we call for multilevel confirmatory analyses focused on modulations of the language network as a therapeutic goal in schizophrenia.

Multimodal speech-gesture training in patients with schizophrenia spectrum disorder: Effects on quality of life and neural processing

Dysfunctional social communication is one of the most stable characteristics in patients with schizophrenia spectrum disorder (SSD) that severely affects quality of life. Interpreting abstract speech and integrating nonverbal information is particularly affected. Considering the difficulty to treat communication dysfunctions with usual intervention, we investigated the possibility to apply a multimodal speech-gesture (MSG) training. In the MSG training, we offered 8 sessions (60 min each) including perceptive and expressive tasks as well as meta-learning elements and transfer exercises to 29 patients with SSD. In a within-group crossover design, patients were randomized to a TAU-first (treatment as usual first, then MSG training) group (N = 20) or a MSG-first (MSG training first, then TAU only) group (N = 9), and were compared to healthy controls (N = 17). Outcomes were quality of life and related changes in the neural processing of abstract speech-gesture information, which were measured pre-post training through standardized psychological questionnaires and functional Magnetic Resonance Imaging, respectively. Pre-training, patients showed reduced quality of life as compared to controls but improved significantly during the training. Strikingly, this improvement was correlated with neural activation changes in the middle temporal gyrus for the processing of abstract multimodal content. Improvement during training, self-report measures and ratings of relatives confirmed the MSG-related changes. Together, we provide first promising results of a novel multimodal speech-gesture training for patients with schizophrenia. We could link training induced changes in speech-gesture processing to changes in quality of life, demonstrating the relevance of intact communication skills and gesture processing for well-being.

Using dynamic point light display stimuli to assess gesture deficits in schizophrenia

Background

Gesture deficits are ubiquitous in schizophrenia patients contributing to poor social communication and functional outcome. Given the dynamic nature of social communications, the current study aimed to explore the underlying socio-cognitive processes associated with point-light-displays (PLDs) of communicative gestures in the absence of any other confounding visual characteristics, and compare them to other well-established stimuli of gestures such as pictures by examining their association with symptom severity and motor-cognitive modalities.

Methods

We included 39-stable schizophrenia outpatients and 27-age-gender matched controls and assessed gesture processing using two tasks. The first task used static stimuli of pictures of a person performing a gesture. The limbs executing the gesture were missing and participants' task was to choose the correct gesture from three-options provided. The second task included videos of dynamic PLDs interacting with each other. One PLD performed communicative gestures, while the other PLD imitated/followed these performed gestures. Participants had to indicate, which of the two PLDs was imitating/following the other. Additionally, we evaluated symptom severity, as well as, motor and cognitive parameters.

Results

Patients underperformed in both gesture tasks compared to controls. Task performance for static stimuli was associated with blunted affect, motor coordination and sequencing domains, while PLD performance was associated with expressive gestures and sensory integration processes.

Discussion

Gesture representations of static and dynamic stimuli are associated with distinct processes contributing to poor social communication in schizophrenia, requiring novel therapeutic interventions. Such stimuli can easily be applied remotely for screening socio-cognitive deficits in schizophrenia.

Altered attentive bias towards interpersonal communication information across phases of schizophrenia: an eye-tracking study

Background

Eye movement abnormality in schizophrenia has been studied for several decades. However, patient differences in eye movements across phases of schizophrenia from eye-tracking studies have not been well documented.

Aims

This pilot study used eye-tracking technology to investigate attentive bias towards interpersonal communication information across different clinical phases of schizophrenia.

Methods

This study included 78 persons at clinical high risk (CHR) for schizophrenia, 68 first-episode (FEZ) patients, and 39 chronically ill patients from the Shanghai At Risk for Psychosis Extending Project (SHARP Extending cohort) as well as 74 healthy controls (HCs). The experiment was an unguided-viewing task composed of 24 trials showing three types of pictures which varied in the degree of interpersonal communication. Type 1 was a scenery picture without people, type 2 was a picture with four people not communicating, and type 3 was a picture with four people communicating. We used two measures: (1) initial fixation duration and (2) total fixation duration.

Results

A ratio for both measures was calculated between measures for pictures with more or less interpersonal communication. The ratio of initial fixation duration for pictures with people communicating versus pictures with people not communicating was lowest in chronically ill patients (0.13 (0.34))compared with HCs (0.31 (0.36)), FEZ patients (0.31 (0.46)), and CHR patients (0.36 (0.42)). The difference in the ratios of initial fixation duration for type 2 and type 3 pictures was also significant for female participants (HCs vs chronically ill patients, t=2.706, p=0.009; CHR patients vs chronically ill patients, t=4.079, p<0.001). In addition, the ratio of initial fixation duration on pictures with people not communicating versus pictures without people negatively correlated with participants’ high-risk symptoms (r=−0.35, p=0.002) among the CHR group and also correlated with the negative symptom subscore on the Positive and Negative Syndrome Scale (PANSS) among chronically ill patients (r=−0.33, p=0.037). The ratio of initial fixation duration between type 1 and type 3 pictures was associated with PANSS negative symptoms only in female patients with schizophrenia (r=−0.46, p=0.004).

Conclusions

These findings suggest an altered attentive bias towards pictures with a high degree of interpersonal communication information across different clinical phases in schizophrenia. The ratio of initial attentive orienting was associated with negative symptoms in female patients.

The Impact of Poor Nonverbal Social Perception on Functional Capacity in Schizophrenia

Background

Nonverbal social perception is the ability to interpret the intentions and dispositions of others by evaluating cues such as facial expressions, body movements, and emotional prosody. Nonverbal social perception plays a key role in social cognition and is fundamental for successful social interactions. Patients with schizophrenia have severe impairments in nonverbal social perception leading to social isolation and withdrawal. Collectively, these aforementioned deficits affect patients' quality of life. Here, we compare nonverbal social perception in patients with schizophrenia and controls and examine how nonverbal social perception relates to daily functioning.

Methods

We compared nonverbal social perception in 41 stable outpatients with schizophrenia and 30 healthy controls using the Mini Profile of Nonverbal Sensitivity (Mini-PONS). The participants evaluated 64 video clips showing a female actor demonstrating various nonverbal social cues. Participants were asked to choose one of two options that best described the observed scenario. We correlated clinical ratings (Positive and Negative Syndrome Scale, Brief Negative Syndrome Scale), Self-report of Negative Symptoms, and functional assessments (functional capacity and functional outcome) with Mini-PONS scores.

Results

Patients performed significantly poorer in the Mini-PONS compared to controls, suggesting deficits in nonverbal social perception. These deficits were not associated with either positive symptoms or negative symptoms (including self-report). However, impaired nonverbal social perception correlated with distinctive domains of BNSS (mainly avolition and blunted affect), as well as functional capacity and functional outcome in patients.

Conclusion

We demonstrate that nonverbal social perception is impaired in stable outpatients with schizophrenia. Nonverbal social perception is directly related to specific negative symptom domains, functional capacity and functional outcome. These findings underline the importance of nonverbal social perception for patients' everyday life and call for novel therapeutic approaches to alleviate nonverbal social perception deficits.

The Processing of Semantic Complexity and Cospeech Gestures in Schizophrenia: A Naturalistic, Multimodal fMRI Study

Schizophrenia is marked by aberrant processing of complex speech and gesture, which may contribute functionally to its impaired social communication. To date, extant neuroscientific studies of schizophrenia have largely investigated dysfunctional speech and gesture in isolation, and no prior research has examined how the two communicative channels may interact in more natural contexts. Here, we tested if patients with schizophrenia show aberrant neural processing of semantically complex story segments, and if speech-associated gestures (co-speech gestures) might modulate this effect. In a functional MRI study, we presented to 34 participants (16 patients and 18 matched-controls) an ecologically-valid retelling of a continuous story, performed via speech and spontaneous gestures. We split the entire story into ten-word segments, and measured the semantic complexity for each segment with idea density, a linguistic measure that is commonly used clinically to evaluate aberrant language dysfunction at the semantic level. Per segment, the presence of numbers of gestures varied (n = 0, 1, +2). Our results suggest that, in comparison to controls, patients showed reduced activation for more complex segments in the bilateral middle frontal and inferior parietal regions. Importantly, this neural aberrance was normalized in segments presented with gestures. Thus, for the first time with a naturalistic multimodal stimulation paradigm, we show that gestures reduced group differences when processing a natural story, probably by facilitating the processing of semantically complex segments of the story in schizophrenia.