A Multimodal Speech-Gesture Training Intervention for Patients With Schizophrenia and Its Neural Underpinnings - the Study Protocol of a Randomized Controlled Pilot Trial

Speech-Gesture Matching and Schizotypal Traits: A Network Approach

BACKGROUND AND HYPOTHESIS

Impaired speech-gesture matching has repeatedly been shown in patients with schizophrenia spectrum disorders. Here, we tested the hypothesis that schizotypal traits in the general population are related to reduced speech-gesture matching performance and reduced self-reports about gesture perception. We further explored the relationships between facets of schizotypy and gesture processing in a network model.

STUDY DESIGN

Participants (1094 mainly healthy adults) were presented with concrete or abstract sentences accompanied with videos showing related or unrelated gestures. For each video, participants evaluated the alignment between speech and gesture. They also completed self-rating scales about the perception and production of gestures (Brief Assessment of Gesture scale) and schizotypal traits (Schizotypal Personality Questionnaire-Brief 22-item version). We analyzed bivariate associations and estimated a non-regularized partial Spearman correlation network. We characterized the network by analyzing bridge centrality and controllability metrics of nodes.

STUDY RESULTS

We found a negative relationship between both concrete and abstract gesture-speech matching performance and overall schizotypy. In the network, disorganization had the highest average controllability and it was negatively related to abstract speech-gesture matching. Bridge centralities indicated that self-reported production of gestures to enhance communication in social interactions connects self-reported gesture perception, schizotypal traits, and gesture processing task performance.

CONCLUSION

The association between impaired abstract speech-gesture matching and disorganization supports a continuum between schizophrenia and schizotypy. Using gestures to facilitate communication connects subjective and objective aspects of gesture processing and schizotypal traits. Future interventional studies in patients should test the potential causal pathways implied by this network model.

Language and communication rehabilitation in patients with schizophrenia: A narrative review

Language impairments often appear in patients with schizophrenia and are potential targets for rehabilitation. Clinical practice and research should be intimately connected. The aim was to perform a narrative review of the assessment and intervention tools that have been used for the rehabilitation of schizophrenia patients with language and communication impairments. Two types of tools, general and specific, were developed for both purposes. General tools include the Positive and Negative Syndrome Scale for assessment, and the Integrated Psychological Therapy for intervention. The specific tools used to evaluate language and communication impairments include the Scale for the Assessment of Thought, Language and Communication, the Formal Thought Disorder scales (for caregivers and patients), and the Thought and Language Disorder scale. The most recent language-specific intervention tools include the Cognitive Pragmatic Treatment, Conecta-2, Let's talk! Multimodal Speech-Gesture training, Speech Therapy Intervention Group, and PragmaCom. These tools primarily involve psychopathology/psychiatry, psychology, linguistics, speech and language therapy, and nursing. In conclusion, a wide range of assessment and intervention tools are available for the rehabilitation of language and communication impairments associated with schizophrenia. An integrative and interdisciplinary approach should always be considered for rehabilitation of language and communication in patients with schizophrenia throughout their lifetime.

Using virtual reality to assess gesture performance deficits in schizophrenia patients

Introduction

Gesture performance deficits are prevalent in schizophrenia patients and are strongly associated with poor social communication skills and community functioning, affecting their overall quality of life. Currently, video-recording technology is widely used in clinical settings to assess gesture production deficits in schizophrenia patients. Nevertheless, the subjective evaluation of video-recordings can encumber task assessment. The present study will aim to use virtual reality to examine its potential use as an alternative tool to objectively measure gesture performance accuracy in schizophrenia patients and healthy controls.

Methods

Gesture performance in the virtual reality setting will be based on the well-established Test of Upper Limb Apraxia. Participants will be immersed in a virtual environment where they will experience themselves being embodied in a collocated virtual body seen from a first-person perspective. Motion trackers will be placed on participants' hands and elbows to track upper body movements in real-time, and to record gesture movement for later analysis. Participants will see a virtual agent sitting across from them, with a virtual table in between. The agent will perform various types of gestures and the participants' task will be to imitate those gestures as accurately as possible. Measurements from the tracking devices will be stored and analyzed to address gesture performance accuracy across groups.

Discussion

This study aims to provide objective measurements of gesture performance accuracy in schizophrenia patients. If successful, the results will provide new knowledge to the gesture literature and offer the potential for novel therapeutic interventions using virtual reality technologies. Such interventions can improve gesturing and thus advance social communication skills in schizophrenia patients.

Multimodal speech-gesture training in patients with schizophrenia spectrum disorder: Effects on quality of life and neural processing

Dysfunctional social communication is one of the most stable characteristics in patients with schizophrenia spectrum disorder (SSD) that severely affects quality of life. Interpreting abstract speech and integrating nonverbal information is particularly affected. Considering the difficulty to treat communication dysfunctions with usual intervention, we investigated the possibility to apply a multimodal speech-gesture (MSG) training. In the MSG training, we offered 8 sessions (60 min each) including perceptive and expressive tasks as well as meta-learning elements and transfer exercises to 29 patients with SSD. In a within-group crossover design, patients were randomized to a TAU-first (treatment as usual first, then MSG training) group (N = 20) or a MSG-first (MSG training first, then TAU only) group (N = 9), and were compared to healthy controls (N = 17). Outcomes were quality of life and related changes in the neural processing of abstract speech-gesture information, which were measured pre-post training through standardized psychological questionnaires and functional Magnetic Resonance Imaging, respectively. Pre-training, patients showed reduced quality of life as compared to controls but improved significantly during the training. Strikingly, this improvement was correlated with neural activation changes in the middle temporal gyrus for the processing of abstract multimodal content. Improvement during training, self-report measures and ratings of relatives confirmed the MSG-related changes. Together, we provide first promising results of a novel multimodal speech-gesture training for patients with schizophrenia. We could link training induced changes in speech-gesture processing to changes in quality of life, demonstrating the relevance of intact communication skills and gesture processing for well-being.

It is time to address language disorders in schizophrenia: A RCT on the efficacy of a novel training targeting the pragmatics of communication (PragmaCom)

INTRODUCTION

Language and communication disruptions in schizophrenia are at the center of a large body of investigation. Yet, the remediation of such disruptions is still in its infancy. Here we targeted what is known to be one of the most damaged language domains in schizophrenia, namely pragmatics, by conducting a pragmatics-centered intervention with a randomized controlled trial design and assessing also durability and generalization. To the best of our knowledge, this is the first study with these characteristics.

METHODS

Inspired by the Gricean account of natural language use, we tailored a novel treatment addressing the pragmatics of communication (PragmaCom) and we tested its efficacy in a sample of individuals with schizophrenia randomized to the experimental group or to an active control group. The primary outcome with respect to the efficacy of the PragmaCom was measured by changes in pragmatic abilities (as evaluated with the global score of the Assessment of Pragmatic Abilities and Cognitive Substrates test) from baseline to 12 weeks and at 3-month follow-up. The secondary outcome was measured by changes in metaphor comprehension, abstract thinking, and global functioning from baseline to 12 weeks and at 3-month follow-up.

RESULTS

Relative to the control group, at post-test the PragmaCom group showed greater and enduring improvement in global pragmatic skills and in metaphor comprehension. At follow-up, these improvements persisted and the PragmaCom exerted beneficial effects also on functioning.

CONCLUSIONS

Despite the limited sample size, we believe that these findings offer initial yet encouraging evidence of the possibility to improve pragmatic skills with a theoretically grounded approach and to obtain durable and clinically relevant benefits. We argue that it is time that therapeutic efforts embrace communicative dysfunctions in order to improve illness outcome.

The Processing of Semantic Complexity and Cospeech Gestures in Schizophrenia: A Naturalistic, Multimodal fMRI Study

Schizophrenia is marked by aberrant processing of complex speech and gesture, which may contribute functionally to its impaired social communication. To date, extant neuroscientific studies of schizophrenia have largely investigated dysfunctional speech and gesture in isolation, and no prior research has examined how the two communicative channels may interact in more natural contexts. Here, we tested if patients with schizophrenia show aberrant neural processing of semantically complex story segments, and if speech-associated gestures (co-speech gestures) might modulate this effect. In a functional MRI study, we presented to 34 participants (16 patients and 18 matched-controls) an ecologically-valid retelling of a continuous story, performed via speech and spontaneous gestures. We split the entire story into ten-word segments, and measured the semantic complexity for each segment with idea density, a linguistic measure that is commonly used clinically to evaluate aberrant language dysfunction at the semantic level. Per segment, the presence of numbers of gestures varied (n = 0, 1, +2). Our results suggest that, in comparison to controls, patients showed reduced activation for more complex segments in the bilateral middle frontal and inferior parietal regions. Importantly, this neural aberrance was normalized in segments presented with gestures. Thus, for the first time with a naturalistic multimodal stimulation paradigm, we show that gestures reduced group differences when processing a natural story, probably by facilitating the processing of semantically complex segments of the story in schizophrenia.

Neural Basis of Speech-Gesture Mismatch Detection in Schizophrenia Spectrum Disorders

Patients with schizophrenia spectrum disorders (SSD) exhibit an aberrant perception and comprehension of abstract speech-gesture combinations associated with dysfunctional activation of the left inferior frontal gyrus (IFG). Recently, a significant deficit of speech-gesture mismatch detection was identified in SSD, but the underlying neural mechanisms have not yet been examined. A novel mismatch-detection fMRI paradigm was implemented manipulating speech-gesture abstractness (abstract/concrete) and relatedness (related/unrelated). During fMRI data acquisition, 42 SSD patients (schizophrenia, schizoaffective disorder, or other non-organic psychotic disorder [ICD-10: F20, F25, F28; DSM-IV: 295.X]) and 36 healthy controls were presented with short video clips of an actor reciting abstract or concrete sentences accompanied by either a semantically related or unrelated gesture. Participants indicated via button press whether they perceived each gesture as matching the speech content or not. Speech-gesture mismatch detection performance was significantly impaired in patients compared to controls. fMRI data analysis revealed that patients showed lower activation in bilateral frontal areas, including the IFG for all abstract > concrete speech-gesture pairs. In addition, they exhibited reduced engagement of the right supplementary motor area (SMA) and bilateral anterior cingulate cortices (ACC) for unrelated > related stimuli. We provide first evidence that impaired speech-gesture mismatch detection in SSD could be the result of dysfunctional activation of the SMA and ACC. Failure to activate the left IFG disrupts the integration of abstract speech-gesture combinations in particular. Future investigations should focus on brain stimulation of the SMA, ACC, and the IFG to improve communication and social functioning in SSD.

Abnormal Gesture Perception and Clinical High-Risk for Psychosis

Individuals diagnosed with psychotic disorders exhibit abnormalities in the perception of expressive behaviors, which are linked to symptoms and visual information processing domains. Specifically, literature suggests these groups have difficulties perceiving gestures that accompany speech. While our understanding of gesture perception in psychotic disorders is growing, gesture perception abnormalities and clues about potential causes and consequences among individuals meeting criteria for a clinical high-risk (CHR) syndrome is limited. Presently, 29 individuals with a CHR syndrome and 32 healthy controls completed an eye-tracking gesture perception paradigm. In this task, participants viewed an actor using abstract and literal gestures while presenting a story and eye gaze data (eg, fixation counts and total fixation time) was collected. Furthermore, relationships between fixation variables and both symptoms (positive, negative, anxiety, and depression) and measures of visual information processing (working memory and attention) were examined. Findings revealed that the CHR group gazed at abstract gestures fewer times than the control group. When individuals in the CHR group did gaze at abstract gestures, on average, they spent significantly less time fixating compared to controls. Furthermore, reduced fixation (ie, count and time) was related to depression and slower response time on an attentional task. While a similar pattern of group differences in the same direction appeared for literal gestures, the effect was not significant. These data highlight the importance of integrating gesture perception abnormalities into vulnerability models of psychosis and inform the development of targeted treatments for social communicative deficits.

Modality-specific dysfunctional neural processing of social-abstract and non-social-concrete information in schizophrenia

Schizophrenia is characterized by marked communication dysfunctions encompassing potential impairments in the processing of social-abstract and non-social-concrete information, especially in everyday situations where multiple modalities are present in the form of speech and gesture. To date, the neurobiological basis of these deficits remains elusive. In a functional magnetic resonance imaging (fMRI) study, 17 patients with schizophrenia or schizoaffective disorder, and 18 matched controls watched videos of an actor speaking, gesturing (unimodal), and both speaking and gesturing (bimodal) about social or non-social events in a naturalistic way. Participants were asked to judge whether each video contains person-related (social) or object-related (non-social) information. When processing social-abstract content, patients showed reduced activation in the medial prefrontal cortex (mPFC) only in the gesture but not in the speech condition. For non-social-concrete content, remarkably, reduced neural activation for patients in the left postcentral gyrus and the right insula was observed only in the speech condition. Moreover, in the bimodal conditions, patients displayed improved task performance and comparable activation to controls in both social and non-social content. To conclude, patients with schizophrenia displayed modality-specific aberrant neural processing of social and non-social information, which is not present for the bimodal conditions. This finding provides novel insights into dysfunctional multimodal communication in schizophrenia, and may have potential therapeutic implications.

Nonverbal communication remains untouched: No beneficial effect of symptomatic improvement on poor gesture performance in schizophrenia

BACKGROUND

Gestures are an important part of communication. Patients with schizophrenia present gesture deficits that tend to deteriorate in the course of the disease and hamper functional outcome. This gesture deficit has been associated with motor abnormalities, cognitive impairment, and psychotic symptoms. Unaffected, first-degree relatives of schizophrenia patients share some subclinical motor and cognitive abnormalities. We aimed to investigate, whether gesture performance changes with symptomatic improvement in patients, and to test the longitudinal performance in unaffected, first-degree relatives.

METHODS

In this study, we measured gesture performance using a validated test in 33 patients, 29 first-degree relatives and 38 healthy controls. Measurements were completed shortly after admission and before discharge in patients. Performance was rated blindly by experts using video recordings of the gesture task. Additionally, we evaluated cognitive function and psychotic symptoms at both visits.

RESULTS

Gesture performance was poorer in relatives compared to controls and poorer in patients compared to both relatives and controls. Patients showed an improvement in psychopathology but a significant decrease in gesture performance at follow-up, while performance in the other groups remained stable. Proportional change of gesture performance correlated with change of cognitive function in patients, whereas there were no correlations with change of cognitive function in the other groups.

CONCLUSION

While symptom severity was reduced, the gesture deficit further deteriorated in schizophrenia. The finding argues for distinct processes contributing to poor nonverbal communication skills in patients, requiring novel alternative treatment efforts.