Lower speech connectedness linked to incidence of psychosis in people at clinical high risk

Automated linguistic analysis in youth at clinical high risk for psychosis

Identifying individuals at clinical high risk for psychosis (CHRP) is crucial for preventing psychosis and improving the prognosis for schizophrenia. Individuals at CHR-P may exhibit mild forms of formal thought disorder (FTD), making it possible to identify them using natural language processing (NLP) methods. In this study, speech samples of 62 CHR-P individuals and 45 healthy controls (HCs) were elicited using Thematic Apperception Test images. The evaluation involved various NLP measures such as semantic similarity, generic, and part-of-speech (POS) features. The CHR-P group demonstrated higher sentence-level semantic similarity and reduced mean image-to-text similarity. Regarding generic analysis, they demonstrated reduced verbosity and produced shorter sentences with shorter words. The POS analysis revealed a decrease in the utilization of adverbs, conjunctions, and first-person singular pronouns, alongside an increase in the utilization of adjectives in the CHR-P group compared to HC. In addition, we developed a machine-learning model based on 30 NLP-derived features to distinguish between the CHR-P and HC groups. The model demonstrated an accuracy of 79.6 % and an AUC-ROC of 0.86. Overall, these findings suggest that automated language analysis of speech could provide valuable information for characterizing FTD during the clinical high-risk phase and has the potential to be applied objectively for early intervention for psychosis.

Detecting schizophrenia, bipolar disorder, psychosis vulnerability and major depressive disorder from 5 minutes of online-collected speech

Background

Psychosis poses substantial social and healthcare burdens. The analysis of speech is a promising approach for the diagnosis and monitoring of psychosis, capturing symptoms like thought disorder and flattened affect. Recent advancements in Natural Language Processing (NLP) methodologies enable the automated extraction of informative speech features, which has been leveraged for early psychosis detection and assessment of symptomology. However, critical gaps persist, including the absence of standardized sample collection protocols, small sample sizes, and a lack of multi-illness classification, limiting clinical applicability. Our study aimed to (1) identify an optimal assessment approach for the online and remote collection of speech, in the context of assessing the psychosis spectrum and evaluate whether a fully automated, speech-based machine learning (ML) pipeline can discriminate among different conditions on the schizophrenia-bipolar spectrum (SSD-BD-SPE), help-seeking comparison subjects (MDD), and healthy controls (HC) at varying layers of analysis and diagnostic complexity.

Methods

We adopted online data collection methods to collect 20 minutes of speech and demographic information from individuals. Participants were categorized as "healthy" help-seekers (HC), having a schizophrenia-spectrum disorder (SSD), bipolar disorder (BD), major depressive disorder (MDD), or being on the psychosis spectrum with sub-clinical psychotic experiences (SPE). SPE status was determined based on self-reported clinical diagnosis and responses to the PHQ-8 and PQ-16 screening questionnaires, while other diagnoses were determined based on self-report from participants. Linguistic and paralinguistic features were extracted and ensemble learning algorithms (e.g., XGBoost) were used to train models. A 70%-30% train-test split and 30-fold cross-validation was used to validate the model performance.

Results

The final analysis sample included 1140 individuals and 22,650 minutes of speech. Using 5-minutes of speech, our model could discriminate between HC and those with a serious mental illness (SSD or BD) with 86% accuracy (AUC = 0.91, Recall = 0.7, Precision = 0.98). Furthermore, our model could discern among HC, SPE, BD and SSD groups with 86% accuracy (F1 macro = 0.855, Recall Macro = 0.86, Precision Macro = 0.86). Finally, in a 5-class discrimination task including individuals with MDD, our model had 76% accuracy (F1 macro = 0.757, Recall Macro = 0.758, Precision Macro = 0.766).

Conclusion

Our ML pipeline demonstrated disorder-specific learning, achieving excellent or good accuracy across several classification tasks. We demonstrated that the screening of mental disorders is possible via a fully automated, remote speech assessment pipeline. We tested our model on relatively high number conditions (5 classes) in the literature and in a stratified sample of psychosis spectrum, including HC, SPE, SSD and BD (4 classes). We tested our model on a large sample (N = 1150) and demonstrated best-in-class accuracy with remotely collected speech data in the psychosis spectrum, however, further clinical validation is needed to test the reliability of model performance.

Quantifying abnormal emotion processing: A novel computational assessment method and application in schizophrenia

Abnormal emotion processing is a core feature of schizophrenia spectrum disorders (SSDs) that encompasses multiple operations. While deficits in some areas have been well-characterized, we understand less about abnormalities in the emotion processing that happens through language, which is highly relevant for social life. Here, we introduce a novel method using deep learning to estimate emotion processing rapidly from spoken language, testing this approach in male-identified patients with SSDs (n = 37) and healthy controls (n = 51). Using free responses to evocative stimuli, we derived a measure of appropriateness, or "emotional alignment" (EA). We examined psychometric characteristics of EA and its sensitivity to a single-dose challenge of oxytocin, a neuropeptide shown to enhance the salience of socioemotional information in SSDs. Patients showed impaired EA relative to controls, and impairment correlated with poorer social cognitive skill and more severe motivation and pleasure deficits. Adding EA to a logistic regression model with language-based measures of formal thought disorder (FTD) improved classification of patients versus controls. Lastly, oxytocin administration improved EA but not FTD among patients. While additional validation work is needed, these initial results suggest that an automated assay using spoken language may be a promising approach to assess emotion processing in SSDs.

N400 event-related brain potential index of semantic processing and two-year clinical outcomes in persons at high risk for psychosis: A longitudinal study

The N400 event-related brain potential (ERP) semantic priming effect reflects greater activation of contextually related versus unrelated concepts in long-term semantic memory. Deficits in this measure have been found in persons with schizophrenia and those at clinical high risk (CHR) for this disorder. In CHR patients, we previously found that these deficits predict poorer social functional outcomes after 1 year. In the present study, we tested whether these deficits predicted greater psychosis-spectrum symptom severity and functional impairment over 2 years. We measured N400 semantic priming effects at baseline in CHR patients (n = 47) who viewed prime words each followed by a related/unrelated target word at stimulus-onset asynchronies (SOAs) of 300 or 750 ms. We measured psychosis-spectrum symptoms using the Structured Interview for Prodromal Symptoms and role and social functioning with the Global Functioning: Role and Social scales, at baseline, 1 (n = 29) and 2 years (n = 25). There was a significant interaction between the N400 semantic priming effect at the 300-ms SOA and time on GF:Role scores, indicating that, contrary to expectations, smaller baseline N400 semantic priming effects were associated with more improvement in role functioning from baseline to Year 1, but baseline N400 priming effects did not predict role functioning at Year 2. N400 priming effects were not significantly associated with different trajectories in psychosis-spectrum symptoms or social functioning. Thus, CHR patients' N400 semantic priming effects did not predict clinical outcomes over 2 years, suggesting that this ERP measure may have greater value as a state or short-term prognostic neurophysiological biomarker.

Towards a scalable approach to assess speech organization across the psychosis-spectrum -online assessment in conjunction with automated transcription and extraction of speech measures

Automatically extracted measures of speech constitute a promising marker of psychosis as disorganized speech is associated with psychotic symptoms and predictive of psychosis-onset. The potential of speech markers is, however, hampered by (i) lengthy assessments in laboratory settings and (ii) manual transcriptions. We investigated whether a short, scalable data collection (online) and processing (automated transcription) procedure would provide data of sufficient quality to extract previously validated speech measures. To evaluate the fit of our approach for purpose, we assessed speech in relation to psychotic-like experiences in the general population. Participants completed an 8-minute-long speech task online. Sample 1 included measures of psychometric schizotypy and delusional ideation (N = 446). Sample 2 included a low and high psychometric schizotypy group (N = 144). Recordings were transcribed both automatically and manually, and connectivity, semantic, and syntactic speech measures were extracted for both types of transcripts. 73%/86% participants in sample 1/2 completed the experiment. Nineteen out of 25 speech measures were strongly (r > 0.7) and significantly correlated between automated and manual transcripts in both samples. Amongst the 14 connectivity measures, 11 showed a significant relationship with delusional ideation. For the semantic and syntactic measures, On Topic score and the Frequency of personal pronouns were negatively correlated with both schizotypy and delusional ideation. Combined with demographic information, the speech markers could explain 11-14% of the variation of delusional ideation and schizotypy in Sample 1 and could discriminate between high-low schizotypy with high accuracy (0.72-0.70, AUC = 0.78-0.79) in Sample 2. The moderate to high retention rate, strong correlation of speech measures across manual and automated transcripts and sensitivity to psychotic-like experiences provides initial evidence that online collected speech in combination with automatic transcription is a feasible approach to increase accessibility and scalability of speech-based assessment of psychosis.

Automated analysis of speech as a marker of sub-clinical psychotic experiences

Automated speech analysis techniques, when combined with artificial intelligence and machine learning, show potential in capturing and predicting a wide range of psychosis symptoms, garnering attention from researchers. These techniques hold promise in predicting the transition to clinical psychosis from at-risk states, as well as relapse or treatment response in individuals with clinical-level psychosis. However, challenges in scientific validation hinder the translation of these techniques into practical applications. Although sub-clinical research could aid to tackle most of these challenges, there have been only few studies conducted in speech and psychosis research in non-clinical populations. This work aims to facilitate this work by summarizing automated speech analytical concepts and the intersection of this field with psychosis research. We review psychosis continuum and sub-clinical psychotic experiences, and the benefits of researching them. Then, we discuss the connection between speech and psychotic symptoms. Thirdly, we overview current and state-of-the art approaches to the automated analysis of speech both in terms of language use (text-based analysis) and vocal features (audio-based analysis). Then, we review techniques applied in subclinical population and findings in these samples. Finally, we discuss research challenges in the field, recommend future research endeavors and outline how research in subclinical populations can tackle the listed challenges.

Linguistic findings in persons with schizophrenia-a review of the current literature

INTRODUCTION

Alterations of verbalized thought occur frequently in psychotic disorders. We characterize linguistic findings in individuals with schizophrenia based on the current literature, including findings relevant for differential and early diagnosis.

METHODS

Review of literature published via PubMed search between January 2010 and May 2022.

RESULTS

A total of 143 articles were included. In persons with schizophrenia, language-related alterations can occur at all linguistic levels. Differentiating from findings in persons with affective disorders, typical symptoms in those with schizophrenia mainly include so-called "poverty of speech," reduced word and sentence production, impaired processing of complex syntax, pragmatic language deficits as well as reduced semantic verbal fluency. At the at-risk state, "poverty of content," pragmatic difficulties and reduced verbal fluency could be of predictive value.

DISCUSSION

The current results support multilevel alterations of the language system in persons with schizophrenia. Creative expressions of psychotic experiences are frequently found but are not in the focus of this review. Clinical examinations of linguistic alterations can support differential diagnostics and early detection. Computational methods (Natural Language Processing) may improve the precision of corresponding diagnostics. The relations between language-related and other symptoms can improve diagnostics.

Trajectories through semantic spaces in schizophrenia and the relationship to ripple bursts

Human cognition is underpinned by structured internal representations that encode relationships between entities in the world (cognitive maps). Clinical features of schizophrenia-from thought disorder to delusions-are proposed to reflect disorganization in such conceptual representations. Schizophrenia is also linked to abnormalities in neural processes that support cognitive map representations, including hippocampal replay and high-frequency ripple oscillations. Here, we report a computational assay of semantically guided conceptual sampling and exploit this to test a hypothesis that people with schizophrenia (PScz) exhibit abnormalities in semantically guided cognition that relate to hippocampal replay and ripples. Fifty-two participants [26 PScz (13 unmedicated) and 26 age-, gender-, and intelligence quotient (IQ)-matched nonclinical controls] completed a category- and letter-verbal fluency task, followed by a magnetoencephalography (MEG) scan involving a separate sequence-learning task. We used a pretrained word embedding model of semantic similarity, coupled to a computational model of word selection, to quantify the degree to which each participant's verbal behavior was guided by semantic similarity. Using MEG, we indexed neural replay and ripple power in a post-task rest session. Across all participants, word selection was strongly influenced by semantic similarity. The strength of this influence showed sensitivity to task demands (category > letter fluency) and predicted performance. In line with our hypothesis, the influence of semantic similarity on behavior was reduced in schizophrenia relative to controls, predicted negative psychotic symptoms, and correlated with an MEG signature of hippocampal ripple power (but not replay). The findings bridge a gap between phenomenological and neurocomputational accounts of schizophrenia.

Speech as a Graph: Developmental Perspectives on the Organization of Spoken Language

Language has been used as a privileged window to investigate mental processes. More recently, descriptions of psychopathological symptoms have been analyzed with the help of natural language processing tools. An example is the study of speech organization using graph theoretical approaches that began approximately 10 years ago. After its application in different areas, there is a need to better characterize what aspects can be associated with typical and atypical behavior throughout the lifespan, given the variables related to aging as well as biological and social contexts. The precise quantification of mental processes assessed through language may allow us to disentangle biological/social markers by looking at naturalistic protocols in different contexts. In this review, we discuss 10 years of studies in which word recurrence graphs were adopted to characterize the chain of thoughts expressed by individuals while producing discourse. Initially developed to understand formal thought disorder in the context of psychotic syndromes, this line of research has been expanded to understand the atypical development in different stages of psychosis and differential diagnosis (such as dementia) as well as the typical development of thought organization in school-age children/teenagers in naturalistic and school-based protocols. We comment on the effects of environmental factors, such as education and reading habits (in monolingual and bilingual contexts), in clinical and nonclinical populations at different developmental stages (from childhood to older adulthood, considering aging effects on cognition). Looking toward the future, there is an opportunity to use word recurrence graphs to address complex questions that consider biological/social factors within a developmental perspective in typical and atypical contexts.

Language network self-inhibition and semantic similarity in first-episode schizophrenia: A computational-linguistic and effective connectivity approach

INTRODUCTION

A central feature of schizophrenia is the disorganization and impoverishment of language. Recently, we observed higher semantic similarity in first-episode-schizophrenia (FES) patients. In this study, we investigate if this aberrant similarity relates to the 'causal' connectivity between two key nodes of the word production system: inferior frontal gyrus (IFG) and the semantic-hub at the ventral anterior temporal lobe (vATL).

METHODS

Resting-state fMRI scans were collected from 60 participants (30 untreated FES and 30 healthy controls). The semantic distance was measured with the CoVec semantic tool based on GloVe. A spectral dynamic causal model with Parametrical Empirical Bayes was constructed modelling the intrinsic self-inhibitory and extrinsic-excitatory connections within the brain regions. We estimated the parameters of a fully connected model with the semantic distance as a covariate.

RESULTS

FES patients chose words with higher semantic similarity when describing the pictures compared to the HC group. Among patients, an increased semantic similarity was related with an increase in intrinsic connections within both the vATL and IFG, suggesting that reduced 'synaptic gain' in these regions likely contribute to aberrant sampling of the semantic space during discourse in schizophrenia.

CONCLUSIONS

Lexical impoverishment relates to increased self-inhibition in both the IFG and vATL. The associated reduction in synaptic gain may relate to reduced precision of locally generated neural activity, forcing the choice of words that are already 'activated' in a lexical network. One approach to improve word sampling may be via promoting synaptic gain via supra-physiological stimulation within the Broca's-vATL network; this proposal needs verification.

Happy thoughts: What computational assessment of connectedness and emotional words can inform about early stages of psychosis

In recent years, different natural language processing tools measured aspects related to narratives' structural, semantic, and emotional content. However, there is a need to better understand the limitations and effectiveness of speech elicitation protocols. The graph-theoretical analysis applied to short narratives reveals lower connectedness associated with negative symptoms even in the early stages of psychosis, but emotional topics seem more informative than others. We investigate the interaction between connectedness and emotional words with negative symptoms and educational level in participants with and without psychosis. For that purpose, we used a speech elicitation protocol based on three positive affective pictures and calculated the proportion of emotional words and connectedness measures in the first-episode psychosis (FEP) group (N: 24) and a control group (N: 33). First, we replicated the association between connectedness and negative symptoms (R2: 0.53, p: 0.0049). Second, the more positive terms, the more connected the narrative was, exclusively under psychosis and in association with education, pointing to an interaction between symptoms and formal education. Negative symptoms were independently associated with connectedness, but not with emotional words, although the associations with education were mutually dependent. Together, education and symptoms explained almost 70 % of connectedness variance (R2: 0.67, p < 0.0001), but not emotional expression. At this initial stage of psychosis, education seems to play an important role, diminishing the impact of negative symptoms on the narrative connectedness. Negative symptoms in FEP impact narrative connectedness in association with emotional expression, revealing aspects of social cognition through a short and innocuous protocol.

The SPEAK study rationale and design: A linguistic corpus-based approach to understanding thought disorder

AIM

Psychotic symptoms are typically measured using clinical ratings, but more objective and sensitive metrics are needed. Hence, we will assess thought disorder using the Research Domain Criteria (RDoC) heuristic for language production, and its recommended paradigm of "linguistic corpus-based analyses of language output". Positive thought disorder (e.g., tangentiality and derailment) can be assessed using word-embedding approaches that assess semantic coherence, whereas negative thought disorder (e.g., concreteness, poverty of speech) can be assessed using part-of-speech (POS) tagging to assess syntactic complexity. We aim to establish convergent validity of automated linguistic metrics with clinical ratings, assess normative demographic variance, determine cognitive and functional correlates, and replicate their predictive power for psychosis transition among at-risk youths.

METHODS

This study will assess language production in 450 English-speaking individuals in Australia and Canada, who have recent onset psychosis, are at clinical high risk (CHR) for psychosis, or who are healthy volunteers, all well-characterized for cognition, function and symptoms. Speech will be elicited using open-ended interviews. Audio files will be transcribed and preprocessed for automated natural language processing (NLP) analyses of coherence and complexity. Data analyses include canonical correlation, multivariate linear regression with regularization, and machine-learning classification of group status and psychosis outcome.

CONCLUSIONS

This prospective study aims to characterize language disturbance across stages of psychosis using computational approaches, including psychometric properties, normative variance and clinical correlates, important for biomarker development. SPEAK will create a large archive of language data available to other investigators, a rich resource for the field.

Online speech assessment of the psychotic spectrum: Exploring the relationship between overlapping acoustic markers of schizotypy, depression and anxiety

BACKGROUND

Remote assessment of acoustic alterations in speech holds promise to increase scalability and validity in research across the psychosis spectrum. A feasible first step in establishing a procedure for online assessments is to assess acoustic alterations in psychometric schizotypy. However, to date, the complex relationship between alterations in speech related to schizotypy and those related to comorbid conditions such as symptoms of depression and anxiety has not been investigated. This study tested whether (1) depression, generalized anxiety and high psychometric schizotypy have similar voice characteristics, (2) which acoustic markers of online collected speech are the strongest predictors of psychometric schizotypy, (3) whether including generalized anxiety and depression symptoms in the model can improve the prediction of schizotypy.

METHODS

We collected cross-sectional, online-recorded speech data from 441 participants, assessing demographics, symptoms of depression, generalized anxiety and psychometric schizotypy.

RESULTS

Speech samples collected online could predict psychometric schizotypy, depression, and anxiety symptoms with weak to moderate predictive power, and with moderate and good predictive power when basic demographic variables were added to the models. Most influential features of these models largely overlapped. The predictive power of speech marker-based models of schizotypy significantly improved after including symptom scores of depression and generalized anxiety in the models (from R2 = 0.296 to R2 = 0. 436).

CONCLUSIONS

Acoustic features of online collected speech are predictive of psychometric schizotypy as well as generalized anxiety and depression symptoms. The acoustic characteristics of schizotypy, depression and anxiety symptoms significantly overlap. Speech models that are designed to predict schizotypy or symptoms of the schizophrenia spectrum might therefore benefit from controlling for symptoms of depression and anxiety.

Lower cohesion and altered first-person pronoun usage in the spoken life narratives of individuals with schizophrenia

Usage of computational tools to quantify language disturbances among individuals with psychosis is increasing, improving measurement efficiency and access to fine-grained constructs. However, few studies apply automated linguistic analysis to life narratives in this population. Such research could facilitate the measurement of psychosis-relevant constructs such as sense of agency, capacity to organize one's personal history, narrative richness, and perceptions of the roles that others play in one's life. Furthermore, research is needed to understand how narrative linguistic features relate to cognitive and social functioning. In the present study, individuals with schizophrenia (n = 32) and individuals without a psychotic disorder (n = 15) produced personal life narratives within the Indiana Psychiatric Illness Interview. Narratives were analyzed using the Coh-Metrix computational tool. Linguistic variables analyzed were indices of connections within causal and goal-driven speech (deep cohesion), unique word usage (lexical diversity), and pronoun usage. Individuals with schizophrenia compared to control participants produced narratives that were lower in deep cohesion, contained more first-person singular pronouns, and contained fewer first-person plural pronouns. Narratives did not significantly differ between groups in lexical diversity, third-person pronoun usage, or total word count. Cognitive-linguistic relationships emerged in the full sample, including significant correlations between greater working memory capacity and greater deep cohesion and lexical diversity. In the schizophrenia group, social problem-solving abilities did not correlate with linguistic variables but were associated with cognition. Findings highlight the relevance of psychotherapies which aim to promote recovery among individuals with psychosis through the construction of coherent life narratives and increasing agency and social connectedness.

Detecting at-risk mental states for psychosis (ARMS) using machine learning ensembles and facial features

AIMS

Our study aimed to develop a machine learning ensemble to distinguish "at-risk mental states for psychosis" (ARMS) subjects from control individuals from the general population based on facial data extracted from video-recordings.

METHODS

58 non-help-seeking medication-naïve ARMS and 70 healthy subjects were screened from a general population sample. At-risk status was assessed with the Structured Interview for Prodromal Syndromes (SIPS), and "Subject's Overview" section was filmed (5-10 min). Several features were extracted, e.g., eye and mouth aspect ratio, Euler angles, coordinates from 51 facial landmarks. This elicited 649 facial features, which were further selected using Gradient Boosting Machines (AdaBoost combined with Random Forests). Data was split in 70/30 for training, and Monte Carlo cross validation was used.

RESULTS

Final model reached 83 % of mean F1-score, and balanced accuracy of 85 %. Mean area under the curve for the receiver operator curve classifier was 93 %. Convergent validity testing showed that two features included in the model were significantly correlated with Avolition (SIPS N2 item) and expression of emotion (SIPS N3 item).

CONCLUSION

Our model capitalized on short video-recordings from individuals recruited from the general population, effectively distinguishing between ARMS and controls. Results are encouraging for large-screening purposes in low-resource settings.

Semantic and Acoustic Markers in Schizophrenia-Spectrum Disorders: A Combinatory Machine Learning Approach

BACKGROUND AND HYPOTHESIS

Speech is a promising marker to aid diagnosis of schizophrenia-spectrum disorders, as it reflects symptoms like thought disorder and negative symptoms. Previous approaches made use of different domains of speech for diagnostic classification, including features like coherence (semantic) and form (acoustic). However, an examination of the added value of each domain when combined is lacking as of yet. Here, we investigate the acoustic and semantic domains separately and combined.

STUDY DESIGN

Using semi-structured interviews, speech of 94 subjects with schizophrenia-spectrum disorders (SSD) and 73 healthy controls (HC) was recorded. Acoustic features were extracted using a standardized feature-set, and transcribed interviews were used to calculate semantic word similarity using word2vec. Random forest classifiers were trained for each domain. A third classifier was used to combine features from both domains; 10-fold cross-validation was used for each model.

RESULTS

The acoustic random forest classifier achieved 81% accuracy classifying SSD and HC, while the semantic domain classifier reached an accuracy of 80%. Joining features from the two domains, the combined classifier reached 85% accuracy, significantly improving on separate domain classifiers. For the combined classifier, top features were fragmented speech from the acoustic domain and variance of similarity from the semantic domain.

CONCLUSIONS

Both semantic and acoustic analyses of speech achieved ~80% accuracy in classifying SSD from HC. We replicate earlier findings per domain, additionally showing that combining these features significantly improves classification performance. Feature importance and accuracy in combined classification indicate that the domains measure different, complementing aspects of speech.

LSD and language: Decreased structural connectivity, increased semantic similarity, changed vocabulary in healthy individuals

Language has been explored as a window into the mind. Psychedelics, known to affect perception and cognition, seem to change language, but a systematic, time-dependent exploration is lacking. Therefore, we aimed at mapping the psychedelic effects on language over the time course of the acute and sub-acute effects in an explorative manner. For this, 24 healthy volunteers (age [mean±SD, range]: 35±11, 25-61 years; 33% women) received 50 μg lysergic acid diethylamide (LSD) or inactive placebo in a randomized, double-blind, placebo-controlled, crossover study. We assessed different language productions (experience reporting, storytelling), components (structure, semantics, vocabulary) and time points (+0 h to +24 h). Language productions included 5-min experience reporting (+1.5 h, +6.5 h) and 1-min storytelling (+0 h, +2 h, +4 h, +6 h, +24 h). Language structure was assessed by computing speech topology (SpeechGraphs), semantics by semantic distances (FastText), vocabulary by word categories (LIWC). LSD, compared to placebo, changed language structure, including decreased verbosity, lexicon, global and local connectivity (+1.5 h to +4 h); decreased semantic distances between neighbouring words and overall words (+2 h to +24 h); and changed vocabulary related to grammar, persons, time, space and biological processes (+1.5 h to +24 h). In conclusion, low to moderate LSD doses changed language over diverse production types, components and time points. While simpler and disconnected structure and semantic similarity might reflect cognitive impairments, changed vocabulary might reflect subjective perceptions. Therefore, language under LSD might provide a window into the psychedelic mind and automated language quantifications should be better explored as valuable tools to yield more unconstrained insights into psychedelic perception and cognition.

Applications of Speech Analysis in Psychiatry

ABSTRACT

The need for objective measurement in psychiatry has stimulated interest in alternative indicators of the presence and severity of illness. Speech may offer a source of information that bridges the subjective and objective in the assessment of mental disorders. We systematically reviewed the literature for articles exploring speech analysis for psychiatric applications. The utility of speech analysis depends on how accurately speech features represent clinical symptoms within and across disorders. We identified four domains of the application of speech analysis in the literature: diagnostic classification, assessment of illness severity, prediction of onset of illness, and prognosis and treatment outcomes. We discuss the findings in each of these domains, with a focus on how types of speech features characterize different aspects of psychopathology. Models that bring together multiple speech features can distinguish speakers with psychiatric disorders from healthy controls with high accuracy. Differentiating between types of mental disorders and symptom dimensions are more complex problems that expose the transdiagnostic nature of speech features. Convergent progress in speech research and computer sciences opens avenues for implementing speech analysis to enhance objectivity of assessment in clinical practice. Application of speech analysis will need to address issues of ethics and equity, including the potential to perpetuate discriminatory bias through models that learn from clinical assessment data. Methods that mitigate bias are available and should play a key role in the implementation of speech analysis.

Application of Graphs in a One Health Framework

The One Health framework, which advocates the crucial interconnection between environmental, animal, and human health and well-being, is becoming of increasing importance and acceptance in health sciences over the last years. The hottest public health topics of the latest years, like zoonotic diseases (e.g., the recent pandemic) or the increasing antibiotic resistance, characterized by many as "pandemic of the future," make the more holistic and combinatorial approach of One Health a necessity to combat such complex problems. Multiple graphs and graph theory have found applications in health sciences for many years, and they can now extend to usage across all levels of a One Health approach to health, ranging from genome, one disease level, to epidemiology and ecosystem graphs. For that last ecosystem layer, a proposed approach is the utilization of process graphs from the chemical engineering field, in order to understand a whole system and what constitute the most crucial aspects of a One Health issue in ecosystem level. Here P-graphs are focused alongside their combinatorial algorithms, implemented in R, and their application researched in an effort to extract information and plan interventions.

How can computational tools help to understand language patterns in mental suffering considering social diversity

The complex interaction between biological and social factors challenges measuring human behavior. Language has been a crucial source of information that mirrors inner processes like thoughts. The development of a novel computational strategy that helps to understand language needs to consider social factors that could also impact human behavior. Ten years ago, I developed a computational approach based on graph theory to measure structural aspects of the narrative's mental organization expressed in spontaneous oral reports. It was possible to measure the decrease in narrative graph connectedness associated with the schizophrenia diagnosis and negative symptoms severity. However, I was worried that the psychiatric field neglected factors from diverse social realities (such as poor access to education). Formal education impacts language by mastering grammar and syntax. Changes in language structure could be related to symptoms and lack of exposure to formal education. Indeed, the same connectedness markers increase according to typical cognitive and academic development. In this paper, I describe the reasons and methods for investigating both factors (psychiatric symptoms and formal education) on language patterns. Further, I evaluate concerns and future challenges of using computational strategies that include social diversity in mental health conditions.

Understanding psychiatric illness through natural language processing (UNDERPIN): Rationale, design, and methodology

Introduction

Psychiatric disorders are diagnosed through observations of psychiatrists according to diagnostic criteria such as the DSM-5. Such observations, however, are mainly based on each psychiatrist's level of experience and often lack objectivity, potentially leading to disagreements among psychiatrists. In contrast, specific linguistic features can be observed in some psychiatric disorders, such as a loosening of associations in schizophrenia. Some studies explored biomarkers, but biomarkers have yet to be used in clinical practice.

Aim

The purposes of this study are to create a large dataset of Japanese speech data labeled with detailed information on psychiatric disorders and neurocognitive disorders to quantify the linguistic features of those disorders using natural language processing and, finally, to develop objective and easy-to-use biomarkers for diagnosing and assessing the severity of them.

Methods

This study will have a multi-center prospective design. The DSM-5 or ICD-11 criteria for major depressive disorder, bipolar disorder, schizophrenia, and anxiety disorder and for major and minor neurocognitive disorders will be regarded as the inclusion criteria for the psychiatric disorder samples. For the healthy subjects, the absence of a history of psychiatric disorders will be confirmed using the Mini-International Neuropsychiatric Interview (M.I.N.I.). The absence of current cognitive decline will be confirmed using the Mini-Mental State Examination (MMSE). A psychiatrist or psychologist will conduct 30-to-60-min interviews with each participant; these interviews will include free conversation, picture-description task, and story-telling task, all of which will be recorded using a microphone headset. In addition, the severity of disorders will be assessed using clinical rating scales. Data will be collected from each participant at least twice during the study period and up to a maximum of five times at an interval of at least one month.

Discussion

This study is unique in its large sample size and the novelty of its method, and has potential for applications in many fields. We have some challenges regarding inter-rater reliability and the linguistic peculiarities of Japanese. As of September 2022, we have collected a total of >1000 records from >400 participants. To the best of our knowledge, this data sample is one of the largest in this field.

Clinical Trial Registration

Identifier: UMIN000032141.

Ethical Implications of the Use of Language Analysis Technologies for the Diagnosis and Prediction of Psychiatric Disorders

Recent developments in artificial intelligence technologies have come to a point where machine learning algorithms can infer mental status based on someone's photos and texts posted on social media. More than that, these algorithms are able to predict, with a reasonable degree of accuracy, future mental illness. They potentially represent an important advance in mental health care for preventive and early diagnosis initiatives, and for aiding professionals in the follow-up and prognosis of their patients. However, important issues call for major caution in the use of such technologies, namely, privacy and the stigma related to mental disorders. In this paper, we discuss the bioethical implications of using such technologies to diagnose and predict future mental illness, given the current scenario of swiftly growing technologies that analyze human language and the online availability of personal information given by social media. We also suggest future directions to be taken to minimize the misuse of such important technologies.

Graph structure analysis of speech production among second language learners of Spanish and Chinese

Language experience shapes the gradual maturation of speech production in both native (L1) and second (L2) languages. Structural aspects like the connectedness of spontaneous narratives reveal this maturation progress in L1 acquisition and, as it does not rely on semantics, it could also reveal structural pattern changes during L2 acquisition. The current study tested whether L2 lexical retrieval associated with vocabulary knowledge could impact the global connectedness of narratives during the initial stages of L2 acquisition. Specifically, the study evaluated the relationship between graph structure (long-range recurrence or connectedness) and L2 learners’ oral production in the L2 and L1. Seventy-nine college-aged students who were native speakers of English and had received classroom instruction in either L2-Spanish or L2-Chinese participated in this study. Three tasks were used: semantic fluency, phonemic fluency and picture description. Measures were operationalized as the number of words per minute in the case of the semantic and phonemic fluency tasks. Graph analysis was carried out for the picture description task using the computational tool SpeechGraphs to calculate connectedness. Results revealed significant positive correlations between connectedness in the picture description task and measures of speech production (number of correct responses per minute) in the phonemic and semantic fluency tasks. These correlations were only significant for the participants’ L2- Spanish and Chinese. Results indicate that producing low connectedness narratives in L2 may be a marker of the initial stages of L2 oral development. These findings are consistent with the pattern reported in the early stages of L1 literacy. Future studies should further explore the interactions between graph structure and second language production proficiency, including more advanced stages of L2 learning and considering the role of cognitive abilities in this process.

Who does what to whom? graph representations of action-predication in speech relate to psychopathological dimensions of psychosis

Graphical representations of speech generate powerful computational measures related to psychosis. Previous studies have mostly relied on structural relations between words as the basis of graph formation, i.e., connecting each word to the next in a sequence of words. Here, we introduced a method of graph formation grounded in semantic relationships by identifying elements that act upon each other (action relation) and the contents of those actions (predication relation). Speech from picture descriptions and open-ended narrative tasks were collected from a cross-diagnostic group of healthy volunteers and people with psychotic or non-psychotic disorders. Recordings were transcribed and underwent automated language processing, including semantic role labeling to identify action and predication relations. Structural and semantic graph features were computed using static and dynamic (moving-window) techniques. Compared to structural graphs, semantic graphs were more strongly correlated with dimensional psychosis symptoms. Dynamic features also outperformed static features, and samples from picture descriptions yielded larger effect sizes than narrative responses for psychosis diagnoses and symptom dimensions. Overall, semantic graphs captured unique and clinically meaningful information about psychosis and related symptom dimensions. These features, particularly when derived from semi-structured tasks using dynamic measurement, are meaningful additions to the repertoire of computational linguistic methods in psychiatry.

Reading and writing habits compensate for aging effects in speech connectedness

We investigate the association of short- and long-range recurrences (speech connectedness) with age, education, and reading and writing habits (RWH) in typical aging using an oral narrative production task. Oral narrative transcriptions were represented as word-graphs to measure short- and long-range recurrences. Speech connectedness was explained by the combination of age, education, and RWH, and the strength of RWH's coefficient reflects the aging effect.

Progressive changes in descriptive discourse in First Episode Schizophrenia: a longitudinal computational semantics study

Computational semantics, a branch of computational linguistics, involves automated meaning analysis that relies on how words occur together in natural language. This offers a promising tool to study schizophrenia. At present, we do not know if these word-level choices in speech are sensitive to the illness stage (i.e., acute untreated vs. stable established state), track cognitive deficits in major domains (e.g., cognitive control, processing speed) or relate to established dimensions of formal thought disorder. In this study, we collected samples of descriptive discourse in patients experiencing an untreated first episode of schizophrenia and healthy control subjects (246 samples of 1-minute speech; n = 82, FES = 46, HC = 36) and used a co-occurrence based vector embedding of words to quantify semantic similarity in speech. We obtained six-month follow-up data in a subsample (99 speech samples, n = 33, FES = 20, HC = 13). At baseline, semantic similarity was evidently higher in patients compared to healthy individuals, especially when social functioning was impaired; but this was not related to the severity of clinically ascertained thought disorder in patients. Across the study sample, higher semantic similarity at baseline was related to poorer Stroop performance and processing speed. Over time, while semantic similarity was stable in healthy subjects, it increased in patients, especially when they had an increasing burden of negative symptoms. Disruptions in word-level choices made by patients with schizophrenia during short 1-min descriptions are sensitive to interindividual differences in cognitive and social functioning at first presentation and persist over the early course of the illness.

Language as a Window Into the Altered State of Consciousness Elicited by Psychedelic Drugs

Psychedelics are drugs capable of eliciting profound alterations in the subjective experience of the users, sometimes with long-lasting consequences. Because of this, psychedelic research tends to focus on human subjects, given their capacity to construct detailed narratives about the contents of their consciousness experiences. In spite of its relevance, the interaction between serotonergic psychedelics and language production is comparatively understudied in the recent literature. This review is focused on two aspects of this interaction: how the acute effects of psychedelic drugs impact on speech organization regardless of its semantic content, and how to characterize the subjective effects of psychedelic drugs by analyzing the semantic content of written retrospective reports. We show that the computational characterization of language production is capable of partially predicting the therapeutic outcome of individual experiences, relate the effects elicited by psychedelics with those associated with other altered states of consciousness, draw comparisons between the psychedelic state and the symptomatology of certain psychiatric disorders, and investigate the neurochemical profile and mechanism of action of different psychedelic drugs. We conclude that researchers studying psychedelics can considerably expand the range of their potential scientific conclusions by analyzing brief interviews obtained before, during and after the acute effects. Finally, we list a series of questions and open problems that should be addressed to further consolidate this approach.

Natural Language Processing markers in first episode psychosis and people at clinical high-risk

Recent work has suggested that disorganised speech might be a powerful predictor of later psychotic illness in clinical high risk subjects. To that end, several automated measures to quantify disorganisation of transcribed speech have been proposed. However, it remains unclear which measures are most strongly associated with psychosis, how different measures are related to each other and what the best strategies are to collect speech data from participants. Here, we assessed whether twelve automated Natural Language Processing markers could differentiate transcribed speech excerpts from subjects at clinical high risk for psychosis, first episode psychosis patients and healthy control subjects (total N = 54). In-line with previous work, several measures showed significant differences between groups, including semantic coherence, speech graph connectivity and a measure of whether speech was on-topic, the latter of which outperformed the related measure of tangentiality. Most NLP measures examined were only weakly related to each other, suggesting they provide complementary information. Finally, we compared the ability of transcribed speech generated using different tasks to differentiate the groups. Speech generated from picture descriptions of the Thematic Apperception Test and a story re-telling task outperformed free speech, suggesting that choice of speech generation method may be an important consideration. Overall, quantitative speech markers represent a promising direction for future clinical applications.

Quantified language connectedness in schizophrenia-spectrum disorders

Language abnormalities are a core symptom of schizophrenia-spectrum disorders and could serve as a potential diagnostic marker. Natural language processing enables quantification of language connectedness, which may be lower in schizophrenia-spectrum disorders. Here, we investigated connectedness of spontaneous speech in schizophrenia-spectrum patients and controls and determine its accuracy in classification. Using a semi-structured interview, speech of 50 patients with a schizophrenia-spectrum disorder and 50 controls was recorded. Language connectedness in a semantic word2vec model was calculated using consecutive word similarity in moving windows of increasing sizes (2-20 words). Mean, minimal and variance of similarity were calculated per window size and used in a random forest classifier to distinguish patients and healthy controls. Classification based on connectedness reached 85% cross-validated accuracy, with 84% specificity and 86% sensitivity. Features that best discriminated patients from controls were variance of similarity at window sizes between 5 and 10. We show impaired connectedness in spontaneous speech of patients with schizophrenia-spectrum disorders even in patients with low ratings of positive symptoms. Effects were most prominent at the level of sentence connectedness. The high sensitivity, specificity and tolerability of this method show that language analysis is an accurate and feasible digital assistant in diagnosing schizophrenia-spectrum disorders.

More than a biomarker: could language be a biosocial marker of psychosis?

Automated extraction of quantitative linguistic features has the potential to predict objectively the onset and progression of psychosis. These linguistic variables are often considered to be biomarkers, with a large emphasis placed on the pathological aberrations in the biological processes that underwrite the faculty of language in psychosis. This perspective offers a reminder that human language is primarily a social device that is biologically implemented. As such, linguistic aberrations in patients with psychosis reflect both social and biological processes affecting an individual. Failure to consider the sociolinguistic aspects of NLP measures will limit their usefulness as digital tools in clinical settings. In the context of psychosis, considering language as a biosocial marker could lead to less biased and more accessible tools for patient-specific predictions in the clinic.