Language as a biomarker for psychosis: A natural language processing approach

Automated linguistic analysis in youth at clinical high risk for psychosis

Identifying individuals at clinical high risk for psychosis (CHRP) is crucial for preventing psychosis and improving the prognosis for schizophrenia. Individuals at CHR-P may exhibit mild forms of formal thought disorder (FTD), making it possible to identify them using natural language processing (NLP) methods. In this study, speech samples of 62 CHR-P individuals and 45 healthy controls (HCs) were elicited using Thematic Apperception Test images. The evaluation involved various NLP measures such as semantic similarity, generic, and part-of-speech (POS) features. The CHR-P group demonstrated higher sentence-level semantic similarity and reduced mean image-to-text similarity. Regarding generic analysis, they demonstrated reduced verbosity and produced shorter sentences with shorter words. The POS analysis revealed a decrease in the utilization of adverbs, conjunctions, and first-person singular pronouns, alongside an increase in the utilization of adjectives in the CHR-P group compared to HC. In addition, we developed a machine-learning model based on 30 NLP-derived features to distinguish between the CHR-P and HC groups. The model demonstrated an accuracy of 79.6 % and an AUC-ROC of 0.86. Overall, these findings suggest that automated language analysis of speech could provide valuable information for characterizing FTD during the clinical high-risk phase and has the potential to be applied objectively for early intervention for psychosis.

Leveraging AI for the diagnosis and treatment of autism spectrum disorder: Current trends and future prospects

The integration of artificial intelligence (AI) into the diagnosis and treatment of autism spectrum disorder (ASD) represents a promising frontier in healthcare. This review explores the current landscape and future prospects of AI technologies in ASD diagnostics and interventions. AI enables early detection and personalized assessment of ASD through the analysis of diverse data sources such as behavioural patterns, neuroimaging, genetics, and electronic health records. Machine learning algorithms exhibit high accuracy in distinguishing ASD from neurotypical development and other developmental disorders, facilitating timely interventions. Furthermore, AI-driven therapeutic interventions, including augmentative communication systems, virtual reality-based training, and robot-assisted therapies, show potential in improving social interactions and communication skills in individuals with ASD. Despite challenges such as data privacy and interpretability, the future of AI in ASD holds promise for refining diagnostic accuracy, deploying telehealth platforms, and tailoring treatment plans. By harnessing AI, clinicians can enhance ASD care delivery, empower patients, and advance our understanding of this complex condition.

Detecting schizophrenia, bipolar disorder, psychosis vulnerability and major depressive disorder from 5 minutes of online-collected speech

Background

Psychosis poses substantial social and healthcare burdens. The analysis of speech is a promising approach for the diagnosis and monitoring of psychosis, capturing symptoms like thought disorder and flattened affect. Recent advancements in Natural Language Processing (NLP) methodologies enable the automated extraction of informative speech features, which has been leveraged for early psychosis detection and assessment of symptomology. However, critical gaps persist, including the absence of standardized sample collection protocols, small sample sizes, and a lack of multi-illness classification, limiting clinical applicability. Our study aimed to (1) identify an optimal assessment approach for the online and remote collection of speech, in the context of assessing the psychosis spectrum and evaluate whether a fully automated, speech-based machine learning (ML) pipeline can discriminate among different conditions on the schizophrenia-bipolar spectrum (SSD-BD-SPE), help-seeking comparison subjects (MDD), and healthy controls (HC) at varying layers of analysis and diagnostic complexity.

Methods

We adopted online data collection methods to collect 20 minutes of speech and demographic information from individuals. Participants were categorized as "healthy" help-seekers (HC), having a schizophrenia-spectrum disorder (SSD), bipolar disorder (BD), major depressive disorder (MDD), or being on the psychosis spectrum with sub-clinical psychotic experiences (SPE). SPE status was determined based on self-reported clinical diagnosis and responses to the PHQ-8 and PQ-16 screening questionnaires, while other diagnoses were determined based on self-report from participants. Linguistic and paralinguistic features were extracted and ensemble learning algorithms (e.g., XGBoost) were used to train models. A 70%-30% train-test split and 30-fold cross-validation was used to validate the model performance.

Results

The final analysis sample included 1140 individuals and 22,650 minutes of speech. Using 5-minutes of speech, our model could discriminate between HC and those with a serious mental illness (SSD or BD) with 86% accuracy (AUC = 0.91, Recall = 0.7, Precision = 0.98). Furthermore, our model could discern among HC, SPE, BD and SSD groups with 86% accuracy (F1 macro = 0.855, Recall Macro = 0.86, Precision Macro = 0.86). Finally, in a 5-class discrimination task including individuals with MDD, our model had 76% accuracy (F1 macro = 0.757, Recall Macro = 0.758, Precision Macro = 0.766).

Conclusion

Our ML pipeline demonstrated disorder-specific learning, achieving excellent or good accuracy across several classification tasks. We demonstrated that the screening of mental disorders is possible via a fully automated, remote speech assessment pipeline. We tested our model on relatively high number conditions (5 classes) in the literature and in a stratified sample of psychosis spectrum, including HC, SPE, SSD and BD (4 classes). We tested our model on a large sample (N = 1150) and demonstrated best-in-class accuracy with remotely collected speech data in the psychosis spectrum, however, further clinical validation is needed to test the reliability of model performance.

Quantifying brain-functional dynamics using deep dynamical systems: Technical considerations

Both mental health and mental illness unfold in complex and unpredictable ways. Novel artificial intelligence approaches from the area of dynamical systems reconstruction can characterize such dynamics and help understand the underlying brain mechanisms, which can also be used as potential biomarkers. However, applying deep learning to model dynamical systems at the individual level must overcome numerous computational challenges to be reproducible and clinically useful. In this study, we performed an extensive analysis of these challenges using generative modeling of brain dynamics from fMRI data as an example and demonstrated their impact on classifying patients with schizophrenia and major depression. This study highlights the tendency of deep learning models to identify functionally unique solutions during parameter optimization, which severely impacts the reproducibility of downstream predictions. We hope this study guides the future development of individual-level generative models and similar machine learning approaches aimed at identifying reproducible biomarkers of mental illness.

Self-concept and Narrative Identity in Youth at Clinical High Risk for Psychosis

BACKGROUND AND HYPOTHESIS

Disturbances of the narrative self and personal identity accompany the onset of psychotic disorders in late adolescence and early adulthood (a formative developmental stage for self-concept and personal narratives). However, these issues have primarily been studied retrospectively after illness onset, limiting any inferences about their developmental course.

STUDY DESIGN

Youth at clinical high risk for psychosis (CHR) (n = 49) and matched healthy comparison youth (n = 52) completed a life story interview (including self-defining memory, turning point, life challenge, and psychotic-like experience) and questionnaires assessing self-esteem, self-beliefs, self-concept clarity, and ruminative/reflective self-focus. Trained raters coded interviews for narrative identity themes of emotional tone, agency, temporal coherence, context coherence, self-event connections, and meaning-making (intraclass correlations >0.75). Statistical analyses tested group differences and relationships between self-concept, narrative identity, symptoms, and functioning.

STUDY RESULTS

CHR participants reported more negative self-esteem and self-beliefs, poorer self-concept clarity, and more ruminative self-focus, all of which related to negative symptoms. CHR participants narrated their life stories with themes of negative emotion and passivity (ie, lack of personal agency), which related to positive and negative symptoms. Reflective self-focus and autobiographical reasoning were unaffected and correlated. Autobiographical reasoning was uniquely associated with preserved role functioning.

CONCLUSIONS

This group of youth at CHR exhibited some, but not all, changes to self-concept and narrative identity seen in psychotic disorders. A core theme of negativity, uncertainty, and passivity ran through their semantic and narrative self-representations. Preserved self-reflection and autobiographical reasoning suggest sources of resilience and potential footholds for cognitive-behavioral and metacognitive interventions.

Natural Language Processing and Schizophrenia: A Scoping Review of Uses and Challenges

(1) Background: Approximately 1% of the global population is affected by schizophrenia, a disorder marked by cognitive deficits, delusions, hallucinations, and language issues. It is associated with genetic, neurological, and environmental factors, and linked to dopaminergic hyperactivity and neurotransmitter imbalances. Recent research reveals that patients exhibit significant language impairments, such as reduced verbal output and fluency. Advances in machine learning and natural language processing show potential for early diagnosis and personalized treatments, but additional research is required for the practical application and interpretation of such technology. The objective of this study is to explore the applications of natural language processing in patients diagnosed with schizophrenia. (2) Methods: A scoping review was conducted across multiple electronic databases, including Medline, PubMed, Embase, and PsycInfo. The search strategy utilized a combination of text words and subject headings, focusing on schizophrenia and natural language processing. Systematically extracted information included authors, population, primary uses of the natural language processing algorithms, main outcomes, and limitations. The quality of the identified studies was assessed. (3) Results: A total of 516 eligible articles were identified, from which 478 studies were excluded based on the first analysis of titles and abstracts. Of the remaining 38 studies, 18 were selected as part of this scoping review. The following six main uses of natural language processing were identified: diagnostic and predictive modeling, followed by specific linguistic phenomena, speech and communication analysis, social media and online content analysis, clinical and cognitive assessment, and linguistic feature analysis. (4) Conclusions: This review highlights the main uses of natural language processing in the field of schizophrenia and the need for more studies to validate the effectiveness of natural language processing in diagnosing and treating schizophrenia.

Clinical efficacy of pre-trained large language models through the lens of aphasia

The rapid development of large language models (LLMs) motivates us to explore how such state-of-the-art natural language processing systems can inform aphasia research. What kind of language indices can we derive from a pre-trained LLM? How do they differ from or relate to the existing language features in aphasia? To what extent can LLMs serve as an interpretable and effective diagnostic and measurement tool in a clinical context? To investigate these questions, we constructed predictive and correlational models, which utilize mean surprisals from LLMs as predictor variables. Using AphasiaBank archived data, we validated our models' efficacy in aphasia diagnosis, measurement, and prediction. Our finding is that LLMs-surprisals can effectively detect the presence of aphasia and different natures of the disorder, LLMs in conjunction with the existing language indices improve models' efficacy in subtyping aphasia, and LLMs-surprisals can capture common agrammatic deficits at both word and sentence level. Overall, LLMs have potential to advance automatic and precise aphasia prediction. A natural language processing pipeline can be greatly benefitted from integrating LLMs, enabling us to refine models of existing language disorders, such as aphasia.

Sleep and dream disturbances associated with dissociative experiences

Some dissociative experiences may be related, in part, to REM intrusion into waking consciousness. If so, some aspects of dream content may be associated with daytime dissociative experiences. We tested the hypothesis that some types of dream content would predict daytime dissociative symptomology. As part of a longitudinal study of the impact of dreams on everyday behavior we administered a battery of survey instruments to 219 volunteers. Assessments included the Dissociative Experiences Scale (DES), along with other measures known to be related to either REM intrusion effects or dissociative experiences. We also collected dream reports and sleep measures across a two-week period from a subgroup of the individuals in the baseline group. Of this subgroup we analyzed two different subsamples; 24 individuals with dream recall for at least half the nights in the two-week period; and 30 individuals who wore the DREEM Headband which captured measures of sleep architecture. In addition to using multiple regression analyses to quantify associations between DES and REM intrusion and dream content variables we used a split half procedure to create high vs low DES groups and then compared groups across all measures. Participants in the high DES group evidenced significantly greater nightmare distress scores, REM Behavior Disorder scores, paranormal beliefs, lucid dreams, and sleep onset times. Validated measures of dreamed first person perspective and overall dream coherence in a time series significantly predicted overall DES score accounting for 26% of the variance in dissociation. Dream phenomenology and coherence of the dreamed self significantly predicts dissociative symptomology as an individual trait. REM intrusion may be one source of dissociative experiences. Attempts to ameliorate dissociative symptoms or to treat nightmare distress should consider the stability of dream content as a viable indicator of dissociative tendencies.

The contribution of prosody to machine classification of schizophrenia

We show how acoustic prosodic features, such as pitch and gaps, can be used computationally for detecting symptoms of schizophrenia from a single spoken response. We compare the individual contributions of acoustic and previously-employed text modalities to the algorithmic determination whether the speaker has schizophrenia. Our classification results clearly show that we can extract relevant acoustic features better than those textual ones. We find that, when combined with those acoustic features, textual features improve classification only slightly.

Advancements and Future Directions in Prevention Based on Evaluation for Individuals With Clinical High Risk of Psychosis: Insights From the SHARP Study

BACKGROUND AND HYPOTHESIS

This review examines the evolution and future prospects of prevention based on evaluation (PBE) for individuals at clinical high risk (CHR) of psychosis, drawing insights from the SHARP (Shanghai At Risk for Psychosis) study. It aims to assess the effectiveness of non-pharmacological interventions in preventing psychosis onset among CHR individuals.

STUDY DESIGN

The review provides an overview of the developmental history of the SHARP study and its contributions to understanding the needs of CHR individuals. It explores the limitations of traditional antipsychotic approaches and introduces PBE as a promising framework for intervention.

STUDY RESULTS

Three key interventions implemented by the SHARP team are discussed: nutritional supplementation based on niacin skin response blunting, precision transcranial magnetic stimulation targeting cognitive and brain functional abnormalities, and cognitive behavioral therapy for psychotic symptoms addressing symptomatology and impaired insight characteristics. Each intervention is evaluated within the context of PBE, emphasizing the potential for tailored approaches to CHR individuals.

CONCLUSIONS

The review highlights the strengths and clinical applications of the discussed interventions, underscoring their potential to revolutionize preventive care for CHR individuals. It also provides insights into future directions for PBE in CHR populations, including efforts to expand evaluation techniques and enhance precision in interventions.

Automated linguistic analysis in speech samples of Turkish-speaking patients with schizophrenia-spectrum disorders

Modern natural language processing (NLP) methods provide ways to objectively quantify language disturbances for potential use in diagnostic classification. We performed computerized language analysis in speech samples of 82 Turkish-speaking subjects, including 44 patients with schizophrenia spectrum disorders (SSD) and 38 healthy controls (HC). Exploratory analysis of speech samples involved 16 sentence-level semantic similarity features using SBERT (Sentence Bidirectional Encoder Representation from Text) as well as 8 generic and 8 part-of-speech (POS) features. The random forest classifier using SBERT-derived semantic similarity features achieved a mean accuracy of 85.6 % for the classification of SSD and HC. When semantic similarity features were combined with generic and POS features, the classifier's mean accuracy reached to 86.8 %. Our analysis reflected increased sentence-level semantic similarity scores in SSD. Generic and POS analyses revealed an increase in the use of verbs, proper nouns and pronouns in SSD while our results showed a decrease in the utilization of conjunctions, determiners, and both average and maximum sentence length in SSD compared to HC. Quantitative language features were correlated with the expressive deficit domain of BNSS (Brief Negative Symptom Scale) as well as with the duration of illness. These findings from Turkish-speaking interviews contribute to the growing evidence-based NLP-derived assessments in non-English-speaking patients.

The 'L-factor': Language as a transdiagnostic dimension in psychopathology

Thoughts and moods constituting our mental life incessantly change. When the steady flow of this dynamics diverges in clinical directions, the possible pathways involved are captured through discrete diagnostic labels. Yet a single vulnerable neurocognitive system may be causally involved in psychopathological deviations transdiagnostically. We argue that language viewed as integrating cortical functions is the best current candidate, whose forms of breakdown along its different dimensions are then manifest as symptoms - from prosodic abnormalities and rumination in depression to distortions of speech perception in verbal hallucinations, distortions of meaning and content in delusions, or disorganized speech in formal thought disorder. Spontaneous connected speech provides continuous objective readouts generating a highly accessible bio-behavioral marker with the potential of revolutionizing neuropsychological measurement. This argument turns language into a transdiagnostic 'L-factor' providing an analytical and mechanistic substrate for previously proposed latent general factors of psychopathology ('p-factor') and cognitive functioning ('c-factor'). Together with immense practical opportunities afforded by rapidly advancing natural language processing (NLP) technologies and abundantly available data, this suggests a new era of translational clinical psychiatry, in which both psychopathology and language may be rethought together.

Speech based natural language profile before, during and after the onset of psychosis: A cluster analysis

BACKGROUND AND HYPOTHESIS

Speech markers are digitally acquired, computationally derived, quantifiable set of measures that reflect the state of neurocognitive processes relevant for social functioning. "Oddities" in language and communication have historically been seen as a core feature of schizophrenia. The application of natural language processing (NLP) to speech samples can elucidate even the most subtle deviations in language. We aim to determine if NLP based profiles that are distinctive of schizophrenia can be observed across the various clinical phases of psychosis.

DESIGN

Our sample consisted of 147 participants and included 39 healthy controls (HC), 72 with first-episode psychosis (FEP), 18 in a clinical high-risk state (CHR), 18 with schizophrenia (SZ). A structured task elicited 3 minutes of speech, which was then transformed into quantitative measures on 12 linguistic variables (lexical, syntactic, and semantic). Cluster analysis that leveraged healthy variations was then applied to determine language-based subgroups.

RESULTS

We observed a three-cluster solution. The largest cluster included most HC and the majority of patients, indicating a 'typical linguistic profile (TLP)'. One of the atypical clusters had notably high semantic similarity in word choices with less perceptual words, lower cohesion and analytical structure; this cluster was almost entirely composed of patients in early stages of psychosis (EPP - early phase profile). The second atypical cluster had more patients with established schizophrenia (SPP - stable phase profile), with more perceptual but less cognitive/emotional word classes, simpler syntactic structure, and a lack of sufficient reference to prior information (reduced givenness).

CONCLUSION

The patterns of speech deviations in early and established stages of schizophrenia are distinguishable from each other and detectable when lexical, semantic and syntactic aspects are assessed in the pursuit of 'formal thought disorder'.

A new schizophrenia screening instrument based on evaluating the patient's writing

Formal Thought Disorder (FTD) is a defining feature of schizophrenia, which is often assessed through patients' speech. Meanwhile, the written language is less studied. The aim of the present study is to establish and validate a comprehensive clinical screening scale, capturing the full variety of empirical characteristics of writing in patients with schizophrenia. The 16-item Screening Instrument for Schizophrenic Features in Writing (SISFiW) is derived from detailed literature review and a "brainstorming" discussion on 30 samples written by patients with schizophrenia. One hundred and fifty-seven participants (114 patients with an ICD-10 diagnoses of schizophrenia; 43 healthy control subjects) were interviewed and symptoms assessed with the Positive and Negative Syndrome Scale (PANSS) and the Scale for the Assessment of Thought, Language, and Communication (TLC). Article samples written by each participant were rated with the SISFiW. Results demonstrated significant difference of the SISFiW-total between the patient group and healthy controls [(3.61 ± 1.72) vs. (0.49 ± 0.63), t = 16.64, p<0.001]. The inter-rater reliability (weighted kappa = 0.72) and the internal consistency (Cronbach's alpha coefficient = 0.613) were acceptable, but correlations with the criterion (PANSS and TLC) were unremarkable. The ROC analysis indicated a cutoff point at 2 with the maximal sensitivity (93.0 %)/specificity (93.0 %). Discriminant analysis of the SISFiW items yielded 8 classifiers that discriminated between the diagnostic groups at a perfect overall performance (with 90.4 % of original and 88.5 % cross-validated grouped cases classified correctly). This instrument appears to be practicable and reliable, with relatively robust discriminatory power, and may serve as a complementary tool to existing FTD rating scales.

Speech markers to predict and prevent recurrent episodes of psychosis: A narrative overview and emerging opportunities

Preventing relapse in schizophrenia improves long-term health outcomes. Repeated episodes of psychotic symptoms shape the trajectory of this illness and can be a detriment to functional recovery. Despite early intervention programs, high relapse rates persist, calling for alternative approaches in relapse prevention. Predicting imminent relapse at an individual level is critical for effective intervention. While clinical profiles are often used to foresee relapse, they lack the specificity and sensitivity needed for timely prediction. Here, we review the use of speech through Natural Language Processing (NLP) to predict a recurrent psychotic episode. Recent advancements in NLP of speech have shown the ability to detect linguistic markers related to thought disorder and other language disruptions within 2-4 weeks preceding a relapse. This approach has shown to be able to capture individual speech patterns, showing promise in its use as a prediction tool. We outline current developments in remote monitoring for psychotic relapses, discuss the challenges and limitations and present the speech-NLP based approach as an alternative to detect relapses with sufficient accuracy, construct validity and lead time to generate clinical actions towards prevention.

Research in China about the biological mechanisms that potentially link socioenvironmental changes and mental health: a scoping review

China's rapid socioeconomic development since 1990 makes it a fitting location to summarise research about how biological changes associated with socioenvironmental changes affect population mental health and, thus, lay the groundwork for subsequent, more focused studies. An initial search identified 308 review articles in the international literature about biomarkers associated with 12 common mental health disorders. We then searched for studies conducted in China that assessed the association of the identified mental health related-biomarkers with socioenvironmental factors in English-language and Chinese-language databases. We located 1330 articles published between 1 January 1990 and 1 August 2021 that reported a total of 3567 associations between 56 specific biomarkers and 11 socioenvironmental factors: 3156 (88·5%) about six types of environmental pollution, 381 (10·7%) about four health-related behaviours (diet, physical inactivity, internet misuse, and other lifestyle factors), and 30 (0·8%) about socioeconomic inequity. Only 245 (18·4%) of the papers simultaneously considered the possible effect of the biomarkers on mental health conditions; moreover, most of these studies assessed biomarkers in animal models of mental disorders, not human subjects. Among the 245 papers, mental health conditions were linked with biomarkers of environmental pollution in 188 (76·7%), with biomarkers of health-related behaviours in 48 (19·6%), and with biomarkers of socioeconomic inequality in 9 (3·7%). The 604 biomarker-mental health condition associations reported (107 in human subjects and 497 in animal models) included 379 (62·7%) about cognitive functioning, 117 (19·4%) about anxiety, 56 (9·3%) about depression, 21 (3·5%) about neurodevelopmental conditions, and 31 (5·1%) about neurobehavioural symptoms. Improved understanding of the biological mechanisms linking socioenvironmental changes to community mental health will require expanding the range of socioenvironmental factors considered, including mental health outcomes in more of the studies about the association of biomarkers with socioenvironmental factors, and increasing the proportion of studies that assess mental health outcomes in humans.

Natural language processing for defining linguistic features in schizophrenia: A sample from Turkish speakers

Natural language processing (NLP) provides fast and accurate extraction of features related to the language of schizophrenia. We utilized NLP methods to test the hypothesis that schizophrenia is associated with altered linguistic features in Turkish, a non-Indo-European language, compared to controls. We also explored whether these possible altered linguistic features were language-dependent or -independent. We extracted and compared speech in schizophrenia (SZ, N = 38) and healthy well-matched control (HC, N = 38) participants using NLP. The analysis was conducted in two parts. In the first one, mean sentence length, total completed words, moving average type-token ratio to measure the lexical diversity, and first-person singular pronoun usage were calculated. In the second one, we used parts-of-speech tagging (POS) and Word2Vec in schizophrenia and control. We found that SZ had lower mean sentence length and moving average type-token ratio but higher use of first-person singular pronoun. All these significant results were correlated with the Thought and Language Disorder Scale score. The POS approach demonstrated that SZ used fewer coordinating conjunctions. Our methodology using Word2Vec detected that SZ had higher semantic similarity than HC and K-Means could differentiate between SZ and HC into two distinct groups with high accuracy, 86.84 %. Our findings showed that altered linguistic features in SZ are mostly language-independent. They are promising to describe language patterns in schizophrenia which proposes that NLP measurements may allow for rapid and objective measurements of linguistic features.

Towards a scalable approach to assess speech organization across the psychosis-spectrum -online assessment in conjunction with automated transcription and extraction of speech measures

Automatically extracted measures of speech constitute a promising marker of psychosis as disorganized speech is associated with psychotic symptoms and predictive of psychosis-onset. The potential of speech markers is, however, hampered by (i) lengthy assessments in laboratory settings and (ii) manual transcriptions. We investigated whether a short, scalable data collection (online) and processing (automated transcription) procedure would provide data of sufficient quality to extract previously validated speech measures. To evaluate the fit of our approach for purpose, we assessed speech in relation to psychotic-like experiences in the general population. Participants completed an 8-minute-long speech task online. Sample 1 included measures of psychometric schizotypy and delusional ideation (N = 446). Sample 2 included a low and high psychometric schizotypy group (N = 144). Recordings were transcribed both automatically and manually, and connectivity, semantic, and syntactic speech measures were extracted for both types of transcripts. 73%/86% participants in sample 1/2 completed the experiment. Nineteen out of 25 speech measures were strongly (r > 0.7) and significantly correlated between automated and manual transcripts in both samples. Amongst the 14 connectivity measures, 11 showed a significant relationship with delusional ideation. For the semantic and syntactic measures, On Topic score and the Frequency of personal pronouns were negatively correlated with both schizotypy and delusional ideation. Combined with demographic information, the speech markers could explain 11-14% of the variation of delusional ideation and schizotypy in Sample 1 and could discriminate between high-low schizotypy with high accuracy (0.72-0.70, AUC = 0.78-0.79) in Sample 2. The moderate to high retention rate, strong correlation of speech measures across manual and automated transcripts and sensitivity to psychotic-like experiences provides initial evidence that online collected speech in combination with automatic transcription is a feasible approach to increase accessibility and scalability of speech-based assessment of psychosis.

Integrating Artificial Intelligence for Drug Discovery in the Context of Revolutionizing Drug Delivery

Drug development is expensive, time-consuming, and has a high failure rate. In recent years, artificial intelligence (AI) has emerged as a transformative tool in drug discovery, offering innovative solutions to complex challenges in the pharmaceutical industry. This manuscript covers the multifaceted role of AI in drug discovery, encompassing AI-assisted drug delivery design, the discovery of new drugs, and the development of novel AI techniques. We explore various AI methodologies, including machine learning and deep learning, and their applications in target identification, virtual screening, and drug design. This paper also discusses the historical development of AI in medicine, emphasizing its profound impact on healthcare. Furthermore, it addresses AI's role in the repositioning of existing drugs and the identification of drug combinations, underscoring its potential in revolutionizing drug delivery systems. The manuscript provides a comprehensive overview of the AI programs and platforms currently used in drug discovery, illustrating the technological advancements and future directions of this field. This study not only presents the current state of AI in drug discovery but also anticipates its future trajectory, highlighting the challenges and opportunities that lie ahead.

Automated analysis of speech as a marker of sub-clinical psychotic experiences

Automated speech analysis techniques, when combined with artificial intelligence and machine learning, show potential in capturing and predicting a wide range of psychosis symptoms, garnering attention from researchers. These techniques hold promise in predicting the transition to clinical psychosis from at-risk states, as well as relapse or treatment response in individuals with clinical-level psychosis. However, challenges in scientific validation hinder the translation of these techniques into practical applications. Although sub-clinical research could aid to tackle most of these challenges, there have been only few studies conducted in speech and psychosis research in non-clinical populations. This work aims to facilitate this work by summarizing automated speech analytical concepts and the intersection of this field with psychosis research. We review psychosis continuum and sub-clinical psychotic experiences, and the benefits of researching them. Then, we discuss the connection between speech and psychotic symptoms. Thirdly, we overview current and state-of-the art approaches to the automated analysis of speech both in terms of language use (text-based analysis) and vocal features (audio-based analysis). Then, we review techniques applied in subclinical population and findings in these samples. Finally, we discuss research challenges in the field, recommend future research endeavors and outline how research in subclinical populations can tackle the listed challenges.

The Influence of Using Novel Predictive Technologies on Judgments of Stigma, Empathy, and Compassion among Healthcare Professionals

BACKGROUND

Our objective was to evaluate whether the description of a machine learning (ML) app or brain imaging technology to predict the onset of schizophrenia or alcohol use disorder (AUD) influences healthcare professionals' judgments of stigma, empathy, and compassion.

METHODS

We randomized healthcare professionals (N = 310) to one vignette about a person whose clinician seeks to predict schizophrenia or an AUD, using a ML app, brain imaging, or a psychosocial assessment. Participants used scales to measure their judgments of stigma, empathy, and compassion.

RESULTS

Participants randomized to the ML vignette endorsed less anger and more fear relative to the psychosocial vignette, and the brain imaging vignette elicited higher pity ratings. The brain imaging and ML vignettes evoked lower personal responsibility judgments compared to the psychosocial vignette. Physicians and nurses reported less empathy than clinical psychologists.

CONCLUSIONS

The use of predictive technologies may reinforce essentialist views about mental health and substance use that may increase specific aspects of stigma and reduce others.

Trajectories through semantic spaces in schizophrenia and the relationship to ripple bursts

Human cognition is underpinned by structured internal representations that encode relationships between entities in the world (cognitive maps). Clinical features of schizophrenia-from thought disorder to delusions-are proposed to reflect disorganization in such conceptual representations. Schizophrenia is also linked to abnormalities in neural processes that support cognitive map representations, including hippocampal replay and high-frequency ripple oscillations. Here, we report a computational assay of semantically guided conceptual sampling and exploit this to test a hypothesis that people with schizophrenia (PScz) exhibit abnormalities in semantically guided cognition that relate to hippocampal replay and ripples. Fifty-two participants [26 PScz (13 unmedicated) and 26 age-, gender-, and intelligence quotient (IQ)-matched nonclinical controls] completed a category- and letter-verbal fluency task, followed by a magnetoencephalography (MEG) scan involving a separate sequence-learning task. We used a pretrained word embedding model of semantic similarity, coupled to a computational model of word selection, to quantify the degree to which each participant's verbal behavior was guided by semantic similarity. Using MEG, we indexed neural replay and ripple power in a post-task rest session. Across all participants, word selection was strongly influenced by semantic similarity. The strength of this influence showed sensitivity to task demands (category > letter fluency) and predicted performance. In line with our hypothesis, the influence of semantic similarity on behavior was reduced in schizophrenia relative to controls, predicted negative psychotic symptoms, and correlated with an MEG signature of hippocampal ripple power (but not replay). The findings bridge a gap between phenomenological and neurocomputational accounts of schizophrenia.

Data Analysis of Psychological Approaches to Soccer Research: Using LDA Topic Modeling

This study identifies the topical areas of research that have attempted a psychological approach to soccer research over the last 33 years (1990-2022) and explored the growth and stagnation of the topic as well as research contributions to soccer development. Data were obtained from 1863 papers from the Web of Science database. The data were collected through keyword text mining and data preprocessing to determine the keywords needed for analysis. Based on the keywords, latent Dirichlet allocation-based topic modeling analysis was performed to analyze the topic distribution of papers and explore research trends by topic area. The topic modeling process included four topic area and fifty topics. The "Coaching Essentials in Football" topic area had the highest frequency, but it was not statistically identified as a trend. However, coaching, including training, is expected to continue to be an important research topic, as it is a key requirement for success in the highly competitive elite football world. Interest in the research field of "Psychological Skills for Performance Development" has waned in recent years. This may be due to the predominance of other subject areas rather than a lack of interest. Various high-tech interventions and problem-solving attempts are being made in this field, providing opportunities for qualitative and quantitative expansion. "Motivation, cognition, and emotion" is a largely underrated subject area in soccer psychology. This could be because survey-based psychological evaluation attempts have decreased as the importance of rapid field application has been emphasized in recent soccer-related studies. However, measuring psychological factors contributes to the study of football psychology through a new methodology and theoretical background. Recognizing the important role of psychological factors in player performance and mental management, as well as presenting new research directions and approaches that can be directly applied to the field, will advance soccer psychology research.

Assessing coherence through linguistic connectives: Analysis of speech in patients with schizophrenia-spectrum disorders

BACKGROUND

Incoherent speech is a core diagnostic symptom of schizophrenia-spectrum disorders (SSD) that can be studied using semantic space models. Since linguistic connectives signal relations between words, they and their surrounding words might represent linguistic loci to detect unusual coherence in speech. Therefore, we investigated whether connectives' measures are useful to assess incoherent speech in SSD.

METHODS

Connectives and their surrounding words were extracted from transcripts of spontaneous speech of 50 SSD-patients and 50 control participants. Using word2vec, two different cosine similarities were calculated: those of connectives and their surrounding words (connectives-related similarity), and those of free-of-connectives words-chunks (non-connectives similarity). Differences between groups in proportion of five types of connectives were assessed using generalized logistic models, and connectives-related similarity was analyzed through non-parametric multivariate analysis of variance. These features were evaluated in classification tasks to differentiate between groups.

RESULTS

SSD-patients used less contingency (e.g., because) (p = .008) and multiclass connectives (e.g., as) (p < .001) than control participants. SSD-patients had higher minimum similarity of multiclass (adj-p = .04) and temporality connectives (e.g., after) (adj-p < .001), narrower similarity-range of expansion (e.g., and) (adj-p = .002) and multiclass connectives (adj-p = .04), and lower maximum similarity of expansion connectives (adj-p = .005). Using connectives' features alone, SSD-patients and controls could be distinguished with 85 % accuracy.

DISCUSSION

Our results show that SSD-speech can be distinguished from speech of control participants with high accuracy, based solely on connectives' features. We conclude that including connectives could strengthen computational models to categorize SSD.

Syntactic complexity of spoken language in the diagnosis of schizophrenia: A probabilistic Bayes network model

In the clinical linguistics of schizophrenia, syntactic complexity has received much attention. In this study, we address whether syntactic complexity deteriorates within the six months following the first episode of psychosis in those who develop a diagnosis of schizophrenia. We collected data from a cohort of twenty-six first-episode psychosis and 12 healthy control subjects using the Thought and Language Index interview in response to three pictures from the Thematic Apperception Test at first assessment and after six months (the time of consensus diagnosis). An automated labeling (part-of-speech tagging) for specific syntactic elements calculated large and granular syntactic complexity indices with a focus on clause complexity as a particular case from this spoken language data. Probabilistic reasoning leveraging the conditional independence properties of Bayes networks revealed that consensus diagnosis of schizophrenia predicted a decrease in nominal subjects per clause among individuals with first episode psychosis. From the entire sample, we estimate a 95.4 % probability that a 50 % decrease in mean nominal subjects per clause after six months is explained by the presence of first episode psychosis. Among those with psychosis, a 30 % decrease in this clause-complexity index after six months of experiencing the first episode predicted with 95 % probability a consensus diagnosis of schizophrenia, representing a conditional relationship between a longitudinal decrease in syntactic complexity and a diagnosis of schizophrenia. We conclude that an early drift towards linguistic disorganization/impoverishment of clause complexity-at the granular level of nominal subject per clause-is a distinctive feature of schizophrenia that decreases longitudinally, thus differentiating schizophrenia from other psychotic illnesses with shared phenomenology.

Linguistic and non-linguistic markers of disorganization in psychotic illness

BACKGROUND

Disorganization, presenting as impairment in thought, language and goal-directed behavior, is a core multidimensional syndrome of psychotic disorders. This study examined whether scalable computational measures of spoken language, and smartphone usage pattern, could serve as digital biomarkers of clinical disorganization symptoms.

METHODS

We examined in a longitudinal cohort of adults with a psychotic disorder, the associations between clinical measures of disorganization and computational measures of 1) spoken language derived from monthly, semi-structured, recorded clinical interviews; and 2) smartphone usage pattern derived via passive sensing technologies over the month prior to the interview. The language features included speech quantity, rate, fluency, and semantic regularity. The smartphone features included data missingness and phone usage during sleep time. The clinical measures consisted of the Positive and Negative Symptom Scale (PANSS) conceptual disorganization, difficulty in abstract thinking, and poor attention, items. Mixed linear regression analyses were used to estimate both fixed and random effects.

RESULTS

Greater severity of clinical symptoms of conceptual disorganization was associated with greater verbosity and more disfluent speech. Greater severity of conceptual disorganization was also associated with greater missingness of smartphone data, and greater smartphone usage during sleep time. While the observed associations were significant across the group, there was also significant variation between individuals.

CONCLUSIONS

The findings suggest that digital measures of speech disfluency may serve as scalable markers of conceptual disorganization. The findings warrant further investigation into the use of recorded interviews and passive sensing technologies to assist in the characterization and tracking of psychotic illness.

Speech disturbances in schizophrenia: Assessing cross-linguistic generalizability of NLP automated measures of coherence

INTRODUCTION

Language disorders - disorganized and incoherent speech in particular - are distinctive features of schizophrenia. Natural language processing (NLP) offers automated measures of incoherent speech as promising markers for schizophrenia. However, the scientific and clinical impact of NLP markers depends on their generalizability across contexts, samples, and languages, which we systematically assessed in the present study relying on a large, novel, cross-linguistic corpus.

METHODS

We collected a Danish (DK), German (GE), and Chinese (CH) cross-linguistic dataset involving transcripts from 187 participants with schizophrenia (111DK, 25GE, 51CH) and 200 matched controls (129DK, 29GE, 42CH) performing the Animated Triangles Task. Fourteen previously published NLP coherence measures were calculated, and between-groups differences and association with symptoms were tested for cross-linguistic generalizability.

RESULTS

One coherence measure, i.e. second-order coherence, robustly generalized across samples and languages. We found several language-specific effects, some of which partially replicated previous findings (lower coherence in German and Chinese patients), while others did not (higher coherence in Danish patients). We found several associations between symptoms and measures of coherence, but the effects were generally inconsistent across languages and rating scales.

CONCLUSIONS

Using a cumulative approach, we have shown that NLP findings of reduced semantic coherence in schizophrenia have limited generalizability across different languages, samples, and measures. We argue that several factors such as sociodemographic and clinical heterogeneity, cross-linguistic variation, and the different NLP measures reflecting different clinical aspects may be responsible for this variability. Future studies should take this variability into account in order to develop effective clinical applications targeting different patient populations.

Lower cohesion and altered first-person pronoun usage in the spoken life narratives of individuals with schizophrenia

Usage of computational tools to quantify language disturbances among individuals with psychosis is increasing, improving measurement efficiency and access to fine-grained constructs. However, few studies apply automated linguistic analysis to life narratives in this population. Such research could facilitate the measurement of psychosis-relevant constructs such as sense of agency, capacity to organize one's personal history, narrative richness, and perceptions of the roles that others play in one's life. Furthermore, research is needed to understand how narrative linguistic features relate to cognitive and social functioning. In the present study, individuals with schizophrenia (n = 32) and individuals without a psychotic disorder (n = 15) produced personal life narratives within the Indiana Psychiatric Illness Interview. Narratives were analyzed using the Coh-Metrix computational tool. Linguistic variables analyzed were indices of connections within causal and goal-driven speech (deep cohesion), unique word usage (lexical diversity), and pronoun usage. Individuals with schizophrenia compared to control participants produced narratives that were lower in deep cohesion, contained more first-person singular pronouns, and contained fewer first-person plural pronouns. Narratives did not significantly differ between groups in lexical diversity, third-person pronoun usage, or total word count. Cognitive-linguistic relationships emerged in the full sample, including significant correlations between greater working memory capacity and greater deep cohesion and lexical diversity. In the schizophrenia group, social problem-solving abilities did not correlate with linguistic variables but were associated with cognition. Findings highlight the relevance of psychotherapies which aim to promote recovery among individuals with psychosis through the construction of coherent life narratives and increasing agency and social connectedness.

Detecting at-risk mental states for psychosis (ARMS) using machine learning ensembles and facial features

AIMS

Our study aimed to develop a machine learning ensemble to distinguish "at-risk mental states for psychosis" (ARMS) subjects from control individuals from the general population based on facial data extracted from video-recordings.

METHODS

58 non-help-seeking medication-naïve ARMS and 70 healthy subjects were screened from a general population sample. At-risk status was assessed with the Structured Interview for Prodromal Syndromes (SIPS), and "Subject's Overview" section was filmed (5-10 min). Several features were extracted, e.g., eye and mouth aspect ratio, Euler angles, coordinates from 51 facial landmarks. This elicited 649 facial features, which were further selected using Gradient Boosting Machines (AdaBoost combined with Random Forests). Data was split in 70/30 for training, and Monte Carlo cross validation was used.

RESULTS

Final model reached 83 % of mean F1-score, and balanced accuracy of 85 %. Mean area under the curve for the receiver operator curve classifier was 93 %. Convergent validity testing showed that two features included in the model were significantly correlated with Avolition (SIPS N2 item) and expression of emotion (SIPS N3 item).

CONCLUSION

Our model capitalized on short video-recordings from individuals recruited from the general population, effectively distinguishing between ARMS and controls. Results are encouraging for large-screening purposes in low-resource settings.

ChatGPT and Bard exhibit spontaneous citation fabrication during psychiatry literature search

ChatGPT (Generative Pre-Trained Transformer) is a large language model (LLM), which comprises a neural network that has learned information and patterns of language use from large amounts of text on the internet. ChatGPT, introduced by OpenAI, responds to human queries in a conversational manner. Here, we aimed to assess whether ChatGPT could reliably produce accurate references to supplement the literature search process. We describe our March 2023 exchange with ChatGPT, which generated thirty-five citations, two of which were real. 12 citations were similar to actual manuscripts (e.g., titles with incorrect author lists, journals, or publication years) and the remaining 21, while plausible, were in fact a pastiche of multiple existent manuscripts. In June 2023, we re-tested ChatGPT's performance and compared it to that of Google's GPT counterpart, Bard 2.0. We investigated performance in English, as well as in Spanish and Italian. Fabrications made by LLMs, including erroneous citations, have been called "hallucinations"; we discuss reasons for which this is a misnomer. Furthermore, we describe potential explanations for citation fabrication by GPTs, as well as measures being taken to remedy this issue, including reinforcement learning. Our results underscore that output from conversational LLMs should be verified.

Validation of natural language processing methods capturing semantic incoherence in the speech of patients with non-affective psychosis

Background

Impairments in speech production are a core symptom of non-affective psychosis (NAP). While traditional clinical ratings of patients' speech involve a subjective human factor, modern methods of natural language processing (NLP) promise an automatic and objective way of analyzing patients' speech. This study aimed to validate NLP methods for analyzing speech production in NAP patients.

Methods

Speech samples from patients with a diagnosis of schizophrenia or schizoaffective disorder were obtained at two measurement points, 6 months apart. Out of N = 71 patients at T1, speech samples were also available for N = 54 patients at T2. Global and local models of semantic coherence as well as different word embeddings (word2vec vs. GloVe) were applied to the transcribed speech samples. They were tested and compared regarding their correlation with clinical ratings and external criteria from cross-sectional and longitudinal measurements.

Results

Results did not show differences for global vs. local coherence models and found more significant correlations between word2vec models and clinically relevant outcome variables than for GloVe models. Exploratory analysis of longitudinal data did not yield significant correlation with coherence scores.

Conclusion

These results indicate that natural language processing methods need to be critically validated in more studies and carefully selected before clinical application.

Executively-mediated language skills are related to performance-based social functioning in the early psychosis spectrum

Social impairment is a core deficit in psychotic spectrum disorders (PSDs). Prior work shows that language abnormalities can predict psychosis onset and are related to social outcomes in PSDs. Few studies have investigated nuanced relationships between language/verbal abilities and social functioning in the early psychosis spectrum, including at-risk (schizotypy) and first episode of psychosis (FEP) individuals. This study aimed to examine the relationship to between language/verbal performance and performance-based and examiner-rated social functioning. We also aimed to replicate prior models that demonstrate neurocognition is related to social functioning through negative symptoms and social cognition. Low schizotypy (n = 42), high schizotypy (n = 44), and FEP (n = 15) participants completed a battery of language/verbal, social cognition, and social functioning measures. Regression analyses revealed that Proverb Test performance was uniquely and significantly associated with performance-based but not examiner-rated social functioning. Other language/verbal measures were not significantly related to social functioning. In mediational analyses, language/verbal performance was indirectly related to social functioning through negative traits, and also through social cognition. Findings extend support for negative symptom and social cognitive intervention in the early psychosis spectrum, and uniquely suggest that executively-mediated language skills may be an additional target to improve social functioning.

Using virtual reality to assess gesture performance deficits in schizophrenia patients

Introduction

Gesture performance deficits are prevalent in schizophrenia patients and are strongly associated with poor social communication skills and community functioning, affecting their overall quality of life. Currently, video-recording technology is widely used in clinical settings to assess gesture production deficits in schizophrenia patients. Nevertheless, the subjective evaluation of video-recordings can encumber task assessment. The present study will aim to use virtual reality to examine its potential use as an alternative tool to objectively measure gesture performance accuracy in schizophrenia patients and healthy controls.

Methods

Gesture performance in the virtual reality setting will be based on the well-established Test of Upper Limb Apraxia. Participants will be immersed in a virtual environment where they will experience themselves being embodied in a collocated virtual body seen from a first-person perspective. Motion trackers will be placed on participants' hands and elbows to track upper body movements in real-time, and to record gesture movement for later analysis. Participants will see a virtual agent sitting across from them, with a virtual table in between. The agent will perform various types of gestures and the participants' task will be to imitate those gestures as accurately as possible. Measurements from the tracking devices will be stored and analyzed to address gesture performance accuracy across groups.

Discussion

This study aims to provide objective measurements of gesture performance accuracy in schizophrenia patients. If successful, the results will provide new knowledge to the gesture literature and offer the potential for novel therapeutic interventions using virtual reality technologies. Such interventions can improve gesturing and thus advance social communication skills in schizophrenia patients.

Syntactic complexity and diversity of spontaneous speech production in schizophrenia spectrum and major depressive disorders

Syntax, the grammatical structure of sentences, is a fundamental aspect of language. It remains debated whether reduced syntactic complexity is unique to schizophrenia spectrum disorder (SSD) or whether it is also present in major depressive disorder (MDD). Furthermore, the association of syntax (including syntactic complexity and diversity) with language-related neuropsychology and psychopathological symptoms across disorders remains unclear. Thirty-four SSD patients and thirty-eight MDD patients diagnosed according to DSM-IV-TR as well as forty healthy controls (HC) were included and tasked with describing four pictures from the Thematic Apperception Test. We analyzed the produced speech regarding its syntax delineating measures for syntactic complexity (the total number of main clauses embedding subordinate clauses) and diversity (number of different types of complex sentences). We performed cluster analysis to identify clusters based on syntax and investigated associations of syntactic, to language-related neuropsychological (verbal fluency and verbal episodic memory), and psychopathological measures (positive and negative formal thought disorder) using network analyses. Syntax in SSD was significantly reduced in comparison to MDD and HC, whereas the comparison of HC and MDD revealed no significant differences. No associations were present between speech measures and current medication, duration and severity of illness, age or sex; the single association accounted for was education. A cluster analysis resulted in four clusters with different degrees of syntax across diagnoses. Subjects with less syntax exhibited pronounced positive and negative symptoms and displayed poorer performance in executive functioning, global functioning, and verbal episodic memory. All cluster-based networks indicated varying degrees of domain-specific and cross-domain connections. Measures of syntactic complexity were closely related while syntactic diversity appeared to be a separate node outside of the syntactic network. Cross-domain associations were more salient in more complex syntactic production.

Linguistic markers of psychosis in Mandarin Chinese: Relations to theory of mind

Disorganized and impoverished language is a key feature of schizophrenia (Sz), but whether and which linguistic changes previously observed in Indo-European languages generalize to other languages remains unclear. Targeting Mandarin Chinese, we aimed to profile aspects of grammatical complexity that we hypothesized would be reduced in schizophrenia in a task of verbalizing social events. 51 individuals with Sz and 39 controls participated in the animated triangles task, a standardized measure of theory of mind (ToM), in which participants describe triangles moving in either a random or an 'intentional' condition. Results revealed that clauses embedded as arguments in other clauses were reduced in Sz, and that both groups produced such clauses and grammatical aspect more frequently in the intentional condition. ToM scores specifically correlated with production of embedded argument clauses. These results document grammatical impoverishment in Sz in Chinese across several structural domains, which in some of its specific aspects relate to mentalizing performance.

Artificial intelligence ecosystem for computational psychiatry: Ideas to practice

Computational psychiatry is an emerging field that not only explores the biological basis of mental illness but also considers the diagnoses and identifies the underlying mechanisms. One of the key strengths of computational psychiatry is that it may identify patterns in large datasets that are not easily identifiable. This may help researchers develop more effective treatments and interventions for mental health problems. This paper is a narrative review that reviews the literature and produces an artificial intelligence ecosystem for computational psychiatry. The artificial intelligence ecosystem for computational psychiatry includes data acquisition, preparation, modeling, application, and evaluation. This approach allows researchers to integrate data from a variety of sources, such as brain imaging, genetics, and behavioral experiments, to obtain a more complete understanding of mental health conditions. Through the process of data preprocessing, training, and testing, the data that are required for model building can be prepared. By using machine learning, neural networks, artificial intelligence, and other methods, researchers have been able to develop diagnostic tools that can accurately identify mental health conditions based on a patient’s symptoms and other factors. Despite the continuous development and breakthrough of computational psychiatry, it has not yet influenced routine clinical practice and still faces many challenges, such as data availability and quality, biological risks, equity, and data protection. As we move progress in this field, it is vital to ensure that computational psychiatry remains accessible and inclusive so that all researchers may contribute to this significant and exciting field.

Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality

BACKGROUND

Assessing a patient's suicide risk is challenging for health professionals because it depends on voluntary disclosure by the patient and often has limited resources. The application of novel machine learning approaches to determine suicide risk has clinical utility.

OBJECTIVE

This study aimed to investigate cross-sectional and longitudinal approaches to assess suicidality based on acoustic voice features of psychiatric patients using artificial intelligence.

METHODS

We collected 348 voice recordings during clinical interviews of 104 patients diagnosed with mood disorders at baseline and 2, 4, 8, and 12 months after recruitment. Suicidality was assessed using the Beck Scale for Suicidal Ideation and suicidal behavior using the Columbia Suicide Severity Rating Scale. The acoustic features of the voice, including temporal, formal, and spectral features, were extracted from the recordings. A between-person classification model that examines the vocal characteristics of individuals cross sectionally to detect individuals at high risk for suicide and a within-person classification model that detects considerable worsening of suicidality based on changes in acoustic features within an individual were developed and compared. Internal validation was performed using 10-fold cross validation of audio data from baseline to 2-month and external validation was performed using data from 2 to 4 months.

RESULTS

A combined set of 12 acoustic features and 3 demographic variables (age, sex, and past suicide attempts) were included in the single-layer artificial neural network for the between-person classification model. Furthermore, 13 acoustic features were included in the extreme gradient boosting machine learning algorithm for the within-person model. The between-person classifier was able to detect high suicidality with 69% accuracy (sensitivity 74%, specificity 62%, area under the receiver operating characteristic curve 0.62), whereas the within-person model was able to predict worsening suicidality over 2 months with 79% accuracy (sensitivity 68%, specificity 84%, area under receiver operating characteristic curve 0.67). The second model showed 62% accuracy in predicting increased suicidality in external sets.

CONCLUSIONS

Within-person analysis using changes in acoustic features within an individual is a promising approach to detect increased suicidality. Automated analysis of voice can be used to support the real-time assessment of suicide risk in primary care or telemedicine.

Active Inference, Epistemic Value, and Uncertainty in Conceptual Disorganization in First-Episode Schizophrenia

BACKGROUND AND HYPOTHESIS

Active inference has become an influential concept in psychopathology. We apply active inference to investigate conceptual disorganization in first-episode schizophrenia. We conceptualize speech production as a decision-making process affected by the latent "conceptual organization"-as a special case of uncertainty about the causes of sensory information. Uncertainty is both minimized via speech production-in which function words index conceptual organization in terms of analytic thinking-and tracked by a domain-general salience network. We hypothesize that analytic thinking depends on conceptual organization. Therefore, conceptual disorganization in schizophrenia would be both indexed by low conceptual organization and reflected in the effective connectivity within the salience network.

STUDY DESIGN

With 1-minute speech samples from a picture description task and resting state fMRI from 30 patients and 30 healthy subjects, we employed dynamic causal and probabilistic graphical models to investigate if the effective connectivity of the salience network underwrites conceptual organization.

STUDY RESULTS

Low analytic thinking scores index low conceptual organization which affects diagnostic status. The influence of the anterior insula on the anterior cingulate cortex and the self-inhibition within the anterior cingulate cortex are elevated given low conceptual organization (ie, conceptual disorganization).

CONCLUSIONS

Conceptual organization, a construct that explains formal thought disorder, can be modeled in an active inference framework and studied in relation to putative neural substrates of disrupted language in schizophrenia. This provides a critical advance to move away from rating-scale scores to deeper constructs in the pursuit of the pathophysiology of formal thought disorder.

Linguistic profile automated characterisation in pluripotential clinical high-risk mental state (CHARMS) conditions: methodology of a multicentre observational study

INTRODUCTION

Language is usually considered the social vehicle of thought in intersubjective communications. However, the relationship between language and high-order cognition seems to evade this canonical and unidirectional description (ie, the notion of language as a simple means of thought communication). In recent years, clinical high at-risk mental state (CHARMS) criteria (evolved from the Ultra-High-Risk paradigm) and the introduction of the Clinical Staging system have been proposed to address the dynamicity of early psychopathology. At the same time, natural language processing (NLP) techniques have greatly evolved and have been successfully applied to investigate different neuropsychiatric conditions. The combination of at-risk mental state paradigm, clinical staging system and automated NLP methods, the latter applied on spoken language transcripts, could represent a useful and convenient approach to the problem of early psychopathological distress within a transdiagnostic risk paradigm.

METHODS AND ANALYSIS

Help-seeking young people presenting psychological distress (CHARMS+/- and Clinical Stage 1a or 1b; target sample size for both groups n=90) will be assessed through several psychometric tools and multiple speech analyses during an observational period of 1-year, in the context of an Italian multicentric study. Subjects will be enrolled in different contexts: Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DINOGMI), Section of Psychiatry, University of Genoa-IRCCS Ospedale Policlinico San Martino, Genoa, Italy; Mental Health Department-territorial mental services (ASL 3-Genoa), Genoa, Italy; and Mental Health Department-territorial mental services (AUSL-Piacenza), Piacenza, Italy. The conversion rate to full-blown psychopathology (CS 2) will be evaluated over 2 years of clinical observation, to further confirm the predictive and discriminative value of CHARMS criteria and to verify the possibility of enriching them with several linguistic features, derived from a fine-grained automated linguistic analysis of speech.

ETHICS AND DISSEMINATION

The methodology described in this study adheres to ethical principles as formulated in the Declaration of Helsinki and is compatible with International Conference on Harmonization (ICH)-good clinical practice. The research protocol was reviewed and approved by two different ethics committees (CER Liguria approval code: 591/2020-id.10993; Comitato Etico dell'Area Vasta Emilia Nord approval code: 2022/0071963). Participants will provide their written informed consent prior to study enrolment and parental consent will be needed in the case of participants aged less than 18 years old. Experimental results will be carefully shared through publication in peer-reviewed journals, to ensure proper data reproducibility.

TRIAL REGISTRATION NUMBER

DOI:10.17605/OSF.IO/BQZTN.

Language and Psychosis: Tightening the Association

This special issue of DISCOURSE in Psychosis focuses on the role of language in psychosis, including the relationships between formal thought disorder and conceptual disorganization, with speech and language markers and the neural mechanisms underlying these features in psychosis. It also covers the application of computational techniques in the study of language in psychosis, as well as the potential for using speech and language data for digital phenotyping in psychiatry.

Semantic and Acoustic Markers in Schizophrenia-Spectrum Disorders: A Combinatory Machine Learning Approach

BACKGROUND AND HYPOTHESIS

Speech is a promising marker to aid diagnosis of schizophrenia-spectrum disorders, as it reflects symptoms like thought disorder and negative symptoms. Previous approaches made use of different domains of speech for diagnostic classification, including features like coherence (semantic) and form (acoustic). However, an examination of the added value of each domain when combined is lacking as of yet. Here, we investigate the acoustic and semantic domains separately and combined.

STUDY DESIGN

Using semi-structured interviews, speech of 94 subjects with schizophrenia-spectrum disorders (SSD) and 73 healthy controls (HC) was recorded. Acoustic features were extracted using a standardized feature-set, and transcribed interviews were used to calculate semantic word similarity using word2vec. Random forest classifiers were trained for each domain. A third classifier was used to combine features from both domains; 10-fold cross-validation was used for each model.

RESULTS

The acoustic random forest classifier achieved 81% accuracy classifying SSD and HC, while the semantic domain classifier reached an accuracy of 80%. Joining features from the two domains, the combined classifier reached 85% accuracy, significantly improving on separate domain classifiers. For the combined classifier, top features were fragmented speech from the acoustic domain and variance of similarity from the semantic domain.

CONCLUSIONS

Both semantic and acoustic analyses of speech achieved ~80% accuracy in classifying SSD from HC. We replicate earlier findings per domain, additionally showing that combining these features significantly improves classification performance. Feature importance and accuracy in combined classification indicate that the domains measure different, complementing aspects of speech.

Latent Factors of Language Disturbance and Relationships to Quantitative Speech Features

BACKGROUND AND HYPOTHESIS

Quantitative acoustic and textual measures derived from speech ("speech features") may provide valuable biomarkers for psychiatric disorders, particularly schizophrenia spectrum disorders (SSD). We sought to identify cross-diagnostic latent factors for speech disturbance with relevance for SSD and computational modeling.

STUDY DESIGN

Clinical ratings for speech disturbance were generated across 14 items for a cross-diagnostic sample (N = 334), including SSD (n = 90). Speech features were quantified using an automated pipeline for brief recorded samples of free speech. Factor models for the clinical ratings were generated using exploratory factor analysis, then tested with confirmatory factor analysis in the cross-diagnostic and SSD groups. The relationships between factor scores and computational speech features were examined for 202 of the participants.

STUDY RESULTS

We found a 3-factor model with a good fit in the cross-diagnostic group and an acceptable fit for the SSD subsample. The model identifies an impaired expressivity factor and 2 interrelated disorganized factors for inefficient and incoherent speech. Incoherent speech was specific to psychosis groups, while inefficient speech and impaired expressivity showed intermediate effects in people with nonpsychotic disorders. Each of the 3 factors had significant and distinct relationships with speech features, which differed for the cross-diagnostic vs SSD groups.

CONCLUSIONS

We report a cross-diagnostic 3-factor model for speech disturbance which is supported by good statistical measures, intuitive, applicable to SSD, and relatable to linguistic theories. It provides a valuable framework for understanding speech disturbance and appropriate targets for modeling with quantitative speech features.

Investigating temporal and prosodic markers in clinical high-risk for psychosis participants using automated acoustic analysis

AIM

Language disturbances are a candidate biomarker for the early detection of psychosis. Temporal and prosodic abnormalities have been observed in schizophrenia patients, while there is conflicting evidence whether such deficits are present in participants meeting clinical high-risk for psychosis (CHR-P) criteria.

METHODS

Clinical interviews from CHR-P participants (n = 50) were examined for temporal and prosodic metrics and compared against a group of healthy controls (n = 17) and participants with affective disorders and substance abuse (n = 23).

RESULTS

There were no deficits in acoustic variables in the CHR-P group, while participants with affective disorders/substance abuse were characterized by slower speech rate, longer pauses and higher unvoiced frames percentage.

CONCLUSION

Our finding suggests that temporal and prosodic aspects of speech are not impaired in early-stage psychosis. Further studies are required to clarify whether such abnormalities are present in sub-groups of CHR-P participants with elevated psychosis-risk.

Depressive symptoms are specifically related to speech pauses in schizophrenia spectrum disorders

Depression is a common and debilitating mental illness associated with sadness and negativity and is often comorbid with other psychiatric conditions, such as schizophrenia. Depressive symptoms are presently primarily assessed through clinical interviews, however there are other behavioural indicators being investigated as more objective methods of depressive symptom assessment. The present study aimed to evaluate the utility of assessing depression using quantitative speech parameters by comparing speech between 23 schizophrenia/schizoaffective patients with clinically significant depressive symptoms (DP) 19 schizophrenia/schizoaffective patients without depressive symptoms (NDP) and 22 healthy controls with no psychiatric history (HC). Participant audio recordings were transcribed and analyzed to extract five types of speech variables: utterances, words, speaking rate, formulation errors and pauses. The results indicated that DP patients produced significantly more pauses within utterances, and had more utterances with pauses compared to NDP patients and HCs (p = <.05), who performed similarly to each other. Word, speaking rate and formulation errors variables were not significantly different between the patient groups (p > .05). The findings suggest that depressive symptoms may have a specific relationship to speech pauses, and support the potential future use of speech pause assessments as an alternative and objective depression rating and monitoring tool.

Acoustic speech markers for schizophrenia-spectrum disorders: a diagnostic and symptom-recognition tool

BACKGROUND

Clinicians routinely use impressions of speech as an element of mental status examination. In schizophrenia-spectrum disorders, descriptions of speech are used to assess the severity of psychotic symptoms. In the current study, we assessed the diagnostic value of acoustic speech parameters in schizophrenia-spectrum disorders, as well as its value in recognizing positive and negative symptoms.

METHODS

Speech was obtained from 142 patients with a schizophrenia-spectrum disorder and 142 matched controls during a semi-structured interview on neutral topics. Patients were categorized as having predominantly positive or negative symptoms using the Positive and Negative Syndrome Scale (PANSS). Acoustic parameters were extracted with OpenSMILE, employing the extended Geneva Acoustic Minimalistic Parameter Set, which includes standardized analyses of pitch (F0), speech quality and pauses. Speech parameters were fed into a random forest algorithm with leave-ten-out cross-validation to assess their value for a schizophrenia-spectrum diagnosis, and PANSS subtype recognition.

RESULTS

The machine-learning speech classifier attained an accuracy of 86.2% in classifying patients with a schizophrenia-spectrum disorder and controls on speech parameters alone. Patients with predominantly positive v. negative symptoms could be classified with an accuracy of 74.2%.

CONCLUSIONS

Our results show that automatically extracted speech parameters can be used to accurately classify patients with a schizophrenia-spectrum disorder and healthy controls, as well as differentiate between patients with predominantly positive v. negatives symptoms. Thus, the field of speech technology has provided a standardized, powerful tool that has high potential for clinical applications in diagnosis and differentiation, given its ease of comparison and replication across samples.

Automated measures of speech content and speech organization in schizophrenia: Test-retest reliability and generalizability across demographic variables

Technological advances in artificial intelligence and natural language processing have increased efficiency of assessing speech content and speech organization in schizophrenia. Despite these developments, there has been little focus on the psychometrics of these approaches. Using two common assessments, the current study addressed this gap by: 1) measuring test-retest reliability; and 2) assessing whether speech content and/or speech organization generalize across demographics. To test these aims, we examined psychometric properties of the Linguistic Inquiry Word Count (LIWC), a speech content measure, and the Coh-Metrix, a speech organization measure. Across baseline to six month (n = 101) and baseline to one year (n = 47) narrative speech samples, we generally observed fair reliability for speech content measures and fair to good reliability for speech organization measures. Regarding demographics, multiple speech indices varied by race, income, and education. The lack of excellent reliability scores for speech indices holds important implications for examining speech variables in clinical trials and highlights the dynamic nature of speech. This work illustrates the importance of designing speech content and speech organization measures with external validity across demographic factors. Future studies examining speech in schizophrenia should account for potential biases against demographic groups introduced by linguistic analysis tools.

Disembodiment and Language in Schizophrenia: An Integrated Psychopathological and Evolutionary Perspective

Different hypotheses have flourished to explain the evolutionary paradox of schizophrenia. In this contribution, we sought to illustrate how, in the schizophrenia spectrum, the concept of embodiment may underpin the phylogenetic and developmental pathways linking sensorimotor processes, the origin of human language, and the construction of a basic sense of the self. In particular, according to an embodied model of language, we suggest that the reuse of basic sensorimotor loops for language, while enabling the development of fully symbolic thought, has pushed the human brain close to the threshold of a severe disruption of self-embodiment processes, which are at the core of schizophrenia psychopathology. We adopted an inter-disciplinary approach (psychopathology, neuroscience, developmental biology) within an evolutionary framework, to gain an integrated, multi-perspectival model on the origin of schizophrenia vulnerability. A maladaptive over-expression of evolutionary-developmental trajectories toward language at the expense of embodiment processes would have led to the evolutionary "trade-off" of a hyper-symbolic activity to the detriment of a disembodied self. Therefore, schizophrenia psychopathology might be the cost of long-term co-evolutive interactions between brain and language.

Applications of Speech Analysis in Psychiatry

ABSTRACT

The need for objective measurement in psychiatry has stimulated interest in alternative indicators of the presence and severity of illness. Speech may offer a source of information that bridges the subjective and objective in the assessment of mental disorders. We systematically reviewed the literature for articles exploring speech analysis for psychiatric applications. The utility of speech analysis depends on how accurately speech features represent clinical symptoms within and across disorders. We identified four domains of the application of speech analysis in the literature: diagnostic classification, assessment of illness severity, prediction of onset of illness, and prognosis and treatment outcomes. We discuss the findings in each of these domains, with a focus on how types of speech features characterize different aspects of psychopathology. Models that bring together multiple speech features can distinguish speakers with psychiatric disorders from healthy controls with high accuracy. Differentiating between types of mental disorders and symptom dimensions are more complex problems that expose the transdiagnostic nature of speech features. Convergent progress in speech research and computer sciences opens avenues for implementing speech analysis to enhance objectivity of assessment in clinical practice. Application of speech analysis will need to address issues of ethics and equity, including the potential to perpetuate discriminatory bias through models that learn from clinical assessment data. Methods that mitigate bias are available and should play a key role in the implementation of speech analysis.

Understanding psychiatric illness through natural language processing (UNDERPIN): Rationale, design, and methodology

Introduction

Psychiatric disorders are diagnosed through observations of psychiatrists according to diagnostic criteria such as the DSM-5. Such observations, however, are mainly based on each psychiatrist's level of experience and often lack objectivity, potentially leading to disagreements among psychiatrists. In contrast, specific linguistic features can be observed in some psychiatric disorders, such as a loosening of associations in schizophrenia. Some studies explored biomarkers, but biomarkers have yet to be used in clinical practice.

Aim

The purposes of this study are to create a large dataset of Japanese speech data labeled with detailed information on psychiatric disorders and neurocognitive disorders to quantify the linguistic features of those disorders using natural language processing and, finally, to develop objective and easy-to-use biomarkers for diagnosing and assessing the severity of them.

Methods

This study will have a multi-center prospective design. The DSM-5 or ICD-11 criteria for major depressive disorder, bipolar disorder, schizophrenia, and anxiety disorder and for major and minor neurocognitive disorders will be regarded as the inclusion criteria for the psychiatric disorder samples. For the healthy subjects, the absence of a history of psychiatric disorders will be confirmed using the Mini-International Neuropsychiatric Interview (M.I.N.I.). The absence of current cognitive decline will be confirmed using the Mini-Mental State Examination (MMSE). A psychiatrist or psychologist will conduct 30-to-60-min interviews with each participant; these interviews will include free conversation, picture-description task, and story-telling task, all of which will be recorded using a microphone headset. In addition, the severity of disorders will be assessed using clinical rating scales. Data will be collected from each participant at least twice during the study period and up to a maximum of five times at an interval of at least one month.

Discussion

This study is unique in its large sample size and the novelty of its method, and has potential for applications in many fields. We have some challenges regarding inter-rater reliability and the linguistic peculiarities of Japanese. As of September 2022, we have collected a total of >1000 records from >400 participants. To the best of our knowledge, this data sample is one of the largest in this field.

Clinical Trial Registration

Identifier: UMIN000032141.