1
|
Šubert M, Tykalová T, Novotný M, Dušek P, Klempíř J, Rusz J. Automated analysis of spoken language differentiates multiple system atrophy from Parkinson's disease. J Neurol 2025; 272:113. [PMID: 39812820 PMCID: PMC11735538 DOI: 10.1007/s00415-024-12828-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2024] [Revised: 10/23/2024] [Accepted: 11/21/2024] [Indexed: 01/16/2025]
Abstract
BACKGROUND AND OBJECTIVES Patients with synucleinopathies such as multiple system atrophy (MSA) and Parkinson's disease (PD) frequently display speech and language abnormalities. We explore the diagnostic potential of automated linguistic analysis of natural spontaneous speech to differentiate MSA and PD. METHODS Spontaneous speech of 39 participants with MSA compared to 39 drug-naive PD and 39 healthy controls matched for age and sex was transcribed and linguistically annotated using automatic speech recognition and natural language processing. A quantitative analysis was performed using 6 lexical and syntactic and 2 acoustic features. Results were compared with human-controlled analysis to assess the robustness of the approach. Diagnostic accuracy was evaluated using sensitivity analysis. RESULTS Despite similar disease duration, linguistic abnormalities were generally more severe in MSA than in PD, leading to high diagnostic accuracy with an area under the curve of 0.81. Compared to controls, MSA showed decreased grammatical component usage, more repetitive phrases, shorter sentences, reduced sentence development, slower articulation rate, and increased duration of pauses, whereas PD had only shorter sentences, reduced sentence development, and longer pauses. Only slower articulation rate was distinctive for MSA while unchanged for PD relative to controls. The highest correlation was found between bulbar/pseudobulbar clinical score and sentence length (r = -0.49, p = 0.002). Despite the relatively high severity of dysarthria in MSA, a strong agreement between manually and automatically computed results was achieved. DISCUSSION Automated linguistic analysis may offer an objective, cost-effective, and widely applicable biomarker to differentiate synucleinopathies with similar clinical manifestations.
Collapse
Affiliation(s)
- Martin Šubert
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Technická 2, Praha 6, 16000, Prague, Czech Republic
| | - Tereza Tykalová
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Technická 2, Praha 6, 16000, Prague, Czech Republic
| | - Michal Novotný
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Technická 2, Praha 6, 16000, Prague, Czech Republic
| | - Petr Dušek
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Jiří Klempíř
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Jan Rusz
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Technická 2, Praha 6, 16000, Prague, Czech Republic.
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic.
- Department of Neurology and ARTORG Center, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland.
| |
Collapse
|
2
|
Rusz J, Krack P, Tripoliti E. From prodromal stages to clinical trials: The promise of digital speech biomarkers in Parkinson's disease. Neurosci Biobehav Rev 2024; 167:105922. [PMID: 39424108 DOI: 10.1016/j.neubiorev.2024.105922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2024] [Revised: 09/19/2024] [Accepted: 10/13/2024] [Indexed: 10/21/2024]
Abstract
Speech impairment is a common and disabling symptom in Parkinson's disease (PD), affecting communication and quality of life. Advances in digital speech processing and artificial intelligence have revolutionized objective speech analysis. Given the complex nature of speech impairment, acoustic speech analysis offers unique biomarkers for neuroprotective treatments from the prodromal stages of PD. Digital speech biomarkers can monitor levodopa-induced motor complications, detect the effects of deep brain stimulation, and provide feedback for behavioral speech therapy. This review updates the mechanisms underlying speech impairment, the impact of speech phenotypes, and the effects of interventions on speech. We evaluate the strengths, potential weaknesses, and suitability of promising digital speech biomarkers in PD for capturing disease progression and treatment efficacy. Additionally, we explore the translational potential of PD speech biomarkers to other neuropsychiatric diseases, offering insights into motion, cognition, and emotion. Finally, we highlight knowledge gaps and suggest directions for future research to enhance the use of quantitative speech measures in disease-modifying clinical trials. The findings demonstrate that one year is sufficient to detect disease progression in early PD through speech biomarkers. Voice quality, pitch, loudness, and articulation measures appear to capture the efficacy of treatment interventions most effectively. Certain speech features, such as loudness and articulation rate, behave oppositely in different neurological diseases, offering valuable insights for differential diagnosis. In conclusion, this review highlights speech as a biomarker in tracking disease progression, especially in the prodromal stages of PD, and calls for further longitudinal studies to establish its efficacy across diverse populations.
Collapse
Affiliation(s)
- Jan Rusz
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic.
| | - Paul Krack
- Movement Disorders Center, Department of Neurology, University Hospital of Bern, Bern, Switzerland
| | - Elina Tripoliti
- UCL, Institute of Neurology, Department of Clinical and Movement Neurosciences, and National Hospital for Neurology and Neurosurgery, UCLH NHS Trust, London, UK
| |
Collapse
|
3
|
Šubert M, Novotný M, Tykalová T, Hlavnička J, Dušek P, Růžička E, Škrabal D, Pelletier A, Postuma RB, Montplaisir J, Gagnon JF, Galbiati A, Ferini-Strambi L, Marelli S, St Louis EK, Timm PC, Teigen LN, Janzen A, Oertel W, Heim B, Holzknecht E, Stefani A, Högl B, Dauvilliers Y, Evangelista E, Šonka K, Rusz J. Spoken Language Alterations can Predict Phenoconversion in Isolated Rapid Eye Movement Sleep Behavior Disorder: A Multicenter Study. Ann Neurol 2024; 95:530-543. [PMID: 37997483 DOI: 10.1002/ana.26835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 11/13/2023] [Accepted: 11/20/2023] [Indexed: 11/25/2023]
Abstract
OBJECTIVE This study assessed the relationship between speech and language impairment and outcome in a multicenter cohort of isolated/idiopathic rapid eye movement (REM) sleep behavior disorder (iRBD). METHODS Patients with iRBD from 7 centers speaking Czech, English, German, French, and Italian languages underwent a detailed speech assessment at baseline. Story-tale narratives were transcribed and linguistically annotated using fully automated methods based on automatic speech recognition and natural language processing algorithms, leading to the 3 distinctive linguistic and 2 acoustic patterns of language deterioration and associated composite indexes of their overall severity. Patients were then prospectively followed and received assessments for parkinsonism or dementia during follow-up. The Cox proportional hazard was performed to evaluate the predictive value of language patterns for phenoconversion over a follow-up period of 5 years. RESULTS Of 180 patients free of parkinsonism or dementia, 156 provided follow-up information. After a mean follow-up of 2.7 years, 42 (26.9%) patients developed neurodegenerative disease. Patients with higher severity of linguistic abnormalities (hazard ratio [HR = 2.35]) and acoustic abnormalities (HR = 1.92) were more likely to develop a defined neurodegenerative disease, with converters having lower content richness (HR = 1.74), slower articulation rate (HR = 1.58), and prolonged pauses (HR = 1.46). Dementia-first (n = 16) and parkinsonism-first with mild cognitive impairment (n = 9) converters had higher severity of linguistic abnormalities than parkinsonism-first with normal cognition converters (n = 17). INTERPRETATION Automated language analysis might provide a predictor of phenoconversion from iRBD into synucleinopathy subtypes with cognitive impairment, and thus can be used to stratify patients for neuroprotective trials. ANN NEUROL 2024;95:530-543.
Collapse
Affiliation(s)
- Martin Šubert
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Michal Novotný
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Tereza Tykalová
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Jan Hlavnička
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Petr Dušek
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Evžen Růžička
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Dominik Škrabal
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Amelie Pelletier
- Department of Neurology, Research Institute of the McGill University Health Centre, Montreal General Hospital, Montreal, Quebec, Canada
- Center for Advanced Research in Sleep Medicine, CIUSSS-NÎM - Hôpital du Sacré-Coeur de Montréal, Montreal, Quebec, Canada
| | - Ronald B Postuma
- Department of Neurology, Research Institute of the McGill University Health Centre, Montreal General Hospital, Montreal, Quebec, Canada
- Center for Advanced Research in Sleep Medicine, CIUSSS-NÎM - Hôpital du Sacré-Coeur de Montréal, Montreal, Quebec, Canada
| | - Jacques Montplaisir
- Center for Advanced Research in Sleep Medicine, CIUSSS-NÎM - Hôpital du Sacré-Coeur de Montréal, Montreal, Quebec, Canada
| | - Jean-François Gagnon
- Center for Advanced Research in Sleep Medicine, CIUSSS-NÎM - Hôpital du Sacré-Coeur de Montréal, Montreal, Quebec, Canada
| | - Andrea Galbiati
- Sleep Disorders Center, Division of Neuroscience, Ospedale San Raffaele, Università Vita-Salute, Milan, Italy
- Department of Psychology, "Vita-Salute" San Raffaele University, Milan, Italy
| | - Luigi Ferini-Strambi
- Sleep Disorders Center, Division of Neuroscience, Ospedale San Raffaele, Università Vita-Salute, Milan, Italy
- Department of Psychology, "Vita-Salute" San Raffaele University, Milan, Italy
| | - Sara Marelli
- Sleep Disorders Center, Division of Neuroscience, Ospedale San Raffaele, Università Vita-Salute, Milan, Italy
| | - Erik K St Louis
- Mayo Center for Sleep Medicine, and Sleep Behavior and Neurophysiology Research Laboratory, Departments of Neurology and Medicine, Division of Pulmonary and Critical Care Medicine Mayo Clinic College of Medicine and Science Rochester, Rochester, MN, USA
- Mayo Clinic Health System Southwest Wisconsin, La Crosse, WI, USA
| | - Paul C Timm
- Mayo Center for Sleep Medicine, and Sleep Behavior and Neurophysiology Research Laboratory, Departments of Neurology and Medicine, Division of Pulmonary and Critical Care Medicine Mayo Clinic College of Medicine and Science Rochester, Rochester, MN, USA
| | - Luke N Teigen
- Mayo Center for Sleep Medicine, and Sleep Behavior and Neurophysiology Research Laboratory, Departments of Neurology and Medicine, Division of Pulmonary and Critical Care Medicine Mayo Clinic College of Medicine and Science Rochester, Rochester, MN, USA
| | - Annette Janzen
- Department of Neurology, Philipps University Marburg, Marburg, Germany
| | - Wolfgang Oertel
- Department of Neurology, Philipps University Marburg, Marburg, Germany
| | - Beatrice Heim
- Department of Neurology, Medical University of Innsbruck, Innsbruck, Austria
| | - Evi Holzknecht
- Department of Neurology, Medical University of Innsbruck, Innsbruck, Austria
| | - Ambra Stefani
- Department of Neurology, Medical University of Innsbruck, Innsbruck, Austria
| | - Birgit Högl
- Department of Neurology, Medical University of Innsbruck, Innsbruck, Austria
| | - Yves Dauvilliers
- National Reference Network for Narcolepsy, Sleep-Wake Disorder Unit, Department of Neurology, Gui-de-Chauliac Hospital, CHU Montpellier, INSERM, University of Montpellier, Montpellier, France
| | - Elisa Evangelista
- National Reference Network for Narcolepsy, Sleep-Wake Disorder Unit, Department of Neurology, Gui-de-Chauliac Hospital, CHU Montpellier, INSERM, University of Montpellier, Montpellier, France
| | - Karel Šonka
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Jan Rusz
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
- Department of Neurology & ARTORG Center, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| |
Collapse
|
4
|
D’Ascanio S, Piras F, Banaj N, Assogna F, Pellicano C, Bassi A, Spalletta G, Piras F. Narrative discourse production in Parkinson's disease: Decoupling the role of cognitive-linguistic and motor speech changes. Heliyon 2023; 9:e18633. [PMID: 37576215 PMCID: PMC10415819 DOI: 10.1016/j.heliyon.2023.e18633] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 07/20/2023] [Accepted: 07/24/2023] [Indexed: 08/15/2023] Open
Abstract
Introduction the interplay between neuropsychological and communicative abilities in Parkinson's disease (PD) has been relatively overlooked, and it is not entirely understood which difficulties are consequent to impaired motor control, and which have a linguistic/cognitive basis. Here, we examined narrative discourse in PD using a multi-level analysis procedure considering sentence-level (productivity, lexical-grammatical processing) and discourse-level processes (narrative organization, informativeness), and partialling out patients' motor speech impairments. The interaction between cognitive (i.e. linguistic and executive) and communication abilities was also investigated. Methods Twenty-nine PD subjects in the mild stage of the disease were compared to 29 matched healthy comparators (HC) on quantitative measures of narrative discourse derived from two picture description tasks. Multivariate (considering articulation rate and educational attainment as covariates) and univariate (with group membership as independent variable) analyses of variance were conducted on separate linguistic domains. The contribution of executive/linguistic abilities to PD's narrative performance was explored by multiple regression analyses on narrative measures significantly differentiating patients from HC. Results significant reductions in patients were observed on measures of productivity (less well-formed words, shorter sentences) and informativeness (fewer conceptual units, less informative elements, lower number of details) and these alterations were explained by variations in linguistic abilities (action and object naming) rather than executive abilities. Articulation rate and educational attainment did not impact the observed reduced productivity and under-informativeness. Conclusion referential narrative discourse is altered in PD, regardless of motor impairments in speech production. The observed reductions in productivity/informativeness aspects of narratives were related to naming abilities and in particular to verbs processing, consistently with the neurocognitive model of motor language coupling. Since narratives are amenable to recurrent and automated analysis for the identification of linguistic patterns potentially anticipating the development of PD and the onset of cognitive deterioration, discourse abilities should be quantitatively and repeatedly profiled in the disorder.
Collapse
Affiliation(s)
- Sara D’Ascanio
- Neuropsychiatry Laboratory, Department of Clinical Neuroscience and Neurorehabilitation, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Fabrizio Piras
- Neuropsychiatry Laboratory, Department of Clinical Neuroscience and Neurorehabilitation, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Nerisa Banaj
- Neuropsychiatry Laboratory, Department of Clinical Neuroscience and Neurorehabilitation, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Francesca Assogna
- Neuropsychiatry Laboratory, Department of Clinical Neuroscience and Neurorehabilitation, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Clelia Pellicano
- Neuropsychiatry Laboratory, Department of Clinical Neuroscience and Neurorehabilitation, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Andrea Bassi
- Neuropsychiatry Laboratory, Department of Clinical Neuroscience and Neurorehabilitation, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Gianfranco Spalletta
- Neuropsychiatry Laboratory, Department of Clinical Neuroscience and Neurorehabilitation, IRCCS Santa Lucia Foundation, Rome, Italy
- Menninger Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, USA
| | - Federica Piras
- Neuropsychiatry Laboratory, Department of Clinical Neuroscience and Neurorehabilitation, IRCCS Santa Lucia Foundation, Rome, Italy
| |
Collapse
|
5
|
Šubert M, Novotný M, Tykalová T, Srpová B, Friedová L, Uher T, Horáková D, Rusz J. Lexical and syntactic deficits analyzed via automated natural language processing: the new monitoring tool in multiple sclerosis. Ther Adv Neurol Disord 2023; 16:17562864231180719. [PMID: 37384113 PMCID: PMC10293520 DOI: 10.1177/17562864231180719] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 05/13/2023] [Indexed: 06/30/2023] Open
Abstract
Background Impairment of higher language functions associated with natural spontaneous speech in multiple sclerosis (MS) remains underexplored. Objectives We presented a fully automated method for discriminating MS patients from healthy controls based on lexical and syntactic linguistic features. Methods We enrolled 120 MS individuals with Expanded Disability Status Scale ranging from 1 to 6.5 and 120 age-, sex-, and education-matched healthy controls. Linguistic analysis was performed with fully automated methods based on automatic speech recognition and natural language processing techniques using eight lexical and syntactic features acquired from the spontaneous discourse. Fully automated annotations were compared with human annotations. Results Compared with healthy controls, lexical impairment in MS consisted of an increase in content words (p = 0.037), a decrease in function words (p = 0.007), and overuse of verbs at the expense of noun (p = 0.047), while syntactic impairment manifested as shorter utterance length (p = 0.002), and low number of coordinate clause (p < 0.001). A fully automated language analysis approach enabled discrimination between MS and controls with an area under the curve of 0.70. A significant relationship was detected between shorter utterance length and lower symbol digit modalities test score (r = 0.25, p = 0.008). Strong associations between a majority of automatically and manually computed features were observed (r > 0.88, p < 0.001). Conclusion Automated discourse analysis has the potential to provide an easy-to-implement and low-cost language-based biomarker of cognitive decline in MS for future clinical trials.
Collapse
Affiliation(s)
- Martin Šubert
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Michal Novotný
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Tereza Tykalová
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Barbora Srpová
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Lucie Friedová
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Tomáš Uher
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Dana Horáková
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
| | - Jan Rusz
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Technická 2, 160 00 Prague, Czech Republic
- Department of Neurology and Centre of Clinical Neuroscience, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic
- Department of Neurology and ARTORG Center for Biomedical Engineering Research, Inselspital (Bern University Hospital), University of Bern, Bern, Switzerland
| |
Collapse
|