An Intelligent Mobile-Enabled System for Diagnosing Parkinson Disease: Development and Validation of a Speech Impairment Detection System

On the inter-dataset generalization of machine learning approaches to Parkinson's disease detection from voice

BACKGROUND AND OBJECTIVE

Parkinson's disease is the second-most-common neurodegenerative disorder that affects motor skills, cognitive processes, mood, and everyday tasks such as speaking and walking. The voices of people with Parkinson's disease may become weak, breathy, or hoarse and may sound emotionless, with slurred words and mumbling. Algorithms for computerized voice analysis have been proposed and have shown highly accurate results. However, these algorithms were developed on single, limited datasets, with participants possessing similar demographics. Such models are prone to overfitting and are unsuitable for generalization, which is essential in real-world applications.

METHODS

We evaluated the computerized Parkinson's disease diagnosis performance of various machine learning models and showed that these models degraded rapidly when used on different datasets. We evaluated two mainstream state-of-the-art approaches, one based on deep convolutional neural networks and another based on voice feature extraction followed by a shallow classifier (i.e., extreme gradient boosting (XGBoost)).

RESULTS

An investigation with four datasets (CzechPD, PC-GITA, ITA, and RMIT-PD) proved that even if the algorithms yielded excellent performance on a single dataset, the results obtained on new data or even a mix of datasets were very unsatisfactory.

CONCLUSIONS

More work needs to be done to make computerized voice analysis methods for Parkinson's disease diagnosis suitable for real-world applications.

Hybrid Machine Learning Framework for Multistage Parkinson's Disease Classification Using Acoustic Features of Sustained Korean Vowels

Recent research has achieved a great classification rate for separating healthy people from those with Parkinson's disease (PD) using speech and the voice. However, these studies have primarily treated early and advanced stages of PD as equal entities, neglecting the distinctive speech impairments and other symptoms that vary across the different stages of the disease. To address this limitation, and improve diagnostic precision, this study assesses the selected acoustic features of dysphonia, as they relate to PD and the Hoehn and Yahr stages, by combining various preprocessing techniques and multiple classification algorithms, to create a comprehensive and robust solution for classification tasks. The dysphonia features extracted from the three sustained Korean vowels /아/(a), /이/(i), and /우/(u) exhibit diversity and strong correlations. To address this issue, the analysis of variance F-Value feature selection classifier from scikit-learn was employed, to identify the topmost relevant features. Additionally, to overcome the class imbalance problem, the synthetic minority over-sampling technique was utilized. To ensure fair comparisons, and mitigate the influence of individual classifiers, four commonly used machine learning classifiers, namely random forest (RF), support vector machine (SVM), k-nearest neighbor (kNN), and multi-layer perceptron (MLP), were employed. This approach enables a comprehensive evaluation of the feature extraction methods, and minimizes the variance in the final classification models. The proposed hybrid machine learning pipeline using the acoustic features of sustained vowels efficiently detects the early and mid-advanced stages of PD with a detection accuracy of 95.48%, and with a detection accuracy of 86.62% for the 4-stage, and a detection accuracy of 89.48% for the 3-stage classification of PD. This study successfully demonstrates the significance of utilizing the diverse acoustic features of dysphonia in the classification of PD and its stages.

Applied Machine Learning Techniques to Diagnose Voice-Affecting Conditions and Disorders: Systematic Literature Review

BACKGROUND

Normal voice production depends on the synchronized cooperation of multiple physiological systems, which makes the voice sensitive to changes. Any systematic, neurological, and aerodigestive distortion is prone to affect voice production through reduced cognitive, pulmonary, and muscular functionality. This sensitivity inspired using voice as a biomarker to examine disorders that affect the voice. Technological improvements and emerging machine learning (ML) technologies have enabled possibilities of extracting digital vocal features from the voice for automated diagnosis and monitoring systems.

OBJECTIVE

This study aims to summarize a comprehensive view of research on voice-affecting disorders that uses ML techniques for diagnosis and monitoring through voice samples where systematic conditions, nonlaryngeal aerodigestive disorders, and neurological disorders are specifically of interest.

METHODS

This systematic literature review (SLR) investigated the state of the art of voice-based diagnostic and monitoring systems with ML technologies, targeting voice-affecting disorders without direct relation to the voice box from the point of view of applied health technology. Through a comprehensive search string, studies published from 2012 to 2022 from the databases Scopus, PubMed, and Web of Science were scanned and collected for assessment. To minimize bias, retrieval of the relevant references in other studies in the field was ensured, and 2 authors assessed the collected studies. Low-quality studies were removed through a quality assessment and relevant data were extracted through summary tables for analysis. The articles were checked for similarities between author groups to prevent cumulative redundancy bias during the screening process, where only 1 article was included from the same author group.

RESULTS

In the analysis of the 145 included studies, support vector machines were the most utilized ML technique (51/145, 35.2%), with the most studied disease being Parkinson disease (PD; reported in 87/145, 60%, studies). After 2017, 16 additional voice-affecting disorders were examined, in contrast to the 3 investigated previously. Furthermore, an upsurge in the use of artificial neural network-based architectures was observed after 2017. Almost half of the included studies were published in last 2 years (2021 and 2022). A broad interest from many countries was observed. Notably, nearly one-half (n=75) of the studies relied on 10 distinct data sets, and 11/145 (7.6%) used demographic data as an input for ML models.

CONCLUSIONS

This SLR revealed considerable interest across multiple countries in using ML techniques for diagnosing and monitoring voice-affecting disorders, with PD being the most studied disorder. However, the review identified several gaps, including limited and unbalanced data set usage in studies, and a focus on diagnostic test rather than disorder-specific monitoring. Despite the limitations of being constrained by only peer-reviewed publications written in English, the SLR provides valuable insights into the current state of research on ML-based voice-affecting disorder diagnosis and monitoring and highlighting areas to address in future research.

Using a smartwatch and smartphone to assess early Parkinson's disease in the WATCH-PD study

Digital health technologies can provide continuous monitoring and objective, real-world measures of Parkinson's disease (PD), but have primarily been evaluated in small, single-site studies. In this 12-month, multicenter observational study, we evaluated whether a smartwatch and smartphone application could measure features of early PD. 82 individuals with early, untreated PD and 50 age-matched controls wore research-grade sensors, a smartwatch, and a smartphone while performing standardized assessments in the clinic. At home, participants wore the smartwatch for seven days after each clinic visit and completed motor, speech and cognitive tasks on the smartphone every other week. Features derived from the devices, particularly arm swing, the proportion of time with tremor, and finger tapping, differed significantly between individuals with early PD and age-matched controls and had variable correlation with traditional assessments. Longitudinal assessments will inform the value of these digital measures for use in future clinical trials.

COVID-19 and Integrated Multidisciplinary Care Model in Parkinson's Disease: Literature Review & Future Perspectives

Clinical diversity and multi-systemic manifestations of Parkinson's disease (PD) necessitate the involvement of several healthcare professionals from different disciplines for optimal care. Clinical guidelines recommend that all persons with PD should have access to a broad range of medical and allied health professionals to implement an efficient and effective multidisciplinary care model. This is well supported by growing evidence showing the benefits of multidisciplinary interventions on improving quality of life and disease progression in PD. However, a "multidisciplinary" approach requires gathering healthcare professionals from different disciplines into an integrative platform for collaborative teamwork. With the Coronavirus Disease 2019 (COVID-19) pandemic, implementation of such a multidisciplinary care model has become increasingly challenging due to social distancing mandates, isolation and quarantine, clinics cancellation, among others. To address this problem, multidisciplinary teams are developing innovate virtual platforms to maintain care of people with PD. In the present review, we cover aspects on how SARS-CoV-2 has affected people with PD, their caregivers, and care team members. We also review current evidence on the importance of maintaining patient-centered care in the era of social distancing, and how can we utilize telehealth and innovative virtual platforms for multidisciplinary care in PD.

A Computerized Analysis with Machine Learning Techniques for the Diagnosis of Parkinson's Disease: Past Studies and Future Perspectives

According to the World Health Organization (WHO), Parkinson's disease (PD) is a neurodegenerative disease of the brain that causes motor symptoms including slower movement, rigidity, tremor, and imbalance in addition to other problems like Alzheimer's disease (AD), psychiatric problems, insomnia, anxiety, and sensory abnormalities. Techniques including artificial intelligence (AI), machine learning (ML), and deep learning (DL) have been established for the classification of PD and normal controls (NC) with similar therapeutic appearances in order to address these problems and improve the diagnostic procedure for PD. In this article, we examine a literature survey of research articles published up to September 2022 in order to present an in-depth analysis of the use of datasets, various modalities, experimental setups, and architectures that have been applied in the diagnosis of subjective disease. This analysis includes a total of 217 research publications with a list of the various datasets, methodologies, and features. These findings suggest that ML/DL methods and novel biomarkers hold promising results for application in medical decision-making, leading to a more methodical and thorough detection of PD. Finally, we highlight the challenges and provide appropriate recommendations on selecting approaches that might be used for subgrouping and connection analysis with structural magnetic resonance imaging (sMRI), DaTSCAN, and single-photon emission computerized tomography (SPECT) data for future Parkinson's research.

Computerized analysis of speech and voice for Parkinson's disease: A systematic review

BACKGROUND AND OBJECTIVE

Speech impairment is an early symptom of Parkinson's disease (PD). This study has summarized the literature related to speech and voice in detecting PD and assessing its severity.

METHODS

A systematic review of the literature from 2010 to 2021 to investigate analysis methods and signal features. The keywords "Automatic analysis" in conjunction with "PD speech" or "PD voice" were used, and the PubMed and ScienceDirect databases were searched. A total of 838 papers were found on the first run, of which 189 were selected. One hundred and forty-seven were found to be suitable for the review. The different datasets, recording protocols, signal analysis methods and features that were reported are listed. Values of the features that separate PD patients from healthy controls were tabulated. Finally, the barriers that limit the wide use of computerized speech analysis are discussed.

RESULTS

Speech and voice may be valuable markers for PD. However, large differences between the datasets make it difficult to compare different studies. In addition, speech analytic methods that are not informed by physiological understanding may alienate clinicians.

CONCLUSIONS

The potential usefulness of speech and voice for the detection and assessment of PD is confirmed by evidence from the classification and correlation results.

Using Voice Biomarkers to Classify Suicide Risk in Adult Telehealth Callers: Retrospective Observational Study

BACKGROUND

Artificial intelligence has the potential to innovate current practices used to detect the imminent risk of suicide and to address shortcomings in traditional assessment methods.

OBJECTIVE

In this paper, we sought to automatically classify short segments (40 milliseconds) of speech according to low versus imminent risk of suicide in a large number (n=281) of telephone calls made to 2 telehealth counselling services in Australia.

METHODS

A total of 281 help line telephone call recordings sourced from On The Line, Australia (n=266, 94.7%) and 000 Emergency services, Canberra (n=15, 5.3%) were included in this study. Imminent risk of suicide was coded for when callers affirmed intent, plan, and the availability of means; level of risk was assessed by the responding counsellor and reassessed by a team of clinical researchers using the Columbia Suicide Severity Rating Scale (=5/6). Low risk of suicide was coded for in an absence of intent, plan, and means and via Columbia suicide Severity Scale Ratings (=1/2). Preprocessing involved normalization and pre-emphasis of voice signals, while voice biometrics were extracted using the statistical language r. Candidate predictors were identified using Lasso regression. Each voice biomarker was assessed as a predictor of suicide risk using a generalized additive mixed effects model with splines to account for nonlinearity. Finally, a component-wise gradient boosting model was used to classify each call recording based on precoded suicide risk ratings.

RESULTS

A total of 77 imminent-risk calls were compared with 204 low-risk calls. Moreover, 36 voice biomarkers were extracted from each speech frame. Caller sex was a significant moderating factor (β=-.84, 95% CI -0.85, -0.84; t=6.59, P<.001). Candidate biomarkers were reduced to 11 primary markers, with distinct models developed for men and women. Using leave-one-out cross-validation, ensuring that the speech frames of no single caller featured in both training and test data sets simultaneously, an area under the precision or recall curve of 0.985 was achieved (95% CI 0.97, 1.0). The gamboost classification model correctly classified 469,332/470,032 (99.85%) speech frames.

CONCLUSIONS

This study demonstrates an objective, efficient, and economical assessment of imminent suicide risk in an ecologically valid setting with potential applications to real-time assessment and response.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12622000486729; https://www.anzctr.org.au/ACTRN12622000486729.aspx.

Hands-feet wireless devices: Test-retest reliability and discriminant validity of motor measures in Parkinson's disease telemonitoring

BACKGROUND

Telemonitoring, a branch of telemedicine, involves the use of technological tools to remotely detect clinical data and evaluate patients. Telemonitoring of patients with Parkinson's disease (PD) should be performed using reliable and discriminant motor measures. Furthermore, the method of data collection and transmission, and the type of subjects suitable for telemonitoring must be well defined.

OBJECTIVE

To analyze differences in patients with PD and healthy controls (HC) with the wearable inertial device SensHands-SensFeet (SH-SF), adopting a standardized acquisition mode, to verify if motor measures provided by SH-SF have a high discriminating capacity and high intraclass correlation coefficient (ICC).

METHODS

Altogether, 64 patients with mild-to-moderate PD and 50 HC performed 14 standardized motor activities for assessing bradykinesia, postural and resting tremors, and gait parameters. SH-SF inertial devices were used to acquire movements and calculate objective motor measures of movement (total: 75). For each motor task, five or more biomechanical parameters were measured twice. The results were compared between patients with PD and HC.

RESULTS

Fifty-eight objective motor measures significantly differed between patients with PD and HC; among these, 32 demonstrated relevant discrimination power (Cohen's d > 0.8). The test-retest reliability was excellent in patients with PD (median ICC = 0.85 right limbs, 0.91 left limbs) and HC (median ICC = 0.78 right limbs, 0.82 left limbs).

CONCLUSION

In a supervised environment, the SH-SF device provides motor measures with good results in terms of reliability and discriminant ability. The reliability of SH-SF measurements should be evaluated in an unsupervised home setting in future studies.

Severity Prediction over Parkinson's Disease Prediction by Using the Deep Brooke Inception Net Classifier

Parkinson's disease (PD) is a neurodegenerative illness that progresses and is long-lasting. It becomes more difficult to talk, write, walk, and do other basic functions when the brain's dopamine-generating neurons are injured or killed. There is a gradual rise in the intensity of these symptoms over time. Using Parkinson's Telemonitoring Voice Data Set from UCI and deep neural networks, we provide a strategy for predicting the severity of Parkinson's disease in this research. An unprocessed speech recording contains a slew of unintelligible data that makes correct diagnosis difficult. Therefore, the raw signal data must be preprocessed using the signal error drop standardization while the features can be grouped by using the wavelet cleft fuzzy algorithm. Then the abnormal features can be selected by using the firming bacteria foraging algorithm for feature size decomposition process. Then classification was made using the deep brooke inception net classifier. The performances of the classifier are compared where the simulation results show that the proposed strategy accuracy in detecting severity of the Parkinson's disease is better than other conventional methods. The proposed DBIN model achieved better accuracy compared to other existing techniques. It is also found that the classification based on extracted voice abnormality data achieves better accuracy (99.8%) over PD prediction; hence it can be concluded as a better metric for severity prediction.

Telemedicine in neurology: advances and possibilities

BACKGROUND

Telemedicine develops from technology that offers opportunities for knowledge transfer and information sharing and allows the provision of health services at a distance.

OBJECTIVE

To evaluate the number of publications on teleneurology in the last two decades in PubMed and the available evidence on the use of this technology in neurological clinical conditions.

METHODS

A quantitative assessment of publications related to telemedicine and neurology in the last two decades. A search was performed on the PubMed database for the descriptors ("Telemedicine"[Mesh]) AND "Neurology"[Mesh]). A review of the articles retrieved on the topic was carried out to evaluate the innovation processes used and applications in various clinical conditions involving teleneurology.

RESULTS

The search performed on March 14th 2022 resulted in 229 publications involving the topic of telemedicine and neurology between 1999 and 2022. Since 2000, there has been an increase in publications related to this topic, with a peak of 71 articles published in 2020, the year in which the World Health Organization defined the COVID-19 pandemic status.

CONCLUSION

In the last two decades, teleneurology has been developing through the expansion of technological resources and the COVID-19 pandemic intensified this process. Different modalities of teleneurology are studied in several neurology subfields and include teleconsultation (between healthcare professionals or between healthcare professionals and patients), telerehabilitation, telemonitoring and tele-education. The advances achieved by teleneurology in this period encouraged technological innovations and health processes that developed opportunities to improve the care provided in a mechanism of constant evolution.

Assessment of Acoustic Features and Machine Learning for Parkinson's Detection

This article presents a machine learning approach for Parkinson's disease detection. Potential multiple acoustic signal features of Parkinson's and control subjects are ascertained. A collaborated feature bank is created through correlated feature selection, Fisher score feature selection, and mutual information-based feature selection schemes. A detection model on top of the feature bank has been developed using the traditional Naïve Bayes, which proved state of the art. The Naïve Bayes detector on collaborative acoustic features can detect the presence of Parkinson's magnificently with a detection accuracy of 78.97% and precision of 0.926, under the hold-out cross validation. The collaborative feature bank on Naïve Bayes revealed distinguishable results as compared to many other recently proposed approaches. The simplicity of Naïve Bayes makes the system robust and effective throughout the detection process.

DailyCog: A Real-World Functional Cognitive Mobile Application for Evaluating Mild Cognitive Impairment (MCI) in Parkinson's Disease

Parkinson's disease (PD) is the second most common progressive neurodegenerative disorder affecting patient functioning and quality of life. Aside from the motor symptoms of PD, cognitive impairment may occur at early stages of PD and has a substantial impact on patient emotional and physical health. Detecting these early signs through actual daily functioning while the patient is still functionally independent is challenging. We developed DailyCog-a smartphone application for the detection of mild cognitive impairment. DailyCog includes an environment that simulates daily tasks, such as making a drink and shopping, as well as a self-report questionnaire related to daily events performed at home requiring executive functions and visual-spatial abilities, and psychomotor speed. We present the detailed design of DailyCog and discuss various considerations that influenced the design. We tested DailyCog on patients with mild cognitive impairment in PD. Our case study demonstrates how the markers we used coincide with the cognitive levels of the users. We present the outcome of our usability study that found that most users were able to use our app with ease, and provide details on how various features were used, along with some of the difficulties that were identified.