1
|
Oliveira GC, Pah ND, Ngo QC, Yoshida A, Gomes NB, Papa JP, Kumar D. A pilot study for speech assessment to detect the severity of Parkinson's disease: An ensemble approach. Comput Biol Med 2024; 185:109565. [PMID: 39709867 DOI: 10.1016/j.compbiomed.2024.109565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 08/09/2024] [Accepted: 12/09/2024] [Indexed: 12/24/2024]
Abstract
BACKGROUND Changes in voice are a symptom of Parkinson's disease and used to assess the progression of the condition. However, natural differences in the voices of people can make this challenging. Computerized binary speech classification can identify people with PD (PwPD), but its multiclass application to detect the severity of the disease remains difficult. METHOD This study investigated six diadochokinetic (DDK) tasks, four features (phonation, articulation, prosody, and their fusion), and three machine learning models for four severity levels of PwPD. The four binary classifications were: (i) Normal vs Not Normal, (ii) Slight vs Not Slight, (iii) Mild vs Not Mild and (iv) Moderate vs. Not Moderate. The best task and features for each class were identified and the models were ensembled to develop a multiclass model to distinguish between Normal vs. Slight vs. Mild vs. Moderate. RESULTS For Normal vs Not-normal, logistic regression (LR) using the prosody from "ka-ka-ka" task, Random Forest (RF) using articulation from "petaka" for Slight vs Not Slight, RF for the fusion from "ka-ka-ka" for Mild vs Not Mild and Gradient Boosting (GB) using prosody from "ta-ta-ta" for Moderate vs Not Moderate gave the best results. Combining these using LR achieved an accuracy of 72%. CONCLUSION Dividing the multiclass problem into four binary problems gives the optimum speech features for each class. This pilot study, conducted on a small public dataset, shows the potential of computerized speech analysis using DDK to evaluate the severity of Parkinson's disease voice symptoms.
Collapse
Affiliation(s)
- Guilherme C Oliveira
- School of Engineering, RMIT University, Victoria, Australia; School of Sciences, São Paulo State University, São Paulo, Brazil.
| | - Nemuel D Pah
- School of Engineering, RMIT University, Victoria, Australia; Electrical Engineering, Universitas Surabaya, Surabaya, Indonesia.
| | - Quoc C Ngo
- School of Engineering, RMIT University, Victoria, Australia.
| | - Arissa Yoshida
- School of Sciences, São Paulo State University, São Paulo, Brazil.
| | - Nícolas B Gomes
- School of Sciences, São Paulo State University, São Paulo, Brazil.
| | - João P Papa
- School of Sciences, São Paulo State University, São Paulo, Brazil.
| | - Dinesh Kumar
- School of Engineering, RMIT University, Victoria, Australia.
| |
Collapse
|
2
|
Kucerenko A, Buddenkotte T, Apostolova I, Klutmann S, Ledig C, Buchert R. Incorporating label uncertainty during the training of convolutional neural networks improves performance for the discrimination between certain and inconclusive cases in dopamine transporter SPECT. Eur J Nucl Med Mol Imaging 2024:10.1007/s00259-024-06988-0. [PMID: 39592475 DOI: 10.1007/s00259-024-06988-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2024] [Accepted: 11/11/2024] [Indexed: 11/28/2024]
Abstract
PURPOSE Deep convolutional neural networks (CNN) hold promise for assisting the interpretation of dopamine transporter (DAT)-SPECT. For improved communication of uncertainty to the user it is crucial to reliably discriminate certain from inconclusive cases that might be misclassified by strict application of a predefined decision threshold on the CNN output. This study tested two methods to incorporate existing label uncertainty during the training to improve the utility of the CNN sigmoid output for this task. METHODS Three datasets were used retrospectively: a "development" dataset (n = 1740) for CNN training, validation and testing, two independent out-of-distribution datasets (n = 640, 645) for testing only. In the development dataset, binary classification based on visual inspection was performed carefully by three well-trained readers. A ResNet-18 architecture was trained for binary classification of DAT-SPECT using either a randomly selected vote ("random vote training", RVT), the proportion of "reduced" votes ( "average vote training", AVT) or the majority vote (MVT) across the three readers as reference standard. Balanced accuracy was computed separately for "inconclusive" sigmoid outputs (within a predefined interval around the 0.5 decision threshold) and for "certain" (non-inconclusive) sigmoid outputs. RESULTS The proportion of "inconclusive" test cases that had to be accepted to achieve a given balanced accuracy in the "certain" test case was lower with RVT and AVT than with MVT in all datasets (e.g., 1.9% and 1.2% versus 2.8% for 98% balanced accuracy in "certain" test cases from the development dataset). In addition, RVT and AVT resulted in slightly higher balanced accuracy in all test cases independent of their certainty (97.3% and 97.5% versus 97.0% in the development dataset). CONCLUSION Making between-readers-discrepancy known to CNN during the training improves the utility of their sigmoid output to discriminate certain from inconclusive cases that might be misclassified by the CNN when the predefined decision threshold is strictly applied. This does not compromise on overall accuracy.
Collapse
Affiliation(s)
- Aleksej Kucerenko
- xAILab Bamberg, Chair of Explainable Machine Learning, Faculty of Information Systems and Applied Computer Sciences, Otto-Friedrich-University, Bamberg, Germany
| | - Thomas Buddenkotte
- Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany
| | - Ivayla Apostolova
- Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany
| | - Susanne Klutmann
- Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany
| | - Christian Ledig
- xAILab Bamberg, Chair of Explainable Machine Learning, Faculty of Information Systems and Applied Computer Sciences, Otto-Friedrich-University, Bamberg, Germany
| | - Ralph Buchert
- Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany.
| |
Collapse
|
3
|
di Biase L, Pecoraro PM, Pecoraro G, Shah SA, Di Lazzaro V. Machine learning and wearable sensors for automated Parkinson's disease diagnosis aid: a systematic review. J Neurol 2024; 271:6452-6470. [PMID: 39143345 DOI: 10.1007/s00415-024-12611-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Revised: 07/22/2024] [Accepted: 07/24/2024] [Indexed: 08/16/2024]
Abstract
BACKGROUND The diagnosis of Parkinson's disease is currently based on clinical evaluation. Despite clinical hallmarks, unfortunately, the error rate is still significant. Low in-vivo diagnostic accuracy of clinical evaluation mainly relies on the lack of quantitative biomarkers for an objective motor performance assessment. Non-invasive technologies, such as wearable sensors, coupled with machine learning algorithms, assess quantitatively and objectively the motor performances, with possible benefits either for in-clinic and at-home settings. We conducted a systematic review of the literature on machine learning algorithms embedded in smart devices in Parkinson's disease diagnosis. METHODS Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, we searched PubMed for articles published between December, 2007 and July, 2023, using a search string combining "Parkinson's disease" AND ("healthy" or "control") AND "diagnosis", within the Groups and Outcome domains. Additional search terms included "Algorithm", "Technology" and "Performance". RESULTS From 89 identified studies, 47 met the inclusion criteria based on the search string and four additional studies were included based on the Authors' expertise. Gait emerged as the most common parameter analysed by machine learning models, with Support Vector Machines as the prevalent algorithm. The results suggest promising accuracy with complex algorithms like Random Forest, Support Vector Machines, and K-Nearest Neighbours. DISCUSSION Despite the promise shown by machine learning algorithms, real-world applications may still face limitations. This review suggests that integrating machine learning with wearable sensors has the potential to improve Parkinson's disease diagnosis. These tools could provide clinicians with objective data, potentially aiding in earlier detection.
Collapse
Affiliation(s)
- Lazzaro di Biase
- Research Unit of Neurology, Neurophysiology and Neurobiology, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo 21, 00128, Rome, Italy.
- Operative Research Unit of Neurology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy.
- Brain Innovations Lab, Università Campus Bio-Medico di Roma, Via Álvaro del Portillo 21, 00128, Rome, Italy.
| | - Pasquale Maria Pecoraro
- Research Unit of Neurology, Neurophysiology and Neurobiology, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo 21, 00128, Rome, Italy
- Operative Research Unit of Neurology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | | | | | - Vincenzo Di Lazzaro
- Research Unit of Neurology, Neurophysiology and Neurobiology, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo 21, 00128, Rome, Italy
- Operative Research Unit of Neurology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| |
Collapse
|
4
|
Wodarski P, Jurkojć J, Michalska J, Kamieniarz A, Juras G, Gzik M. Balance assessment in selected stages of Parkinson's disease using trend change analysis. J Neuroeng Rehabil 2023; 20:99. [PMID: 37528430 PMCID: PMC10394805 DOI: 10.1186/s12984-023-01229-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 07/28/2023] [Indexed: 08/03/2023] Open
Abstract
BACKGROUND Balance disorders in patients diagnosed with Parkinson's disease (PD) are associated with a change in balance-keeping strategy and reflex disorders which regulate the maintenance of vertical body posture. Center of foot pressure (COP) displacement signals were analyzed during quiet standing experiments to define such changes. The research aimed to apply stock exchange indices based on the trend change analyses to the assessment of a level of the Parkinson disease progression on the grounds of the analysis of the COP signals. METHODS 30 patients in two stages of PD, 40 elderly participants, and 20 individuals at a young age were studied. Each person was subjected to 3 measurements with open and closed eyes. A technical analysis of the COP displacement signal was performed, and the following quantities were determined: indices related to the number of trend changes (TCI), indices defining a mean time (TCI_dT), and mean displacement (TCI_dS) and mean velocity (TCI_dV) between such changes. RESULTS The results indicate a higher TCI value for PD than for aged-matched control group (p < 0.05). In the case of PD patients, there was also an increase in the TCI_dS value by 2-5 mm, which mainly contributed to the increase in TCI_dV. Statistically significant differences for the TCI_dT values occurred between all groups in which differences in the average COP velocity were noted. CONCLUSIONS The TCI and TCI_dV results obtained for the healthy participants enabled the development of indices supporting PD diagnostics. The causes of the TCI_dV changes in patients were determined, i.e., whether they resulted from an increase in the TCI_dT or TCI_dS between the moments of trend changes indicated by the developed algorithm. The developed methodology provides new information on the impact of PD on the strategy of maintaining balance, which was impossible to obtain using currently used analyses. Trial registration The conducted research is an observational study and does not include a health care intervention. Participants gave their consent to participate in the research and the procedure was approved by the Institutional Bioethics Committee.
Collapse
Affiliation(s)
- Piotr Wodarski
- Department of Biomechatronics, Faculty of Biomedical Engineering, Silesian University of Technology, Gliwice, Poland
| | - Jacek Jurkojć
- Department of Biomechatronics, Faculty of Biomedical Engineering, Silesian University of Technology, Gliwice, Poland
| | - Justyna Michalska
- Department of Human Motor Behavior, Institute of Sport Sciences, Academy of Physical Education in Katowice, Katowice, Poland
| | - Anna Kamieniarz
- Department of Human Motor Behavior, Institute of Sport Sciences, Academy of Physical Education in Katowice, Katowice, Poland
| | - Grzegorz Juras
- Department of Human Motor Behavior, Institute of Sport Sciences, Academy of Physical Education in Katowice, Katowice, Poland
| | - Marek Gzik
- Department of Biomechatronics, Faculty of Biomedical Engineering, Silesian University of Technology, Gliwice, Poland
| |
Collapse
|