1
|
Fleming JE, Senneff S, Lowery MM. Multivariable closed-loop control of deep brain stimulation for Parkinson's disease. J Neural Eng 2023; 20:056029. [PMID: 37733003 DOI: 10.1088/1741-2552/acfbfa] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Accepted: 09/21/2023] [Indexed: 09/22/2023]
Abstract
Objective. Closed-loop deep brain stimulation (DBS) methods for Parkinson's disease (PD) to-date modulate either stimulation amplitude or frequency to control a single biomarker. While good performance has been demonstrated for symptoms that are correlated with the chosen biomarker, suboptimal regulation can occur for uncorrelated symptoms or when the relationship between biomarker and symptom varies. Control of stimulation-induced side-effects is typically not considered.Approach.A multivariable control architecture is presented to selectively target suppression of either tremor or subthalamic nucleus beta band oscillations. DBS pulse amplitude and duration are modulated to maintain amplitude below a threshold and avoid stimulation of distal large diameter axons associated with stimulation-induced side effects. A supervisor selects between a bank of controllers which modulate DBS pulse amplitude to control rest tremor or beta activity depending on the level of muscle electromyographic (EMG) activity detected. A secondary controller limits pulse amplitude and modulates pulse duration to target smaller diameter axons lying close to the electrode. The control architecture was investigated in a computational model of the PD motor network which simulated the cortico-basal ganglia network, motoneuron pool, EMG and muscle force signals.Main results.Good control of both rest tremor and beta activity was observed with reduced power delivered when compared with conventional open loop stimulation, The supervisor avoided over- or under-stimulation which occurred when using a single controller tuned to one biomarker. When DBS amplitude was constrained, the secondary controller maintained the efficacy of stimulation by increasing pulse duration to compensate for reduced amplitude. Dual parameter control delivered effective control of the target biomarkers, with additional savings in the power delivered.Significance.Non-linear multivariable control can enable targeted suppression of motor symptoms for PD patients. Moreover, dual parameter control facilitates automatic regulation of the stimulation therapeutic dosage to prevent overstimulation, whilst providing additional power savings.
Collapse
Affiliation(s)
- John E Fleming
- Neuromuscular Systems Laboratory, UCD School of Electrical & Electronic Engineering, University College Dublin, Dublin, Ireland
- Medical Research Council Brain Network Dynamics Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Mansfield Road, Oxford OX1 3TH, United Kingdom
| | - Sageanne Senneff
- Neuromuscular Systems Laboratory, UCD School of Electrical & Electronic Engineering, University College Dublin, Dublin, Ireland
| | - Madeleine M Lowery
- Neuromuscular Systems Laboratory, UCD School of Electrical & Electronic Engineering, University College Dublin, Dublin, Ireland
| |
Collapse
|
2
|
Hemmerling D, Wodzinski M, Orozco-Arroyave JR, Sztaho D, Daniol M, Jemiolo P, Wojcik-Pedziwiatr M. Vision Transformer for Parkinson's Disease Classification using Multilingual Sustained Vowel Recordings. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083719 DOI: 10.1109/embc40787.2023.10340478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Parkinson's disease (PD) is the 2nd most prevalent neurodegenerative disease in the world. Thus, the early detection of PD has recently been the subject of several scientific and commercial studies. In this paper, we propose a pipeline using Vision Transformer applied to mel-spectrograms for PD classification using multilingual sustained vowel recordings. Furthermore, our proposed transformed-based model shows a great potential to use voice as a single modality biomarker for automatic PD detection without language restrictions, a wide range of vowels, with an F1-score equal to 0.78. The results of our study fall within the range of the estimated prevalence of voice and speech disorders in Parkinson's disease, which ranges from 70-90%. Our study demonstrates a high potential for adaptation in clinical decision-making, allowing for increasingly systematic and fast diagnosis of PD with the potential for use in telemedicine.Clinical relevance- There is an urgent need to develop non invasive biomarker of Parkinson's disease effective enough to detect the onset of the disease to introduce neuroprotective treatment at the earliest stage possible and to follow the results of that intervention. Voice disorders in PD are very frequent and are expected to be utilized as an early diagnostic biomarker. The voice analysis using deep neural networks open new opportunities to assess neurodegenerative diseases' symptoms, for fast diagnosis-making, to guide treatment initiation, and risk prediction. The detection accuracy for voice biomarkers according to our method reached close to the maximum achievable value.
Collapse
|
3
|
Ngo QC, Motin MA, Pah ND, Drotár P, Kempster P, Kumar D. Computerized analysis of speech and voice for Parkinson's disease: A systematic review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 226:107133. [PMID: 36183641 DOI: 10.1016/j.cmpb.2022.107133] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Revised: 09/13/2022] [Accepted: 09/13/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND AND OBJECTIVE Speech impairment is an early symptom of Parkinson's disease (PD). This study has summarized the literature related to speech and voice in detecting PD and assessing its severity. METHODS A systematic review of the literature from 2010 to 2021 to investigate analysis methods and signal features. The keywords "Automatic analysis" in conjunction with "PD speech" or "PD voice" were used, and the PubMed and ScienceDirect databases were searched. A total of 838 papers were found on the first run, of which 189 were selected. One hundred and forty-seven were found to be suitable for the review. The different datasets, recording protocols, signal analysis methods and features that were reported are listed. Values of the features that separate PD patients from healthy controls were tabulated. Finally, the barriers that limit the wide use of computerized speech analysis are discussed. RESULTS Speech and voice may be valuable markers for PD. However, large differences between the datasets make it difficult to compare different studies. In addition, speech analytic methods that are not informed by physiological understanding may alienate clinicians. CONCLUSIONS The potential usefulness of speech and voice for the detection and assessment of PD is confirmed by evidence from the classification and correlation results.
Collapse
Affiliation(s)
| | - Mohammod Abdul Motin
- Biosignals Lab, RMIT University, Melbourne, Australia; Department of Electrical & Electronic Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Nemuel Daniel Pah
- Biosignals Lab, RMIT University, Melbourne, Australia; Universitas Surabaya, Indonesia
| | - Peter Drotár
- Intelligent Information Systems Lab, Technical University of Kosice, Letna 9, 42001, Kosice, Slovakia
| | - Peter Kempster
- Neurosciences Department, Monash Health, Clayton, VIC, Australia; Department of Medicine, School of Clinical Sciences, Monash University, Clayton, VIC, Australia
| | - Dinesh Kumar
- Biosignals Lab, RMIT University, Melbourne, Australia.
| |
Collapse
|
4
|
Automated methods for diagnosis of Parkinson’s disease and predicting severity level. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06626-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
5
|
Advances in Parkinson's Disease detection and assessment using voice and speech: A review of the articulatory and phonatory aspects. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102418] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
|
6
|
An improved framework for Parkinson’s disease prediction using Variational Mode Decomposition-Hilbert spectrum of speech signal. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.04.014] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
7
|
Pah ND, Motin MA, Kempster P, Kumar DK. Detecting Effect of Levodopa in Parkinson's Disease Patients Using Sustained Phonemes. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2021; 9:4900409. [PMID: 33796418 PMCID: PMC8007086 DOI: 10.1109/jtehm.2021.3066800] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/01/2020] [Revised: 01/05/2021] [Accepted: 03/01/2021] [Indexed: 11/08/2022]
Abstract
BACKGROUND Parkinson's disease (PD) is a multi-symptom neurodegenerative disease generally managed with medications, of which levodopa is the most effective. Determining the dosage of levodopa requires regular meetings where motor function can be observed. Speech impairment is an early symptom in PD and has been proposed for early detection and monitoring of the disease. However, findings from previous research on the effect of levodopa on speech have not shown a consistent picture. METHOD This study has investigated the effect of medication on PD patients for three sustained phonemes; /a/, /o/, and /m/, which were recorded from 24 PD patients during medication off and on stages, and from 22 healthy participants. The differences were statistically investigated, and the features were classified using Support Vector Machine (SVM). RESULTS The results show that medication has a significant effect on the change of time and amplitude perturbation (jitter and shimmer) and harmonics of /m/, which was the most sensitive individual phoneme to the levodopa response. /m/ and /o/ performed at a comparable level in discriminating PD-off from control recordings. However, SVM classifications based on the combined use of the three phonemes /a/, /o/, and /m/ showed the best classifications, both for medication effect and for separating PD from control voice. The SVM classification for PD-off versus PD-on achieved an AUC of 0.81. CONCLUSION Studies of phonation by computerized voice analysis in PD should employ recordings of multiple phonemes. Our findings are potentially relevant in research to identify early parkinsonian dysarthria, and to tele-monitoring of the levodopa response in patients with established PD.
Collapse
Affiliation(s)
- Nemuel D. Pah
- Electrical Engineering DepartmentUniversitas SurabayaSurabaya60293Indonesia
- School of EngineeringRMIT UniversityMelbourneVIC3000Australia
| | - Mohammod A. Motin
- School of EngineeringRMIT UniversityMelbourneVIC3000Australia
- Department of Electrical and Electronic EngineeringRajshahi University of Engineering and TechnologyRajshahi6204Bangladesh
| | | | - Dinesh K. Kumar
- School of EngineeringRMIT UniversityMelbourneVIC3000Australia
| |
Collapse
|
8
|
Hilbert spectrum analysis for automatic detection and evaluation of Parkinson’s speech. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.102050] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
9
|
Lauraitis A, Maskeliūnas R, Damaševičius R, Krilavičius T. A Mobile Application for Smart Computer-Aided Self-Administered Testing of Cognition, Speech, and Motor Impairment. SENSORS (BASEL, SWITZERLAND) 2020; 20:E3236. [PMID: 32517223 PMCID: PMC7309061 DOI: 10.3390/s20113236] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Revised: 05/29/2020] [Accepted: 06/03/2020] [Indexed: 11/16/2022]
Abstract
We present a model for digital neural impairment screening and self-assessment, which can evaluate cognitive and motor deficits for patients with symptoms of central nervous system (CNS) disorders, such as mild cognitive impairment (MCI), Parkinson's disease (PD), Huntington's disease (HD), or dementia. The data was collected with an Android mobile application that can track cognitive, hand tremor, energy expenditure, and speech features of subjects. We extracted 238 features as the model inputs using 16 tasks, 12 of them were based on a self-administered cognitive testing (SAGE) methodology and others used finger tapping and voice features acquired from the sensors of a smart mobile device (smartphone or tablet). Fifteen subjects were involved in the investigation: 7 patients with neurological disorders (1 with Parkinson's disease, 3 with Huntington's disease, 1 with early dementia, 1 with cerebral palsy, 1 post-stroke) and 8 healthy subjects. The finger tapping, SAGE, energy expenditure, and speech analysis features were used for neural impairment evaluations. The best results were achieved using a fusion of 13 classifiers for combined finger tapping and SAGE features (96.12% accuracy), and using bidirectional long short-term memory (BiLSTM) (94.29% accuracy) for speech analysis features.
Collapse
Affiliation(s)
- Andrius Lauraitis
- Department of Multimedia Engineering, Kaunas University of Technology, 50186 Kaunas, Lithuania; (A.L.); (R.M.)
| | - Rytis Maskeliūnas
- Department of Multimedia Engineering, Kaunas University of Technology, 50186 Kaunas, Lithuania; (A.L.); (R.M.)
| | - Robertas Damaševičius
- Department of Applied Informatics, Vytautas Magnus University, 44404 Kaunas, Lithuania;
- Faculty of Applied Mathematics, Silesian University of Technology, 44-100 Gliwice, Poland
| | - Tomas Krilavičius
- Department of Applied Informatics, Vytautas Magnus University, 44404 Kaunas, Lithuania;
- Baltic Institute of Advanced Technology, 01124 Vilnius, Lithuania
| |
Collapse
|
10
|
Khan T, Lundgren LE, Anderson DG, Nowak I, Dougherty M, Verikas A, Pavel M, Jimison H, Nowaczyk S, Aharonson V. Assessing Parkinson's disease severity using speech analysis in non-native speakers. COMPUT SPEECH LANG 2020. [DOI: 10.1016/j.csl.2019.101047] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
11
|
Karan B, Sahu SS, Mahto K. Parkinson disease prediction using intrinsic mode function based features from speech signal. Biocybern Biomed Eng 2020. [DOI: 10.1016/j.bbe.2019.05.005] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
12
|
Detecting Parkinson's disease from sustained phonation and speech signals. PLoS One 2017; 12:e0185613. [PMID: 28982171 PMCID: PMC5628839 DOI: 10.1371/journal.pone.0185613] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2017] [Accepted: 09/16/2017] [Indexed: 11/19/2022] Open
Abstract
This study investigates signals from sustained phonation and text-dependent speech modalities for Parkinson’s disease screening. Phonation corresponds to the vowel /a/ voicing task and speech to the pronunciation of a short sentence in Lithuanian language. Signals were recorded through two channels simultaneously, namely, acoustic cardioid (AC) and smart phone (SP) microphones. Additional modalities were obtained by splitting speech recording into voiced and unvoiced parts. Information in each modality is summarized by 18 well-known audio feature sets. Random forest (RF) is used as a machine learning algorithm, both for individual feature sets and for decision-level fusion. Detection performance is measured by the out-of-bag equal error rate (EER) and the cost of log-likelihood-ratio. Essentia audio feature set was the best using the AC speech modality and YAAFE audio feature set was the best using the SP unvoiced modality, achieving EER of 20.30% and 25.57%, respectively. Fusion of all feature sets and modalities resulted in EER of 19.27% for the AC and 23.00% for the SP channel. Non-linear projection of a RF-based proximity matrix into the 2D space enriched medical decision support by visualization.
Collapse
|
13
|
A Machine Learning System for the Diagnosis of Parkinson’s Disease from Speech Signals and Its Application to Multiple Speech Signal Types. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2016. [DOI: 10.1007/s13369-016-2206-3] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
14
|
|