1
|
Zhang H, Ho ESL, Zhang FX, Del Din S, Shum HPH. Pose-based tremor type and level analysis for Parkinson's disease from video. Int J Comput Assist Radiol Surg 2024; 19:831-840. [PMID: 38238490 PMCID: PMC11098891 DOI: 10.1007/s11548-023-03052-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Accepted: 12/20/2023] [Indexed: 03/13/2024]
Abstract
PURPOSE Current methods for diagnosis of PD rely on clinical examination. The accuracy of diagnosis ranges between 73 and 84%, and is influenced by the experience of the clinical assessor. Hence, an automatic, effective and interpretable supporting system for PD symptom identification would support clinicians in making more robust PD diagnostic decisions. METHODS We propose to analyze Parkinson's tremor (PT) to support the analysis of PD, since PT is one of the most typical symptoms of PD with broad generalizability. To realize the idea, we present SPA-PTA, a deep learning-based PT classification and severity estimation system that takes consumer-grade videos of front-facing humans as input. The core of the system is a novel attention module with a lightweight pyramidal channel-squeezing-fusion architecture that effectively extracts relevant PT information and filters noise. It enhances modeling performance while improving system interpretability. RESULTS We validate our system via individual-based leave-one-out cross-validation on two tasks: the PT classification task and the tremor severity rating estimation task. Our system presents a 91.3% accuracy and 80.0% F1-score in classifying PT with non-PT class, while providing a 76.4% accuracy and 76.7% F1-score in more complex multiclass tremor rating classification task. CONCLUSION Our system offers a cost-effective PT classification and tremor severity estimation results as warning signs of PD for undiagnosed patients with PT symptoms. In addition, it provides a potential solution for supporting PD diagnosis in regions with limited clinical resources.
Collapse
Affiliation(s)
- Haozheng Zhang
- Department of Computer Science, Durham University, Durham, UK
| | - Edmond S L Ho
- School of Computing Science, University of Glasgow, Glasgow, UK
| | | | - Silvia Del Din
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- National Institute for Health and Care Research Newcastle Biomedical Research Centre, The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Hubert P H Shum
- Department of Computer Science, Durham University, Durham, UK.
| |
Collapse
|
2
|
Nassajpour M, Shuqair M, Rosenfeld A, Tolea MI, Galvin JE, Ghoraani B. Objective estimation of m-CTSIB balance test scores using wearable sensors and machine learning. Front Digit Health 2024; 6:1366176. [PMID: 38707195 PMCID: PMC11066210 DOI: 10.3389/fdgth.2024.1366176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 04/04/2024] [Indexed: 05/07/2024] Open
Abstract
Accurate balance assessment is important in healthcare for identifying and managing conditions affecting stability and coordination. It plays a key role in preventing falls, understanding movement disorders, and designing appropriate therapeutic interventions across various age groups and medical conditions. However, traditional balance assessment methods often suffer from subjectivity, lack of comprehensive balance assessments and remote assessment capabilities, and reliance on specialized equipment and expert analysis. In response to these challenges, our study introduces an innovative approach for estimating scores on the Modified Clinical Test of Sensory Interaction on Balance (m-CTSIB). Utilizing wearable sensors and advanced machine learning algorithms, we offer an objective, accessible, and efficient method for balance assessment. We collected comprehensive movement data from 34 participants under four different sensory conditions using an array of inertial measurement unit (IMU) sensors coupled with a specialized system to evaluate ground truth m-CTSIB balance scores for our analysis. This data was then preprocessed, and an extensive array of features was extracted for analysis. To estimate the m-CTSIB scores, we applied Multiple Linear Regression (MLR), Support Vector Regression (SVR), and XGBOOST algorithms. Our subject-wise Leave-One-Out and 5-Fold cross-validation analysis demonstrated high accuracy and a strong correlation with ground truth balance scores, validating the effectiveness and reliability of our approach. Key insights were gained regarding the significance of specific movements, feature selection, and sensor placement in balance estimation. Notably, the XGBOOST model, utilizing the lumbar sensor data, achieved outstanding results in both methods, with Leave-One-Out cross-validation showing a correlation of 0.96 and a Mean Absolute Error (MAE) of 0.23 and 5-fold cross-validation showing comparable results with a correlation of 0.92 and an MAE of 0.23, confirming the model's consistent performance. This finding underlines the potential of our method to revolutionize balance assessment practices, particularly in settings where traditional methods are impractical or inaccessible.
Collapse
Affiliation(s)
- Marjan Nassajpour
- Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL, United States
| | - Mustafa Shuqair
- Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL, United States
| | - Amie Rosenfeld
- Department of Neurology, Comprehensive Center for Brain Health, University of Miami, Boca Raton, FL, United States
| | - Magdalena I. Tolea
- Department of Neurology, Comprehensive Center for Brain Health, University of Miami, Boca Raton, FL, United States
| | - James E. Galvin
- Department of Neurology, Comprehensive Center for Brain Health, University of Miami, Boca Raton, FL, United States
| | - Behnaz Ghoraani
- Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL, United States
| |
Collapse
|
3
|
Paredes-Acuna N, Utpadel-Fischler D, Ding K, Thakor NV, Cheng G. Upper limb intention tremor assessment: opportunities and challenges in wearable technology. J Neuroeng Rehabil 2024; 21:8. [PMID: 38218890 PMCID: PMC10787996 DOI: 10.1186/s12984-023-01302-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 12/26/2023] [Indexed: 01/15/2024] Open
Abstract
BACKGROUND Tremors are involuntary rhythmic movements commonly present in neurological diseases such as Parkinson's disease, essential tremor, and multiple sclerosis. Intention tremor is a subtype associated with lesions in the cerebellum and its connected pathways, and it is a common symptom in diseases associated with cerebellar pathology. While clinicians traditionally use tests to identify tremor type and severity, recent advancements in wearable technology have provided quantifiable ways to measure movement and tremor using motion capture systems, app-based tasks and tools, and physiology-based measurements. However, quantifying intention tremor remains challenging due to its changing nature. METHODOLOGY & RESULTS This review examines the current state of upper limb tremor assessment technology and discusses potential directions to further develop new and existing algorithms and sensors to better quantify tremor, specifically intention tremor. A comprehensive search using PubMed and Scopus was performed using keywords related to technologies for tremor assessment. Afterward, screened results were filtered for relevance and eligibility and further classified into technology type. A total of 243 publications were selected for this review and classified according to their type: body function level: movement-based, activity level: task and tool-based, and physiology-based. Furthermore, each publication's methods, purpose, and technology are summarized in the appendix table. CONCLUSIONS Our survey suggests a need for more targeted tasks to evaluate intention tremors, including digitized tasks related to intentional movements, neurological and physiological measurements targeting the cerebellum and its pathways, and signal processing techniques that differentiate voluntary from involuntary movement in motion capture systems.
Collapse
Affiliation(s)
- Natalia Paredes-Acuna
- Institute for Cognitive Systems, Technical University of Munich, Arcisstraße 21, 80333, Munich, Germany.
| | - Daniel Utpadel-Fischler
- Department of Neurology, School of Medicine, Technical University of Munich, Munich, Germany
| | - Keqin Ding
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Nitish V Thakor
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Gordon Cheng
- Institute for Cognitive Systems, Technical University of Munich, Arcisstraße 21, 80333, Munich, Germany
| |
Collapse
|
4
|
Sharma M, Mishra RK, Hall AJ, Casado J, Cole R, Nunes AS, Barchard G, Vaziri A, Pantelyat A, Wills AM. Remote at-home wearable-based gait assessments in Progressive Supranuclear Palsy compared to Parkinson's Disease. BMC Neurol 2023; 23:434. [PMID: 38082255 PMCID: PMC10712191 DOI: 10.1186/s12883-023-03466-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2023] [Accepted: 11/13/2023] [Indexed: 12/18/2023] Open
Abstract
BACKGROUND Wearable sensors can differentiate Progressive Supranuclear Palsy (PSP) from Parkinson's Disease (PD) in laboratory settings but have not been tested in remote settings. OBJECTIVES To compare gait and balance in PSP and PD remotely using wearable-based assessments. METHODS Participants with probable PSP or probable/clinically established PD with reliable caregivers, still able to ambulate 10 feet unassisted, were recruited, enrolled, and consented remotely and instructed by video conference to operate a study-specific tablet solution (BioDigit Home ™) and to wear three inertial sensors (LEGSys™, BioSensics LLC, Newton, MA USA) while performing the Timed Up and Go, 5 × sit-to-stand, and 2-min walk tests. PSPRS and MDS-UPDRS scores were collected virtually or during routine clinical visits. RESULTS Between November, 2021- November, 2022, 27 participants were screened of whom 3 were excluded because of technological difficulties. Eleven PSP and 12 PD participants enrolled, of whom 10 from each group had complete analyzable data. Demographics were well-matched (PSP mean age = 67.6 ± 1.3 years, 40% female; PD mean age = 70.3 ± 1.8 years, 40% female) while disease duration was significantly shorter in PSP (PSP 14 ± 3.5 months vs PD 87.9 ± 16.9 months). Gait parameters showed significant group differences with effect sizes ranging from d = 1.0 to 2.27. Gait speed was significantly slower in PSP: 0.45 ± 0.06 m/s vs. 0.79 ± 0.06 m/s in PD (d = 1.78, p < 0.001). CONCLUSION Our study demonstrates the feasibility of measuring gait in PSP and PD remotely using wearable sensors. The study provides insight into digital biomarkers for both neurodegenerative diseases. TRIAL REGISTRATION ClinicalTrials.gov Identifier: NCT04753320, first posted Febuary 15, 2021.
Collapse
Affiliation(s)
- Mansi Sharma
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Wang ACC Rm 715, 55 Fruit St. , Boston, MA, 02114, USA
| | | | - Anna J Hall
- Department of Neurology, Johns Hopkins University School of Medicine, 600 North Wolfe Street, Meyer 6-181C, Baltimore, MD, 21287, USA
| | - Jose Casado
- BioSensics LLC, 57 Chapel St, Suite 200, Newton, MA, 02458, USA
| | - Rylee Cole
- BioSensics LLC, 57 Chapel St, Suite 200, Newton, MA, 02458, USA
| | - Adonay S Nunes
- BioSensics LLC, 57 Chapel St, Suite 200, Newton, MA, 02458, USA
| | | | - Ashkan Vaziri
- BioSensics LLC, 57 Chapel St, Suite 200, Newton, MA, 02458, USA
| | - Alexander Pantelyat
- Department of Neurology, Johns Hopkins University School of Medicine, 600 North Wolfe Street, Meyer 6-181C, Baltimore, MD, 21287, USA
| | - Anne-Marie Wills
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Wang ACC Rm 715, 55 Fruit St. , Boston, MA, 02114, USA.
| |
Collapse
|
5
|
Skaramagkas V, Boura I, Spanaki C, Michou E, Karamanis G, Kefalopoulou Z, Tsiknakis M. Detecting Minor Symptoms of Parkinson's Disease in the Wild Using Bi-LSTM with Attention Mechanism. SENSORS (BASEL, SWITZERLAND) 2023; 23:7850. [PMID: 37765907 PMCID: PMC10535804 DOI: 10.3390/s23187850] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 09/02/2023] [Accepted: 09/11/2023] [Indexed: 09/29/2023]
Abstract
Parkinson's disease (PD) is a neurodegenerative disorder characterized by motor and nonmotor impairment with various implications on patients' quality of life. Since currently available therapies are only symptomatic, identifying individuals with prodromal, preclinical, or early-stage PD is crucial, as they would be ideal candidates for future disease-modifying therapies. Our analysis aims to develop a robust model for accurate PD detection using accelerometer data collected from PD and non-PD individuals with mild or no tremor during phone conversations. An open-access dataset comprising accelerometer recordings from 22 PD patients and 11 healthy controls (HCs) was utilized. The data were preprocessed to extract relevant time-, frequency-, and energy-related features, and a bidirectional long short-term memory (Bi-LSTM) model with attention mechanism was employed for classification. The performance of the model was evaluated using fivefold cross-validation, and metrics of accuracy, precision, recall, specificity, and f1-score were computed. The proposed model demonstrated high accuracy (98%), precision (99%), recall (98%), specificity (96%), and f1-score (98%) in accurately distinguishing PD patients from HCs. Our findings indicate that the proposed model outperforms existing approaches and holds promise for detection of PD with subtle symptoms, like tremor, in the wild. Such symptoms can present in the early or even prodromal stage of the disease, and appropriate mobile-based applications may be a practical tool in real-life settings to alert individuals at risk to seek medical assistance or give patients feedback in monitoring their symptoms.
Collapse
Affiliation(s)
- Vasileios Skaramagkas
- Institute of Computer Science, Foundation for Research and Technology Hellas (FORTH), GR-700 13 Heraklion, Greece;
- Department of Electrical and Computer Engineering, Hellenic Mediterranean University, GR-710 04 Heraklion, Greece
| | - Iro Boura
- School of Medicine, University of Crete, GR-710 03 Heraklion, Greece; (I.B.); (C.S.)
- Department of Basic and Clinical Neuroscience, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London WC2R 2LS, UK
| | - Cleanthi Spanaki
- School of Medicine, University of Crete, GR-710 03 Heraklion, Greece; (I.B.); (C.S.)
- Department of Neurology, University Hospital of Heraklion, GR-715 00 Heraklion, Greece
| | - Emilia Michou
- School of Health Rehabilitation Sciences, Department of Speech and Language Therapy, University of Patras, GR-265 04 Patras, Greece;
| | - Georgios Karamanis
- Department of Neurology, Patras University Hospital, GR-264 04 Patras, Greece; (G.K.); (Z.K.)
| | - Zinovia Kefalopoulou
- Department of Neurology, Patras University Hospital, GR-264 04 Patras, Greece; (G.K.); (Z.K.)
| | - Manolis Tsiknakis
- Institute of Computer Science, Foundation for Research and Technology Hellas (FORTH), GR-700 13 Heraklion, Greece;
- Department of Electrical and Computer Engineering, Hellenic Mediterranean University, GR-710 04 Heraklion, Greece
| |
Collapse
|
6
|
Vescio B, De Maria M, Crasà M, Nisticò R, Calomino C, Aracri F, Quattrone A, Quattrone A. Development of a New Wearable Device for the Characterization of Hand Tremor. Bioengineering (Basel) 2023; 10:1025. [PMID: 37760127 PMCID: PMC10525186 DOI: 10.3390/bioengineering10091025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 08/17/2023] [Accepted: 08/28/2023] [Indexed: 09/29/2023] Open
Abstract
Rest tremor (RT) is observed in subjects with Parkinson's disease (PD) and Essential Tremor (ET). Electromyography (EMG) studies have shown that PD subjects exhibit alternating contractions of antagonistic muscles involved in tremors, while the contraction pattern of antagonistic muscles is synchronous in ET subjects. Therefore, the RT pattern can be used as a potential biomarker for differentiating PD from ET subjects. In this study, we developed a new wearable device and method for differentiating alternating from a synchronous RT pattern using inertial data. The novelty of our approach relies on the fact that the evaluation of synchronous or alternating tremor patterns using inertial sensors has never been described so far, and current approaches to evaluate the tremor patterns are based on surface EMG, which may be difficult to carry out for non-specialized operators. This new device, named "RT-Ring", is based on a six-axis inertial measurement unit and a Bluetooth Low-Energy microprocessor, and can be worn on a finger of the tremulous hand. A mobile app guides the operator through the whole acquisition process of inertial data from the hand with RT, and the prediction of tremor patterns is performed on a remote server through machine learning (ML) models. We used two decision tree-based algorithms, XGBoost and Random Forest, which were trained on features extracted from inertial data and achieved a classification accuracy of 92% and 89%, respectively, in differentiating alternating from synchronous tremor segments in the validation set. Finally, the classification response (alternating or synchronous RT pattern) is shown to the operator on the mobile app within a few seconds. This study is the first to demonstrate that different electromyographic tremor patterns have their counterparts in terms of rhythmic movement features, thus making inertial data suitable for predicting the muscular contraction pattern of tremors.
Collapse
Affiliation(s)
- Basilio Vescio
- Biotecnomed S.C.aR.L., Viale Europa, 88100 Catanzaro, Italy;
| | - Marida De Maria
- Neuroscience Research Center, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy; (M.D.M.); (M.C.); (R.N.); (C.C.); (F.A.); (A.Q.)
| | - Marianna Crasà
- Neuroscience Research Center, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy; (M.D.M.); (M.C.); (R.N.); (C.C.); (F.A.); (A.Q.)
| | - Rita Nisticò
- Neuroscience Research Center, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy; (M.D.M.); (M.C.); (R.N.); (C.C.); (F.A.); (A.Q.)
| | - Camilla Calomino
- Neuroscience Research Center, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy; (M.D.M.); (M.C.); (R.N.); (C.C.); (F.A.); (A.Q.)
| | - Federica Aracri
- Neuroscience Research Center, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy; (M.D.M.); (M.C.); (R.N.); (C.C.); (F.A.); (A.Q.)
| | - Aldo Quattrone
- Neuroscience Research Center, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy; (M.D.M.); (M.C.); (R.N.); (C.C.); (F.A.); (A.Q.)
| | - Andrea Quattrone
- Institute of Neurology, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy
| |
Collapse
|
7
|
Fujikawa J, Morigaki R, Yamamoto N, Nakanishi H, Oda T, Izumi Y, Takagi Y. Diagnosis and Treatment of Tremor in Parkinson's Disease Using Mechanical Devices. LIFE (BASEL, SWITZERLAND) 2022; 13:life13010078. [PMID: 36676025 PMCID: PMC9863142 DOI: 10.3390/life13010078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 12/09/2022] [Accepted: 12/23/2022] [Indexed: 12/29/2022]
Abstract
BACKGROUND Parkinsonian tremors are sometimes confused with essential tremors or other conditions. Recently, researchers conducted several studies on tremor evaluation using wearable sensors and devices, which may support accurate diagnosis. Mechanical devices are also commonly used to treat tremors and have been actively researched and developed. Here, we aimed to review recent progress and the efficacy of the devices related to Parkinsonian tremors. METHODS The PubMed and Scopus databases were searched for articles. We searched for "Parkinson disease" and "tremor" and "device". RESULTS Eighty-six articles were selected by our systematic approach. Many studies demonstrated that the diagnosis and evaluation of tremors in patients with PD can be done accurately by machine learning algorithms. Mechanical devices for tremor suppression include deep brain stimulation (DBS), electrical muscle stimulation, and orthosis. In recent years, adaptive DBS and optimization of stimulation parameters have been studied to further improve treatment efficacy. CONCLUSIONS Due to developments using state-of-the-art techniques, effectiveness in diagnosing and evaluating tremor and suppressing it using these devices is satisfactorily high in many studies. However, other than DBS, no devices are in practical use. To acquire high-level evidence, large-scale studies and randomized controlled trials are needed for these devices.
Collapse
Affiliation(s)
- Joji Fujikawa
- Department of Advanced Brain Research, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
| | - Ryoma Morigaki
- Department of Advanced Brain Research, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
- Department of Neurosurgery, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
- Parkinson’s Disease and Dystonia Research Center, Tokushima University Hospital, 2-50-1 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
- Correspondence: ; Tel.: +81-88-633-7149
| | - Nobuaki Yamamoto
- Department of Neurology, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
| | - Hiroshi Nakanishi
- Department of Neurosurgery, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
- Beauty Life Corporation, 2 Kiba-Cho, Minato-Ku, Nagoya 455-0021, Aichi, Japan
| | - Teruo Oda
- Department of Advanced Brain Research, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
| | - Yuishin Izumi
- Parkinson’s Disease and Dystonia Research Center, Tokushima University Hospital, 2-50-1 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
- Department of Neurology, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
| | - Yasushi Takagi
- Department of Advanced Brain Research, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
- Department of Neurosurgery, Institute of Biomedical Sciences, Graduate School of Medicine, Tokushima University, 3-18-15 Kuramoto-Cho, Tokushima-Shi 770-8503, Tokushima, Japan
| |
Collapse
|
8
|
Di Libero T, Langiano E, Carissimo C, Ferrara M, Diotaiuti P, Rodio A. Technological support for people with Parkinson’s disease: a narrative review. JOURNAL OF GERONTOLOGY AND GERIATRICS 2022. [DOI: 10.36150/2499-6564-n523] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
9
|
Junaid SB, Imam AA, Balogun AO, De Silva LC, Surakat YA, Kumar G, Abdulkarim M, Shuaibu AN, Garba A, Sahalu Y, Mohammed A, Mohammed TY, Abdulkadir BA, Abba AA, Kakumi NAI, Mahamad S. Recent Advancements in Emerging Technologies for Healthcare Management Systems: A Survey. Healthcare (Basel) 2022; 10:healthcare10101940. [PMID: 36292387 PMCID: PMC9601636 DOI: 10.3390/healthcare10101940] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 09/26/2022] [Accepted: 09/28/2022] [Indexed: 11/16/2022] Open
Abstract
In recent times, the growth of the Internet of Things (IoT), artificial intelligence (AI), and Blockchain technologies have quickly gained pace as a new study niche in numerous collegiate and industrial sectors, notably in the healthcare sector. Recent advancements in healthcare delivery have given many patients access to advanced personalized healthcare, which has improved their well-being. The subsequent phase in healthcare is to seamlessly consolidate these emerging technologies such as IoT-assisted wearable sensor devices, AI, and Blockchain collectively. Surprisingly, owing to the rapid use of smart wearable sensors, IoT and AI-enabled technology are shifting healthcare from a conventional hub-based system to a more personalized healthcare management system (HMS). However, implementing smart sensors, advanced IoT, AI, and Blockchain technologies synchronously in HMS remains a significant challenge. Prominent and reoccurring issues such as scarcity of cost-effective and accurate smart medical sensors, unstandardized IoT system architectures, heterogeneity of connected wearable devices, the multidimensionality of data generated, and high demand for interoperability are vivid problems affecting the advancement of HMS. Hence, this survey paper presents a detailed evaluation of the application of these emerging technologies (Smart Sensor, IoT, AI, Blockchain) in HMS to better understand the progress thus far. Specifically, current studies and findings on the deployment of these emerging technologies in healthcare are investigated, as well as key enabling factors, noteworthy use cases, and successful deployments. This survey also examined essential issues that are frequently encountered by IoT-assisted wearable sensor systems, AI, and Blockchain, as well as the critical concerns that must be addressed to enhance the application of these emerging technologies in the HMS.
Collapse
Affiliation(s)
| | - Abdullahi Abubakar Imam
- School of Digital Science, Universiti Brunei Darussalam, Brunei Darussalam, Jalan Tungku Link, Gadong BE1410, Brunei
- Correspondence: (A.A.I.); or (A.O.B.)
| | - Abdullateef Oluwagbemiga Balogun
- Department of Computer Science, University of Ilorin, Ilorin 1515, Nigeria
- Department of Computer and Information Science, Universiti Teknologi PETRONAS, Sri Iskandar 32610, Malaysia
- Correspondence: (A.A.I.); or (A.O.B.)
| | | | | | - Ganesh Kumar
- Department of Computer and Information Science, Universiti Teknologi PETRONAS, Sri Iskandar 32610, Malaysia
| | - Muhammad Abdulkarim
- Department of Computer Science, Ahmadu Bello University, Zaria 810211, Nigeria
| | - Aliyu Nuhu Shuaibu
- Department of Electrical Engineering, University of Jos, Bauchi Road, Jos 930105, Nigeria
| | - Aliyu Garba
- Department of Computer Science, Ahmadu Bello University, Zaria 810211, Nigeria
| | - Yusra Sahalu
- SEHA Abu Dhabi Health Services Co., Abu Dhabi 109090, United Arab Emirates
| | - Abdullahi Mohammed
- Department of Computer Science, Ahmadu Bello University, Zaria 810211, Nigeria
| | | | | | | | - Nana Aliyu Iliyasu Kakumi
- Patient Care Department, General Ward, Saudi German Hospital Cairo, Taha Hussein Rd, Huckstep, El Nozha, Cairo Governorate 4473303, Egypt
| | - Saipunidzam Mahamad
- Department of Computer and Information Science, Universiti Teknologi PETRONAS, Sri Iskandar 32610, Malaysia
| |
Collapse
|
10
|
Xu Z, Shen B, Tang Y, Wu J, Wang J. Deep Clinical Phenotyping of Parkinson's Disease: Towards a New Era of Research and Clinical Care. PHENOMICS (CHAM, SWITZERLAND) 2022; 2:349-361. [PMID: 36939759 PMCID: PMC9590510 DOI: 10.1007/s43657-022-00051-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Revised: 03/12/2022] [Accepted: 03/28/2022] [Indexed: 11/27/2022]
Abstract
Despite recent advances in technology, clinical phenotyping of Parkinson's disease (PD) has remained relatively limited as current assessments are mainly based on empirical observation and subjective categorical judgment at the clinic. A lack of comprehensive, objective, and quantifiable clinical phenotyping data has hindered our capacity to diagnose, assess patients' conditions, discover pathogenesis, identify preclinical stages and clinical subtypes, and evaluate new therapies. Therefore, deep clinical phenotyping of PD patients is a necessary step towards understanding PD pathology and improving clinical care. In this review, we present a growing community consensus and perspective on how to clinically phenotype this disease, that is, to phenotype the entire course of disease progression by integrating capacity, performance, and perception approaches with state-of-the-art technology. We also explore the most studied aspects of PD deep clinical phenotypes, namely, bradykinesia, tremor, dyskinesia and motor fluctuation, gait impairment, speech impairment, and non-motor phenotypes.
Collapse
Affiliation(s)
- Zhiheng Xu
- Department of Neurology and National Research Center for Aging and Medicine & National Center for Neurological Disorders, State Key Laboratory of Medical Neurobiology, Huashan Hospital, Fudan University, Shanghai, 200040 China
| | - Bo Shen
- Department of Neurology and National Research Center for Aging and Medicine & National Center for Neurological Disorders, State Key Laboratory of Medical Neurobiology, Huashan Hospital, Fudan University, Shanghai, 200040 China
| | - Yilin Tang
- Department of Neurology and National Research Center for Aging and Medicine & National Center for Neurological Disorders, State Key Laboratory of Medical Neurobiology, Huashan Hospital, Fudan University, Shanghai, 200040 China
| | - Jianjun Wu
- Department of Neurology and National Research Center for Aging and Medicine & National Center for Neurological Disorders, State Key Laboratory of Medical Neurobiology, Huashan Hospital, Fudan University, Shanghai, 200040 China
| | - Jian Wang
- Department of Neurology and National Research Center for Aging and Medicine & National Center for Neurological Disorders, State Key Laboratory of Medical Neurobiology, Huashan Hospital, Fudan University, Shanghai, 200040 China
| |
Collapse
|
11
|
Endo M, Poston KL, Sullivan EV, Fei-Fei L, Pohl KM, Adeli E. GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2022; 13438:130-139. [PMID: 36342887 PMCID: PMC9635991 DOI: 10.1007/978-3-031-16452-1_13] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Parkinson's disease (PD) is a neurological disorder that has a variety of observable motor-related symptoms such as slow movement, tremor, muscular rigidity, and impaired posture. PD is typically diagnosed by evaluating the severity of motor impairments according to scoring systems such as the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS). Automated severity prediction using video recordings of individuals provides a promising route for non-intrusive monitoring of motor impairments. However, the limited size of PD gait data hinders model ability and clinical potential. Because of this clinical data scarcity and inspired by the recent advances in self-supervised large-scale language models like GPT-3, we use human motion forecasting as an effective self-supervised pre-training task for the estimation of motor impairment severity. We introduce GaitForeMer, Gait Forecasting and impairment estimation transforMer, which is first pre-trained on public datasets to forecast gait movements and then applied to clinical data to predict MDS-UPDRS gait impairment severity. Our method outperforms previous approaches that rely solely on clinical data by a large margin, achieving an F1 score of 0.76, precision of 0.79, and recall of 0.75. Using GaitForeMer, we show how public human movement data repositories can assist clinical use cases through learning universal motion representations. The code is available at https://github.com/markendo/GaitForeMer.
Collapse
Affiliation(s)
- Mark Endo
- Stanford University, Stanford, CA 94305, USA
| | | | | | - Li Fei-Fei
- Stanford University, Stanford, CA 94305, USA
| | - Kilian M Pohl
- Stanford University, Stanford, CA 94305, USA
- SRI International, Menlo Park, CA 94025, USA
| | - Ehsan Adeli
- Stanford University, Stanford, CA 94305, USA
| |
Collapse
|
12
|
Carissimo C, Cerro G, Ferrigno L, Golluccio G, Marino A. Development and Assessment of a Movement Disorder Simulator Based on Inertial Data. SENSORS (BASEL, SWITZERLAND) 2022; 22:6341. [PMID: 36080798 PMCID: PMC9460515 DOI: 10.3390/s22176341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 08/12/2022] [Accepted: 08/19/2022] [Indexed: 06/15/2023]
Abstract
The detection analysis of neurodegenerative diseases by means of low-cost sensors and suitable classification algorithms is a key part of the widely spreading telemedicine techniques. The choice of suitable sensors and the tuning of analysis algorithms require a large amount of data, which could be derived from a large experimental measurement campaign involving voluntary patients. This process requires a prior approval phase for the processing and the use of sensitive data in order to respect patient privacy and ethical aspects. To obtain clearance from an ethics committee, it is necessary to submit a protocol describing tests and wait for approval, which can take place after a typical period of six months. An alternative consists of structuring, implementing, validating, and adopting a software simulator at most for the initial stage of the research. To this end, the paper proposes the development, validation, and usage of a software simulator able to generate movement disorders-related data, for both healthy and pathological conditions, based on raw inertial measurement data, and give tri-axial acceleration and angular velocity as output. To present a possible operating scenario of the developed software, this work focuses on a specific case study, i.e., the Parkinson's disease-related tremor, one of the main disorders of the homonym pathology. The full framework is reported, from raw data availability to pathological data generation, along with a common machine learning method implementation to evaluate data suitability to be distinguished and classified. Due to the development of a flexible and easy-to-use simulator, the paper also analyses and discusses the data quality, described with typical measurement features, as a metric to allow accurate classification under a low-performance sensing device. The simulator's validation results show a correlation coefficient greater than 0.94 for angular velocity and 0.93 regarding acceleration data. Classification performance on Parkinson's disease tremor was greater than 98% in the best test conditions.
Collapse
Affiliation(s)
- Chiara Carissimo
- Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Gianni Cerro
- Department of Medicine and Health Sciences “Vincenzo Tiberio”, University of Molise, 86100 Campobasso, Italy
| | - Luigi Ferrigno
- Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Giacomo Golluccio
- Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Alessandro Marino
- Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| |
Collapse
|
13
|
Ellis R, Kelly P, Huang C, Pearlmutter A, Izmailova ES. Sensor Verification and Analytical Validation of Algorithms to Measure Gait and Balance and Pronation/Supination in Healthy Volunteers. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22166275. [PMID: 36016036 PMCID: PMC9412295 DOI: 10.3390/s22166275] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 08/11/2022] [Accepted: 08/15/2022] [Indexed: 05/25/2023]
Abstract
Numerous studies have sought to demonstrate the utility of digital measures of motor function in Parkinson’s disease. Frameworks, such as V3, document digital measure development: technical verification, analytical and clinical validation. We present the results of a study to (1) technically verify accelerometers in an Apple iPhone 8 Plus and ActiGraph GT9X versus an oscillating table and (2) analytically validate software tasks for walking and pronation/supination on the iPhone plus passively detect walking measures with the ActiGraph in healthy volunteers versus human raters. In technical verification, 99.4% of iPhone and 91% of ActiGraph tests show good or excellent agreement versus the oscillating table as the gold standard. For the iPhone software task and algorithms, intraclass correlation coefficients (ICCs) > 0.75 are achieved versus the human raters for measures when walking distance is >10 s and pronation/supination when the arm is rotated more than two times. Passively detected walking start and end time was accurate to approx. 1 s and walking measures were accurate to one unit, e.g., one step. The results suggest that the Apple iPhone and ActiGraph GT9X accelerometers are fit for purpose and that task and passively collected measures are sufficiently analytically valid to assess usability and clinical validity in Parkinson’s patients.
Collapse
|
14
|
Computational Methods for Physiological Signal Processing and Data Analysis. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:9861801. [PMID: 35991128 PMCID: PMC9385367 DOI: 10.1155/2022/9861801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 06/30/2022] [Indexed: 11/22/2022]
Abstract
Biomedical signal processing and data analysis play pivotal roles in the advanced medical expert system solutions. Signal processing tools are able to diminish the potential artifact effects and improve the anticipative signal quality. Data analysis techniques can assist in reducing redundant data dimensions and extracting dominant features associated with pathological status. Recent computational methods have greatly improved the effectiveness of signal processing and data analysis, to support the efficient point-of-care diagnosis and accurate medical decision-making. This editorial article highlights the research works published in the special issue of Computational Methods for Physiological Signal Processing and Data Analysis. The context introduces three deep learning applications in epileptic seizure detection, human exercise intensity analysis, and lung nodule CT image segmentation, respectively. The article also summarizes the research works on detection of event-related potential in the single-trial electroencephalogram (EEG) signals during the auditory tests, along with the methodology on estimating the generalized exponential distribution parameters using the simulated and real data produced under the Type I generalized progressive hybrid censoring schemes. The article concludes with perspectives and discussions on future trends in biomedical signal processing and data analysis technologies.
Collapse
|
15
|
Bo F, Yerebakan M, Dai Y, Wang W, Li J, Hu B, Gao S. IMU-Based Monitoring for Assistive Diagnosis and Management of IoHT: A Review. Healthcare (Basel) 2022; 10:healthcare10071210. [PMID: 35885736 PMCID: PMC9318359 DOI: 10.3390/healthcare10071210] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 06/20/2022] [Accepted: 06/23/2022] [Indexed: 01/22/2023] Open
Abstract
With the rapid development of Internet of Things (IoT) technologies, traditional disease diagnoses carried out in medical institutions can now be performed remotely at home or even ambient environments, yielding the concept of the Internet of Health Things (IoHT). Among the diverse IoHT applications, inertial measurement unit (IMU)-based systems play a significant role in the detection of diseases in many fields, such as neurological, musculoskeletal, and mental. However, traditional numerical interpretation methods have proven to be challenging to provide satisfying detection accuracies owing to the low quality of raw data, especially under strong electromagnetic interference (EMI). To address this issue, in recent years, machine learning (ML)-based techniques have been proposed to smartly map IMU-captured data on disease detection and progress. After a decade of development, the combination of IMUs and ML algorithms for assistive disease diagnosis has become a hot topic, with an increasing number of studies reported yearly. A systematic search was conducted in four databases covering the aforementioned topic for articles published in the past six years. Eighty-one articles were included and discussed concerning two aspects: different ML techniques and application scenarios. This review yielded the conclusion that, with the help of ML technology, IMUs can serve as a crucial element in disease diagnosis, severity assessment, characteristic estimation, and monitoring during the rehabilitation process. Furthermore, it summarizes the state-of-the-art, analyzes challenges, and provides foreseeable future trends for developing IMU-ML systems for IoHT.
Collapse
Affiliation(s)
- Fan Bo
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Mustafa Yerebakan
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL 32611, USA;
| | - Yanning Dai
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China;
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing 100191, China
| | - Weibing Wang
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jia Li
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
- Correspondence: (J.L.); (B.H.); (S.G.)
| | - Boyi Hu
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL 32611, USA;
- Correspondence: (J.L.); (B.H.); (S.G.)
| | - Shuo Gao
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China;
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing 100191, China
- Correspondence: (J.L.); (B.H.); (S.G.)
| |
Collapse
|
16
|
Khwaounjoo P, Singh G, Grenfell S, Özsoy B, MacAskill MR, Anderson TJ, Çakmak YO. Non-Contact Hand Movement Analysis for Optimal Configuration of Smart Sensors to Capture Parkinson's Disease Hand Tremor. SENSORS 2022; 22:s22124613. [PMID: 35746395 PMCID: PMC9230824 DOI: 10.3390/s22124613] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Revised: 06/09/2022] [Accepted: 06/10/2022] [Indexed: 02/01/2023]
Abstract
Parkinson’s disease affects millions worldwide with a large rise in expected burden over the coming decades. More easily accessible tools and techniques to diagnose and monitor Parkinson’s disease can improve the quality of life of patients. With the advent of new wearable technologies such as smart rings and watches, this is within reach. However, it is unclear what method for these new technologies may provide the best opportunity to capture the patient-specific severity. This study investigates which locations on the hand can be used to capture and monitor maximal movement/tremor severity. Using a Leap Motion device and custom-made software the volume, velocity, acceleration, and frequency of Parkinson’s (n = 55, all right-handed, majority right-sided onset) patients’ hand locations (25 joints inclusive of all fingers/thumb and the wrist) were captured simultaneously. Distal locations of the right hand, i.e., the ends of fingers and the wrist showed significant trends (p < 0.05) towards having the largest movement velocities and accelerations. The right hand, compared with the left hand, showed significantly greater volumes, velocities, and accelerations (p < 0.01). Supplementary analysis showed that the volumes, acceleration, and velocities had significant correlations (p < 0.001) with clinical MDS-UPDRS scores, indicating the potential suitability of using these metrics for monitoring disease progression. Maximal movements at the distal hand and wrist area indicate that these locations are best suited to capture hand tremor movements and monitor Parkinson’s disease.
Collapse
Affiliation(s)
- Prashanna Khwaounjoo
- Department of Anatomy, School of Biomedical Sciences, University of Otago, Dunedin 9016, New Zealand; (P.K.); (G.S.)
- Medical Technologies Centre of Research Excellence, Auckland 1142, New Zealand
| | - Gurleen Singh
- Department of Anatomy, School of Biomedical Sciences, University of Otago, Dunedin 9016, New Zealand; (P.K.); (G.S.)
| | - Sophie Grenfell
- New Zealand Brain Research Institute, Christchurch 8011, New Zealand; (S.G.); (M.R.M.); (T.J.A.)
| | - Burak Özsoy
- Global Dynamic Systems (GDS) ARGE, Teknopark Istanbul, Istanbul 34906, Turkey;
| | - Michael R. MacAskill
- New Zealand Brain Research Institute, Christchurch 8011, New Zealand; (S.G.); (M.R.M.); (T.J.A.)
- Department of Medicine, University of Otago, Christchurch 8140, New Zealand
| | - Tim J. Anderson
- New Zealand Brain Research Institute, Christchurch 8011, New Zealand; (S.G.); (M.R.M.); (T.J.A.)
- Department of Medicine, University of Otago, Christchurch 8140, New Zealand
| | - Yusuf O. Çakmak
- Department of Anatomy, School of Biomedical Sciences, University of Otago, Dunedin 9016, New Zealand; (P.K.); (G.S.)
- Medical Technologies Centre of Research Excellence, Auckland 1142, New Zealand
- Centre for Health Systems and Technology, Dunedin 9054, New Zealand
- Brain Health Research Centre, Dunedin 9054, New Zealand
- Centre for Bioengineering and Nanotechnology, University of Otago, Dunedin 9054, New Zealand
- Correspondence:
| |
Collapse
|
17
|
Ma C, Zhang P, Wang J, Zhang J, Pan L, Li X, Yin C, Li A, Zong R, Zhang Z. Objective quantification of the severity of postural tremor based on kinematic parameters: A multi-sensory fusion study. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 219:106741. [PMID: 35338882 DOI: 10.1016/j.cmpb.2022.106741] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 02/27/2022] [Accepted: 03/08/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Current clinical assessments of essential tremor (ET) are primarily based on expert consultation combined with reviewing patient complaints, physician expertise, and diagnostic experience. Thus, traditional evaluation methods often lead to biased diagnostic results. There is a clinical demand for a method that can objectively quantify the severity of the patient's disease. METHODS This study aims to develop an artificial intelligence-aided diagnosis method based on multi-sensory fusion wearables. The experiment relies on a rigorous clinical trial paradigm to collect multi-modal fusion of signals from 98 ET patients. At the same time, three clinicians scored independently, and the consensus score obtained was used as the ground truth for the machine learning models. RESULTS Sixty kinematic parameters were extracted from the signals recorded by the nine-axis inertial measurement unit (IMU). The results showed that most of the features obtained by IMU could effectively characterize the severity of the tremors. The accuracy of the optimal model for three tasks classifying five severity levels was 97.71%, 97.54%, and 97.72%, respectively. CONCLUSIONS This paper reports the first attempt to combine multiple feature selection and machine learning algorithms for fine-grained automatic quantification of postural tremor in ET patients. The promising results showed the potential of the proposed approach to quantify the severity of ET objectively.
Collapse
Affiliation(s)
- Chenbin Ma
- Center for Artificial Intelligence in Medicine, Medical Innovation Research Department, PLA General Hospital, 100853, Beijing, China; Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, 100191, Beijing, China; School of Biological Science and Medical Engineering, Beihang University, 100191, Beijing, China; Shenyuan Honors College, Beihang University, 100191, Beijing, China
| | - Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, 100191, Beijing, China; School of Biological Science and Medical Engineering, Beihang University, 100191, Beijing, China
| | - Jiachen Wang
- Medical School of Chinese PLA, 100853, Beijing, China
| | - Jian Zhang
- Medical School of Chinese PLA, 100853, Beijing, China
| | - Longsheng Pan
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
| | - Xuemei Li
- Clinics of Cadre, Department of Outpatient, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
| | - Chunyu Yin
- Clinics of Cadre, Department of Outpatient, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
| | - Ailing Li
- Pusheng Yixin (Beijing) Hospital Management Co., Ltd, 100020, Beijing, China
| | - Rui Zong
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China.
| | - Zhengbo Zhang
- Center for Artificial Intelligence in Medicine, Medical Innovation Research Department, PLA General Hospital, 100853, Beijing, China.
| |
Collapse
|
18
|
Smid A, Elting JWJ, van Dijk JMC, Otten B, Oterdoom DLM, Tamasi K, Heida T, van Laar T, Drost G. Intraoperative Quantification of MDS-UPDRS Tremor Measurements Using 3D Accelerometry: A Pilot Study. J Clin Med 2022; 11:jcm11092275. [PMID: 35566401 PMCID: PMC9104023 DOI: 10.3390/jcm11092275] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Revised: 04/10/2022] [Accepted: 04/16/2022] [Indexed: 02/05/2023] Open
Abstract
The most frequently used method for evaluating tremor in Parkinson’s disease (PD) is currently the internationally standardized Movement Disorder Society—Unified PD Rating Scale (MDS-UPDRS). However, the MDS-UPDRS is associated with limitations, such as its inherent subjectivity and reliance on experienced raters. Objective motor measurements using accelerometry may overcome the shortcomings of visually scored scales. Therefore, the current study focuses on translating the MDS-UPDRS tremor tests into an objective scoring method using 3D accelerometry. An algorithm to measure and classify tremor according to MDS-UPDRS criteria is proposed. For this study, 28 PD patients undergoing neurosurgical treatment and 26 healthy control subjects were included. Both groups underwent MDS-UPDRS tests to rate tremor severity, while accelerometric measurements were performed at the index fingers. All measurements were performed in an off-medication state. Quantitative measures were calculated from the 3D acceleration data, such as tremor amplitude and area-under-the-curve of power in the 4−6 Hz range. Agreement between MDS-UPDRS tremor scores and objective accelerometric scores was investigated. The trends were consistent with the logarithmic relationship between tremor amplitude and MDS-UPDRS score reported in previous studies. The accelerometric scores showed a substantial concordance (>69.6%) with the MDS-UPDRS ratings. However, accelerometric kinetic tremor measures poorly associated with the given MDS-UPDRS scores (R2 < 0.3), mainly due to the noise between 4 and 6 Hz found in the healthy controls. This study shows that MDS-UDPRS tremor tests can be translated to objective accelerometric measurements. However, discrepancies were found between accelerometric kinetic tremor measures and MDS-UDPRS ratings. This technology has the potential to reduce rater dependency of MDS-UPDRS measurements and allow more objective intraoperative monitoring of tremor.
Collapse
Affiliation(s)
- Annemarie Smid
- Department of Neurosurgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (J.M.C.v.D.); (D.L.M.O.); (K.T.); (G.D.)
- Correspondence:
| | - Jan Willem J. Elting
- Department of Neurology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (J.W.J.E.); (T.v.L.)
- Expertise Center Movement Disorders Groningen, University Medical Center Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - J. Marc C. van Dijk
- Department of Neurosurgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (J.M.C.v.D.); (D.L.M.O.); (K.T.); (G.D.)
| | - Bert Otten
- Center for Human Movement Sciences, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
| | - D. L. Marinus Oterdoom
- Department of Neurosurgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (J.M.C.v.D.); (D.L.M.O.); (K.T.); (G.D.)
| | - Katalin Tamasi
- Department of Neurosurgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (J.M.C.v.D.); (D.L.M.O.); (K.T.); (G.D.)
- Department of Epidemiology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Tjitske Heida
- Department of Biomedical Signals and Systems, Faculty EEMCS, TechMed Centre, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands;
| | - Teus van Laar
- Department of Neurology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (J.W.J.E.); (T.v.L.)
- Expertise Center Movement Disorders Groningen, University Medical Center Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Gea Drost
- Department of Neurosurgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (J.M.C.v.D.); (D.L.M.O.); (K.T.); (G.D.)
- Department of Neurology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (J.W.J.E.); (T.v.L.)
| |
Collapse
|
19
|
Xing X, Luo N, Li S, Zhou L, Song C, Liu J. Identification and Classification of Parkinsonian and Essential Tremors for Diagnosis Using Machine Learning Algorithms. Front Neurosci 2022; 16:701632. [PMID: 35386595 PMCID: PMC8978337 DOI: 10.3389/fnins.2022.701632] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Accepted: 03/02/2022] [Indexed: 11/23/2022] Open
Abstract
Due to overlapping tremor features, the medical diagnosis of Parkinson’s disease (PD) and essential tremor (ET) mainly relies on the clinical experience of doctors, which often leads to misdiagnosis. Seven predictive models using machine learning algorithms including random forest (RF), eXtreme Gradient Boosting (XGBoost), support vector machine (SVM), logistic regression (LR), ridge classification (Ridge), backpropagation neural network (BP), and convolutional neural network (CNN) were evaluated and compared aiming to better differentiate between PD and ET by using accessible demographics and tremor information of the upper limbs. The tremor information including tremor acceleration and surface electromyogram (sEMG) signals were collected from 398 patients (PD = 257, ET = 141) and then were used to train the established models to separate PD and ET. The performance of the models was evaluated by indices of accuracy and area under the curve (AUC), which indicated the ensemble learning models including RF and XGBoost showed the best overall predictive ability with accuracy above 0.84 and AUC above 0.90. Furthermore, the relative importance of sex, age, four postures, and five tremor features was analyzed and ranked showing that the dominant frequency of sEMG of flexors, the average amplitude of sEMG of flexors, resting posture, and winging posture had a greater impact on the diagnosis of PD, whereas sex and age were less important. These results provide a reference for the intelligent diagnosis of PD and show promise for use in wearable tremor suppression devices.
Collapse
Affiliation(s)
- Xupo Xing
- Shanghai Institute for Minimally Invasive Therapy, School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Ningdi Luo
- Department of Neurology and Institute of Neurology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shun Li
- Shanghai Institute for Minimally Invasive Therapy, School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Liche Zhou
- Department of Neurology and Institute of Neurology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Chengli Song
- Shanghai Institute for Minimally Invasive Therapy, School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
- *Correspondence: Chengli Song,
| | - Jun Liu
- Department of Neurology and Institute of Neurology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- *Correspondence: Chengli Song,
| |
Collapse
|
20
|
Chandrabhatla AS, Pomeraniec IJ, Ksendzovsky A. Co-evolution of machine learning and digital technologies to improve monitoring of Parkinson's disease motor symptoms. NPJ Digit Med 2022; 5:32. [PMID: 35304579 PMCID: PMC8933519 DOI: 10.1038/s41746-022-00568-y] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Accepted: 01/21/2022] [Indexed: 11/09/2022] Open
Abstract
Parkinson’s disease (PD) is a neurodegenerative disorder characterized by motor impairments such as tremor, bradykinesia, dyskinesia, and gait abnormalities. Current protocols assess PD symptoms during clinic visits and can be subjective. Patient diaries can help clinicians evaluate at-home symptoms, but can be incomplete or inaccurate. Therefore, researchers have developed in-home automated methods to monitor PD symptoms to enable data-driven PD diagnosis and management. We queried the US National Library of Medicine PubMed database to analyze the progression of the technologies and computational/machine learning methods used to monitor common motor PD symptoms. A sub-set of roughly 12,000 papers was reviewed that best characterized the machine learning and technology timelines that manifested from reviewing the literature. The technology used to monitor PD motor symptoms has advanced significantly in the past five decades. Early monitoring began with in-lab devices such as needle-based EMG, transitioned to in-lab accelerometers/gyroscopes, then to wearable accelerometers/gyroscopes, and finally to phone and mobile & web application-based in-home monitoring. Significant progress has also been made with respect to the use of machine learning algorithms to classify PD patients. Using data from different devices (e.g., video cameras, phone-based accelerometers), researchers have designed neural network and non-neural network-based machine learning algorithms to categorize PD patients across tremor, gait, bradykinesia, and dyskinesia. The five-decade co-evolution of technology and computational techniques used to monitor PD motor symptoms has driven significant progress that is enabling the shift from in-lab/clinic to in-home monitoring of PD symptoms.
Collapse
Affiliation(s)
- Anirudha S Chandrabhatla
- School of Medicine, University of Virginia Health Sciences Center, Charlottesville, VA, 22903, USA
| | - I Jonathan Pomeraniec
- Surgical Neurology Branch, National Institutes of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, 20892, USA. .,Department of Neurosurgery, University of Virginia Health Sciences Center, Charlottesville, VA, 22903, USA.
| | - Alexander Ksendzovsky
- Department of Neurosurgery, University of Maryland Medical System, Baltimore, MD, 21201, USA
| |
Collapse
|
21
|
Gopal A, Hsu WY, Allen DD, Bove R. Remote Assessments of Hand Function in Neurological Disorders: Systematic Review. JMIR Rehabil Assist Technol 2022; 9:e33157. [PMID: 35262502 PMCID: PMC8943610 DOI: 10.2196/33157] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Revised: 01/17/2022] [Accepted: 01/26/2022] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Loss of fine motor skills is observed in many neurological diseases, and remote monitoring assessments can aid in early diagnosis and intervention. Hand function can be regularly assessed to monitor loss of fine motor skills in people with central nervous system disorders; however, there are challenges to in-clinic assessments. Remotely assessing hand function could facilitate monitoring and supporting of early diagnosis and intervention when warranted. OBJECTIVE Remote assessments can facilitate the tracking of limitations, aiding in early diagnosis and intervention. This study aims to systematically review existing evidence regarding the remote assessment of hand function in populations with chronic neurological dysfunction. METHODS PubMed and MEDLINE, CINAHL, Web of Science, and Embase were searched for studies that reported remote assessment of hand function (ie, outside of traditional in-person clinical settings) in adults with chronic central nervous system disorders. We excluded studies that included participants with orthopedic upper limb dysfunction or used tools for intervention and treatment. We extracted data on the evaluated hand function domains, validity and reliability, feasibility, and stage of development. RESULTS In total, 74 studies met the inclusion criteria for Parkinson disease (n=57, 77% studies), stroke (n=9, 12%), multiple sclerosis (n=6, 8%), spinal cord injury (n=1, 1%), and amyotrophic lateral sclerosis (n=1, 1%). Three assessment modalities were identified: external device (eg, wrist-worn accelerometer), smartphone or tablet, and telerehabilitation. The feasibility and overall participant acceptability were high. The most common hand function domains assessed included finger tapping speed (fine motor control and rigidity), hand tremor (pharmacological and rehabilitation efficacy), and finger dexterity (manipulation of small objects required for daily tasks) and handwriting (coordination). Although validity and reliability data were heterogeneous across studies, statistically significant correlations with traditional in-clinic metrics were most commonly reported for telerehabilitation and smartphone or tablet apps. The most readily implementable assessments were smartphone or tablet-based. CONCLUSIONS The findings show that remote assessment of hand function is feasible in neurological disorders. Although varied, the assessments allow clinicians to objectively record performance in multiple hand function domains, improving the reliability of traditional in-clinic assessments. Remote assessments, particularly via telerehabilitation and smartphone- or tablet-based apps that align with in-clinic metrics, facilitate clinic to home transitions, have few barriers to implementation, and prompt remote identification and treatment of hand function impairments.
Collapse
Affiliation(s)
- Arpita Gopal
- Weill Institute of Neurosciences, University of California San Francisco, San Francisco, CA, United States
| | - Wan-Yu Hsu
- Weill Institute of Neurosciences, University of California San Francisco, San Francisco, CA, United States
| | - Diane D Allen
- Department of Physical Therapy and Rehabilitation Science, University of California San Francisco/San Francisco State University, San Francisco, CA, United States
| | - Riley Bove
- Weill Institute of Neurosciences, University of California San Francisco, San Francisco, CA, United States
| |
Collapse
|
22
|
Perju-Dumbrava L, Barsan M, Leucuta DC, Popa LC, Pop C, Tohanean N, Popa SL. Artificial intelligence applications and robotic systems in Parkinson's disease (Review). Exp Ther Med 2022; 23:153. [PMID: 35069834 PMCID: PMC8753978 DOI: 10.3892/etm.2021.11076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Accepted: 10/05/2021] [Indexed: 11/11/2022] Open
Abstract
Parkinson's disease (PD) is the second most frequent neurodegenerative disorder following Alzheimer's disease. Advanced stages of PD, 4 or 5 of the Hoehn and Yahr Scale, are characterized by severe motor complications, limited mobility without assistance, risk of falling, and non-motor complications. The aim of this review was to provide a practical overview on specific artificial intelligence (AI) systems for the management of advanced stages of PD, as well as relevant technological limitations. The authors conducted a systematic search on PubMed and EMBASE with predefined keywords searching for studies published until December 2020. Full articles that satisfied the inclusion criteria were included in the systematic review. To minimize results bias, the reference list was manually searched for pertinent articles to identify any additional relevant missed publications. Exclusion criteria included the following: Other stages of PD than 4 and 5 of the Hoehn and Yahr Scale, case reports, reviews, practice guidelines, commentaries, opinions, letters, editorials, short surveys, articles in press, conference abstracts, conference papers, and abstracts published without a full article. The search identified 21 studies analyzing AI-based applications and robotic systems used for the management of advanced stages of PD, out of which 6 articles analyzed AI-based applications for autonomous management of pharmacologic therapy, 5 articles analyzed home-based telemedicine systems and 10 articles analysed robot-assisted gait training systems. The authors identified significant evidence demonstrating that current AI-based technologies are feasible for automatic management of patients with advanced stages of PD. Improving the quality of care and reducing the cost for patients and healthcare systems are the most important advantages.
Collapse
Affiliation(s)
- Lacramioara Perju-Dumbrava
- Department of Neurology, ‘Iuliu Hațieganu’ University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania
| | - Maria Barsan
- Department of Occupational Health, ‘Iuliu Hațieganu’ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Daniel Corneliu Leucuta
- Department of Medical Informatics and Biostatistics, ‘Iuliu Hațieganu’ University of Medicine and Pharmacy, 400349 Cluj-Napoca, Romania
| | - Luminita C. Popa
- Department of Neurology, ‘Iuliu Hațieganu’ University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania
| | - Cristina Pop
- Department of Pharmacology, Physiology and Pathophysiology, Faculty of Pharmacy, ‘Iuliu Hațieganu’ University of Medicine and Pharmacy, 400349 Cluj-Napoca, Romania
| | - Nicoleta Tohanean
- Department of Neurology, ‘Iuliu Hațieganu’ University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania
| | - Stefan L. Popa
- Second Medical Department, ‘Iuliu Hațieganu’ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| |
Collapse
|
23
|
Page A, Yung N, Auinger P, Venuto C, Glidden A, Macklin E, Omberg L, Schwarzschild MA, Dorsey ER. A Smartphone Application as an Exploratory Endpoint in a Phase 3 Parkinson's Disease Clinical Trial: A Pilot Study. Digit Biomark 2022; 6:1-8. [PMID: 35224425 PMCID: PMC8832247 DOI: 10.1159/000521232] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Accepted: 11/30/2021] [Indexed: 02/16/2024] Open
Abstract
BACKGROUND Smartphones can generate objective measures of Parkinson's disease (PD) and supplement traditional in-person rating scales. However, smartphone use in clinical trials has been limited. OBJECTIVE This study aimed to determine the feasibility of introducing a smartphone research application into a PD clinical trial and to evaluate the resulting measures. METHODS A smartphone application was introduced part-way into a phase 3 randomized clinical trial of inosine. The application included finger tapping, gait, and cognition tests, and participants were asked to complete an assessment battery at home and in clinic alongside the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS). RESULTS Of 236 eligible participants in the parent study, 88 (37%) consented to participate, and 59 (27 randomized to inosine and 32 to placebo) completed a baseline smartphone assessment. These 59 participants collectively completed 1,292 batteries of assessments. The proportion of participants who completed at least one smartphone assessment was 61% at 3, 54% at 6, and 35% at 12 months. Finger tapping speed correlated weakly with the part III motor portion (r = -0.16, left hand; r = -0.04, right hand) and total (r = -0.14) MDS-UPDRS. Gait speed correlated better with the same measures (r = -0.25, part III motor; r = -0.34, total). Over 6 months, finger tapping speed, gait speed, and memory scores did not differ between those randomized to active drug or placebo. CONCLUSIONS Introducing a smartphone application midway into a phase 3 clinical trial was challenging. Measures of bradykinesia and gait speed correlated modestly with traditional outcomes and were consistent with the study's overall findings, which found no benefit of the active drug.
Collapse
Affiliation(s)
- Alex Page
- Center for Health + Technology, University of Rochester Medical Center, Rochester, New York, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, New York, USA
| | - Norman Yung
- Center for Health + Technology, University of Rochester Medical Center, Rochester, New York, USA
| | - Peggy Auinger
- Center for Health + Technology, University of Rochester Medical Center, Rochester, New York, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, New York, USA
| | - Charles Venuto
- Center for Health + Technology, University of Rochester Medical Center, Rochester, New York, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, New York, USA
| | - Alistair Glidden
- Center for Health + Technology, University of Rochester Medical Center, Rochester, New York, USA
| | - Eric Macklin
- Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts, USA
| | | | | | - E. Ray Dorsey
- Center for Health + Technology, University of Rochester Medical Center, Rochester, New York, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, New York, USA
| |
Collapse
|
24
|
Ma C, Li D, Pan L, Li X, Yin C, Li A, Zhang Z, Zong R. Quantitative assessment of essential tremor based on machine learning methods using wearable device. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103244] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
25
|
Nahavandi D, Alizadehsani R, Khosravi A, Acharya UR. Application of artificial intelligence in wearable devices: Opportunities and challenges. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 213:106541. [PMID: 34837860 DOI: 10.1016/j.cmpb.2021.106541] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 11/07/2021] [Accepted: 11/15/2021] [Indexed: 05/13/2023]
Abstract
BACKGROUND AND OBJECTIVES Wearable technologies have added completely new and fast emerging tools to the popular field of personal gadgets. Aside from being fashionable and equipped with advanced hardware technologies such as communication modules and networking, wearable devices have the potential to fuel artificial intelligence (AI) methods with a wide range of valuable data. METHODS Various AI techniques such as supervised, unsupervised, semi-supervised and reinforcement learning (RL) have already been used to carry out various tasks. This paper reviews the recent applications of wearables that have leveraged AI to achieve their objectives. RESULTS Particular example applications of supervised and unsupervised learning for medical diagnosis are reviewed. Moreover, examples combining the internet of things, wearables, and RL are reviewed. Application examples of wearables will be also presented for specific domains such as medical, industrial, and sport. Medical applications include fitness, movement disorder, mental health, etc. Industrial applications include employee performance improvement with the aid of wearables. Sport applications are all about providing better user experience during workout sessions or professional gameplays. CONCLUSION The most important challenges regarding design and development of wearable devices and the computation burden of using AI methods are presented. Finally, future challenges and opportunities for wearable devices are presented.
Collapse
Affiliation(s)
- Darius Nahavandi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Waurn Ponds, VIC 3216, Australia
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Waurn Ponds, VIC 3216, Australia
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Waurn Ponds, VIC 3216, Australia.
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore; Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taiwan
| |
Collapse
|
26
|
Adams JL, Dinesh K, Snyder CW, Xiong M, Tarolli CG, Sharma S, Dorsey ER, Sharma G. A real-world study of wearable sensors in Parkinson's disease. NPJ Parkinsons Dis 2021; 7:106. [PMID: 34845224 PMCID: PMC8629990 DOI: 10.1038/s41531-021-00248-w] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Accepted: 10/27/2021] [Indexed: 12/17/2022] Open
Abstract
Most wearable sensor studies in Parkinson's disease have been conducted in the clinic and thus may not be a true representation of everyday symptoms and symptom variation. Our goal was to measure activity, gait, and tremor using wearable sensors inside and outside the clinic. In this observational study, we assessed motor features using wearable sensors developed by MC10, Inc. Participants wore five sensors, one on each limb and on the trunk, during an in-person clinic visit and for two days thereafter. Using the accelerometer data from the sensors, activity states (lying, sitting, standing, walking) were determined and steps per day were also computed by aggregating over 2 s walking intervals. For non-walking periods, tremor durations were identified that had a characteristic frequency between 3 and 10 Hz. We analyzed data from 17 individuals with Parkinson's disease and 17 age-matched controls over an average 45.4 h of sensor wear. Individuals with Parkinson's walked significantly less (median [inter-quartile range]: 4980 [2835-7163] steps/day) than controls (7367 [5106-8928] steps/day; P = 0.04). Tremor was present for 1.6 [0.4-5.9] hours (median [range]) per day in most-affected hands (MDS-UPDRS 3.17a or 3.17b = 1-4) of individuals with Parkinson's, which was significantly higher than the 0.5 [0.3-2.3] hours per day in less-affected hands (MDS-UPDRS 3.17a or 3.17b = 0). These results, which require replication in larger cohorts, advance our understanding of the manifestations of Parkinson's in real-world settings.
Collapse
Affiliation(s)
- Jamie L Adams
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA.
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA.
| | - Karthik Dinesh
- Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY, USA
| | | | - Mulin Xiong
- Michigan State University College of Human Medicine, East Lansing, MI, USA
| | - Christopher G Tarolli
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
| | - Saloni Sharma
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
| | - E Ray Dorsey
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
| | - Gaurav Sharma
- Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY, USA
| |
Collapse
|
27
|
Lu M, Zhao Q, Poston KL, Sullivan EV, Pfefferbaum A, Shahid M, Katz M, Montaser-Kouhsari L, Schulman K, Milstein A, Niebles JC, Henderson VW, Fei-Fei L, Pohl KM, Adeli E. Quantifying Parkinson's disease motor severity under uncertainty using MDS-UPDRS videos. Med Image Anal 2021; 73:102179. [PMID: 34340101 PMCID: PMC8453121 DOI: 10.1016/j.media.2021.102179] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Revised: 06/28/2021] [Accepted: 07/13/2021] [Indexed: 11/15/2022]
Abstract
Parkinson's disease (PD) is a brain disorder that primarily affects motor function, leading to slow movement, tremor, and stiffness, as well as postural instability and difficulty with walking/balance. The severity of PD motor impairments is clinically assessed by part III of the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS), a universally-accepted rating scale. However, experts often disagree on the exact scoring of individuals. In the presence of label noise, training a machine learning model using only scores from a single rater may introduce bias, while training models with multiple noisy ratings is a challenging task due to the inter-rater variabilities. In this paper, we introduce an ordinal focal neural network to estimate the MDS-UPDRS scores from input videos, to leverage the ordinal nature of MDS-UPDRS scores and combat class imbalance. To handle multiple noisy labels per exam, the training of the network is regularized via rater confusion estimation (RCE), which encodes the rating habits and skills of raters via a confusion matrix. We apply our pipeline to estimate MDS-UPDRS test scores from their video recordings including gait (with multiple Raters, R=3) and finger tapping scores (single rater). On a sizable clinical dataset for the gait test (N=55), we obtained a classification accuracy of 72% with majority vote as ground-truth, and an accuracy of ∼84% of our model predicting at least one of the raters' scores. Our work demonstrates how computer-assisted technologies can be used to track patients and their motor impairments, even when there is uncertainty in the clinical ratings. The latest version of the code will be available at https://github.com/mlu355/PD-Motor-Severity-Estimation.
Collapse
Affiliation(s)
- Mandy Lu
- Department of Computer Science, Stanford University, Stanford CA 94305, USA
| | - Qingyu Zhao
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA
| | - Kathleen L Poston
- Department of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA
| | - Edith V Sullivan
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA
| | - Adolf Pfefferbaum
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA; Center for Health Sciences, SRI International, Menlo Park CA 94025, USA
| | - Marian Shahid
- Department of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA
| | - Maya Katz
- Department of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA
| | - Leila Montaser-Kouhsari
- Department of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA
| | - Kevin Schulman
- Department of Medicine, Stanford University, Stanford CA 94305, USA
| | - Arnold Milstein
- Department of Medicine, Stanford University, Stanford CA 94305, USA
| | | | - Victor W Henderson
- Department of Epidemiology & Population Health, Stanford University, Stanford CA 94305, USA; Department of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA
| | - Li Fei-Fei
- Department of Computer Science, Stanford University, Stanford CA 94305, USA
| | - Kilian M Pohl
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA; Center for Health Sciences, SRI International, Menlo Park CA 94025, USA
| | - Ehsan Adeli
- Department of Computer Science, Stanford University, Stanford CA 94305, USA; Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA.
| |
Collapse
|
28
|
Albuquerque P, Verlekar TT, Correia PL, Soares LD. A Spatiotemporal Deep Learning Approach for Automatic Pathological Gait Classification. SENSORS 2021; 21:s21186202. [PMID: 34577408 PMCID: PMC8473368 DOI: 10.3390/s21186202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Revised: 09/08/2021] [Accepted: 09/13/2021] [Indexed: 12/03/2022]
Abstract
Human motion analysis provides useful information for the diagnosis and recovery assessment of people suffering from pathologies, such as those affecting the way of walking, i.e., gait. With recent developments in deep learning, state-of-the-art performance can now be achieved using a single 2D-RGB-camera-based gait analysis system, offering an objective assessment of gait-related pathologies. Such systems provide a valuable complement/alternative to the current standard practice of subjective assessment. Most 2D-RGB-camera-based gait analysis approaches rely on compact gait representations, such as the gait energy image, which summarize the characteristics of a walking sequence into one single image. However, such compact representations do not fully capture the temporal information and dependencies between successive gait movements. This limitation is addressed by proposing a spatiotemporal deep learning approach that uses a selection of key frames to represent a gait cycle. Convolutional and recurrent deep neural networks were combined, processing each gait cycle as a collection of silhouette key frames, allowing the system to learn temporal patterns among the spatial features extracted at individual time instants. Trained with gait sequences from the GAIT-IT dataset, the proposed system is able to improve gait pathology classification accuracy, outperforming state-of-the-art solutions and achieving improved generalization on cross-dataset tests.
Collapse
Affiliation(s)
- Pedro Albuquerque
- Instituto de Telecomunicações, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais 1, 1049-001 Lisboa, Portugal; (P.A.); (P.L.C.)
| | - Tanmay Tulsidas Verlekar
- Department of CSIS and APPCAIR, BITS Pilani, K K Birla, Goa Campus, Goa 403726, India
- Correspondence:
| | - Paulo Lobato Correia
- Instituto de Telecomunicações, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais 1, 1049-001 Lisboa, Portugal; (P.A.); (P.L.C.)
| | - Luís Ducla Soares
- Instituto de Telecomunicações, Instituto Universitário de Lisboa (ISCTE-IUL), Av. das Forças Armadas, 1649-026 Lisboa, Portugal;
| |
Collapse
|
29
|
Hssayeni MD, Chala A, Dev R, Xu L, Shaw J, Furht B, Ghoraani B. The forecast of COVID-19 spread risk at the county level. JOURNAL OF BIG DATA 2021; 8:99. [PMID: 34249603 PMCID: PMC8261401 DOI: 10.1186/s40537-021-00491-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Accepted: 06/30/2021] [Indexed: 05/07/2023]
Abstract
The early detection of the coronavirus disease 2019 (COVID-19) outbreak is important to save people's lives and restart the economy quickly and safely. People's social behavior, reflected in their mobility data, plays a major role in spreading the disease. Therefore, we used the daily mobility data aggregated at the county level beside COVID-19 statistics and demographic information for short-term forecasting of COVID-19 outbreaks in the United States. The daily data are fed to a deep learning model based on Long Short-Term Memory (LSTM) to predict the accumulated number of COVID-19 cases in the next two weeks. A significant average correlation was achieved (r=0.83 (p = 0.005)) between the model predicted and actual accumulated cases in the interval from August 1, 2020 until January 22, 2021. The model predictions had r > 0.7 for 87% of the counties across the United States. A lower correlation was reported for the counties with total cases of <1000 during the test interval. The average mean absolute error (MAE) was 605.4 and decreased with a decrease in the total number of cases during the testing interval. The model was able to capture the effect of government responses on COVID-19 cases. Also, it was able to capture the effect of age demographics on the COVID-19 spread. It showed that the average daily cases decreased with a decrease in the retiree percentage and increased with an increase in the young percentage. Lessons learned from this study not only can help with managing the COVID-19 pandemic but also can help with early and effective management of possible future pandemics. The code used for this study was made publicly available on https://github.com/Murtadha44/covid-19-spread-risk. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1186/s40537-021-00491-1.
Collapse
Affiliation(s)
- Murtadha D. Hssayeni
- Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL 33431 USA
| | | | - Roger Dev
- LexisNexis Risk Solution, Alpharetta, GA USA
| | - Lili Xu
- LexisNexis Risk Solution, Alpharetta, GA USA
| | - Jesse Shaw
- LexisNexis Risk Solution, Alpharetta, GA USA
| | - Borko Furht
- Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL 33431 USA
| | - Behnaz Ghoraani
- Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL 33431 USA
| |
Collapse
|
30
|
Vescio B, Quattrone A, Nisticò R, Crasà M, Quattrone A. Wearable Devices for Assessment of Tremor. Front Neurol 2021; 12:680011. [PMID: 34177785 PMCID: PMC8226078 DOI: 10.3389/fneur.2021.680011] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Accepted: 05/05/2021] [Indexed: 12/28/2022] Open
Abstract
Tremor is an impairing symptom associated with several neurological diseases. Some of such diseases are neurodegenerative, and tremor characterization may be of help in differential diagnosis. To date, electromyography (EMG) is the gold standard for the analysis and diagnosis of tremors. In the last decade, however, several studies have been conducted for the validation of different techniques and new, non-invasive, portable, or even wearable devices have been recently proposed as complementary tools to EMG for a better characterization of tremors. Such devices have proven to be useful for monitoring the efficacy of therapies or even aiding in differential diagnosis. The aim of this review is to present systematically such new solutions, trying to highlight their potentialities and limitations, with a hint to future developments.
Collapse
Affiliation(s)
| | - Andrea Quattrone
- Department of Medical and Surgical Sciences, Institute of Neurology, Magna Græcia University, Catanzaro, Italy
| | - Rita Nisticò
- Neuroimaging Unit, Institute of Molecular Bioimaging and Physiology of the National Research Council (IBFM-CNR), Catanzaro, Italy
| | - Marianna Crasà
- Department of Medical and Surgical Sciences, Neuroscience Research Center, Magna Græcia University, Catanzaro, Italy
| | - Aldo Quattrone
- Neuroimaging Unit, Institute of Molecular Bioimaging and Physiology of the National Research Council (IBFM-CNR), Catanzaro, Italy.,Department of Medical and Surgical Sciences, Neuroscience Research Center, Magna Græcia University, Catanzaro, Italy
| |
Collapse
|
31
|
Albán-Cadena AC, Villalba-Meneses F, Pila-Varela KO, Moreno-Calvo A, Villalba-Meneses CP, Almeida-Galárraga DA. Wearable sensors in the diagnosis and study of Parkinson's disease symptoms: a systematic review. J Med Eng Technol 2021; 45:532-545. [PMID: 34060967 DOI: 10.1080/03091902.2021.1922528] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
Nowadays, there are several diseases which affect different systems of the body, producing changes in the correct functioning of the organism and the people lifestyles. One of them is Parkinson's disease (PD), which is defined as a neurodegenerative disorder provoked by the destruction of dopaminergic neurons in the brain, resulting in a set of motor and non-motor symptoms. As this disease affects principally to ancient people, several researchers have studied different treatments and therapies for stopping neurodegeneration and diminishing symptoms, to improve the quality patients' lives. The most common therapies created for PD are based on pharmacological treatment for controlling the degeneration advance and the physical ones which do not reveal the progress of patients. For this reason, this review paper opens the possibility for using wearable motion capture systems as an option for the control and study of PD. Therefore, it aims to (1) study the different wearable systems used for capture the movements of PD patients and (2) determine which of them bring better results for monitoring and assess PD people. For the analysis, it uses papers based on experiments that prove the functioning of several motion systems in different aspects as monitoring, treatment and diagnose of the disease. As a result, it works with 30 papers which describe the factors mentioned before. Additionally, the paper uses journals and literature review about the pathology, its characteristics and the function of wearable sensors for the correct understanding of the topic.
Collapse
Affiliation(s)
- Andrea C Albán-Cadena
- School of Biological Sciences & Engineering, Universidad Yachay Tech, Urcuquí, Ecuador
| | - Fernando Villalba-Meneses
- School of Biological Sciences & Engineering, Universidad Yachay Tech, Urcuquí, Ecuador.,University of Zaragoza, Zaragoza, Spain
| | - Kevin O Pila-Varela
- School of Biological Sciences & Engineering, Universidad Yachay Tech, Urcuquí, Ecuador
| | | | | | | |
Collapse
|
32
|
Powers R, Etezadi-Amoli M, Arnold EM, Kianian S, Mance I, Gibiansky M, Trietsch D, Alvarado AS, Kretlow JD, Herrington TM, Brillman S, Huang N, Lin PT, Pham HA, Ullal AV. Smartwatch inertial sensors continuously monitor real-world motor fluctuations in Parkinson's disease. Sci Transl Med 2021; 13:13/579/eabd7865. [PMID: 33536284 DOI: 10.1126/scitranslmed.abd7865] [Citation(s) in RCA: 84] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Accepted: 01/11/2021] [Indexed: 12/19/2022]
Abstract
Longitudinal, remote monitoring of motor symptoms in Parkinson's disease (PD) could enable more precise treatment decisions. We developed the Motor fluctuations Monitor for Parkinson's Disease (MM4PD), an ambulatory monitoring system that used smartwatch inertial sensors to continuously track fluctuations in resting tremor and dyskinesia. We designed and validated MM4PD in 343 participants with PD, including a longitudinal study of up to 6 months in a 225-subject cohort. MM4PD measurements correlated to clinical evaluations of tremor severity (ρ = 0.80) and mapped to expert ratings of dyskinesia presence (P < 0.001) during in-clinic tasks. MM4PD captured symptom changes in response to treatment that matched the clinician's expectations in 94% of evaluated subjects. In the remaining 6% of cases, symptom data from MM4PD identified opportunities to make improvements in pharmacologic strategy. These results demonstrate the promise of MM4PD as a tool to support patient-clinician communication, medication titration, and clinical trial design.
Collapse
Affiliation(s)
| | | | | | - Sara Kianian
- Apple Inc., Cupertino, CA 95014, USA.,Renaissance School of Medicine, Stony Brook University, Stony Brook, NY 11794, USA
| | | | | | | | | | | | - Todd M Herrington
- Department of Neurology, Massachusetts General Hospital, Boston, MA 02114, USA.,Department of Neurology, Harvard Medical School, Boston, MA 02115, USA
| | - Salima Brillman
- Parkinson's Disease and Movement Center of Silicon Valley, Menlo Park, CA 94025, USA
| | - Nengchun Huang
- Silicon Valley Parkinson's Center, Los Gatos, CA 95032, USA
| | - Peter T Lin
- Silicon Valley Parkinson's Center, Los Gatos, CA 95032, USA
| | | | | |
Collapse
|
33
|
Vescio B, Nisticò R, Augimeri A, Quattrone A, Crasà M, Quattrone A. Development and Validation of a New Wearable Mobile Device for the Automated Detection of Resting Tremor in Parkinson's Disease and Essential Tremor. Diagnostics (Basel) 2021; 11:200. [PMID: 33573076 PMCID: PMC7911899 DOI: 10.3390/diagnostics11020200] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Revised: 01/13/2021] [Accepted: 01/25/2021] [Indexed: 12/12/2022] Open
Abstract
Involuntary tremor at rest is observed in patients with Parkinson's disease (PD) or essential tremor (ET). Electromyography (EMG) studies have shown that phase displacement between antagonistic muscles at prevalent tremor frequency can accurately differentiate resting tremor in PD from that detected in ET. Currently, phase evaluation is qualitative in most cases. The aim of this study is to develop and validate a new mobile tool for the automated and quantitative characterization of phase displacement (resting tremor pattern) in ambulatory clinical settings. A new low-cost, wearable mobile device, called µEMG, is described, based on low-end instrumentation amplifiers and simple digital signal processing (DSP) capabilities. Measurements of resting tremor characteristics from this new device were compared with standard EMG. A good level of agreement was found in a sample of 21 subjects (14 PD patients with alternating resting tremor pattern and 7 ET patients with synchronous resting tremor pattern). Our results demonstrate that tremor analysis using µEMG is easy to perform and it can be used in routine clinical practice for the automated quantification of resting tremor patterns. Moreover, the measurement process is handy and operator-independent.
Collapse
Affiliation(s)
- Basilio Vescio
- Biotecnomed S.C.aR.L., 88100 Catanzaro, Italy; (B.V.); (A.A.)
| | - Rita Nisticò
- Neuroimaging Unit, Institute of Molecular Bioimaging and Physiology of the National Research Council (IBFM-CNR), 88100 Catanzaro, Italy;
| | | | - Andrea Quattrone
- Institute of Neurology, Magna Græcia University, 88100 Catanzaro, Italy;
| | - Marianna Crasà
- Neuroscience Research Center, Magna Græcia University, 88100 Catanzaro, Italy;
| | - Aldo Quattrone
- Neuroimaging Unit, Institute of Molecular Bioimaging and Physiology of the National Research Council (IBFM-CNR), 88100 Catanzaro, Italy;
- Neuroscience Research Center, Magna Græcia University, 88100 Catanzaro, Italy;
| |
Collapse
|
34
|
Sigcha L, Pavón I, Costa N, Costa S, Gago M, Arezes P, López JM, De Arcas G. Automatic Resting Tremor Assessment in Parkinson's Disease Using Smartwatches and Multitask Convolutional Neural Networks. SENSORS 2021; 21:s21010291. [PMID: 33406692 PMCID: PMC7794726 DOI: 10.3390/s21010291] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 12/22/2020] [Accepted: 12/29/2020] [Indexed: 12/28/2022]
Abstract
Resting tremor in Parkinson's disease (PD) is one of the most distinctive motor symptoms. Appropriate symptom monitoring can help to improve management and medical treatments and improve the patients' quality of life. Currently, tremor is evaluated by physical examinations during clinical appointments; however, this method could be subjective and does not represent the full spectrum of the symptom in the patients' daily lives. In recent years, sensor-based systems have been used to obtain objective information about the disease. However, most of these systems require the use of multiple devices, which makes it difficult to use them in an ambulatory setting. This paper presents a novel approach to evaluate the amplitude and constancy of resting tremor using triaxial accelerometers from consumer smartwatches and multitask classification models. These approaches are used to develop a system for an automated and accurate symptom assessment without interfering with the patients' daily lives. Results show a high agreement between the amplitude and constancy measurements obtained from the smartwatch in comparison with those obtained in a clinical assessment. This indicates that consumer smartwatches in combination with multitask convolutional neural networks are suitable for providing accurate and relevant information about tremor in patients in the early stages of the disease, which can contribute to the improvement of PD clinical evaluation, early detection of the disease, and continuous monitoring.
Collapse
Affiliation(s)
- Luis Sigcha
- Instrumentation and Applied Acoustics Research Group (I2A2), ETSI Industriales, Universidad Politécnica de Madrid, Campus Sur UPM, Ctra. Valencia, Km 7, 28031 Madrid, Spain; (L.S.); (J.M.L.); (G.D.A.)
- ALGORITMI Research Center, School of Engineering, University of Minho, 4800-058 Guimarães, Portugal; (N.C.); (S.C.); (P.A.)
| | - Ignacio Pavón
- Instrumentation and Applied Acoustics Research Group (I2A2), ETSI Industriales, Universidad Politécnica de Madrid, Campus Sur UPM, Ctra. Valencia, Km 7, 28031 Madrid, Spain; (L.S.); (J.M.L.); (G.D.A.)
- Correspondence: ; Tel.: +34-91-067-7222
| | - Nélson Costa
- ALGORITMI Research Center, School of Engineering, University of Minho, 4800-058 Guimarães, Portugal; (N.C.); (S.C.); (P.A.)
| | - Susana Costa
- ALGORITMI Research Center, School of Engineering, University of Minho, 4800-058 Guimarães, Portugal; (N.C.); (S.C.); (P.A.)
| | - Miguel Gago
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, 4710-057 Braga, Portugal;
| | - Pedro Arezes
- ALGORITMI Research Center, School of Engineering, University of Minho, 4800-058 Guimarães, Portugal; (N.C.); (S.C.); (P.A.)
| | - Juan Manuel López
- Instrumentation and Applied Acoustics Research Group (I2A2), ETSI Industriales, Universidad Politécnica de Madrid, Campus Sur UPM, Ctra. Valencia, Km 7, 28031 Madrid, Spain; (L.S.); (J.M.L.); (G.D.A.)
| | - Guillermo De Arcas
- Instrumentation and Applied Acoustics Research Group (I2A2), ETSI Industriales, Universidad Politécnica de Madrid, Campus Sur UPM, Ctra. Valencia, Km 7, 28031 Madrid, Spain; (L.S.); (J.M.L.); (G.D.A.)
| |
Collapse
|
35
|
Dong R, Cai D, Ikuno S. Motion Capture Data Analysis in the Instantaneous Frequency-Domain Using Hilbert-Huang Transform. SENSORS (BASEL, SWITZERLAND) 2020; 20:E6534. [PMID: 33207544 PMCID: PMC7698183 DOI: 10.3390/s20226534] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/10/2020] [Revised: 11/11/2020] [Accepted: 11/13/2020] [Indexed: 12/24/2022]
Abstract
Motion capture data are widely used in different research fields such as medical, entertainment, and industry. However, most motion researches using motion capture data are carried out in the time-domain. To understand human motion complexities, it is necessary to analyze motion data in the frequency-domain. In this paper, to analyze human motions, we present a framework to transform motions into the instantaneous frequency-domain using the Hilbert-Huang transform (HHT). The empirical mode decomposition (EMD) that is a part of HHT decomposes nonstationary and nonlinear signals captured from the real-world experiments into pseudo monochromatic signals, so-called intrinsic mode function (IMF). Our research reveals that the multivariate EMD can decompose complicated human motions into a finite number of nonlinear modes (IMFs) corresponding to distinct motion primitives. Analyzing these decomposed motions in Hilbert spectrum, motion characteristics can be extracted and visualized in instantaneous frequency-domain. For example, we apply our framework to (1) a jump motion, (2) a foot-injured gait, and (3) a golf swing motion.
Collapse
Affiliation(s)
- Ran Dong
- School of Computer Science, Tokyo University of Technology, Tokyo 192-0982, Japan;
| | - Dongsheng Cai
- Faculty of Engineering, Information and Systems, University of Tsukuba, Ibaraki 305-8577, Japan;
| | - Soichiro Ikuno
- School of Computer Science, Tokyo University of Technology, Tokyo 192-0982, Japan;
| |
Collapse
|
36
|
Bacanoiu MV, Mititelu RR, Danoiu M, Olaru G, Buga AM. Functional Recovery in Parkinson's Disease: Current State and Future Perspective. J Clin Med 2020; 9:jcm9113413. [PMID: 33114424 PMCID: PMC7692963 DOI: 10.3390/jcm9113413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Revised: 10/18/2020] [Accepted: 10/20/2020] [Indexed: 12/05/2022] Open
Abstract
Parkinson’s disease (PD) is one of the most frequent neurodegenerative disorders, affecting not only the motor function but also limiting the autonomy of affected people. In the last decade, the physical exercises of different intensities carried out by kinetic therapeutic activities, by robotic technologies or with the participation of sensory cues, have become increasingly appreciated in the management of Parkinson’s disease impairments. The aim of this paper was to evaluate the impact of physical exercises with and without physical devices on the motor and cognitive variables of PD patients. In order to achieve our objectives, we performed a systematic review of available original articles based on the impact of kinetic therapeutic activity. Through the search strategy, we selected original papers that were laboriously processed using characteristics related to physical therapy, or the tools used in physiological and psychological rehabilitation strategies for PD patients. In this study, we presented the most current intervention techniques in the rehabilitation programs of patients with Parkinson’s disease, namely the use of assisted devices, virtual imagery or the performing of physical therapies that have the capacity to improve walking deficits, tremor and bradykinesia, to reduce freezing episodes of gait and postural instability, or to improve motor and cognitive functions.
Collapse
Affiliation(s)
- Manuela Violeta Bacanoiu
- Department of Physical Therapy and Sports Medicine, University of Craiova, 200207 Craiova, Romania; (M.D.); (G.O.)
- Department of Laboratory Medicine, County Clinical Emergency Hospital of Craiova, 200642 Craiova, Romania
- Correspondence: (M.V.B.); (A.M.B.); Tel.: +40-0351-443-500 (A.M.B.)
| | - Radu Razvan Mititelu
- Department of Biochemistry, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania; or
| | - Mircea Danoiu
- Department of Physical Therapy and Sports Medicine, University of Craiova, 200207 Craiova, Romania; (M.D.); (G.O.)
| | - Gabriela Olaru
- Department of Physical Therapy and Sports Medicine, University of Craiova, 200207 Craiova, Romania; (M.D.); (G.O.)
| | - Ana Maria Buga
- Department of Biochemistry, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania; or
- Correspondence: (M.V.B.); (A.M.B.); Tel.: +40-0351-443-500 (A.M.B.)
| |
Collapse
|
37
|
Lu M, Poston K, Pfefferbaum A, Sullivan EV, Fei-Fei L, Pohl KM, Niebles JC, Adeli E. Vision-based Estimation of MDS-UPDRS Gait Scores for Assessing Parkinson's Disease Motor Severity. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2020; 12263:637-647. [PMID: 33103164 PMCID: PMC7585545 DOI: 10.1007/978-3-030-59716-0_61] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Parkinson's disease (PD) is a progressive neurological disorder primarily affecting motor function resulting in tremor at rest, rigidity, bradykinesia, and postural instability. The physical severity of PD impairments can be quantified through the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS), a widely used clinical rating scale. Accurate and quantitative assessment of disease progression is critical to developing a treatment that slows or stops further advancement of the disease. Prior work has mainly focused on dopamine transport neuroimaging for diagnosis or costly and intrusive wearables evaluating motor impairments. For the first time, we propose a computer vision-based model that observes non-intrusive video recordings of individuals, extracts their 3D body skeletons, tracks them through time, and classifies the movements according to the MDS-UPDRS gait scores. Experimental results show that our proposed method performs significantly better than chance and competing methods with an F 1-score of 0.83 and a balanced accuracy of 81%. This is the first benchmark for classifying PD patients based on MDS-UPDRS gait severity and could be an objective biomarker for disease severity. Our work demonstrates how computer-assisted technologies can be used to non-intrusively monitor patients and their motor impairments. The code is available at https://github.com/mlu355/PD-Motor-Severity-Estimation.
Collapse
Affiliation(s)
- Mandy Lu
- Computer Science Department, Stanford University, Stanford, CA, USA
| | | | - Adolf Pfefferbaum
- School of Medicine, Stanford University, Stanford, CA, USA
- Center of Health Sciences, SRI International, Menlo Park, CA, USA
| | | | - Li Fei-Fei
- Computer Science Department, Stanford University, Stanford, CA, USA
| | - Kilian M Pohl
- School of Medicine, Stanford University, Stanford, CA, USA
- Center of Health Sciences, SRI International, Menlo Park, CA, USA
| | | | - Ehsan Adeli
- Computer Science Department, Stanford University, Stanford, CA, USA
- School of Medicine, Stanford University, Stanford, CA, USA
| |
Collapse
|
38
|
Moon S, Song HJ, Sharma VD, Lyons KE, Pahwa R, Akinwuntan AE, Devos H. Classification of Parkinson's disease and essential tremor based on balance and gait characteristics from wearable motion sensors via machine learning techniques: a data-driven approach. J Neuroeng Rehabil 2020; 17:125. [PMID: 32917244 PMCID: PMC7488406 DOI: 10.1186/s12984-020-00756-5] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Accepted: 09/02/2020] [Indexed: 02/07/2023] Open
Abstract
BACKGROUND Parkinson's disease (PD) and essential tremor (ET) are movement disorders that can have similar clinical characteristics including tremor and gait difficulty. These disorders can be misdiagnosed leading to delay in appropriate treatment. The aim of the study was to determine whether balance and gait variables obtained with wearable inertial motion sensors can be utilized to differentiate between PD and ET using machine learning. Additionally, we compared classification performances of several machine learning models. METHODS This retrospective study included balance and gait variables collected during the instrumented stand and walk test from people with PD (n = 524) and with ET (n = 43). Performance of several machine learning techniques including neural networks, support vector machine, k-nearest neighbor, decision tree, random forest, and gradient boosting, were compared with a dummy model or logistic regression using F1-scores. RESULTS Machine learning models classified PD and ET based on balance and gait characteristics better than the dummy model (F1-score = 0.48) or logistic regression (F1-score = 0.53). The highest F1-score was 0.61 of neural network, followed by 0.59 of gradient boosting, 0.56 of random forest, 0.55 of support vector machine, 0.53 of decision tree, and 0.49 of k-nearest neighbor. CONCLUSIONS This study demonstrated the utility of machine learning models to classify different movement disorders based on balance and gait characteristics collected from wearable sensors. Future studies using a well-balanced data set are needed to confirm the potential clinical utility of machine learning models to discern between PD and ET.
Collapse
Affiliation(s)
- Sanghee Moon
- Department of Physical Therapy, Ithaca College, Ithaca, NY, USA.
- Department of Physical Therapy and Rehabilitation Science, University of Kansas Medical Center, Kansas City, KS, USA.
| | - Hyun-Je Song
- Department of Information Technology, Jeonbuk National University, Jeonju, South Korea
| | - Vibhash D Sharma
- Department of Neurology, University of Kansas Medical Center, Kansas City, KS, USA
| | - Kelly E Lyons
- Department of Neurology, University of Kansas Medical Center, Kansas City, KS, USA
| | - Rajesh Pahwa
- Department of Neurology, University of Kansas Medical Center, Kansas City, KS, USA
| | - Abiodun E Akinwuntan
- Department of Physical Therapy and Rehabilitation Science, University of Kansas Medical Center, Kansas City, KS, USA
- Office of the Dean, School of Health Professions, University of Kansas Medical Center, Kansas City, KS, USA
| | - Hannes Devos
- Department of Physical Therapy and Rehabilitation Science, University of Kansas Medical Center, Kansas City, KS, USA
| |
Collapse
|
39
|
Aich S, Youn J, Chakraborty S, Pradhan PM, Park JH, Park S, Park J. A Supervised Machine Learning Approach to Detect the On/Off State in Parkinson's Disease Using Wearable Based Gait Signals. Diagnostics (Basel) 2020; 10:diagnostics10060421. [PMID: 32575764 PMCID: PMC7344560 DOI: 10.3390/diagnostics10060421] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Revised: 06/12/2020] [Accepted: 06/18/2020] [Indexed: 01/07/2023] Open
Abstract
Fluctuations in motor symptoms are mostly observed in Parkinson's disease (PD) patients. This characteristic is inevitable, and can affect the quality of life of the patients. However, it is difficult to collect precise data on the fluctuation characteristics using self-reported data from PD patients. Therefore, it is necessary to develop a suitable technology that can detect the medication state, also termed the "On"/"Off" state, automatically using wearable devices; at the same time, this could be used in the home environment. Recently, wearable devices, in combination with powerful machine learning techniques, have shown the potential to be effectively used in critical healthcare applications. In this study, an algorithm is proposed that can detect the medication state automatically using wearable gait signals. A combination of features that include statistical features and spatiotemporal gait features are used as inputs to four different classifiers such as random forest, support vector machine, K nearest neighbour, and Naïve Bayes. In total, 20 PD subjects with definite motor fluctuations have been evaluated by comparing the performance of the proposed algorithm in association with the four aforementioned classifiers. It was found that random forest outperformed the other classifiers with an accuracy of 96.72%, a recall of 97.35%, and a precision of 96.92%.
Collapse
Affiliation(s)
| | - Jinyoung Youn
- Department of Neurology, Samsung Medical Center, School of medicine Sungkyunkwan University, Seoul 06351, Korea
- Correspondence: (J.Y.); (J.P.); Tel.:+82-51-797-2448 (J.P.)
| | | | - Pyari Mohan Pradhan
- Department of Electronics and Communication Engineering, IIT Roorkee 247667, India;
| | - Jin-han Park
- Department of Respiratory Medicine, Haeundae Paik Hospital, Inje University, Busan 48108, Korea;
| | - Seongho Park
- Department of Neurology, Haeundae Paik Hospital, Inje University, Busan 48108 Korea;
| | - Jinse Park
- Department of Neurology, Haeundae Paik Hospital, Inje University, Busan 48108 Korea;
- Correspondence: (J.Y.); (J.P.); Tel.:+82-51-797-2448 (J.P.)
| |
Collapse
|
40
|
Zhang H, Deng K, Li H, Albin RL, Guan Y. Deep Learning Identifies Digital Biomarkers for Self-Reported Parkinson's Disease. PATTERNS 2020; 1. [PMID: 32699844 PMCID: PMC7375444 DOI: 10.1016/j.patter.2020.100042] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Large-scale population screening and in-home monitoring for patients with Parkinson's disease (PD) has so far been mainly carried out by traditional healthcare methods and systems. Development of mobile health may provide an independent, future method to detect PD. Current PD detection algorithms will benefit from better generalizability with data collected in real-world situations. In this paper, we report the top-performing smartphone-based method in the recent DREAM Parkinson's Disease Digital Biomarker Challenge for digital diagnosis of PD. Utilizing real-world accelerometer records, this approach differentiated PD from control subjects with an area under the receiver-operating characteristic curve of 0.87 by 3D augmentation of accelerometer records, a significant improvement over other state-of-the-art methods. This study paves the way for future at-home screening of PD and other neurodegenerative conditions affecting movement.
Collapse
Affiliation(s)
- Hanrui Zhang
- Department of Computational Medicine and Bioinformatics, University of Michigan Medical School, Ann Arbor, MI 48109, USA
| | - Kaiwen Deng
- Department of Computational Medicine and Bioinformatics, University of Michigan Medical School, Ann Arbor, MI 48109, USA
| | - Hongyang Li
- Department of Computational Medicine and Bioinformatics, University of Michigan Medical School, Ann Arbor, MI 48109, USA
| | - Roger L Albin
- Department of Neurology, University of Michigan Medical School, Ann Arbor, MI, USA.,Neurology Service & GRECC, VAAAHS, Ann Arbor, MI 48109, USA
| | - Yuanfang Guan
- Department of Computational Medicine and Bioinformatics, University of Michigan Medical School, Ann Arbor, MI 48109, USA.,Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI 48109, USA.,Lead Contact
| |
Collapse
|
41
|
The Rehapiano-Detecting, Measuring, and Analyzing Action Tremor Using Strain Gauges. SENSORS 2020; 20:s20030663. [PMID: 31991705 PMCID: PMC7038321 DOI: 10.3390/s20030663] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2019] [Revised: 01/23/2020] [Accepted: 01/23/2020] [Indexed: 02/02/2023]
Abstract
We have developed a device, the Rehapiano, for the fast and quantitative assessment of action tremor. It uses strain gauges to measure force exerted by individual fingers. This article verifies the device's capability to measure and monitor the development of upper limb tremor. The Rehapiano uses a precision, 24-bit, analog-to-digital converter and an Arduino microcomputer to transfer raw data via a USB interface to a computer for processing, database storage, and evaluation. First, our experiments validated the device by measuring simulated tremors with known frequencies. Second, we created a measurement protocol, which we used to measure and compare healthy patients and patients with Parkinson's disease. Finally, we evaluated the repeatability of a quantitative assessment. We verified our hypothesis that the Rehapiano is able to detect force changes, and our experimental results confirmed that our system is capable of measuring action tremor. The Rehapiano is also sensitive enough to enable the quantification of Parkinsonian tremors.
Collapse
|