1
|
Park JM, Moon CW, Lee BC, Oh E, Lee J, Jang WJ, Cho KH, Lee SH. Detection of freezing of gait in Parkinson's disease from foot-pressure sensing insoles using a temporal convolutional neural network. Front Aging Neurosci 2024; 16:1437707. [PMID: 39092074 PMCID: PMC11291202 DOI: 10.3389/fnagi.2024.1437707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 07/01/2024] [Indexed: 08/04/2024] Open
Abstract
Backgrounds Freezing of gait (FoG) is a common and debilitating symptom of Parkinson's disease (PD) that can lead to falls and reduced quality of life. Wearable sensors have been used to detect FoG, but current methods have limitations in accuracy and practicality. In this paper, we aimed to develop a deep learning model using pressure sensor data from wearable insoles to accurately detect FoG in PD patients. Methods We recruited 14 PD patients and collected data from multiple trials of a standardized walking test using the Pedar insole system. We proposed temporal convolutional neural network (TCNN) and applied rigorous data filtering and selective participant inclusion criteria to ensure the integrity of the dataset. We mapped the sensor data to a structured matrix and normalized it for input into our TCNN. We used a train-test split to evaluate the performance of the model. Results We found that TCNN model achieved the highest accuracy, precision, sensitivity, specificity, and F1 score for FoG detection compared to other models. The TCNN model also showed good performance in detecting FoG episodes, even in various types of sensor noise situations. Conclusions We demonstrated the potential of using wearable pressure sensors and machine learning models for FoG detection in PD patients. The TCNN model showed promising results and could be used in future studies to develop a real-time FoG detection system to improve PD patients' safety and quality of life. Additionally, our noise impact analysis identifies critical sensor locations, suggesting potential for reducing sensor numbers.
Collapse
Affiliation(s)
- Jae-Min Park
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Chang-Won Moon
- Department of Rehabilitation Medicine, Chungnam National University College of Medicine, Daejeon, Republic of Korea
- Department of Biomedical Institute, Chungnam National University, Daejeon, Republic of Korea
| | - Byung Chan Lee
- Department of Physical Medicine and Rehabilitation, Chung-Ang University Hospital, Seoul, Republic of Korea
| | - Eungseok Oh
- Department of Neurology, College of Medicine, Chungnam National University Hospital, Daejeon, Republic of Korea
| | - Juhyun Lee
- Department of Biomedical Institute, Chungnam National University, Daejeon, Republic of Korea
| | - Won-Jun Jang
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Kang Hee Cho
- Department of Rehabilitation Medicine, Chungnam National University College of Medicine, Daejeon, Republic of Korea
- Department of Biomedical Institute, Chungnam National University, Daejeon, Republic of Korea
| | - Si-Hyeon Lee
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| |
Collapse
|
2
|
Elbatanouny H, Kleanthous N, Dahrouj H, Alusi S, Almajali E, Mahmoud S, Hussain A. Insights into Parkinson's Disease-Related Freezing of Gait Detection and Prediction Approaches: A Meta Analysis. SENSORS (BASEL, SWITZERLAND) 2024; 24:3959. [PMID: 38931743 PMCID: PMC11207947 DOI: 10.3390/s24123959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 05/29/2024] [Accepted: 05/29/2024] [Indexed: 06/28/2024]
Abstract
Parkinson's Disease (PD) is a complex neurodegenerative disorder characterized by a spectrum of motor and non-motor symptoms, prominently featuring the freezing of gait (FOG), which significantly impairs patients' quality of life. Despite extensive research, the precise mechanisms underlying FOG remain elusive, posing challenges for effective management and treatment. This paper presents a comprehensive meta-analysis of FOG prediction and detection methodologies, with a focus on the integration of wearable sensor technology and machine learning (ML) approaches. Through an exhaustive review of the literature, this study identifies key trends, datasets, preprocessing techniques, feature extraction methods, evaluation metrics, and comparative analyses between ML and non-ML approaches. The analysis also explores the utilization of cueing devices. The limited adoption of explainable AI (XAI) approaches in FOG prediction research represents a significant gap. Improving user acceptance and comprehension requires an understanding of the logic underlying algorithm predictions. Current FOG detection and prediction research has a number of limitations, which are identified in the discussion. These include issues with cueing devices, dataset constraints, ethical and privacy concerns, financial and accessibility restrictions, and the requirement for multidisciplinary collaboration. Future research avenues center on refining explainability, expanding and diversifying datasets, adhering to user requirements, and increasing detection and prediction accuracy. The findings contribute to advancing the understanding of FOG and offer valuable guidance for the development of more effective detection and prediction methodologies, ultimately benefiting individuals affected by PD.
Collapse
Affiliation(s)
- Hagar Elbatanouny
- Department of Electrical Engineering, University of Sharjah, Sharjah 27272, United Arab Emirates; (H.D.); (E.A.); (S.M.)
| | | | - Hayssam Dahrouj
- Department of Electrical Engineering, University of Sharjah, Sharjah 27272, United Arab Emirates; (H.D.); (E.A.); (S.M.)
| | - Sundus Alusi
- The Walton Centre NHS Foundation Trust, Liverpool L9 7LJ, UK;
| | - Eqab Almajali
- Department of Electrical Engineering, University of Sharjah, Sharjah 27272, United Arab Emirates; (H.D.); (E.A.); (S.M.)
| | - Soliman Mahmoud
- Department of Electrical Engineering, University of Sharjah, Sharjah 27272, United Arab Emirates; (H.D.); (E.A.); (S.M.)
- University of Khorfakkan, Khorfakkan, Sharjah 18119, United Arab Emirates
| | - Abir Hussain
- Department of Electrical Engineering, University of Sharjah, Sharjah 27272, United Arab Emirates; (H.D.); (E.A.); (S.M.)
| |
Collapse
|
3
|
Koltermann K, Clapham J, Blackwell G, Jung W, Burnet EN, Gao Y, Shao H, Cloud L, Pretzer-Aboff I, Zhou G. Gait-Guard: Turn-aware Freezing of Gait Detection for Non-intrusive Intervention Systems. ...IEEE...INTERNATIONAL CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES. IEEE INTERNATIONAL CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES 2024; 2024:61-72. [PMID: 39262653 PMCID: PMC11384236 DOI: 10.1109/chase60773.2024.00016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/13/2024]
Abstract
Freezing of gait significantly reduces the quality of life for Parkinson's disease patients by increasing the risk of injurious falls and reducing mobility. Real-time intervention mechanisms promise relief from these symptoms, but require accurate real-time, portable freezing of gait detection systems to be effective. Current real-time detection systems have unacceptable false positive freezing of gait identification rates to be adopted by the patients for real-world use. To rectify this, we propose Gait-Guard, a closed-loop, real-time, and portable freezing of gait detection and intervention system that treats symptoms in real-time with a low false positive rate. We collected 1591 freezing of gait events across 26 patients to evaluate Gait-Guard. Gait-Guard achieved a 112% reduction in the false positive intervention rate when compared with other validated real-time freezing of gait detection systems, and detected 96.5% of the true positives with an average intervention latency of just 378.5ms in a subject-independent study, making Gait-Guard a practical system for patients to use in their daily lives.
Collapse
Affiliation(s)
| | | | | | - Woosub Jung
- Computer & Information Sciences, Towson University
| | | | - Ye Gao
- Department of Computer Science, William & Mary
| | - Huajie Shao
- Department of Computer Science, William & Mary
| | - Leslie Cloud
- Department of Neurology, Virginia Commonwealth University
| | | | - Gang Zhou
- Department of Computer Science, William & Mary
| |
Collapse
|
4
|
Li G, Li S, Xie J, Zhang Z, Zou J, Yang C, He L, Zeng Q, Shu L, Huang G. Identifying changes in dynamic plantar pressure associated with radiological knee osteoarthritis based on machine learning and wearable devices. J Neuroeng Rehabil 2024; 21:45. [PMID: 38570841 PMCID: PMC10988837 DOI: 10.1186/s12984-024-01337-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 03/07/2024] [Indexed: 04/05/2024] Open
Abstract
BACKGROUND Knee osteoarthritis (KOA) is an irreversible degenerative disease that characterized by pain and abnormal gait. Radiography is typically used to detect KOA but has limitations. This study aimed to identify changes in plantar pressure that are associated with radiological knee osteoarthritis (ROA) and to validate them using machine learning algorithms. METHODS This study included 92 participants with variable degrees of KOA. A modified Kellgren-Lawrence scale was used to classify participants into non-ROA and ROA groups. The total feature set included 210 dynamic plantar pressure features captured by a wearable in-shoe system as well as age, gender, height, weight, and body mass index. Filter and wrapper methods identified the optimal features, which were used to train five types of machine learning classification models for further validation: k-nearest neighbors (KNN), support vector machine (SVM), random forest (RF), AdaBoost, and eXtreme gradient boosting (XGBoost). RESULTS Age, the standard deviation (SD) of the peak plantar pressure under the left lateral heel (f_L8PPP_std), the SD of the right second peak pressure (f_Rpeak2_std), and the SD of the variation in the anteroposterior displacement of center of pressure (COP) in the right foot (f_RYcopstd_std) were most associated with ROA. The RF model with an accuracy of 82.61% and F1 score of 0.8000 had the best generalization ability. CONCLUSION Changes in dynamic plantar pressure are promising mechanical biomarkers that distinguish between non-ROA and ROA. Combining a wearable in-shoe system with machine learning enables dynamic monitoring of KOA, which could help guide treatment plans.
Collapse
Affiliation(s)
- Gege Li
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China
- School of Rehabilitation Medicine, Southern Medical University, Guangzhou, China
| | - Shilin Li
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China
- Department of Rehabilitation Medicine, the First Affiliated Hospital of Nanchang University, Nanchang, China
| | - Junan Xie
- School of Microelectronics, South China University of Technology, Guangzhou, China
| | - Zhuodong Zhang
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China
- School of Rehabilitation Medicine, Southern Medical University, Guangzhou, China
| | - Jihua Zou
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China
- School of Rehabilitation Medicine, Southern Medical University, Guangzhou, China
| | - Chengduan Yang
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China
- School of Rehabilitation Medicine, Southern Medical University, Guangzhou, China
| | - Longlong He
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China
- Department of Clinical Medicine, Xiamen Medical College, Xiamen, China
| | - Qing Zeng
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China.
- School of Rehabilitation Medicine, Southern Medical University, Guangzhou, China.
| | - Lin Shu
- School of Future Technology, South China University of Technology, Guangzhou, China.
- Pazhou Lab, Guangzhou, China.
| | - Guozhi Huang
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China.
- School of Rehabilitation Medicine, Southern Medical University, Guangzhou, China.
| |
Collapse
|
5
|
Hu K, Mei S, Wang W, Martens KAE, Wang L, Lewis SJG, Feng DD, Wang Z. Multi-Level Adversarial Spatio-Temporal Learning for Footstep Pressure Based FoG Detection. IEEE J Biomed Health Inform 2023; 27:4166-4177. [PMID: 37227913 DOI: 10.1109/jbhi.2023.3272902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
Freezing of gait (FoG) is one of the most common symptoms of Parkinson's disease, which is a neurodegenerative disorder of the central nervous system impacting millions of people around the world. To address the pressing need to improve the quality of treatment for FoG, devising a computer-aided detection and quantification tool for FoG has been increasingly important. As a non-invasive technique for collecting motion patterns, the footstep pressure sequences obtained from pressure sensitive gait mats provide a great opportunity for evaluating FoG in the clinic and potentially in the home environment. In this study, FoG detection is formulated as a sequential modelling task and a novel deep learning architecture, namely Adversarial Spatio-temporal Network (ASTN), is proposed to learn FoG patterns across multiple levels. ASTN introduces a novel adversarial training scheme with a multi-level subject discriminator to obtain subject-independent FoG representations, which helps to reduce the over-fitting risk due to the high inter-subject variance. As a result, robust FoG detection can be achieved for unseen subjects. The proposed scheme also sheds light on improving subject-level clinical studies from other scenarios as it can be integrated with many existing deep architectures. To the best of our knowledge, this is one of the first studies of footstep pressure-based FoG detection and the approach of utilizing ASTN is the first deep neural network architecture in pursuit of subject-independent representations. In our experiments on 393 trials collected from 21 subjects, the proposed ASTN achieved an AUC 0.85, clearly outperforming conventional learning methods.
Collapse
|
6
|
Koltermann K, Jung W, Blackwell G, Pinney A, Chen M, Cloud L, Pretzer-Aboff I, Zhou G. FoG-Finder: Real-time Freezing of Gait Detection and Treatment. ...IEEE...INTERNATIONAL CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES. IEEE INTERNATIONAL CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES 2023; 2023:22-33. [PMID: 37736618 PMCID: PMC10513482] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 09/23/2023]
Abstract
Freezing of gait is a serious symptom of Parkinson's disease that increases the risk of injury through falling, and reduces quality of life. Current clinical freezing of gait treatments fail to adequately address the fall risk posed by freezing of gait symptoms, and current real-time treatment systems have high false positive rates. To address this problem, we designed a closed-loop, non-intrusive, and real-time freezing of gait detection and treatment system, FoG-Finder, that automatically detects and treats freezing of gait. To evaluate FoG-Finder, we first collected 716 freezing of gait events from 11 patients. We then compared FoG-Finder against other real-time systems with our dataset. Our system was able to achieve a 13.4% higher F1 score and a 10.7% higher overall accuracy while achieving a reduction of 85.8% in the false positive treatment rate compared with other validated real-time freezing of gait detection and treatment systems. Additionally, FoG-Finder achieved an average treatment latency of 427ms and 615ms for subject-dependent and leave-one-subject-out settings, respectively, making it a viable system to treat freezing of gait in the real-world.
Collapse
Affiliation(s)
| | - Woosub Jung
- Department of Computer Science, William & Mary
| | | | | | | | - Leslie Cloud
- Department of Neurology, Virginia Commonwealth University
| | | | - Gang Zhou
- Department of Computer Science, William & Mary
| |
Collapse
|
7
|
Huang T, Li M, Huang J. Recent trends in wearable device used to detect freezing of gait and falls in people with Parkinson's disease: A systematic review. Front Aging Neurosci 2023; 15:1119956. [PMID: 36875701 PMCID: PMC9975590 DOI: 10.3389/fnagi.2023.1119956] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 01/23/2023] [Indexed: 02/17/2023] Open
Abstract
Background The occurrence of freezing of gait (FOG) is often observed in moderate to last-stage Parkinson's disease (PD), leading to a high risk of falls. The emergence of the wearable device has offered the possibility of FOG detection and falls of patients with PD allowing high validation in a low-cost way. Objective This systematic review seeks to provide a comprehensive overview of existing literature to establish the forefront of sensors type, placement and algorithm to detect FOG and falls among patients with PD. Methods Two electronic databases were screened by title and abstract to summarize the state of art on FOG and fall detection with any wearable technology among patients with PD. To be eligible for inclusion, papers were required to be full-text articles published in English, and the last search was completed on September 26, 2022. Studies were excluded if they; (i) only examined cueing function for FOG, (ii) only used non-wearable devices to detect or predict FOG or falls, and (iii) did not provide sufficient details about the study design and results. A total of 1,748 articles were retrieved from two databases. However, only 75 articles were deemed to meet the inclusion criteria according to the title, abstract and full-text reviewed. Variable was extracted from chosen research, including authorship, details of the experimental object, type of sensor, device location, activities, year of publication, evaluation in real-time, the algorithm and detection performance. Results A total of 72 on FOG detection and 3 on fall detection were selected for data extraction. There were wide varieties of the studied population (from 1 to 131), type of sensor, placement and algorithm. The thigh and ankle were the most popular device location, and the combination of accelerometer and gyroscope was the most frequently used inertial measurement unit (IMU). Furthermore, 41.3% of the studies used the dataset as a resource to examine the validity of their algorithm. The results also showed that increasingly complex machine-learning algorithms had become the trend in FOG and fall detection. Conclusion These data support the application of the wearable device to access FOG and falls among patients with PD and controls. Machine learning algorithms and multiple types of sensors have become the recent trend in this field. Future work should consider an adequate sample size, and the experiment should be performed in a free-living environment. Moreover, a consensus on provoking FOG/fall, methods of assessing validity and algorithm are necessary.Systematic Review Registration: PROSPERO, identifier CRD42022370911.
Collapse
Affiliation(s)
- Tinghuai Huang
- Laboratory of Laser Sports Medicine, South China Normal University, Guangzhou, Guangdong, China
| | - Meng Li
- Laboratory of Laser Sports Medicine, South China Normal University, Guangzhou, Guangdong, China
| | - Jianwei Huang
- Department of Gastroenterology, The Fifth Affiliated Hospital of Guangzhou Medical University, Guangzhou Medical University, Guangzhou, Guangdong, China
| |
Collapse
|