1
|
Liang A. Assessing gait dysfunction severity in Parkinson's Disease using 2-Stream Spatial-Temporal Neural Network. J Biomed Inform 2024; 157:104679. [PMID: 38925280 DOI: 10.1016/j.jbi.2024.104679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Revised: 06/18/2024] [Accepted: 06/19/2024] [Indexed: 06/28/2024]
Abstract
Parkinson's Disease (PD), a neurodegenerative disorder, significantly impacts the quality of life for millions of people worldwide. PD primarily impacts dopaminergic neurons in the brain's substantia nigra, resulting in dopamine deficiency and gait impairments such as bradykinesia and rigidity. Currently, several well-established tools, such as the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) and Hoehn and Yahr (H&Y) Scale, are used for evaluating gait dysfunction in PD. While insightful, these methods are subjective, time-consuming, and often ineffective in early-stage diagnosis. Other methods using specialized sensors and equipment to measure movement disorders are cumbersome and expensive, limiting their accessibility. This study introduces a hierarchical approach to evaluating gait dysfunction in PD through videos. The novel 2-Stream Spatial-Temporal Neural Network (2S-STNN) leverages the spatial-temporal features from the skeleton and silhouette streams for PD classification. This approach achieves an accuracy rate of 89% and outperforms other state-of-the-art models. The study also employs saliency values to highlight critical body regions that significantly influence model decisions and are severely affected by the disease. For a more detailed analysis, the study investigates 21 specific gait attributes for a nuanced quantification of gait disorders. Parameters such as walking pace, step length, and neck forward angle are found to be strongly correlated with PD gait severity categories. This approach offers a comprehensive and convenient solution for PD management in clinical settings, enabling patients to receive a more precise evaluation and monitoring of their gait impairments.
Collapse
Affiliation(s)
- Andrew Liang
- The Harker School, 500 Saratoga Ave, San Jose, 95129, USA.
| |
Collapse
|
2
|
Jeyasingh-Jacob J, Crook-Rumsey M, Shah H, Joseph T, Abulikemu S, Daniels S, Sharp DJ, Haar S. Markerless Motion Capture to Quantify Functional Performance in Neurodegeneration: Systematic Review. JMIR Aging 2024; 7:e52582. [PMID: 39106477 PMCID: PMC11336506 DOI: 10.2196/52582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Revised: 03/22/2024] [Accepted: 07/15/2024] [Indexed: 08/09/2024] Open
Abstract
BACKGROUND Markerless motion capture (MMC) uses video cameras or depth sensors for full body tracking and presents a promising approach for objectively and unobtrusively monitoring functional performance within community settings, to aid clinical decision-making in neurodegenerative diseases such as dementia. OBJECTIVE The primary objective of this systematic review was to investigate the application of MMC using full-body tracking, to quantify functional performance in people with dementia, mild cognitive impairment, and Parkinson disease. METHODS A systematic search of the Embase, MEDLINE, CINAHL, and Scopus databases was conducted between November 2022 and February 2023, which yielded a total of 1595 results. The inclusion criteria were MMC and full-body tracking. A total of 157 studies were included for full-text screening, out of which 26 eligible studies that met the selection criteria were included in the review. . RESULTS Primarily, the selected studies focused on gait analysis (n=24), while other functional tasks, such as sit to stand (n=5) and stepping in place (n=1), were also explored. However, activities of daily living were not evaluated in any of the included studies. MMC models varied across the studies, encompassing depth cameras (n=18) versus standard video cameras (n=5) or mobile phone cameras (n=2) with postprocessing using deep learning models. However, only 6 studies conducted rigorous comparisons with established gold-standard motion capture models. CONCLUSIONS Despite its potential as an effective tool for analyzing movement and posture in individuals with dementia, mild cognitive impairment, and Parkinson disease, further research is required to establish the clinical usefulness of MMC in quantifying mobility and functional performance in the real world.
Collapse
Affiliation(s)
- Julian Jeyasingh-Jacob
- Department of Brain Sciences, Imperial College London, London, United Kingdom
- Care Research and Technology Centre, UK Dementia Research Institute, Imperial College London, London, United Kingdom
| | - Mark Crook-Rumsey
- Care Research and Technology Centre, UK Dementia Research Institute, Imperial College London, London, United Kingdom
- Department of Basic and Clinical Neuroscience, King's College London, London, United Kingdom
| | - Harshvi Shah
- Department of Brain Sciences, Imperial College London, London, United Kingdom
- Care Research and Technology Centre, UK Dementia Research Institute, Imperial College London, London, United Kingdom
| | - Theresita Joseph
- Department of Brain Sciences, Imperial College London, London, United Kingdom
- Care Research and Technology Centre, UK Dementia Research Institute, Imperial College London, London, United Kingdom
| | - Subati Abulikemu
- Department of Brain Sciences, Imperial College London, London, United Kingdom
- Care Research and Technology Centre, UK Dementia Research Institute, Imperial College London, London, United Kingdom
| | - Sarah Daniels
- Department of Brain Sciences, Imperial College London, London, United Kingdom
- Care Research and Technology Centre, UK Dementia Research Institute, Imperial College London, London, United Kingdom
| | - David J Sharp
- Department of Brain Sciences, Imperial College London, London, United Kingdom
- Care Research and Technology Centre, UK Dementia Research Institute, Imperial College London, London, United Kingdom
| | - Shlomi Haar
- Department of Brain Sciences, Imperial College London, London, United Kingdom
- Care Research and Technology Centre, UK Dementia Research Institute, Imperial College London, London, United Kingdom
| |
Collapse
|
3
|
Sanders O, Wang B, Kontson K. Concurrent Validity Evidence for Pressure-Sensing Walkways Measuring Spatiotemporal Features of Gait: A Systematic Review and Meta-Analysis. SENSORS (BASEL, SWITZERLAND) 2024; 24:4537. [PMID: 39065933 PMCID: PMC11281155 DOI: 10.3390/s24144537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Revised: 06/29/2024] [Accepted: 07/03/2024] [Indexed: 07/28/2024]
Abstract
Technologies that capture and analyze movement patterns for diagnostic or therapeutic purposes are a major locus of innovation in the United States. Several studies have evaluated their measurement properties in different conditions with variable findings. To date, the authors are not aware of any systematic review of studies conducted to assess the concurrent validity of pressure-sensing walkway technologies. The results of such an analysis could establish the body of evidence needed to confidently use these systems as reference or gold-standard systems when validating novel tools or measures. A comprehensive search of electronic databases including MEDLINE, Embase, and Cumulative Index to Nursing and Allied Health Literature (CINAHL) was performed. The initial search yielded 7670 papers. After removing duplicates and applying study inclusion/exclusion criteria, 11 papers were included in the systematic review with 10 included in a meta-analysis. There were 25 spatial and temporal gait parameters extracted from the included studies. The results showed there was not a significant bias for nearly all spatiotemporal gait parameters when the walkway system was compared to the reference systems. The findings from this analysis should provide confidence in using the walkway systems as reference systems in future studies to support the evaluation and validation of novel technologies deriving gait parameters.
Collapse
Affiliation(s)
- Ozell Sanders
- Office of Product Evaluation and Quality, Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, MD 20993, USA;
| | - Bin Wang
- Office of Clinical Evaluation and Analysis, Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, MD 20993, USA;
| | - Kimberly Kontson
- Office of Science and Engineering Labs, Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, MD 20993, USA
| |
Collapse
|
4
|
Goree JH, Tobey-Moore LR, Petersen E, White C, Judkins D, Brown GA, Virmani T. Radiofrequency ablation for patients with lumbar spinal arthritis provides quantifiable improvement in gait velocity: a prospective study. Reg Anesth Pain Med 2024:rapm-2023-105244. [PMID: 38388011 DOI: 10.1136/rapm-2023-105244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Accepted: 02/13/2024] [Indexed: 02/24/2024]
Affiliation(s)
- Johnathan Heck Goree
- Anesthesiology, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA
| | - Leah R Tobey-Moore
- Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA
| | - Erika Petersen
- University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA
| | - Cale White
- Department of Physical Medical and Rehabilitation, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA
| | | | | | - Tuhin Virmani
- Department of Neurology, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA
| |
Collapse
|
5
|
Ino T, Samukawa M, Ishida T, Wada N, Koshino Y, Kasahara S, Tohyama H. Validity of AI-Based Gait Analysis for Simultaneous Measurement of Bilateral Lower Limb Kinematics Using a Single Video Camera. SENSORS (BASEL, SWITZERLAND) 2023; 23:9799. [PMID: 38139644 PMCID: PMC10747245 DOI: 10.3390/s23249799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 12/02/2023] [Accepted: 12/12/2023] [Indexed: 12/24/2023]
Abstract
Accuracy validation of gait analysis using pose estimation with artificial intelligence (AI) remains inadequate, particularly in objective assessments of absolute error and similarity of waveform patterns. This study aimed to clarify objective measures for absolute error and waveform pattern similarity in gait analysis using pose estimation AI (OpenPose). Additionally, we investigated the feasibility of simultaneous measuring both lower limbs using a single camera from one side. We compared motion analysis data from pose estimation AI using video footage that was synchronized with a three-dimensional motion analysis device. The comparisons involved mean absolute error (MAE) and the coefficient of multiple correlation (CMC) to compare the waveform pattern similarity. The MAE ranged from 2.3 to 3.1° on the camera side and from 3.1 to 4.1° on the opposite side, with slightly higher accuracy on the camera side. Moreover, the CMC ranged from 0.936 to 0.994 on the camera side and from 0.890 to 0.988 on the opposite side, indicating a "very good to excellent" waveform similarity. Gait analysis using a single camera revealed that the precision on both sides was sufficiently robust for clinical evaluation, while measurement accuracy was slightly superior on the camera side.
Collapse
Affiliation(s)
- Takumi Ino
- Graduate School of Health Sciences, Hokkaido University, Sapporo 0600812, Japan;
- Department of Physical Therapy, Faculty of Health Sciences, Hokkaido University of Science, Sapporo 0068585, Japan
| | - Mina Samukawa
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| | - Tomoya Ishida
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| | - Naofumi Wada
- Department of Information and Computer Science, Faculty of Engineering, Hokkaido University of Science, Sapporo 0068585, Japan;
| | - Yuta Koshino
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| | - Satoshi Kasahara
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| | - Harukazu Tohyama
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| |
Collapse
|
6
|
Sabo A, Iaboni A, Taati B, Fasano A, Gorodetsky C. Evaluating the ability of a predictive vision-based machine learning model to measure changes in gait in response to medication and DBS within individuals with Parkinson's disease. Biomed Eng Online 2023; 22:120. [PMID: 38082277 PMCID: PMC10714555 DOI: 10.1186/s12938-023-01175-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 11/19/2023] [Indexed: 12/18/2023] Open
Abstract
INTRODUCTION Gait impairments in Parkinson's disease (PD) are treated with dopaminergic medication or deep-brain stimulation (DBS), although the magnitude of the response is variable between individuals. Computer vision-based approaches have previously been evaluated for measuring the severity of parkinsonian gait in videos, but have not been evaluated for their ability to identify changes within individuals in response to treatment. This pilot study examines whether a vision-based model, trained on videos of parkinsonism, is able to detect improvement in parkinsonian gait in people with PD in response to medication and DBS use. METHODS A spatial-temporal graph convolutional model was trained to predict MDS-UPDRS-gait scores in 362 videos from 14 older adults with drug-induced parkinsonism. This model was then used to predict MDS-UPDRS-gait scores on a different dataset of 42 paired videos from 13 individuals with PD, recorded while ON and OFF medication and DBS treatment during the same clinical visit. Statistical methods were used to assess whether the model was responsive to changes in gait in the ON and OFF states. RESULTS The MDS-UPDRS-gait scores predicted by the model were lower on average (representing improved gait; p = 0.017, Cohen's d = 0.495) during the ON medication and DBS treatment conditions. The magnitude of the differences between ON and OFF state was significantly correlated between model predictions and clinician annotations (p = 0.004). The predicted scores were significantly correlated with the clinician scores (Kendall's tau-b = 0.301, p = 0.010), but were distributed in a smaller range as compared to the clinician scores. CONCLUSION A vision-based model trained on parkinsonian gait did not accurately predict MDS-UPDRS-gait scores in a different PD cohort, but detected weak, but statistically significant proportional changes in response to medication and DBS use. Large, clinically validated datasets of videos captured in many different settings and treatment conditions are required to develop accurate vision-based models of parkinsonian gait.
Collapse
Affiliation(s)
- Andrea Sabo
- KITE, Toronto Rehabilitation Institute, University Health Network, 550 University Avenue, Toronto, ON, M5G 2A2, Canada
| | - Andrea Iaboni
- KITE, Toronto Rehabilitation Institute, University Health Network, 550 University Avenue, Toronto, ON, M5G 2A2, Canada
- Department of Psychiatry, University of Toronto, 250 College Street, 8th Floor, Toronto, ON, M5T 1R8, Canada
- Centre for Mental Health, University Health Network, 33 Russell Street, Toronto, ON, M5S 2S1, Canada
| | - Babak Taati
- KITE, Toronto Rehabilitation Institute, University Health Network, 550 University Avenue, Toronto, ON, M5G 2A2, Canada
- Department of Computer Science, University of Toronto, 10 King's College Road, Room 3302, Toronto, ON, M5S 3G4, Canada
- Institute of Biomedical Engineering, University of Toronto, 164 College Street. Room 407, Toronto, ON, M2S 3G9, Canada
- Vector Institute, 661 University Ave Suite 710, Toronto, ON, M5G 1M1, Canada
| | - Alfonso Fasano
- KITE, Toronto Rehabilitation Institute, University Health Network, 550 University Avenue, Toronto, ON, M5G 2A2, Canada
- Division of Neurology, The Hospital for Sick Children, University of Toronto, 555 University Avenue, Toronto, ON, M5G 1X8, Canada
- Edmond J. Safra Program in Parkinson's Disease, Morton and Gloria Shulman Movement Disorders Clinic, Toronto Western Hospital, UHN, Toronto, ON, Canada
- Krembil Brain Institute, Toronto, ON, Canada
- CenteR for Advancing Neurotechnological Innovation to Application (CRANIA), Toronto, ON, Canada
| | - Carolina Gorodetsky
- Division of Neurology, The Hospital for Sick Children, University of Toronto, 555 University Avenue, Toronto, ON, M5G 1X8, Canada.
- Edmond J. Safra Program in Parkinson's Disease, Morton and Gloria Shulman Movement Disorders Clinic, Toronto Western Hospital, UHN, Toronto, ON, Canada.
| |
Collapse
|
7
|
Martínez-Zarzuela M, González-Alonso J, Antón-Rodríguez M, Díaz-Pernas FJ, Müller H, Simón-Martínez C. Multimodal video and IMU kinematic dataset on daily life activities using affordable devices. Sci Data 2023; 10:648. [PMID: 37737210 PMCID: PMC10516922 DOI: 10.1038/s41597-023-02554-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 09/08/2023] [Indexed: 09/23/2023] Open
Abstract
Human activity recognition and clinical biomechanics are challenging problems in physical telerehabilitation medicine. However, most publicly available datasets on human body movements cannot be used to study both problems in an out-of-the-lab movement acquisition setting. The objective of the VIDIMU dataset is to pave the way towards affordable patient gross motor tracking solutions for daily life activities recognition and kinematic analysis. The dataset includes 13 activities registered using a commodity camera and five inertial sensors. The video recordings were acquired in 54 subjects, of which 16 also had simultaneous recordings of inertial sensors. The novelty of dataset lies in: (i) the clinical relevance of the chosen movements, (ii) the combined utilization of affordable video and custom sensors, and (iii) the implementation of state-of-the-art tools for multimodal data processing of 3D body pose tracking and motion reconstruction in a musculoskeletal model from inertial data. The validation confirms that a minimally disturbing acquisition protocol, performed according to real-life conditions can provide a comprehensive picture of human joint angles during daily life activities.
Collapse
Affiliation(s)
| | | | | | | | - Henning Müller
- University of Applied Sciences and Arts Western Switzerland (HES-SO) Valais-Wallis, Sierre, Switzerland
- Medical faculty, University of Geneva, Geneva, Switzerland
| | - Cristina Simón-Martínez
- University of Applied Sciences and Arts Western Switzerland (HES-SO) Valais-Wallis, Sierre, Switzerland
| |
Collapse
|