1
|
Amin M, Martínez-Heras E, Ontaneda D, Prados Carrasco F. Artificial Intelligence and Multiple Sclerosis. Curr Neurol Neurosci Rep 2024; 24:233-243. [PMID: 38940994 PMCID: PMC11258192 DOI: 10.1007/s11910-024-01354-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/18/2024] [Indexed: 06/29/2024]
Abstract
In this paper, we analyse the different advances in artificial intelligence (AI) approaches in multiple sclerosis (MS). AI applications in MS range across investigation of disease pathogenesis, diagnosis, treatment, and prognosis. A subset of AI, Machine learning (ML) models analyse various data sources, including magnetic resonance imaging (MRI), genetic, and clinical data, to distinguish MS from other conditions, predict disease progression, and personalize treatment strategies. Additionally, AI models have been extensively applied to lesion segmentation, identification of biomarkers, and prediction of outcomes, disease monitoring, and management. Despite the big promises of AI solutions, model interpretability and transparency remain critical for gaining clinician and patient trust in these methods. The future of AI in MS holds potential for open data initiatives that could feed ML models and increasing generalizability, the implementation of federated learning solutions for training the models addressing data sharing issues, and generative AI approaches to address challenges in model interpretability, and transparency. In conclusion, AI presents an opportunity to advance our understanding and management of MS. AI promises to aid clinicians in MS diagnosis and prognosis improving patient outcomes and quality of life, however ensuring the interpretability and transparency of AI-generated results is going to be key for facilitating the integration of AI into clinical practice.
Collapse
Affiliation(s)
- Moein Amin
- Mellen Center for Multiple Sclerosis Treatment and Research, Cleveland Clinic, Cleveland, OH, USA
| | - Eloy Martínez-Heras
- Neuroimmunology and Multiple Sclerosis Unit, Laboratory of Advanced Imaging in Neuroimmunological Diseases, Hospital Clinic Barcelona, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Universitat de Barcelona, Barcelona, Spain
| | - Daniel Ontaneda
- Mellen Center for Multiple Sclerosis Treatment and Research, Cleveland Clinic, Cleveland, OH, USA
| | - Ferran Prados Carrasco
- e-Health Center, Universitat Oberta de Catalunya, Barcelona, Spain.
- Queen Square MS Centre, Department of Neuroinflammation, UCL Institute of Neurology, Faculty of Brain Sciences, University College London, London, UK.
- Center for Medical Image Computing, University College London, London, UK.
- National Institute for Health Research Biomedical Research Centre at UCL and UCLH, London, UK.
| |
Collapse
|
2
|
Amprimo G, Masi G, Olmo G, Ferraris C. Deep Learning for hand tracking in Parkinson's Disease video-based assessment: Current and future perspectives. Artif Intell Med 2024; 154:102914. [PMID: 38909431 DOI: 10.1016/j.artmed.2024.102914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 05/19/2024] [Accepted: 05/21/2024] [Indexed: 06/25/2024]
Abstract
BACKGROUND Parkinson's Disease (PD) demands early diagnosis and frequent assessment of symptoms. In particular, analysing hand movements is pivotal to understand disease progression. Advancements in hand tracking using Deep Learning (DL) allow for the automatic and objective disease evaluation from video recordings of standardised motor tasks, which are the foundation of neurological examinations. In view of this scenario, this narrative review aims to describe the state of the art and the future perspective of DL frameworks for hand tracking in video-based PD assessment. METHODS A rigorous search of PubMed, Web of Science, IEEE Explorer, and Scopus until October 2023 using primary keywords such as parkinson, hand tracking, and deep learning was performed to select eligible by focusing on video-based PD assessment through DL-driven hand tracking frameworks RESULTS:: After accurate screening, 23 publications met the selection criteria. These studies used various solutions, from well-established pose estimation frameworks, like OpenPose and MediaPipe, to custom deep architectures designed to accurately track hand and finger movements and extract relevant disease features. Estimated hand tracking data were then used to differentiate PD patients from healthy individuals, characterise symptoms such as tremors and bradykinesia, or regress the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) by automatically assessing clinical tasks such as finger tapping, hand movements, and pronation-supination. CONCLUSIONS DL-driven hand tracking holds promise for PD assessment, offering precise, objective measurements for early diagnosis and monitoring, especially in a telemedicine scenario. However, to ensure clinical acceptance, standardisation and validation are crucial. Future research should prioritise large open datasets, rigorous validation on patients, and the investigation of new frontiers such as tracking hand-hand and hand-object interactions for daily-life tasks assessment.
Collapse
Affiliation(s)
- Gianluca Amprimo
- Politecnico di Torino - Control and Computer Engineering Department, Corso Duca degli Abruzzi, 24, Turin, 10129, Italy; National Research Council - Institute of Electronics, Information Engineering and Telecommunications, Corso Duca degli Abruzzi, 24, Turin, 10029, Italy.
| | - Giulia Masi
- Politecnico di Torino - Control and Computer Engineering Department, Corso Duca degli Abruzzi, 24, Turin, 10129, Italy. https://www.researchgate.net/profile/Giulia-Masi-2
| | - Gabriella Olmo
- Politecnico di Torino - Control and Computer Engineering Department, Corso Duca degli Abruzzi, 24, Turin, 10129, Italy. https://www.sysbio.polito.it/analytics-technologies-health/
| | - Claudia Ferraris
- National Research Council - Institute of Electronics, Information Engineering and Telecommunications, Corso Duca degli Abruzzi, 24, Turin, 10029, Italy. https://www.ieiit.cnr.it/people/Ferraris-Claudia
| |
Collapse
|
3
|
Ferrer-Mallol E, Matthews C, Aziza R, Mendoza A, Sahota N, Komarzynski S, Lakshminarayana R, Davies EH. Video-based assessments of activities of daily living: generating real-world evidence in pediatric rare diseases. Expert Rev Pharmacoecon Outcomes Res 2024; 24:713-721. [PMID: 38789406 DOI: 10.1080/14737167.2024.2360201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2024] [Accepted: 05/22/2024] [Indexed: 05/26/2024]
Abstract
INTRODUCTION Preserving function and independence to perform activities of daily living (ADL) is critical for patients and carers to manage the burden of care and improve quality of life. In children living with rare diseases, video recording ADLs offer the opportunity to collect the patients' experience in a real-life setting and accurately reflect treatment effectiveness on outcomes that matter to patients and families. AREAS COVERED We reviewed the measurement of ADL in pediatric rare diseases and the use of video to develop at-home electronic clinical outcome assessments (eCOA) by leveraging smartphone apps and artificial intelligence-based analysis. We broadly searched PubMed using Boolean combinations of the following MeSH terms 'Rare Diseases,' 'Quality of Life,' 'Activities of Daily Living,' 'Child,' 'Video Recording,' 'Outcome Assessment, Healthcare,' 'Intellectual disability,' and 'Genetic Diseases, Inborn.' Non-controlled vocabulary was used to include human pose estimation in movement analysis. EXPERT OPINION Broad uptake of video eCOA in drug development is linked to the generation of technical and clinical validation evidence to confidently assess a patient's functional abilities. Software platforms handling video data must align with quality regulations to ensure data integrity, security, and privacy. Regulatory flexibility and optimized validation processes should facilitate video eCOA to support benefit/risk drug assessment.
Collapse
|
4
|
Haberfehlner H, Roth Z, Vanmechelen I, Buizer AI, Jeroen Vermeulen R, Koy A, Aerts JM, Hallez H, Monbaliu E. A Novel Video-Based Methodology for Automated Classification of Dystonia and Choreoathetosis in Dyskinetic Cerebral Palsy During a Lower Extremity Task. Neurorehabil Neural Repair 2024; 38:479-492. [PMID: 38842031 DOI: 10.1177/15459683241257522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2024]
Abstract
BACKGROUND Movement disorders in children and adolescents with dyskinetic cerebral palsy (CP) are commonly assessed from video recordings, however scoring is time-consuming and expert knowledge is required for an appropriate assessment. OBJECTIVE To explore a machine learning approach for automated classification of amplitude and duration of distal leg dystonia and choreoathetosis within short video sequences. METHODS Available videos of a heel-toe tapping task were preprocessed to optimize key point extraction using markerless motion analysis. Postprocessed key point data were passed to a time series classification ensemble algorithm to classify dystonia and choreoathetosis duration and amplitude classes (scores 0, 1, 2, 3, and 4), respectively. As ground truth clinical scoring of dystonia and choreoathetosis by the Dyskinesia Impairment Scale was used. Multiclass performance metrics as well as metrics for summarized scores: absence (score 0) and presence (score 1-4) were determined. RESULTS Thirty-three participants were included: 29 with dyskinetic CP and 4 typically developing, age 14 years:6 months ± 5 years:15 months. The multiclass accuracy results for dystonia were 77% for duration and 68% for amplitude; for choreoathetosis 30% for duration and 38% for amplitude. The metrics for score 0 versus score 1 to 4 revealed an accuracy of 81% for dystonia duration, 77% for dystonia amplitude, 53% for choreoathetosis duration and amplitude. CONCLUSIONS This methodology study yielded encouraging results in distinguishing between presence and absence of dystonia, but not for choreoathetosis. A larger dataset is required for models to accurately represent distinct classes/scores. This study presents a novel methodology of automated assessment of movement disorders solely from video data.
Collapse
Affiliation(s)
- Helga Haberfehlner
- Department of Rehabilitation Sciences, KU Leuven Bruges, Bruges, Belgium
- Department of Rehabilitation Sciences, KU Leuven, Leuven, Belgium
- Amsterdam UMC, Vrije Universiteit Amsterdam, Department of Rehabilitation Medicine, Amsterdam, The Netherlands
- Amsterdam Movement Sciences, Rehabilitation & Development, Amsterdam, The Netherlands
| | - Zachary Roth
- Department of Rehabilitation Sciences, KU Leuven Bruges, Bruges, Belgium
- Department of Rehabilitation Sciences, KU Leuven, Leuven, Belgium
| | - Inti Vanmechelen
- Department of Rehabilitation Sciences, KU Leuven Bruges, Bruges, Belgium
- Department of Rehabilitation Sciences, KU Leuven, Leuven, Belgium
| | - Annemieke I Buizer
- Amsterdam UMC, Vrije Universiteit Amsterdam, Department of Rehabilitation Medicine, Amsterdam, The Netherlands
- Amsterdam Movement Sciences, Rehabilitation & Development, Amsterdam, The Netherlands
- Amsterdam UMC, Emma Children's Hospital, Amsterdam, The Netherlands
| | | | - Anne Koy
- Department of Pediatrics, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Jean-Marie Aerts
- Department of Computer Science, Mechatronics Research Group (M-Group), KU Leuven Bruges, Distrinet, Bruges, Belgium
| | - Hans Hallez
- Department of Biosystems, Division of Animal and Human Health Engineering, Measure, Model and Manage Bioresponse (M3-BIORES), KU Leuven, Leuven, Belgium
| | - Elegast Monbaliu
- Department of Rehabilitation Sciences, KU Leuven Bruges, Bruges, Belgium
- Department of Rehabilitation Sciences, KU Leuven, Leuven, Belgium
| |
Collapse
|
5
|
Guarin DL, Wong JK, McFarland NR, Ramirez-Zamora A. Characterizing Disease Progression in Parkinson's Disease from Videos of the Finger Tapping Test. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2293-2301. [PMID: 38905096 PMCID: PMC11260436 DOI: 10.1109/tnsre.2024.3416446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/23/2024]
Abstract
INTRODUCTION Parkinson's disease (PD) is characterized by motor symptoms whose progression is typically assessed using clinical scales, namely the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS). Despite its reliability, the scale is bounded by a 5-point scale that limits its ability to track subtle changes in disease progression and is prone to subjective interpretations. We aimed to develop an automated system to objectively quantify motor symptoms in PD using Machine Learning (ML) algorithms to analyze videos and capture nuanced features of disease progression. METHODS We analyzed videos of the Finger Tapping test, a component of the MDS-UPDRS, from 24 healthy controls and 66 PD patients using ML algorithms for hand pose estimation. We computed multiple movement features related to bradykinesia from videos and employed a novel tiered classification approach to predict disease severity that employed different features according to severity. We compared our video-based disease severity prediction approach against other approaches recently introduced in the literature. RESULTS Traditional kinematics features such as amplitude and velocity changed linearly with disease severity, while other non-traditional features displayed non-linear trends. The proposed disease severity prediction approach demonstrated superior accuracy in detecting PD and distinguishing between different levels of disease severity when compared to existing approaches.
Collapse
|
6
|
Mifsud J, Embry KR, Macaluso R, Lonini L, Cotton RJ, Simuni T, Jayaraman A. Detecting the symptoms of Parkinson's disease with non-standard video. J Neuroeng Rehabil 2024; 21:72. [PMID: 38702705 PMCID: PMC11067123 DOI: 10.1186/s12984-024-01362-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 04/20/2024] [Indexed: 05/06/2024] Open
Abstract
BACKGROUND Neurodegenerative diseases, such as Parkinson's disease (PD), necessitate frequent clinical visits and monitoring to identify changes in motor symptoms and provide appropriate care. By applying machine learning techniques to video data, automated video analysis has emerged as a promising approach to track and analyze motor symptoms, which could facilitate more timely intervention. However, existing solutions often rely on specialized equipment and recording procedures, which limits their usability in unstructured settings like the home. In this study, we developed a method to detect PD symptoms from unstructured videos of clinical assessments, without the need for specialized equipment or recording procedures. METHODS Twenty-eight individuals with Parkinson's disease completed a video-recorded motor examination that included the finger-to-nose and hand pronation-supination tasks. Clinical staff provided ground truth scores for the level of Parkinsonian symptoms present. For each video, we used a pre-existing model called PIXIE to measure the location of several joints on the person's body and quantify how they were moving. Features derived from the joint angles and trajectories, designed to be robust to recording angle, were then used to train two types of machine-learning classifiers (random forests and support vector machines) to detect the presence of PD symptoms. RESULTS The support vector machine trained on the finger-to-nose task had an F1 score of 0.93 while the random forest trained on the same task yielded an F1 score of 0.85. The support vector machine and random forest trained on the hand pronation-supination task had F1 scores of 0.20 and 0.33, respectively. CONCLUSION These results demonstrate the feasibility of developing video analysis tools to track motor symptoms across variable perspectives. These tools do not work equally well for all tasks, however. This technology has the potential to overcome barriers to access for many individuals with degenerative neurological diseases like PD, providing them with a more convenient and timely method to monitor symptom progression, without requiring a structured video recording procedure. Ultimately, more frequent and objective home assessments of motor function could enable more precise telehealth optimization of interventions to improve clinical outcomes inside and outside of the clinic.
Collapse
Affiliation(s)
- Joseph Mifsud
- Max Näder Center for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
| | - Kyle R Embry
- Max Näder Center for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
- Northwestern University, Chicago, IL, USA
| | - Rebecca Macaluso
- Max Näder Center for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
| | - Luca Lonini
- Max Näder Center for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
- Northwestern University, Chicago, IL, USA
| | - R James Cotton
- Northwestern University, Chicago, IL, USA
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, USA
| | | | - Arun Jayaraman
- Max Näder Center for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA.
- Northwestern University, Chicago, IL, USA.
| |
Collapse
|
7
|
Canoro V, Picillo M, Cuoco S, Pellecchia MT, Barone P, Erro R. Development of the Digital Inclusion Questionnaire (DIQUEST) in Parkinson's Disease. Neurol Sci 2024; 45:1063-1069. [PMID: 37843691 PMCID: PMC10857963 DOI: 10.1007/s10072-023-07090-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 09/21/2023] [Indexed: 10/17/2023]
Abstract
BACKGROUND No tool is currently able to measure digital inclusion in clinical populations suitable for telemedicine. We developed the "Digital Inclusion Questionnaire" (DIQUEST) to estimate access and skills in Parkinson's Disease (PD) patients and verified its properties with a pilot study. METHODS Thirty PD patients completed the initial version of the DIQUEST along with the Mobile Device Proficiency Questionnaire (MDPQ) and a practical computer task. A Principal Components Analysis (PCA) was conducted to define the DIQUEST factor structure and remove less informative items. We used Cronbach's α to measure internal reliability and Spearman's correlation test to determine the convergent and predictive validity with the MDPQ and the practical task, respectively. RESULTS The final version of the DIQUEST consisted of 20 items clustering in five components: "advanced skills," "navigation skills," "basic skills/knowledge," "physical access," and "economical access." All components showed high reliability (α > 0.75) as did the entire questionnaire (α = 0.94). Correlation analysis demonstrated high convergent (rho: 0.911; p<0.001) and predictive (rho: 0.807; p<0.001) validity. CONCLUSIONS We have here presented the development of the DIQUEST as a screening tool to assess the level of digital inclusion, particularly addressing the access and skills domains. Future studies are needed for its validation beyond PD.
Collapse
Affiliation(s)
- Vincenzo Canoro
- Department of Medicine, Surgery and Dentistry "Scuola Medica Salernitana", Neuroscience Section, 84081, Baronissi, SA, Italy
| | - Marina Picillo
- Department of Medicine, Surgery and Dentistry "Scuola Medica Salernitana", Neuroscience Section, 84081, Baronissi, SA, Italy
| | - Sofia Cuoco
- Department of Medicine, Surgery and Dentistry "Scuola Medica Salernitana", Neuroscience Section, 84081, Baronissi, SA, Italy
| | - Maria Teresa Pellecchia
- Department of Medicine, Surgery and Dentistry "Scuola Medica Salernitana", Neuroscience Section, 84081, Baronissi, SA, Italy
| | - Paolo Barone
- Department of Medicine, Surgery and Dentistry "Scuola Medica Salernitana", Neuroscience Section, 84081, Baronissi, SA, Italy
| | - Roberto Erro
- Department of Medicine, Surgery and Dentistry "Scuola Medica Salernitana", Neuroscience Section, 84081, Baronissi, SA, Italy.
| |
Collapse
|
8
|
Yang YY, Ho MY, Tai CH, Wu RM, Kuo MC, Tseng YJ. FastEval Parkinsonism: an instant deep learning-assisted video-based online system for Parkinsonian motor symptom evaluation. NPJ Digit Med 2024; 7:31. [PMID: 38332372 PMCID: PMC10853559 DOI: 10.1038/s41746-024-01022-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Accepted: 01/18/2024] [Indexed: 02/10/2024] Open
Abstract
The Motor Disorder Society's Unified Parkinson's Disease Rating Scale (MDS-UPDRS) is designed to assess bradykinesia, the cardinal symptoms of Parkinson's disease (PD). However, it cannot capture the all-day variability of bradykinesia outside the clinical environment. Here, we introduce FastEval Parkinsonism ( https://fastevalp.cmdm.tw/ ), a deep learning-driven video-based system, providing users to capture keypoints, estimate the severity, and summarize in a report. Leveraging 840 finger-tapping videos from 186 individuals (103 patients with Parkinson's disease (PD), 24 participants with atypical parkinsonism (APD), 12 elderly with mild parkinsonism signs (MPS), and 47 healthy controls (HCs)), we employ a dilated convolution neural network with two data augmentation techniques. Our model achieves acceptable accuracies (AAC) of 88.0% and 81.5%. The frequency-intensity (FI) value of thumb-index finger distance was indicated as a pivotal hand parameter to quantify the performance. Our model also shows the usability for multi-angle videos, tested in an external database enrolling over 300 PD patients.
Collapse
Affiliation(s)
- Yu-Yuan Yang
- Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, No. 1 Roosevelt Rd. Sec. 4, Taipei, 10617, Taiwan, ROC
| | - Ming-Yang Ho
- Department of Computer Science and Information Engineering, National Taiwan University, No. 1 Roosevelt Rd. Sec. 4, Taipei, 10617, Taiwan, ROC
| | - Chung-Hwei Tai
- Department of Neurology, National Taiwan University Hospital, No. 1 Changde St., Zhongzheng Dist., Taipei City, 100229, Taiwan, ROC
| | - Ruey-Meei Wu
- Department of Medicine, National Taiwan University Cancer Center, No. 57, Lane 155, Sec. 3, Keelung Rd., Da'an Dist., Taipei City, 106, Taiwan, ROC
| | - Ming-Che Kuo
- Department of Neurology, National Taiwan University Hospital, No. 1 Changde St., Zhongzheng Dist., Taipei City, 100229, Taiwan, ROC.
- Department of Medicine, National Taiwan University Cancer Center, No. 57, Lane 155, Sec. 3, Keelung Rd., Da'an Dist., Taipei City, 106, Taiwan, ROC.
| | - Yufeng Jane Tseng
- Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, No. 1 Roosevelt Rd. Sec. 4, Taipei, 10617, Taiwan, ROC.
- Department of Computer Science and Information Engineering, National Taiwan University, No. 1 Roosevelt Rd. Sec. 4, Taipei, 10617, Taiwan, ROC.
| |
Collapse
|
9
|
Morgan C, Tonkin EL, Masullo A, Jovan F, Sikdar A, Khaire P, Mirmehdi M, McConville R, Tourte GJL, Whone A, Craddock I. A multimodal dataset of real world mobility activities in Parkinson's disease. Sci Data 2023; 10:918. [PMID: 38123584 PMCID: PMC10733419 DOI: 10.1038/s41597-023-02663-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 10/19/2023] [Indexed: 12/23/2023] Open
Abstract
Parkinson's disease (PD) is a neurodegenerative disorder characterised by motor symptoms such as gait dysfunction and postural instability. Technological tools to continuously monitor outcomes could capture the hour-by-hour symptom fluctuations of PD. Development of such tools is hampered by the lack of labelled datasets from home settings. To this end, we propose REMAP (REal-world Mobility Activities in Parkinson's disease), a human rater-labelled dataset collected in a home-like setting. It includes people with and without PD doing sit-to-stand transitions and turns in gait. These discrete activities are captured from periods of free-living (unobserved, unstructured) and during clinical assessments. The PD participants withheld their dopaminergic medications for a time (causing increased symptoms), so their activities are labelled as being "on" or "off" medications. Accelerometry from wrist-worn wearables and skeleton pose video data is included. We present an open dataset, where the data is coarsened to reduce re-identifiability, and a controlled dataset available on application which contains more refined data. A use-case for the data to estimate sit-to-stand speed and duration is illustrated.
Collapse
Affiliation(s)
- Catherine Morgan
- Movement Disorders Group, Bristol Brain Centre, North Bristol NHS Trust, Southmead Hospital, Southmead Road, Bristol, BS10 5NB, UK
- Translational Health Sciences, University of Bristol, 5 Tyndall Ave, Bristol, BS8 1UD, UK
| | - Emma L Tonkin
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK.
| | - Alessandro Masullo
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK
| | - Ferdian Jovan
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK
- School of Natural and Computing Sciences, University of Aberdeen, Aberdeen, UK
| | - Arindam Sikdar
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK
- Edge Hill University, Ormskirk, UK
| | - Pushpajit Khaire
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK
- Datta Meghe Institute of Higher Education and Research, Wardha, India
| | - Majid Mirmehdi
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK
| | - Ryan McConville
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK
| | - Gregory J L Tourte
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK
- Advanced Research Computing, University of Oxford, Oxford, UK
| | - Alan Whone
- Movement Disorders Group, Bristol Brain Centre, North Bristol NHS Trust, Southmead Hospital, Southmead Road, Bristol, BS10 5NB, UK
- Translational Health Sciences, University of Bristol, 5 Tyndall Ave, Bristol, BS8 1UD, UK
| | - Ian Craddock
- Faculty of Engineering, University of Bristol, Digital Health Offices, 1 Cathedral Square, Bristol, BS1 5DD, UK
| |
Collapse
|
10
|
Lanotte F, O’Brien MK, Jayaraman A. AI in Rehabilitation Medicine: Opportunities and Challenges. Ann Rehabil Med 2023; 47:444-458. [PMID: 38093518 PMCID: PMC10767220 DOI: 10.5535/arm.23131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 11/23/2023] [Indexed: 01/03/2024] Open
Abstract
Artificial intelligence (AI) tools are increasingly able to learn from larger and more complex data, thus allowing clinicians and scientists to gain new insights from the information they collect about their patients every day. In rehabilitation medicine, AI can be used to find patterns in huge amounts of healthcare data. These patterns can then be leveraged at the individual level, to design personalized care strategies and interventions to optimize each patient's outcomes. However, building effective AI tools requires many careful considerations about how we collect and handle data, how we train the models, and how we interpret results. In this perspective, we discuss some of the current opportunities and challenges for AI in rehabilitation. We first review recent trends in AI for the screening, diagnosis, treatment, and continuous monitoring of disease or injury, with a special focus on the different types of healthcare data used for these applications. We then examine potential barriers to designing and integrating AI into the clinical workflow, and we propose an end-to-end framework to address these barriers and guide the development of effective AI for rehabilitation. Finally, we present ideas for future work to pave the way for AI implementation in real-world rehabilitation practices.
Collapse
Affiliation(s)
- Francesco Lanotte
- Max Nader Lab for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, United States
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, United States
| | - Megan K. O’Brien
- Max Nader Lab for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, United States
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, United States
| | - Arun Jayaraman
- Max Nader Lab for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, United States
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, United States
| |
Collapse
|
11
|
Tam W, Alajlani M, Abd-Alrazaq A. An Exploration of Wearable Device Features Used in UK Hospital Parkinson Disease Care: Scoping Review. J Med Internet Res 2023; 25:e42950. [PMID: 37594791 PMCID: PMC10474516 DOI: 10.2196/42950] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Revised: 03/13/2023] [Accepted: 04/14/2023] [Indexed: 08/19/2023] Open
Abstract
BACKGROUND The prevalence of Parkinson disease (PD) is becoming an increasing concern owing to the aging population in the United Kingdom. Wearable devices have the potential to improve the clinical care of patients with PD while reducing health care costs. Consequently, exploring the features of these wearable devices is important to identify the limitations and further areas of investigation of how wearable devices are currently used in clinical care in the United Kingdom. OBJECTIVE In this scoping review, we aimed to explore the features of wearable devices used for PD in hospitals in the United Kingdom. METHODS A scoping review of the current research was undertaken and reported according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. The literature search was undertaken on June 6, 2022, and publications were obtained from MEDLINE or PubMed, Embase, and the Cochrane Library. Eligible publications were initially screened by their titles and abstracts. Publications that passed the initial screening underwent a full review. The study characteristics were extracted from the final publications, and the evidence was synthesized using a narrative approach. Any queries were reviewed by the first and second authors. RESULTS Of the 4543 publications identified, 39 (0.86%) publications underwent a full review, and 20 (0.44%) publications were included in the scoping review. Most studies (11/20, 55%) were conducted at the Newcastle upon Tyne Hospitals NHS Foundation Trust, with sample sizes ranging from 10 to 418. Most study participants were male individuals with a mean age ranging from 57.7 to 78.0 years. The AX3 was the most popular device brand used, and it was commercially manufactured by Axivity. Common wearable device types included body-worn sensors, inertial measurement units, and smartwatches that used accelerometers and gyroscopes to measure the clinical features of PD. Most wearable device primary measures involved the measured gait, bradykinesia, and dyskinesia. The most common wearable device placements were the lumbar region, head, and wrist. Furthermore, 65% (13/20) of the studies used artificial intelligence or machine learning to support PD data analysis. CONCLUSIONS This study demonstrated that wearable devices could help provide a more detailed analysis of PD symptoms during the assessment phase and personalize treatment. Using machine learning, wearable devices could differentiate PD from other neurodegenerative diseases. The identified evidence gaps include the lack of analysis of wearable device cybersecurity and data management. The lack of cost-effectiveness analysis and large-scale participation in studies resulted in uncertainty regarding the feasibility of the widespread use of wearable devices. The uncertainty around the identified research gaps was further exacerbated by the lack of medical regulation of wearable devices for PD, particularly in the United Kingdom where regulations were changing due to the political landscape.
Collapse
Affiliation(s)
- William Tam
- Insitute of Digital Healthcare, Warwick Manufacturing Group, University of Warwick, Coventry, United Kingdom
| | - Mohannad Alajlani
- Insitute of Digital Healthcare, Warwick Manufacturing Group, University of Warwick, Coventry, United Kingdom
| | | |
Collapse
|
12
|
Morinan G, Dushin Y, Sarapata G, Rupprechter S, Peng Y, Girges C, Salazar M, Milabo C, Sibley K, Foltynie T, Cociasu I, Ricciardi L, Baig F, Morgante F, Leyland LA, Weil RS, Gilron R, O’Keeffe J. Computer vision quantification of whole-body Parkinsonian bradykinesia using a large multi-site population. NPJ Parkinsons Dis 2023; 9:10. [PMID: 36707523 PMCID: PMC9883391 DOI: 10.1038/s41531-023-00454-8] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Accepted: 01/13/2023] [Indexed: 01/28/2023] Open
Abstract
Parkinson's disease (PD) is a common neurological disorder, with bradykinesia being one of its cardinal features. Objective quantification of bradykinesia using computer vision has the potential to standardise decision-making, for patient treatment and clinical trials, while facilitating remote assessment. We utilised a dataset of part-3 MDS-UPDRS motor assessments, collected at four independent clinical and one research sites on two continents, to build computer-vision-based models capable of inferring the correct severity rating robustly and consistently across all identifiable subgroups of patients. These results contrast with previous work limited by small sample sizes and small numbers of sites. Our bradykinesia estimation corresponded well with clinician ratings (interclass correlation 0.74). This agreement was consistent across four clinical sites. This result demonstrates how such technology can be successfully deployed into existing clinical workflows, with consumer-grade smartphone or tablet devices, adding minimal equipment cost and time.
Collapse
Affiliation(s)
- Gareth Morinan
- Machine Medicine Technologies Ltd., The Leather Market Unit 1.1.1 11/13 Weston Street, London, SE1 3ER UK
| | - Yuriy Dushin
- Machine Medicine Technologies Ltd., The Leather Market Unit 1.1.1 11/13 Weston Street, London, SE1 3ER, UK.
| | - Grzegorz Sarapata
- Machine Medicine Technologies Ltd., The Leather Market Unit 1.1.1 11/13 Weston Street, London, SE1 3ER UK
| | - Samuel Rupprechter
- Machine Medicine Technologies Ltd., The Leather Market Unit 1.1.1 11/13 Weston Street, London, SE1 3ER UK
| | - Yuwei Peng
- Machine Medicine Technologies Ltd., The Leather Market Unit 1.1.1 11/13 Weston Street, London, SE1 3ER UK
| | - Christine Girges
- grid.436283.80000 0004 0612 2631Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, Queen Square, London, WC1N 3BG UK
| | - Maricel Salazar
- grid.436283.80000 0004 0612 2631Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, Queen Square, London, WC1N 3BG UK
| | - Catherine Milabo
- grid.436283.80000 0004 0612 2631Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, Queen Square, London, WC1N 3BG UK
| | - Krista Sibley
- grid.436283.80000 0004 0612 2631Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, Queen Square, London, WC1N 3BG UK
| | - Thomas Foltynie
- grid.436283.80000 0004 0612 2631Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, Queen Square, London, WC1N 3BG UK
| | - Ioana Cociasu
- grid.264200.20000 0000 8546 682XNeuroscience Research Centre, Molecular and Clinical Sciences Research Institute, St George’s, University of London, Cranmer Terrace, London, SW17 0RE UK
| | - Lucia Ricciardi
- grid.264200.20000 0000 8546 682XNeuroscience Research Centre, Molecular and Clinical Sciences Research Institute, St George’s, University of London, Cranmer Terrace, London, SW17 0RE UK
| | - Fahd Baig
- grid.264200.20000 0000 8546 682XNeuroscience Research Centre, Molecular and Clinical Sciences Research Institute, St George’s, University of London, Cranmer Terrace, London, SW17 0RE UK
| | - Francesca Morgante
- grid.264200.20000 0000 8546 682XNeuroscience Research Centre, Molecular and Clinical Sciences Research Institute, St George’s, University of London, Cranmer Terrace, London, SW17 0RE UK ,grid.10438.3e0000 0001 2178 8421Department of Clinical and Experimental Medicine, University of Messina, Messina, Italy, Via Consolare Valeria, 98165 Messina, Italy
| | - Louise-Ann Leyland
- grid.436283.80000 0004 0612 2631Dementia Research Center, Institute of Neurology, University College London, Queen Square, London, WC1N 3AR UK
| | - Rimona S. Weil
- grid.436283.80000 0004 0612 2631Dementia Research Center, Institute of Neurology, University College London, Queen Square, London, WC1N 3AR UK
| | - Ro’ee Gilron
- grid.266102.10000 0001 2297 6811The Starr Lab, University of California San Francisco, 513 Parnassus Ave, HSE-823, San Francisco, CA 94143 USA
| | - Jonathan O’Keeffe
- Machine Medicine Technologies Ltd., The Leather Market Unit 1.1.1 11/13 Weston Street, London, SE1 3ER UK
| |
Collapse
|
13
|
Goh L, Paul SS, Canning CG, Ehgoetz Martens KA, Song J, Campoy SL, Allen NE. The Ziegler Test Is Reliable and Valid for Measuring Freezing of Gait in People With Parkinson Disease. Phys Ther 2022; 102:pzac122. [PMID: 36130220 PMCID: PMC10071484 DOI: 10.1093/ptj/pzac122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 05/06/2022] [Accepted: 09/07/2022] [Indexed: 11/13/2022]
Abstract
OBJECTIVE The purpose of this study was to determine interrater and test-retest reliability of the Ziegler test to measure freezing of gait (FOG) severity in people with Parkinson disease. Secondary aims were to evaluate test validity and explore Ziegler test duration as a proxy FOG severity measure. METHODS Physical therapists watched 36 videos of people with Parkinson disease and FOG perform the Ziegler test and rated FOG severity using the rating scale in real time. Two researchers rated 12 additional videos and repeated the ratings at least 1 week later. Interrater and test-retest reliability were calculated using intraclass correlation coefficients (ICCs). Bland-Altman plots were used to visualize agreement between the researchers for test-retest reliability. Correlations between the Ziegler scores, Ziegler test duration, and percentage of time frozen (based on video annotations) were determined using Pearson r. RESULTS Twenty-four physical therapists participated. Overall, the Ziegler test showed good interrater (ICC2,1 = 0.80; 95% CI = 0.65-0.92) and excellent test-retest (ICC3,1 = 0.91; 95% CI = 0.82-0.96) reliability when used to measure FOG. It was also a valid measure, with a high correlation (r = 0.72) between the scores and percentage of time frozen. Ziegler test duration was moderately correlated (r = 0.67) with percentage of time frozen and may be considered a proxy FOG severity measure. CONCLUSION The Ziegler test is a reliable and valid tool to measure FOG when used by physical therapists in real time. Ziegler test duration may be used as a proxy for measuring FOG severity. IMPACT Despite FOG being a significant contributor to falls and poor mobility in people with Parkinson disease, current tools to assess FOG are either not suitably responsive or too resource intensive for use in clinical settings. The Ziegler test is a reliable and valid measure of FOG, suitable for clinical use, and may be used by physical therapists regardless of their level of clinical experience.
Collapse
Affiliation(s)
- Lina Goh
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Serene S Paul
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Colleen G Canning
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | | | - Jooeun Song
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Stephanie L Campoy
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Natalie E Allen
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
14
|
Rana A, Dumka A, Singh R, Panda MK, Priyadarshi N. A Computerized Analysis with Machine Learning Techniques for the Diagnosis of Parkinson's Disease: Past Studies and Future Perspectives. Diagnostics (Basel) 2022; 12:2708. [PMID: 36359550 PMCID: PMC9689408 DOI: 10.3390/diagnostics12112708] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 10/30/2022] [Accepted: 11/02/2022] [Indexed: 08/03/2023] Open
Abstract
According to the World Health Organization (WHO), Parkinson's disease (PD) is a neurodegenerative disease of the brain that causes motor symptoms including slower movement, rigidity, tremor, and imbalance in addition to other problems like Alzheimer's disease (AD), psychiatric problems, insomnia, anxiety, and sensory abnormalities. Techniques including artificial intelligence (AI), machine learning (ML), and deep learning (DL) have been established for the classification of PD and normal controls (NC) with similar therapeutic appearances in order to address these problems and improve the diagnostic procedure for PD. In this article, we examine a literature survey of research articles published up to September 2022 in order to present an in-depth analysis of the use of datasets, various modalities, experimental setups, and architectures that have been applied in the diagnosis of subjective disease. This analysis includes a total of 217 research publications with a list of the various datasets, methodologies, and features. These findings suggest that ML/DL methods and novel biomarkers hold promising results for application in medical decision-making, leading to a more methodical and thorough detection of PD. Finally, we highlight the challenges and provide appropriate recommendations on selecting approaches that might be used for subgrouping and connection analysis with structural magnetic resonance imaging (sMRI), DaTSCAN, and single-photon emission computerized tomography (SPECT) data for future Parkinson's research.
Collapse
Affiliation(s)
- Arti Rana
- Computer Science & Engineering, Veer Madho Singh Bhandari Uttarakhand Technical University, Dehradun 248007, Uttarakhand, India
| | - Ankur Dumka
- Department of Computer Science and Engineering, Women Institute of Technology, Dehradun 248007, Uttarakhand, India
- Department of Computer Science & Engineering, Graphic Era Deemed to be University, Dehradun 248001, Uttarakhand, India
| | - Rajesh Singh
- Division of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, Uttarakhand, India
- Department of Project Management, Universidad Internacional Iberoamericana, Campeche 24560, Mexico
| | - Manoj Kumar Panda
- Department of Electrical Engineering, G.B. Pant Institute of Engineering and Technology, Pauri 246194, Uttarakhand, India
| | - Neeraj Priyadarshi
- Department of Electrical Engineering, JIS College of Engineering, Kolkata 741235, West Bengal, India
| |
Collapse
|
15
|
Bendig J, Spanz A, Leidig J, Frank A, Stahr M, Reichmann H, Loewenbrück KF, Falkenburger BH. Measuring the Usability of eHealth Solutions for Patients With Parkinson Disease: Observational Study. JMIR Form Res 2022; 6:e39954. [DOI: 10.2196/39954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Revised: 08/28/2022] [Accepted: 09/03/2022] [Indexed: 11/06/2022] Open
Abstract
Background
Parkinson disease (PD) is a neurodegenerative disorder with a variety of motor and nonmotor symptoms. Many of these symptoms can be monitored by eHealth solutions, including smartphone apps, wearable sensors, and camera systems. The usability of such systems is a key factor in long-term use, but not much is known about the predictors of successful use and preferable methods to assess usability in patients with PD.
Objective
This study tested methods to assess usability and determined prerequisites for successful use in patients with PD.
Methods
We performed comprehensive usability assessments with 18 patients with PD using a mixed methods usability battery containing the System Usability Scale, a rater-based evaluation of device-specific tasks, and qualitative interviews. Each patient performed the usability battery with 2 of 3 randomly assigned devices: a tablet app, wearable sensors, and a camera system. The usability battery was administered at the beginning and at the end of a 4-day testing period. Between usability batteries, the systems were used by the patients during 3 sessions of motor assessments (wearable sensors and camera system) and at the movement disorder ward (tablet app).
Results
In this study, the rater-based evaluation of tasks discriminated the best between the 3 eHealth solutions, whereas subjective modalities such as the System Usability Scale were not able to distinguish between the systems. Successful use was associated with different clinical characteristics for each system: eHealth literacy and cognitive function predicted successful use of the tablet app, and better motor function and lower age correlated with the independent use of the camera system. The successful use of the wearable sensors was independent of clinical characteristics. Unfortunately, patients who were not able to use the devices well provided few improvement suggestions in qualitative interviews.
Conclusions
eHealth solutions should be developed with a specific set of patients in mind and subsequently tested in this cohort. For a complete picture, usability assessments should include a rater-based evaluation of task performance, and there is a need to develop strategies to circumvent the underrepresentation of poorly performing patients in qualitative usability research.
Collapse
|
16
|
Wilkins KB, Petrucci MN, Kehnemouyi Y, Velisar A, Han K, Orthlieb G, Trager MH, O’Day JJ, Aditham S, Bronte-Stewart H. Quantitative Digitography Measures Motor Symptoms and Disease Progression in Parkinson’s Disease. JOURNAL OF PARKINSON'S DISEASE 2022; 12:1979-1990. [PMID: 35694934 PMCID: PMC9535590 DOI: 10.3233/jpd-223264] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Background: Assessment of motor signs in Parkinson’s disease (PD) requires an in-person examination. However, 50% of people with PD do not have access to a neurologist. Wearable sensors can provide remote measures of some motor signs but require continuous monitoring for several days. A major unmet need is reliable metrics of all cardinal motor signs, including rigidity, from a simple short active task that can be performed remotely or in the clinic. Objective: Investigate whether thirty seconds of repetitive alternating finger tapping (RAFT) on a portable quantitative digitography (QDG) device, which measures amplitude and timing, produces reliable metrics of all cardinal motor signs in PD. Methods: Ninety-six individuals with PD and forty-two healthy controls performed a thirty-second QDG-RAFT task and clinical motor assessment. Eighteen individuals were followed longitudinally with repeated assessments for an average of three years and up to six years. Results: QDG-RAFT metrics showed differences between PD and controls and provided correlated metrics for total motor disability (MDS-UPDRS III) and for rigidity, bradykinesia, tremor, gait impairment, and freezing of gait (FOG). Additionally, QDG-RAFT tracked disease progression over several years off therapy and showed differences between akinetic-rigid and tremor-dominant phenotypes, as well as people with and without FOG. Conclusions: QDG is a reliable technology, which could be used in the clinic or remotely. This could improve access to care, allow complex remote disease management based on data received in real time, and accurate monitoring of disease progression over time in PD. QDG-RAFT also provides the comprehensive motor metrics needed for therapeutic trials.
Collapse
Affiliation(s)
- Kevin B. Wilkins
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Matthew N. Petrucci
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Yasmine Kehnemouyi
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Anca Velisar
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
- The Smith-Kettlewell Eye Research Institute, San Francisco, CA, USA
| | - Katie Han
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Gerrit Orthlieb
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Megan H. Trager
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
- Columbia University College of Physicians and Surgeons, New York City, NY, USA
| | - Johanna J. O’Day
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
| | - Sudeep Aditham
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Helen Bronte-Stewart
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA
- Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA, USA
| |
Collapse
|
17
|
Hu H, Xiao D, Rhodin H, Murphy TH. Towards a Visualizable, De-identified Synthetic Biomarker of Human Movement Disorders. JOURNAL OF PARKINSON'S DISEASE 2022; 1:2085-2096. [PMID: 36057831 PMCID: PMC10473142 DOI: 10.3233/jpd-223351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/10/2022] [Indexed: 12/15/2022]
Abstract
Human motion analysis has been a common thread across modern and early medicine. While medicine evolves, analysis of movement disorders is mostly based on clinical presentation and trained observers making subjective assessments using clinical rating scales. Currently, the field of computer vision has seen exponential growth and successful medical applications. While this has been the case, neurology, for the most part, has not embraced digital movement analysis. There are many reasons for this including: the limited size of labeled datasets, accuracy and nontransparent nature of neural networks, and potential legal and ethical concerns. We hypothesize that a number of opportunities are made available by advancements in computer vision that will enable digitization of human form, movements, and will represent them synthetically in 3D. Representing human movements within synthetic body models will potentially pave the way towards objective standardized digital movement disorder diagnosis and building sharable open-source datasets from such processed videos. We provide a perspective of this emerging field and describe how clinicians and computer scientists can navigate this new space. Such digital movement capturing methods will be important for both machine learning-based diagnosis and computer vision-aided clinical assessment. It would also supplement face-to-face clinical visits and be used for longitudinal monitoring and remote diagnosis.
Collapse
Affiliation(s)
- Hao Hu
- University of British Columbia, Department of Psychiatry, Kinsmen Laboratory of Neurological Research, Detwiller Pavilion, Vancouver, BC, Canada
- Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
| | - Dongsheng Xiao
- University of British Columbia, Department of Psychiatry, Kinsmen Laboratory of Neurological Research, Detwiller Pavilion, Vancouver, BC, Canada
- Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
| | - Helge Rhodin
- Department of Computer Science, University of British Columbia, Vancouver, BC, Canada
| | - Timothy H. Murphy
- University of British Columbia, Department of Psychiatry, Kinsmen Laboratory of Neurological Research, Detwiller Pavilion, Vancouver, BC, Canada
- Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
18
|
Khanna NN, Maindarkar M, Saxena A, Ahluwalia P, Paul S, Srivastava SK, Cuadrado-Godia E, Sharma A, Omerzu T, Saba L, Mavrogeni S, Turk M, Laird JR, Kitas GD, Fatemi M, Barqawi AB, Miner M, Singh IM, Johri A, Kalra MM, Agarwal V, Paraskevas KI, Teji JS, Fouda MM, Pareek G, Suri JS. Cardiovascular/Stroke Risk Assessment in Patients with Erectile Dysfunction-A Role of Carotid Wall Arterial Imaging and Plaque Tissue Characterization Using Artificial Intelligence Paradigm: A Narrative Review. Diagnostics (Basel) 2022; 12:1249. [PMID: 35626404 PMCID: PMC9141739 DOI: 10.3390/diagnostics12051249] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 05/14/2022] [Accepted: 05/15/2022] [Indexed: 12/12/2022] Open
Abstract
PURPOSE The role of erectile dysfunction (ED) has recently shown an association with the risk of stroke and coronary heart disease (CHD) via the atherosclerotic pathway. Cardiovascular disease (CVD)/stroke risk has been widely understood with the help of carotid artery disease (CTAD), a surrogate biomarker for CHD. The proposed study emphasizes artificial intelligence-based frameworks such as machine learning (ML) and deep learning (DL) that can accurately predict the severity of CVD/stroke risk using carotid wall arterial imaging in ED patients. METHODS Using the PRISMA model, 231 of the best studies were selected. The proposed study mainly consists of two components: (i) the pathophysiology of ED and its link with coronary artery disease (COAD) and CHD in the ED framework and (ii) the ultrasonic-image morphological changes in the carotid arterial walls by quantifying the wall parameters and the characterization of the wall tissue by adapting the ML/DL-based methods, both for the prediction of the severity of CVD risk. The proposed study analyzes the hypothesis that ML/DL can lead to an accurate and early diagnosis of the CVD/stroke risk in ED patients. Our finding suggests that the routine ED patient practice can be amended for ML/DL-based CVD/stroke risk assessment using carotid wall arterial imaging leading to fast, reliable, and accurate CVD/stroke risk stratification. SUMMARY We conclude that ML and DL methods are very powerful tools for the characterization of CVD/stroke in patients with varying ED conditions. We anticipate a rapid growth of these tools for early and better CVD/stroke risk management in ED patients.
Collapse
Affiliation(s)
- Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Mahesh Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.M.); (S.P.)
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| | - Ajit Saxena
- Department of Urology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India;
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.M.); (S.P.)
| | - Saurabh K. Srivastava
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad 244001, India;
| | - Elisa Cuadrado-Godia
- Department of Neurology, Hospital del Mar Medical Research Institute, 08003 Barcelona, Spain;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22908, USA;
| | - Tomaz Omerzu
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (T.O.); (M.T.)
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09124 Cagliari, Italy;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, 176 74 Athens, Greece;
| | - Monika Turk
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (T.O.); (M.T.)
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, NY 55905, USA;
| | - Al Baha Barqawi
- Division of Urology, Department of Surgery, University of Colorado Anschutz Medical Campus, Aurora, CO 80045, USA;
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | | | - Vikas Agarwal
- Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA;
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| |
Collapse
|
19
|
Suri JS, Paul S, Maindarkar MA, Puvvula A, Saxena S, Saba L, Turk M, Laird JR, Khanna NN, Viskovic K, Singh IM, Kalra M, Krishnan PR, Johri A, Paraskevas KI. Cardiovascular/Stroke Risk Stratification in Parkinson's Disease Patients Using Atherosclerosis Pathway and Artificial Intelligence Paradigm: A Systematic Review. Metabolites 2022; 12:metabo12040312. [PMID: 35448500 PMCID: PMC9033076 DOI: 10.3390/metabo12040312] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 03/25/2022] [Accepted: 03/29/2022] [Indexed: 12/20/2022] Open
Abstract
Parkinson’s disease (PD) is a severe, incurable, and costly condition leading to heart failure. The link between PD and cardiovascular disease (CVD) is not available, leading to controversies and poor prognosis. Artificial Intelligence (AI) has already shown promise for CVD/stroke risk stratification. However, due to a lack of sample size, comorbidity, insufficient validation, clinical examination, and a lack of big data configuration, there have been no well-explained bias-free AI investigations to establish the CVD/Stroke risk stratification in the PD framework. The study has two objectives: (i) to establish a solid link between PD and CVD/stroke; and (ii) to use the AI paradigm to examine a well-defined CVD/stroke risk stratification in the PD framework. The PRISMA search strategy selected 223 studies for CVD/stroke risk, of which 54 and 44 studies were related to the link between PD-CVD, and PD-stroke, respectively, 59 studies for joint PD-CVD-Stroke framework, and 66 studies were only for the early PD diagnosis without CVD/stroke link. Sequential biological links were used for establishing the hypothesis. For AI design, PD risk factors as covariates along with CVD/stroke as the gold standard were used for predicting the CVD/stroke risk. The most fundamental cause of CVD/stroke damage due to PD is cardiac autonomic dysfunction due to neurodegeneration that leads to heart failure and its edema, and this validated our hypothesis. Finally, we present the novel AI solutions for CVD/stroke risk prediction in the PD framework. The study also recommends strategies for removing the bias in AI for CVD/stroke risk prediction using the PD framework.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
- Correspondence: ; Tel.: +1-(916)-749-5628
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.A.M.)
| | - Maheshrao A. Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.A.M.)
| | - Anudeep Puvvula
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
- Annu’s Hospitals for Skin & Diabetes, Gudur 524101, India
| | - Sanjay Saxena
- Department of CSE, International Institute of Information Technology, Bhuneshwar 751003, India;
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09121 Cagliari, Italy;
| | - Monika Turk
- Deparment of Neurology, University Medical Centre Maribor, 1262 Maribor, Slovenia;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India;
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
| | - Mannudeep Kalra
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA;
| | | | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| |
Collapse
|
20
|
Bendig J, Wolf AS, Mark T, Frank A, Mathiebe J, Scheibe M, Müller G, Stahr M, Schmitt J, Reichmann H, Loewenbrück KF, Falkenburger BH. Feasibility of a Multimodal Telemedical Intervention for Patients with Parkinson's Disease-A Pilot Study. J Clin Med 2022; 11:jcm11041074. [PMID: 35207351 PMCID: PMC8875136 DOI: 10.3390/jcm11041074] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 02/09/2022] [Accepted: 02/16/2022] [Indexed: 01/13/2023] Open
Abstract
Symptoms of Parkinson’s disease (PD) can be controlled well, but treatment often requires expert judgment. Telemedicine and sensor-based assessments can allow physicians to better observe the evolvement of symptoms over time, in particular with motor fluctuations. In addition, they potentially allow less frequent visits to the expert’s office and facilitate care in rural areas. A variety of systems with different strengths and shortcomings has been investigated in recent years. We designed a multimodal telehealth intervention (TelePark) to mitigate the shortcomings of individual systems and assessed the feasibility of our approach in 12 patients with PD over 12 weeks in preparation for a larger randomized controlled trial. TelePark uses video visits, a smartphone app, a camera system, and wearable sensors. Structured training included setting up the equipment in patients’ homes and group-based online training. Usability was assessed by questionnaires and semi-standardized telephone interviews. Overall, 11 out of 12 patients completed the trial (5 female, 6 male). Mean age was 65 years, mean disease duration 7 years, mean MoCA score 27. Adherence was stable throughout the study and 79% for a short questionnaire administered every second day, 62% for medication confirmation, and 33% for an electronic Hauser diary. Quality of life did not change in the course of the study, and a larger cohort will be required to determine the effect on motor symptoms. Interviews with trial participants identified motivations to use such systems and areas for improvements. These insights can be helpful in designing similar trials.
Collapse
Affiliation(s)
- Jonas Bendig
- Department of Neurology, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.B.); (A.-S.W.); (T.M.); (A.F.); (M.S.); (H.R.); (K.F.L.)
| | - Anna-Sophie Wolf
- Department of Neurology, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.B.); (A.-S.W.); (T.M.); (A.F.); (M.S.); (H.R.); (K.F.L.)
| | - Tony Mark
- Department of Neurology, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.B.); (A.-S.W.); (T.M.); (A.F.); (M.S.); (H.R.); (K.F.L.)
| | - Anika Frank
- Department of Neurology, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.B.); (A.-S.W.); (T.M.); (A.F.); (M.S.); (H.R.); (K.F.L.)
- German Center for Neurodegenerative Diseases (DZNE), 01307 Dresden, Germany
| | - Josephine Mathiebe
- Center for Evidence-Based Healthcare, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.M.); (M.S.); (G.M.); (J.S.)
| | - Madlen Scheibe
- Center for Evidence-Based Healthcare, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.M.); (M.S.); (G.M.); (J.S.)
| | - Gabriele Müller
- Center for Evidence-Based Healthcare, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.M.); (M.S.); (G.M.); (J.S.)
| | - Marcus Stahr
- Department of Neurology, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.B.); (A.-S.W.); (T.M.); (A.F.); (M.S.); (H.R.); (K.F.L.)
- Department of Psychiatry, Sächsisches Krankenhaus Arnsdorf, 01477 Arnsdorf, Germany
| | - Jochen Schmitt
- Center for Evidence-Based Healthcare, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.M.); (M.S.); (G.M.); (J.S.)
| | - Heinz Reichmann
- Department of Neurology, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.B.); (A.-S.W.); (T.M.); (A.F.); (M.S.); (H.R.); (K.F.L.)
| | - Kai F. Loewenbrück
- Department of Neurology, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.B.); (A.-S.W.); (T.M.); (A.F.); (M.S.); (H.R.); (K.F.L.)
| | - Björn H. Falkenburger
- Department of Neurology, University Hospital Carl Gustav Carus and Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, 01307 Dresden, Germany; (J.B.); (A.-S.W.); (T.M.); (A.F.); (M.S.); (H.R.); (K.F.L.)
- German Center for Neurodegenerative Diseases (DZNE), 01307 Dresden, Germany
- Correspondence:
| |
Collapse
|
21
|
Salchow-Hömmen C, Skrobot M, Jochner MCE, Schauer T, Kühn AA, Wenger N. Review-Emerging Portable Technologies for Gait Analysis in Neurological Disorders. Front Hum Neurosci 2022; 16:768575. [PMID: 35185496 PMCID: PMC8850274 DOI: 10.3389/fnhum.2022.768575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Accepted: 01/07/2022] [Indexed: 01/29/2023] Open
Abstract
The understanding of locomotion in neurological disorders requires technologies for quantitative gait analysis. Numerous modalities are available today to objectively capture spatiotemporal gait and postural control features. Nevertheless, many obstacles prevent the application of these technologies to their full potential in neurological research and especially clinical practice. These include the required expert knowledge, time for data collection, and missing standards for data analysis and reporting. Here, we provide a technological review of wearable and vision-based portable motion analysis tools that emerged in the last decade with recent applications in neurological disorders such as Parkinson's disease and Multiple Sclerosis. The goal is to enable the reader to understand the available technologies with their individual strengths and limitations in order to make an informed decision for own investigations and clinical applications. We foresee that ongoing developments toward user-friendly automated devices will allow for closed-loop applications, long-term monitoring, and telemedical consulting in real-life environments.
Collapse
Affiliation(s)
- Christina Salchow-Hömmen
- Department of Neurology With Experimental Neurology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Matej Skrobot
- Department of Neurology With Experimental Neurology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Magdalena C E Jochner
- Department of Neurology With Experimental Neurology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Thomas Schauer
- Control Systems Group, Technische Universität Berlin, Berlin, Germany
| | - Andrea A Kühn
- Department of Neurology With Experimental Neurology, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Berlin School of Mind and Brain, Charité-Universitätsmedizin Berlin, Berlin, Germany
- NeuroCure Clinical Research Centre, Charité-Universitätsmedizin Berlin, Berlin, Germany
- German Center for Neurodegenerative Diseases, DZNE, Berlin, Germany
| | - Nikolaus Wenger
- Department of Neurology With Experimental Neurology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
22
|
Monje MHG, Domínguez S, Vera-Olmos J, Antonini A, Mestre TA, Malpica N, Sánchez-Ferro Á. Remote Evaluation of Parkinson's Disease Using a Conventional Webcam and Artificial Intelligence. Front Neurol 2022; 12:742654. [PMID: 35002915 PMCID: PMC8733479 DOI: 10.3389/fneur.2021.742654] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Accepted: 10/18/2021] [Indexed: 11/25/2022] Open
Abstract
Objective: This study aimed to prove the concept of a new optical video-based system to measure Parkinson's disease (PD) remotely using an accessible standard webcam. Methods: We consecutively enrolled a cohort of 42 patients with PD and healthy subjects (HSs). The participants were recorded performing MDS-UPDRS III bradykinesia upper limb tasks with a computer webcam. The video frames were processed using the artificial intelligence algorithms tracking the movements of the hands. The video extracted features were correlated with clinical rating using the Movement Disorder Society revision of the Unified Parkinson's Disease Rating Scale and inertial measurement units (IMUs). The developed classifiers were validated on an independent dataset. Results: We found significant differences in the motor performance of the patients with PD and HSs in all the bradykinesia upper limb motor tasks. The best performing classifiers were unilateral finger tapping and hand movement speed. The model correlated both with the IMUs for quantitative assessment of motor function and the clinical scales, hence demonstrating concurrent validity with the existing methods. Conclusions: We present here the proof-of-concept of a novel webcam-based technology to remotely detect the parkinsonian features using artificial intelligence. This method has preliminarily achieved a very high diagnostic accuracy and could be easily expanded to other disease manifestations to support PD management.
Collapse
Affiliation(s)
- Mariana H G Monje
- HM CINAC (Centro Integral de Neurociencias Abarca Campal), Hospital Universitario HM Puerta del Sur, HM Hospitales, Madrid, Spain.,Department of Neurology, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Sergio Domínguez
- LAIMBIO, Laboratorio de Análisis de Imagen Médica y Biometría, Universidad Rey Juan Carlos, Madrid, Spain
| | - Javier Vera-Olmos
- LAIMBIO, Laboratorio de Análisis de Imagen Médica y Biometría, Universidad Rey Juan Carlos, Madrid, Spain
| | - Angelo Antonini
- Parkinson and Movement Disorders Unit, Department of Neurosciences (DNS), Padova University, Padova, Italy
| | - Tiago A Mestre
- Division of Neurology, Department of Medicine, Parkinson's Disease and Movement Disorders Centre, The Ottawa Hospital Research Institute, The University of Ottawa Brain Research Institute, Ottawa, ON, Canada
| | - Norberto Malpica
- LAIMBIO, Laboratorio de Análisis de Imagen Médica y Biometría, Universidad Rey Juan Carlos, Madrid, Spain
| | - Álvaro Sánchez-Ferro
- HM CINAC (Centro Integral de Neurociencias Abarca Campal), Hospital Universitario HM Puerta del Sur, HM Hospitales, Madrid, Spain.,Movement Disorders Unit, Neurology Department, Hospital Universitario 12 de Octubre, Madrid, Spain
| |
Collapse
|
23
|
Xu X, Zeng Z, Qi Y, Ren K, Zhang C, Sun B, Li D. Remote video-based outcome measures of patients with Parkinson's disease after deep brain stimulation using smartphones: a pilot study. Neurosurg Focus 2021; 51:E2. [PMID: 34724646 DOI: 10.3171/2021.8.focus21383] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 08/17/2021] [Indexed: 11/06/2022]
Abstract
OBJECTIVE To provide better postoperative healthcare for patients with Parkinson's disease (PD) who received deep brain stimulation (DBS) surgery and to allow surgeons improved tracking of surgical outcomes, the authors sought to examine the applicability and feasibility of remote assessment using smartphones. METHODS A disease management mobile application specifically for PD was used to perform the remote assessment of patients with PD who underwent DBS. Connection with patients was first established via a phone call or a social application, and instructions for completing the remote assessment were delivered. During the video-based virtual meeting, three nonmotor assessment scales measuring the quality of life and mental state, and a modified version of the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale, part III (MDS-UPDRS III) measuring motor abilities were evaluated. After the assessment, a report and the satisfaction questionnaire were sent to the patient. RESULTS Overall, 22 patients were recruited over a 4-week period. Among those, 18 patients completed the assessment on the mobile application. The mean duration was 41.3 minutes for video assessment and 17.5 minutes for nonmotor assessment via telephone. The mean estimated cost was 427.68 Chinese yuan (CNY) for an in-person visit and 20.91 CNY for a virtual visit (p < 0.001). The mean time estimate for an in-person visit was 5.51 hours and 0.68 hours for a virtual visit (p = 0.002). All patients reported satisfaction (77.78% very satisfied and 22.22% satisfied) with the virtual visit and were specifically impressed by the professionalism and great attitude of the physician assistant. The majority of patients agreed that the evaluation time was reasonable (50% totally agree, 44.44% agree, and 5.56% neither agree nor disagree) and all patients expressed interest in future virtual visits (61.11% very willingly and 38.89% willingly). No adverse events were observed during the virtual visit. CONCLUSIONS Innovation in remote assessment technologies was highly feasible for its transforming power in the clinical management of patients with PD who underwent DBS and research. Video-based remote assessment offered considerable time and resource reduction for both patients and doctors. It also increased safety and was a well-accepted, favored tool. Finally, the results of this study have shown there is potential to combine remote assessment tools with real-life clinical visits and other telemedical technologies to collectively benefit the postoperative healthcare of patients with PD undergoing DBS.
Collapse
Affiliation(s)
- Xinmeng Xu
- 1Clinical Neuroscience Center, Ruijin Hospital Luwan Branch, Shanghai Jiao Tong University School of Medicine, Shanghai
| | - Zhitong Zeng
- 2Department of Neurosurgery, Center for Functional Neurosurgery, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai
| | - Yijia Qi
- 1Clinical Neuroscience Center, Ruijin Hospital Luwan Branch, Shanghai Jiao Tong University School of Medicine, Shanghai
| | - Kang Ren
- 3GYENNO SCIENCE CO., LTD., Shenzhen; and
| | - Chencheng Zhang
- 2Department of Neurosurgery, Center for Functional Neurosurgery, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai.,4Shanghai Research Center for Brain Science and Brain-Inspired Intelligence, Shanghai, China
| | - Bomin Sun
- 2Department of Neurosurgery, Center for Functional Neurosurgery, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai
| | - Dianyou Li
- 2Department of Neurosurgery, Center for Functional Neurosurgery, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai
| |
Collapse
|
24
|
Simonet C, Galmes MA, Lambert C, Rees RN, Haque T, Bestwick JP, Lees AJ, Schrag A, Noyce AJ. Slow Motion Analysis of Repetitive Tapping (SMART) Test: Measuring Bradykinesia in Recently Diagnosed Parkinson's Disease and Idiopathic Anosmia. JOURNAL OF PARKINSONS DISEASE 2021; 11:1901-1915. [PMID: 34180422 DOI: 10.3233/jpd-212683] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Bradykinesia is the defining motor feature of Parkinson's disease (PD). There are limitations to its assessment using standard clinical rating scales, especially in the early stages of PD when a floor effect may be observed. OBJECTIVE To develop a quantitative method to track repetitive tapping movements and to compare people in the early stages of PD, healthy controls, and individuals with idiopathic anosmia. METHODS This was a cross-sectional study of 99 participants (early-stage PD = 26, controls = 64, idiopathic anosmia = 9). For each participant, repetitive finger tapping was recorded over 20 seconds using a smartphone at 240 frames per second. From each video, amplitude between fingers, frequency (number of taps per second), and velocity (distance travelled per second) was extracted. Clinical assessment was based on the motor section of the MDS-UPDRS. RESULTS People in the early stage of PD performed the task with slower velocity (p < 0.001) and with greater frequency slope than controls (p = 0.003). The combination of reduced velocity and greater frequency slope obtained the best accuracy to separate early-stage PD from controls based on metric thresholds alone (AUC = 0.88). Individuals with anosmia exhibited slower velocity (p = 0.001) and smaller amplitude (p < 0.001) compared with controls. CONCLUSION We present a simple, proof-of-concept method to detect early motor dysfunction in PD. Mean tap velocity appeared to be the best parameter to differentiate patients with PD from controls. Patients with anosmia also showed detectable differences in motor performance compared with controls which may suggest that some were in the prodromal phase of PD.
Collapse
Affiliation(s)
- Cristina Simonet
- Preventive Neurology Unit, Wolfson Institute of Preventive Medicine, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Miquel A Galmes
- Physical and Analytical Chemistry Department, Jaume I University, Castelló de la Plana, Spain
| | | | - Richard N Rees
- Department of Clinical and Movement Neuroscience, UCL Institute of Neurology, London, United Kingdom
| | - Tahrina Haque
- Preventive Neurology Unit, Wolfson Institute of Preventive Medicine, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Jonathan P Bestwick
- Preventive Neurology Unit, Wolfson Institute of Preventive Medicine, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Andrew J Lees
- Reta Lila Weston Institute of Neurological Studies, University College London Queen Square Institute of Neurology, London, United Kingdom
| | - Anette Schrag
- Preventive Neurology Unit, Wolfson Institute of Preventive Medicine, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Department of Clinical and Movement Neuroscience, UCL Institute of Neurology, London, United Kingdom
| | - Alastair J Noyce
- Preventive Neurology Unit, Wolfson Institute of Preventive Medicine, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Department of Clinical and Movement Neuroscience, UCL Institute of Neurology, London, United Kingdom
| |
Collapse
|
25
|
Alzubaidi MS, Shah U, Dhia Zubaydi H, Dolaat K, Abd-Alrazaq AA, Ahmed A, Househ M. The Role of Neural Network for the Detection of Parkinson's Disease: A Scoping Review. Healthcare (Basel) 2021; 9:healthcare9060740. [PMID: 34208654 PMCID: PMC8235532 DOI: 10.3390/healthcare9060740] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2021] [Revised: 05/26/2021] [Accepted: 05/26/2021] [Indexed: 11/16/2022] Open
Abstract
Background: Parkinson’s Disease (PD) is a chronic neurodegenerative disorder that has been ranked second after Alzheimer’s disease worldwide. Early diagnosis of PD is crucial to combat against PD to allow patients to deal with it properly. However, there is no medical test(s) available to diagnose PD conclusively. Therefore, computer-aided diagnosis (CAD) systems offered a better solution to make the necessary data-driven decisions and assist the physician. Numerous studies were conducted to propose CAD to diagnose PD in the early stages. No comprehensive reviews have been conducted to summarize the role of AI tools to combat PD. Objective: The study aimed to explore and summarize the applications of neural networks to diagnose PD. Methods: PRISMA Extension for Scoping Reviews (PRISMA-ScR) was followed to conduct this scoping review. To identify the relevant studies, both medical databases (e.g., PubMed) and technical databases (IEEE) were searched. Three reviewers carried out the study selection and extracted the data from the included studies independently. Then, the narrative approach was adopted to synthesis the extracted data. Results: Out of 1061 studies, 91 studies satisfied the eligibility criteria in this review. About half of the included studies have implemented artificial neural networks to diagnose PD. Numerous studies included focused on the freezing of gait (FoG). Biomedical voice and signal datasets were the most commonly used data types to develop and validate these models. However, MRI- and CT-scan images were also utilized in the included studies. Conclusion: Neural networks play an integral and substantial role in combating PD. Many possible applications of neural networks were identified in this review, however, most of them are limited up to research purposes.
Collapse
Affiliation(s)
- Mahmood Saleh Alzubaidi
- College of Science and Engineering, Hamad Bin Khalifa University, Doha 53, Qatar; (U.S.); (K.D.); (A.A.A.-A.); (A.A.)
- Correspondence: (M.S.A.); (M.H.)
| | - Uzair Shah
- College of Science and Engineering, Hamad Bin Khalifa University, Doha 53, Qatar; (U.S.); (K.D.); (A.A.A.-A.); (A.A.)
| | - Haider Dhia Zubaydi
- National Advanced IPv6 Centre, Universiti Sains Malaysia, Gelugor 11800, Malaysia;
| | - Khalid Dolaat
- College of Science and Engineering, Hamad Bin Khalifa University, Doha 53, Qatar; (U.S.); (K.D.); (A.A.A.-A.); (A.A.)
| | - Alaa A. Abd-Alrazaq
- College of Science and Engineering, Hamad Bin Khalifa University, Doha 53, Qatar; (U.S.); (K.D.); (A.A.A.-A.); (A.A.)
| | - Arfan Ahmed
- College of Science and Engineering, Hamad Bin Khalifa University, Doha 53, Qatar; (U.S.); (K.D.); (A.A.A.-A.); (A.A.)
| | - Mowafa Househ
- College of Science and Engineering, Hamad Bin Khalifa University, Doha 53, Qatar; (U.S.); (K.D.); (A.A.A.-A.); (A.A.)
- Correspondence: (M.S.A.); (M.H.)
| |
Collapse
|