1
|
Friedrich MU, Roenn AJ, Palmisano C, Alty J, Paschen S, Deuschl G, Ip CW, Volkmann J, Muthuraman M, Peach R, Reich MM. Validation and application of computer vision algorithms for video-based tremor analysis. NPJ Digit Med 2024; 7:165. [PMID: 38906946 PMCID: PMC11192937 DOI: 10.1038/s41746-024-01153-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Accepted: 05/29/2024] [Indexed: 06/23/2024] Open
Abstract
Tremor is one of the most common neurological symptoms. Its clinical and neurobiological complexity necessitates novel approaches for granular phenotyping. Instrumented neurophysiological analyses have proven useful, but are highly resource-intensive and lack broad accessibility. In contrast, bedside scores are simple to administer, but lack the granularity to capture subtle but relevant tremor features. We utilise the open-source computer vision pose tracking algorithm Mediapipe to track hands in clinical video recordings and use the resulting time series to compute canonical tremor features. This approach is compared to marker-based 3D motion capture, wrist-worn accelerometry, clinical scoring and a second, specifically trained tremor-specific algorithm in two independent clinical cohorts. These cohorts consisted of 66 patients diagnosed with essential tremor, assessed in different task conditions and states of deep brain stimulation therapy. We find that Mediapipe-derived tremor metrics exhibit high convergent clinical validity to scores (Spearman's ρ = 0.55-0.86, p≤ .01) as well as an accuracy of up to 2.60 mm (95% CI [-3.13, 8.23]) and ≤0.21 Hz (95% CI [-0.05, 0.46]) for tremor amplitude and frequency measurements, matching gold-standard equipment. Mediapipe, but not the disease-specific algorithm, was capable of analysing videos involving complex configurational changes of the hands. Moreover, it enabled the extraction of tremor features with diagnostic and prognostic relevance, a dimension which conventional tremor scores were unable to provide. Collectively, this demonstrates that current computer vision algorithms can be transformed into an accurate and highly accessible tool for video-based tremor analysis, yielding comparable results to gold standard tremor recordings.
Collapse
Affiliation(s)
- Maximilian U Friedrich
- Center for Brain Circuit Therapeutics, Brigham and Women's Hospital, Boston, MA, USA.
- Harvard Medical School, Boston, MA, USA.
- Department of Neurology, University Hospital Wurzburg, Wuerzburg, Germany.
| | - Anna-Julia Roenn
- Department of Neurology, University Hospital Wurzburg, Wuerzburg, Germany
| | - Chiara Palmisano
- Department of Neurology, University Hospital Wurzburg, Wuerzburg, Germany
| | - Jane Alty
- Wicking Dementia Research and Education Centre, College of Health and Medicine, University of Tasmania, Hobart, Tasmania, Australia
| | | | | | - Chi Wang Ip
- Department of Neurology, University Hospital Wurzburg, Wuerzburg, Germany
| | - Jens Volkmann
- Department of Neurology, University Hospital Wurzburg, Wuerzburg, Germany
| | | | - Robert Peach
- Department of Neurology, University Hospital Wurzburg, Wuerzburg, Germany
- Department of Brain Sciences, Imperial College, London, UK
| | - Martin M Reich
- Department of Neurology, University Hospital Wurzburg, Wuerzburg, Germany.
| |
Collapse
|
2
|
Uryga A, Kazimierska A, Popek M, Dragan B, Burzyńska M, Masalski M, Kasprowicz M. Applying video motion magnification to reveal spontaneous tympanic membrane displacement as an indirect measure of intracranial pressure in patients with brain pathologies. Acta Neurochir (Wien) 2023; 165:2227-2235. [PMID: 37369772 PMCID: PMC10409653 DOI: 10.1007/s00701-023-05681-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Accepted: 06/12/2023] [Indexed: 06/29/2023]
Abstract
BACKGROUND The observation of tympanic membrane displacement (TMD) opens up the possibility of indirect intracranial pressure (ICP) estimation. In this study, we applied a phase-based video motion magnification (VMM) algorithm to reveal spontaneous pulse TMD waveforms (spTMD) and compare them with invasively measured ICP in patients with intracranial pathologies. METHODS Nine adults (six traumatic brain injury and three aneurysmal subarachnoid haemorrhage; median age 44 (29-53) years admitted to the intensive care unit of Wroclaw Medical University between October 2021 and October 2022 with implanted ICP sensors were included in this retrospective study. Video recordings of the tympanic membrane were performed using a portable otoscope with a video camera and analysed by a custom-written VMM algorithm. ICP was monitored using intraparenchymal sensors and arterial blood pressure (ABP) was measured in the radial arterial lines. ICP, ABP, and spTMD videos were captured simultaneously. The pulse amplitudes of ICP (Amp_ICP), ABP (Amp_ABP) and spTMD (Amp_spTMD) were estimated using fast Fourier transform within the heart rate (HR)-related frequency range. RESULTS Amp_spTMD was significantly correlated with mean ICP (rS = 0.73; p = 0.025) and with Amp_ICP (rS = 0.88; p = 0.002). Age was not a significant moderator of this association. There were no significant relationships between Amp_spTMD and either mean ABP, HR, or Amp_ABP. CONCLUSIONS The study suggests that Amp_spTMD increases with the increase in mean ICP and Amp_ICP. Estimation of Amp_spTMD using the VMM algorithm has the potential to allow for non-invasive detection of the risk of elevated ICP; however, further investigation in a larger group of patients is required.
Collapse
Affiliation(s)
- Agnieszka Uryga
- Department of Biomedical Engineering, Wroclaw University of Science and Technology, Wybrzeże Wyspiańskiego 27, 50-370, Wroclaw, Poland.
| | - Agnieszka Kazimierska
- Department of Biomedical Engineering, Wroclaw University of Science and Technology, Wybrzeże Wyspiańskiego 27, 50-370, Wroclaw, Poland
| | - Mateusz Popek
- Department of Biomedical Engineering, Wroclaw University of Science and Technology, Wybrzeże Wyspiańskiego 27, 50-370, Wroclaw, Poland
| | - Barbara Dragan
- Department of Anaesthesiology and Intensive Therapy, Wroclaw Medical University, Borowska 213, 50-566, Wroclaw, Poland
| | - Małgorzata Burzyńska
- Department of Anaesthesiology and Intensive Therapy, Wroclaw Medical University, Borowska 213, 50-566, Wroclaw, Poland
| | - Marcin Masalski
- Department of Biomedical Engineering, Wroclaw University of Science and Technology, Wybrzeże Wyspiańskiego 27, 50-370, Wroclaw, Poland
- Department and Clinic of Otolaryngology, Head and Neck Surgery, Wroclaw Medical University, Borowska 213, 50-566, Wroclaw, Poland
| | - Magdalena Kasprowicz
- Department of Biomedical Engineering, Wroclaw University of Science and Technology, Wybrzeże Wyspiańskiego 27, 50-370, Wroclaw, Poland.
| |
Collapse
|
3
|
Landers M, Saria S, Espay AJ. Will Artificial Intelligence Replace the Movement Disorders Specialist for Diagnosing and Managing Parkinson's Disease? JOURNAL OF PARKINSONS DISEASE 2021; 11:S117-S122. [PMID: 34219671 PMCID: PMC8385515 DOI: 10.3233/jpd-212545] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
The use of artificial intelligence (AI) to help diagnose and manage disease is of increasing interest to researchers and clinicians. Volumes of health data are generated from smartphones and ubiquitous inexpensive sensors. By using these data, AI can offer otherwise unobtainable insights about disease burden and patient status in a free-living environment. Moreover, from clinical datasets AI can improve patient symptom monitoring and global epidemiologic efforts. While these applications are exciting, it is necessary to examine both the utility and limitations of these novel analytic methods. The most promising uses of AI remain aspirational. For example, defining the molecular subtypes of Parkinson's disease will be assisted by future applications of AI to relevant datasets. This will allow clinicians to match patients to molecular therapies and will thus help launch precision medicine. Until AI proves its potential in pushing the frontier of precision medicine, its utility will primarily remain in individualized monitoring, complementing but not replacing movement disorders specialists.
Collapse
Affiliation(s)
- Matt Landers
- Department of Computer Science, Whiting School of Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Suchi Saria
- Departments of Computer Science and Statistics, Whiting School of Engineering, Johns Hopkins University, Baltimore, MD, USA.,Department of Health Policy and Management, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, USA.,Bayesian Health, New York, NY, USA
| | - Alberto J Espay
- Department of Neurology, James J. and Joan A. Gardner Family Center for Parkinson's Disease and Movement Disorders, University of Cincinnati, Cincinnati, OH, USA
| |
Collapse
|