1
|
Letzkus L, Pulido JV, Adeyemo A, Baek S, Zanelli S. Machine learning approaches to evaluate infants' general movements in the writhing stage-a pilot study. Sci Rep 2024; 14:4522. [PMID: 38402234 PMCID: PMC10894291 DOI: 10.1038/s41598-024-54297-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 02/11/2024] [Indexed: 02/26/2024] Open
Abstract
The goals of this study are to describe machine learning techniques employing computer-vision movement algorithms to automatically evaluate infants' general movements (GMs) in the writhing stage. This is a retrospective study of infants admitted 07/2019 to 11/2021 to a level IV neonatal intensive care unit (NICU). Infant GMs, classified by certified expert, were analyzed in two-steps (1) determination of anatomic key point location using a NICU-trained pose estimation model [accuracy determined using object key point similarity (OKS)]; (2) development of a preliminary movement model to distinguish normal versus cramped-synchronized (CS) GMs using cosine similarity and autocorrelation of major joints. GMs were analyzed using 85 videos from 74 infants; gestational age at birth 28.9 ± 4.1 weeks and postmenstrual age (PMA) at time of video 35.9 ± 4.6 weeks The NICU-trained pose estimation model was more accurate (0.91 ± 0.008 OKS) than a generic model (0.83 ± 0.032 OKS, p < 0.001). Autocorrelation values in the lower limbs were significantly different between normal (5 videos) and CS GMs (5 videos, p < 0.05). These data indicate that automated pose estimation of anatomical key points is feasible in NICU patients and that a NICU-trained model can distinguish between normal and CS GMs. These preliminary data indicate that machine learning techniques may represent a promising tool for earlier CP risk assessment in the writhing stage and prior to hospital discharge.
Collapse
Affiliation(s)
- Lisa Letzkus
- Department of Pediatrics, University of Virginia Children's Hospital, PO Box 800828, Charlottesville, VA, 22908, USA.
| | - J Vince Pulido
- Applied Physics Laboratory, Johns Hopkins University, Laurel, MD, USA
| | - Abiodun Adeyemo
- Department of Pediatrics, University of Virginia Children's Hospital, PO Box 800828, Charlottesville, VA, 22908, USA
| | - Stephen Baek
- School of Data Science, University of Virginia, Charlottesville, VA, USA
| | - Santina Zanelli
- Department of Pediatrics, University of Virginia Children's Hospital, PO Box 800828, Charlottesville, VA, 22908, USA
| |
Collapse
|
2
|
Kulvicius T, Zhang D, Nielsen-Saines K, Bölte S, Kraft M, Einspieler C, Poustka L, Wörgötter F, Marschik PB. Infant movement classification through pressure distribution analysis. COMMUNICATIONS MEDICINE 2023; 3:112. [PMID: 37587165 PMCID: PMC10432534 DOI: 10.1038/s43856-023-00342-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 08/01/2023] [Indexed: 08/18/2023] Open
Abstract
BACKGROUND Aiming at objective early detection of neuromotor disorders such as cerebral palsy, we propose an innovative non-intrusive approach using a pressure sensing device to classify infant general movements. Here we differentiate typical general movement patterns of the "fidgety period" (fidgety movements) vs. the "pre-fidgety period" (writhing movements). METHODS Participants (N = 45) were sampled from a typically-developing infant cohort. Multi-modal sensor data, including pressure data from a pressure sensing mat with 1024 sensors, were prospectively recorded for each infant in seven succeeding laboratory sessions in biweekly intervals from 4 to 16 weeks of post-term age. 1776 pressure data snippets, each 5 s long, from the two targeted age periods were taken for movement classification. Each snippet was pre-annotated based on corresponding synchronised video data by human assessors as either fidgety present or absent. Multiple neural network architectures were tested to distinguish the fidgety present vs. fidgety absent classes, including support vector machines, feed-forward networks, convolutional neural networks, and long short-term memory networks. RESULTS Here we show that the convolution neural network achieved the highest average classification accuracy (81.4%). By comparing the pros and cons of other methods aiming at automated general movement assessment to the pressure sensing approach, we infer that the proposed approach has a high potential for clinical applications. CONCLUSIONS We conclude that the pressure sensing approach has great potential for efficient large-scale motion data acquisition and sharing. This will in return enable improvement of the approach that may prove scalable for daily clinical application for evaluating infant neuromotor functions.
Collapse
Affiliation(s)
- Tomas Kulvicius
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany.
- Department for Computational Neuroscience, Third Institute of Physics-Biophysics, Georg-August-University of Göttingen, Göttingen, Germany.
| | - Dajie Zhang
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany
- Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany
- iDN - interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria
| | - Karin Nielsen-Saines
- Division of Pediatric Infectious Diseases, David Geffen UCLA School of Medicine, Los Angeles, CA, USA
| | - Sven Bölte
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden
- Child and Adolescent Psychiatry, Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
- Curtin Autism Research Group, Curtin School of Allied Health, Curtin University, Perth, WA, Australia
| | - Marc Kraft
- Department of Medical Engineering, Technical University Berlin, Berlin, Germany
| | - Christa Einspieler
- iDN - interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria
| | - Luise Poustka
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany
- Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany
| | - Florentin Wörgötter
- Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany
- Department of Medical Engineering, Technical University Berlin, Berlin, Germany
| | - Peter B Marschik
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany
- Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany
- iDN - interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
3
|
Haffner DN, Sankovic A. A Neurologist's Guide to Neonatal Neurodevelopmental Assessments and Preterm Brain Injury. Semin Pediatr Neurol 2022; 42:100974. [PMID: 35868724 DOI: 10.1016/j.spen.2022.100974] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 04/14/2022] [Accepted: 04/14/2022] [Indexed: 11/19/2022]
Abstract
Despite advances in medical care and improved survival of extremely preterm infants, rates of neurodevelopmental impairment remain high. Outcomes are significantly improved with early intervention, but infants must be appropriately identified to facilitate services. Neuroimaging provides important information regarding neurodevelopmental outcomes but prognosticating and communicating risk remains challenging. Standardized neonatal neurodevelopmental assessments provide supplemental information to aid in the identification of high-risk infants and counseling for their families.
Collapse
Affiliation(s)
- Darrah N Haffner
- Division of Pediatric Neurology, Nationwide Children's Hospital and the Ohio State University, 700 Children's Dr Columbus, 43205 OH, United States.
| | - Alexandra Sankovic
- Division of Pediatric Neurology, Nationwide Children's Hospital and the Ohio State University, 700 Children's Dr Columbus, 43205 OH, United States
| |
Collapse
|