1
|
Kather C, Shofer FS, Park JI, Bogen D, Pierce SR, Kording K, Nilan KA, Zhang H, Prosser LA, Johnson MJ. Quantifying interaction with robotic toys in pre-term and full-term infants. Front Pediatr 2023; 11:1153841. [PMID: 37928351 PMCID: PMC10622661 DOI: 10.3389/fped.2023.1153841] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 08/29/2023] [Indexed: 11/07/2023] Open
Abstract
Infants born pre-term are at an increased risk for developmental, behavioral, and motor delay and subsequent disability. When these problems are detected early, clinical intervention can be effective at improving functional outcomes. Current methods of early clinical assessment are resource intensive, require extensive training, and do not always capture infants' behavior in natural play environments. We developed the Play and Neuro Development Assessment (PANDA) Gym, an affordable, mechatronic, sensor-based play environment that can be used outside clinical settings to capture infant visual and motor behavior. Using a set of classification codes developed from the literature, we analyzed videos from 24 pre-term and full-term infants as they played with each of three robotic toys designed to elicit different types of interactions-a lion, an orangutan, and an elephant. We manually coded for frequency and duration of toy interactions such as kicking, grasping, touching, and gazing. Pre-term infants gazed at the toys with similar frequency as full-term infants, but infants born full-term physically engaged more frequently and for longer durations with the robotic toys than infants born pre-term. While we showed we could detect differences between full-term and pre-term infants, further work is needed to determine whether differences seen were primarily due to age, developmental delays, or a combination.
Collapse
Affiliation(s)
- Collin Kather
- Rehabilitation Robotics Lab, Department of Physical Medicine and Rehabilitation, University of Pennsylvania, Philadelphia, PA, United States
| | - Frances S. Shofer
- Department of Emergency Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Jeong Inn Park
- Rehabilitation Robotics Lab, Department of Physical Medicine and Rehabilitation, University of Pennsylvania, Philadelphia, PA, United States
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, United States
| | - Daniel Bogen
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, United States
| | - Samuel R. Pierce
- Department of Physical Therapy, The Children’s Hospital of Philadelphia, Philadelphia, PA, United States
| | - Konrad Kording
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, United States
| | - Kathleen A. Nilan
- Division of Neonatology, The Children’s Hospital of Philadelphia, Philadelphia, PA, United States
| | - Huayan Zhang
- Division of Neonatology, The Children’s Hospital of Philadelphia, Philadelphia, PA, United States
- Department of Neonatology, Guangzhou Women’s and Children’s Medical Center, Guangzhou, China
| | - Laura A. Prosser
- Department of Pediatrics, University of Pennsylvania, Philadelphia, PA, United States
- Division of Rehabilitation Medicine, The Children’s Hospital of Philadelphia, Philadelphia, PA, United States
| | - Michelle J. Johnson
- Rehabilitation Robotics Lab, Department of Physical Medicine and Rehabilitation, University of Pennsylvania, Philadelphia, PA, United States
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, United States
| |
Collapse
|
2
|
Kulvicius T, Zhang D, Nielsen-Saines K, Bölte S, Kraft M, Einspieler C, Poustka L, Wörgötter F, Marschik PB. Infant movement classification through pressure distribution analysis. COMMUNICATIONS MEDICINE 2023; 3:112. [PMID: 37587165 PMCID: PMC10432534 DOI: 10.1038/s43856-023-00342-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 08/01/2023] [Indexed: 08/18/2023] Open
Abstract
BACKGROUND Aiming at objective early detection of neuromotor disorders such as cerebral palsy, we propose an innovative non-intrusive approach using a pressure sensing device to classify infant general movements. Here we differentiate typical general movement patterns of the "fidgety period" (fidgety movements) vs. the "pre-fidgety period" (writhing movements). METHODS Participants (N = 45) were sampled from a typically-developing infant cohort. Multi-modal sensor data, including pressure data from a pressure sensing mat with 1024 sensors, were prospectively recorded for each infant in seven succeeding laboratory sessions in biweekly intervals from 4 to 16 weeks of post-term age. 1776 pressure data snippets, each 5 s long, from the two targeted age periods were taken for movement classification. Each snippet was pre-annotated based on corresponding synchronised video data by human assessors as either fidgety present or absent. Multiple neural network architectures were tested to distinguish the fidgety present vs. fidgety absent classes, including support vector machines, feed-forward networks, convolutional neural networks, and long short-term memory networks. RESULTS Here we show that the convolution neural network achieved the highest average classification accuracy (81.4%). By comparing the pros and cons of other methods aiming at automated general movement assessment to the pressure sensing approach, we infer that the proposed approach has a high potential for clinical applications. CONCLUSIONS We conclude that the pressure sensing approach has great potential for efficient large-scale motion data acquisition and sharing. This will in return enable improvement of the approach that may prove scalable for daily clinical application for evaluating infant neuromotor functions.
Collapse
Affiliation(s)
- Tomas Kulvicius
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany.
- Department for Computational Neuroscience, Third Institute of Physics-Biophysics, Georg-August-University of Göttingen, Göttingen, Germany.
| | - Dajie Zhang
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany
- Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany
- iDN - interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria
| | - Karin Nielsen-Saines
- Division of Pediatric Infectious Diseases, David Geffen UCLA School of Medicine, Los Angeles, CA, USA
| | - Sven Bölte
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden
- Child and Adolescent Psychiatry, Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
- Curtin Autism Research Group, Curtin School of Allied Health, Curtin University, Perth, WA, Australia
| | - Marc Kraft
- Department of Medical Engineering, Technical University Berlin, Berlin, Germany
| | - Christa Einspieler
- iDN - interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria
| | - Luise Poustka
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany
- Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany
| | - Florentin Wörgötter
- Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany
- Department of Medical Engineering, Technical University Berlin, Berlin, Germany
| | - Peter B Marschik
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany
- Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany
- iDN - interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
3
|
Kozioł A, López Pérez D, Laudańska Z, Malinowska-Korczak A, Babis K, Mykhailova O, D’Souza H, Tomalski P. Motor Overflow during Reaching in Infancy: Quantification of Limb Movement Using Inertial Motion Units. SENSORS (BASEL, SWITZERLAND) 2023; 23:2653. [PMID: 36904857 PMCID: PMC10007533 DOI: 10.3390/s23052653] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 02/24/2023] [Accepted: 02/26/2023] [Indexed: 06/18/2023]
Abstract
Early in life, infants exhibit motor overflow, which can be defined as the generation of involuntary movements accompanying purposeful actions. We present the results of a quantitative study exploring motor overflow in 4-month-old infants. This is the first study quantifying motor overflow with high accuracy and precision provided by Inertial Motion Units. The study aimed to investigate the motor activity across the non-acting limbs during goal-directed action. To this end, we used wearable motion trackers to measure infant motor activity during a baby-gym task designed to capture overflow during reaching movements. The analysis was conducted on the subsample of participants (n = 20), who performed at least four reaches during the task. A series of Granger causality tests revealed that the activity differed depending on the non-acting limb and the type of the reaching movement. Importantly, on average, the non-acting arm preceded the activation of the acting arm. In contrast, the activity of the acting arm was followed by the activation of the legs. This may be caused by their distinct purposes in supporting postural stability and efficiency of movement execution. Finally, our findings demonstrate the utility of wearable motion trackers for precise measurement of infant movement dynamics.
Collapse
Affiliation(s)
- Agata Kozioł
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, 00-378 Warsaw, Poland
- Graduate School for Social Research, Polish Academy of Sciences, 00-330 Warsaw, Poland
| | - David López Pérez
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, 00-378 Warsaw, Poland
| | - Zuzanna Laudańska
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, 00-378 Warsaw, Poland
- Graduate School for Social Research, Polish Academy of Sciences, 00-330 Warsaw, Poland
| | - Anna Malinowska-Korczak
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, 00-378 Warsaw, Poland
| | - Karolina Babis
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, 00-378 Warsaw, Poland
| | - Oleksandra Mykhailova
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, 00-378 Warsaw, Poland
| | - Hana D’Souza
- Centre for Human Developmental Science, School of Psychology, Cardiff University, Cardiff CF10 3AT, UK
| | - Przemysław Tomalski
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, 00-378 Warsaw, Poland
| |
Collapse
|
4
|
A HAND USE AND GRASP SENSOR SYSTEM IN MONITORING INFANT FINE MOTOR DEVELOPMENT. Arch Rehabil Res Clin Transl 2022; 4:100203. [PMID: 36123986 PMCID: PMC9482029 DOI: 10.1016/j.arrct.2022.100203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Objective To assess the feasibility of a hand use and grasp sensor system in collecting and quantifying fine motor development longitudinally in an infant's home environment. Design Cohort study. Researchers made home visits monthly to participating families to collect grasp data from infants using a hand use and grasp sensor. Setting Data collection were conducted in each participant's home. Participants A convenience sample of 14 typical developmental infants were enrolled from 3 months to 9 months of age. Two infants dropped out. A total of 62 testing sessions involving 12 infants were available for analysis (N=12). Interventions At each session, the infant was seated in a standardized infant seat. Each instrumented toy was hung on the hand use and grasp sensor structure, presented for 6 minutes in 3 feedback modes: visual, auditory, and vibratory. Main Outcome Measures Infant grasp frequency and duration, peak grasping force, average grasping force, force coefficient of variation, and proportion of bimanual grasps. Results A total of 2832 recorded grasp events from 12 infants were analyzed. In linear mixed-effects model analysis, when interacting with each toy, infants’ peak grasp force, average grasp force, and accumulated grasp time all increased significantly with age (all P<.001). Bimanual grasps also occupied an increasingly greater percentage of infants’ total grasps as they grew older (bar toy P<.001, candy toy P=.021). Conclusions We observed significant changes in hand use and grasp sensor outcome measures with age that are consistent with maturation of grasp skills. We envision the evolution of hand use and grasp sensor technology into an inexpensive and convenient tool to track infant grasp development for early detection of possible developmental delay and/or cerebral palsy as a supplement to clinical evaluations.
Collapse
|