1
|
Bao B, Zhang S, Li H, Cui W, Guo K, Zhang Y, Yang K, Liu S, Tong Y, Zhu J, Lin Y, Xu H, Yang H, Cheng X, Cheng H. Intelligence Sparse Sensor Network for Automatic Early Evaluation of General Movements in Infants. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2306025. [PMID: 38445881 PMCID: PMC11109618 DOI: 10.1002/advs.202306025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 01/23/2024] [Indexed: 03/07/2024]
Abstract
General movements (GMs) have been widely used for the early clinical evaluation of infant brain development, allowing immediate evaluation of potential development disorders and timely rehabilitation. The infants' general movements can be captured digitally, but the lack of quantitative assessment and well-trained clinical pediatricians presents an obstacle for many years to achieve wider deployment, especially in low-resource settings. There is a high potential to explore wearable sensors for movement analysis due to outstanding privacy, low cost, and easy-to-use features. This work presents a sparse sensor network with soft wireless IMU devices (SWDs) for automatic early evaluation of general movements in infants. The sparse network consisting of only five sensor nodes (SWDs) with robust mechanical properties and excellent biocompatibility continuously and stably captures full-body motion data. The proof-of-the-concept clinical testing with 23 infants showcases outstanding performance in recognizing neonatal activities, confirming the reliability of the system. Taken together with a tiny machine learning algorithm, the system can automatically identify risky infants based on the GMs, with an accuracy of up to 100% (99.9%). The wearable sparse sensor network with an artificial intelligence-based algorithm facilitates intelligent evaluation of infant brain development and early diagnosis of development disorders.
Collapse
Affiliation(s)
- Benkun Bao
- School of Biomedical Engineering (Suzhou)Division of Life Sciences and MedicineUniversity of Science and Technology of ChinaHefei230022P. R. China
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Senhao Zhang
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
- Department of Engineering Science and MechanicsThe Pennsylvania State UniversityUniversity ParkPA16802USA
| | - Honghua Li
- Department of Developmental and Behavioral PediatricsThe First Hospital of Jilin UniversityChangchun130021P. R. China
| | - Weidong Cui
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Kai Guo
- School of Biomedical Engineering (Suzhou)Division of Life Sciences and MedicineUniversity of Science and Technology of ChinaHefei230022P. R. China
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Yingying Zhang
- School of Biomedical Engineering (Suzhou)Division of Life Sciences and MedicineUniversity of Science and Technology of ChinaHefei230022P. R. China
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Kerong Yang
- School of Biomedical Engineering (Suzhou)Division of Life Sciences and MedicineUniversity of Science and Technology of ChinaHefei230022P. R. China
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Shuai Liu
- School of Biomedical Engineering (Suzhou)Division of Life Sciences and MedicineUniversity of Science and Technology of ChinaHefei230022P. R. China
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Yao Tong
- School of Biomedical Engineering (Suzhou)Division of Life Sciences and MedicineUniversity of Science and Technology of ChinaHefei230022P. R. China
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Jia Zhu
- School of Material and EnergyUniversity of Electronic Science and Technology of ChinaChengdu610054P. R. China
| | - Yuan Lin
- School of Material and EnergyUniversity of Electronic Science and Technology of ChinaChengdu610054P. R. China
| | - Huanlan Xu
- Department of Rehabilitation MedicineChildren's Hospital of Soochow UniversitySuzhou215025P. R. China
| | - Hongbo Yang
- School of Biomedical Engineering (Suzhou)Division of Life Sciences and MedicineUniversity of Science and Technology of ChinaHefei230022P. R. China
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Xiankai Cheng
- School of Biomedical Engineering (Suzhou)Division of Life Sciences and MedicineUniversity of Science and Technology of ChinaHefei230022P. R. China
- Suzhou Institute of Biomedical Engineering and TechnologyChinese Academy of ScienceSuzhou215011P. R. China
| | - Huanyu Cheng
- Department of Engineering Science and MechanicsThe Pennsylvania State UniversityUniversity ParkPA16802USA
| |
Collapse
|
2
|
Sermpon N, Gima H. Relationship between fidgety movement and frequency of movement toward midline: An observational study. Early Hum Dev 2023; 177-178:105718. [PMID: 36801663 DOI: 10.1016/j.earlhumdev.2023.105718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Revised: 01/24/2023] [Accepted: 01/24/2023] [Indexed: 02/04/2023]
Abstract
BACKGROUND Infants show other movements and posture patterns during the fidgety movement period, including movement toward midline (MTM). Few studies have quantified MTM occurring during the fidgety movement period. AIMS This study aimed to examine the relationship between fidgety movements (FMs) and MTM frequency and occurrence rate per minute, from two video data sets (video attached to Prechtl video manual and accuracy data from Japan). STUDY DESIGN Observational study. SUBJECTS It encompassed 47 videos. Of these, 32 were deemed normal FMs. The study amalgamated FMs that were sporadic, abnormal, or absent into a category of aberrant (n = 15). OUTCOME MEASURES Infant video data were observed. MTM item occurrences were recorded and calculated for occurrence percentage and MTM rate of occurrence per minute. The differences between groups for the upper limbs, lower limbs, and total MTM were statistically analysed. RESULTS Twenty-three infant videos of normal FMs and seven infant videos of aberrant FMs showed MTM. Eight infant videos of aberrant FMs showed no MTM, and only four with absent FMs were included. There was a significant difference in the total MTM rate of occurrence per minute between normal FMs versus aberrant FMs (p = 0.008). CONCLUSIONS This study presented MTM frequency and rate of occurrence per minute in infants who showed FMs during the fidgety movement period. Those who showed absent FMs also demonstrated no MTM. Further study may need a larger sample size of absent FMs and information on later development.
Collapse
Affiliation(s)
- Nisasri Sermpon
- Department of Physical Therapy, Graduate School of Human Health Sciences, Tokyo Metropolitan University, Japan; Faculty of Physical Therapy, Mahidol University, Thailand
| | - Hirotaka Gima
- Department of Physical Therapy, Graduate School of Human Health Sciences, Tokyo Metropolitan University, Japan.
| |
Collapse
|
3
|
Groos D, Adde L, Støen R, Ramampiaro H, Ihlen EAF. Towards human-level performance on automatic pose estimation of infant spontaneous movements. Comput Med Imaging Graph 2021; 95:102012. [PMID: 34864580 DOI: 10.1016/j.compmedimag.2021.102012] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Revised: 10/17/2021] [Accepted: 10/21/2021] [Indexed: 10/19/2022]
Abstract
Assessment of spontaneous movements can predict the long-term developmental disorders in high-risk infants. In order to develop algorithms for automated prediction of later disorders, highly precise localization of segments and joints by infant pose estimation is required. Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset, covering the large variation in 1424 videos from a clinical international community. The localization performance of the networks was evaluated as the deviation between the estimated keypoint positions and human expert annotations. The computational efficiency was also assessed to determine the feasibility of the neural networks in clinical practice. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations, while still operating efficiently. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries by quantifying infant movements from video recordings with human-level performance.
Collapse
Affiliation(s)
- Daniel Groos
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Lars Adde
- Department of Clinical and Molecular Medicine, Norwegian University of Science and Technology, Trondheim, Norway; Clinic of Clinical Services, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway
| | - Ragnhild Støen
- Department of Clinical and Molecular Medicine, Norwegian University of Science and Technology, Trondheim, Norway; Department of Neonatology, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway
| | - Heri Ramampiaro
- Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Espen A F Ihlen
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway.
| |
Collapse
|
4
|
Kihara H, Nakano H, Nakamura T, Gima H. Infant's Behaviour Checklist for low birth weight infants and later neurodevelopmental outcome. Sci Rep 2021; 11:19286. [PMID: 34588563 PMCID: PMC8481230 DOI: 10.1038/s41598-021-98884-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 09/15/2021] [Indexed: 11/09/2022] Open
Abstract
Assessment of the characteristics of spontaneous movements and behaviour in early infancy helps in estimating developmental outcomes. We introduced the Infant Behaviour Checklist (IBC) and examined the relationship between the behavioural characteristics of low-birth-weight infants and neurodevelopmental outcomes at 6 years of age. The behavioural characteristics during the neonatal (36-43 weeks, adjusted) and early infancy periods (49-60 weeks, adjusted) were assessed in very-low-birth-weight infants. The IBC includes 44 common behaviours. We assessed the appearance of individual behavioural characteristics at each period according to the neurodevelopmental outcome. Of the 143 infants assessed during the neonatal period, 89 had typical development (TD), 30 had intellectual disability (ID), and 24 had autism spectrum disorder (ASD). In 78 infants assessed during early infancy, 40, 21, and 17 had TD, ID, and ASD, respectively. The frequency of appearance of three behaviour-related items was significantly lower in the ID group than in the TD group. The frequency of appearance of three posture- and behaviour-related items was significantly lower, while that of two posture-related items was significantly higher, in the ASD group than in the TD group. Behavioural assessment using the IBC may provide promising clues when considering early intervention for low-birth-weight infants.
Collapse
Affiliation(s)
- Hideki Kihara
- Babycastle Corporation, 373-1, Tsubuku-imamachi, Kurume City, Fukuoka, 830-8630, Japan
| | - Hisako Nakano
- Department of Physical Therapy, Kyorin University, 5-4-1 Shimorenjaku, Mitaka City, , Tokyo, 181-8612, Japan
| | - Tomohiko Nakamura
- Department of Neonatology, Nagano Children's Hospital, 3100, Toyoshina, Azumino City, Nagano, 399-8288, Japan
| | - Hirotaka Gima
- Department of Physical Therapy, Faculty of Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
- Department of Physical Therapy, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
| |
Collapse
|
5
|
Wu Y, Bouwstra H, Heineman KR, Hadders‐Algra M. Atypical general movements in the general population: Prevalence over the last 15 years and associated factors. Acta Paediatr 2020; 109:2762-2769. [PMID: 32335944 PMCID: PMC7754433 DOI: 10.1111/apa.15329] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/09/2019] [Revised: 03/16/2020] [Accepted: 04/22/2020] [Indexed: 11/30/2022]
Abstract
AIM To determine the prevalence of atypical general movements (GMs) in the general population, to examine its time trend and associated factors. METHODS Participants consisted of 300 infants born in 2016-2018 (current cohort; gestational age 39.4 weeks (27-42); 162 boys), representative of the Dutch population. GMs were assessed at 2-4 months corrected age in terms of GM-complexity (definitely abnormal (DA) or not) and fidgety movements (present or absent). GM-complexity data from a cohort of 455 Dutch infants born in 2001-2002 were used to investigate the time trend. RESULTS In the current cohort, 10 infants (3%) showed DA GM-complexity and 8 (3%) absent fidgety movements. Only one infant had both GM-impairments (0.3%). The prevalence of DA GM-complexity did not differ from that in the 2001-2002 cohort (adjusted odds ratio (OR) = 1.47 [0.53, 4.06]). DA GM-complexity was associated with maternal smoking (adjusted OR = 3.59 [1.56, 8.28]) and marginally with prematurity (adjusted OR = 2.78 [1.00, 7.74]); absence of fidgety movements was curvilinearly associated with assessment age only (OR = 1.06 [1.01, 1.12]). CONCLUSION In the general population, the prevalence of DA GM-complexity and absent fidgety movements is 3%. The finding that they rarely co-occur and are associated with different factors indicates that GM-assessment needs to address both aspects.
Collapse
Affiliation(s)
- Ying‐Chin Wu
- University of Groningen, University Medical Center GroningenDepartment of PaediatricsDivision of Developmental NeurologyGroningenThe Netherlands
| | - Hylco Bouwstra
- University of Groningen, University Medical Center GroningenDepartment of PaediatricsDivision of Developmental NeurologyGroningenThe Netherlands
- Department of General Practice and Elderly Care MedicineAmsterdam UMCAmsterdamThe Netherlands
| | - Kirsten R. Heineman
- University of Groningen, University Medical Center GroningenDepartment of PaediatricsDivision of Developmental NeurologyGroningenThe Netherlands
- SEIN Stichting Epilepsie Instellingen NederlandZwolleThe Netherlands
| | - Mijna Hadders‐Algra
- University of Groningen, University Medical Center GroningenDepartment of PaediatricsDivision of Developmental NeurologyGroningenThe Netherlands
| |
Collapse
|
6
|
General Movement Assessment from videos of computed 3D infant body models is equally effective compared to conventional RGB video rating. Early Hum Dev 2020; 144:104967. [PMID: 32304982 DOI: 10.1016/j.earlhumdev.2020.104967] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Revised: 01/29/2020] [Accepted: 02/03/2020] [Indexed: 11/24/2022]
Abstract
BACKGROUND General Movement Assessment (GMA) is a powerful tool to predict Cerebral Palsy (CP). Yet, GMA requires substantial training challenging its broad implementation in clinical routine. This inspired a world-wide quest for automated GMA. AIMS To test whether a low-cost, marker-less system for three-dimensional motion capture from RGB depth sequences using a whole body infant model may serve as the basis for automated GMA. STUDY DESIGN Clinical case study at an academic neurodevelopmental outpatient clinic. SUBJECTS Twenty-nine high risk infants were assessed at their clinical follow-up at 2-4 month corrected age (CA). Their neurodevelopmental outcome was assessed regularly up to 12-31 months CA. OUTCOME MEASURES GMA according to Hadders-Algra by a masked GMA-expert of conventional and computed 3D body model ("SMIL motion") videos of the same GMs. Agreement between both GMAs was tested using dichotomous and graded scaling with Kappa and intraclass correlations, respectively. Sensitivity and specificity to predict CP at ≥12 months CA were assessed. RESULTS Agreement of the two GMA ratings was moderate-good for GM-complexity (κ = 0.58; ICC = 0.874 [95%CI 0.730; 0.941]) and substantial-good for fidgety movements (FMs; Kappa = 0.78, ICC = 0.926 [95%CI 0.843; 0.965]). Five children were diagnosed with CP (four bilateral, one unilateral CP). The GMs of the child with unilateral CP were twice rated as mildly abnormal with FMs. GM-complexity and somewhat less FMs, of both conventional and SMIL motion videos predicted bilateral CP comparably to published literature. CONCLUSIONS Our computed infant 3D full body model is an attractive starting point for automated GMA in infants at risk of CP.
Collapse
|
7
|
Fujii S, Watanabe H, Taga G. Wearable strain sensor suit for infants to measure limb movements under interaction with caregiver. Infant Behav Dev 2020; 58:101418. [PMID: 31935592 DOI: 10.1016/j.infbeh.2019.101418] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Revised: 12/25/2019] [Accepted: 12/27/2019] [Indexed: 11/28/2022]
Abstract
Development of motion capture technology has enabled the measurement of body movements over long periods of time in daily life. Although accelerometers have been used as primary sensors, problems arise when they are used to measure the movements of infants. Because infants and caregivers interact frequently, accelerometer data from infants may be significantly distorted by a caregiver's movement. To overcome this problem, a strain sensor suit was developed for infants to measure flexion and extension movements of the limbs. A case study was performed to analyze the strain sensor data of an infant in relation to the accelerometer data of the infant's and a caregiver's body under various types of infant-caregiver interaction. The results demonstrated that the strain sensor data had low correlation with the accelerometer data of the infant and caregiver while the accelerometer data between infant and caregiver had higher correlation. This suggests that the strain sensor is suitable to detect limbs' angular displacements mostly independent from the translational body movements exerted by a caregiver.
Collapse
Affiliation(s)
- Shinya Fujii
- Faculty of Environmental and Information Studies, Keio University, Kanagawa, Japan
| | - Hama Watanabe
- Graduate School of Education, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Gentaro Taga
- Graduate School of Education, The University of Tokyo, Bunkyo-ku, Tokyo, Japan.
| |
Collapse
|
8
|
Gima H, Teshima M, Tagami E, Sato T, Ohta H. The shape of disposable diaper affects spontaneous movements of lower limbs in young infants. Sci Rep 2019; 9:16176. [PMID: 31700099 PMCID: PMC6838332 DOI: 10.1038/s41598-019-52471-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2018] [Accepted: 10/10/2019] [Indexed: 12/24/2022] Open
Abstract
This study examined the characteristics of young infants' lower limb spontaneous movements based on differences in shape of diapers. Twenty-seven healthy infants (103 ± 16.3 days old) were enrolled in this study. We measured the spontaneous movements of their lower limbs in four conditions (Naked, wearing Normal type diapers, wearing Type A diapers, and wearing Type B diapers). The Normal diaper has a wider waist belt than the Type A diaper, and the Type B diaper has a narrower crotch area than the Type A diaper. We observed them in seven indices (the velocity of lower limb movements, the trajectory area of knee movement in the sagittal plane and the frontal plane, the distance between both knees and between side of abdomen and knee, and correlation of velocities between side of abdomen and knee and between left and right ankles). The results showed that the velocity of the lower limb movements in the Naked condition was higher than when wearing Normal diapers. The value for the trajectory area of knee movement in sagittal plane, which reflects the range of lower leg lifting movements and closeness of such movements to the trunk, for the Type B diaper condition was higher than that for the Normal diaper condition. This result indicates that the shape of the diaper affects the spontaneous movements of the lower limbs of young infants.
Collapse
Affiliation(s)
- Hirotaka Gima
- Child Developmental and Learning Research Center, Faculty of Regional Sciences, Tottori University, 4-101 Koyama-Minami, Tottori, 680-8551, Japan
| | - Midori Teshima
- Global Research & Development Division, Unicharm Corporation, 1531-7 Wadahama, Toyohama-cho, Kanonji, Kagawa, 769-1602, Japan
| | - Etsuko Tagami
- Global Research & Development Division, Unicharm Corporation, 1531-7 Wadahama, Toyohama-cho, Kanonji, Kagawa, 769-1602, Japan
| | - Toshihiro Sato
- Global Research & Development Division, Unicharm Corporation, 1531-7 Wadahama, Toyohama-cho, Kanonji, Kagawa, 769-1602, Japan
| | - Hidenobu Ohta
- Department of Pyschophysiology, National Institute of Mental Health, National Center of Neurology and Psychiatry, 4-1-1 Ogawa-higashi-cho, Kodaira, Tokyo, 187-8553, Japan. .,Department of Psychiatry, Asai Hospital, 38-1 Togane, Chiba, 283-0062, Japan. .,Department of Neuropsychiatry, Akita University Graduate School of Medicine, 1-1-1, Akita, 010-8543, Japan.
| |
Collapse
|
9
|
Heathcock JC, Lockman JJ. Infant and Child Development: Innovations and Foundations for Rehabilitation. Phys Ther 2019; 99:643-646. [PMID: 31155659 DOI: 10.1093/ptj/pzz067] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/07/2019] [Accepted: 04/07/2019] [Indexed: 11/13/2022]
Affiliation(s)
- Jill C Heathcock
- The Ohio State University, Columbus, Ohio. Dr Heathcock is a PTJ Editorial Board member
| | | |
Collapse
|