1
|
Doroniewicz I, Ledwoń DJ, Bugdol M, Kieszczyńska K, Affanasowicz A, Latos D, Matyja M, Myśliwiec A. Towards novel classification of infants' movement patterns supported by computerized video analysis. J Neuroeng Rehabil 2024; 21:129. [PMID: 39085937 PMCID: PMC11290138 DOI: 10.1186/s12984-024-01429-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 07/22/2024] [Indexed: 08/02/2024] Open
Abstract
BACKGROUND Positional preferences, asymmetry of body position and movements potentially indicate abnormal clinical conditions in infants. However, a lack of standardized nomenclature hinders accurate assessment and documentation of these preferences over time. Video tools offer a safe and reproducible method to analyze and describe infant movement patterns, aiding in physiotherapy management and goal planning. The study aimed to develop an objective classification system for infant movement patterns with particular emphasis on the specific distribution of muscle tension, using methods of computer analysis of video recordings to enhance accuracy and reproducibility in assessments. METHODS The study involved the recording of videos of 51 infants between 6 and 15 weeks of age, born at term, with an Apgar score of at least 8 points. Based on observations of a recording of infant spontaneous movements in the supine position, experts identified postural-motor patterns: symmetry and typical asymmetry linked to the asymmetrical tonic neck reflex. Deviations from the typical postural-motor system were indicated, and subcategories of atypical patterns were distinguished. A computer-based inference system was developed to automatically classify individual patterns. RESULTS The following division of motor patterns was used: (1) normal patterns, including (a) typical (symmetrical, asymmetrical: variants 1 and 2); and (b) atypical (variants: 1 to 4), (2) positional preference, and (3) abnormal patterns. The proposed automatic classification method achieved an expert decision mapping accuracy of 84%. For atypical patterns, the high reproducibility of the system's results was confirmed. Lower reproducibility, not exceeding 70%, was achieved with typical patterns. CONCLUSIONS Based on the observation of infant spontaneous movements, it is possible to identify movement patterns divided into typical and atypical patterns. Computer-based analysis of infant movement patterns makes it possible to objectify and satisfactorily reproduce diagnostic decisions.
Collapse
Affiliation(s)
- Iwona Doroniewicz
- Institute of Physiotherapy and Health Science, Academy of Physical Education in Katowice, Katowice, Poland
| | - Daniel J Ledwoń
- Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800, Zabrze, Poland.
| | - Monika Bugdol
- Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800, Zabrze, Poland
| | - Katarzyna Kieszczyńska
- Institute of Physiotherapy and Health Science, Academy of Physical Education in Katowice, Katowice, Poland
| | - Alicja Affanasowicz
- Institute of Physiotherapy and Health Science, Academy of Physical Education in Katowice, Katowice, Poland
| | - Dominika Latos
- Institute of Physiotherapy and Health Science, Academy of Physical Education in Katowice, Katowice, Poland
| | - Małgorzata Matyja
- Institute of Physiotherapy and Health Science, Academy of Physical Education in Katowice, Katowice, Poland
| | - Andrzej Myśliwiec
- Institute of Physiotherapy and Health Science, Academy of Physical Education in Katowice, Katowice, Poland
| |
Collapse
|
2
|
Cleary DB, Maybery MT, Green C, Whitehouse AJO. The first six months of life: A systematic review of early markers associated with later autism. Neurosci Biobehav Rev 2023; 152:105304. [PMID: 37406749 DOI: 10.1016/j.neubiorev.2023.105304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 06/02/2023] [Accepted: 07/02/2023] [Indexed: 07/07/2023]
Abstract
There is now good evidence that behavioural signs of autism spectrum conditions (autism) emerge over the first two years of life. Identifying clear developmental differences early in life may facilitate earlier identification and intervention that can promote longer-term quality of life. Here we present a systematic review of studies investigating behavioural markers of later autism diagnosis or symptomology taken at 0-6 months. The following databases were searched for articles published between 01/01/2000 and 15/03/2022: Embase, Medline, Scopus, PubMed, PsycINFO, CINAHL, Web of Science and Proquest. Twenty-five studies met inclusion criteria: assessment of behaviour at 0-6 months and later assessment of autism symptomology or diagnosis. Studies examined behaviours of attention, early social and communication behaviours, and motor behaviours, as well as composite measures. Findings indicated some evidence of measures of general attention, attention to social stimuli, and motor behaviours associated with later autism diagnosis or symptomology. Findings were inconsistent regarding social and communication behaviours, with a lack of repeated or validated measures limiting drawing firm conclusions. We discuss implications of the findings and suggest recommendations for future research.
Collapse
Affiliation(s)
- Dominique B Cleary
- Telethon Kids Institute, The University of Western Australia, Australia; School of Psychological Science, The University of Western Australia, Australia.
| | - Murray T Maybery
- School of Psychological Science, The University of Western Australia, Australia
| | | | | |
Collapse
|
3
|
Mendez AI, Tokish H, McQueen E, Chawla S, Klin A, Maitre NL, Klaiman C. A Comparison of the Clinical Presentation of Preterm Birth and Autism Spectrum Disorder: Commonalities and Distinctions in Children Under 3. Clin Perinatol 2023; 50:81-101. [PMID: 36868715 PMCID: PMC10842306 DOI: 10.1016/j.clp.2022.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2023]
Abstract
Premature infants and infants later diagnosed with autism spectrum disorder (ASD) share many commonalities in clinical presentations. However, prematurity and ASD also have differences in clinical presentation. These overlapping phenotypes can lead to misdiagnoses of ASD or missing a diagnosis of ASD in preterm infants. We document these commonalities and differences in various developmental domains with the hope of aiding in the accurate early detection of ASD and timely intervention implementation in children born premature. Given the degree of similarities in presentation, evidence-based interventions designed specifically for preterm toddlers or toddlers with ASD may ultimately aid both populations.
Collapse
Affiliation(s)
- Adriana I Mendez
- Department of Psychology, Emory University, 36 Eagle Row, Atlanta, GA 30322, USA; Marcus Autism Center, 1920 Briarcliff Road, Atlanta, GA 30329, USA; Department of Pediatrics, Emory University School of Medicine, 2015 Uppergate Drive, Atlanta, GA 30322, USA; Children's Healthcare of Atlanta, 1405 Clifton Road Northeast, Atlanta, GA 30322, USA
| | - Hannah Tokish
- Marcus Autism Center, 1920 Briarcliff Road, Atlanta, GA 30329, USA; Department of Pediatrics, Emory University School of Medicine, 2015 Uppergate Drive, Atlanta, GA 30322, USA; Children's Healthcare of Atlanta, 1405 Clifton Road Northeast, Atlanta, GA 30322, USA
| | - Emma McQueen
- Marcus Autism Center, 1920 Briarcliff Road, Atlanta, GA 30329, USA; Department of Pediatrics, Emory University School of Medicine, 2015 Uppergate Drive, Atlanta, GA 30322, USA; Children's Healthcare of Atlanta, 1405 Clifton Road Northeast, Atlanta, GA 30322, USA
| | - Shivaang Chawla
- Marcus Autism Center, 1920 Briarcliff Road, Atlanta, GA 30329, USA; Department of Pediatrics, Emory University School of Medicine, 2015 Uppergate Drive, Atlanta, GA 30322, USA; Children's Healthcare of Atlanta, 1405 Clifton Road Northeast, Atlanta, GA 30322, USA
| | - Ami Klin
- Marcus Autism Center, 1920 Briarcliff Road, Atlanta, GA 30329, USA; Department of Pediatrics, Emory University School of Medicine, 2015 Uppergate Drive, Atlanta, GA 30322, USA; Children's Healthcare of Atlanta, 1405 Clifton Road Northeast, Atlanta, GA 30322, USA
| | - Nathalie L Maitre
- Department of Pediatrics, Emory University School of Medicine, 2015 Uppergate Drive, Atlanta, GA 30322, USA; Children's Healthcare of Atlanta, 1405 Clifton Road Northeast, Atlanta, GA 30322, USA
| | - Cheryl Klaiman
- Marcus Autism Center, 1920 Briarcliff Road, Atlanta, GA 30329, USA; Department of Pediatrics, Emory University School of Medicine, 2015 Uppergate Drive, Atlanta, GA 30322, USA; Children's Healthcare of Atlanta, 1405 Clifton Road Northeast, Atlanta, GA 30322, USA.
| |
Collapse
|
4
|
Sermpon N, Gima H. Relationship between fidgety movement and frequency of movement toward midline: An observational study. Early Hum Dev 2023; 177-178:105718. [PMID: 36801663 DOI: 10.1016/j.earlhumdev.2023.105718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Revised: 01/24/2023] [Accepted: 01/24/2023] [Indexed: 02/04/2023]
Abstract
BACKGROUND Infants show other movements and posture patterns during the fidgety movement period, including movement toward midline (MTM). Few studies have quantified MTM occurring during the fidgety movement period. AIMS This study aimed to examine the relationship between fidgety movements (FMs) and MTM frequency and occurrence rate per minute, from two video data sets (video attached to Prechtl video manual and accuracy data from Japan). STUDY DESIGN Observational study. SUBJECTS It encompassed 47 videos. Of these, 32 were deemed normal FMs. The study amalgamated FMs that were sporadic, abnormal, or absent into a category of aberrant (n = 15). OUTCOME MEASURES Infant video data were observed. MTM item occurrences were recorded and calculated for occurrence percentage and MTM rate of occurrence per minute. The differences between groups for the upper limbs, lower limbs, and total MTM were statistically analysed. RESULTS Twenty-three infant videos of normal FMs and seven infant videos of aberrant FMs showed MTM. Eight infant videos of aberrant FMs showed no MTM, and only four with absent FMs were included. There was a significant difference in the total MTM rate of occurrence per minute between normal FMs versus aberrant FMs (p = 0.008). CONCLUSIONS This study presented MTM frequency and rate of occurrence per minute in infants who showed FMs during the fidgety movement period. Those who showed absent FMs also demonstrated no MTM. Further study may need a larger sample size of absent FMs and information on later development.
Collapse
Affiliation(s)
- Nisasri Sermpon
- Department of Physical Therapy, Graduate School of Human Health Sciences, Tokyo Metropolitan University, Japan; Faculty of Physical Therapy, Mahidol University, Thailand
| | - Hirotaka Gima
- Department of Physical Therapy, Graduate School of Human Health Sciences, Tokyo Metropolitan University, Japan.
| |
Collapse
|
5
|
Doi H, Iijima N, Furui A, Soh Z, Yonei R, Shinohara K, Iriguchi M, Shimatani K, Tsuji T. Prediction of autistic tendencies at 18 months of age via markerless video analysis of spontaneous body movements in 4-month-old infants. Sci Rep 2022; 12:18045. [PMID: 36302797 PMCID: PMC9614013 DOI: 10.1038/s41598-022-21308-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Accepted: 09/26/2022] [Indexed: 01/24/2023] Open
Abstract
Early intervention is now considered the core treatment strategy for autism spectrum disorders (ASD). Thus, it is of significant clinical importance to establish a screening tool for the early detection of ASD in infants. To achieve this goal, in a longitudinal design, we analyzed spontaneous bodily movements of 4-month-old infants from general population and assessed their ASD-like behaviors at 18 months of age. A total of 26 movement features were calculated from video-recorded bodily movements of infants at 4 months of age. Their risk of ASD was assessed at 18 months of age with the Modified Checklist for Autism in Toddlerhood, a widely used screening questionnaire. Infants at high risk for ASD at 18 months of age exhibited less rhythmic and weaker bodily movement patterns at 4 months of age than low-risk infants. When the observed bodily movement patterns were submitted to a machine learning-based analysis, linear and non-linear classifiers successfully predicted ASD-like behavior at 18 months of age based on the bodily movement patterns at 4 months of age, at the level acceptable for practical use. This study analyzed the relationship between spontaneous bodily movements at 4 months of age and the ASD risk at 18 months of age. Experimental results suggested the utility of the proposed method for the early screening of infants at risk for ASD. We revealed that the signs of ASD risk could be detected as early as 4 months after birth, by focusing on the infant's spontaneous bodily movements.
Collapse
Affiliation(s)
- Hirokazu Doi
- grid.411113.70000 0000 9122 4296Department of Science and Engineering, Kokushikan University, Setagaya, Japan
| | - Naoya Iijima
- grid.257022.00000 0000 8711 3200Graduate School of Engineering, Hiroshima University, Higashihiroshima, Japan
| | - Akira Furui
- grid.257022.00000 0000 8711 3200Graduate School of Advanced Science and Engineering, Hiroshima University, Higashihiroshima, Japan
| | - Zu Soh
- grid.257022.00000 0000 8711 3200Graduate School of Advanced Science and Engineering, Hiroshima University, Higashihiroshima, Japan
| | - Rikuya Yonei
- grid.257022.00000 0000 8711 3200School of Engineering, Hiroshima University, Higashihiroshima, Japan
| | - Kazuyuki Shinohara
- grid.174567.60000 0000 8902 2273Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
| | - Mayuko Iriguchi
- grid.174567.60000 0000 8902 2273Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
| | - Koji Shimatani
- grid.412155.60000 0001 0726 4429Faculty of Health and Welfare, Prefectural University of Hiroshima, Hiroshima, Japan
| | - Toshio Tsuji
- grid.257022.00000 0000 8711 3200Graduate School of Advanced Science and Engineering, Hiroshima University, Higashihiroshima, Japan
| |
Collapse
|
6
|
Posar A, Visconti P. Early Motor Signs in Autism Spectrum Disorder. CHILDREN (BASEL, SWITZERLAND) 2022; 9:children9020294. [PMID: 35205014 PMCID: PMC8870370 DOI: 10.3390/children9020294] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 02/08/2022] [Accepted: 02/17/2022] [Indexed: 12/02/2022]
Abstract
A growing number of literature data suggest the presence of early impairments in the motor development of children with autism spectrum disorder, which could be often recognized even before the appearance of the classical social communication deficits of autism. In this narrative review, we aimed at performing an update about the available data on the early motor function in children with autism spectrum disorder. Early motor impairment in these children can manifest itself both as a mere delay of motor development and as the presence of atypicalities of motor function, such as a higher rate and a larger inventory, of stereotyped movements both with and without objects. In the perspective of a timely diagnosis, the presence of early motor signs can be an important clue, especially in an individual considered at high risk for autism. Motor and communication (both verbal and non-verbal) skills are connected and a pathogenetic role of early motor dysfunctions in the development of autism can be hypothesized. From this, derives the importance of an early enabling intervention aimed at improving motor skills, which could also have favorable effects on other aspects of development.
Collapse
Affiliation(s)
- Annio Posar
- IRCCS Istituto delle Scienze Neurologiche di Bologna, UOSI Disturbi dello Spettro Autistico, 40139 Bologna, Italy;
- Dipartimento di Scienze Biomediche e Neuromotorie, Università di Bologna, 40126 Bologna, Italy
- Correspondence: ; Tel.: +39-051-6225111
| | - Paola Visconti
- IRCCS Istituto delle Scienze Neurologiche di Bologna, UOSI Disturbi dello Spettro Autistico, 40139 Bologna, Italy;
| |
Collapse
|
7
|
Early Developmental Signs in Children with Autism Spectrum Disorder: Results from the Japan Environment and Children’s Study. CHILDREN 2022; 9:children9010090. [PMID: 35053715 PMCID: PMC8774672 DOI: 10.3390/children9010090] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Revised: 12/25/2021] [Accepted: 01/05/2022] [Indexed: 11/16/2022]
Abstract
Autism spectrum disorder (ASD) is a developmental disability in early childhood. Early identification and intervention in children with ASD are essential for children and their families. This study aimed to identify the earliest signs of ASD. Using a large cohort including data from 104,062 fetal records in the Japan Environment and Children’s Study, we examined the Ages and Stages Questionnaires® (ASQ-3TM) scores of children with and without ASD. The ASQ-3 comprises five domains: communication, gross motor, fine motor, problem solving, and personal-social. The ASQ-3 scores were obtained at ages 6 months, 1 year, and 3 years. There were 64,501 children with available ASQ-3 data. The number of children diagnosed with ASD was 188 (0.29%) at 3 years of age. The highest relative risk (RR) for any domain below the monitoring score at 6 months was in the communication (RR 1.90, 95% CI 1.29–2.78, p = 0.0041), followed by fine motor (RR 1.50, 95% CI 1.28–1.76, p < 0.0001) domain. A low ASQ-3 score in the communication domain at 6 months was related to an ASD diagnosis at 3 years of age. The ASQ-3 score at 6 months can contribute to the early identification of and intervention for ASD.
Collapse
|
8
|
Taga G. Global entrainment in the brain-body-environment: retrospective and prospective views. BIOLOGICAL CYBERNETICS 2021; 115:431-438. [PMID: 34633537 DOI: 10.1007/s00422-021-00898-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 09/25/2021] [Indexed: 05/21/2023]
Abstract
We celebrate the 60th anniversary of Biological Cybernetics. It has also been 30 years since "Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment" was published in Biological Cybernetics (Taga et al. in Biol Cybern 65(3):147-159, 1991). I would like to look back on the creation of this paper and discuss its subsequent development and future perspectives.
Collapse
Affiliation(s)
- Gentaro Taga
- Graduate School of Education, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.
| |
Collapse
|
9
|
Kihara H, Nakano H, Nakamura T, Gima H. Infant's Behaviour Checklist for low birth weight infants and later neurodevelopmental outcome. Sci Rep 2021; 11:19286. [PMID: 34588563 PMCID: PMC8481230 DOI: 10.1038/s41598-021-98884-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 09/15/2021] [Indexed: 11/09/2022] Open
Abstract
Assessment of the characteristics of spontaneous movements and behaviour in early infancy helps in estimating developmental outcomes. We introduced the Infant Behaviour Checklist (IBC) and examined the relationship between the behavioural characteristics of low-birth-weight infants and neurodevelopmental outcomes at 6 years of age. The behavioural characteristics during the neonatal (36-43 weeks, adjusted) and early infancy periods (49-60 weeks, adjusted) were assessed in very-low-birth-weight infants. The IBC includes 44 common behaviours. We assessed the appearance of individual behavioural characteristics at each period according to the neurodevelopmental outcome. Of the 143 infants assessed during the neonatal period, 89 had typical development (TD), 30 had intellectual disability (ID), and 24 had autism spectrum disorder (ASD). In 78 infants assessed during early infancy, 40, 21, and 17 had TD, ID, and ASD, respectively. The frequency of appearance of three behaviour-related items was significantly lower in the ID group than in the TD group. The frequency of appearance of three posture- and behaviour-related items was significantly lower, while that of two posture-related items was significantly higher, in the ASD group than in the TD group. Behavioural assessment using the IBC may provide promising clues when considering early intervention for low-birth-weight infants.
Collapse
Affiliation(s)
- Hideki Kihara
- Babycastle Corporation, 373-1, Tsubuku-imamachi, Kurume City, Fukuoka, 830-8630, Japan
| | - Hisako Nakano
- Department of Physical Therapy, Kyorin University, 5-4-1 Shimorenjaku, Mitaka City, , Tokyo, 181-8612, Japan
| | - Tomohiko Nakamura
- Department of Neonatology, Nagano Children's Hospital, 3100, Toyoshina, Azumino City, Nagano, 399-8288, Japan
| | - Hirotaka Gima
- Department of Physical Therapy, Faculty of Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
- Department of Physical Therapy, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
| |
Collapse
|
10
|
Karadaş C, Bakkaloğlu H, Demir Ş. Exploring the effect of motor coordination on repetitive behaviours in children with autism spectrum disorder. INTERNATIONAL JOURNAL OF DEVELOPMENTAL DISABILITIES 2021; 69:238-247. [PMID: 37025329 PMCID: PMC10071942 DOI: 10.1080/20473869.2021.1948318] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Revised: 05/24/2021] [Accepted: 06/22/2021] [Indexed: 06/19/2023]
Abstract
Objective: This study was conducted to explore the effect of motor coordination on repetitive behaviors in children with Autism Spectrum Disorder (ASD) aged 5-15 years. Methods: The study employed the causal-comparative design, one of the correlational survey designs. The study was carried out with data obtained from parents of 241 children with ASD. The parents were administered the measurement tools of Gilliam Autism Rating Scale-2-Turkish Version to confirm the diagnosis of ASD, Demographic Information Form to obtain information about the child and the parent, Repetitive Behavior Scale-Revised-Turkish Version to evaluate the repetitive behaviors, and Developmental Coordination Disorder Questionnaire-07-Turkish Version to evaluate the motor coordination performance. The data were analyzed MANCOVA in the R package program. Results: The study results revealed that 72% of children with ASD had a risk of Developmental Coordination Disorder (DCD). The repetitive behaviors of children with and without DCD risk differed significantly. The severity and intensity of the repetitive behaviors of children with DCD risk were higher than those without DCD risk when age, gender, and comorbidity were taken under control. Conclusion: The motor coordination problems in children with ASD are effective on repetitive behaviors.
Collapse
Affiliation(s)
- Cebrail Karadaş
- Department of Special Education, Ankara University, Ankara, Turkey
| | | | - Şeyda Demir
- Department of Special Education, Ankara University, Ankara, Turkey
| |
Collapse
|
11
|
Alvari G, Furlanello C, Venuti P. Is Smiling the Key? Machine Learning Analytics Detect Subtle Patterns in Micro-Expressions of Infants with ASD. J Clin Med 2021; 10:1776. [PMID: 33921756 PMCID: PMC8073678 DOI: 10.3390/jcm10081776] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Revised: 04/15/2021] [Accepted: 04/16/2021] [Indexed: 01/01/2023] Open
Abstract
Time is a key factor to consider in Autism Spectrum Disorder. Detecting the condition as early as possible is crucial in terms of treatment success. Despite advances in the literature, it is still difficult to identify early markers able to effectively forecast the manifestation of symptoms. Artificial intelligence (AI) provides effective alternatives for behavior screening. To this end, we investigated facial expressions in 18 autistic and 15 typical infants during their first ecological interactions, between 6 and 12 months of age. We employed Openface, an AI-based software designed to systematically analyze facial micro-movements in images in order to extract the subtle dynamics of Social Smiles in unconstrained Home Videos. Reduced frequency and activation intensity of Social Smiles was computed for children with autism. Machine Learning models enabled us to map facial behavior consistently, exposing early differences hardly detectable by non-expert naked eye. This outcome contributes to enhancing the potential of AI as a supportive tool for the clinical framework.
Collapse
Affiliation(s)
- Gianpaolo Alvari
- Department of Psychology and Cognitive Sciences, University of Trento, 38068 Rovereto, Italy;
- Data Science for Health (DSH) Research Unit, Bruno Kessler Foundation (FBK), 38123 Trento, Italy
| | | | - Paola Venuti
- Department of Psychology and Cognitive Sciences, University of Trento, 38068 Rovereto, Italy;
| |
Collapse
|
12
|
de Belen RAJ, Bednarz T, Sowmya A, Del Favero D. Computer vision in autism spectrum disorder research: a systematic review of published studies from 2009 to 2019. Transl Psychiatry 2020; 10:333. [PMID: 32999273 PMCID: PMC7528087 DOI: 10.1038/s41398-020-01015-w] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Revised: 09/04/2020] [Accepted: 09/09/2020] [Indexed: 11/29/2022] Open
Abstract
The current state of computer vision methods applied to autism spectrum disorder (ASD) research has not been well established. Increasing evidence suggests that computer vision techniques have a strong impact on autism research. The primary objective of this systematic review is to examine how computer vision analysis has been useful in ASD diagnosis, therapy and autism research in general. A systematic review of publications indexed on PubMed, IEEE Xplore and ACM Digital Library was conducted from 2009 to 2019. Search terms included ['autis*' AND ('computer vision' OR 'behavio* imaging' OR 'behavio* analysis' OR 'affective computing')]. Results are reported according to PRISMA statement. A total of 94 studies are included in the analysis. Eligible papers are categorised based on the potential biological/behavioural markers quantified in each study. Then, different computer vision approaches that were employed in the included papers are described. Different publicly available datasets are also reviewed in order to rapidly familiarise researchers with datasets applicable to their field and to accelerate both new behavioural and technological work on autism research. Finally, future research directions are outlined. The findings in this review suggest that computer vision analysis is useful for the quantification of behavioural/biological markers which can further lead to a more objective analysis in autism research.
Collapse
Affiliation(s)
| | - Tomasz Bednarz
- School of Art & Design, University of New South Wales, Sydney, NSW, Australia
| | - Arcot Sowmya
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW, Australia
| | - Dennis Del Favero
- School of Art & Design, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
13
|
Ohtaka-Maruyama C. Subplate Neurons as an Organizer of Mammalian Neocortical Development. Front Neuroanat 2020; 14:8. [PMID: 32265668 PMCID: PMC7103628 DOI: 10.3389/fnana.2020.00008] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Accepted: 02/20/2020] [Indexed: 12/30/2022] Open
Abstract
Subplate neurons (SpNs) are one of the earliest born and matured neurons in the developing cerebral cortex and play an important role in the early development of the neocortex. It has been known that SpNs have an essential role in thalamocortical axon (TCA) pathfinding and the establishment of the first neural circuit from the thalamus towards cortical layer IV. In addition to this function, it has recently been revealed in mouse corticogenesis that SpNs play an important role in the regulation of radial neuronal migration during the mid-embryonic stage. Moreover, accumulating studies throw light on the possible roles of SpNs in adult brain functions and also their involvement in psychiatric or other neurological disorders. As SpNs are unique to mammals, they may have contributed to the evolution of the mammalian neocortex by efficiently organizing cortical formation during the limited embryonic period of corticogenesis. By increasing our knowledge of the functions of SpNs, we will clarify how SpNs act as an organizer of mammalian neocortical formation.
Collapse
Affiliation(s)
- Chiaki Ohtaka-Maruyama
- Neural Network Project, Department of Brain Development and Neural Regeneration, Tokyo Metropolitan Institute of Medical Science, Tokyo, Japan
| |
Collapse
|
14
|
Gima H, Teshima M, Tagami E, Sato T, Ohta H. The shape of disposable diaper affects spontaneous movements of lower limbs in young infants. Sci Rep 2019; 9:16176. [PMID: 31700099 PMCID: PMC6838332 DOI: 10.1038/s41598-019-52471-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2018] [Accepted: 10/10/2019] [Indexed: 12/24/2022] Open
Abstract
This study examined the characteristics of young infants' lower limb spontaneous movements based on differences in shape of diapers. Twenty-seven healthy infants (103 ± 16.3 days old) were enrolled in this study. We measured the spontaneous movements of their lower limbs in four conditions (Naked, wearing Normal type diapers, wearing Type A diapers, and wearing Type B diapers). The Normal diaper has a wider waist belt than the Type A diaper, and the Type B diaper has a narrower crotch area than the Type A diaper. We observed them in seven indices (the velocity of lower limb movements, the trajectory area of knee movement in the sagittal plane and the frontal plane, the distance between both knees and between side of abdomen and knee, and correlation of velocities between side of abdomen and knee and between left and right ankles). The results showed that the velocity of the lower limb movements in the Naked condition was higher than when wearing Normal diapers. The value for the trajectory area of knee movement in sagittal plane, which reflects the range of lower leg lifting movements and closeness of such movements to the trunk, for the Type B diaper condition was higher than that for the Normal diaper condition. This result indicates that the shape of the diaper affects the spontaneous movements of the lower limbs of young infants.
Collapse
Affiliation(s)
- Hirotaka Gima
- Child Developmental and Learning Research Center, Faculty of Regional Sciences, Tottori University, 4-101 Koyama-Minami, Tottori, 680-8551, Japan
| | - Midori Teshima
- Global Research & Development Division, Unicharm Corporation, 1531-7 Wadahama, Toyohama-cho, Kanonji, Kagawa, 769-1602, Japan
| | - Etsuko Tagami
- Global Research & Development Division, Unicharm Corporation, 1531-7 Wadahama, Toyohama-cho, Kanonji, Kagawa, 769-1602, Japan
| | - Toshihiro Sato
- Global Research & Development Division, Unicharm Corporation, 1531-7 Wadahama, Toyohama-cho, Kanonji, Kagawa, 769-1602, Japan
| | - Hidenobu Ohta
- Department of Pyschophysiology, National Institute of Mental Health, National Center of Neurology and Psychiatry, 4-1-1 Ogawa-higashi-cho, Kodaira, Tokyo, 187-8553, Japan. .,Department of Psychiatry, Asai Hospital, 38-1 Togane, Chiba, 283-0062, Japan. .,Department of Neuropsychiatry, Akita University Graduate School of Medicine, 1-1-1, Akita, 010-8543, Japan.
| |
Collapse
|
15
|
Gima H, Shimatani K, Nakano H, Watanabe H, Taga G. Evaluation of Fidgety Movements of Infants Based on Gestalt Perception Reflects Differences in Limb Movement Trajectory Curvature. Phys Ther 2019; 99:701-710. [PMID: 31155660 DOI: 10.1093/ptj/pzz034] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/08/2018] [Accepted: 02/12/2019] [Indexed: 11/12/2022]
Abstract
BACKGROUND Infants aged 2 to 5 months show spontaneous general movements (GMs) of the whole body, which are referred to as fidgety movements (FMs). Although previous studies have shown that evaluation of GMs by the General Movement Assessment (GMA) has predictive value about later neurological impairments, it remains unknown whether raters consistently perceive and rate such complex kinematic information. OBJECTIVE The purpose of this study was to construct a method to reveal which movement features are associated with each rater's evaluation of FMs based on the GMA. DESIGN GMA scores of 163 healthy infants aged 11 to 16 weeks postterm were matched with data obtained from a 3-dimensional motion analysis system. METHODS Three physical therapists performed the GMA and classified GMs into 9 types, from which we focused on 3 subtypes differing in the temporal organization of FMs (continual, intermittent, and sporadic FMs). We also calculated 6 movement indices (average velocity of limb movements, number of movement units, kurtosis of acceleration, jerk index, average curvature, and correlation between limb velocities) for arms and legs for each infant and analyzed which movement indices were associated with the ratings of the 3 FM subtypes by each rater. RESULTS Only the average curvature differed significantly among the ratings of the 3 FM subtypes for all 3 raters. Each rater showed significant differences in the average curvature in either arms or legs. LIMITATIONS It is difficult to generalize the present results to raters with various levels of expertise and experience in using the GMA. This issue calls for further research. CONCLUSIONS The method used revealed commonality and individuality about the perceived movement features that can be associated with the rating of FMs.
Collapse
Affiliation(s)
- Hirotaka Gima
- Child Developmental and Learning Research Center, Faculty of Regional Sciences, Tottori University, 4-101, Koyama-Minami, Tottori, 680-8550, Japan; and Graduate School of Education, The University of Tokyo, Tokyo, Japan
| | - Koji Shimatani
- Graduate School of Comprehensive Scientific Research, Prefectural University of Hiroshima, Hiroshima, Japan
| | - Hisako Nakano
- Department of Physical Therapy, Kyorin University, Tokyo, Japan
| | - Hama Watanabe
- Graduate School of Education, The University of Tokyo
| | - Gentaro Taga
- Graduate School of Education, The University of Tokyo
| |
Collapse
|
16
|
Sapiro G, Hashemi J, Dawson G. Computer vision and behavioral phenotyping: an autism case study. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2019; 9:14-20. [PMID: 37786644 PMCID: PMC10544819 DOI: 10.1016/j.cobme.2018.12.002] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Despite significant recent advances in molecular genetics and neuroscience, behavioral ratings based on clinical observations are still the gold standard for screening, diagnosing, and assessing outcomes in neurodevelopmental disorders, including autism spectrum disorder. Such behavioral ratings are subjective, require significant clinician expertise and training, typically do not capture data from the children in their natural environments such as homes or schools, and are not scalable for large population screening, low-income communities, or longitudinal monitoring, all of which are critical for outcome evaluation in multisite studies and for understanding and evaluating symptoms in the general population. The development of computational approaches to standardized objective behavioral assessment is, thus, a significant unmet need in autism spectrum disorder in particular and developmental and neurodegenerative disorders in general. Here, we discuss how computer vision, and machine learning, can develop scalable low-cost mobile health methods for automatically and consistently assessing existing biomarkers, from eye tracking to movement patterns and affect, while also providing tools and big data for novel discovery.
Collapse
Affiliation(s)
- Guillermo Sapiro
- Electrical and Computer Engineering, Computer Sciences, Biomedical Engineering, and Math, Duke University, Durham, NC, 27707, United States
| | - Jordan Hashemi
- Electrical and Computer Engineering, Duke University, Durham, NC, 27707, United States
| | - Geraldine Dawson
- Duke Center for Autism and Brain Development, Department of Psychiatry and Behavioral Science, Duke University, Durham, NC, 27707, United States
| |
Collapse
|
17
|
Ben-Sasson A, Atun-Einy O, Yahav-Jonas G, Lev-On S, Gev T. Training Physical Therapists in Early ASD Screening. J Autism Dev Disord 2018; 48:3926-3938. [PMID: 29971656 DOI: 10.1007/s10803-018-3668-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Physical therapists (PTs) are often one of the first professionals to evaluate children at risk. To examine the effect of an early screening training on pediatric PTs': (1) knowledge of autism spectrum disorder (ASD), (2) clinical self-efficacy, and (3) identification of markers. Twenty-six PTs participated in a 2-day "Early ASD Screening" workshop. The ASD Knowledge and Self-Efficacy Questionnaire, and video case study analysis were completed pre- and post-training. Changes following training were significant for ASD knowledge related to etiology and learning performance, early signs, risk factors, and clinical self-efficacy. Rating the videoed case study after the training, was significantly more accurate than it was before. Training PTs is important for enhancing early identification of ASD.
Collapse
Affiliation(s)
- Ayelet Ben-Sasson
- Department of Occupational Therapy, University of Haifa, 3498838, Haifa, Israel.
| | - Osnat Atun-Einy
- Department of Physical Therapy, University of Haifa, 3498838, Haifa, Israel
| | - Gal Yahav-Jonas
- Association for Children at Risk, 9 Hazvi St., Tel Aviv, 67197, Israel
| | - Shimona Lev-On
- Weinberg Child Development Center, Sheba Tel-Hashomer Hospital, Ramat Gan, 52621, Israel
| | - Tali Gev
- Department of Psychology, Bar-Ilan University, Ramat Gan, 5290002, Israel
| |
Collapse
|
18
|
Dawson G, Campbell K, Hashemi J, Lippmann SJ, Smith V, Carpenter K, Egger H, Espinosa S, Vermeer S, Baker J, Sapiro G. Atypical postural control can be detected via computer vision analysis in toddlers with autism spectrum disorder. Sci Rep 2018; 8:17008. [PMID: 30451886 PMCID: PMC6242931 DOI: 10.1038/s41598-018-35215-8] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2018] [Accepted: 10/31/2018] [Indexed: 12/23/2022] Open
Abstract
Evidence suggests that differences in motor function are an early feature of autism spectrum disorder (ASD). One aspect of motor ability that develops during childhood is postural control, reflected in the ability to maintain a steady head and body position without excessive sway. Observational studies have documented differences in postural control in older children with ASD. The present study used computer vision analysis to assess midline head postural control, as reflected in the rate of spontaneous head movements during states of active attention, in 104 toddlers between 16-31 months of age (Mean = 22 months), 22 of whom were diagnosed with ASD. Time-series data revealed robust group differences in the rate of head movements while the toddlers watched movies depicting social and nonsocial stimuli. Toddlers with ASD exhibited a significantly higher rate of head movement as compared to non-ASD toddlers, suggesting difficulties in maintaining midline position of the head while engaging attentional systems. The use of digital phenotyping approaches, such as computer vision analysis, to quantify variation in early motor behaviors will allow for more precise, objective, and quantitative characterization of early motor signatures and potentially provide new automated methods for early autism risk identification.
Collapse
Affiliation(s)
- Geraldine Dawson
- Duke Center for Autism and Brain Development, Department of Psychiatry and Behavioral Sciences, Duke University, Durham, North Carolina, USA.
| | | | - Jordan Hashemi
- Duke Center for Autism and Brain Development, Department of Psychiatry and Behavioral Sciences, Duke University, Durham, North Carolina, USA
- Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina, USA
| | - Steven J Lippmann
- Department of Population Health Sciences, Duke University, Durham, North Carolina, USA
| | - Valerie Smith
- Department of Population Health Sciences, Duke University, Durham, North Carolina, USA
| | - Kimberly Carpenter
- Duke Center for Autism and Brain Development, Department of Psychiatry and Behavioral Sciences, Duke University, Durham, North Carolina, USA
| | - Helen Egger
- NYU Langone Child Study Center, New York University, New York, New York, USA
| | - Steven Espinosa
- Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina, USA
| | - Saritha Vermeer
- Duke Center for Autism and Brain Development, Department of Psychiatry and Behavioral Sciences, Duke University, Durham, North Carolina, USA
| | - Jeffrey Baker
- Department of Pediatrics, Duke University, Durham, NC, USA
| | - Guillermo Sapiro
- Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina, USA
- Departments of Biomedical Engineering, Computer Science, and Mathematics, Duke University, Durham, NC, USA
| |
Collapse
|
19
|
Fulceri F, Grossi E, Contaldo A, Narzisi A, Apicella F, Parrini I, Tancredi R, Calderoni S, Muratori F. Motor Skills as Moderators of Core Symptoms in Autism Spectrum Disorders: Preliminary Data From an Exploratory Analysis With Artificial Neural Networks. Front Psychol 2018; 9:2683. [PMID: 30687159 PMCID: PMC6333655 DOI: 10.3389/fpsyg.2018.02683] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2018] [Accepted: 12/13/2018] [Indexed: 02/05/2023] Open
Abstract
Motor disturbances have been widely observed in children with autism spectrum disorder (ASD), and motor problems are currently reported as associated features supporting the diagnosis of ASD in the current Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Studies on this issue reported disturbances in different motor domains, including both gross and fine motor areas as well as coordination, postural control, and standing balance. However, they failed to clearly state whether motor impairments are related to demographical and developmental features of ASD. Both the different methodological approaches assessing motor skills and the heterogeneity in clinical features of participants analyzed have been implicated as contributors to variance in findings. However, the non-linearity of the relationships between variables may account for the inability of the traditional analysis to grasp the core problem suggesting that the "single symptom approach analysis" should be overcome. Artificial neural networks (ANNs) are computational adaptive systems inspired by the functioning processes of the human brain particularly adapted to solving non-linear problems. This study aimed to apply the ANNs to reveal the entire spectrum of the relationship between motor skills and clinical variables. Thirty-two male children with ASD [mean age: 48.5 months (SD: 8.8); age range: 30-60 months] were recruited in a tertiary care university hospital. A multidisciplinary comprehensive diagnostic evaluation was associated with a standardized assessment battery for motor skills, the Peabody Developmental Motor Scale-Second Edition. Exploratory analyses were performed through the ANNs. The findings revealed that poor motor skills were a common clinical feature of preschoolers with ASD, relating both to the high level of repetitive behaviors and to the low level of expressive language. Moreover, unobvious trends among motor, cognitive and social skills have been detected. In conclusion, motor abnormalities in preschoolers with ASD were widespread, and the degree of impairment may inform clinicians about the severity of ASD core symptoms. Understanding motor disturbances in children with ASD may be relevant to clarify neurobiological basis and ultimately to guide the development of tailored treatments.
Collapse
Affiliation(s)
- Francesca Fulceri
- Research Coordination and Support Service, Istituto Superiore di Sanità, Rome, Italy
| | - Enzo Grossi
- Autism Research Unit, Villa Santa Maria Institute, Tavernerio, Italy
| | | | | | | | | | | | - Sara Calderoni
- IRCCS Fondazione Stella Maris, Pisa, Italy
- Department of Clinical and Experimental Medicine, University of Pisa, Pisa, Italy
- *Correspondence: Sara Calderoni, ;
| | - Filippo Muratori
- IRCCS Fondazione Stella Maris, Pisa, Italy
- Department of Clinical and Experimental Medicine, University of Pisa, Pisa, Italy
| |
Collapse
|