The Acceptability and Effectiveness of Web-Based Developmental Surveillance Programs: Rapid Review

Cognitive pediatric tele-assessment: a scoping review

Cognitive tele-assessment (CTA) adoption has increased considerably recently, in parallel with the maturation of the digital technologies that enable it, and the push to move assessment to the online format during the COVID-19 pandemic in 2019. This mode of assessment stems from remote assessment applications that originated in general tele-medicine, where it was typically used for patient screening as part of an intervention. The development of remote tele-medicine was later adapted for CTA in adult populations in tele-neuropsychiatry and tele-psychology and is increasingly applied in experimental research in cognitive science research with adult and pediatric populations, and for remote academic assessment. Compared to in-person assessment, CTA offers advantages such as decreasing time and logistic costs and facilitating the assessment of remote or special needs populations. However, given the novelty of CTA, its technical, methodological, and ethical issues remain poorly understood, especially in cases where methods for assessment of adults are used in pediatric populations. In the current paper, we provide a scoping review on the evolution of remote tele-assessment from the years 2000 to 2021, to identify its main themes, methodologies, and applications, and then focus on the issues of assessment in pediatric populations. Finally, we present recommendations on how to address the challenges previously mentioned.

A realist review of digitally delivered child development assessment and screening tools: Psychometrics and considerations for future use

BACKGROUND

Developmental screening improves the detection of developmental concerns, yet numerous children are not screened/assessed. Remote child developmental tool administration has been utilized to increase screening and assessment accessibility.

METHOD

We conducted a realist review to: (1) identify existing multi-domain child development assessment and screening tools for children 0-5 years; (2) review psychometric data on their digital (i.e., only administered remotely) administration; and (3) explore contextual factors relevant to their digital administration. We searched APA PsycInfo, MEDLINE, CINAHL, and ERIC to identify tools and papers on their psychometrics. We reference-searched included articles and searched Google for relevant grey literature.

RESULTS

Of 33 multi-domain child development tools identified in objective one, five tools (in five studies) were delivered digitally and compared to traditional (e.g., paper) delivery (i.e., objective two). Studies evaluated within-group equivalence reliability (k = 2) and between-group equivalence (k = 3). Within-group equivalence reliability was established for the Vineland Adaptive Behavior Scales, and domains (e.g., gross motor) of the Ages and Stages Questionnaires 2nd edition (ASQ-2) and Revised Prescreening Denver Questionnaire (R-PDQ). Between group equivalence was demonstrated for Developmental Neuropsychological Assessment, 2nd Edition (NEPSY-II) subtests and Bayley Scales of Infant and Toddler Development, 3rd edition (Bayley-3) items. In another between group evaluation, web-based and paper versions of the ASQ-2 were deemed generally equivalent. Digital Bayley-3 inter-observer reliability ranged from 0.82 to 1.0. Examiner support, time, tool modifications, family resources, and comfort promotion supported digital administration.

CONCLUSION

Digitally delivered ASQ-2, R-PDQ, Vineland, and Bayley-3 and NEPSY-II components show promise for equivalence with traditional administration.

Routine developmental screening in Australian general practice: a pilot study

BACKGROUND

Parents' Evaluation of Developmental Status, (PEDS), is a validated screening tool designed for primary health care clinicians to assess child development. Despite widespread use by local government child-nurse services, PEDS has not been tested in Australian general practice. We examined the effect of an intervention that aimed to use PEDS to improve documented assessment of child developmental status during routine general practice consultations.

METHODS

The study took place in a single general practice in Melbourne, Australia. The intervention included training of all general practice staff regarding PEDS processes and provision of PEDS questionnaires, scoring and interpretation forms. Mixed methods incorporated audits of clinical records of young children (1 to ≤ 5 years) before and after the intervention, and written questionnaires and a focus group (informed by the Theoretical Domains Framework and COM-B model) with receptionists, practice nurses and general practitioners.

RESULTS

Documented developmental status more than doubled after the intervention with almost one in three (30.4%) records documenting the PEDS tool. Overall, staff responses to questionnaires indicated that PEDS processes had been successfully implemented, half of the staff felt PEDS had developed their professional skills and clinicians expressed confidence using the tool (71%). Thematic analysis of the focus group transcript revealed divided reactions to PEDS screening with most barriers arising from general practitioners' motivation to use PEDS tools and perceptions of environmental constraints.

CONCLUSIONS

A team-practice intervention that applied PEDS training and implementation, more than doubled documented rates of child developmental status during routine visits. Solutions to underlying barriers could be incorporated into a revised training module. Future studies need to test the tool in more methodologically robust studies that include analysis of the outcomes of developmental surveillance and long-term sustainability of PEDS use in practices.

Early childhood tracking application: Correspondence between crowd-based developmental percentiles and clinical tools

Barriers to child developmental screening lead to delayed diagnosis and intervention. babyTRACKS, a mobile application for tracking developmental milestones, presents parents their child's percentiles computed relative to crowd-based data. This study evaluated correspondence between crowd-based percentiles and traditional development measures. Research analyzed babyTRACKS diaries of 1951 children. Parents recorded attainment age for milestones across Gross Motor, Fine Motor, Language, Cognitive, and Social domains. Fifty-seven parents completed the Ages and Stages Questionnaire (ASQ-3), and 13 families participated in the Mullen Scales of Early Learning (MSEL) expert assessment. Crowd-based percentiles were compared with: Centers for Disease Control (CDC) norms for comparable milestones, ASQ-3 and MSEL scores. babyTRACKS percentiles correlated with the percentage of unmet CDC milestones, and with higher ASQ-3 and MSEL scores across several domains. Children who did not meet CDC age thresholds had lower babyTRACKS percentiles by about 20 points and those at ASQ-3 risk had lower babyTRACKS Fine Motor and Language scores. Repeated measures tests showed significantly higher MSEL versus babyTRACKS percentiles in the Language domain. Although ages and milestones in diary varied, the app percentiles corresponded with traditional measures, particularly in fine motor and language domains. Future research is needed for determining referral thresholds while minimizing false alarms.

Parental experience of an early developmental surveillance programme for autism within Australian general practice: a qualitative study

OBJECTIVES

Implementing support and services early in the life course has been shown to promote positive developmental outcomes for children at high likelihood of developmental conditions including autism. This study examined parents'/caregivers' experiences and perceptions about a digital developmental surveillance pathway for autism, the autism surveillance pathway (ASP), and usual care, the surveillance as usual (SaU) pathway, in the primary healthcare general practice setting.

DESIGN

This qualitative study involves using a convenience selection process of the full sample of parents/caregivers that participated in the main programme, 'General Practice Surveillance for Autism', a cluster-randomised controlled trial study. All interviews were audio-recorded, transcribed and coded using NVivo V.12 software. An inductive thematic interpretive approach was adopted and data were analysed thematically.

PARTICIPANTS

Twelve parents/caregivers of children with or without a developmental condition/autism (who participated in the main programme) in South Western Sydney and Melbourne were interviewed.

SETTINGS

All interviews were completed over the phone.

RESULTS

There were seven major themes and 20 subthemes that included positive experiences, such as pre-existing patient-doctor relationships and their perceptions on the importance of knowing and accessing early support/services. Barriers or challenges experienced while using the SaU pathway included long waiting periods, poor communication and lack of action plans, complexity associated with navigating the healthcare system and lack of understanding by general practitioners (GPs). Common suggestions for improvement included greater awareness/education for parents/carers and the availability of accessible resources on child development for parents/caregivers.

CONCLUSION

The findings support the use of digital screening tools for developmental surveillance, including for autism, using opportunistic contacts in the general practice setting.

TRIAL REGISTRATION NUMBER

ANZCTR (ACTRN12619001200178).

Improvements for Therapeutic Intervention from the Use of Web Applications and Machine Learning Techniques in Different Affectations in Children Aged 0–6 Years

Technological advances together with machine learning techniques give health science disciplines tools that can improve the accuracy of evaluation and diagnosis. The objectives of this study were: (1) to design a web application based on cloud technology (eEarlyCare-T) for creating personalized therapeutic intervention programs for children aged 0–6 years old; (2) to carry out a pilot study to test the usability of the eEarlyCare-T application in therapeutic intervention programs. We performed a pilot study with 23 children aged between 3 and 6 years old who presented a variety of developmental problems. In the data analysis, we used machine learning techniques of supervised learning (prediction) and unsupervised learning (clustering). Three clusters were found in terms of functional development in the 11 areas of development. Based on these groupings, various personalized therapeutic intervention plans were designed. The variable with most predictive value for functional development was the users’ developmental age (predicted 75% of the development in the various areas). The use of web applications together with machine learning techniques facilitates the analysis of functional development in young children and the proposal of personalized intervention programs.

The feasibility of a crowd-based early developmental milestone tracking application

Objective

Parents’ tracking of developmental milestones can assist healthcare providers with early detection of developmental delays and appropriate referrals to early intervention. Crowdsourcing is one way to update the content and age data distribution of developmental checklists for parents and providers. This feasibility study examined which developmental milestones parents chose to track and what they added beyond traditional milestones, using the babyTRACKS crowd-based mobile app.

Method

We analyzed the developmental diaries of 3,832 children, registered in the babyTRACKS app at an average age of 9.3 months. Their parents recorded a median of 5 milestones per diary, selecting from the accumulating lists of age-appropriate milestones or authoring new milestones. The final database included 645 types of milestones; 89.15% were developmental, of which 43.6% were comparable to the Centers for Disease Control (CDC) milestones while the rest were crowd-authored. Milestones were categorized into developmental domains: Gross Motor, Fine Motor, Oral Motor, Self-Care, Cognitive, Language Comprehension, Speech, Non-Verbal Communication, Social, Emotional, and Regulation.

Results

On average, the milestone domains of Gross Motor, Fine Motor, Cognitive and Social were the most added to diaries (20%-30% of a diary). Within the Cognitive, Speech and Language Comprehension domains there were significantly more CDC comparable versus crowd-authored milestones (29% versus 21%, 22% versus 10%, 8% versus 4%). In contrast, within the Regulation and Oral Motor domains there were more crowd versus CDC milestones (17% versus 3%, 9% versus 3%). Crowd-authored Speech milestones were significantly older by 7 months than CDC milestones.

Conclusion

Tracking daily observations of child development provides a window into personally relevant milestones for the child and parent. The crowd of parents can independently track and add new milestones across main developmental domains. Regulation and Oral Motor development especially interest parents. Parents may be less aware of early progress in Language Comprehension and Speech; thus, these domains require more structured screening. Designing mobile early screening which is crowd-based engages parents as proactive partners in developmental tracking.