Development, feasibility and acceptability of a gamified cognitive DEvelopmental assessment on an E-Platform (DEEP) in rural Indian pre-schoolers - a pilot study

Cognitive control in infancy: Attentional predictors using a tablet-based measure

Cognitive control is a predictor of later-life outcomes and may underpin higher order executive processes. The present study examines the development of early cognitive control during the first 24-month. We evaluated a tablet-based assessment of cognitive control among infants aged 18- and 24-month. We also examined concurrent and longitudinal associations between attentional disengagement, general cognitive skills and cognitive control. Participants (N = 60, 30 female) completed the tablet-task at 18- and 24-month of age. Attentional disengagement and general cognitive development were assessed at 5-, 8-, 12-, 18- and 24-month using an eye-tracking measure and the Mullen Scales of Early Learning (MSEL), respectively. The cognitive control task demonstrated good internal consistency, sensitivity to age-related change in performance and stable individual differences. No associations were found between infant cognitive control and MSEL scores longitudinally or concurrently. The eye-tracking task revealed that slower attentional disengagement at 8-month, but faster disengagement at 18-month, predicted higher cognitive control scores at 24-month. This task may represent a useful tool for measuring emergent cognitive control. The multifaceted relationship between attention and infant cognitive control suggests that the rapid development of the attentional system in infancy results in distinct attentional skills, at different ages, being relevant for cognitive control development.

Scalable Transdiagnostic Early Assessment of Mental Health (STREAM): a study protocol

INTRODUCTION

Early childhood development forms the foundations for functioning later in life. Thus, accurate monitoring of developmental trajectories is critical. However, such monitoring often relies on time-intensive assessments which necessitate administration by skilled professionals. This difficulty is exacerbated in low-resource settings where such professionals are predominantly concentrated in urban and often private clinics, making them inaccessible to many. This geographic and economic inaccessibility contributes to a significant 'detection gap' where many children who might benefit from support remain undetected. The Scalable Transdiagnostic Early Assessment of Mental Health (STREAM) project aims to bridge this gap by developing an open-source, scalable, tablet-based platform administered by non-specialist workers to assess motor, social and cognitive developmental status. The goal is to deploy STREAM through public health initiatives, maximising opportunities for effective early interventions.

METHODS AND ANALYSIS

The STREAM project will enrol and assess 4000 children aged 0-6 years from Malawi (n=2000) and India (n=2000). It integrates three established developmental assessment tools measuring motor, social and cognitive functioning using gamified tasks, observation checklists, parent-report and audio-video recordings. Domain scores for motor, social and cognitive functioning will be developed and assessed for their validity and reliability. These domain scores will then be used to construct age-adjusted developmental reference curves.

ETHICS AND DISSEMINATION

Ethical approval has been obtained from local review boards at each site (India: Sangath Institutional Review Board; All India Institute of Medical Science (AIIMS) Ethics Committee; Indian Council of Medical Research-Health Ministry Screening Committee; Malawi: College of Medicine Research and Ethics Committee; Malawi Ministry of Health-Blantyre District Health Office). The study adheres to Good Clinical Practice standards and the ethical guidelines of the 6th (2008) Declaration of Helsinki. Findings from STREAM will be disseminated to participating families, healthcare professionals, policymakers, educators and researchers, at local, national and international levels through meetings, academic journals and conferences.

Executive functioning skills and their environmental predictors among pre-school aged children in South Africa and The Gambia

Executive functions (EFs) in early childhood are predictors of later developmental outcomes and school readiness. Much of the research on EFs and their psychosocial correlates has been conducted in high-income, minority world countries, which represent a small and biased portion of children globally. The aim of this study is to examine EFs among children aged 3-5 years in two African countries, South Africa (SA) and The Gambia (GM), and to explore shared and distinct predictors of EFs in these settings. The SA sample (N = 243, 51.9% female) was recruited from low-income communities within the Cape Town Metropolitan area. In GM, participants (N = 171, 49.7% female) were recruited from the rural West Kiang region. EFs, working memory (WM), inhibitory control (IC) and cognitive flexibility (CF), were measured using tablet-based tasks. Associations between EF task performance and indicators of socioeconomic status (household assets, caregiver education) and family enrichment factors (enrichment activities, diversity of caregivers) were assessed. Participants in SA scored higher on all EF tasks, but children in both sites predominantly scored within the expected range for their age. There were no associations between EFs and household or familial variables in SA, except for a trend-level association between caregiver education and CF. Patterns were similar in GM, where there was a trend-level association between WM and enrichment activities but no other relationships. We challenge the postulation that children in low-income settings have poorer EFs, simply due to lower socioeconomic status, but highlight the need to identify predictors of EFs in diverse, global settings. RESEARCH HIGHLIGHTS: Assessed Executive Functioning (EF) skills and their psychosocial predictors among pre-school aged children (aged 3-5 years) in two African settings (The Gambia and South Africa). On average, children within each setting performed within the expected range for their age, although children in South Africa had higher scores across tasks. There was little evidence of any association between socioeconomic variables and EFs in either site. Enrichment activities were marginally associated with better working memory in The Gambia, and caregiver education with cognitive flexibility in South Africa, both associations were trend-level significance.

The current landscape and future of tablet-based cognitive assessments for children in low-resourced settings

Interest in measuring cognition in children in low-resourced settings has increased in recent years, but options for cognitive assessments are limited. Researchers are faced with challenges when using existing assessments in these settings, such as trained workforce shortages, less relevant testing stimuli, limitations of proprietary assessments, and inadequate parental knowledge of cognitive milestones. Tablet-based direct child assessments are emerging as a practical solution to these challenges, but evidence of their validity and utility in cross-cultural settings is limited. In this overview, we introduce key concepts of this field while exploring the current landscape of tablet-based assessments for low-resourced settings. We also make recommendations for future directions of this relatively novel field. We conclude that tablet-based assessments are an emerging and promising method of assessing cognition in young children. Further awareness and dissemination of validated tablet-based assessments may increase capacity for child development research and clinical practice in low-resourced settings.

Evaluation of a tablet-based assessment tool for measuring cognition among children 4-6 years of age in Ghana

OBJECTIVES

To investigate several basic psychometric properties, including construct, convergent and discriminant validity, of the tablet-based Rapid Assessment of Cognitive and Emotional Regulation (RACER) among children aged 4-6 years in Ghana.

METHODS

We investigated whether RACER tasks administered to children in Ghana could successfully reproduce expected patterns of performance previously found in high-income countries on similar tasks assessing inhibitory control (e.g., slower responses on inhibition trials), declarative memory (e.g., higher accuracy on previously seen items), and procedural memory (e.g., faster responses on sequence blocks). Next, we assessed the validity of declarative memory and inhibitory control scores by examining associations of these scores with corresponding paper-based test scores and increasing child age. Lastly, we examined whether RACER was more sensitive than paper-based tests to environmental risk factors common in low- and middle-income countries (LMICs).

RESULTS

Of the 966 children enrolled, more than 96% completed the declarative memory and inhibitory control tasks; however, around 30% of children were excluded from data analysis on the procedural memory task due to missing more than half of trials. The performance of children in Ghana replicated previously documented patterns of performance. RACER inhibitory control accuracy score was significantly correlated with child age (r (929) = .09, p = .007). However, our findings did not support other hypotheses.

CONCLUSIONS

The high task completion rates and replication of expected patterns support that certain RACER sub-tasks are feasible for measuring child cognitive development in LMIC settings. However, this study did not provide evidence to support that RACER is a valid tool to capture meaningful individual differences among children aged 4-6 years in Ghana.

Associations between executive function and early math and literacy skills in preschool children

The current study directly compared the magnitude of associations between executive function (EF) and math versus literacy and investigated whether they differed by age within the preschool years. Participants were 92 typically developing, preschool children in the United States (M _age=58.53 months; 47.8% Female; 58.7% White; 29.3% Non-White). Children completed a developmentally sensitive battery of direct EF assessments, math and literacy achievement tests, and IQ tests. Results showed an EF Composite was associated with math, but not literacy, after controlling for age, verbal and nonverbal IQ, and socioeconomic status. Extending prior work to a younger age, we examined whether the association between EF and academic achievement was moderated by age but found no significant interactions. These findings support the link between EF and math before kindergarten and indicate a similar magnitude of associations in younger and older preschoolers.

The effect of cumulative early life adversities, and their differential mediation through hair cortisol levels, on childhood growth and cognition: Three-year follow-up of a birth cohort in rural India

Background: Early adversities negatively impact children's growth and development, putatively mediated by chronic physiological stress resulting from these adverse experiences. We aimed to estimate the associations between prospectively measured cumulative early adversities with growth and cognition outcomes in rural Indian preschool children and to explore if hair cortisol concentration (HCC), a measure of chronic physiological stress, mediated the above association. Methods: Participants were recruited from the SPRING cRCT in rural Haryana, India. Adversities experienced through pregnancy and the first year of life were measured in 1304 children at 12-months. HCC was measured at 12-months in 845 of them. Outcome measures were height-for-age-z-score (HAZ), weight-for-age-z-score (WAZ) and cognition, measured in 1124 children followed up at 3-years. Cognition was measured using a validated tablet-based gamified tool named DEEP. Results: Cumulative adversities at 12-months were inversely associated with all outcomes measures at 3-years. Each unit increase in adversity score led to a decrease of 0·08 units [95% confidence interval (CI):-0·11,-0·06] in DEEP-z-score; 0·12 units [-0·14,-0·09] in HAZ and 0·11 units [-0·13,-0·09] in WAZ. 12-month HCC was inversely associated with DEEP-z-score (-0·09 [-0·16,-0·01]) and HAZ (-0·12 [-0·20,-0·04]), but the association with WAZ was not significant (p = 0·142). HCC marginally mediated the association between cumulative adversities and HAZ (proportion mediated = 0·06, p = 0·014). No evidence of mediation was found for the cognition outcome. Conclusions: Cumulative early adversities and HCC measured at 12-months have persistent negative effects on child growth and cognition at 3-years. The association between adversities and these two child outcomes were differentially mediated by HCC, with no evidence of mediation observed for the cognitive outcome. Future studies should focus on other stress biomarkers, and alternate pathways such as the immune, inflammation and cellular ageing pathways, to unpack key mechanisms underlying the established relationship between early adversities and poor child outcomes.

The effect of cumulative early life adversities, and their differential mediation through hair cortisol levels, on childhood growth and cognition: Three-year follow-up of a birth cohort in rural India

Background: Early adversities negatively impact children’s growth and development, putatively mediated by chronic physiological stress resulting from these adverse experiences. We aimed to estimate the associations between prospectively measured cumulative early adversities with growth and cognition outcomes in rural Indian preschool children and to explore if hair cortisol concentration (HCC), a measure of chronic physiological stress, mediated the above association. Methods: Participants were recruited from the SPRING cRCT in rural Haryana, India. Adversities experienced through pregnancy and the first year of life were measured in 1304 children at 12-months. HCC was measured at 12-months in 845 of them. Outcome measures were height-for-age-z-score (HAZ), weight-for-age-z-score (WAZ) and cognition, measured in 1124 children followed up at 3-years. Cognition was measured using a validated tablet-based gamified tool named DEEP. Results: Cumulative adversities at 12-months were inversely associated with all outcomes measures at 3-years. Each unit increase in adversity score led to a decrease of 0·08 units [95% confidence interval (CI):-0·11,-0·06] in DEEP-z-score; 0·12 units [-0·14,-0·09] in HAZ and 0·11 units [-0·13,-0·09] in WAZ. 12-month HCC was inversely associated with DEEP-z-score (-0·09 [-0·16,-0·01]) and HAZ (-0·12 [-0·20,-0·04]), but the association with WAZ was not significant (p = 0·142). HCC marginally mediated the association between cumulative adversities and HAZ (proportion mediated = 0·06, p = 0·014). No evidence of mediation was found for the cognition outcome. Conclusions: Cumulative early adversities and HCC measured at 12-months have persistent negative effects on child growth and cognition at 3-years. The association between adversities and these two child outcomes were differentially mediated by HCC, with no evidence of mediation observed for the cognitive outcome. Future studies should focus on other stress biomarkers, and alternate pathways such as the immune, inflammation and cellular ageing pathways, to unpack key mechanisms underlying the established relationship between early adversities and poor child outcomes.

The Acceptability, Feasibility, and Utility of Portable Electroencephalography to Study Resting-State Neurophysiology in Rural Communities

Electroencephalography (EEG) provides a non-invasive means to advancing our understanding of the development and function of the brain. However, the majority of the world’s population residing in low and middle income countries has historically been limited from contributing to, and thereby benefiting from, such neurophysiological research, due to lack of scalable validated methods of EEG data collection. In this study, we establish a standard operating protocol to collect approximately 3 min each of eyes-open and eyes-closed resting-state EEG data using a low-cost portable EEG device in rural households through formative work in the community. We then evaluate the acceptability of these EEG assessments to young children and feasibility of administering them through non-specialist workers. Finally, we describe properties of the EEG recordings obtained using this novel approach to EEG data collection. The formative phase was conducted with 9 families which informed protocols for consenting, child engagement strategies and data collection. The protocol was then implemented on 1265 families. 977 children (Mean age = 38.8 months, SD = 0.9) and 1199 adults (Mean age = 27.0 years, SD = 4) provided resting-state data for this study. 259 children refused to wear the EEG cap or removed it, and 58 children refused the eyes-closed recording session. Hardware or software issues were experienced during 30 and 25 recordings in eyes-open and eyes-closed conditions respectively. Disturbances during the recording sessions were rare and included participants moving their heads, touching the EEG headset with their hands, opening their eyes within the eyes-closed recording session, and presence of loud sounds in the testing environment. Similar to findings in laboratory-based studies from high-income settings, the percentage of recordings which showed an alpha peak was higher in eyes-closed than eyes-open condition, with the peak occurring most frequently in electrodes at O1 and O2 positions, and the mean frequency of the alpha peak was found to be lower in children (8.43 Hz, SD = 1.73) as compared to adults (10.71 Hz, SD = 3.96). We observed a deterioration in the EEG signal with prolonged device usage. This study demonstrates the acceptability, feasibility and utility of conducting EEG research at scale in a rural low-resource community, while highlighting its potential limitations, and offers the impetus needed to further refine the methods and devices and validate such scalable methods to overcome existing research inequity.

Collecting big data with small screens: Group tests of children's cognition with touchscreen tablets are reliable and valid

Collecting experimental cognitive data with young children usually requires undertaking one-on-one assessments, which can be both expensive and time-consuming. In addition, there is increasing acknowledgement of the importance of collecting larger samples for improving statistical power Button et al. (Nature Reviews Neuroscience 14(5), 365-376, 2013), and reproducing exploratory findings Open Science Collaboration (Science, 349(6251), aac4716-aac4716 2015). One way both of these goals can be achieved more easily, even with a small team of researchers, is to utilize group testing. In this paper, we evaluate the results from a novel tablet application developed for the Resilience in Education and Development (RED) Study. The RED-app includes 12 cognitive tasks designed for groups of children aged 7 to 13 to independently complete during a 1-h school lesson. The quality of the data collected was high despite the lack of one-on-one engagement with participants. Most outcomes from the tablet showed moderate or high reliability, estimated using internal consistency metrics. Tablet-measured cognitive abilities also explained more than 50% of variance in teacher-rated academic achievement. Overall, the results suggest that tablet-based, group cognitive assessments of children are an efficient, reliable, and valid method of collecting the large datasets that modern psychology requires. We have open-sourced the scripts and materials used to make the application, so that they can be adapted and used by others.

The role of RDoC in future classification of mental disorders

The Research Domain Criteria (RDoC) project constitutes a translational framework for psychopathology research, initiated by the National Institute of Mental Health in an attempt to provide new avenues for research to circumvent problems emerging from the use of symptom-based diagnostic categories in diagnosing disorders. The RDoC alternative is a focus on psychopathology based on dimensions simultaneously defined by observable behavior (including quantitative measures of cognitive or affective behavior) and neurobiological measures. Key features of the RDoC framework include an emphasis on functional dimensions that range from normal to abnormal, integration of multiple measures in study designs (which can foster computational approaches), and high priority on studies of neurodevelopment and environmental influences (and their interaction) that can contribute to advances in understanding the etiology of disorders throughout the lifespan. The paper highlights key implications for ways in which RDoC can contribute to future ideas about classification, as well as some of the considerations involved in translating basic behavioral and neuroscience data to psychopathology.


The association of a novel digital tool for assessment of early childhood cognitive development, 'DEvelopmental assessment on an E-Platform (DEEP)', with growth in rural India: A proof of concept study

BACKGROUND

There is an urgent need to fill the gap of scalable cognitive assessment tools for preschool children to enable identification of children at-risk of sub-optimal development and to support their timely referral into interventions. We present the associations between growth in early childhood, a well-established marker of cognitive development, and scores on a novel digital cognitive assessment tool called DEvelopmental Assessment on an E-Platform (DEEP) on a sample of 3-year old pre-schoolers from a rural region in north India.

METHODS

Between February 2018 and March 2019, 1359 children from the Sustainable Programme Incorporating Nutrition and Games (SPRING) programme were followed up at 3-years age and data on DEEP, anthropometry and a clinical developmental assessment, the Bayley's Scale of Infant and Toddler Development, 3rd edition (BSID-III) was collected. DEEP data from 200 children was used to train a machine learning algorithm to predict their score on the cognitive domain of BSID-III. The DEEP score of the remaining 1159 children was then predicted using this algorithm to examine the cross-sectional and prospective association of growth with the DEEP score.

FINDINGS

The magnitude of the concurrent positive association between height-for-age and cognitive z-scores in 3-year olds was similar when cognition was measured by BSID-III (0.20 standard deviations increase for every unit change in specifically age-adjusted height (HAZ), 95% CI = 0.06-0.35) and DEEP (0.26 CI, 0.11-0.41). A similar positive prospective relationship was found between growth at 18 (0.21 CI, 0.17-0.26) and 12-months (0.18 CI, 0.13-0.23) and DEEP score measured at 3-years. Additionally, the relationship between growth and cognitive development was found to be dependant on socioeconomic status (SES).

INTERPRETATION

In this study, we suggest the utility of DEEP, a scalable, digital cognitive assessment tool, to measure cognition in preschool children. Further validation in different and larger datasets is necessary to confirm our findings.

FUNDING

The SPRING Programme was funded through a Wellcome Trust programme grant and the follow-up study by the Corporate Social Responsibility initiative grant from Madura Microfinance Ltd.

Promoting Developmental Potential in Early Childhood: A Global Framework for Health and Education

In the early years of life, children’s interactions with the physical and social environment- including families, schools and communities—play a defining role in developmental trajectories with long-term implications for their health, well-being and earning potential as they become adults. Importantly, failing to reach their developmental potential contributes to global cycles of poverty, inequality, and social exclusion. Guided by a rights-based approach, this narrative review synthesizes selected studies and global initiatives promoting early child development and proposes a universal intervention framework of child-environment interactions to optimize children’s developmental functioning and trajectories.

Proof of Concept of a Gamified DEvelopmental Assessment on an E-Platform (DEEP) Tool to Measure Cognitive Development in Rural Indian Preschool Children

Over 250 million children in developing countries are at risk of not achieving their developmental potential, and unlikely to receive timely interventions because existing developmental assessments that help identify children who are faltering are prohibitive for use in low resource contexts. To bridge this “detection gap,” we developed a tablet-based, gamified cognitive assessment tool named DEvelopmental assessment on an E-Platform (DEEP), which is feasible for delivery by non-specialists in rural Indian households and acceptable to all end-users. Here we provide proof-of-concept of using a supervised machine learning (ML) approach benchmarked to the Bayley’s Scale of Infant and Toddler Development, 3rd Edition (BSID-III) cognitive scale, to predict a child’s cognitive development using metrics derived from gameplay on DEEP. Two-hundred children aged 34–40 months recruited from rural Haryana, India were concurrently assessed using DEEP and BSID-III. Seventy percent of the sample was used for training the ML algorithms using a 10-fold cross validation approach and ensemble modeling, while 30% was assigned to the “test” dataset to evaluate the algorithm’s accuracy on novel data. Of the 522 features that computationally described children’s performance on DEEP, 31 features which together represented all nine games of DEEP were selected in the final model. The predicted DEEP scores were in good agreement (ICC [2,1] > 0.6) and positively correlated (Pearson’s r = 0.67) with BSID-cognitive scores, and model performance metrics were highly comparable between the training and test datasets. Importantly, the mean absolute prediction error was less than three points (<10% error) on a possible range of 31 points on the BSID-cognitive scale in both the training and test datasets. Leveraging the power of ML which allows iterative improvements as more diverse data become available for training, DEEP, pending further validation, holds promise to serve as an acceptable and feasible cognitive assessment tool to bridge the detection gap and support optimum child development.

Validation of a mobile game-based assessment of cognitive control among children and adolescents

Cognitive control is the most fundamental psychological function that underlies the execution of many other psychological functions. A mobile game application could be a useful strategy to evaluate cognitive control in the groups of children and adolescents. Although a serious game that is based on gamification would be an optimal platform for the administration of behavioral and clinical assessments of children and adolescents, most studies on gamification have been conducted among adults and older adults than among children and adolescents. This study aimed to assess cognitive control using a mobile game that used gamification and compared the results to those from traditional neuropsychological tests for children and adolescents. In order to address this objective, this study used a serious game, namely, “CoCon,” which was developed to assess cognitive control in children and adolescents. This study included 100 participants from a community sample (mean age = 11.75 years, ranged from 9 to 16 years, SD = 1.40 years; Male = 59(59%), Female = 41(41%)). The analyses interrogated the relationships among various game behaviors scores of CoCon, the standardized neuropsychological tests (K-WISC-IV, CTT, and Stroop), and self-reporting executive function difficulty questionnaire. As results, a mobile game application-based assessment proved to be a reliable and valid measure of the cognitive control in children and adolescents. The index scores from the CoCon were significantly related to various cognitive control functions and differentiated between the high and low cognitive control groups. Specifically, even though the participants completed the mobile game ‘CoCon’ in their natural habitats, the CoCon scores were comparable to the measures from standard neuropsychological tests. In conclusion, the present findings suggest that mobile games that use advanced technology and sophisticated psychological strategies can serve as a new and expanded platform for the administration of psychological assessments.