Psychometric Properties of Child (0-5 Years) Outcome Measures as used in Randomized Controlled Trials of Parent Programs: A Systematic Review

Parents' Evaluation of Developmental Status and Strength and Difficulties Questionnaire as Screening Measures for Children in India: A Scoping Review

Due to the limited availability of suitable measures, screening children for developmental delays and social-emotional learning has long been a challenge in India. This scoping review examined the use of the Parents' Evaluation of Developmental Status (PEDS), PEDS: Developmental Milestones (PEDS:DM), and the Strength and Difficulties Questionnaire (SDQ) with children (<13 years old) in India. The scoping review was conducted following the Joanna Briggs Institute Protocol to identify primary research studies that examined the use of the PEDS, PEDS:DM, and SDQ in India between 1990 and 2020. A total of seven studies for the PEDS and eight studies for the SDQ were identified for inclusion in the review. There were no studies using the PEDS:DM. Two empirical studies used the PEDS, while seven empirical studies used the SDQ. This review represents the first step in understanding the use of screening tools with children in India.

Social-Emotional Development of Children in Asia: A Systematic Review

There has been growing interest in the social-emotional development of children. However, the social-emotional development of children in Asia remains a knowledge gap. This systematic review identifies and summarizes existing studies on children's social-emotional development in Asia. We conducted a systematic review using the Guidelines for Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA). We reviewed 45 studies that met the inclusion criteria, and they were from 12 Asian countries, primarily the East Asia region (China and Hong Kong). Most of the studies were cross-sectional in design (n = 28, 62.2%). Six themes emerged, including (a) social-emotional development (overall) (n = 24, 53.3%); (b) social competence (n = 7, 15.6%); (c) emotional development (n = 5, 11.1%); (d) social-emotional learning (n = 3, 6.7%); (e) problem behavior (n = 3, 6.7%); (f) self-regulation (n = 2, 4.4%); and (g) both social-emotional learning and problem behavior (n = 1, 2.2%). The findings highlighted the paucity of studies, the need for examining more diverse variables in a similar population, and the low quality of intervention studies in social-emotional research in Asia. Research gaps indicate the need for more social-emotional and ethnocultural studies in other Asian regions. Parent and teacher knowledge of children's social-emotional functioning should be examined more closely in future research.

Psychometric properties of the Social Behavior Questionnaire (SBQ) in a longitudinal population-based sample

We assessed the psychometric properties of the Social Behavior Questionnaire (SBQ), a 30-item questionnaire evaluating social (e.g., disruptive behaviors, bullying) and emotional problems (e.g., anxiety, depression) among children aged 3.5–12 years. Children ( n = 1,950, 50.21% boys) were drawn from the Quebec Longitudinal Study of Child Development. Mothers reported the frequency with which children presented social and emotional behaviors from 3.5 to 8 years of age, and teachers from 6 to 12 years. We assessed internal structure using Confirmatory Factor Analysis, reliability using Cronbach’s alpha, and convergent and discriminant validity using a multitrait-multimethod (MTMM) approach. The six-factor (emotional distress, withdrawal, impulsive/hyperactive/inattentive, disruptive behaviors, prosocial behaviors, and peer relationships difficulties) structure of the SBQ showed good fit from ages 3.5 to 12 years. Reliability estimates were good to excellent (alphas > .7), and MTMM showed good convergent and discriminant validity. Overall, the SBQ presented good psychometric properties with a large population-based sample aged 3.5–12 years. Further studies should assess its screening potential by investigating its convergent validity with diagnostic information.

A proportionate, universal parenting programme to enhance social-emotional well-being in infants and toddlers in England: the E-SEE Steps RCT

Background

Mental disorders have become a public health crisis. Early prevention is key. Parenting programmes are effective for children aged ≥ 3 years; however, there is a lack of evidence of their effectiveness for children aged ≤ 2 years.

Objectives

To establish if the model named Enhancing Social–Emotional Health and Well-being in the Early Years (E-SEE) Steps can (1) enhance child social emotional well-being and establish whether or not it is cost-effective at 20 months of age when compared with services as usual; and (2) be delivered as a proportionate universal model with fidelity.

Design

A pragmatic two-arm randomised controlled trial and economic appraisal, with an embedded process evaluation to examine the outcomes, implementation and cost-effectiveness of the intervention, and intervention uptake, compared with services as usual. The study had an external pilot phase (which was originally planned as an internal pilot).

Setting

The intervention was delivered in community settings by early years children’s services and/or public health staff in four sites.

Participants

A total of 341 parents of infants aged ≤ 8 weeks were randomised in a ratio of 5 : 1 (intervention, n = 285; control, n = 56). The target sample was 606 parents.

Intervention

Two Incredible Years® parenting programmes (i.e. infant and toddler) delivered in a proportionate universal model with three levels [one universal (book) and two targeted group-based parenting programmes].

Main outcome measures

Child social and emotional well-being (primary outcome) was assessed using the Ages and Stages Questionnaire: Social and Emotional, 2nd edition, at 2, 9 and 18 months after randomisation. Parent depression (secondary key outcome) was assessed using the Patient Health Questionnaire-9 items. Both questionnaires were eligibility screeners for targeted groups.

Results

The primary outcome analysis provided no evidence that the E-SEE Steps model was effective in enhancing child social and emotional well-being. The adjusted mean difference was 3.02 on the original Ages and Stages Questionnaire: Social and Emotional, 2nd edition, in favour of the control [95% confidence interval –0.03 to 6.08; p = 0.052; N = 321 (intervention, n = 268; control, n = 53)]. Analysis of the key secondary outcome (i.e. parent depression levels as assessed by the Patient Health Questionnaire-9 items) provided weak evidence on the Patient Health Questionnaire-9 items in favour of the intervention (adjusted mean difference –0.61, 95% confidence interval –1.34 to 0.12; p = 0.1). Other secondary outcomes did not differ between arms. The economic analysis showed that the E-SEE Steps model was associated with higher costs and was marginally more effective (0.031 quality-adjusted life-years gained from E-SEE Steps compared with SAU, 95% confidence interval –0.008 to 0.071) than services as usual, resulting in an incremental cost-effectiveness ratio of approximately £20,062 per quality-adjusted life-year compared with services as usual. Overall take-up of the targeted parenting programmes was low. Sites, although enthusiastic, identified barriers to delivering the intervention.

Limitations

The target sample size was not met and the study was not powered to explore the effectiveness of each level of intervention. Most parents in the sample were well educated and, therefore, the results are unlikely to be generalisable, particularly to those at greatest risk of poor social and emotional well-being.

Conclusions

The E-SEE Steps proportionate universal model did not enhance child social and emotional well-being, but generated non-significant improvements in parent health outcomes, resulting in considerable uncertainty around the cost-effectiveness of the intervention. The primary and key secondary outcome gave inconsistent signals. Although, with system changes, increased resources and adaptations to the intervention, the model could be implemented, evidence for positive outcomes from the E-SEE Steps model is poor.

Future work

The universal-level E-SEE Step data (i.e. the Incredible Years book) from the external pilot will be pooled with the main trial data for further exploration up to follow-up 1, which is the time point at which most change was seen.

Trial registration

This trial is registered as ISRCTN11079129.

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Public Health Research programme and will be published in full in Public Health Research; Vol. 10, No. 8. See the NIHR Journals Library website for further project information.

A randomized controlled trial of a proportionate universal parenting program delivery model (E-SEE Steps) to enhance child social-emotional wellbeing

Background

Evidence for parenting programs to improve wellbeing in children under three is inconclusive. We investigated the fidelity, impact, and cost-effectiveness of two parenting programs delivered within a longitudinal proportionate delivery model (‘E-SEE Steps’).

Methods

Eligible parents with a child ≤ 8 weeks were recruited into a parallel two-arm, assessor blinded, randomized controlled, community-based, trial with embedded economic and process evaluations. Post-baseline randomization applied a 5:1 (intervention-to-control) ratio, stratified by primary (child social-emotional wellbeing (ASQ:SE-2)) and key secondary (maternal depression (PHQ-9)) outcome scores, sex, and site. All intervention parents received the Incredible Years^® Baby Book (IY-B), and were offered the targeted Infant (IY-I)/Toddler (IY-T) program if eligible, based on ASQ:SE-2/PHQ-9 scores. Control families received usual services. Fidelity data were analysed descriptively. Primary analysis applied intention to treat. Effectiveness analysis fitted a marginal model to outcome scores. Cost-effectiveness analysis involved Incremental Cost-Effectiveness Ratios (ICERs).

Results

The target sample (N = 606) was not achieved; 341 mothers were randomized (285:56), 322 (94%) were retained to study end. Of those eligible for the IY-I (n = 101), and IY-T (n = 101) programs, 51 and 21 respectively, attended. Eight (of 14) groups met the 80% self-reported fidelity criteria. No significant differences between arms were found for adjusted mean difference scores; ASQ:SE-2 (3.02, 95% CI: -0.03, 6.08, p = 0.052), PHQ-9 (-0.61; 95% CI: -1.34, 0.12, p = 0.1). E-SEE Steps had higher costs, but improved mothers’ Health-related Quality of Life (0.031 Quality Adjusted Life Year (QALY) gain), ICER of £20,062 per QALY compared to control. Serious adverse events (n = 86) were unrelated to the intervention.

Conclusions

E-SEE Steps was not effective, but was borderline cost-effective. The model was delivered with varying fidelity, with lower-than-expected IY-T uptake. Changes to delivery systems and the individual programs may be needed prior to future evaluation.

Trial registration

International Standard Randomized Controlled Trial Number: ISRCTN11079129.

The Measurement Properties and Acceptability of a New Parent–Infant Bonding Tool (‘Me and My Baby’) for Use in United Kingdom Universal Healthcare Settings: A Psychometric, Cross-Sectional Study

Introduction

The National Institute for Health and Care Excellence (NICE) guidelines acknowledge the importance of the parent–infant relationship for child development but highlight the need for further research to establish reliable tools for assessment, particularly for parents of children under 1 year. This study explores the acceptability and psychometric properties of a co-developed tool, ‘Me and My Baby’ (MaMB).

Study design

A cross-sectional design was applied. The MaMB was administered universally (in two sites) with mothers during routine 6–8-week Health Visitor contacts. The sample comprised 467 mothers (434 MaMB completers and 33 ‘non-completers’). Dimensionality of instrument responses were evaluated via exploratory and confirmatory ordinal factor analyses. Item response modeling was conducted via a Rasch calibration to evaluate how the tool conformed to principles of ‘fundamental measurement’. Tool acceptability was evaluated via completion rates and comparing ‘completers’ and ‘non-completers’ demographic differences on age, parity, ethnicity, and English as an additional language. Free-text comments were summarized. Data sharing agreements and data management were compliant with the General Data Protection Regulation, and University of York data management policies.

Results

High completion rates suggested the MaMB was acceptable. Psychometric analyses showed the response data to be an excellent fit to a unidimensional confirmatory factor analytic model. All items loaded statistically significantly and substantially (>0.4) on a single underlying factor (latent variable). The item response modeling showed that most MaMB items fitted the Rasch model. (Rasch) item reliability was high (0.94) yet the test yielded little information on each respondent, as highlighted by the relatively low ‘person separation index’ of 0.1.

Conclusion and next steps

MaMB reliably measures a single construct, likely to be infant bonding. However, further validation work is needed, preferably with ‘enriched population samples’ to include higher-need/risk families. The MaMB tool may benefit from reduced response categories (from four to three) and some modest item wording amendments. Following further validation and reliability appraisal the MaMB may ultimately be used with fathers/other primary caregivers and be potentially useful in research, universal health settings as part of a referral pathway, and clinical practice, to identify dyads in need of additional support/interventions.

Parent mental health and family functioning following diagnosis of CHD: a research agenda and recommendations from the Cardiac Neurodevelopmental Outcome Collaborative

Diagnosis of CHD substantially affects parent mental health and family functioning, thereby influencing child neurodevelopmental and psychosocial outcomes. Recognition of the need to proactively support parent mental health and family functioning following cardiac diagnosis to promote psychosocial adaptation has increased substantially over recent years. However, significant gaps in knowledge remain and families continue to report critical unmet psychosocial needs. The Parent Mental Health and Family Functioning Working Group of the Cardiac Neurodevelopmental Outcome Collaborative was formed in 2018 through support from an R13 grant from the National Heart, Lung, and Blood Institute to identify significant knowledge gaps related to parent mental health and family functioning, as well as critical questions that must be answered to further knowledge, policy, care, and outcomes. Conceptually driven investigations are needed to identify parent mental health and family functioning factors with the strongest influence on child outcomes, to obtain a deeper understanding of the biomarkers associated with these factors, and to better understand how parent mental health and family functioning influence child outcomes over time. Investigations are also needed to develop, test, and implement sustainable models of mental health screening and assessment, as well as effective interventions to optimise parent mental health and family functioning to promote psychosocial adaptation. The critical questions and investigations outlined in this paper provide a roadmap for future research to close gaps in knowledge, improve care, and promote positive outcomes for families of children with CHD.

Early Motor Function of Children With Autism Spectrum Disorder: A Systematic Review

CONTEXT

Early motor impairments have been reported in children with neurodevelopmental disorders (NDD), but it is not clear if early detection of motor impairments can identify children at risk for NDD or how early such impairments might be detected.

OBJECTIVE

To characterize early motor function in children later diagnosed with NDD relative to typically developing children or normative data.

DATA SOURCES

The Cumulative Index to Nursing and Allied Health Literature, Embase, Medline, PsycINFO, and Scopus electronic databases were searched.

STUDY SELECTION

Eligible studies were required to include an examination of motor function in children (0-24 months) with later diagnosis of NDD by using standardized assessment tools.

DATA EXTRACTION

Data were extracted by 4 independent researchers. The quality of the studies was assessed by using the Standard Quality Assessment Criteria for Evaluating Primary Research Papers from a Variety of Fields checklist.

RESULTS

Twenty-five studies were included in this review; in most of the studies, the authors examined children with later autism spectrum disorder (ASD). Early motor impairments were detected in children later diagnosed with ASD. The meta-analysis results indicated that differences in fine, gross, and generalized motor functions between the later ASD and typically developing groups increased with age. Motor function across different NDD groups was found to be mixed.

LIMITATIONS

Results may not be applicable to children with different types of NDD not reported in this review.

CONCLUSIONS

Early motor impairments are evident in children later diagnosed with ASD. More research is needed to ascertain the clinical utility of motor impairment detection as an early transdiagnostic marker of NDD risk.

Psychometric Properties of Parent Outcome Measures Used in RCTs of Antenatal and Early Years Parent Programs: A Systematic Review

Parenting programs are effective in the early intervention and treatment of children’s social, emotional and behavioural difficulties. However, inconsistency in the use of outcome measures limits the comparability of programs and creates challenges for practitioners seeking to monitor progress of families in their care. A systematic review was conducted to identify measures, appraise their psychometric properties and ease of implementation, with the overall objective of recommending a small battery of measures for use by researchers and practitioners. This article provides an overview of the most commonly used measures in experimental evaluations of parenting programs delivered to parents of children up to, and including, the age of 5 years (including antenatal programs). An in-depth appraisal of the psychometric properties and ease of implementation of parent outcome measures is also presented (findings in relation to child and dyadic outcome measures are presented elsewhere). Following a systematic search, 64 measures were identified as being used in three or more of 279 included evaluation studies. Data on the psychometric properties of 18 parent outcome measures were synthesised from 87 development and validation studies. Whilst it was not possible to identify a definitive battery of recommended measures, we are able to recommend specific measures that could be prioritised in further research and development and hold promise for those seeking to monitor the outcomes of parents and children in receipt of parenting programs.