Examining the validity of the Homework Performance Questionnaire: Multi-informant assessment in elementary and middle school

Implementation resources to support teachers' use of behavioral classroom interventions: protocol of a randomized pilot trial

BACKGROUND

Teacher-delivered behavioral classroom management interventions are effective for students with or at-risk for attention-deficit/hyperactivity disorder (ADHD) or other disruptive behavior challenges, but they can be difficult for teachers to use in the classroom. In this study, we will pilot test a package of implementation strategies to support teachers in using behavioral classroom interventions for students with ADHD symptoms.

METHODS

We will use a 2-group, randomized controlled trial to compare outcomes for teachers who receive Positive Behavior Management Implementation Resources (PBMIR), a theory and data-driven implementation resource package designed to increase teacher implementation of behavioral classroom management interventions, with those who do not receive this additional implementation support. We will measure teacher implementation outcomes (e.g., observed fidelity to behavioral classroom interventions) and student clinical outcomes (e.g., ADHD-related impairment, ADHD symptoms, student-teacher relationship, academic performance) before and after an 8-week intervention period for both groups; we will also measure teacher-reported acceptability, appropriateness, and feasibility for the PBMIR group following the intervention period.

DISCUSSION

If there is preliminary evidence of feasibility and effectiveness, this pilot study will provide the foundation for evaluation the PBMIR at a larger scale and the potential to improve outcomes for students with or at risk for ADHD.

TRIAL REGISTRATION

This clinical trial was registered at ClinicalTrials.gov. ( https://clinicaltrials.gov/ ) on 8/5/2022 which was prior to the time of first participant enrollment. The registration number is: NCT05489081.

Children's excessive digital media use, mental health problems and the protective role of parenting during COVID-19

COVID-19's outbreak in March 2020 and the social distancing measures that followed it changed the lives of children worldwide. Studies assessing the pandemic's implications for children have reported an alarming increase in the use of digital media (DM) and warned of its adverse impacts on children's functioning and development. The current study aimed to assess the relationship between excessive and problematic DM use and emotional, behavioral, and academic functioning among Israeli adolescents during COVID-19 and to identify adolescents at elevated risk of developing problematic DM use. Three hundred forty-seven Israeli parent-child dyads (M age = 11.81, SD = 1.41) separately completed measures assessing children's DM use (time and addiction), functioning (academic, social, emotional, and behavioral), behavioral dysregulation, and the parents' parenting practices. The results showed that DM addiction, but not DM use, was related to children's emotional, behavioral, and academic difficulties. Moreover, the results indicated that negative parenting and behavioral dysregulation increased the risk of DM addiction, which in turn increased emotional, behavioral, and academic difficulties. The results underscored parents' role in preventing problematic DM use and highlighted the need to treat DM use and problematic DM use as distinct constructs.

Academic functioning in children with and without sluggish cognitive tempo

Sluggish cognitive tempo (SCT) is increasingly conceptualized as a transdiagnostic set of symptoms associated with poorer functional outcomes, although the extent to which SCT is associated with academic functioning remains unclear. This study recruited children based on the presence or absence of clinically elevated SCT symptoms, using a multi-informant and multi-method design to provide a comprehensive examination of academic functioning in children with and without clinically elevated SCT symptoms. Participants were 207 children in Grades 2-5 (ages 7-11 years; 63.3% male), including 103 with clinically elevated teacher-reported SCT symptoms and 104 without elevated SCT, closely matched on grade and sex. A multi-informant, multi-method design that included standardized achievement testing, curriculum-based measurement (CBM), grades, classroom and laboratory observations, and parent and teacher rating scales was used. Children with elevated SCT symptoms had poorer academic functioning than their peers across most domains examined. Specifically, compared to children without SCT, children with elevated SCT had significantly lower grade point average (d = 0.42) and standardized achievement scores (ds = 0.40-0.77), poorer CBM performance including lower productivity (ds = 0.39-0.51), poorer homework performance and organizational skills (ds = 0.58-0.85), and lower teacher-reported academic skills (ds = 0.63-0.74) and academic enablers (ds = 0.66-0.74). The groups did not significantly differ on percentage of time on task during classroom observations or academic enabler interpersonal skills. Most effects were robust to control of family income, medication use, and attention-deficit/hyperactivity disorder inattentive symptoms, although effects for motivation and study skills academic enablers were reduced. This study demonstrates that children with clinically elevated SCT symptoms have wide-ranging academic difficulties compared to their peers without SCT. Findings point to the potential importance of assessing and treating SCT to improve academic outcomes.

Impact of Adenotonsillectomy on Homework Performance in Children With Obstructive Sleep-Disordered Breathing

OBJECTIVE

As a first line treatment for pediatric obstructive sleep-disordered breathing (SDB), adenotonsillectomy (AT) has been shown to confer physiologic and neurocognitive benefits to a child. However, there is a scarcity of data on how homework performance is affected postoperatively. Our objective was to evaluate the impact of AT on homework performance in children with SDB.

METHODS

Children in grades 1 to 8 undergoing AT for SDB based on clinical criteria with or without preoperative polysomnography along with a control group of children undergoing surgery unrelated to the treatment of SDB were recruited. The primary outcome of interest was the differential change in homework performance between the study group and control at follow-up as measured by the validated Homework Performance Questionnaire (HPQ-P). Adjustments were made for demographics and Pediatric Sleep Questionnaire (PSQ) scores.

RESULTS

116 AT and 47 control subjects were recruited, and follow-up data was obtained in 99 AT and 35 control subjects. There were no significant differences between the general (total) HPQ-P scores and subscale scores between the AT and control subjects at entry and there were no significant differences in the change scores (follow-up minus initial scores) between the groups. Regression modeling also demonstrated that there were no group (AT vs control) by time interactions that predicted differential improvements in the HPQ-P (P > .10 for each model) although initial PSQ score was a significant predictor of lower HPQ-P scores for all models.

CONCLUSIONS

Children with SDB experienced improvement in HPQ-P scores postoperatively, but the degree of change was not significant when compared to controls. Further studies incorporating additional educational metrics are encouraged to assess the true scholastic impact of AT in children with SDB.

The Impact of Social Determinants of Health on the Efficacy of School-Based Interventions for Adolescents with ADHD

Adolescents with Attention-deficit/hyperactivity disorder (ADHD) experience significant impairment in functioning. There are multiple clinic-based interventions that address these impairments (e.g., behavioral parent training). However, clinic-based interventions are often associated with barriers to care (e.g., transportation and financial resources), which can limit access based upon social determinants of health (e.g., parental income). School-based interventions have been developed to address the impairments adolescents with ADHD experience, with the goal of also improving access to care and limiting the impact social determinants of health. Despite this, to date, there has been almost no research evaluating the role of social determinants of health on the efficacy of school-based ADHD interventions. In a sample of 222 adolescents with ADHD randomly assigned to receive two different interventions, the present study evaluates the impact of income, maternal education, single-parent status, and race, on intervention efficacy. Single-parent status had the greatest impact on intervention efficacy, resulting in diminished improvements for two of the three outcomes. There was also a significant moderation effect for income, but only for parent-rated homework performance. In addition, main effects were found for single-parent status and race that represent disparities present at baseline that remained post-intervention. Overall, this study suggests that although school-based models of service delivery have the potential to significantly improve access to care, social determinants of health, and single-parent status, in particular, still need to be considered and addressed.

Academic Motivation Deficits in Adolescents with ADHD and Associations with Academic Functioning

The present study evaluates differences in self-reported intrinsic and extrinsic academic motivation and amotivation between eighth-grade adolescents with (n = 162) and without (n = 140) ADHD. This study also examines associations between motivation and academic functioning with objective (i.e., grade point average, standardized reading and math scores) and cross-rater measurement (i.e., parent-reported homework performance). Multivariate analysis of variance controlling for sex, intelligence, and medication status found that adolescents with ADHD exhibited a significant motivational deficit compared to adolescents without ADHD across all areas of academic motivation, including intrinsic motivation (d = 0.49), extrinsic motivation (d = 0.43), and amotivation (d = 0.42). To examine whether motivation was differentially associated with academic impairment in the ADHD and comparison groups, a multi-group path analysis was conducted controlling for sex, intelligence, and medication status. Findings showed that motivation was differentially associated with academic impairment for adolescents with and without ADHD. For the comparison group, higher amotivation was associated with poorer homework performance and lower intrinsic motivation was associated with lower reading accuracy. In the ADHD group, higher amotivation was associated with poorer homework performance and math fluency, higher extrinsic motivation was associated with better homework performance and higher GPA, and higher intrinsic motivation was associated with higher reading accuracy. This study builds upon previous research in demonstrating that adolescents with ADHD have academic motivational deficits when compared to their peers without ADHD. Research is needed to understand the longitudinal interplay of academic motivation and academic functioning, with an eye towards developing or modifying interventions to increase academic motivation and academic success.

Evaluation of the Interplay Between Homework Motivation and Sluggish Cognitive Tempo in Youth With ADHD: Associations With Homework Performance

Objective: This study evaluated which Sluggish Cognitive Tempo (SCT) factors (i.e., Slow, Sleepy, Daydreamer) are most strongly associated with homework motivation, and whether homework motivation mediates the path between SCT and academic impairment. Method: Participants were 285 middle school students (boys 209) in Grades 6 to 8 (ages 10-15 years) who were comprehensively diagnosed with ADHD. Results: Parent- and self-report of SCT Slow behaviors predicted homework motivation above and beyond symptoms of ADHD, oppositional defiant disorder (ODD), anxiety, depression, and intelligence. The mediation models tested were multi-informant and cross-rater (parent-report of SCT to self-report of motivation to teacher-report of homework problems), and suggest that low motivation may help explain the associations between SCT and functional impairment. Conclusion: SCT and motivation are significantly associated constructs. Clinically, youth with ADHD and comorbid SCT may be more likely to present with low motivation, placing them at risk for academic failure. The manuscript discusses potential clinical implications of these findings.

Predictors and Trajectories of Response to the Homework, Organization, and Planning Skills (HOPS) Intervention for Adolescents With ADHD

The goal of the present study was to evaluate the relative importance of adolescent and parent skills acquired during participation in the Homework, Organization, and Planning Skills (HOPS) intervention in predicting intervention response. A sample of 111 middle school students with attention-deficit/hyperactivity disorder (66% male; M_age = 11.99, SD = 1.05) received the HOPS intervention, which includes 16 brief sessions with the adolescent and two parent meetings. Each session, school mental health providers completed checklists measuring students' acquisition of homework recording, materials organization, and time management skills. Parents provided information on whether they monitored and used contingencies to reinforce skills use at home. Outcome measures included parent and teacher ratings of homework problems and organizational/time management skills postintervention. Grade point average and assignment completion were also evaluated as objective outcomes. Regressions found accurate homework recording and time management to be unique predictors of parent-reported homework and organizational skills outcomes. Growth mixture models examining organizational skills trajectories throughout the intervention significantly predicted parent- and teacher-reported outcomes, GPA, and assignment completion; homework recording trajectories predicted parent-reported outcomes and GPA. Sixty-eight percent of participants displayed high acquisition of organization and homework recording skills. Parent-reported use of monitoring and contingencies to support adolescent skills implementation was not associated with outcomes. Results highlight the importance of examining individual differences in school-based intervention studies targeting organization, time management, and planning. Importantly, for a school-based adolescent-focused intervention, improvement in outcomes does not appear to be dependent upon parent skills implementation.

Evaluating the Factor Validity of the Children's Organizational Skills Scale in Youth with ADHD

Children and adolescents with ADHD often have difficulties with organization, time management, and planning (OTMP) skills, and these skills are a common target of intervention. A limited array of tools for measuring these abilities in youth is available, and one of the most prominent measures is the Children's Organizational Skills Scale (COSS). Although the COSS fills an important need, a replication of the COSS factor structure outside of initial measure development has not been conducted in any population. Given that the COSS is frequently used in ADHD research, the current study evaluated the factor structure of the parent-rated COSS in a sample (N = 619) of adolescents with ADHD. Results indicated that the original factor structure could be replicated, although the use of item parcels appeared to affect model fit statistics. An alternative bi-factor model was also tested that did not require the use of parcels, with results suggesting similar model fit in comparison to the original factor structure. Exploratory validity tests indicated that the domain-general factor of the bi-factor model appears related to broad executive functioning abilities.

Meta-analysis of organizational skills interventions for children and adolescents with Attention-Deficit/Hyperactivity Disorder

BACKGROUND

In addition to problems with attention and hyperactivity, children with ADHD present with poor organizational skills required for managing time and materials in academic projects. Organizational skills training (OST) has been increasingly used to address these deficits. We conducted a systematic review and meta-analysis of OST in children with ADHD.

OBJECTIVES

The objective of this study was to systematically review the evidence of the effects of OST for children with ADHD for organizational skills, attention, and academic performance.

METHODS

We searched 3 electronic databases to locate randomized controlled trials published in English in peer-reviewed journals comparing OST with parent education, treatment-as-usual, or waitlist control conditions. Standardized mean difference effect sizes from the studies were statistically combined using a random-effects meta-analyses across six outcomes: teacher- and parent-rated organizational skills, teacher- and parent-rated inattention, teacher-rated academic performance, and Grade Point Average (GPA). Risk of bias was assessed for randomization, allocation concealment, blinding of participants and treatment personnel, blinding of outcome assessors, incomplete outcome data, and selective outcome reporting.

RESULTS

Twelve studies involving 1054 children (576 treatment, 478 control) were included in the meta-analyses. Weighted mean effect sizes for teacher- and parent-rated outcome measures of organizational skills were g=0.54 (95% CI 0.17 to 0.91) and g=0.83 (95% CI 0.32 to 1.34), respectively. Weighted mean effect sizes of teacher- and parent-rated symptoms of inattention were g=0.26 (95% CI 0.01 to 0.52) and g=0.56 (95% CI 0.38 to 0.74), respectively. Weighted standardized mean effect size for teacher-rated academic performance and GPA were g=0.33 (95% CI 0.14 to 0.51) and g=0.29 (95% CI 0.07 to 0.51), respectively.

CONCLUSIONS

OST leads to moderate improvements in organizational skills of children with ADHD as rated by teachers and large improvements as rated by parents. More modest improvements were observed on the ratings of symptoms of inattention and academic performance.

PROTOCOL REGISTRATION

PROSPERO (CRD42015019261).

Introduction to bifactor polytomous item response theory analysis

A bifactor item response theory model can be used to aid in the interpretation of the dimensionality of a multifaceted questionnaire that assumes continuous latent variables underlying the propensity to respond to items. This model can be used to describe the locations of people on a general continuous latent variable as well as on continuous orthogonal specific traits that characterize responses to groups of items. The bifactor graded response (bifac-GR) model is presented in contrast to a correlated traits (or multidimensional GR model) and unidimensional GR model. Bifac-GR model specification, assumptions, estimation, and interpretation are demonstrated with a reanalysis of data (Campbell, 2008) on the Shared Activities Questionnaire. We also show the importance of marginalizing the slopes for interpretation purposes and we extend the concept to the interpretation of the information function. To go along with the illustrative example analyses, we have made available supplementary files that include command file (syntax) examples and outputs from flexMIRT, IRTPRO, R, Mplus, and STATA. Supplementary data to this article can be found online at http://dx.doi.org/10.1016/j.jsp.2016.11.001. Data needed to reproduce analyses in this article are available as supplemental materials (online only) in the Appendix of this article.

Longitudinal evaluation of the importance of homework assignment completion for the academic performance of middle school students with ADHD

The primary goal of this study was to longitudinally evaluate the homework assignment completion patterns of middle school age adolescents with ADHD, their associations with academic performance, and malleable predictors of homework assignment completion. Analyses were conducted on a sample of 104 middle school students comprehensively diagnosed with ADHD and followed for 18 months. Multiple teachers for each student provided information about the percentage of homework assignments turned in at five separate time points and school grades were collected quarterly. Results showed that agreement between teachers with respect to students assignment completion was high, with an intraclass correlation of .879 at baseline. Students with ADHD were turning in an average of 12% fewer assignments each academic quarter in comparison to teacher-reported classroom averages. Regression analyses revealed a robust association between the percentage of assignments turned in at baseline and school grades 18 months later, even after controlling for baseline grades, achievement (reading and math), intelligence, family income, and race. Cross-lag analyses demonstrated that the association between assignment completion and grades was reciprocal, with assignment completion negatively impacting grades and low grades in turn being associated with decreased future homework completion. Parent ratings of homework materials management abilities at baseline significantly predicted the percentage of assignments turned in as reported by teachers 18 months later. These findings demonstrate that homework assignment completion problems are persistent across time and an important intervention target for adolescents with ADHD.