Formative behavioral assessment across eight constructs: Dependability of direct behavior ratings and formative behavior rating measures

Due to their promise as a feasible tool for evaluating the effects of school-based interventions, Direct Behavior Ratings (DBR) have received much research attention over the past 2 decades. Although DBR methodology has demonstrated much promise, favorable psychometric characteristics only have been demonstrated for tools measuring a small number of constructs. Likewise, although a variety of methods of DBR have been proposed, most extant studies have focused on the use of single-item methods. The present study examined the dependability of four methods of formative behavioral assessment (i.e., single-item and multi-item ratings administered either daily [DBR] or weekly [formative behavior rating measures or FBRM]) across eight psychological constructs (i.e., interpersonal skills, academic engagement, organizational skills, disruptive behavior, oppositional behavior, interpersonal conflict, anxious depressed, and social withdrawal). School-based professionals (N = 91; i.e., teachers, paraprofessionals, and intervention specialists) each rated one student across all eight constructs after being assigned to one of the four assessment conditions. Dependability estimates varied substantially across methods and constructs (range = 0.75-0.96), although findings of the present study support the use of the broad set of formative assessment tools evaluated.

Executive Function in Autism: Association with ADHD and ASD Symptoms

There is substantial comorbidity between autism spectrum disorder (ASD) and attention deficit/hyperactivity disorder (ADHD), and there are well-documented executive functioning (EF) deficits in both populations. An important question concerns whether EF deficits in children with ASD are related to severity of ASD, ADHD, or both. We examined ADHD and ASD symptoms in relation to ratings of EF in the home and classroom. The sample comprised 64 children (55 males) diagnosed with ASD (mean age = 9.26 years; mean FSIQ = 92). Analyses indicated that parent and teacher ratings of EF (except Shift and Emotional Control) were consistently related to ADHD symptom severity, but not to ASD severity. Thus, functioning in the domains of Shift and Emotional control appear relatively spared, whereas performance in all other EF was impaired in relation to ADHD symptoms.

Network analyses of Oppositional Defiant Disorder (ODD) symptoms in children

Based on parent and teacher ratings of their children, this study used regularized partial correlation network analysis (EBIC glasso) to examine the structure of DSM-5 Oppositional Defiant Disorder (ODD) symptoms. Parent and teachers (N = 934) from the general community in Malaysia completed questionnaires covering DSM-5 ODD symptoms. The most central ODD symptom for parent ratings was anger, followed by argue. For teacher ratings, it was anger, followed by defy. For both parent and teacher ratings, the networks revealed at least medium effect size connections for temper and argue, defy, and argue, blames others, and annoy, and spiteful and angry. Overall, the findings were highly comparable across parent and teacher ratings, and they showed a novel understanding of the structure of the ODD symptoms. The clinical implications of the findings for assessment and treatment of ODD are discussed.

Exploratory Factor Analysis of SRS-2 Teacher Ratings for Youth with ASD

This study examined the factor structure and internal consistency of special education teaching staff ratings on the Social Responsiveness Scale-2 (SRS-2; Constantino and Gruber 2012), as well as the percentage of ratings falling above pre-established cut scores, for a sample of lower-functioning youth with autism spectrum disorder (ASD; n = 264). Results of the exploratory factor analysis yielded a four-factor correlated solution. The individual factors and total score demonstrated satisfactory internal consistency reliability for screening purposes. When applying the lowest pre-established cut score (T ≥ 60; minimum indication of clinically significant symptoms/impairments), 85 % of the sample had ratings in that range or higher (more severe). Implications for assessment and future research are provided.

Evaluating the quality of peer interactions in children and adolescents with autism with the Penn Interactive Peer Play Scale (PIPPS)

Background

A core difficulty for individuals with autism is making friends and successfully engaging and interacting with peers. The majority of measures to assess peer interactions are observations in a school setting or self-report. The present study examined the convergent validity of using a teacher rating scale, the Penn Interactive Peer Play Scale (PIPPS), for collecting information about the quality of peer interactions at school.

Methods

Teachers completed the PIPPS for 107 children with ASD when the child was 9 and 13 years of age. Clinicians completed diagnostic and cognitive assessments and caregivers completed the Autism Diagnostic Interview-Revised (ADI-R) when the child was 9.

Results

Parent report of reciprocal friendships from the ADI-R was associated with teacher report about how socially connected the child was at school on the PIPPS, indicating strong convergence between teachers and parents. Children with more severe restricted and repetitive behaviors and lower verbal abilities were less connected with peers. Children with access to typical peers had more connections with peers compared to those who were in a special education classroom.

Conclusions

The findings suggest that teacher ratings from the PIPPS can accurately capture the quality of peer interactions in children and adolescents with ASD and may be useful for clinicians and researchers to evaluate peer engagement in the classroom.

Pre-service teachers' perceptions of sluggish cognitive tempo

Sluggish cognitive tempo (SCT) is characterized by a passive form of inattention that may not overtly disrupt classroom goals. Due to the nature of these symptoms, children with SCT may be "falling through the cracks" in schools. The current study examined pre-service teachers' perceptions of SCT in the classroom. Undergraduate education majors (n = 161) read vignettes describing fictitious fourth-grade boys presenting with symptoms of SCT, attention-deficit/hyperactivity disorder (ADHD), or a non-ADHD-related control: social anxiety disorder (SA), and rated each of the vignettes in terms of their perceptions of the boy described. Results were analyzed using repeated measures ANOVAs and paired-sample t tests. Pre-service teachers viewed all three sets of symptoms as concerning, but viewed ADHD behaviors as the most problematic. These results are promising, as they suggest that pre-service teachers are concerned about both hyperactive (i.e., ADHD) and non-hyperactive behavioral problems (i.e., SCT and SA). Implications and future directions are discussed.

Psychopathic personality traits in 5 year old twins: the importance of genetic and shared environmental influences

There is limited research on the genetic and environmental bases of psychopathic personality traits in children. In this study, psychopathic personality traits were assessed in a total of 1189 5-year-old boys and girls drawn from the Preschool Twin Study in Sweden. Psychopathic personality traits were assessed with the Child Problematic Traits Inventory, a teacher-report measure of psychopathic personality traits in children ranging from 3 to 12 years old. Univariate results showed that genetic influences accounted for 57, 25, and 74 % of the variance in the grandiose-deceitful, callous-unemotional, and impulsive-need for stimulation dimensions, while the shared environment accounted for 17, 48 and 9 % (n.s.) in grandiose-deceitful and callous-unemotional, impulsive-need for stimulation dimensions, respectively. No sex differences were found in the genetic and environmental variance components. The non-shared environment accounted for the remaining 26, 27 and 17 % of the variance, respectively. The three dimensions of psychopathic personality were moderately correlated (0.54-0.66) and these correlations were primarily mediated by genetic and shared environmental factors. In contrast to research conducted with adolescent and adult twins, we found that both genetic and shared environmental factors influenced psychopathic personality traits in early childhood. These findings indicate that etiological models of psychopathic personality traits would benefit by taking developmental stages and processes into consideration.

Factor structure of parent and teacher ratings of the ODD symptoms for Malaysian primary school children

This present study used confirmatory factor analysis (CFA) to examine the applicability of one-, two- three- and second order Oppositional Defiant Disorder (ODD) factor models, proposed in previous studies, in a group of Malaysian primary school children. These models were primarily based on parent reports. In the current study, parent and teacher ratings of the ODD symptoms were obtained for 934 children. For both groups of respondents, the findings showing some support for all models examined, with most support for a second order model with Burke et al. (2010) three factors (oppositional, antagonistic, and negative affect) as the primary factors. The diagnostic implications of the findings are discussed.

ADHD bifactor model based on parent and teacher ratings of Malaysian children

BACKGROUND

The study used confirmatory factor analysis to ascertain support for the bifactor model of the Attention Deficit/Hyperactivity Disorder (ADHD) symptoms, based on parent and teacher ratings for a group of Malaysian children.

METHODS

Malaysian parents and teachers completed ratings of ADHD and Opposition Defiant Disorder (ODD) symptoms for 934 children.

RESULTS

For both sets of ratings, the findings indicating good fit for the bifactor model, and the factors in this model showed differential associations with ODD, thereby supporting the internal and external validity of this model.

DISCUSSION

The theoretical and clinical implications of the findings are discussed.

Predictive validity of curriculum-based measurement and teacher ratings of academic achievement

Two alternative universal screening approaches to identify students with early learning difficulties were examined, along with a combination of these approaches. These approaches, consisting of (a) curriculum-based measurement (CBM) and (b) teacher ratings using Performance Screening Guides (PSGs), served as predictors of achievement tests in reading and mathematics. Participants included 413 students in grades 1, 2, and 3 in Tennessee (n=118) and Wisconsin (n=295) who were divided into six subsamples defined by grade and state. Reading and mathematics achievement tests with established psychometric properties were used as criteria within a concurrent and predictive validity framework. Across both achievement areas, CBM probes shared more variance with criterion measures than did teacher ratings, although teacher ratings added incremental validity among most subsamples. PSGs tended to be more accurate for identifying students in need of assistance at a 1-month interval, whereas CBM probes were more accurate at a 6-month interval. Teachers indicated that (a) false negatives are more problematic than are false positives, (b) both screening methods are useful for identifying early learning difficulties, and (c) both screening methods are useful for identifying students in need of interventions. Collectively, these findings suggest that the two types of measures, when used together, yield valuable information about students who need assistance in reading and mathematics.