Third variables in longitudinal research: Application of longitudinal mediation and moderation in school psychology

Third variable models, such as mediation and moderation, can identify contextual factors that help explain the relation between two variables. Although used less frequently in school psychology research, longitudinal mediation, longitudinal moderation, and the integration of these two approaches can be used to describe the developmental changes in children's psychological and behavioral processes throughout the school years and beyond. This article provides conceptual descriptions of longitudinal mediation, longitudinal moderation, longitudinal moderated mediation, and longitudinal mediated moderation and demonstrates the use of these methods with a large sample of elementary students. Extensions of these methods and applied examples from the literature are also discussed. The Mplus syntax from our illustrated examples are provided for those interested in reproducing the analyses.

The effect of measurement error on the positive predictive value of PSW methods for SLD identification: How buffer zones dispel the illusion of inaccuracy

Patterns of Strengths and Weaknesses (PSW) methods are widely used for identifying specific learning disabilities (SLDs). Several researchers, however, have reported that the diagnostic accuracy of PSW methods is unacceptably low when strict thresholds were used to identify students with SLDs. We believe these findings give a misleading impression of the magnitude of the diagnostic errors that are likely to arise in PSW assessments. In a simulation study of 10 million cases using a simplified PSW method for demonstration, most of what have been called diagnostic errors were cases in which observed scores and true scores fell on opposite sides of a strict threshold but were still within a buffer zone the size of a typical measurement error. Because small score differences do not result in meaningfully different case conceptualizations, the use of buffer zones reveals that previous estimates of the diagnostic accuracy of PSW methods are misleadingly low. We also demonstrate that diagnostic decisions become increasingly reliable when observed scores are comfortably distant from diagnostic thresholds. For practitioners, we present a flowchart and practical guidelines to improve the accuracy and stability of SLD identification decisions.

Do Cognitive-Achievement Relations Vary by General Ability Level?

Cognitive-achievement relations research has been instrumental in understanding the development of academic skills and learning difficulties. Most cognitive-achievement relations research has been conducted with large samples and represent average relations across the ability spectrum. A notable gap in the literature is whether these relations vary by cognitive ability levels (IQ). This study examined cognitive-achievement relations across different general ability levels (Low, Average, and High) to fill this gap. Based on Spearman's Law of Diminishing Returns, it would be expected that general intelligence would be a stronger predictor of academic skills at lower levels of IQ, and more specific abilities would be stronger predictors of academic skills at higher levels of IQ. To test this, multi-group path analysis and structural equation modeling were used to examine whether integrated models of cognitive-reading relations are differentiated by IQ levels in the Woodcock-Johnson III and Woodcock-Johnson IV standardization samples. Global and broad cognitive abilities were used as predictors of basic reading skills and reading comprehension for elementary and secondary school students. The magnitude of prediction differed across ability groups in some cases, but not all. Importantly, the variance explained in basic reading skills and reading comprehension tended to be larger for the Low group compared to the Average and High groups. When variance accounted for by general intelligence was removed from the broad abilities, the effects of the broad abilities were similar across ability groups, but the indirect effects of g were higher for the Low group. Additionally, g had stronger relative effects on reading in the Low group, and broad abilities had stronger relative effects on reading in the Average and High groups. The implications and limitations of this study are discussed.

Measurement Equality of Frequency and Severity Item Response Options on Depression and Generalized Anxiety Scales

Rating scales are commonly used in psychological research and practice. It is important to consider how different item response options used on rating scales, such as those based on frequency or severity, may affect how they measure psychological constructs. In this study, participants were randomly assigned to conditions where they completed two depression and two generalized anxiety rating scales that used either frequency or severity item response options. Descriptive statistics and reliability estimates across depression and generalized anxiety scales using different item response options were similar. Measurement invariance tests indicated that depression and generalized anxiety scales with different item response options could be considered practically invariant. Finally, depression and generalized anxiety scales with different item response options had similar correlations with measures of impairment and other psychological constructs. There were essentially no differences in psychometric and measurement properties of these depression and generalized anxiety scales when using different item response options, suggesting this may not substantially affect the measurement of these constructs.

Working memory capacity development through childhood: A longitudinal analysis

Working memory is an often studied and important psychological construct. The growth of working memory capacity (WMC) in childhood is described as linear. Average adult WMC is estimated as either four or five "chunks." Using latent curve models of data from a measure of digit span backward that was administered longitudinally to a large sample representative of the native-English-speaking U.S. kindergarten population in 2011, we found that WMC growth in childhood is curvilinear. It shows an increasing yet decelerating pattern. Scoring rules (e.g., requiring 50% or 75% of trials correct) influence age-based estimates, but WMCs have likely been underestimated in children, and the average adult WMC of five is more plausible than four, as measured by digit span backward. Developmental WMC estimates, such as those reported in this research, may help others develop prescriptive learning interventions for children and understand its growth and decline across the life span. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Measurement Invariance of the Occupational Engagement Scale – Student and Career Adapt-Abilities Scale across Veterans and Civilians

Veterans of the U.S. military experience unique difficulties when reentering the civilian workforce, which may inform their post-military career development in different ways than civilians. The purpose of this study was to examine the measurement invariance of the Occupational Engagement Scale-Student (OES-S) and the Career Adapt-Abilities Scale-USA Form (CAAS) across adults with and without a military background. A sample of 418 U.S. military veterans and 411 civilians were recruited. Multiple group confirmatory factor analysis (MG-CFA) was used to examine factorial invariance of scores obtained from the OES-S and CAAS with veterans and civilians. Findings suggested the measures were invariant across veteran and civilian samples. These scales appear to measure the same constructs for veterans and civilians and can likely be used for veterans in both research and practice. Implications for career assessment and counseling are discussed.

The dose-effect and good enough level models of change for specific psychological concerns

OBJECTIVE

Most research on the dose-effect (DE) and good-enough level (GEL) models of change has used general outcome measures. The purpose of this study was to determine if predictions from these models generalize to specific presenting concerns and outcome measures.

METHOD

A large sample of treatment-seeking college students (N = 64,319) who attended different numbers of therapy sessions and completed the College Counseling Assessment of Psychological Symptoms-34 (CCAPS-34, Locke et al., Measurement & Evaluation in Counseling & Development, 2012, 45, p. 151) during sessions was used. An analysis of reliable and clinically significant improvement (RCSI) and latent growth curve models (LGCMs) were used for clients attending different numbers of sessions across eight scales from the CCAPS-34 to examine the: (a) amount of change from the first to last session, (b) rates of RCSI, (c) shape of change trajectories, and (d) rates of change across sessions.

RESULTS

Across all CCAPS-34 scales, clients who attended more sessions tended to experience more improvement, had higher rates of RCSI, and the trajectories of change were nonlinear, consistent with the DE model. Clients who attended fewer sessions tended to experience faster rates of change than those who attended more sessions, consistent with the GEL model.

CONCLUSIONS

Aspects of both the DE and GEL models appear to generalize to specific outcome measures on the CCAPS-34. Results suggest both individual differences in sensitivity to therapy and amount of therapy received influence therapeutic change. A greater focus on individual needs, especially early in treatment, may be especially important when determining the length of therapy. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Military Background and Gender Identity in Psychological Assessment Among College Students: Factorial Invariance of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62)

The purpose of this study was to examine the factorial invariance of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62) across military background and gender identity. A sample of 2,208 military students and 2,208 nonmilitary students were chosen from a large database of university and college counseling centers. Using exploratory structural equation modeling, findings suggested the CCAPS-62 is mostly invariant across military background and gender identity. Only three item thresholds appeared to be noninvariant across groups. These results suggest comparisons of scores across military background and gender can be made. Latent mean differences across groups were also examined. After controlling for several background variables, there were some differences between males and females on subscales measuring depression, eating concerns, and generalized anxiety, but no differences between military and nonmilitary students. Implications for practice and future research are discussed.

Dynamic changes in generalized anxiety and depression during counseling

Comorbidity of generalized anxiety and depression is common in clinical populations. Understanding how change in generalized anxiety and depression are related during counseling may help improve treatment. College student data (N = 51,922) from university and college counseling centers across the United States were used to examine relationships between change in generalized anxiety and depression across 12 counseling sessions using bivariate dual change score models. Results suggested greater improvement in depression was related to greater improvement in generalized anxiety across sessions, but greater improvement in generalized anxiety was related to less improvement in depression across sessions. This same pattern of results generalized to individuals who attended counseling with concerns in anxiety only, depression only, and both anxiety and depression. Although there were general improvements in generalized anxiety and depression across counseling sessions, greater improvement in depression at earlier sessions appeared to be a leading indicator of greater improvement in generalized anxiety at later sessions. Implications and future directions are discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Cognitive ability influences on written expression: Evidence for developmental and sex-based differences in school-age children

Some studies have demonstrated that the Cattell-Horn-Carroll (CHC) cognitive abilities influence writing; however, little research has investigated whether CHC cognitive abilities influence writing the same way for males and females across grades. We used multiple group structural equation models to investigate whether CHC cognitive ability influences on written expression differed between grades or sex using the Kaufman Assessment Battery for Children, Second Edition and the Kaufman Tests of Educational Achievement, Second Edition co-normed standardization sample data (N=2117). After testing for consistent measurement of cognitive abilities across grades and sex, we tested whether the cognitive ability influences on written expression were moderated by grade level or sex. An important developmental shift was observed equally across sex groups: Learning Efficiency (Gl) influences decreased whereas Crystallized Ability (Gc) influences increased after fourth grade. Further, Short-Term Memory (Gsm) and Retrieval Fluency (Gr) influences on written expression depended on sex at grades 1-4, with larger Gr influences for females and larger Gsm influences for males. We internally replicated our main findings using two different cognitive explanatory models, adding further support for the developmental and sex-based differential cognitive ability influences on writing. Explanatory cognitive models of writing need to incorporate development, and possibly, sex to provide an expanded understanding of writing development and guard against potential generalizability issues characteristic of special population (i.e., male-female) studies.

What Does the Shipley-2 Measure for Children and Adolescents? Integrated and Conjoint Confirmatory Factor Analysis With the WISC-IV

We used integrated and conjoint confirmatory factor analysis of Shipley-2 and Wechsler Intelligence Scale for Children–Fourth Edition (WISC-IV) data to investigate constructs measured in the Shipley-2 for children and adolescents. We also estimated Shipley-2 composite reliability at the subtest level rather than the item level. The three Shipley-2 subtests for the most part measured what was described in the manual, although Block Patterns measured visual spatial ability in addition to fluid ability and Abstraction was best considered a measure of psychometric g. The g factors derived from the WISC-IV and Shipley-2 were similar but not identical. Internal reliability estimates for Shipley-2 composites that were based on correlations between the subtests were substantially lower than those based on the items. Last, based on WISC-IV derived g factors, 37% to 53% of the variance in Shipley-2 composites was explained by g. Some of the reliable variance in the Shipley-2 composites was due to something specific that the subtests had in common not explained by psychometric g.

Global, broad, or specific cognitive differences? Using a MIMIC model to examine differences in CHC abilities in children with learning disabilities

This study was designed to better understand the relations between learning disabilities and different levels of latent cognitive abilities, including general intelligence (g), broad cognitive abilities, and specific abilities based on the Cattell-Horn-Carroll theory of intelligence (CHC theory). Data from the Differential Ability Scales-Second Edition (DAS-II) were used to create a multiple-indicator multiple cause model to examine the latent mean differences in cognitive abilities between children with and without learning disabilities in reading (LD reading), math (LD math), and reading and writing(LD reading and writing). Statistically significant differences were found in the g factor between the norm group and the LD groups. After controlling for differences in g, the LD reading and LD reading and writing groups showed relatively lower latent processing speed, and the LD math group showed relatively higher latent comprehension-knowledge. There were also some differences in some specific cognitive abilities, including lower scores in spatial relations and numerical facility for the LD math group, and lower scores in visual memory for the LD reading and writing group. These specific mean differences were above and beyond any differences in the latent cognitive factor means.