Evidence-Based Assessment: Best Practices, Customary Practices, and Recommendations for Field-Based Assessment

Clinical Reasoning: A Missing Piece for Improving Evidence-Based Assessment in Psychology

Clinical reasoning is a foundational component of conducting evidence-based psychological assessments. In spite of its importance, limited attention has been paid to the teaching or measurement of clinical reasoning skills relative to psychological assessment, as well as how clinical reasoning develops or how its efficacy can be measured. Improving clinical reasoning throughout the assessment process, from initial case conceptualization to hypotheses testing, to recommendation writing, has the potential to address commonly noted concerns regarding diagnostic accuracy, as well as the accessibility and utility of psychological reports and recommendations, and will, ultimately, lead to improved outcomes for clients. Consequently, we provide a definition of clinical reasoning in relation to psychological assessment, followed by a critique of graduate training assessment and the current challenges of measuring clinical reasoning in psychology. Lastly, this paper provides suggestions for how to incorporate clinical reasoning throughout the assessment process as a way to answer client questions more effectively and provide meaningful recommendations to improve outcomes.

Examination of Psychometric Evidence for Criterion-Referenced Scores from the SSIS SEL Brief Scales

Efficient and intuitive interpretive frameworks for social-emotional learning (SEL) measures are necessary for identifying student needs and informing programming decisions across multitiered systems of support in schools. Though familiar to educators and often used with standardized tests of academic achievement, criterion-referenced frameworks are less common in SEL assessment. As such, the current study examined the psychometric evidence for scores from one such framework, the Competency-Referenced Performance Framework, which was developed to inform universal screening decisions based on the SSIS SEL Brief Scales (Elliott et al., 2020). Specifically, we evaluated stability, test-criterion relationships with academic outcomes, and treatment sensitivity of the CRPF using data from an efficacy trial of a universal SEL program. Results provided preliminary supportive evidence for the CRPF.

Examining School Psychologists’ Attitudes Toward Standardized Assessment Tools

Despite a call for evidence-based practice in school psychology, limited research on the topic of evidence-based assessment exists. To begin to address this gap in the research, a modified version of Jenson–Doss and Hawley’s (2010) Attitudes Toward Standardized Assessment (ASA) scale was administered to 371 U.S. school psychologists. Examination of the modified ASA’s factor structure suggested that a bifactor model with a single overall domain and three sub-domains was the most parsimonious. Indices of dimensionality indicated that the overall score may be the best indicator of school psychologist’s perceptions of standardized assessment. Additionally, school psychologists’ reported favorable attitudes of standardized assessment compared to clinical judgment alone. Limitations and implications for future research are discussed.

Predicting School Suspension Risk from Eighth through Tenth Grade Using the Strengths and Difficulties Questionnaire

The current study examined (1) if the Strengths and Difficulties Questionnaire (SDQ) would yield alternative factor structures related to either symptoms or strengths with early adolescent students when an exploratory factor analysis (EFA) is used; (2) which scales best predicted suspensions of typically developing early adolescents; and (3) what cut-off scores were useful for identifying youth at risk for suspensions. The current study included 321 parent-student dyads, who were followed from the middle of eighth grade until the end of tenth grade. A symptoms-based EFA yielded three factors: Misbehavior, Isolation, and Agitation. A strength-based EFA yielded three factors, as, well: Emotional, Social, and Moral competence. Logistic regression path analyses were used to predict risk of any suspension at the end of eighth, ninth, and tenth grades. The predictor variables were the original SDQ Conduct Problems and Hyperactivity scales in one model, the Misbehavior and Agitation scales in a second model, and the Emotional and Moral competence scales in the third model. Only the Misbehavior scale consistently predicted suspensions across each grade (b = .27, OR = 1.32, p < .001; b = .15, OR = 1.18, p = .029; b = .17, OR = 1.18, p = .029, respectively). For the Misbehavior scale, cut-off scores were established that reflected the 75th and 90th percentile; however, each cut-off demonstrated strengths and weaknesses for identifying at-risk students. The expectation of screening to identify youth at-risk for suspensions, a complex school discipline decision, is discussed.

Test use and assessment practices of school psychologists in the United States: Findings from the 2017 National Survey

Although several studies have examined the specific instruments and procedures used by school psychologists when conducting comprehensive psychoeducational evaluations, the last one was published over 20 years ago (viz., Wilson & Reschly, 1996). Given the substantial theoretical and practical advances in assessment since then, the purpose of the current study was to examine the test use and assessment practices of contemporary school psychologists in the United States. Data from the 2017 National Survey of Assessment Practices in School Psychology revealed that test use and assessment practices have evolved significantly. Much of this change consists of the substitution of tests and practices with limited reliability and validity with those with greater psychometric support. Results of this study also indicate that school psychologists regularly conduct multi-method assessments to prevent, identify, monitor, and remediate child and adolescent learning difficulties and other presenting problems in the schools.