Assessing the Psychometric Utility of IQ Scores: A Tutorial Using the Wechsler Intelligence Scale for Children–Fifth Edition

Bootstrap Exploratory Graph Analysis of the WISC-V with a Clinical Sample

One important aspect of construct validity is structural validity. Structural validity refers to the degree to which scores of a psychological test are a reflection of the dimensionality of the construct being measured. A factor analysis, which assumes that unobserved latent variables are responsible for the covariation among observed test scores, has traditionally been employed to provide structural validity evidence. Factor analytic studies have variously suggested either four or five dimensions for the WISC-V and it is unlikely that any new factor analytic study will resolve this dimensional dilemma. Unlike a factor analysis, an exploratory graph analysis (EGA) does not assume a common latent cause of covariances between test scores. Rather, an EGA identifies dimensions by locating strongly connected sets of scores that form coherent sub-networks within the overall network. Accordingly, the present study employed a bootstrap EGA technique to investigate the structure of the 10 WISC-V primary subtests using a large clinical sample (N = 7149) with a mean age of 10.7 years and a standard deviation of 2.8 years. The resulting structure was composed of four sub-networks that paralleled the first-order factor structure reported in many studies where the fluid reasoning and visual-spatial dimensions merged into a single dimension. These results suggest that discrepant construct and scoring structures exist for the WISC-V that potentially raise serious concerns about the test interpretations of psychologists who employ the test structure preferred by the publisher.

Consensus-Based Evaluation of Outcome Measures in Pediatric Stroke Care: A Toolkit

Following a pediatric stroke, outcome measures selected for monitoring functional recovery and development vary widely. We sought to develop a toolkit of outcome measures that are currently available to clinicians, possess strong psychometric properties, and are feasible for use within clinical settings. A multidisciplinary group of clinicians and scientists from the International Pediatric Stroke Organization comprehensively reviewed the quality of measures in multiple domains described in pediatric stroke populations including global performance, motor and cognitive function, language, quality of life, and behavior and adaptive functioning. The quality of each measure was evaluated using guidelines focused on responsiveness and sensitivity, reliability, validity, feasibility, and predictive utility. A total of 48 outcome measures were included and were rated by experts based on the available evidence within the literature supporting the strengths of their psychometric properties and practical use. Only three measures were found to be validated for use in pediatric stroke: the Pediatric Stroke Outcome Measure, the Pediatric Stroke Recurrence and Recovery Questionnaire, and the Pediatric Stroke Quality of Life Measure. However, multiple additional measures were deemed to have good psychometric properties and acceptable utility for assessing pediatric stroke outcomes. Strengths and weaknesses of commonly used measures including feasibility are highlighted to guide evidence-based and practicable outcome measure selection. Improving the coherence of outcome assessment will facilitate comparison of studies and enhance research and clinical care in children with stroke. Further work is urgently needed to close the gap and validate measures across all clinically significant domains in the pediatric stroke population.

The Validity of WISC-V Profiles of Strengths and Weaknesses

The Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V; Wechsler, 2014 ) provides a general intelligence score, representing g, and five index scores, reflecting underlying broad factors. Within person differences between the overall performance across subtests and index scores, denoted as index difference scores, are often used to examine profiles of strengths and weaknesses. In this study, the validity of such profiles was examined for the Dutch WISC-V. In line with previous studies, broad factors explained little variance in index scores. A simulation study showed that variation in index difference scores also reflected little broad factor variance. The simulation study further revealed that, as a consequence, a significant discrepancy between an index score and overall performance was accompanied in only 40%–74% of the cases by a discrepancy on the underlying broad factor. Overall, these results provide little support for the validity and thereby clinical use of WISC-V profiles.

Diversity of Intelligence is the Norm Within the Autism Spectrum: Full Scale Intelligence Scores Among Children with ASD

Although previous research helped to define differences in intelligence between neurotypicals and those with ASD, results were limited by small sample sizes or restricted subtests. Using data from the NIMH Data Archive, this study examined the intelligence of children with ASD (N = 671). Results demonstrate an average standard deviation of 25.75, which is 1.72 times greater than that of the normative sample for the WISC-III. Moreover, students with ASD are 12 times more likely than the general population of students to score within the intellectual disability range, but are also 1.5 times more likely to score in the superior range, suggesting that more students with ASD should be considered for giftedness. Determining the diversity of intelligence among those with ASD has implications for research, clinical practice, and neurological understanding.

A Short Version of the EFECO Online Questionnaire for the Assessment of Executive Functions in School-Age Children

Executive function (EF) is a group of processes that allow individuals to be goal-oriented and to have adaptive functioning, so that adequate performance is essential for success in activities of daily living, at school and in other activities. The present study aims to create a short version of the Executive Functioning Questionnaire (EFECO) since there is a gap in the Spanish literature due to the lack of behavioural observation questionnaires at school age. A total of 3926 participants completed the online questionnaire. Subsequently, the validity and reliability of the data are analysed. The results show that the short version of the questionnaire, the EFECO-S, has a structure with five dimensions (emotional self-control, initiation, working memory, inhibition, and spatial organisation), as well as a second-order factor (global executive skill) and high reliability (ordinal Alpha = 0.68-0.88). The EFECO is composed of 67 items, while the EFECO-S has 20 items, four per factor, which turns it into a quick and easy to apply test. Therefore, it becomes an interesting alternative to be applied in screening processes with children who may be experiencing executive difficulties.

Internal (Factorial) Validity of the ANAM using a Cohort of Woman High-School Soccer Players

INTRODUCTION

Computerized neuropsychological testing is a cornerstone of sport-related concussion assessment. Female soccer players are at an increased risk for concussion as well as exposures to repetitive head impacts from heading a soccer ball. Our primary aim was to examine factorial validity of the Automated Neuropsychological Assessment Metrics (ANAM) neuropsychological test battery in computing the multiple neurocognitive constructs it purports to measure in a large cohort of interscholastic female soccer players.

METHODS

Study participants included 218 interscholastic female soccer players (age = 17.0±0.7 year; mass = 55.5±6.8 kg; height = 164.7±6.6 cm) drawn from a large (850+) prospective database examining purposeful heading from four area high schools over a 10-year period. The ANAM-2001 measured neurocognitive performance. Three methods were used to identify integral constructs underlying the ANAM: (a) exploratory factor analysis (EFA), (b) first-order confirmatory factor analysis (CFA), and (c) hierarchical CFA.

RESULTS

Neuropsychological phenomena measured by the ANAM-2001 were best reproduced by a hierarchical CFA organization, composed of two lower level factors (Simple Reaction Time, Mental Efficiency) and a single, general composite. Although the ANAM was multidimensional, only the composite was found to possess sufficient construct dimensionality and reliability for clinical score interpretation. Findings failed to uphold suppositions that the ANAM measures seven distinct constructs, or that any of its seven tests provide unique information independent of other constructs, or the composite, to support individual interpretation.

CONCLUSIONS

Outcomes infer the ANAM possesses factorial-validity evidence, but only scores from the composite appear to sufficiently internally valid, and reliable, to support applied use by practitioners.