1
|
Becker ABC, Maurer J, Daseking M, Pauls F. Measurement Invariance of the WISC-V across a Clinical Sample of Children and Adolescents with ADHD and a Matched Control Group. J Intell 2024; 12:6. [PMID: 38248904 PMCID: PMC10817318 DOI: 10.3390/jintelligence12010006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 12/05/2023] [Accepted: 12/14/2023] [Indexed: 01/23/2024] Open
Abstract
Measurement invariance of the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V) 10-primary subtest battery was analyzed across a group of children and adolescents with ADHD (n = 91) and a control group (n = 91) matched by sex, age, migration background, and parental education or type of school. First, confirmatory factor analyses (CFAs) were performed to establish the model fit for the WISC-V second-order five-factor model in each group. A sufficiently good fit of the model was found for the data in both groups. Subsequently, multigroup confirmatory factor analyses (MGCFAs) were conducted to test for measurement invariance across the ADHD and control group. Results of these analyses indicated configural and metric invariance but did not support full scalar invariance. However, after relaxing equality constraints on the Vocabulary (VC), Digit Span (DS), Coding (CD), Symbol Search (SS), and Picture Span (PS) subtest intercepts as well as on the intercepts of the first-order factors Working Memory (WM) and Processing Speed (PS), partial scalar invariance could be obtained. Furthermore, model-based reliability coefficients indicated that the WISC-V provides a more precise measurement of general intelligence (e.g., represented by the Full-Scale IQ, FSIQ) than it does for cognitive subdomains (e.g., represented by the WISC-V indexes). Group comparisons revealed that the ADHD group scored significantly lower than the control group on four primary subtests, thus achieving significantly lower scores on the corresponding primary indexes and the FSIQ. Given that measurement invariance across the ADHD and the control group could not be fully confirmed for the German WISC-V, clinical interpretations based on the WISC-V primary indexes are limited and should only be made with great caution regarding the cognitive profiles of children and adolescents with ADHD.
Collapse
Affiliation(s)
| | - Jenny Maurer
- Department of Developmental and Educational Psychology, Helmut Schmidt University, 22043 Hamburg, Germany; (J.M.); (M.D.)
| | - Monika Daseking
- Department of Developmental and Educational Psychology, Helmut Schmidt University, 22043 Hamburg, Germany; (J.M.); (M.D.)
| | - Franz Pauls
- Department of Clinical Psychology and Psychotherapy, Helmut Schmidt University, 22043 Hamburg, Germany;
| |
Collapse
|
2
|
Stephenson KG, Levine A, Russell NCC, Horack J, Butter EM. Measuring intelligence in Autism and ADHD: Measurement invariance of the-Binet 5th edition and impact of subtest scatter on abbreviated IQ accuracy. Autism Res 2023; 16:2350-2363. [PMID: 37767546 DOI: 10.1002/aur.3034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 09/08/2023] [Indexed: 09/29/2023]
Abstract
Scatter and heterogeneity in cognitive profiles is thought to be common in autism spectrum disorder (ASD), which may indicate differences in the construct of IQ. However, less research has investigated IQ scatter in attention-deficit/hyperactivity disorder (ADHD). Scatter is also thought to negatively impact the predictive validity of IQ summary scores, although there is research refuting this notion. Abbreviated IQ tests, such as the Stanford-Binet fifth edition (SB-5) abbreviated battery IQ (ABIQ), may be especially susceptible to the influence of scatter. We tested the measurement invariance of the SB-5 as well as the predictive validity of the ABIQ in predicting FSIQ in 1679 youth (21% female) ages 2-16 years with a clinical diagnosis of ASD or ADHD. Results indicated the SB-5 is measuring IQ the same way in ASD and ADHD. There were no differences between diagnostic groups in scatter between ABIQ (i.e., routing) subtests. Additionally, scatter was not related to dimensional autistic traits. Higher degree of scatter was associated with poorer predictive validity of the ABIQ and a higher likelihood of overestimating FSIQ, regardless of diagnosis. Overall, we found more similarities than differences between the ASD and ADHD groups. Our results show that the SB-5 ABIQ is generally a strong predictor of FSIQ in youth with neurodevelopmental disorders. However, the use of the SB-5 ABIQ in research and clinical applications, without consideration of scatter on routing subtests, is potentially problematic.
Collapse
Affiliation(s)
- Kevin G Stephenson
- Child Development Center, Department of Pediatrics, Nationwide Children's Hospital, Columbus, Ohio, USA
- Departments of Pediatrics and Psychology, The Ohio State University, Columbus, Ohio, USA
| | - Ann Levine
- Child Development Center, Department of Pediatrics, Nationwide Children's Hospital, Columbus, Ohio, USA
- Departments of Pediatrics and Psychology, The Ohio State University, Columbus, Ohio, USA
| | - Nicholas C C Russell
- Child Development Center, Department of Pediatrics, Nationwide Children's Hospital, Columbus, Ohio, USA
- Departments of Pediatrics and Psychology, The Ohio State University, Columbus, Ohio, USA
| | - John Horack
- Child Development Center, Department of Pediatrics, Nationwide Children's Hospital, Columbus, Ohio, USA
| | - Eric M Butter
- Child Development Center, Department of Pediatrics, Nationwide Children's Hospital, Columbus, Ohio, USA
- Departments of Pediatrics and Psychology, The Ohio State University, Columbus, Ohio, USA
| |
Collapse
|
3
|
Rodríguez-Cancino M, Concha-Salgado A. WISC-V Measurement Invariance According to Sex and Age: Advancing the Understanding of Intergroup Differences in Cognitive Performance. J Intell 2023; 11:180. [PMID: 37754908 PMCID: PMC10532351 DOI: 10.3390/jintelligence11090180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Revised: 06/15/2023] [Accepted: 06/29/2023] [Indexed: 09/28/2023] Open
Abstract
This study sought to verify whether the constructs measured on the WISC-V are equivalent according to sex and age group in Chilean students to substantiate intergroup comparisons. For this, the measurement invariance of two variants of the five-factor intelligence model was explored with the ten primary subtests (hierarchical and oblique) using multigroup confirmatory factor analysis. Seven hundred and forty participants between 6 and 16 years of age from the Chilean standardization sample were assessed. The results show complete invariance according to sex, but incomplete according to the age group. The implications of these findings in both the professional area of psychology and future research are discussed.
Collapse
|
4
|
Da Silveira TBN, Lopes HS. Intelligence across humans and machines: a joint perspective. Front Psychol 2023; 14:1209761. [PMID: 37663348 PMCID: PMC10470035 DOI: 10.3389/fpsyg.2023.1209761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 08/01/2023] [Indexed: 09/05/2023] Open
Abstract
This paper aims to address the divergences and contradictions in the definition of intelligence across different areas of knowledge, particularly in computational intelligence and psychology, where the concept is of significant interest. Despite the differences in motivation and approach, both fields have contributed to the rise of cognitive science. However, the lack of a standardized definition, empirical evidence, or measurement strategy for intelligence is a hindrance to cross-fertilization between these areas, particularly for semantic-based applications. This paper seeks to equalize the definitions of intelligence from the perspectives of computational intelligence and psychology, and offer an overview of the methods used to measure intelligence. We argue that there is no consensus for intelligence, and the term is interchangeably used with similar, opposed, or even contradictory definitions in many fields. This paper concludes with a summary of its central considerations and contributions, where we state intelligence is an agent's ability to process external and internal information to find an optimum adaptation (decision-making) to the environment according to its ontology and then decode this information as an output action.
Collapse
Affiliation(s)
- Tiago Buatim Nion Da Silveira
- Computational Intelligence Laboratory (LABIC), Federal University of Technology – Paraná, Curitiba, Brazil
- Polytechnic School, University of Vale do Itajaí, Itajaí, Brazil
| | - Heitor Silvério Lopes
- Computational Intelligence Laboratory (LABIC), Federal University of Technology – Paraná, Curitiba, Brazil
| |
Collapse
|
5
|
Wilson CJ, Bowden SC, Byrne LK, Joshua NR, Marx W, Weiss LG. The cross-cultural generalizability of cognitive ability measures: A systematic literature review. INTELLIGENCE 2023. [DOI: 10.1016/j.intell.2023.101751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
6
|
Giofrè D, Allen K, Toffalini E, Caviola S. The Impasse on Gender Differences in Intelligence: a Meta-Analysis on WISC Batteries. EDUCATIONAL PSYCHOLOGY REVIEW 2022. [DOI: 10.1007/s10648-022-09705-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
AbstractThis meta-analysis reviews 79 studies (N = 46,605) that examined the existence of gender difference on intelligence in school-aged children. To do so, we limited the literature search to works that assessed the construct of intelligence through the Wechsler Intelligence Scales for Children (WISC) batteries, evaluating eventual gender differences in indices and subtests. The theoretical framework we adopted is the cross-battery approach which locates cognitive abilities into different levels, also considering the possible mediating effect of the version of the WISC being used. As for broad abilities, a notable discrepancy emerged in favour of males for visual and crystallized intelligence, while female/male differences on fluid intelligence were negligible. Conversely, females’ performance on the processing speed factor was superior. Interesting results emerged at the subtest levels, albeit with less pronounced differences in performance. Results generally showed that older versions of WISC batteries displayed larger gender differences compared to the most recent ones.
Collapse
|
7
|
Examination of differential effects of cognitive abilities on reading and mathematics achievement across race and ethnicity: Evidence with the WJ IV. J Sch Psychol 2022; 93:1-27. [DOI: 10.1016/j.jsp.2022.05.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 03/28/2022] [Accepted: 05/30/2022] [Indexed: 11/24/2022]
|
8
|
Egeland J, Andreassen T, Lund O. Factor structure of the new Scandinavian WISC-V version: Support for a five-factor model. Scand J Psychol 2021; 63:1-7. [PMID: 34752640 DOI: 10.1111/sjop.12780] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 08/24/2021] [Accepted: 08/29/2021] [Indexed: 01/17/2023]
Abstract
The fifth version of Wechsler Intelligence Scale for Children is designed to measure five distinct aspects of intelligence, incorporating a new fluid reasoning index to the four indexes of the previous fourth version. Several factor analyses, however, have failed to support the fifth factor. The Scandinavian version is the only national version not showing clear superiority for the five-factor solution in the Manual. In the present study, we analyze WISC-V protocols from a clinical sample of 237 children tested with the new Scandinavian version. We perform six confirmatory factor analyses (CFA) testing three hierarchical-, two bifactor-, and one correlated candidate factor models. The study shows that the three-factor model does not fit the data, and that all four- and five-factor models showed good fit. The four-factor bifactor model was somewhat better than the five-bifactor and hierarchical models, but the correlated five-factor model was the superior model. Finding support for five-factors in a clinical sample representative of those most probable to be tested with the test, strengthen the claim that also the Scandinavian version measure a distinct fluid factor as intended by the test owners, and thus that clinicians may use the index scores as their main level of analysis. Review of previous CFAs show that the choice of statistical methods for CFA, bifactor or hierarchical/correlated, influence whether second order factor models are better than g-factor models.
Collapse
Affiliation(s)
| | | | - Olaf Lund
- Vestfold Hospital Trust, Tonsberg, Norway
| |
Collapse
|
9
|
Stephenson KG, Beck JS, South M, Norris M, Butter E. Validity of the WISC-V in Youth with Autism Spectrum Disorder: Factor Structure and Measurement Invariance. JOURNAL OF CLINICAL CHILD AND ADOLESCENT PSYCHOLOGY 2021; 50:669-681. [PMID: 33448884 DOI: 10.1080/15374416.2020.1846543] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Objective: Assessment of intellectual abilities in individuals with autism spectrum disorder (ASD) is a core component of a comprehensive diagnostic evaluation. However, relatively limited information is available regarding the validity of one of the most commonly-used measures of intelligence, the Wechsler Intelligence Scale for Children - 5th Edition (WISC-V) in ASD.Method: We investigated the factor structure and measurement invariance of the WISC-V in a sample of 349 children aged 6-16 diagnosed with ASD using single- and multi-group confirmatory factor analysis. The comparison group was the WISC-V standardization sample.Results: A four-index bifactor solution best fit the ASD group data. Measurement invariance analyses indicated support for configural and metric, but not scalar, invariance of the published 5-index structure, suggesting systematic differences in performance among some subscales in ASD. The 7-subtest FSIQ scale had partial scalar invariance after relaxing equality constraints on the Coding and Digit Span subtest intercepts, suggesting sources other than theorized IQ ability contribute to lower scores on these subtests within ASD. The Cognitive Proficiency Index (CPI) failed to demonstrate appropriate fit in baseline models. The General Ability Index (GAI) had full configural, metric, and scalar invariance.Conclusions: Statistical bias on the WISC-V within ASD in processing speed and working memory subtests creates significant limitations for the use of FSIQ and especially CPI index scores in ASD populations. The GAI showed strong measurement properties and should be considered as the preferred indicator of overall intellectual functioning when assessing children with ASD using the WISC-V.
Collapse
Affiliation(s)
- Kevin G Stephenson
- Child Development Center, Nationwide Children's Hospital.,Departments of Pediatrics and Psychology, The Ohio State University
| | - Jonathan S Beck
- Department of Psychiatry and Behavioral Sciences, Rush University Medical Center
| | - Mikle South
- Departments of Psychology and Neuroscience, Brigham Young University
| | - Megan Norris
- Child Development Center, Nationwide Children's Hospital.,Departments of Pediatrics and Psychology, The Ohio State University
| | - Eric Butter
- Child Development Center, Nationwide Children's Hospital.,Departments of Pediatrics and Psychology, The Ohio State University
| |
Collapse
|
10
|
Dombrowski SC, Watkins MW, McGill RJ, Canivez GL, Holingue C, Pritchard AE, Jacobson LA. Measurement Invariance of the Wechsler Intelligence Scale for Children, Fifth Edition 10-Subtest Primary Battery: Can Index Scores be Compared across Age, Sex, and Diagnostic Groups? JOURNAL OF PSYCHOEDUCATIONAL ASSESSMENT 2020. [DOI: 10.1177/0734282920954583] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Measurement invariance of the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V) 10 subtest primary battery was evaluated across sex, age (6–8, 9–11, 12–14, and 15–16 year-olds), and three diagnostic (attention-deficit/hyperactivity disorder, anxiety, and encephalopathy) groups within a large clinical sample ( N = 5359) referred to a children’s specialty hospital. Competing models were tested using confirmatory factor analysis (CFA), and a five-factor oblique model corresponding to the publisher’s hypothesized first-order measurement model (e.g., verbal comprehension, fluid reasoning, visual-spatial, working memory, and processing speed) was found to have the best model fit. Multigroup CFA was subsequently used to evaluate progressively more restrictive constraints on the measurement model. Results indicated that full metric invariance was attained across the three groups studied. Full scalar invariance was attained for sex and diagnostic groups. Partial scalar invariance was attained for age-group. The results of this study provide support for the first-order scoring structure of the five WISC-V factors in the 10 subtest primary battery with this large clinical sample.
Collapse
Affiliation(s)
| | | | | | | | - Calliope Holingue
- Kennedy Krieger Institute, Johns Hopkins University School of Medicine, MD, USA
| | - Alison E. Pritchard
- Kennedy Krieger Institute, Johns Hopkins University School of Medicine, MD, USA
| | - Lisa A. Jacobson
- Kennedy Krieger Institute, Johns Hopkins University School of Medicine, MD, USA
| |
Collapse
|
11
|
Fenollar-Cortés J, Watkins MW. Construct validity of the Spanish Version of the Wechsler Intelligence Scale for Children Fifth Edition (WISC-VSpain). ACTA ACUST UNITED AC 2018. [DOI: 10.1080/21683603.2017.1414006] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Affiliation(s)
| | - Marley W. Watkins
- Department of Educational Psychology, Baylor University, Waco, Texas, USA
| |
Collapse
|
12
|
Trundt KM, Keith TZ, Caemmerer JM, Smith LV. Testing for Construct Bias in the Differential Ability Scales, Second Edition: A Comparison Among African American, Asian, Hispanic, and Caucasian Children. JOURNAL OF PSYCHOEDUCATIONAL ASSESSMENT 2017. [DOI: 10.1177/0734282917698303] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Individually administered intelligence measures are commonly used in diagnostic work, but there is a continuing need for research investigating possible test bias among these measures. One current intelligence measure, the Differential Ability Scales, Second Edition (DAS-II), is a test with growing popularity. The issue of test bias, however, has not been thoroughly investigated with the DAS-II. The current study investigated whether the DAS-II demonstrates systematic construct bias when used with children from three racial and ethnic groups—African American, Asian, and Hispanic—when compared to non-Hispanic Caucasian children. Multi-group confirmatory factor analyses with data from the DAS-II standardization sample were used to assess whether the constructs and measurement of constructs were invariant across groups. Results indicate cross-group internal structure validity in the DAS-II, and thus a lack of construct bias. Minor differences were found, but these differences do not affect the calculation of composite scores on the DAS-II and thus would not result in unfair scoring for the groups involved. Results of this study support the appropriateness of the DAS-II for clinical use with these racial and ethnic groups.
Collapse
|