1
|
Becker ABC, Maurer J, Daseking M, Pauls F. Measurement Invariance of the WISC-V across a Clinical Sample of Children and Adolescents with ADHD and a Matched Control Group. J Intell 2024; 12:6. [PMID: 38248904 PMCID: PMC10817318 DOI: 10.3390/jintelligence12010006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 12/05/2023] [Accepted: 12/14/2023] [Indexed: 01/23/2024] Open
Abstract
Measurement invariance of the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V) 10-primary subtest battery was analyzed across a group of children and adolescents with ADHD (n = 91) and a control group (n = 91) matched by sex, age, migration background, and parental education or type of school. First, confirmatory factor analyses (CFAs) were performed to establish the model fit for the WISC-V second-order five-factor model in each group. A sufficiently good fit of the model was found for the data in both groups. Subsequently, multigroup confirmatory factor analyses (MGCFAs) were conducted to test for measurement invariance across the ADHD and control group. Results of these analyses indicated configural and metric invariance but did not support full scalar invariance. However, after relaxing equality constraints on the Vocabulary (VC), Digit Span (DS), Coding (CD), Symbol Search (SS), and Picture Span (PS) subtest intercepts as well as on the intercepts of the first-order factors Working Memory (WM) and Processing Speed (PS), partial scalar invariance could be obtained. Furthermore, model-based reliability coefficients indicated that the WISC-V provides a more precise measurement of general intelligence (e.g., represented by the Full-Scale IQ, FSIQ) than it does for cognitive subdomains (e.g., represented by the WISC-V indexes). Group comparisons revealed that the ADHD group scored significantly lower than the control group on four primary subtests, thus achieving significantly lower scores on the corresponding primary indexes and the FSIQ. Given that measurement invariance across the ADHD and the control group could not be fully confirmed for the German WISC-V, clinical interpretations based on the WISC-V primary indexes are limited and should only be made with great caution regarding the cognitive profiles of children and adolescents with ADHD.
Collapse
Affiliation(s)
| | - Jenny Maurer
- Department of Developmental and Educational Psychology, Helmut Schmidt University, 22043 Hamburg, Germany; (J.M.); (M.D.)
| | - Monika Daseking
- Department of Developmental and Educational Psychology, Helmut Schmidt University, 22043 Hamburg, Germany; (J.M.); (M.D.)
| | - Franz Pauls
- Department of Clinical Psychology and Psychotherapy, Helmut Schmidt University, 22043 Hamburg, Germany;
| |
Collapse
|
2
|
Cheng ASM, To JQJ, Wahianuar NH, Chan YH, Mulay KV. Concurrent validity of intelligence assessments in children with developmental disabilities in an Asian setting: Comparison of the Kaufman brief intelligence test - Second edition with the Wechsler Intelligence Scales. Pediatr Neonatol 2023:S1875-9572(23)00211-5. [PMID: 37989607 DOI: 10.1016/j.pedneo.2023.07.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Revised: 06/21/2023] [Accepted: 07/18/2023] [Indexed: 11/23/2023] Open
Abstract
BACKGROUND This study was carried out to compare the concurrent validity of the Kaufman Brief Intelligence Test - Second Edition (KBIT-2) with that of two Wechsler Intelligence Scales (Wechsler Intelligence Scale for Children - Fifth Edition (WISC-V) and the Wechsler Preschool and Primary Scale of Intelligence - Fourth Edition (WPPSI-IV)) in an Asian setting. METHODS A retrospective study reviewed the medical records of 101 children with developmental disorders who were being followed up at a tertiary child development unit. Pearson product moment correlation coefficients were calculated between the KBIT-2 and Wechsler assessment scores. Simple regression analysis was used to calculate standard errors of estimation to assess the accuracy of predicting Wechsler scores using KBIT-2 scores. RESULTS A strong positive correlation was observed between KBIT-2's Intelligence Quotient (IQ) Composite and WISC-V's Full-Scale IQ (FSIQ) scores (r = 0.722, p < 0.01). KBIT-2 IQ composite scores showed a moderately strong positive correlation with WPPSI-IV FSIQ scores (r = 0.648, p < 0.01). Simple regression analysis showed that KBIT-2 scores tended to underestimate or overestimate the Wechsler scores, with the highest variability seen in KBIT-2's Non-Verbal IQ and Wechsler's Fluid Reasoning Index scores (error limits: -53.1 to 39.7). CONCLUSION Our study demonstrates that KBIT-2 has good concurrent validity when compared to other IQ tests such as the Wechsler scales, and it suggests that KBIT-2 is a good screening tool for assessing intelligence in a group of children with developmental disabilities. Further studies are needed to determine whether KBIT-2 can be used for the purpose of diagnostic decision-making or special education program placement.
Collapse
Affiliation(s)
- Alison S M Cheng
- Khoo Teck Puat - National University Children's Medical Institute, National University Hospital, National University Health System, Singapore
| | - Jolene Q J To
- Khoo Teck Puat - National University Children's Medical Institute, National University Hospital, National University Health System, Singapore
| | - Noor Hafizah Wahianuar
- Khoo Teck Puat - National University Children's Medical Institute, National University Hospital, National University Health System, Singapore
| | - Yiong Huak Chan
- Biostatistics Unit, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Kalyani Vijaykumar Mulay
- Khoo Teck Puat - National University Children's Medical Institute, National University Hospital, National University Health System, Singapore; Department of Paediatrics, Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
| |
Collapse
|
3
|
Rodríguez-Cancino M, Concha-Salgado A. WISC-V Measurement Invariance According to Sex and Age: Advancing the Understanding of Intergroup Differences in Cognitive Performance. J Intell 2023; 11:180. [PMID: 37754908 PMCID: PMC10532351 DOI: 10.3390/jintelligence11090180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Revised: 06/15/2023] [Accepted: 06/29/2023] [Indexed: 09/28/2023] Open
Abstract
This study sought to verify whether the constructs measured on the WISC-V are equivalent according to sex and age group in Chilean students to substantiate intergroup comparisons. For this, the measurement invariance of two variants of the five-factor intelligence model was explored with the ten primary subtests (hierarchical and oblique) using multigroup confirmatory factor analysis. Seven hundred and forty participants between 6 and 16 years of age from the Chilean standardization sample were assessed. The results show complete invariance according to sex, but incomplete according to the age group. The implications of these findings in both the professional area of psychology and future research are discussed.
Collapse
|
4
|
Arslan D, Sak U. Factorial Invariance of the Anadolu Sak Intelligence Scale Across Gender. JOURNAL OF PSYCHOEDUCATIONAL ASSESSMENT 2023. [DOI: 10.1177/07342829231158834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023]
Abstract
The purpose of this study was to examine the factorial invariance of the ASIS (Anadolu Sak Intelligence Scale) across gender. Raw scores from the ASIS standardization study ( N = 4641) were used in the analyses. Factorial invariance was analyzed by gender across three age groups: 4–7 ( N = 2528), 8–9 ( N = 848), and 10–12 ( N = 1265) using the Multisample Confirmatory Factor Analysis. Six models were developed from unconstrained to more constrained to test the factorial invariance. Each model tested one hypothesis. The findings showed that the second-order g model of the ASIS was invariant in all age groups. In addition, the first-order and second-order factor loadings and g variance were invariant across gender. A partial subtest intercept invariance was found for ages 4–7. Findings imply that ASIS factor scores mean the same latent variable for boys and girls in different age groups.
Collapse
Affiliation(s)
| | - Ugur Sak
- Anadolu University, Eskisehir, Turkiye
| |
Collapse
|
5
|
Egeland J, Andreassen T, Lund O. Factor structure of the new Scandinavian WISC-V version: Support for a five-factor model. Scand J Psychol 2021; 63:1-7. [PMID: 34752640 DOI: 10.1111/sjop.12780] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 08/24/2021] [Accepted: 08/29/2021] [Indexed: 01/17/2023]
Abstract
The fifth version of Wechsler Intelligence Scale for Children is designed to measure five distinct aspects of intelligence, incorporating a new fluid reasoning index to the four indexes of the previous fourth version. Several factor analyses, however, have failed to support the fifth factor. The Scandinavian version is the only national version not showing clear superiority for the five-factor solution in the Manual. In the present study, we analyze WISC-V protocols from a clinical sample of 237 children tested with the new Scandinavian version. We perform six confirmatory factor analyses (CFA) testing three hierarchical-, two bifactor-, and one correlated candidate factor models. The study shows that the three-factor model does not fit the data, and that all four- and five-factor models showed good fit. The four-factor bifactor model was somewhat better than the five-bifactor and hierarchical models, but the correlated five-factor model was the superior model. Finding support for five-factors in a clinical sample representative of those most probable to be tested with the test, strengthen the claim that also the Scandinavian version measure a distinct fluid factor as intended by the test owners, and thus that clinicians may use the index scores as their main level of analysis. Review of previous CFAs show that the choice of statistical methods for CFA, bifactor or hierarchical/correlated, influence whether second order factor models are better than g-factor models.
Collapse
Affiliation(s)
| | | | - Olaf Lund
- Vestfold Hospital Trust, Tonsberg, Norway
| |
Collapse
|
6
|
Bulut O, Cormier DC, Aquilina AM, Bulut HC. Age and Sex Invariance of the Woodcock-Johnson IV Tests of Cognitive Abilities: Evidence from Psychometric Network Modeling. J Intell 2021; 9:35. [PMID: 34287315 PMCID: PMC8293399 DOI: 10.3390/jintelligence9030035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Revised: 05/26/2021] [Accepted: 07/02/2021] [Indexed: 11/23/2022] Open
Abstract
The Woodcock-Johnson IV Tests of Cognitive Abilities (WJ IV COG) is a comprehensive assessment battery designed to assess broad and narrow cognitive abilities, as defined by the Cattell-Horn-Carroll (CHC) theory of intelligence. Previous studies examined the invariance of the WJ assessments across sex and age groups using factor analytic methods. Psychometric network modeling is an alternative methodology that can address both direct and indirect relationships among the observed variables. In this study, we employed psychometric network modeling to examine the invariance of the WJ IV COG across sex and age groups. Using a normative sample (n = 4212 participants) representative of the United States population, we tested the extent to which the factorial structure of the WJ IV COG aligned with CHC theory for the school-aged sample. Next, we used psychometric network modeling as a data-driven method to investigate whether the network structure of the WJ IV COG remains similar across different sex and age (age 6 to 19, inclusively) groups. Our results showed that the WJ IV COG maintained the same network structure across all age and sex groups, although the network structure at younger ages indicated weaker relationships among some subtests. Overall, the results provide construct validity evidence for the WJ IV COG, based on both theoretical and data-driven methods.
Collapse
Affiliation(s)
- Okan Bulut
- Centre for Research in Applied Measurement and Evaluation, University of Alberta, Edmonton, AB T6G 2G5, Canada;
| | - Damien C. Cormier
- Centre for Research in Applied Measurement and Evaluation, University of Alberta, Edmonton, AB T6G 2G5, Canada;
| | - Alexandra M. Aquilina
- Department of Educational Psychology, University of Alberta, Edmonton, AB T6G 2G5, Canada;
| | - Hatice C. Bulut
- Department of Educational Sciences, Cukurova University, Adana 01250, Turkey;
| |
Collapse
|
7
|
Dombrowski SC, Watkins MW, McGill RJ, Canivez GL, Holingue C, Pritchard AE, Jacobson LA. Measurement Invariance of the Wechsler Intelligence Scale for Children, Fifth Edition 10-Subtest Primary Battery: Can Index Scores be Compared across Age, Sex, and Diagnostic Groups? JOURNAL OF PSYCHOEDUCATIONAL ASSESSMENT 2020. [DOI: 10.1177/0734282920954583] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Measurement invariance of the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V) 10 subtest primary battery was evaluated across sex, age (6–8, 9–11, 12–14, and 15–16 year-olds), and three diagnostic (attention-deficit/hyperactivity disorder, anxiety, and encephalopathy) groups within a large clinical sample ( N = 5359) referred to a children’s specialty hospital. Competing models were tested using confirmatory factor analysis (CFA), and a five-factor oblique model corresponding to the publisher’s hypothesized first-order measurement model (e.g., verbal comprehension, fluid reasoning, visual-spatial, working memory, and processing speed) was found to have the best model fit. Multigroup CFA was subsequently used to evaluate progressively more restrictive constraints on the measurement model. Results indicated that full metric invariance was attained across the three groups studied. Full scalar invariance was attained for sex and diagnostic groups. Partial scalar invariance was attained for age-group. The results of this study provide support for the first-order scoring structure of the five WISC-V factors in the 10 subtest primary battery with this large clinical sample.
Collapse
Affiliation(s)
| | | | | | | | - Calliope Holingue
- Kennedy Krieger Institute, Johns Hopkins University School of Medicine, MD, USA
| | - Alison E. Pritchard
- Kennedy Krieger Institute, Johns Hopkins University School of Medicine, MD, USA
| | - Lisa A. Jacobson
- Kennedy Krieger Institute, Johns Hopkins University School of Medicine, MD, USA
| |
Collapse
|