1
|
Rodríguez-Cancino M, Concha-Salgado A. The Internal Structure of the WISC-V in Chile: Exploratory and Confirmatory Factor Analyses of the 15 Subtests. J Intell 2024; 12:105. [PMID: 39590632 PMCID: PMC11595532 DOI: 10.3390/jintelligence12110105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2024] [Revised: 10/03/2024] [Accepted: 10/24/2024] [Indexed: 11/28/2024] Open
Abstract
The WISC-V is a widely used scale in clinical and educational settings in Chile. Given that its use guides critical decision-making for children and adolescents, it is essential to have evidence of its psychometric properties, including validity based on internal structure. This study analyzed the factor structure of the WISC-V through an exploratory (EFA) and confirmatory (CFA) approach considering the age range of 853 children and adolescents between 6 and 16 years. We obtained evidence favoring the four-factor structure in the EFA, which is a clearer organization in the 15-16 age group. In the confirmatory stage, the best four- and five-factor models showed factor loadings greater than 0.4, except for one subtest in the processing speed domain in the 6-8 age group. The internal consistency ranged from acceptable to good estimates for the best two models. The results support the use of hierarchical factor structures of four and five factors, which offer specific advantages and disadvantages discussed in the article. The implications of these findings in both the professional area of psychology and future research are discussed.
Collapse
|
2
|
Rosario Nieves E, Rosenstein LD, González D, Bordes Edgar V, Jofre Zarate D, MacDonald Wer B. Is language translation enough in cross-cultural neuropsychological assessments of patients from Latin America? APPLIED NEUROPSYCHOLOGY. ADULT 2024:1-12. [PMID: 38984786 DOI: 10.1080/23279095.2024.2376829] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2024]
Abstract
OBJECTIVE The purpose of this review was to highlight the need to consider factors other than language when adapting tests across cultural groups and to offer a list of tests that have been adapted for use among patients from or descended from Latin American Countries. Despite efforts in the field through publications and workshops, the authors were aware of continued errors in cross-cultural assessment of these patients, resulting in misdiagnosis and unintentional inequitable care. Thus, we sought to reinforce the existing literature. METHOD We reviewed the literature pertaining to cross-cultural adaptation of neuropsychological measures. Relevant papers were identified by our institution's Academic Enhanced Search Option (AcESO) Database, PubMed, and Google Scholar. RESULTS 102 papers, articles, and other published literature were reviewed describing issues related to the adaptation of tests for groups originally from or descended from Latin American Countries residing in the United States. CONCLUSIONS It is imperative that tests be appropriately developed or adapted for the target population with appropriate normative data available, and ideally administered by a fluent speaker trained in assessment. Inappropriate use of tests not adapted for a particular patient's language and country of origin can result in misdiagnosis, potentially resulting in harm to the individual.
Collapse
Affiliation(s)
- Emmanuel Rosario Nieves
- Department of Psychiatry, UT Southwestern Medical Center; Dallas, Texas, USA
- Parkland Health and Hospital System Behavioral Health Clinic; Dallas, Texas, USA
| | - Leslie D Rosenstein
- Department of Psychiatry, UT Southwestern Medical Center; Dallas, Texas, USA
- Parkland Health and Hospital System Behavioral Health Clinic; Dallas, Texas, USA
| | - Deborah González
- Department of Psychiatry, UT Southwestern Medical Center; Dallas, Texas, USA
| | - Veronica Bordes Edgar
- Department of Psychiatry, UT Southwestern Medical Center; Dallas, Texas, USA
- Departments of Pediatrics, UT Southwestern Medical Center; Dallas, Texas, USA
- Developmental and Behavioral Pediatrics, Children's HealthDallas, Texas, USA
| | - Diego Jofre Zarate
- Department of Psychiatry, UT Southwestern Medical Center; Dallas, Texas, USA
| | - Beatriz MacDonald Wer
- Department of Psychiatry, UT Southwestern Medical Center; Dallas, Texas, USA
- Departments of Pediatrics, UT Southwestern Medical Center; Dallas, Texas, USA
- Developmental and Behavioral Pediatrics, Children's HealthDallas, Texas, USA
| |
Collapse
|
3
|
Rosenqvist J, Slama S, Haavisto A. Generalizability of the Swedish WISC-V to the Finland-Swedish minority - the FinSwed study. Child Neuropsychol 2024:1-27. [PMID: 38526303 DOI: 10.1080/09297049.2024.2331277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 03/11/2024] [Indexed: 03/26/2024]
Abstract
International guidelines highlight the importance of using appropriate and culturally fair test materials when conducting clinical psychological assessments. In the present study, the generalizability of the Swedish WISC-V with Scandinavian normative data was explored in 6-16-year-old Swedish-speaking children in Finland (N = 134), as no local test versions or norms are available for this minority. First, metric measurement invariance was established, i.e., the constructs measured were equivalent between the standardization data and the present sample. Second, the performance of this minority group on the Swedish WISC-V was compared to the Scandinavian normative mean. The findings showed that the Finland-Swedish children performed overall higher than the normative mean on the Swedish WISC-V, with an FSIQ of 103. The performance was significantly higher also in the indexes VSI, FRI, and WMI as well as in several subtests. However, in the subtest Vocabulary, the Finland-Swedish children achieved significantly lower scores than the Scandinavian mean. Further analyses showed significant associations between cognitive performance and age as well as parental education. For the VCI and the FSIQ, performance increased significantly with age, despite the use of age-standardized scaled scores. The general high performance was suggested to relate to the overall high educational level of the Finland-Swedes as well as to other cultural and test-related factors. The results have implications for clinicians conducting assessments with this minority, but also highlight the importance of establishing test fairness by validating tests when used in different cultural groups.
Collapse
Affiliation(s)
- Johanna Rosenqvist
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
- Division of Neuropsychology, HUS Neurocenter, Helsinki University Hospital and University of Helsinki, Helsinki, Finland
| | - Susanna Slama
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| | - Anu Haavisto
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
- Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden
- Faculty of Education and Welfare Studies, Åbo Akademi University, Vasa, Finland
| |
Collapse
|
4
|
Viñas-Guasch N, Chia PSQ, Yap MLM, Wu CY, Chen SHA. Cognitive pediatric tele-assessment: a scoping review. Front Psychol 2023; 14:1288021. [PMID: 38162979 PMCID: PMC10754967 DOI: 10.3389/fpsyg.2023.1288021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Accepted: 11/27/2023] [Indexed: 01/03/2024] Open
Abstract
Cognitive tele-assessment (CTA) adoption has increased considerably recently, in parallel with the maturation of the digital technologies that enable it, and the push to move assessment to the online format during the COVID-19 pandemic in 2019. This mode of assessment stems from remote assessment applications that originated in general tele-medicine, where it was typically used for patient screening as part of an intervention. The development of remote tele-medicine was later adapted for CTA in adult populations in tele-neuropsychiatry and tele-psychology and is increasingly applied in experimental research in cognitive science research with adult and pediatric populations, and for remote academic assessment. Compared to in-person assessment, CTA offers advantages such as decreasing time and logistic costs and facilitating the assessment of remote or special needs populations. However, given the novelty of CTA, its technical, methodological, and ethical issues remain poorly understood, especially in cases where methods for assessment of adults are used in pediatric populations. In the current paper, we provide a scoping review on the evolution of remote tele-assessment from the years 2000 to 2021, to identify its main themes, methodologies, and applications, and then focus on the issues of assessment in pediatric populations. Finally, we present recommendations on how to address the challenges previously mentioned.
Collapse
Affiliation(s)
- Nestor Viñas-Guasch
- Psychology, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Phoebe Si Qi Chia
- Psychology, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| | - Michelle Li-Mei Yap
- Centre for Research in Child Development, National Institute of Education, Nanyang Technological University, Singapore, Singapore
| | - Chiao-Yi Wu
- Centre for Research in Child Development, National Institute of Education, Nanyang Technological University, Singapore, Singapore
- Centre for Research and Development in Learning (CRADLE), Nanyang Technological University, Singapore, Singapore
| | - S. H. Annabel Chen
- Psychology, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
- Centre for Research and Development in Learning (CRADLE), Nanyang Technological University, Singapore, Singapore
- Lee Kong Chian School of Medicine (LKCMedicine), Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
5
|
Rodríguez-Cancino M, Concha-Salgado A. WISC-V Measurement Invariance According to Sex and Age: Advancing the Understanding of Intergroup Differences in Cognitive Performance. J Intell 2023; 11:180. [PMID: 37754908 PMCID: PMC10532351 DOI: 10.3390/jintelligence11090180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Revised: 06/15/2023] [Accepted: 06/29/2023] [Indexed: 09/28/2023] Open
Abstract
This study sought to verify whether the constructs measured on the WISC-V are equivalent according to sex and age group in Chilean students to substantiate intergroup comparisons. For this, the measurement invariance of two variants of the five-factor intelligence model was explored with the ten primary subtests (hierarchical and oblique) using multigroup confirmatory factor analysis. Seven hundred and forty participants between 6 and 16 years of age from the Chilean standardization sample were assessed. The results show complete invariance according to sex, but incomplete according to the age group. The implications of these findings in both the professional area of psychology and future research are discussed.
Collapse
|
6
|
Mulligan CA, Ayoub JL. Remote Assessment: Origins, Benefits, and Concerns. J Intell 2023; 11:114. [PMID: 37367516 DOI: 10.3390/jintelligence11060114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2023] [Revised: 06/07/2023] [Accepted: 06/07/2023] [Indexed: 06/28/2023] Open
Abstract
Although guidelines surrounding COVID-19 have relaxed and school-aged students are no longer required to wear masks and social distance in schools, we have become, as a nation and as a society, more comfortable working from home, learning online, and using technology as a platform to communicate ubiquitously across ecological environments. In the school psychology community, we have also become more familiar with assessing students virtually, but at what cost? While there is research suggesting score equivalency between virtual and in-person assessment, score equivalency alone is not sufficient to validate a measure or an adaptation thereof. Furthermore, the majority of psychological measures on the market are normed for in-person administration. In this paper, we will not only review the pitfalls of reliability and validity but will also unpack the ethics of remote assessment as an equitable practice.
Collapse
Affiliation(s)
- Christy A Mulligan
- Derner School of Psychology, Adelphi University, 1 South Avenue, Garden City, NY 11530, USA
| | - Justin L Ayoub
- Nassau BOCES, 71 Clinton Road P.O. Box 9195, Garden City, NY 11530, USA
| |
Collapse
|
7
|
Feldman SJ, Beslow LA, Felling RJ, Malone LA, Waak M, Fraser S, Bakeer N, Lee JEM, Sherman V, Howard MM, Cavanaugh BA, Westmacott R, Jordan LC. Consensus-Based Evaluation of Outcome Measures in Pediatric Stroke Care: A Toolkit. Pediatr Neurol 2023; 141:118-132. [PMID: 36812698 PMCID: PMC10042484 DOI: 10.1016/j.pediatrneurol.2023.01.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Revised: 01/08/2023] [Accepted: 01/16/2023] [Indexed: 01/20/2023]
Abstract
Following a pediatric stroke, outcome measures selected for monitoring functional recovery and development vary widely. We sought to develop a toolkit of outcome measures that are currently available to clinicians, possess strong psychometric properties, and are feasible for use within clinical settings. A multidisciplinary group of clinicians and scientists from the International Pediatric Stroke Organization comprehensively reviewed the quality of measures in multiple domains described in pediatric stroke populations including global performance, motor and cognitive function, language, quality of life, and behavior and adaptive functioning. The quality of each measure was evaluated using guidelines focused on responsiveness and sensitivity, reliability, validity, feasibility, and predictive utility. A total of 48 outcome measures were included and were rated by experts based on the available evidence within the literature supporting the strengths of their psychometric properties and practical use. Only three measures were found to be validated for use in pediatric stroke: the Pediatric Stroke Outcome Measure, the Pediatric Stroke Recurrence and Recovery Questionnaire, and the Pediatric Stroke Quality of Life Measure. However, multiple additional measures were deemed to have good psychometric properties and acceptable utility for assessing pediatric stroke outcomes. Strengths and weaknesses of commonly used measures including feasibility are highlighted to guide evidence-based and practicable outcome measure selection. Improving the coherence of outcome assessment will facilitate comparison of studies and enhance research and clinical care in children with stroke. Further work is urgently needed to close the gap and validate measures across all clinically significant domains in the pediatric stroke population.
Collapse
Affiliation(s)
- Samantha J Feldman
- Department of Psychology, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Lauren A Beslow
- Division of Neurology, Children's Hospital of Philadelphia, Departments of Neurology and Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Ryan J Felling
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Laura A Malone
- Johns Hopkins University School of Medicine and the Kennedy Krieger Institute, Baltimore, Maryland
| | - Michaela Waak
- Pediatric Critical Care Research Group, Child Health Research Centre, The University of Queensland, Queensland, Australia; Pediatric Intensive Care Unit, Queensland Children's Hospital, South Brisbane, Australia
| | - Stuart Fraser
- Division of Vascular Neurology, Department of Pediatrics, University of Texas Health Science Center, Houston, Texas
| | - Nihal Bakeer
- Indiana Hemophilia and Thrombosis Center, Indianapolis, Indiana
| | - Jo Ellen M Lee
- Department of Neurology, Nationwide Children's Hospital, Columbus, Ohio
| | | | - Melissa M Howard
- Casa Colina Hospital and Centers for Healthcare, Pomona, California
| | - Beth Anne Cavanaugh
- Division of Pediatric Neurology, Department of Pediatrics, University of Tennessee Health Science Center, Le Bonheur Children's Hospital, Memphis, Tennessee
| | - Robyn Westmacott
- Department of Psychology, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Lori C Jordan
- Division of Pediatric Neurology, Department of Pediatrics, Vanderbilt University Medical Center, Nashville, Tennessee.
| |
Collapse
|
8
|
Graves SL. Assessing Black intelligence: National and international perspectives on standardization sample appropriateness. SCHOOL PSYCHOLOGY INTERNATIONAL 2022. [DOI: 10.1177/01430343221146558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
9
|
Pauls F, Daseking M. Revisiting the Factor Structure of the German WISC-V for Clinical Interpretability: An Exploratory and Confirmatory Approach on the 10 Primary Subtests. Front Psychol 2021; 12:710929. [PMID: 34594275 PMCID: PMC8476749 DOI: 10.3389/fpsyg.2021.710929] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Accepted: 08/10/2021] [Indexed: 11/18/2022] Open
Abstract
With the exception of a recently published study and the analyses provided in the test manual, structural validity is mostly uninvestigated for the German version of the Wechsler Intelligence Scale for Children - Fifth Edition (WISC-V). Therefore, the main aim of the present study was to examine the latent structure of the 10 WISC-V primary subtests on a bifurcated extended population-representative German standardization sample (N=1,646) by conducting both exploratory (EFA; n=823) and confirmatory (CFA; n=823) factor analyses on the original data. Since no more than one salient subtest loading could be found on the Fluid Reasoning (FR) factor in EFA, results indicated a four-factor rather than a five-factor model solution when the extraction of more than two suggested factors was forced. Likewise, a bifactor model with four group factors was found to be slightly superior in CFA. Variance estimation from both EFA and CFA revealed that the general factor dominantly accounted for most of the subtest variance and construct reliability estimates further supported interpretability of the Full Scale Intelligence Quotient (FSIQ). In both EFA and CFA, most group factors explained rather small proportions of common subtest variance and produced low construct replicability estimates, suggesting that the WISC-V primary indexes were of lower interpretive value and should be evaluated with caution. Clinical interpretation should thus be primarily based on the FSIQ and include a comprehensive analysis of the cognitive profile derived from the WISC-V primary indexes rather than analyses of each single primary index.
Collapse
Affiliation(s)
- Franz Pauls
- Department of Clinical Psychology, Helmut-Schmidt-University/University of the Federal Armed Forces, Hamburg, Germany
| | - Monika Daseking
- Department of Educational Psychology, Helmut-Schmidt-University/University of the Federal Armed Forces, Hamburg, Germany
| |
Collapse
|
10
|
McGill RJ, Ward TJ, Canivez GL. On the validation of ability measures in school psychology: Do established psychometric standards matter? SCHOOL PSYCHOLOGY INTERNATIONAL 2021. [DOI: 10.1177/0143034320985209] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In this rejoinder, we address Kettler’s comments regarding our article for this special section regarding the validation practices employed with recently translated and adapted versions of the Wechsler Intelligence Scale for Children (WISC), which are used by school and educational psychologists in clinical practice around the world. Whereas we seek to briefly clarify points of minor contention, there is much that we agree on from the commentary. We reiterate the need to take seriously established psychometric standards in our discipline when validating commercial ability measures for the benefit of our ethical charges.
Collapse
Affiliation(s)
| | - Thomas J. Ward
- William & Mary School of Education, USA
- Eastern Illinois University, USA
| | | |
Collapse
|
11
|
Kettler RJ. Interpretation of the translated WISC-V: Caveat venditor and caveat emptor. SCHOOL PSYCHOLOGY INTERNATIONAL 2020. [DOI: 10.1177/0143034320942281] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The article is a commentary on Use of Translated and Adapted Versions of the WISC-V: Caveat Emptor. Per online instructions, it has no abstract.
Collapse
|