Construction and validation of an ecological version of the Wisconsin Card Sorting Test applied to an elderly population

Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument

OBJECTIVES

The main objectives of this study are to identify the dimensions of Ecological Validity (EV) within the definitions of this concept, understand how they are operationalized in neurocognitive tests, and propose a checklist for EV attributes in neurocognitive tests.

METHOD

A systematized review was combined with content analysis of the selected papers, using the inductive method. We analyzed 82 studies on the EV of neurocognitive tests, 19 literature reviews and 63 empirical studies. Based on this review, we identified the relevant criteria for evaluating EV.

RESULTS

EV is a multidimensional concept with two main dimensions: representativeness and generalization. Representativeness involves the subdimensions simplicity-complexity and artificial-natural and several criteria organized on a continuum from low EV to high EV. Generalization is dependent on representativeness and is influenced by different cognitive and non-cognitive factors. We propose six stages for operationalizing EV, from defining the objectives of the neurocognitive assessment to the methodology for scoring and interpreting the results.

CONCLUSION

This systematized review helps to operationalize the concept of EV by providing a tool for evaluating and improving EV while developing new tests. Further studies with a longitudinal design can compare the predictive value of tests with higher versus lower EV-checklist scores.Key pointsQuestion: Understand the definition of EV, its dimensions and subdimensions, how EV is operationalized in neurocognitive tests and propose a checklist for the EV attributes of neurocognitive tests.Findings: The primary findings were that representativeness and generalization are the main dimensions of EV. Representativeness involves several subdimensions, whereas generalization is dependent on representativeness and is influenced by cognitive and non-cognitive factors. We provided an EV-checklist organized into six parts.Importance: The EV-checklist can be used to guide the development of ecologically valid neurocognitive tests and/or assess the EV of existing ones.Next steps: Examine the predictive value of tests that have higher EV-checklist scores.

Assessing learning potential in elderly stroke patients: The validity of the dynamic Clock Drawing Task in comparison with the dynamic Wisconsin Card Sorting Test

Currently, there is no valid and feasible dynamic test available for assessing learning potential in elderly stroke patients. We designed a dynamic version of the Clock Drawing Task (dCDT) which we compared to the dynamic Wisconsin Card Sorting Test (dWCST). The dWCST has shown adequate validity in adult patients with brain injury but has a long administration time. Participants were 47 stroke patients admitted to a geriatric rehabilitation unit. All participants completed the dCDT, the mean administration time was 7 min. 90.7% of the participants were able to complete the dWCST, the mean administration time was 36 min. The numerical learning potential indices of the dCDT were not significantly correlated. Based on the dCDT, 70.2% of the participants were classified as high achiever, 10.6% as strong learner, 19.2% as poor learner, and none as decliner. The numerical learning potential indices of the dWCST correlated significantly. Based on the dWCST, 5.3% of the participants were classified as high achiever, 42.1% as strong learner, 50% as poor learner, and 2.6% as decliner. The learning potential indices of the dCDT and those of the dWCST were not significantly correlated, indicating poor convergent validity of the dCDT. The results provide no clear support for the use of the dCDT in elderly stroke patients. The dWCST does show adequate validity and feasibility in the elderly stroke population, despite longer administration time. Future research should focus on examining the validity of the dCDT in a larger sample as well as examining the predictive validity of the dWCST.

Assessment of Executive Function in Patients with Traumatic Brain Injury with the Wisconsin Card-Sorting Test

This review aimed at providing a brief and comprehensive summary of recent research regarding the use of the Wisconsin Card-Sorting Test (WCST) to assess executive function in patients with traumatic brain injury (TBI). A bibliographical search, performed in PubMed, Web of Science, Scopus, Cochrane Library, and PsycInfo, targeted publications from 2010 to 2020, in English or Spanish. Information regarding the studies’ designs, sample features and use of the WCST scores was recorded. An initial search eliciting 387 citations was reduced to 47 relevant papers. The highest proportion of publications came from the United States of America (34.0%) and included adult patients (95.7%). Observational designs were the most frequent (85.1%), the highest proportion being cross-sectional or case series studies. The average time after the occurrence of the TBI ranged from 4 to 62 years in single case studies, and from 6 weeks up to 23.5 years in the studies with more than one patient. Four studies compared groups of patients with TBI according to the severity (mild, moderate and/or severe), and in two cases, the studies compared TBI patients with healthy controls. Randomized control trials were seven in total. The noncomputerized WCST version including 128 cards was the most frequently used (78.7%). Characterization of the clinical profile of participants was the most frequent purpose (34.0%). The WCST is a common measure of executive function in patients with TBI. Although shorter and/or computerized versions are available, the original WCST with 128 cards is still used most often. The WCST is a useful tool for research and clinical purposes, yet a common practice is to report only one or a few of the possible scores, which prevents further valid comparisons across studies. Results might be useful to professionals in the clinical and research fields to guide them in assessment planning and proper interpretation of the WCST scores.

Age, education and gender effects on Wisconsin card sorting test: standardization, reliability and validity in healthy Argentinian adults

The Wisconsin Card Sorting Test (WCST) is a widely used neuropsychological assessment of executive functioning. The aim of this study was to provide norm values and analyze the psychometric properties of WCST in healthy Argentinian adults aged from 18 to 89 years old (N = 235). Descriptive statistics are reported as means, standard deviations and percentiles, with the effects of age, education and gender being investigated by ANOVA, and with the effect sizes being calculated. The psychometrics were studied using the WCST structure, reliability, convergent validity, and discriminant validity, and WCST norms adjusted for age and educational level are proposed. This instrument is a reliable and valid tool for the assessment of executive functions. However, as the age- and educational-related effects were demonstrated, these characteristics need to be considered before interpreting WCST scores. Regarding gender, no differences were found. Our results expand the geographical and sociocultural applicability of WCST.