Cultural values underlying psychometric cognitive testing

Feasibility of an interpreter-mediated neuropsychological test battery for trauma-affected refugees

Background: Cognitive impairment in trauma-affected refugees is often unassessed due to the absence of suitable cross-cultural neuropsychological measures, the high prevalence of psychiatric symptoms, and the need for interpreter mediation. This poses both a clinical challenge and a health inequality for trauma-affected refugees who are left without access to much needed rehabilitation. Untreated cognitive impairment is likely to reduce the effectiveness of mental health interventions.Aim: To assess the operational and clinical feasibility of a neuropsychological test battery specifically developed for trauma-affected refugees from Syria.Method: A neuropsychological test battery was developed to assess executive function, mental speed, attention, and memory. The test battery was administered to 27 refugees from Syria recruited after being referred for specialized trauma treatment. Operational feasibility was assessed by examining completion time and completion rate. Clinical feasibility was assessed through performance validity rates, skewness, and floor effects.Results: The test battery included Supermarket Fluency, Color Trails Test, Symbol Digit Modalities Test, World Health Organization/University of California, Los Angeles - Auditory Verbal Learning Test, and Digit Span. The mean completion time was 54 min, with 62% of participants completing the full battery and 70% of all tests being completed. Concerning performance validity, 11% of the participants failed two performance validity tests, while 26% failed one. Tests scores were generally skewed, and one subtest, Color Trails 2, showed evidence of a floor effect.Conclusions: Despite high levels of cognitive impairment in trauma-affected refugee populations, to our knowledge, the feasibility of a neuropsychological test battery has not previously been established for this group. This study supports the operational and clinical feasibility of the proposed interpreter-mediated neuropsychological test battery to trauma-affected refugees, provided that additional time is allocated to complete tests with time limits. The study highlights the need for cross-cultural validation of neuropsychological tests in trauma-affected refugees.

Cross-Linguistic and Multicultural Effects on Animal Fluency Performance in Persons With Aphasia

PURPOSE

The current study examined the impact of cross-linguistic and cultural differences on an animal fluency task between Korean- and English-speaking persons with aphasia (PWA) and neurologically intact older adults (OAs). Specifically, we investigated the influence of zodiac animals on word retrieval, given their cultural familiarity in East Asia, hypothesizing that Korean speakers have a higher likelihood of producing zodiac animals compared to English speakers.

METHOD

Sixty-seven PWA (30 English-speaking, 37 Korean-speaking) and 30 OAs (15 per language group) completed an animal fluency task. Analyses focused on three approaches: total correct responses, culturally specific responses (zodiac animals and ratio of zodiac animals), and an item-level comparison of language-general and language-specific items to identify animal items that could differentiate between the language groups.

RESULTS

Korean speakers, both with and without aphasia, produced a greater proportion of zodiac animals compared to English speakers. Conversely, English speakers demonstrated greater semantic diversity in animal responses than Korean speakers.

CONCLUSIONS

Both PWA and OA groups demonstrated differential patterns in producing zodiac animals, depending on their language and the culture. These findings shed light on the importance of considering cultural and linguistic diversity during aphasia assessment of word retrieval difficulties.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.28942022.

Detection of clinical Alzheimer's disease in diverse populations: Contribution of a delayed recall to the TNI-93

Faced with increasing diversity in Europe, a large body of research in neuropsychology has emerged to develop tools for the reliable detection of cognitive disorders in diverse older adults. Following this perspective, few tools have been validated, particularly for assessing episodic memory, such as the Nine Images Test (TNI-93). The aim of the present study was to test the interest of adding a delayed recall to the classic TNI-93 procedure for the detection of clinical Alzheimer's disease (AD) in diverse populations. A French retrospective analysis was conducted based on the clinical and neuropsychological data of 281 patients (111 who received a clinical diagnosis of AD; 101 with a cognitive profile not suggestive of AD and 70 patients with a subjective cognitive decline). The sample was mostly composed of people with a low level of education and non-French speakers. The TNI-93 data from the neuropsychological assessment, including a free and a cued recall after a 20 min delay, were analysed. First, AD patients performed more poorly than both other groups on all scores. However, performance decreased more significantly after a 20 min delay in AD patients than in the other groups. Second, the Receiver-Operating-Characteristic analysis showed that the higher diagnostic accuracy for the detection of AD patients was obtained for the 20 min free recall. These results confirm the relevance of the TNI-93 for the clinical detection of AD in diverse populations. The added delayed recall condition seems relevant to highlight the accelerated forgetting of AD patients in a 20 min time window following learning.

Alzheimer disease seen through the lens of sex and gender

Alzheimer disease (AD) is a life-limiting neurodegenerative disorder that disproportionately affects women. Indeed, sex and gender are emerging as crucial modifiers of diagnostic and therapeutic pathways in AD. This Review provides an overview of the interactions of sex and gender with important developments in AD and offers insights into priorities for future research to facilitate the development and implementation of personalized approaches in the shifting paradigm of AD care. In particular, this Review focuses on the influence of sex and gender on important advances in the treatment and diagnosis of AD, including disease-modifying therapies, fluid-based biomarkers, cognitive assessment tools and multidomain lifestyle interventional studies.

Reliability and Optimal Cut-Off Points of the Test for Upper Limb Apraxia (TULIA) for Spanish-Speaking Post-Stroke Patients

OBJECTIVE

To evaluate the reliability, identify the optimal cut-off points, and determine the diagnostic accuracy of the TULIA Apraxia test in a sample of Spanish-speaking post-stroke patients.

DESIGN

Cross-sectional.

SETTING

Public primary care.

PARTICIPANTS

201 post-stroke patients.

MAIN MEASURES

Reliability was assessed using Cronbach's alpha. Cut-off points were identified for each TULIA Apraxia sub-test and stratified for age (≤65 years, > 65 years) using ROC curve analysis, area under the curve, and Youden index. Diagnostic accuracy was evaluated using sensitivity, specificity, and predictive values.

RESULTS

Cronbach's alpha of the sub-tests varied from 0.716 (95% CI 0.653-0.772) for pantomime intransitive to 0.824 (95% CI 0.784-0.858) for imitation non-symbolic. Cut-off points ranged from ≤25 to ≤35 points. For individuals aged ≤65 years, the cut-offs that best balanced sensitivity and specificity were ≤25 points for detecting alterations in imitation transitive and ≤33 points for pantomime non-symbolic. For individuals over 65 years, the imitation transitive cut-off (≤26 points) presented the most adjusted balance. The minimum positive predictive value was 0.667 (95% CI 0.542-0.777), indicating that the TULIA Apraxia tests correctly classified more than 67% of patients with apraxia. The minimum negative predictive value was 0.763 (95% CI 0.644-0.859), showing that the test accurately identified more than 76% of patients without apraxia.

CONCLUSIONS

The TULIA Apraxia test is reliable in Spanish-speaking post-stroke patients. Optimal cut-off points, along with their respective sensitivity and specificity values, exhibit adequate test accuracy. Predictive values indicate that the test correctly identifies individuals with and without apraxia.

Time-Based prospective memory predicts insight into functional abilities among community-dwelling older adults

OBJECTIVE

Accurate appraisal of one's own abilities (i.e., insight) is necessary for appropriate compensatory behaviors and sustained independence during aging. Although insight is often purported to be related to executive functioning (EF), nuanced understanding of the cognitive correlates of insight for functional abilities among nondemented older adults is lacking. Because insight shares neuroanatomic underpinnings with time-based prospective memory (PM), the present study examined the contributions of time-based PM, beyond event-based PM and other potential cognitive confounds (i.e., episodic memory, time estimation, and EF), in predicting insight into one's own performance on instrumental activities of daily living (IADLs) among community-dwelling older adults.

METHOD

A group of 88 nondemented, community-dwelling older adults completed performance-based measures of time- and event-based PM, episodic memory, time estimation, and EF, as well as IADL tasks followed by self-appraisals of their own IADL performance as indices of insight.

RESULTS

Time-based PM was moderately-to-strongly associated with insight, beyond event-based PM, time estimation, and episodic memory [F(1,83) = 11.58, p = .001, ηp2 = .122], as well as beyond EF and demographic covariates [F(1,79) = 10.72, p = .002, ηp2 = .119].Specifically, older adults who performed more poorly on a time-based PM task overestimated the efficiency of their own IADL performance to a greater extent.

CONCLUSIONS

Findings suggest that nondemented older adults with poorer time-based PM may be more prone to inaccurately appraising their functional abilities and that this vulnerability may not be adequately captured by traditional EF measures.

Socioeconomic Status and Childhood Executive Function: Differing Conceptualizations, Diverse Assessments, and Decontextualized Investigations

Developing the ability to regulate actions, thoughts, and emotions is necessary for successfully engaging in goal-directed activities, which form the essence of success in many life situations. In this regard, executive function (EF), as an aspect of these top-down control processes, has been the subject of inquiry in many developmental studies aiming to identify its link with various other aspects of a child's life, including family socioeconomic status (SES). This article presents a critical look at the association between family SES and childhood EF by reviewing studies that provide contrasting perspectives compared to the generally reported positive correlation between these two constructs. We first address the various aspects of assessing SES and childhood EF, emphasizing their multifaceted nature. Next, we discuss the interplays between different components of these two constructs, especially as it unfolds in various cultural contexts. Finally, we conclude by discussing mainly neglected lines of research that could further improve our understanding of the extent of socioeconomic impacts on child development, specifically regarding executive function. Considering these lines of research is a necessary step to a more accurate analysis of the link between socioeconomic factors and childhood executive function.

Cultural Considerations in Intelligence Test Adaptations: a Critical Review of the WAIS-IV India and Its U.K. and U.S. Counterparts

OBJECTIVE

This study critically examined the adaptation and normative processes of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV)India.

METHOD

WAIS-IV U.K. Edition Administration and Scoring Manual, WAIS-IVIndia Administration and Scoring Manual, and WAIS-IV Administration and Scoring Manual and Technical and Interpretive Manuals were used to extract test development and adaptation process data. The analyses were descriptive and qualitative.

RESULTS

A review of the manuals showed that the normative sample were fluent English speakers with high education levels, which is not representative of India's multilingual and educational diversity. The study identified minimal cultural and linguistic adaptations in subtests, which raised concern about potential biases in the test adaptation process across cultures. The lack of clarity in item selection, demographic data, sample selection, and psychometric properties raised questions about the test's reliability and validity. Issues related to education, age, gender, and regional distribution are discussed, emphasizing the test's limitations in capturing the diverse characteristics of the heterogeneous Indian population.

CONCLUSIONS

WAIS-IV India may not adequately represent India's population. More careful consideration of socioecological and psychometric factors when adapting intelligence (IQ) tests and use of advanced data harmonization methods can provide robust cross-national statistical harmonization in the future along with more ecologically valid local test development efforts. This can allow consideration of social determinants of health and other factors that can inform a more nuanced approach to IQ test development in non-western contexts.

Interpreter-mediated neuropsychological assessment: Clinical considerations and recommendations from the European Consortium on Cross-Cultural Neuropsychology (ECCroN)

OBJECTIVE

With increasing international migration, societies have become increasingly diverse worldwide. Although neuropsychological assessment is influenced by several diversity characteristics, language barriers have repeatedly been identified as one of the main challenges to cross-cultural neuropsychological assessment in migrant populations. Importantly, neuropsychologists are often required to conduct interpreter-mediated neuropsychological assessments without any graduate training or continuing education on the topic. To address this gap, the objective of this paper is to provide guidelines for interpreter-mediated neuropsychological assessment.

METHOD

A European Consortium on Cross-Cultural Neuropsychology (ECCroN) task force conducted a conceptual literature review and provided recommendations for good practice and working principles to inform the preparation and administration of interpreter-mediated assessments.

RESULTS

ECCroN takes the position that it is the responsibility of neuropsychologists, as well as the institutions or organizations that employ them, to ensure effective communication between themselves and their patients. This may be accomplished by preparing for an interpreter-mediated assessment by engaging an appropriate interpreter, which in most circumstances will be a professional in-person interpreter speaking the same language(s) or dialect(s) as the patient, and considering practical, language, and cross-cultural issues. During the assessment, reasonable steps should be taken to proactively manage the proceedings and adopt a communication style that facilitates effective patient-directed communication, and when interpreting test data and determining formulations and diagnoses, the limitations of interpreter-mediated assessment should be carefully considered.

CONCLUSION

Adhering to the provided recommendations and working principles may help neuropsychologists provide competent interpreter-mediated neuropsychological assessments to linguistically diverse patients.

Severe Cognitive Impairment in Trauma-Affected Refugees-Exploring the Impact of Traumatic Brain Injury

Background/Objectives: This study explores the relationship between cognitive performance measured by the Symbol Digit Modality Test (SDMT) and the severity of self-reported head injury, traumatic brain injury (TBI), post-traumatic stress disorder (PTSD), depression, pain, and psychosocial dysfunction in a population of trauma-affected refugees. Refugees, especially those who have been subjected to torture, often face various difficulties, such as PTSD, depression and somatic disturbances (e.g., pain), which can significantly impact their day-to-day functioning. Methods: Participants included 141 adult refugees (38% women) with a mean age of 45.4 years (SD = 9.4) and 9.7 years (SD = 4.9) of education who were referred for treatment of post-traumatic distress to DIGNITY, Danish Institute Against Torture. Participants completed standardized self-report measures of PTSD, anxiety, depression, pain, and health-related disability and measures of trauma history, physical injuries including head injury and loss of consciousness, and the SDMT, a quick standardized performance-based measure of cognitive impairment. Results: Eighty-eight percent of participants evidenced signs of substantial cognitive impairment as indexed by lower SDMT scores. Those with a self-reported history of TBI, marked by loss of consciousness, exhibited lower SDMT scores and higher health-related disabilities. Severity of PTSD, depression, anxiety, and pain were highly correlated with lower SDMT scores. TBI history was not significantly associated with the severity of PTSD, depression, anxiety, or pain, suggesting a complex interplay among these factors. Conclusions: Cognitive impairments are prevalent in trauma-affected refugees, interacting with symptoms of post-traumatic stress and pain, likely explaining the high disability levels in this population. Further research should employ a broader range of cognitive measures and detailed investigations of head injury/TBI experiences to investigate their impact on overall functioning, treatment response, and longer-term outcomes. This study adds to a small but growing body of studies documenting cognitive impairments in trauma-affected refugees, highlighting the importance of addressing cognitive impairments in treatment for trauma-affected refugees, particularly those with histories of torture and TBI. Clinicians working with trauma-affected refugees should consider the assessment of cognitive difficulties as part of comprehensive care planning.

Children's color trails test: Greek normative data and clinical validity in children with traumatic brain injury and attention deficit - Hyperactivity disorder

The Children's Color Trail Test (CCTT) is considered a culture fair equivalent of the Trail Making Test for the assessment of cognitive flexibility in pediatric populations, while others emphasize its additional validity as a measure of attention, perceptual tracking, processing speed, susceptibility to interference and inhibition. The need for standardized neuropsychological tests in Greece, especially for the pediatric population is significant. In the present study, considering the relatively good psychometric properties of the CCTT and its wide cross-cultural application, we decided that such a tool would be useful to Greek clinicians and researchers, and therefore developed norms for the Greek child and adolescent population. Additionally, we examined the clinical validity of the test, administering it to two groups of patients (children with Traumatic Brain Injury and Attention Deficit - Hyperactivity Disorder). We administered the test to 417 native healthy Greek children 6-15 years, recruited primarily from Southwestern Greece from several public schools. Linear regression analysis revealed a significant influence of age on completion time in both parts of the CCTT, whereas sex did not influence time to completion. Older children consistently completed the test faster than younger children, whereas girls and boys performed similarly on both conditions. In addition, CCTT differentiated the performance of children who have had a TBI and those diagnosed with ADHD from the performances of their typically developing peers. This study provides much needed performance and clinical utility data for the pediatric population in Greece on a promising neuropsychological tool for use in clinical and research settings.

Neuropsychological application of the International Test Commission Guidelines for Translation and Adapting of Tests

OBJECTIVE

The number of test translations and adaptations has risen exponentially over the last two decades, and these processes are now becoming a common practice. The International Test Commission (ITC) Guidelines for Translating and Adapting Tests (Second Edition, 2017) offer principles and practices to ensure the quality of translated and adapted tests. However, they are not specific to the cognitive processes examined with clinical neuropsychological measures. The aim of this publication is to provide a specialized set of recommendations for guiding neuropsychological test translation and adaptation procedures.

METHODS

The International Neuropsychological Society's Cultural Neuropsychology Special Interest Group established a working group tasked with extending the ITC guidelines to offer specialized recommendations for translating/adapting neuropsychological tests. The neuropsychological application of the ITC guidelines was formulated by authors representing over ten nations, drawing upon literature concerning neuropsychological test translation, adaptation, and development, as well as their own expertise and consulting colleagues experienced in this field.

RESULTS

A summary of neuropsychological-specific commentary regarding the ITC test translation and adaptation guidelines is presented. Additionally, examples of applying these recommendations across a broad range of criteria are provided to aid test developers in attaining valid and reliable outcomes.

CONCLUSIONS

Establishing specific neuropsychological test translation and adaptation guidelines is critical to ensure that such processes produce reliable and valid psychometric measures. Given the rapid global growth experienced in neuropsychology over the last two decades, the recommendations may assist researchers and practitioners in carrying out such endeavors.

Robust reference group normative data for neuropsychological tests accounting for primary language use in Asian American older adults

OBJECTIVE

The present study aimed to develop neuropsychological norms for older Asian Americans with English as a primary or secondary language, using data from the National Alzheimer's Coordinating Center (NACC).

METHOD

A normative sample of Asian American participants was derived from the NACC database using robust criteria: participants were cognitively unimpaired at baseline (i.e., no MCI or dementia) and remained cognitively unimpaired at 1-year follow-up. Clinical and demographic characteristics were compared between Primary and Secondary English speakers using analyses of variance for continuous measures and chi-square tests for categorical variables. Linear regression models compared neuropsychological performance between the groups, adjusting for demographics (age, sex, and education). Regression models were developed for clinical application to compute demographically adjusted z-scores.

RESULTS

Secondary English speakers were younger than Primary English speakers (p < .001). There were significant differences between the groups on measures of mental status (Mini-Mental State Examination, p = .002), attention (Trail Making Test A, Digit Span Forward Total Score, p <.001), language (Boston Naming Test, Animal Fluency, Vegetable Fluency, p < .001), and executive function (Trail Making Test B, p = .02).

CONCLUSIONS

Separate normative data are needed for Primary vs. Secondary English speakers from Asian American backgrounds. We provide normative data on older Asian Americans to enable clinicians to account for English use in the interpretation of neuropsychological assessment scores.

Contextualizing Positionality, Intersectionality, and Intelligence in the Anthropocene

The geological epoch of the Anthropocene has challenged traditional definitions of what intellectual abilities are necessary to creatively problem-solve, understand, and address contemporary societal and environmental crises. If we hope to make meaningful changes to how our society addresses these complex issues and pave the way for a better future for generations to come, we must advance traditional theories and measures of higher-order abilities to reflect equity and inclusion. To this end, we must address global issues by integrating the complexities of intersectional identities as they impact our understanding of what constitutes intelligence in individuals, groups, and diverse communities. This re-envisioning of intelligence presents new complexities for understanding and challenges for our field beyond the boundaries of what has been previously touted by many disciplines, including psychology. It is an opportunity to re-envision what it means to be intelligent in a diverse global context while also honoring and recognizing the value of difference, positionality, and other ways of knowing.

Principles for Adapting Assessments of Executive Function across Cultural Contexts

Direct assessments of executive functions (EFs) are increasingly used in research and clinical settings, with a central assumption that they assess "universal" underlying skills. Their use is spreading globally, raising questions about the cultural appropriateness of assessments devised in Western industrialized countries. We selectively reviewed multidisciplinary evidence and theory to identify sets of cultural preferences that may be at odds with the implicit assumptions of EF assessments. These preferences relate to motivation and compliance; cultural expectations for interpersonal engagement; contextualized vs. academic thinking; cultural notions of speed and time; the willingness to be silly, be incorrect, or do the opposite; and subject-matter familiarity. In each case, we discuss how the cultural preference may be incompatible with the assumptions of assessments, and how future research and practice can address the issue. Many of the cultural preferences discussed differ between interdependent and independent cultures and between schooled and unschooled populations. Adapting testing protocols to these cultural preferences in different contexts will be important for expanding our scientific understanding of EF from the narrow slice of the human population that has participated in the research to date.

Multivariate word properties in fluency tasks reveal markers of Alzheimer's dementia

INTRODUCTION

Verbal fluency tasks are common in Alzheimer's disease (AD) assessments. Yet, standard valid response counts fail to reveal disease-specific semantic memory patterns. Here, we leveraged automated word-property analysis to capture neurocognitive markers of AD vis-à-vis behavioral variant frontotemporal dementia (bvFTD).

METHODS

Patients and healthy controls completed two fluency tasks. We counted valid responses and computed each word's frequency, granularity, neighborhood, length, familiarity, and imageability. These features were used for group-level discrimination, patient-level identification, and correlations with executive and neural (magnetic resonanance imaging [MRI], functional MRI [fMRI], electroencephalography [EEG]) patterns.

RESULTS

Valid responses revealed deficits in both disorders. Conversely, frequency, granularity, and neighborhood yielded robust group- and subject-level discrimination only in AD, also predicting executive outcomes. Disease-specific cortical thickness patterns were predicted by frequency in both disorders. Default-mode and salience network hypoconnectivity, and EEG beta hypoconnectivity, were predicted by frequency and granularity only in AD.

DISCUSSION

Word-property analysis of fluency can boost AD characterization and diagnosis.

HIGHLIGHTS

We report novel word-property analyses of verbal fluency in AD and bvFTD. Standard valid response counts captured deficits and brain patterns in both groups. Specific word properties (e.g., frequency, granularity) were altered only in AD. Such properties predicted cognitive and neural (MRI, fMRI, EEG) patterns in AD. Word-property analysis of fluency can boost AD characterization and diagnosis.

Exploring How Sociocultural Factors Affect the Experience of Completing Neuropsychological Assessments Within Older Greek-Australians

OBJECTIVE

The field of cultural neuropsychology has grown exponentially over the last three decades. With a limited culturally informed evidence base to guide neuropsychological practice, the acceptability of existing paradigms has been called into question when applied to culturally diverse and educationally disadvantaged groups. This qualitative study aimed to explore the experiences of Greek Australian older adults who underwent a cognitive assessment to better understand potential barriers and facilitators to engagement and to improve neuropsychological assessment outcomes.

METHOD

Semi-structured interviews were developed to explore cultural attitudes and contextual factors relating to neuropsychological assessment. Interviews were conducted by Greek-speaking neuropsychologists using a sample of 10 healthy elderly Greek Australians following the completion of a comprehensive neuropsychological assessment. Data were analyzed using a phenomenological design within a critical realist framework.

RESULTS

Analysis revealed the emergence of three broad themes: sociocultural factors, experiences within the broader medical system, and the assessment experience. Engagement with cognitive assessment was influenced by several factors, including rapport building, understanding of the assessment, and use of inappropriate tests. Furthermore, level and quality of education, sex differences, language barriers, acculturation, previous experiences of prejudice, anxiety, and a preference for Greek-speaking clinicians were additional factors reported to affect the client experience and validity of assessment outcomes.

CONCLUSION

Neuropsychological assessment is, in part, affected by culturally reinforced attitudes. Failing to adjust the relationship between the clinician and client, test environment, style of communication, and the use of culturally inappropriate tests is likely to affect the validity of assessment outcomes.

A Systematic Review of Normative Data for Verbal Fluency Test in Different Languages

Verbal fluency tests are easy and quick to use in neuropsychological assessments, so they have been counted among the most classical tools in this context. To date, several normative data for verbal fluency tests have been provided in different languages and countries. A systematic review was carried out with studies that provide normative data for verbal fluency tests. Studies were collected from Scopus, PubMed and Web of Science. 183 studies were retrieved from the database search, of which 73 finally met the inclusion criteria. An analysis of the risk of bias regarding samples selection/characterization and procedure/results reports is conducted for each article. Finally, a full description of the normative data characteristics, considering country and language, verbal fluency task characteristics (type of task) and sample characteristics (number of subjects, gender, age, education) is included. The current systematic review provides an overview and analysis of internationally published normative data that might help clinicians in their search for valid and useful norms on verbal fluency tasks, as well as updated information about qualitative aspects of the different options currently available.

Know thyself: Executive functioning and sex predict self-appraisal of functional abilities in community-dwelling older adults

Objective: The capacity for accurate self-appraisals of age-related changes in cognitive and functional abilities is integral to the maintenance of independence in later life, yet there is little understanding of the factors that place nondemented older adults at risk for poor self-awareness. This study examined the potential contributions of executive functioning (EF), crystallized intelligence (IQ-Cr), and sex in predicting congruence between performance and self-appraisals of instrumental activities of daily living (IADL) in a group of community-dwelling older adults. Method: A group of 150 nondemented, community-dwelling older adults (White and majority highly educated) completed measures of EF and IQ-Cr. Participants also completed five timed IADL tasks and self-appraised their performance relative to others of similar age. Results: Sex [F(1,148)  =  7.75, p = .006, ηp2 = .05] and EF [(F(1,147) = 5.30, p = .02, ηp2 = .04)], but not IQ-Cr, predicted the relationship between performance and self-appraisals, such that those with lower EF and those of male sex overestimated their performance more than those with higher EF and females. Conclusions: Findings indicate that having average to below average EF abilities and being of male sex are risk factors for less accurate self-report of IADL abilities and as such might represent important considerations when assessing IADL abilities via self-report among largely independent, community-dwelling older adults.

Reliable Digit Span Scores Among Latin American Monolingual Spanish Speakers

OBJECTIVE

The Reliable Digit Span (RDS) is an embedded measure used to assess performance validity. The purpose of this study was to determine whether the RDS can be used with Spanish speakers from Latin America.

METHOD

The Digit Span subtest of the Wechsler Adult Intelligence Scale-IV was administered to 66 Spanish-speaking patients, 66 English-speaking patients, and 30 Spanish-speaking normal controls. The Spanish-speaking patients had a mean age of 65.82 (standard deviation [SD] = 12.44) and mean education of 6.62 years (SD = 4.91), whereas the controls had a mean age of 48.27 (SD = 10.97) and mean education of 8.33 (SD = 3.04). The English-speaking patients had a mean age of 56.44 (SD = 13.53) and mean education of 12.14 (SD = 2.37).

RESULTS

The average RDS among the Spanish-speaking patients was 5.36 (SD = 1.27) and the average RDS among the controls was 5.90 (SD = 1.06). The mean RDS of the English-speaking patients was 7.83 (SD = 1.72). The modal RDS among Spanish-speaking patients was 5. The modal RDS among Spanish-speaking controls was also 5, though the distribution was bimodal in nature with nearly as many 7 s as 5 s. The modal RDS among the English-speaking patients was 7. Among patients with ≥9 years of education and controlling for age, there remained a significant difference between both language patient groups on the RDS (F(1, 79) = 30.85, p < .0001).

CONCLUSIONS

These data suggest that the RDS may not be a valuable measure in assessing performance validity among monolingual Spanish speakers from Latin America, particularly among those with low levels of education.

Use of the Spanish English Neuropsychological Assessment Scale in older adult Latines and those at risk for autosomal dominant Alzheimer's disease

OBJECTIVE

The Spanish English Neuropsychological Assessment Scale (SENAS) is a cognitive battery with English and Spanish versions for use with persons for whom either language is predominant. Few studies have examined its utility outside the normative sample. The current study examined SENAS performance in samples of older adult Latines and Latines with or at risk for autosomal dominant Alzheimer's disease (ADAD) mutations.

METHOD

The SENAS was administered to 202 older adults from the Los Angeles Latino Eye Study (LALES) and 29 adults with (carriers) or without (non-carriers) mutations causing ADAD. We examined associations between SENAS, age, education, and language (LALES) and between SENAS, estimated years from familial age of dementia diagnosis, education, language, and acculturation (ADAD). Partial correlations were used to examine differences in correlational strength between estimated years from familial age of dementia diagnosis and SENAS scores among ADAD carriers compared to chronological age and SENAS in the LALES sample. Exploratory t-tests were performed to examine SENAS performance differences between ADAD carriers and non-carriers.

RESULTS

In an older adult sample (LALES), increased age correlated with worse verbal delayed recall; English fluency and higher education correlated with better naming and visuospatial subtest performance. Among ADAD carriers, verbal and nonverbal delayed recall and object naming subtest performance worsened as they approached their familial age of dementia diagnosis. English fluency and higher U.S.-acculturation were related to better SENAS performance among carriers and non-carriers. Tests of verbal delayed recall and object naming best distinguished ADAD carriers from their familial non-carrier counterparts.

CONCLUSIONS

Verbal delayed recall and object naming measures appear to be most sensitive to age-related changes in older adult samples and mutation-related changes in distinguishing ADAD carriers from non-carriers. Future research should examine the sensitivity of SENAS in other samples, such as larger samples of symptomatic ADAD carriers and other AD subtypes.

Processing speed test: Results from a Japanese normative sample of healthy participants compared with a US normative sample

BACKGROUND

The Processing Speed Test (PST), a validated iPad®-based cognitive screening test for MS, has been applied to the cognitive assessment of Japanese MS patients using US normative data.

METHODS

To develop PST normative data from Japanese healthy volunteers and compare the PST score distribution between Japanese and US healthy volunteers, 254 healthy Japanese-speaking volunteers were enrolled and stratified by age (20-65 years). Potential participants with a Mini-Mental State Examination score < 27 were excluded. PST raw scores (total correct) were from the Japan cohort and compared with age-restricted US normative data and propensity score-matched data created by matching sex, age, and educational level from a published study of 428 healthy participants. PST score distributions and standardized z-scores were compared using t-test and Kolmogorov-Smirnov test statistics.

RESULTS

The mean age of the Japan cohort was 44.1 years. The PST scores of Japanese volunteers were significantly different from those of the age-restricted (mean ± SD 61.8 ± 10.1 vs 53.7 ± 10.8; p < 0.001) and the propensity score-matched US cohort (62.1 ± 10.1 vs 53.3 ± 10.6; p < 0.001).

CONCLUSION

Regression analyses centered on US normative data could underestimate disease severity in Japanese MS patients, suggesting that separate normative data should be considered for each population sample.

Best Practices and Methodological Strategies for Addressing Generalizability in Neuropsychological Assessment

Generalizability considerations are widely discussed and a core foundation for understanding when and why treatment effects will replicate across sample demographics. However, guidelines on assessing and reporting generalizability-related factors differ across fields and are inconsistently applied. This paper synthesizes obstacles and best practices to apply recent work on measurement and sample diversity. We present a brief history of how knowledge in psychology has been constructed, with implications for who has been historically prioritized in research. We then review how generalizability remains a contemporary threat to neuropsychological assessment and outline best practices for researchers and clinical neuropsychologists. In doing so, we provide concrete tools to evaluate whether a given assessment is generalizable across populations and assist researchers in effectively testing and reporting treatment differences across sample demographics.

Comparing online and face-to-face administration of a neuropsychological computerized attention test: Assessment modality does not influence performance

Background

The cognitive impairment associated with the COVID-19 pandemic highlighted the need for teleneuropsychology (1). Moreover, neurologic diseases associated with mental deterioration usually require the use of the same neuropsychological instrument to assess cognitive changes across time. Therefore, in such cases, a learning effect upon retesting is not desired. Attention and its subdomains can be measured using Go/no-go tests, such as, the Continuous Visual Attention Test (CVAT). Here, we administered the CVAT to investigate the effect of modality (online vs. face-to-face) on attentional performance. The variables of the CVAT measures four attention domains: focused-attention, behavioral-inhibition, intrinsic-alertness (reaction time, RT), and sustained-attention (intra-individual variability of RTs, VRT).

Methods

The CVAT was applied face-to face and online in 130 adult Americans and 50 adult Brazilians. Three different study designs were used: (1) Between-subjects design: healthy Americans were tested face-to-face (n = 88) or online (n = 42). We verified if there were any differences between the two modalities. (2) Within-subjects design: Brazilians participants (n = 50) were tested twice (online and face-to-face). For each CVAT variable, repeated measures ANCOVAs were performed to verify whether modality or first vs. second tests differ. Agreement was analyzed using Kappa, intraclass correlation coefficients, and Bland-Altman plots. (3) Paired comparisons: we compared Americans vs. Brazilians, pairing subjects by age, sex, and level of education, grouping by modality.

Results

Assessment modality did not influence performance using two independent samples (between-subjects design) or the same individual tested twice (within-subjects design). The second test and the first test did not differ. Data indicated significant agreements for the VRT variable. Based on paired samples, Americans did not differ from Brazilians and a significant agreement was found for the VRT variable.

Conclusion

The CVAT can be administered online or face-to-face without learning upon retesting. The data on agreement (online vs. face-to-face, test vs. retest, Americans vs. Brazilians) indicate that VRT is the most reliable variable.

Limitations

High educational level of the participants and absence of a perfect balanced within-subjects design.

Cognitive assessment of literacy learning difficulties in adult non- or low-literate second language learners

The population of non- or low-literate adult immigrants studying a new language is large and growing in many countries. The aim of this study was to develop and validate a new instrument for the assessment of cognitive impairment that may hinder literacy learning in adult non- or low-literate L2 learners, the Cognitive Assessment of Literacy Learning Difficulties (CALL), in a language center setting. This was a case-control study in which the CALL was validated in adult non- or low-literate students, or students who were not literate in the Latin alphabet, in nine Danish language centers. Educator classification of students with very slow progression in learning basic Danish literacy was used as a benchmark for literacy learning difficulties. Classification was further based on the number of lessons participants had required to pass tests during Danish language program levels. An acceptable discriminative validity (AUC 0.76; specificity 0.94, sensitivity 0.64) for literacy learning difficulties (n = 32) versus schooling and sex matched control participants (n = 28) was found. In comparison, years of formal schooling had an AUC of 0.58. Age had a small effect on the ability of the CALL to predict literacy learning difficulties (OR = 1.097, p = 0.013), whereas sex and years of schooling did not. CALL was found to be a valid instrument for identification of cognitive impairment that may hinder literacy learning in adult non- or low-literate L2 learners in a Danish language center setting.

Illiteracy, Neuropsychological Assessment, and Cognitive Rehabilitation: A Narrative Review

OBJECT

Νeuropsychological assessment is particularly important for the accurate discrimination of cognitive abilities and weaknesses of patients in order to determine the appropriate therapeutic intervention. However, the reliability and validity of neuropsychological assessment appears to be influenced by a wide range of factors, including literacy and educational level.

AIM

This systematic review evaluates neuropsychological tests appropriate for the valid assessment of illiterate individuals and the effectiveness of cognitive rehabilitation programs for illiterate and/or low-educated individuals according to the results of English language studies that have been published in the PubMed/Medline electronic database until August 2022 (no initiation date).

RESULTS

49 studies were included for neuropsychological assessment and 4 studies for cognitive rehabilitation. In terms of investigating the validity and reliability of neuropsychological tests for the assessment of healthy illiterate individuals, most studies concluded that for the majority of neuropsychological tests there is a significant difference in performance between healthy illiterate and literate individuals. However, there was consensus among studies that the performance of illiterate subjects was equivalent to the performance of literate subjects on tasks depicting colored and real objects. Regarding cognitive rehabilitation programs, all four studies concluded that they are effective in improving the cognitive functions of illiterate and/or low-literate patients with mild cognitive impairment and/or mild dementia.

CONCLUSIONS

For the assessment of illiterate individuals, it is imperative that neuropsychological tests with high ecological validity (i.e., tests related to activities of daily living) be administered so as not to underestimate their cognitive functioning. At the same time, cognitive enhancement/stimulation programs seem to be effective in this population group; however, this area needs further investigation.

Normative Data in Cross-Cultural Neuropsychological Instruments in Spaniards and Colombians Living in Spain

BACKGROUND

Cross-Cultural Dementia Screening (CCD), Rowland Universal Dementia Assessment Scale (RUDAS), and European Cross-cultural Neuropsychological Test Battery (CNTB) are three novel neuropsychological instruments developed from a cross-cultural perspective to reduce the impact of culture in cognitive assessment and improve the assessment in diverse populations.

OBJECTIVE

We aimed to collect and present normative data on these tests in a majority population sample (Spaniards living in Spain) and in a minority population sample (Colombians living in Spain).

METHODS

CCD, RUDAS, and CNTB were administered to a group of 300 cognitively healthy participants (150 Spaniards and 150 Colombians). Linear regression modeling strategy was used to provide adjusted norms for demographic factors and to explore the influence of these factors on test performance.

RESULTS

Most of the CCD and CNTB scores were predicted by age and years of education, with some tests only predicted by age or showing a ceiling effect. The comparison of normative data between the two samples confirmed the favorable cross-cultural properties of these instruments, with only some differences in processing speed and executive functioning scores.

CONCLUSIONS

Our study finds a comparable influence of demographic factors in both populations on the performance of CCD, RUDAS, and CNTB, confirming their adequate cross-cultural properties. We provide normative data for these tests in Spaniards and Colombians living in Spain.

Validation of a digit symbol substitution test for use in supervised and unsupervised assessment in mild Alzheimer's disease

INTRODUCTION

The Digit-Symbol-Substitution Test (DSST) is used widely in neuropsychological investigations of Alzheimer's Disease (AD). A computerized version of this paradigm, the DSST-Meds, utilizes medicine-date pairings and has been developed for administration in both supervised and unsupervised environments. This study determined the utility and validity of the DSST-Meds for measuring cognitive dysfunction in early AD.

METHOD

Performance on the DSST-Meds was compared to performance on the WAIS Coding test, and a computerized digit symbol coding test (DSST-Symbols). The first study compared supervised performance on the three DSSTs versions in cognitively unimpaired (CU) adults (n = 104). The second compared supervised DSST performance between CU (n = 60) and mild-symptomatic AD (mild-AD, n = 79) groups. The third study compared performance on the DSST-Meds between unsupervised (n= 621) and supervised settings.

RESULTS

In Study 1, DSST-Meds accuracy showed high correlations with the DSST-Symbols accuracy (r = 0.81) and WAIS-Coding accuracy (r = 0.68). In Study 2, when compared to CU adults, the mild-AD group showed lower accuracy on all three DSSTs (Cohen's d ranging between 1.39 and 2.56) and DSST-Meds accuracy was correlated moderately with Mini-Mental State Examination scores (r = 0.44, p < .001). Study 3 observed no difference in DSST-meds accuracy between supervised and unsupervised administrations.

CONCLUSION

The DSST-Meds showed good construct and criterion validity when used in both supervised and unsupervised contexts and provided a strong foundation to investigate the utility of the DSST in groups with low familiarity to neuropsychological assessment.

Executive Function Touch battery: Translation and preliminary measure validation for Pakistani preschoolers

Keeping in mind the importance of measuring early executive function (EF) skills in low and middle-income countries, the present study examined the feasibility and preliminary psychometric properties of a performance-based computerized EF measure; EF Touch, to be used with Pakistani preschoolers. Review of the content and Urdu translation of verbal instruction EF Touch battery was carried out by subject matter experts before data collection from the 120 preschoolers aged between 3.1 to 5.9 years. The feasibility report indicated that between 79.2% -100% of the preschoolers completed each executive function task. Confirmatory factor analysis revealed the unidimensionality of the EF battery. Item response theory models were used for the initial assessment of tasks and item parameters. Results demonstrated that each task worked invariantly across subgroups of preschoolers residing in low and middle-income households. Moreover, preschoolers showed differences on each task, and task scores reflect their latent EF skills in the low to moderate range. The battery was demonstrated as a feasible and reliable measure for use with low and middle-income countries specifically in Pakistan.

Impairment in Working Memory and Executive Function Associated with Mercury Exposure in Indigenous Populations in Upper Amazonian Peru

The Matsigenka people living traditional lifestyles in remote areas of the Amazon rely on a fish-based diet that exposes them to methylmercury (MeHg) at levels that have been associated with decreased IQ scores. In this study, the association between Hg levels and working memory was explored using the framework of the Multicomponent Model. Working memory tasks were modified to fit the culture and language of the Matsigenka when needed and included measures for verbal storage (Word Span) visuospatial storage (Corsi Block Task) and a measure of executive functions, the Self-Ordered Pointing Task (SOPT). An innovation of the Trail Making Tests A & B (TMT A & B) was pilot tested as another potential measure of executive functions. The mean hair Hg levels of 30 participants, ages 12 to 55 years, from three different communities (Maizal, Cacaotal and Yomibato) was 7.0 ppm (sd = 2.40), well above the World Health Organization (WHO) limit for hair of 2.0 ppm and ranged from 1.8 to 14.2 ppm, with 98% of a broader sample of 152 individuals exceeding the WHO limit. Hair Hg levels showed significant associations with cognitive performance, but the degree varied in magnitude according to the type of task. Hg levels were negatively associated with executive functioning performance (SOPT errors), while Hg levels and years of education predicted visuospatial performance (Corsi Block accuracy). Education was the only predictor of Word Span accuracy. The results show that Hg exposure is negatively associated with working memory performance when there is an increased reliance on executive functioning. Based on our findings and the review of the experimental research, we suggest that the SOPT and the Corsi Block have the potential to be alternatives to general intelligence tests when studying remote groups with extensive cultural differences.

Assessment of aphasia: dialectal and cultural considerations in neurology

INTRODUCTION

In the context of neurological disorders, language assessment is traditionally based on the use of the standard language of the community in which the assessment is performed. Dialectal variables constitute a 'forgotten' topic. This review aims to provide resources and working guidelines to overcome this limitation.

DEVELOPMENT

The study was conducted as follows: 1) review of basic concepts of dialectology (language, dialect, isogloss line, idiolect, register, 'standard variant', bilingualism); 2) characterisation of Spanish and Catalan dialectologies and search for online resources for the development of neurological assessment tools; 3) ad hoc search on the PubMed database (keywords 'dialect', 'aphasia' and 'multilingual').

CONCLUSIONS

We provide online resources to promote adequate development of assessment tools in Spanish and Catalan, accounting for Dialectal considerations. We propose a set of working guidelines for the introduction of Dialectal variables in language tests to ensure their ultimate objective: to evaluate the real use of the language, and not cultural knowledge of the standard language.

Comparison of WPPSI-IV and WISC-V cognitive profiles in 6-7-year-old Finland-Swedish children - findings from the FinSwed study

The Wechsler scales are among the most widely used tests in cognitive and neuropsychological assessments. When assessing children aged 6:0-7:7 years the clinician can choose between Wechsler Preschool and Primary Scale of Intelligence - Fourth Edition (WPPSI-IV) and Wechsler Intelligence Scale for Children - Fifth Edition (WISC-V). Information about how the tests function and differ in this overlapping age range is limited. Using a between-subjects design, the present study compared the cognitive profiles of typically developing Swedish-speaking children in Finland in this overlapping age range (6:1 - 7:2 years), assessed with the Swedish versions of either WPPSI-IV (n = 38) or WISC-V (n = 24). Profile analyses and one-way ANCOVA were performed to investigate differences in the comparable subtests, indexes and Full Scale IQ. On the subtest level, children assessed with WISC-V had significantly lower scores on the subtests Vocabulary, Matrix Reasoning, and Bug/Symbol Search compared to children assessed with WPPSI-IV. On the index level, scores for the Verbal Comprehension Index and the Fluid Reasoning Index were significantly lower for children assessed with WISC-V. The Full Scale IQ was significantly lower on WISC-V. Taken together, the findings indicate that WPPSI-IV and WISC-V produce partly different cognitive profiles. These differences are important to recognize when choosing which test to use and when interpreting the results of clinical assessments of children in this age group.

Diagnostic Accuracy of the Swedish Version of the Rowland Universal Dementia Assessment Scale (RUDAS-S) for Multicultural Cognitive Screening in Swedish Memory Clinics

Background:

The number of people with a migration background and dementia is increasing in Europe. All patients with suspected dementia have the right to an appropriate cognitive assessment and correct diagnosis for optimal treatment and support. Rowland Universal Dementia Assessment Scale (RUDAS) cognitive screening instrument is less affected by language, culture, and educational background, and adapted for use in multicultural populations.

Objective:

To compare the diagnostic accuracy of RUDAS-S to the Swedish version of Mini-Mental State Examination (MMSE-SR) for detecting dementia in a multicultural group of outpatients in Swedish memory clinics.

Methods:

We tested 123 outpatients (36 nonnative Swedish), in 4 memory clinics in Southern Sweden with RUDAS-S to supplement the usual cognitive assessment.

Results:

RUDAS-S had moderate to good diagnostic performance for detecting dementia in a multicultural population in Sweden, with an area under the receiver operating characteristic curve (AUC) of 0.81. At a cutoff score <25 its sensitivity was 0.92, specificity 0.60, and accuracy 76%. The AUC for the MMSE-SR was 0.79. At a cutoff score <23 its sensitivity was 0.65, specificity 0.81, and accuracy 73%.

Conclusion:

RUDAS-S is at least as accurate as MMSE-SR for detecting dementia in memory clinics in Sweden and can be used for all patients undergoing a cognitive assessment, irrespective of their cultural, language, and educational background. However, there is a need for other cross-cultural cognitive tests to complement RUDAS-S to extend cognitive examination.

Cultural factors related to neuropsychological performance and brain atrophy among Hispanic older adults with amnestic Mild Cognitive Impairment (aMCI): A pilot study

OBJECTIVES

This study examined the association of cultural factors and literacy to neuropsychological performance and measures of regional brain atrophy among Hispanic elders diagnosed with amnestic Mild Cognitive Impairment (aMCI).

METHOD

Acculturation and literacy levels were measured among 45 subjects tested in Spanish; their primary language. Scores for measures of memory, executive functioning, and verbal fluency, as well as volumetric analysis of MRI scans of left hemisphere structures commonly affected by Alzheimer's disease (AD) were examined. Linear regression models were employed to examine the association of acculturation and literacy to neuropsychological performance and MRI measures.

RESULTS

After controlling for age, higher literacy levels were associated with better performance on phonemic verbal fluency (r = 0.300, p < .05), while higher levels of acculturation to the U.S. was associated with poorer performance on category verbal fluency (r = 0.300, p < .05). There was a significant inverse relationship after controlling for age between literacy and the left entorhinal cortex (r = -0.455, p < .05), left precuneus (r = -0.457, p < .05), and left posterior cingulate (r = -0.415, p < .05).

CONCLUSIONS

Results of the current pilot study indicate that high acculturation to the U.S. among aMCI immigrants from Latin-American countries may hinder performance on verbal learning measures when they are administered in one's primary language. Moreover, in this cohort, a higher literacy level, which is indicative of greater cognitive reserve, was associated with better performance in language measures, but with greater atrophy in brain regions susceptible to neurodegenerative disease. These preliminary findings should be further examined among larger cohorts and using more diverse measures, which capture other cultural constructs.

He Tūhononga Whaiaro: A Kaupapa Māori Approach to Mate Wareware (Dementia) and Cognitive Assessment of Older Māori

AIM

The aim of this study is to investigate Māori (Indigenous peoples of Aotearoa New Zealand) understandings of dementia (mate wareware) and develop a framework to inform assessment of cognitive impairment.

METHOD

Qualitative, kaupapa Māori (Māori approach) research with 241 older Māori (kaumātua) involving 17 focus groups across Aotearoa New Zealand (NZ) and eight families (whānau) from one region. We thematically analyzed transcribed data from audio-recorded interviews.

RESULTS

Two overarching themes, namely, connection (Tūhononga) and self (Whaiaro), and eight subthemes in particular mind (hinengaro), spirit (wairua), body (tinana), family (whānau), social connection (whanaungatanga), identity and role (tuakiri), place (wāhi), and ancestors (tūpuna) emerged. Māori language (Te Reo Māori) was important for cognitive health.

CONCLUSION

The findings embedded in cultural values improve understanding of dementia (mate wareware) in Māori. These themes can inform the assessment of older Māori with cognitive impairment. For those without cognitive impairment, the Tūhononga Whaiaro framework suggests factors potentially crucial for healthy aging in Māori.

Translation and Cultural Adaptation of NIH Toolbox Cognitive Tests into Swahili and Dholuo Languages for Use in Children in Western Kenya

OBJECTIVES

Performing high-quality and reliable cognitive testing requires significant resources and training. As a result, large-scale studies involving cognitive testing are difficult to perform in low- and middle-income settings, limiting access to critical knowledge to improve academic achievement and economic production in these populations. The NIH Toolbox® is a collection of cognitive, motor, sensory, and emotional tests that can be administered and scored using an iPad® tablet, reducing the need for training and quality monitoring; and thus, it is a potential solution to this problem.

METHODS

We describe our process for translation and cultural adaptation of the existing NIH Toolbox tests of fluid cognition into the Swahili and Dholuo languages for use in children aged 3-14 years in western Kenya. Through serial forward and back translations, cognitive interviews, group consensus, outside feedback, and support from the NIH Toolbox team, we produced translated tests that have both face validity and linguistic validation.

RESULTS

During our cognitive interviews, we found that the five chosen tests (one each of attention, cognitive flexibility, working memory, episodic memory, and processing speed) were generally well understood by children aged 7-14 years in our chosen populations. The cognitive interviews informed alterations in translation as well as slight changes in some images to culturally adapt the tests.

CONCLUSIONS

This study describes the process by which we translated five fluid cognition tests from the NIH Toolbox into the Swahili and Dholuo languages. The finished testing application will be available for future studies, including a pilot study for assessment of psychometric properties.

Examination of the validity of the 'Papadum test': an alternative to the clock drawing test for people with low levels of education

Objectives: The clock drawing test (CDT) is a widely used cognitive screening test. However, CDT performance is affected by education. This study examined an alternative, the Papadum test, designed for people with low levels of education/literacy. The association between education and test performance, correlation between CDT and Papadum test, and diagnostic accuracy of both CDT and Papadum tests were examined. Method: 89 healthy literate adults and 59 literate adults (all Bengali speaking) with a diagnosis of mild-moderate dementia from hospitals in Kolkata, India undertook the CDT and the Papadum test. Results: Education had a significant association with the CDT but not with the Papadum test. Across the whole sample there was a significant correlation between CDT and Papadum, but not within separate groups of healthy controls and patients. Diagnostic accuracy for the Papadum test was similar to that for CDT. Conclusions: Results highlight the strong influence that education has on CDT performance indicating that it is not suitable for those with low levels of literacy. The Papadum test could provide a viable alternative as a screening tool to the CDT for use with people who are illiterate or have low levels of education. Further validation studies are required.

“I Know Hyena. Do you Know Hyena?” Challenges in Interpreter-Mediated Dementia Assessment, Focusing on the Role of the Interpreter

Dementia assessment requires functional communication and interaction between healthcare professionals and the patient being assessed. These can be affected by the requirement for an interpreter to communicate with the patient. The purpose of this study was to elucidate the interactions between patient, healthcare professionals and interpreter, focusing on the role of the interpreter and the challenges that may arise in interpreter-mediated dementia assessment. The study had an ethnographic design in which the data consisted of audio and video recordings of 19 dementia assessments conducted in the presence of an interpreter. The data were analyzed using the constant comparative method. The results showed that the interpreter could affect the patient’s performance and results during the dementia assessment. The interpreter could alter the meaning and content of what was communicated, sometimes change information and instructions exchanged between the patient and healthcare professionals, could avoid interpreting everything being said, and occasionally made their own corrections to what was being communicated. This occurred mainly because of the interpreter’s lack of linguistic skills and the interpreter failing to adhere to the ethical guidelines governing their profession. These challenges could also occur when the interpreter was not familiar with the context of dementia assessment. Alterations made by the interpreter to what was being communicated could lead to incorrect evaluation of the patient’s cognitive abilities and health status. This, in turn, may lead to misjudgment of the patient’s remaining resources and symptoms and their required treatment and support.

Assessing cognition in people with severe mental disorders in low- and middle-income countries: a systematic review of assessment measures

BACKGROUND

Cognitive difficulties are common in people with severe mental disorders (SMDs) and various measures of cognition are of proven validity. However, there is a lack of systematic evidence regarding the psychometric properties of these measures in low- and middle-income countries (LMICs).

OBJECTIVE

To systematically review the psychometric properties of cognitive measures validated in people with SMDs in LMICs.

METHODS

We conducted a systematic review of the literature by searching from four electronic databases. Two authors independently screened studies for their eligibility. Measurement properties of measures in all included studies were extracted. All eligible measures were assessed against criteria set for clinical and research recommendations. Results are summarized narratively and measures were grouped by measurement type and population.

RESULTS

We identified 23 unique measures from 28 studies. None of these was from low-income settings. Seventeen of the measures were performance-based. The majority (n = 16/23) of the measures were validated in people with schizophrenia. The most commonly reported measurement properties were: known group, convergent, and divergent validity (n = 25/28). For most psychometric property, studies of methodological qualities were found to be doubtful. Among measures evaluated in people with schizophrenia, Brief Assessment of Cognition in Schizophrenia, Cognitive Assessment Interview, MATRICS Consensus Cognitive Battery, and CogState Schizophrenia Battery were with the highest scores for clinical and research recommendation.

CONCLUSIONS

Studies included in our review provide only limited quality evidence and future studies should consider adapting and validating measures using stronger designs and methods. Nonetheless, validated assessments of cognition could help in the management and allocating therapy in people with SMDs in LMICs.

Cross-cultural differences in visuo-spatial processing and the culture-fairness of visuo-spatial intelligence tests: an integrative review and a model for matrices tasks

Visuo-spatial reasoning tests, such as Raven's matrices, Cattell's culture-fair test, or various subtests of the Wechsler scales, are frequently used to estimate intelligence scores in the context of inter-racial comparisons. This has led to several high-profile works claiming that certain ethnic groups have lower intelligence than others, presumably due to genetic inferiority. This logic is predicated on the assumption that such visuo-spatial tests, because they are non-verbal, must be culture-fair: that their solution process does not significantly draw on factors that vary from one culture to the next. This assumption of culture-fairness is dubious at best and has been questioned by many authors. In this article, I review the substantial body of psychological and ethnographic literature which has demonstrated that the perception, manipulation and conceptualization of visuo-spatial information differs significantly across cultures, in a way that is relevant to intelligence tests. I then outline a model of how these inter-cultural differences can affect seven major steps of the solution process for Raven's matrices, with a brief discussion of other visuo-spatial reasoning tests. Overall, a number of cultural assumptions appear to be deeply ingrained in all visuo-spatial reasoning tests, to the extent that it disqualifies the view of such tests as intrinsically culture-fair and makes it impossible to draw clear-cut conclusions from average score differences between ethnic groups.

A New Remote Guided Method for Supervised Web-Based Cognitive Testing to Ensure High-Quality Data: Development and Usability Study

BACKGROUND

The global COVID-19 pandemic has triggered a fundamental reexamination of how human psychological research can be conducted safely and robustly in a new era of digital working and physical distancing. Online web-based testing has risen to the forefront as a promising solution for the rapid mass collection of cognitive data without requiring human contact. However, a long-standing debate exists over the data quality and validity of web-based studies. This study examines the opportunities and challenges afforded by the societal shift toward web-based testing and highlights an urgent need to establish a standard data quality assurance framework for online studies.

OBJECTIVE

This study aims to develop and validate a new supervised online testing methodology, remote guided testing (RGT).

METHODS

A total of 85 healthy young adults were tested on 10 cognitive tasks assessing executive functioning (flexibility, memory, and inhibition) and learning. Tasks were administered either face-to-face in the laboratory (n=41) or online using remote guided testing (n=44) and delivered using identical web-based platforms (Cambridge Neuropsychological Test Automated Battery, Inquisit, and i-ABC). Data quality was assessed using detailed trial-level measures (missed trials, outlying and excluded responses, and response times) and overall task performance measures.

RESULTS

The results indicated that, across all data quality and performance measures, RGT data was statistically-equivalent to in-person data collected in the lab (P>.40 for all comparisons). Moreover, RGT participants out-performed the lab group on measured verbal intelligence (P<.001), which could reflect test environment differences, including possible effects of mask-wearing on communication.

CONCLUSIONS

These data suggest that the RGT methodology could help ameliorate concerns regarding online data quality-particularly for studies involving high-risk or rare cohorts-and offer an alternative for collecting high-quality human cognitive data without requiring in-person physical attendance.

Normative Data for Verbal Fluency, Trail Making, and Rey-Osterrieth Complex Figure Tests on Monolingual Spanish-Speaking Older Adults

OBJECTIVE

This study aimed to generate updated normative data for commonly used tests in neuropsychological assessment applied to older monolingual Spanish-speaking adults: Verbal fluency tests, the Trail Making Test (TMT), and the Rey-Osterrieth complex figure test (ROCF).

METHOD

To obtain normative data, 382 cognitively healthy 60- to 90-year-old Spanish monolingual participants from the Autonomous Community of Madrid (Spain) with 0-22 years education were assessed using an overlapping interval strategy that involved cell and midpoint techniques, and that assessed the influence of age, education, and sex.

RESULTS

Age and education were associated with the scores in the verbal fluency tests, TMT, and ROCF, whereas sex only significantly affected the TMT results. Age-adjusted scaled scores (SSA) based on percentile ranks were also converted into age-education scaled scores (SSAE) using a linear regression model. In addition, tables with the relevant adjustments for sex are provided for TMT-A and TMT-B.

CONCLUSIONS

Thus, this study provides updated, uniform normative data for widely used neuropsychological tests on older Spanish adults. The normative procedure followed helps to make consistent comparisons when using these neuropsychological tests, which will improve the interpretation of the data obtained when these tools are employed, reducing the risk of misdiagnosing cognitive impairment in older adults.

Cognitive Assessment in Culturally, Linguistically, and Educationally Diverse Older Populations in Europe

Due to increasing cultural, linguistic, and educational diversity in older populations across Europe, accurate assessment of cognitive functioning in people from diverse backgrounds becomes increasingly important. This paper aims to provide a state-of-the-art review of cognitive assessment in culturally, linguistically, and educationally diverse older populations in Europe, focusing on challenges and recent advances in cross-cultural assessment. Significant work has been carried out on the identification of challenges in cognitive assessment in culturally, linguistically, and educationally diverse older populations and on development and validation of cross-cultural cognitive tests. Most research has addressed the influences of language barriers, education and literacy, and culture and acculturation and in particular, the European Cross-Cultural Neuropsychological Test Battery (CNTB) and the Rowland Universal Dementia Assessment Scale (RUDAS) are well-validated across European countries. However, cross-cultural cognitive assessment is largely still a developing field in Europe, and there is a continuing need for developments within the field.

Culture, Ethnicity, and Level of Education in Alzheimer's Disease

Alzheimer's disease (AD) is the most frequent cause of dementia, where the abnormal accumulation of beta-amyloid (Aβ) and tau lead to neurodegeneration as well as loss of cognitive, behavioral, and functional abilities. The present review analyzes AD from a cross-cultural neuropsychological perspective, looking at differences in culture-associated variables, neuropsychological test performance and biomarkers across ethnic and racial groups. Studies have found significant effects of culture, preferred language, country of origin, race, and ethnicity on cognitive test performance, although the definition of those grouping terms varies across studies. Together, with the substantial underrepresentation of minority groups in research, the inconsistent classification might conduce to an inaccuratte diagnosis that often results from biases in testing procedures that favor the group to which test developers belong. These biases persist even after adjusting for variables related to disadvantageous societal conditions, such as low level of education, unfavorable socioeconomic status, health care access, or psychological stressors. All too frequently, educational level is confounded with culture. Minorities often have lower educational attainment and lower quality of education, causing differences in test results that are then attributed to culture. Higher levels of education are also associated with increased cognitive reserve, a protective factor against cognitive decline in the presence of neurodegeneration. Biomarker research suggests there might be significant differences in specific biomarker profiles for each ethnicity/race in need of accurate cultural definitions to adequately predict risk and disease progression across ethnic/racial groups. Overall, this review highlights the need for diversity in all domains of AD research that lack inclusion and the collection of relevant information from these groups.

Regression-Based Normative Data for Independent and Cognitively Active Spanish Older Adults: Free and Cued Selective Reminding Test, Rey-Osterrieth Complex Figure Test and Judgement of Line Orientation

The aim of this work was to develop normative data for neuropsychological tests for the assessment of independent and cognitively active Spanish older adults over 55 years of age.

METHODS

regression-based normative data were calculated from a sample of 103 nondepressed independent community-dwelling adults aged 55 or older (66% women). The raw data for the Free and Cued Selective Reminding Test (FCSRT), the Rey-Osterrieth Complex Figure Test (ROCF) and the Judgement of Line Orientation Test (JLO) were regressed on age, sex and education. The model predicting the FCSRT delayed-recall (FCSRT-Del) scores also included the FCSRT immediate-recall (FCSRT-Imm) scores. The model predicting the ROCF immediate-recall (ROCF-Imm) scores included the ROCF copy-trial (ROCF-C) scores, and the model predicting the ROCF delayed-recall (ROCF-Del) scores included both the ROCF-C and the ROCF-Imm scores. In order to identify low scores, z-scores were used to determine the discrepancy between the observed and the predicted scores. The base rates of the low scores for both the SABIEX normative data and the published normative data obtained from the general population were compared.

RESULTS

the effects of the different sociodemographic variables (age, sex and education) varied throughout the neuropsychological measures. Despite finding similar proportions of low scores between the normative data sets, the agreement was irrelevant or only fair-to-good.

CONCLUSIONS

the normative data obtained from the general population might not be sensitive enough to identify low scores in cognitively active older adults, incorrectly classifying them as cognitively normal compared to the less active population.

Cultural Bias in Intelligence Assessment Using a Culture-Free Test in Moroccan Children

OBJECTIVE

Previous research has shown that cognitive tests can lead to misclassification when applying non-representative norms to measure cognitive performance. The objective of this study was to investigate whether this misclassification also occurs with a non-verbal so-called "culture-free" intelligence test administered to different age groups.

METHOD

The intelligence of a sample of healthy Moroccan children (N = 147) ages 7, 9, and 11 was assessed using the Coloured Raven's Progressive Matrices (CPM). Raw scores were used to study age differences, as well as misclassifications when applying the norms of three countries culturally different from Morocco (United Kingdom, Spain, and Oman).

RESULTS

Intelligence performance was not within the normal range when non-representative norms were applied to the Moroccan raw scores. Misclassifications accounted for a large percentage of the participants that supposedly displayed intelligence deficits, especially when applying the British norms. Up to 15.68% of the healthy children fell within the "intellectually impaired" range, and up to 62.5% fell "below average," with these percentages especially higher at older ages.

CONCLUSIONS

Our findings confirm that "culture-free" tests should be adapted to each culture and applied together with their culture's specific norms to prevent misclassification and allow for a better, unbiased neuropsychological assessment.