Modern neuropsychological tests for a diversity of cultural contexts

Validation of Self-Administered Visual and Verbal Episodic Memory Tasks in Healthy Controls and a Clinical Sample

This study evaluated the performance characteristics, construct validity, and reliability of two computerized, self-administered verbal and visual recognition memory tests based on the Remember-Know paradigm. Around 250 healthy control participants and 440 patients referred for neuropsychological assessment used an iPad to complete the Words and Faces recognition memory tests before or after concurrent neuropsychological testing. Performance accuracy was high but without ceiling effects. Education, but not age, was related to overall performance for both samples while the influence of gender and race differed across samples. In the clinical sample, overall performance was worse in those patients demonstrating memory impairment on clinical assessment. Words and Faces subtests demonstrated the strongest correlations with neuropsychological measures of verbal and nonverbal memory, respectively. Both showed moderate correlations with processing speed while Faces was also correlated with visuospatial skills. The memory tests showed good test-retest reliability over two testing sessions. These findings demonstrate acceptable psychometric properties in clinical and community samples and suggest that this computerized format is feasible for memory assessment in clinical contexts.

Ethical issues in clinical neuropsychology: International diversity perspectives

OBJECTIVE

Much of the information about the ethical practice of clinical neuropsychology has focused on North America. Additionally, of the scholarly publications on the intersection of ethical issues and cultural diversity practices in neuropsychology, most have focused on North America. The extent to which practitioners in other parts of the world are aware of, and find useful, such information is largely unknown. Similarly, the extent to which North American neuropsychologists are familiar with ethical issues and challenges encountered around the world is unknown. The purpose of this article is to advance the discussion of ethical issues in clinical neuropsychology from an international diversity perspective.

METHOD

The article presents, via a panel interview format, the thoughts and experiences of a small sample of neuropsychologists who represent all continents except North America (and Antarctica).

RESULTS

Neuropsychologists across continents share an ethical commitment to providing services that are beneficial, and not harmful, to the recipients of the services. Professional competence is at the heart of such services.

CONCLUSIONS

Through continued and expanded dialogue about ethical issues with neuropsychology colleagues around the world, the potential exists for improvement in the provision of effective and compassionate care in our own towns.

Matching science to reality: how to deploy a participant-driven digital brain health platform

Introduction

Advances in digital technologies for health research enable opportunities for digital phenotyping of individuals in research and clinical settings. Beyond providing opportunities for advanced data analytics with data science and machine learning approaches, digital technologies offer solutions to several of the existing barriers in research practice that have resulted in biased samples.

Methods

A participant-driven, precision brain health monitoring digital platform has been introduced to two longitudinal cohort studies, the Boston University Alzheimer's Disease Research Center (BU ADRC) and the Bogalusa Heart Study (BHS). The platform was developed with prioritization of digital data in native format, multiple OS, validity of derived metrics, feasibility and usability. A platform including nine remote technologies and three staff-guided digital assessments has been introduced in the BU ADRC population, including a multimodal smartphone application also introduced to the BHS population. Participants select which technologies they would like to use and can manipulate their personal platform and schedule over time.

Results

Participants from the BU ADRC are using an average of 5.9 technologies to date, providing strong evidence for the usability of numerous digital technologies in older adult populations. Broad phenotyping of both cohorts is ongoing, with the collection of data spanning cognitive testing, sleep, physical activity, speech, motor activity, cardiovascular health, mood, gait, balance, and more. Several challenges in digital phenotyping implementation in the BU ADRC and the BHS have arisen, and the protocol has been revised and optimized to minimize participant burden while sustaining participant contact and support.

Discussion

The importance of digital data in its native format, near real-time data access, passive participant engagement, and availability of technologies across OS has been supported by the pattern of participant technology use and adherence across cohorts. The precision brain health monitoring platform will be iteratively adjusted and improved over time. The pragmatic study design enables multimodal digital phenotyping of distinct clinically characterized cohorts in both rural and urban U.S. settings.

Effect of Metabolic Syndrome Risk Factors on Processing Speed and Executive Function in Three Racialized Groups

BACKGROUND

Metabolic syndrome (MetS) has been associated with increased risk for Alzheimer's disease and related dementias (ADRD). Understanding the association of MetS risk factors to processing speed and executive function in the pre-clinical stages of ADRD in under-represented groups would offer insight on potential mechanisms through which MetS associates with ADRD risk.

OBJECTIVE

Examine association of MetS features and processing speed and executive function across three racial groups.

METHODS

Cognitively unimpaired adults from the Wisconsin Alzheimer's Disease Research Center and the Wisconsin Registry for Alzheimer's Disease Prevention completed blood-draws and neuropsychological testing. Six cognitive outcomes were assessed in association to MetS risk factors: Trailmaking Tests A and B, Animal Fluency, Digit Symbol, and composite scores for Processing Speed and Executive Function. Linear mixed effect models were used to assess the relationship between MetS risk factor count and longitudinal cognitive performance across three racialized groups.

RESULTS

Participant sample sizes varied by outcome analyzed (N = 714-1,088). African American and Native American groups exhibited higher rates of MetS than non-Hispanic Whites. MetS was associated with processing speed and executive function across all racialized groups. Three-way interaction by racialized group was limited to one cognitive outcome: Trailmaking Test A.

CONCLUSION

Metabolic dysfunction incrementally affects cognitive trajectory, with generally similar associations across racial groups. Since racialized groups exhibit higher levels of both MetS and ADRD, MetS may represent a driving factor for increased ADRD risk experience by racialized group and an important and modifiable target through which to reduce risk of ADRD.

Assessment of Neurocognitive Functions, Olfaction, Taste, Mental, and Psychosocial Health in COVID-19 in Adults: Recommendations for Harmonization of Research and Implications for Clinical Practice

OBJECTIVE

To propose a set of internationally harmonized procedures and methods for assessing neurocognitive functions, smell, taste, mental, and psychosocial health, and other factors in adults formally diagnosed with COVID-19 (confirmed as SARS-CoV-2 + WHO definition).

METHODS

We formed an international and cross-disciplinary NeuroCOVID Neuropsychology Taskforce in April 2020. Seven criteria were used to guide the selection of the recommendations' methods and procedures: (i) Relevance to all COVID-19 illness stages and longitudinal study design; (ii) Standard, cross-culturally valid or widely available instruments; (iii) Coverage of both direct and indirect causes of COVID-19-associated neurological and psychiatric symptoms; (iv) Control of factors specifically pertinent to COVID-19 that may affect neuropsychological performance; (v) Flexibility of administration (telehealth, computerized, remote/online, face to face); (vi) Harmonization for facilitating international research; (vii) Ease of translation to clinical practice.

RESULTS

The three proposed levels of harmonization include a screening strategy with telehealth option, a medium-size computerized assessment with an online/remote option, and a comprehensive evaluation with flexible administration. The context in which each harmonization level might be used is described. Issues of assessment timelines, guidance for home/remote assessment to support data fidelity and telehealth considerations, cross-cultural adequacy, norms, and impairment definitions are also described.

CONCLUSIONS

The proposed recommendations provide rationale and methodological guidance for neuropsychological research studies and clinical assessment in adults with COVID-19. We expect that the use of the recommendations will facilitate data harmonization and global research. Research implementing the recommendations will be crucial to determine their acceptability, usability, and validity.

Considerations for Selecting Cognitive Endpoints and Psychological Patient-Reported Outcomes for Clinical Trials in Pediatric Patients With Sickle Cell Disease

Pediatric patients with sickle cell disease (SCD) experience a range of medical complications that result in significant morbidity and mortality. Recent advances in prophylactic and curative treatment approaches have highlighted the need for sensitive and clinically-meaningful trial endpoints. The detrimental effects of cognitive and psychological difficulties on social and economic mobility are well described. Although numerous reviews have assessed cognitive outcomes in other rare genetic disorders, SCD has not received the same focus. This review describes the cognitive (i.e., executive function and processing speed) and psychological domains (i.e., depression and anxiety) that are consistently associated with SCD pathology and, therefore, may be of particular interest as clinical trial endpoints. We then discuss corresponding well-validated and reliable cognitive tests and patient-reported outcomes (PROs) that may be appropriate for clinical trials given their robust psychometric properties, ease of administration, and previous use in the SCD population. Further, we provide a discussion of potential pitfalls and considerations to guide endpoint selection. In line with the move toward patient-centered medicine, we identify specific tests (e.g., NIH Toolbox Cognition Module, Wechsler Cancellation Test) and psychological PROs (e.g., PROMIS depression and anxiety scales) that are sensitive to SCD morbidity and have the potential to capture changes that are clinically meaningful in the context of patients' day to day lives. In particularly vulnerable cognitive domains, such as executive function, we highlight the advantages of composite over single-test scores within the context of trials. We also identify general (i.e., practice effects, disease heterogeneity) and SCD-specific considerations (i.e., genotype, treatment course, and disease course, including degree of neurologic, pain, and sleep morbidity) for trial measures. Executive function composites hold particular promise as trial endpoints that are clinically meaningful, amenable to change, relatively easy to collect, and can be incorporated into the routine care of patients with SCD in various settings and countries.

Post-Stroke Psychiatric and Cognitive Symptoms in West Asia, South Asia and Africa: A Systematic Review and Meta-Analysis

Recent research has shown that the prevalence of stroke incidents and the number of survivors in developing countries surpass those from developed countries. This study aimed to enumerate the prevalence of post-stroke psychiatric and cognitive symptoms among stroke survivors from West and South Asia and Africa through a systematic review and meta-analysis. Data from each country was systematically acquired from five major databases (PsycINFO, Web of Science, Scopus, PubMed/Medline, and Google Scholar (for any missing articles and grey literature)). Meta-analytic techniques were then used to estimate the prevalence of various post-stoke psychiatric and cognitive symptoms. A total of 36 articles were accrued from 11 countries, of which 25 were evaluated as part of the meta-analysis. The pooled prevalence of post-stroke depression as per the Hospital Anxiety and Depression Scale (HADS), Hamilton Depression Rating Scale, Patient Health Questionnaire, Schedules for Clinical Assessment in Neuropsychiatry (SCAN), Geriatric Depression Scale, and the Montgomery-Asberg Depression Rating Scale ranged from 28.00 to 50.24%. Pooled prevalence of post-stroke anxiety based on the HADS and SCAN was 44.19% and 10.96%, respectively. The pooled prevalence of post-stroke cognitive impairment as per the Mini-Mental Status Examination was 16.76%. This present review has suggested that both psychiatric and cognitive symptoms are common among stroke survivors. Concerted efforts are needed to institute robust studies using culturally sensitive measures to contemplate mechanisms that address the unmet needs of this vulnerable population.

Cogstate Brief Battery: Cognition and the feigning of cognitive impairment in chronic pain

Chronic pain (CP) is often associated with cognitive impairment. The Cogstate Brief Battery (CBB), a computerized assessment battery, has been studied in several neuropsychiatric disorders but not in CP. Since feigning of cognitive impairment is common in CP, the current study aimed to assess the CBB's utility in differentiating CP patients (n = 64) from healthy participants (n = 33), as well as to assess the effect of simulating cognitive impairment by CP patients on performance in the battery. CP outpatients were randomly assigned to one of two groups: (a) Patients performing the CBB to the best of their ability. (b) Patients simulating cognitive impairment. Independent-samples t-tests indicated that three of four CBB tasks successfully differentiated CP patients from matched healthy controls. Additionally, an analysis of covariance (ANCOVA) indicated that CP patients who simulated cognitive impairment performed more poorly in all four CBB tasks, with the detection task having the strongest discrimination capacity. This is the first study to point toward the usefulness and sensitivity of the CBB for assessment of cognition and detection of feigned cognitive impairment in CP. Further studies are required to validate these preliminary findings and assess the CBB's utility in daily clinical practice.

Professional practices, beliefs, and incomes of U.S. neuropsychologists: The AACN, NAN, SCN 2020 practice and "salary survey"

OBJECTIVE

This portion of the 2020 survey updates practice information, beliefs, and income data of clinical neuropsychologists who practice within the United States. Methods: Doctoral-level neuropsychology practitioners were invited via numerous methods, with multiple reminders, to participate in a web-based survey from January 17 through April 2, 2020. The useable U.S. sample of 1677 doctoral-level practitioners was 6.2% larger than the comparable group in the prior 2015 practice survey. Results: Whereas women practitioners predominate, which continues a steeply increasing trend across time, increases in overall ethnic/racial diversity continue at a slow pace. Median age has remained very similar over the last 30 years, reflecting a continuous influx of young practitioners. A relatively small minority of neuropsychologists work part time. The proportion of board-certified neuropsychologists continues to show meaningful increase; interest in subspecialization certification is relatively high. Reliance on technicians remains popular, especially for neuropsychologists who work in institutions or are board certified. Although implementation of new CPT codes in 2019 and related payor policies appear to have had more negative than positive effects, psychology-related annual incomes of neuropsychologists have again increased compared to prior surveys. Variables such as specific work setting, state, region, years in practice, forensic practice hours, board certification, and basis for determining income (e.g. hours billed, revenue collected, relative value units) have an impact on income. More than half of practitioners engage in forensic neuropsychology, with the number of related practice hours per week again increasing. There is very high agreement regarding the use of response validity measures in clinical practice and forensic practice. Neurologists remain the number one referral source whether working in an institution, private practice, or a combination of both, and regardless of maintaining a pediatric, adult, or lifespan practice. Career satisfaction ratings for income, job, and work-life balance remain high, with the majority of ratings regarding the future of the specialty in the positive range. Additional data summaries related to a wide range of professional and practice topics are provided. Conclusions: Updating and comparing survey information at five-year intervals continues to provide insights and perspectives regarding relative stabilities and changes in practice activities, beliefs, and incomes of U.S. clinical neuropsychologists. Such information also provides guidance regarding the future of the specialty.

Taking the Test: A Qualitative Analysis of Cultural and Contextual Factors Impacting Neuropsychological Assessment of Xhosa-Speaking South Africans

Objective

There is an urgent need to make neuropsychological (NP) testing more acceptable, accessible, and culturally salient, particularly for culturally, educationally, and linguistically diverse individuals from countries who may have little-to-no experience with NP testing. In settings with limited resources such as South Africa, unique cultural and contextual factors (e.g., structural inequality, poverty) may impact the experience of NP evaluation. Research in this area is limited and requires further exploration. This qualitative study explores the role of cultural and contextual factors that may impact the experience of NP evaluation in a sample of Xhosa-speaking South African adults. Participant interviews explored the context from which individuals arrived at the NP assessment (e.g., quality of education, understanding of cognitive disorders), and their experience of completing NP tests.

Method

This qualitative study used data from semistructured interviews to conduct a thematic analysis exploring contextual factors and the experience of completing NP tests for the first time among Xhosa-speaking South African adults (N = 22). Results: Although no participants had prior experience with NP testing, most found testing procedures acceptable. Most participants, however, reported a limited understanding of the purpose of NP testing and cognitive problems. Additionally, some participants reported perceptions and attitudes that could affect test performance, such as misinterpreting standard testing procedures (e.g., no feedback from the examiner, being stopped mid-task) as indicative of poor performance.

Conclusions

This study provided much needed exploration into unique cultural factors that may impact the experience of NP assessment in South Africa, which could bias test performance and interpretation, and may aid the field of cross-cultural NP in better serving culturally and linguistically diverse populations. In these countries, neuropsychologists may need to actively evaluate participants’ understanding of NP testing to help foster optimal assessment conditions. They may also need to educate participants on possible causes of cognitive disorders.

The Psychometric Properties of the Grit-O Scale Within the Twente Region in Netherlands: An ICM-CFA vs. ESEM Approach

The purpose of this study was to examine the psychometric properties (i.e., factorial validity, measurement invariance, and reliability) of the Grit-Original scale (Grit-O) within the Netherlands. The Grit-O scale was subjected to a competing measurement modeling strategy that sequentially compared both independent cluster model confirmatory factor analytical- and exploratory structural equation modeling approaches. The results showed that both a two first order, bi-factor structure as well as a less restrictive two factor ESEM factorial structure best-fitted the data. The instrument showed to be reliable at both a lower- (Cronbach’s alpha) and upper-level (composite reliability) limit. However, measurement invariance between genders could only be established for the B-ICM-CFA model. Finally, concurrent validity was established through relating the GRIT-O to task performance. The linear use of the Grit-O scale should therefore carefully be considered.

Introduction to the special issue: Are modern neuropsychological assessment methods really "modern"? Reflections on the current neuropsychological test armamentarium

OBJECTIVE

We introduce this special issue which focuses on how advances in neuroscience and technology can modernize and transform clinical neuropsychological assessment.

METHOD

We included both invited and solicited papers to reflect on the strengths and weaknesses of currently used, standardized neuropsychological tests and to explore how we might incorporate new technologies and neuroscientific advances to modernize neuropsychological assessment methods.

RESULTS

The papers are organized along the following themes: (1) A critique of the current clinical neuropsychological test armamentarium; (2) A description of new opportunities for collecting neurobehavioral data with technology; (3) Digital science, biomedical big data and the internet; (4) Integrating neuropsychological, neuroimaging, and neurophysiological assessments; (5) Modernization, globalization and culture.

CONCLUSION

The process of modernizing methods of assessment in clinical neuropsychology is laborious and requires a coordinated, sustained effort among clinicians, researchers, and the test industry. While embracing technology is necessary, we must also be aware of unintended consequences as we navigate this exciting new territory.