Differential Item Functioning of the Everyday Cognition (ECog) Scales in Relation to Racial/Ethnic Groups

Cross-cultural adaptation of the everyday cognition scale (M-ECog) in older Mexican adults with cognitive impairment

The Everyday Cognition (ECog) scale was created to evaluate the functional abilities of older adults across a wide range of abilities between normal aging and dementia. ECog screens cognitive alterations such as subjective cognitive decline (SCD) and mild cognitive impairment (MCI). This early recognition is done by the measurement of the ability to perform the activities of daily living (ADLs).

Objective

To establish the cross-cultural adaptation, validity, and reliability of the ECog Mexican version (M-ECog) in participants with: SCD, MCI, and dementia coming from a memory clinic.

Methods

There were 200 patients and their respective informants in a memory clinic of a third level hospital in Mexico City. Four groups were studied: 50 cognitively healthy (CH), 50 SCD, 50 MCI, and 50 dementia. The clinical evaluation included: sociodemographic and health characteristics, cognitive status by the Mini-Mental State Evaluation (MMSE) and Montreal Cognitive Evaluation Spanish version (MoCA-E), and caregiver information (informants) about the difficulty in ADLs as well as the ECog Spanish version (M-ECog).

Results

The M-ECog was significantly correlated with MMSE, MoCA-E, and ADLs. It showed the ability to discriminate the different cognitive declines (Cronbach's alpha 0.881). The intra-class correlation coefficient was 0.877 (95% confidence interval - CI, 0.850-0.902; p<0.001). The patient's group area under curve (AUC) of M-ECog for SCD was 0.70 (95%CI 0.58-0.82, p<0.005), for MCI it was 0.94 (95%CI 0.89-0.99, p<0.001) and for dementia 0.86 (95%CI 0.79-0.92, p<0.001).

Conclusion

The M-ECog scale proves to be valid and reliable for measuring everyday abilities mediated by cognition. It is self-applicable without requiring extensive prior formation. It is useful to screen for SCD and MCI in older Mexican adults.

Direct and Indirect Effects of Socioeconomic Status and Discrimination on Subjective Cognitive Decline: A Longitudinal Study of African American Women

OBJECTIVES

The present study builds on recent findings suggesting that the stress of institutional and interpersonal racism may contribute to African Americans' elevated risk for dementia. We investigated the extent to which 2 consequences of racism-low socioeconomic status (SES) and discrimination-predict self-reported cognitive decline (SCD) 19 years later. Further, we examined potential mediating pathways that might link SES and discrimination to cognitive decline. Potential mediators included depression, accelerated biological aging, and onset of chronic illnesses.

METHODS

Hypotheses were tested using a sample of 293 African American women. SCD was assessed using the Everyday Cognition Scale. Structural equation modeling was used to assess the effects of SES and racial discrimination, both measured in 2002, on SCD reported in 2021. Turning to the mediators, midlife depression was assessed in 2002, accelerated aging in 2019, and chronic illness in 2019. Age and prodrome depression were included as covariates.

RESULTS

There were direct effects of SES and discrimination on SCD. In addition, these 2 stressors showed a significant indirect effect on SCD through depression. Finally, there was evidence for a more complex pathway where SES and discrimination accelerate biological aging, with accelerated aging, in turn leading to chronic illness, which then predicted SCD.

DISCUSSION

Results of the present study add to a growing literature indicating that living in a racialized society is a central factor in explaining the high risk for dementia among Black Americans. Future research should continue to emphasize the various ways that exposure to racism over the life course effects cognition.

The application of cross-sectionally derived dementia algorithms to longitudinal data in risk factor analyses

PURPOSE

Dementia algorithms are often developed in cross-sectional samples but implemented in longitudinal studies to ascertain incident dementia. However, algorithm performance may be higher in cross-sectional settings, and this may impact estimates of risk factor associations.

METHODS

We used data from the Religious Orders Study and the Memory and Aging Project (N = 3460) to assess the performance of example algorithms in classifying prevalent dementia in cross-sectional samples versus incident dementia in longitudinal samples. We used an applied example and simulation study to characterize the impact of varying sensitivity, specificity, and unequal sensitivity or specificity between exposure groups (differential performance) on estimated hazard ratios from Cox models.

RESULTS

Using all items, algorithm sensitivity was higher for prevalent (0.796) versus incident dementia (0.719); hazard ratios had slight bias. Sensitivity differences were larger using a subset of items (0.732 vs. 0.600) and hazard ratios were 13%-19% higher across adjustment sets compared to estimates using gold-standard dementia status. Simulations indicated specificity and differential algorithmic performance between exposure groups may have large effects on hazard ratios.

CONCLUSIONS

Algorithms developed using cross-sectional data may be adequate for longitudinal settings when performance is high and non-differential. Poor specificity or differential performance between exposure groups may lead to biases.

Beyond depression: examining the role of anxiety and anxiety sensitivity on subjective cognition and functioning in older adults

OBJECTIVES

Subjective cognitive difficulties in the elderly may serve as potential risk-factors for future, objective decline and conversion to neurodegenerative disorders (e.g., mild cognitive impairment [MCI] and dementia). Though these subjective declines have been associated with depression, and to a lesser extent, anxiety, it is unknown if related constructs (e.g. anxiety sensitivity) and specific kinds of worries (e.g. worry about developing dementia, health anxiety) are related to subjective declines. The current study sought to examine if cognitive concerns related to anxiety sensitivity, dementia worry, and health anxiety added incremental validity beyond general symptoms of anxiety and depression in predicting subjective cognition and functioning in a sample of older adults.

METHODS

Participants were 429 older adults who were at least 60 years old. Participants completed questionnaires on subjective cognition, subjective everyday function, anxiety, depression, anxiety sensitivity, dementia worry, and health anxiety via Qualtrics Panels. Hierarchical multiple regressions were conducted.

RESULTS

Our variables of interest (anxiety sensitivity, dementia worry, and health anxiety) added significant variance in predicting subjective cognition and everyday function. Specifically, anxiety sensitivity was related to subjective cognition and functioning, while dementia worry and health anxiety were variably associated.

CONCLUSION

Our results suggest that constructs related to anxiety and worry have a significant relationship with subjective cognition and function in older adults beyond general symptoms of depression and anxiety. Future work should examine if interventions and education may help to decrease anxiety sensitivity and worry about dementia respectively in older adults, which may in tern protect against future subjective declines.

Differences in the measurement of cognition for the assessment of dementia across geographic contexts: Recommendations for cross-national research

INTRODUCTION

Most cognitive assessments have been developed in high-income countries but are used in diverse contexts. Differences in culture and context may affect the performance of cognitive items.

METHODS

We used the Harmonized Cognitive Assessment Protocol (HCAP) surveys in the United States, Mexico, India, England, and South Africa (combined N = 11,364) to quantify associations across countries between cognitive items and cognitive impairment status using age- and sex-adjusted logistic regression.

RESULTS

Associations were stronger in the United States (median odds ratio [OR] across items = 0.17) and England (median OR = 0.19), compared to South Africa (median OR = 0.23), India (median OR = 0.29), and Mexico (median OR = 0.28). Items assessing memory (e.g., delayed recall tasks) had the most consistent associations of the largest magnitudes across contexts.

DISCUSSION

Transporting cognitive items among countries and cultures warrants caution. Our results can guide the design of future instruments by identifying items that performed well either in individual contexts or across the range of contexts considered.

HIGHLIGHTS

Little quantitative evidence exists to guide the design of cognitive assessments in cross-national studies. The performance of cognitive items for the measurement of dementia varied across countries. Items with lower variation across countries (e.g., delayed word recall) should be used in future cross-national assessments. Across countries, there was variability in the performance of language assessments, with the exception of the animal naming task. Results can be used to design future cross-national or location-specific cognitive assessments.

The effect of missing data and imputation on the detection of bias in cognitive testing using differential item functioning methods

Background

Item response theory (IRT) methods for addressing differential item functioning (DIF) can detect group differences in responses to individual items (e.g., bias). IRT and DIF-detection methods have been used increasingly often to identify bias in cognitive test performance by characteristics (DIF grouping variables) such as hearing impairment, race, and educational attainment. Previous analyses have not considered the effect of missing data on inferences, although levels of missing cognitive data can be substantial in epidemiologic studies.

Methods

We used data from Visit 6 (2016–2017) of the Atherosclerosis Risk in Communities Neurocognitive Study (N = 3,580) to explicate the effect of artificially imposed missing data patterns and imputation on DIF detection.

Results

When missing data was imposed among individuals in a specific DIF group but was unrelated to cognitive test performance, there was no systematic error. However, when missing data was related to cognitive test performance and DIF group membership, there was systematic error in DIF detection. Given this missing data pattern, the median DIF detection error associated with 10%, 30%, and 50% missingness was -0.03, -0.08, and -0.14 standard deviation (SD) units without imputation, but this decreased to -0.02, -0.04, and -0.08 SD units with multiple imputation.

Conclusions

Incorrect inferences in DIF testing have downstream consequences for the use of cognitive tests in research. It is therefore crucial to consider the effect and reasons behind missing data when evaluating bias in cognitive testing.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01572-2.

"Do I Have a Memory Problem? I Can't Recall": An Evaluation of Measurement Invariance in Subjective Reporting of Memory Symptoms among Persons with and without Objective HIV-Associated Memory Impairment

OBJECTIVE

Memory symptoms and objective impairment are common in HIV disease and are associated with disability. A paradoxical issue is that objective episodic memory failures can interfere with accurate recall of memory symptoms. The present study assessed whether responses on a self-report scale of memory symptoms demonstrate measurement invariance in persons with and without objective HIV-associated memory impairment.

METHOD

In total, 505 persons with HIV completed the Prospective and Retrospective Memory Questionnaire (PRMQ). Objective memory impairment (n = 141) was determined using a 1-SD cutoff on clinical tests of episodic memory. PRMQ measurement invariance was assessed by confirmatory factor analyses examining a one-factor model with increasing cross-group equality constraints imposed on factor loadings and item thresholds (i.e., configural, weak, and strong invariance).

RESULTS

Configural model fit indicated that identical items measured a one-factor model for both groups. Comparison to the weak model indicated that factor loadings were equivalent across groups. However, there was evidence of partial strong invariance, with two PRMQ item thresholds differing across memory impairment groups. Post hoc analyses using a 1.5-SD memory impairment cutoff (n = 77) revealed both partial weak and partial strong invariance, such that PRMQ item loadings differed across memory groups for three items.

CONCLUSIONS

The PRMQ demonstrated a robust factor structure among persons with and without objective HIV-associated memory impairment. However, on select PRMQ items, individuals with memory impairment reported observed scores that were relatively higher than their latent score, while items were more strongly associated with the memory factor in a group with greater memory impairment.

Evidence for neuropsychological health disparities in Black Americans with HIV disease

OBJECTIVE

Black Americans are at high risk for HIV disease and associated morbidity. The impact and clinical correlates of HIV-associated neurocognitive impairment among Black Americans is not fully understood. The current study uses a full factorial design to examine the independent and combined effects of race and HIV disease on neurocognitive functioning, including its associations with everyday functioning and clinical disease markers in Black and White persons with HIV (PWH).

METHOD

Participants included 40 Black PWH, 83 White PWH, 28 Black HIV- and 64 White HIV- individuals. Neurocognition was measured by raw sample-based z-scores from a clinical battery. Everyday functioning was assessed using self- and clinician-rated measures of cognitive symptoms and activities of daily living. HIV-associated neurocognitive disorders were also classified using demographically adjusted normative standards and the Frascati criteria.

RESULTS

We observed a significant three-way interaction between HIV, race, and domain on raw neurocognitive z-scores. This omnibus effect was driven by medium and large effect size decrements in processing speed and semantic memory, respectively, in Black PWH compared to other study groups. Black PWH also demonstrated higher frequencies of HIV-associated neurocognitive disorders as compared to White PWH. Unexpectedly, global neurocognitive performance was negatively related to everyday functioning impairments for White PWH, but not for Black PWH.

CONCLUSIONS

Systemic disadvantages for Black Americans may combine with HIV disease to compound some neurocognitive impairments in this under-served population. Prospective studies are needed to identify better ways to prevent, measure, diagnose, and manage HIV-associated neurocognitive disorders among Black Americans.

The Measurement of Everyday Cognition (ECog): Revisions and Updates

INTRODUCTION

The Everyday Cognition scale (ECog), a measure of everyday functioning developed in 2008, is sensitive to early detection and progression of neurodegenerative disease. The goal was to update ECog item content to ensure relevancy to contemporary older adults from diverse backgrounds.

METHODS

Participants included 44 culturally diverse older adults (18 with normal cognition, 11 with mild cognitive impairment) and their study partners. Item understandability and relevance was evaluated using iterative interviewing methods that were analyzed using standard qualitative methods. On the basis of this information, items were modified, deleted, or developed as needed.

RESULTS

Of the 39 original items, 19 were revised, 3 new items were added (primarily to cover contemporary activities such as the use of technology), and 1 was deleted. The revised version (ECog-II) includes 41 items.

DISCUSSION

To ensure strong psychometric properties, and to facilitate harmonization of previously collected data, we preserved well over half of the items. Future work will validate the revised ECog by measuring associations with neuropsychological performance, external measures of disease, and other functional measures. Overall, the revised ECog will continue to be a useful tool for measuring cognitively relevant everyday abilities in clinical settings and intervention clinical trials.

Subjective cognitive decline and objective cognition among diverse U.S. Hispanics/Latinos: Results from the Study of Latinos-Investigation of Neurocognitive Aging (SOL-INCA)

Introduction

Despite increased risk of cognitive decline in Hispanics/Latinos, research on early risk markers of Alzheimer's disease in this group is lacking. Subjective cognitive decline (SCD) may be an early risk marker of pathological aging. We investigated associations of SCD with objective cognition among a diverse sample of Hispanics/Latinos living in the United States.

Methods

SCD was measured with the Everyday Cognition Short Form (ECog‐12) and cognitive performance with a standardized battery in 6125 adults aged ≥ 50 years without mild cognitive impairment or dementia (x̄_age = 63.2 years, 54.5% women). Regression models interrogated associations of SCD with objective global, memory, and executive function scores.

Results

Higher SCD was associated with lower objective global (B = −0.16, SE = 0.01), memory (B = −0.13, SE = 0.02), and executive (B = −0.13, SE = 0.02, p's < .001) function composite scores in fully adjusted models.

Discussion

Self‐reported SCD, using the ECog‐12, may be an indicator of concurrent objective cognition in diverse middle‐aged and older community‐dwelling Hispanics/Latinos.

Examining the factor structure of the Multifactorial Memory Questionnaire

Many adults report memory changes as they age. The Multifactorial Memory Questionnaire (MMQ) measures different aspects of self-reported memory, including satisfaction with one's memory, self-appraisal of memory ability, and compensatory strategy use. This questionnaire has been extensively used for clinical and research purposes, with studies reporting differences in the factor structure (three or four factors) underlying this measure. The current study evaluates previously reported factor configurations of the MMQ using best measurement practices. Confirmatory factor analyses were conducted on data from 560 cognitively - normal adults, ranging in age from 50 to 90 years old. Our results demonstrate support for both 3-factor model (with Satisfaction, Ability and Strategy scales) and 4-factor model structure (with Satisfaction, Ability, Internal Strategy and External Strategy scales) of this instrument. These results harmonise the existing literature which, in separate studies using exploratory analyses, supports the validity of one model or the other. The confirmation of multiple Strategy scales will provide clinicians and researchers with additional relevant information about how older adults compensate for their memory changes, enabling a broader understanding of the experience of age-related memory change. We contextualise these results within existing research identifying conceptual differences between internal and external strategy implementation.

International Mind, Activities and Urban Places (iMAP) study: methods of a cohort study on environmental and lifestyle influences on brain and cognitive health

INTRODUCTION

Numerous studies have found associations between characteristics of urban environments and risk factors for dementia and cognitive decline, such as physical inactivity and obesity. However, the contribution of urban environments to brain and cognitive health has been seldom examined directly. This cohort study investigates the extent to which and how a wide range of characteristics of urban environments influence brain and cognitive health via lifestyle behaviours in mid-aged and older adults in three cities across three continents.

METHODS AND ANALYSIS

Participants aged 50-79 years and living in preselected areas stratified by walkability, air pollution and socioeconomic status are being recruited in Melbourne (Australia), Barcelona (Spain) and Hong Kong (China) (n=1800 total; 600 per site). Two assessments taken 24 months apart will capture changes in brain and cognitive health. Cognitive function is gauged with a battery of eight standardised tests. Brain health is assessed using MRI scans in a subset of participants. Information on participants' visited locations is collected via an interactive web-based mapping application and smartphone geolocation data. Environmental characteristics of visited locations, including the built and natural environments and their by-products (e.g., air pollution), are assessed using geographical information systems, online environmental audits and self-reports. Data on travel and lifestyle behaviours (e.g., physical and social activities) and participants' characteristics (e.g., sociodemographics) are collected using objective and/or self-report measures.

ETHICS AND DISSEMINATION

The study has been approved by the Human Research Ethics Committee of the Australian Catholic University, the Institutional Review Board of the University of Hong Kong and the Parc de Salut Mar Clinical Research Ethics Committee of the Government of Catalonia. Results will be communicated through standard scientific channels. Methods will be made freely available via a study-dedicated website.

TRIAL REGISTRATION NUMBER

ACTRN12619000817145.