Japanese-English language equivalence of the Cognitive Abilities Screening Instrument among Japanese-Americans

Differential Item Functioning and Clinical Utility of the Subjective Memory Complaints Questionnaire in a Multi-Ethnic Cohort

INTRODUCTION

This study evaluated the psychometric properties of the Subjective Memory Complaints Questionnaire (SMCQ) in a non-Hispanic White (NHW) and Mexican American (MA) sample from Texas in the USA.

METHODS

Data were obtained from the Health and Aging Brain Study - Health Disparities (HABS-HD; N = 1,691, age = 66.5 ± 8.7, education = 12.4 ± 4.8, 60.6% female, 33.2% MA Spanish speaking). Unidimensionality of the SMCQ was evaluated with confirmatory factor analysis. Differential item functioning (DIF) of the SMCQ was assessed across age, sex, education, and ethnicity/language using item response theory/logistic ordinal regression. Associations of the SMCQ in relation to cognitive status, Alzheimer's disease (AD) blood-based biomarkers, and psychological distress were examined.

RESULTS

The SMCQ showed excellent fit in a single-factor model (CFI = 0.97, TLI = 0.97, RMSEA [95% CI] = 0.05 [0.04, 0.05], SRMR = 0.07). Significant item-level DIF was detected by education level and ethnicity/language, but not by age or sex; when detected, DIF was not salient (i.e., adverse). The SMCQ was associated with greater psychological distress, worse Clinical Dementia Rating scores, and greater disease burden as measured by total tau and neurofilament light.

CONCLUSIONS

Practically negligible item-level bias was identified across education and ethnicity/language. Detected DIF can be described as benign, indicating that some items manifested differently between groups but had minimal impact on measurement properties. These results demonstrate that the SMCQ performs appropriately across demographic variables. Our findings also provide support for the associations of SMCQ scores with self-reported mood, cognitive status, and AD blood-based biomarkers.

Alzheimer's Disease Screening Tools for Asian Americans: A Scoping Review

With growing numbers of aging Asian Americans, Native Hawaiians, and Pacific Islanders (AANHPIs), the availability of culturally and linguistically appropriate screening tools for Alzheimer's disease and its related dementias (ADRD) is needed. The aim of this scoping review is to summarize the tools that have been adapted for and validated among the AANHPI population. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol for systematic reviews, six databases were searched for peer-reviewed articles describing ADRD among AANHPIs. Among 1,477 articles screened for inclusion, 15 articles were included in the final analysis. Results showed a paucity of studies that psychometrically validate tools among this population. Furthermore, studies that culturally adapted and/or translated existing tools mostly targeted East Asian American populations. Our review provides a first step in mapping the extant literature on ADRD screening tools for this underresearched population and will serve as a guide for future research, policy, and intervention.

Differential item functioning of the Beck Anxiety Inventory in a rural, multi-ethnic cohort

BACKGROUND

Evaluating measurement bias is vital to ensure equivalent assessment across diverse groups. One approach for evaluating test bias, differential item functioning (DIF), assesses item-level bias across specified groups by comparing item-level responses between groups that have the same overall score. Previous DIF studies of the Beck Anxiety Inventory (BAI) have only assessed bias across age, sex, and disease duration in monolingual samples. We expand this literature through DIF analysis of the BAI across age, sex, education, ethnicity, cognitive status, and test language.

METHODS

BAI data from a sample (n = 527, mean age=61.4 ± 12.7, mean education=10.9 ± 4.3, 69.3% female, 41.9% Hispanic/Latin American) from rural communities in West Texas, USA were analyzed. Item response theory (IRT) / logistic ordinal regression DIF was conducted across dichotomized demographic grouping factors. The Mann-Whitney U test and Hedge's g standardized mean differences were calculated before and after adjusting for the impact of DIF.

RESULTS

Significant DIF was demonstrated in 10/21 items. An adverse impact of DIF was not identified when demographics were assessed individually. Adverse DIF was identified for only one participant (1/527, 0.2%) when all demographics were aggregated.

LIMITATIONS

These results might not be generalizable to a sample with broader racial representation, more severe cognitive impairment, and higher levels of anxiety.

CONCLUSIONS

Minimal item-level bias was identified across demographic factors considered. These results support prior evidence that the BAI is valid for assessing anxiety across age and sex while contributing new evidence of its clinical relevance across education, ethnicity, cognitive status, and English/Spanish test language.

Alcohol consumption and cognitive function in elderly Japanese men

Although heavy alcohol consumption has been identified as a risk factor for adverse cognitive functioning, it currently remains unclear whether moderate alcohol consumption exerts similar effects. Observational studies previously reported the potential benefits of moderate alcohol consumption on cognition, particularly in the elderly; however, these effects have not yet been demonstrated in Asian populations. The aim of the present study was to investigate the relationship between alcohol consumption levels and global and domain-specific cognitive functions in cognitively intact elderly Japanese men. Cross-sectional data from the Shiga Epidemiological Study of Subclinical Atherosclerosis (SESSA), an ongoing prospective, population-based study in Shiga, Japan, were used to examine the relationship between alcohol consumption and cognitive function. Men (n = 585) aged ≥65 years provided information on their weekly consumption of alcohol, and the data obtained were used to construct categories of never, ex- (quit before interview), very light (<14 g/day), light (14-23 g/day), moderate (>23-46 g/day), and heavy (>46 g/day) drinkers. Cognitive function was measured using the Cognitive Abilities Screening Instrument (CASI). A fractional logistic regression model adjusted for age, education, body mass index, smoking, exercise, hypertension, diabetes, and dyslipidemia showed that the CASI scores for global and domain-specific cognitive functions were not significantly different between all subgroups of current drinkers and never-drinkers. However, the CASI score of ex-drinkers (multivariable adjusted mean CASI score [SD]) was significantly lower than that of never-drinkers in the global [never vs. ex: 90.16 (2.21) vs. 88.26 (2.58)] and abstraction and judgment domain [never vs. ex: 9.48 (0.46) vs. 8.61 (0.57)]). The present results do not suggest any beneficial or adverse relationship between current alcohol consumption levels and cognitive functioning (both global and domain specific) in elderly Japanese men; however, low cognitive function among ex-drinkers warrants future investigations to identify the factors causing drinkers to quit.

Incident prolonged QT interval in midlife and late-life cognitive performance

BACKGROUND

Measures of cardiac ventricular electrophysiology have been associated with cognitive performance in cross-sectional studies. We sought to evaluate the association of worsening ventricular repolarization in midlife, as measured by incident prolonged QT interval, with cognitive decline in late life.

METHODS

Midlife QT interval was assessed by electrocardiography during three study visits from 1965/68 to 1971/74 in a cohort of Japanese American men aged 46-68 at Exam 1 from the Honolulu Heart Study. We defined incident prolonged QT as the QT interval in the upper quartile at Exam 2 or 3 after QT interval in lower three quartiles at Exam 1. Cognitive performance was assessed at least once using the Cognitive Abilities Screening Instrument (CASI), scored using item response theory (CASI-IRT), during four subsequent visits from 1991/93 to 1999/2000 among 2,511 of the 4,737 men in the Honolulu-Asia Aging Study otherwise eligible for inclusion in analyses. We used marginal structural modeling to determine the association of incident prolonged QT with cognitive decline, using weighting to account for confounding and attrition.

RESULTS

Incident prolonged QT interval in midlife was not associated with late-life CASI-IRT at cognitive baseline (estimated difference in CASI-IRT: 0.04; 95% CI: -0.28, 0.35; p = 0.81), or change in CASI-IRT over time (estimated difference in annual change in CASI-IRT: -0.002; 95%CI: -0.013, 0.010; p = 0.79). Findings were consistent across sensitivity analyses.

CONCLUSIONS

Although many midlife cardiovascular risk factors and cardiac structure and function measures are associated with late-life cognitive decline, incident prolonged QT interval in midlife was not associated with late-life cognitive performance or cognitive decline.

Measurement Equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Applied Cognition - General Concerns, Short Forms in Ethnically Diverse Groups

AIMS

The goals of these analyses were to examine the psychometric properties and measurement equivalence of a self-reported cognition measure, the Patient Reported Outcome Measurement Information System^® (PROMIS^®) Applied Cognition - General Concerns short form. These items are also found in the PROMIS Cognitive Function (version 2) item bank. This scale consists of eight items related to subjective cognitive concerns. Differential item functioning (DIF) analyses of gender, education, race, age, and (Spanish) language were performed using an ethnically diverse sample (n = 5,477) of individuals with cancer. This is the first analysis examining DIF in this item set across ethnic and racial groups.

METHODS

DIF hypotheses were derived by asking content experts to indicate whether they posited DIF for each item and to specify the direction. The principal DIF analytic model was item response theory (IRT) using the graded response model for polytomous data, with accompanying Wald tests and measures of magnitude. Sensitivity analyses were conducted using ordinal logistic regression (OLR) with a latent conditioning variable. IRT-based reliability, precision and information indices were estimated.

RESULTS

DIF was identified consistently only for the item, brain not working as well as usual. After correction for multiple comparisons, this item showed significant DIF for both the primary and sensitivity analyses. Black respondents and Hispanics in comparison to White non-Hispanic respondents evidenced a lower conditional probability of endorsing the item, brain not working as well as usual. The same pattern was observed for the education grouping variable: as compared to those with a graduate degree, conditioning on overall level of subjective cognitive concerns, those with less than high school education also had a lower probability of endorsing this item. DIF was also observed for age for two items after correction for multiple comparisons for both the IRT and OLR-based models: "I have had to work really hard to pay attention or I would make a mistake" and "I have had trouble shifting back and forth between different activities that require thinking". For both items, conditional on cognitive complaints, older respondents had a higher likelihood than younger respondents of endorsing the item in the cognitive complaints direction. The magnitude and impact of DIF was minimal. The scale showed high precision along much of the subjective cognitive concerns continuum; the overall IRT-based reliability estimate for the total sample was 0.88 and the estimates for subgroups ranged from 0.87 to 0.92.

CONCLUSION

Little DIF of high magnitude or impact was observed in the PROMIS Applied Cognition - General Concerns short form item set. One item, "It has seemed like my brain was not working as well as usual" might be singled out for further study. However, in general the short form item set was highly reliable, informative, and invariant across differing race/ethnic, educational, age, gender, and language groups.

The applicability of the cognitive abilities screening instrument-short (CASI-S) in primary care in Brazil

BACKGROUND

The Cognitive Abilities Screening Instrument - Short (CASI-S) is a brief cognitive screening test. However, there is limited information regarding its applicability in primary care.

OBJECTIVES

To ascertain whether the CASI-S differentiates between dementia patients and normal controls in primary care; to examine its correlation with other cognitive instruments, to analyze its internal consistency, test-retest stability, and diagnostic accuracy.

METHODS

In a case-control study, carried out at two Primary Care Units (PCUs) in the eastern region of the city of São Paulo, 47 older adults were diagnosed with dementia according to DSM-IV criteria (mean age = 76.81 ± 7.03 years), and 55 were classified as normal controls (mean age = 72.78 ± 7.37 years), by a multidisciplinary panel which had access to results from a comprehensive cognitive battery and the patients' health data. The present analyses included results from the Mini-Mental State Examination (MMSE). The CASI-S was not used to determine diagnostic status.

RESULTS

The CASI-S was easily applied in the primary care setting. There was a significant performance difference (p < 0.001) between dementia patients (15.57 ± 7.40) and normal controls (26.67 ± 3.52) on the CASI-S. CASI-S scores correlated with age (ρ = -0.410, p < 0.001), educational level (ρ = 0.373, p < 0.001), and MMSE score (ρ = 0.793, p < 0.001). The internal consistency of the CASI-S was high (α = 0.848) and the correlation between test and retest was 0.688, suggesting adequate temporal stability. In the ROC curve analyses, scores of 22/23 generated an area under the curve of 0.907, with sensitivity of 93% and specificity of 81%.

CONCLUSIONS

The CASI-S can be useful for dementia screening in primary care in Brazil.

Effects of education and race on cognitive decline: An integrative study of generalizability versus study-specific results

The objective of the study was to examine variability across multiple prospective cohort studies in level and rate of cognitive decline by race/ethnicity and years of education. We compare data across studies, we harmonized estimates of common latent factors representing overall or general cognitive performance, memory, and executive function derived from the: (a) Washington Heights, Hamilton Heights, Inwood Columbia Aging Project (N = 4,115), (b) Spanish and English Neuropsychological Assessment Scales (N = 525), (c) Duke Memory, Health, and Aging study (N = 578), and (d) Neurocognitive Outcomes of Depression in the Elderly (N = 585). We modeled cognitive change over age for cognitive outcomes by race, education, and study. We adjusted models for sex, dementia status, and study-specific characteristics. The results found that for baseline levels of overall cognitive performance, memory, and executive function, differences in race and education tended to be larger than between-study differences and consistent across studies. This pattern did not hold for rate of cognitive decline: effects of education and race/ethnicity on cognitive change were not consistently observed across studies, and when present were small, with racial/ethnic minorities and those with lower education declining at faster rates. In this diverse set of datasets, non-Hispanic Whites and those with higher education had substantially higher baseline cognitive test scores. However, differences in the rate of cognitive decline by race/ethnicity and education did not follow this pattern. This study suggests that baseline test scores and longitudinal change have different determinants, and future studies to examine similarities and differences of causes of cognitive decline in racially/ethnically and educationally diverse older groups is needed.

Differential item functioning due to cognitive status does not impact depressive symptom measures in four heterogeneous samples of older adults

OBJECTIVE

The objective of this study is to determine whether differential item functioning (DIF) due to cognitive status impacted three depressive symptoms measures commonly used with older adults.

METHODS

Differential item functioning in depressive symptoms was assessed among participants (N = 3558) taking part in four longitudinal studies of cognitive aging, using the Geriatric Depression Scale, the Montgomery-Åsberg Depression Rating Scale, and the Center for Epidemiologic Studies Depression Scale. Participants were grouped by cognitive status using a general cognitive performance score derived from each study's neuropsychological battery and linked to a national average using a population-based survey representative of the US population. The Clinical Dementia Rating score was used as an alternate grouping variable in three of the studies.

RESULTS

Although statistically significant DIF based on cognitive status was found for some depressive symptom items (e.g., items related to memory complaints, appetite loss, lack of energy, and mood), the effect of item bias on the total score for each scale was negligible.

CONCLUSIONS

The depressive symptoms scales in these four studies measured depression in the same way, regardless of cognitive status. This may reduce concerns about using these depression measures in cognitive aging research, as relationships between depression and cognitive decline are unlikely to have been due to item bias, at least in the ways that were measured in the datasets we considered.

Demographic characteristics do not decrease the utility of depressive symptoms assessments: examining the practical impact of item bias in four heterogeneous samples of older adults

OBJECTIVE

Previous studies have identified differential item function (DIF) in depressive symptoms measures, but the impact of DIF has been rarely reported. Given the critical importance of depressive symptoms assessment among older adults, we examined whether DIF due to demographic characteristics resulted in salient score changes in commonly used measures.

METHODS

Four longitudinal studies of cognitive aging provided a sample size of 3754 older adults and included individuals both with and without a clinical diagnosis of major depression. Each study administered at least one of the following measures: the Center for Epidemiologic Studies Depression scale (20-item ordinal response or 10-item dichotomous response versions), the Geriatric Depression Scale, and the Montgomery-Åsberg Depression Rating Scale. Hybrid logistic regression-item response theory methods were used to examine the presence and impact of DIF due to age, sex, race/ethnicity, and years of education on the depressive symptoms items.

RESULTS

Although statistically significant DIF due to demographic factors was present on several items, its cumulative impact on depressive symptoms scores was practically negligible.

CONCLUSIONS

The findings support substantive meaningfulness of previously reported demographic differences in depressive symptoms among older adults, showing that these individual differences were unlikely to have resulted from item bias attributable to demographic characteristics we examined.

Subjective cognitive complaints of older adults at the population level: an item response theory analysis

Subjective cognitive complaints (SCCs) are increasingly a focus in studies on prodromal Alzheimer disease (AD) and risk for dementia. Little is known about the optimal approach to measure SCCs. We used item response theory (IRT) to examine the characteristics of 24 SCC items in a sample of 3495 older adults pooled from 4 community-based studies. We investigated the potential advantages of IRT scoring over conventional scoring on the basis of participants' item response patterns. Items most likely endorsed by individuals low in SCC severity relate to word retrieval and general subjective memory decline. Items likely endorsed only by individuals high in SCC severity relate to nonepisodic memory changes, such as decline in comprehension, judgment and executive functions, praxis and procedural memory, and social behavior changes. Above and beyond conventional total score, IRT scoring of SCCs was associated with performance on objective cognitive tests, and was associated with cognitive test performance among participants endorsing only 1 SCC item. Thus, IRT scoring captures additional information beyond a simple sum of SCC symptoms. Modern psychometric approaches including IRT may be useful in developing: (1) brief community screening questionnaires; and (2) more sensitive measures of very subtle subjective decline for use in prodromal Alzheimer disease research.

Modifying measures based on differential item functioning (DIF) impact analyses

OBJECTIVE

Measure modification can impact comparability of scores across groups and settings. Changes in items can affect the percent admitting to a symptom.

METHODS

Using item response theory (IRT) methods, well-calibrated items can be used interchangeably, and the exact same item does not have to be administered to each respondent, theoretically permitting wider latitude in terms of modification.

RESULTS

Recommendations regarding modifications vary, depending on the use of the measure. In the context of research, adjustments can be made at the analytic level by freeing and fixing parameters based on findings of differential item functioning (DIF). The consequences of DIF for clinical decision making depend on whether or not the patient's performance level approaches the scale decision cutpoint. High-stakes testing may require item removal or separate calibrations to ensure accurate assessment.

DISCUSSION

Guidelines for modification based on DIF analyses and illustrations of the impact of adjustments are presented.

Explaining differences in episodic memory performance among older African Americans and Whites: the roles of factors related to cognitive reserve and test bias

Older African Americans tend to perform poorly in comparison with older Whites on episodic memory tests. Observed group differences may reflect some combination of biological differences, measurement bias, and other confounding factors that differ across groups. Cognitive reserve refers to the hypothesis that factors, such as years of education, cognitive activity, and socioeconomic status, promote brain resilience in the face of pathological threats to brain integrity in late life. Educational quality, measured by reading test performance, has been postulated as an important aspect of cognitive reserve. Previous studies have not concurrently evaluated test bias and other explanations for observed differences between older African Americans and Whites. We combined data from two studies to address this question. We analyzed data from 273 African American and 720 White older adults. We assessed DIF using an item response theory/ordinal logistic regression approach. DIF and factors associated with cognitive reserve did not explain the relationship between race, and age- and sex-adjusted episodic memory test performance. However, reading level did explain this relationship. The results reinforce the importance of considering education quality, as measured by reading level, when assessing cognition among diverse older adults.

Multiple, correlated covariates associated with differential item functioning (DIF): Accounting for language DIF when education levels differ across languages

Differential item functioning (DIF) occurs when a test item has different statistical properties in subgroups, controlling for the underlying ability measured by the test. DIF assessment is necessary when evaluating measurement bias in tests used across different language groups. However, other factors such as educational attainment can differ across language groups, and DIF due to these other factors may also exist. How to conduct DIF analyses in the presence of multiple, correlated factors remains largely unexplored. This study assessed DIF related to Spanish versus English language in a 44-item object naming test. Data come from a community-based sample of 1,755 Spanish- and English-speaking older adults. We compared simultaneous accounting, a new strategy for handling differences in educational attainment across language groups, with existing methods. Compared to other methods, simultaneously accounting for language- and education-related DIF yielded salient differences in some object naming scores, particularly for Spanish speakers with at least 9 years of education. Accounting for factors that vary across language groups can be important when assessing language DIF. The use of simultaneous accounting will be relevant to other cross-cultural studies in cognition and in other fields, including health-related quality of life.

lordif: An R Package for Detecting Differential Item Functioning Using Iterative Hybrid Ordinal Logistic Regression/Item Response Theory and Monte Carlo Simulations

Logistic regression provides a flexible framework for detecting various types of differential item functioning (DIF). Previous efforts extended the framework by using item response theory (IRT) based trait scores, and by employing an iterative process using group-specific item parameters to account for DIF in the trait scores, analogous to purification approaches used in other DIF detection frameworks. The current investigation advances the technique by developing a computational platform integrating both statistical and IRT procedures into a single program. Furthermore, a Monte Carlo simulation approach was incorporated to derive empirical criteria for various DIF statistics and effect size measures. For purposes of illustration, the procedure was applied to data from a questionnaire of anxiety symptoms for detecting DIF associated with age from the Patient-Reported Outcomes Measurement Information System.

Use of spoken and written Japanese did not protect Japanese-American men from cognitive decline in late life

OBJECTIVES

Spoken bilingualism may be associated with cognitive reserve. Mastering a complicated written language may be associated with additional reserve. We sought to determine if midlife use of spoken and written Japanese was associated with lower rates of late life cognitive decline.

METHODS

Participants were second-generation Japanese-American men from the Hawaiian island of Oahu, born 1900-1919, free of dementia in 1991, and categorized based on midlife self-reported use of spoken and written Japanese (total n included in primary analysis = 2,520). Cognitive functioning was measured with the Cognitive Abilities Screening Instrument scored using item response theory. We used mixed effects models, controlling for age, income, education, smoking status, apolipoprotein E e4 alleles, and number of study visits.

RESULTS

Rates of cognitive decline were not related to use of spoken or written Japanese. This finding was consistent across numerous sensitivity analyses.

DISCUSSION

We did not find evidence to support the hypothesis that multilingualism is associated with cognitive reserve.

Midlife use of written Japanese and protection from late life dementia

BACKGROUND

The cognitive reserve hypothesis would predict that use of written Japanese should confer protection against dementia because of the complexity of its ideograms compared with written English. We sought to test this hypothesis in analyses from a longitudinal study of Japanese-American men.

METHODS

Participants were second-generation Japanese-American men (Nisei) on the island of Oahu, Hawaii, who were seen in 1965 and in subsequent examinations to detect dementia beginning in 1991-1993. Use of spoken and written Japanese was self-reported in 1965 (Analyses 1 and 2), and midlife use of written Japanese and written English was self-reported in 1994-1996 (Analysis 3). We analyzed prevalent dementia outcomes in 1991-1993 (Analysis 1, n = 3139) using logistic regression, and incident dementia outcomes in 1994-2002 (Analysis 2, n = 2299) and in 1997-2002 (Analysis 3, n = 1655) using Cox proportional hazards regression. Dementia outcomes included all-cause dementia, probable and possible Alzheimer disease, and probable vascular dementia. We adjusted models for probable and possible confounders.

RESULTS

Participants who reported proficiency with written Japanese were older and had lower incomes. For Analysis 1, there were 154 prevalent cases of dementia, 74 of Alzheimer disease, and 43 of vascular dementia; for Analysis 2, 236 incident cases of dementia, 138 of Alzheimer disease, and 45 of vascular dementia; and for Analysis 3, 125 incident cases of dementia, 80 of Alzheimer disease, and 20 of vascular dementia. There was no relationship in adjusted models between self-reported proficiency with written Japanese and any dementia outcomes.

CONCLUSIONS

Proficiency with written Japanese does not appear to be protective for dementia.

Top cited papers in International Psychogeriatrics: 6b. Behavioral disorders and caregivers' reaction in Taiwanese patients with Alzheimer's disease

The behavioral and psychological symptoms of dementia (BPSD) are common and serious problems that affect the quality of life of the patients who experience such symptoms as well as their caregivers (Matsui et al., 2006). BPSD present a major challenge in the medical management of cognitively impaired patients. Our paper entitled “Behavioral disorders and caregivers’ reaction in Taiwanese patients with Alzheimer's disease” (hereafter referred to as the “paper”) (Fuh et al., 2001) has been cited widely, reflecting the importance of these clinical issues and the growing international interest in studies of BPSD.