Brain health registry updates: An online longitudinal neuroscience platform

Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures

INTRODUCTION

Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies.

METHOD

In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects.

RESULTS

Internal consistency was good across samples (ρxx = .80 to .85, p < .001). Test-retest reliability was marginal (ICC = .49, p < .001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ = .44 to .76, p < .001), while correlations with discriminant measures were small (ρ = .23 to .27, p < .05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to -.21, p < .001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p < .001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p < .001), but there were not significantly more perfect scores.

CONCLUSION

The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples.

Relationship of Hoarding and Depression Symptoms in Older Adults

Hoarding disorder (HD) is a debilitating neuropsychiatric condition that affects 2%-6% of the population and increases in incidence with age. Major depressive disorder (MDD) co-occurs with HD in approximately 50% of cases and leads to increased functional impairment and disability. However, only one study to date has examined the rate and trajectory of hoarding symptoms in older individuals with a lifetime history of MDD, including those with current active depression (late-life depression; LLD). We therefore sought to characterize this potentially distinct phenotype. We determined the incidence of HD in two separate cohorts of participants with LLD (n = 73) or lifetime history of MDD (n = 580) and examined the reliability and stability of hoarding symptoms using the Saving Inventory-Revised (SI-R) and Hoarding Rating Scale-Self Report (HRS), as well as the co-variance of hoarding and depression scores over time. HD was present in 12% to 33% of participants with MDD, with higher rates found in those with active depressive symptoms. Hoarding severity was stable across timepoints in both samples (all correlations >0.75), and fewer than 30% of participants in each sample experienced significant changes in severity between any two timepoints. Change in depression symptoms over time did not co-vary with change in hoarding symptoms. These findings indicate that hoarding is a more common comorbidity in LLD than previously suggested, and should be considered in screening and management of LLD. Future studies should further characterize the interaction of these conditions and their impact on outcomes, particularly functional impairment in this vulnerable population.

Development and Validation of a Vocabulary Measure in the Mobile Toolbox

OBJECTIVE

We describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies.

METHOD

Word Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones.

RESULTS

The final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001).

CONCLUSION

The MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.

Examining Demographic Factors, Psychosocial Wellbeing and Cardiovascular Health in Subjective Cognitive Decline in the Brain Health Registry Cohort

BACKGROUND

Subjective cognitive decline (SCD) is defined as an individual's perception of sustained cognitive decline compared to their normal state while still performing within boundaries for normal functioning. Demographic, psychosocial and medical factors have been linked to age-related cognitive decline, and Alzheimer's dementia (AD). However, their relation to risk for SCD remains unclear. This study aims to identify demographic factors, psychosocial and cardiovascular health associated with SCD within the Brain Health Registry (BHR) online cohort.

METHODS

Participants aged 55+ (N=27,596) in the BHR self-reported SCD measured using the Everyday Cognition Scale (ECog) and medical conditions, depressive symptoms, body mass index, quality of sleep, health, family history of AD, years of education, race, ethnicity and gender. Multivariable linear regression was used to examine whether SCD was associated with demographic, psychosocial, and medical conditions.

RESULTS

We found that advanced age, depressive symptoms, poorer sleep quality and poorer quality of health were positively associated with more self-reported SCD in all models. No race or ethnicity differences were found in association with SCD. Males who reported alcohol and tobacco use or underweight BMI had higher ECog scores compared with females.

CONCLUSION

In addition to well-established risk factors for cognitive decline, such as age, our study consistently and robustly identified a strong association between psychosocial factors and self-reported cognitive decline in an online cohort. These findings provide further evidence that psychosocial health plays a pivotal role in comprehending the risk of SCD and early-stage cognitive ageing. Our findings emphasise the significance of psychosocial factors within the broader context of cardiovascular and demographic risk factors.

Participant completion of longitudinal assessments in an online cognitive aging registry: The role of medical conditions

INTRODUCTION

This study aimed to understand whether older adults' longitudinal completion of assessments in an online Alzheimer's disease and related dementias (ADRD)-related registry is influenced by self-reported medical conditions.

METHODS

Brain Health Registry (BHR) is an online cognitive aging and ADRD-related research registry that includes longitudinal health and cognitive assessments. Using logistic regressions, we examined associations between longitudinal registry completion outcomes and self-reported (1) number of medical conditions and (2) eight defined medical condition groups (cardiovascular, metabolic, immune system, ADRD, current psychiatric, substance use/abuse, acquired, other specified conditions) in adults aged 55+ (N = 23,888). Longitudinal registry completion outcomes were assessed by the completion of the BHR initial questionnaire (first questionnaire participants see at each visit) at least twice and completion of a cognitive assessment (Cogstate Brief Battery) at least twice. Models included ethnocultural identity, education, age, and subjective memory concern as covariates.

RESULTS

We found that the likelihood of longitudinally completing the initial questionnaire was negatively associated with reporting a diagnosis of ADRD and current psychiatric conditions but was positively associated with reporting substance use/abuse and acquired medical conditions. The likelihood of longitudinally completing the cognitive assessment task was negatively associated with number of reported medical conditions, as well as with reporting cardiovascular conditions, ADRD, and current psychiatric conditions. Previously identified associations between ethnocultural identity and longitudinal assessment completion in BHR remained after accounting for the presence of medical conditions.

DISCUSSION

This post hoc analysis provides novel, initial evidence that older adults' completion of longitudinal assessments in an online registry is associated with the number and types of participant-reported medical conditions. Our findings can inform future efforts to make online studies with longitudinal health and cognitive assessments more usable for older adults with medical conditions. The results need to be interpreted with caution due to selection biases, and the under-inclusion of minoritized communities.

Evaluation of the Electronic Clinical Dementia Rating for Dementia Screening

Importance

The Clinical Dementia Rating (CDR) is a well-validated instrument widely used to detect and stage dementia due to Alzheimer disease. The digital Electronic Clinical Dementia Rating (eCDR) can be remotely self-administered and automatically scored, with potential to facilitate efficient dementia screening and staging.

Objective

To evaluate the association of the eCDR with the CDR and other in-clinic assessments for screening older adults for cognitive impairment.

Design, Setting, and Participants

This multisite, cross-sectional study used baseline data from a longitudinal, observational study from 2020 to 2023, including up to 3 years of follow-up. Participants were enrolled from 3 Alzheimer Disease Research Centers and the Brain Health Registry. Participants (aged ≥55 years, with a study partner, and no acute or unstable major medical conditions) were recruited during in-clinic visits or by automated emails.

Exposures

Participants completed the Uniform Data Set Version 3 (UDS; including the CDR) in supervised clinical research settings, and then completed the eCDR remotely, online and unsupervised, using their own device.

Main Outcomes and Measures

The primary outcomes were eCDR scores (item; categorical box and global; continuous box and global), CDR scores (item; categorical box and global), and UDS assessment scores. Associations were evaluated using linear and logistic regressions.

Results

A total of 3565 participants were contacted, and 288 were enrolled. Among 173 participants with item-level data (mean [SD] age, 70.84 [7.65] years; 76 women [43.9%]), eCDR to CDR concordance was 90% or higher for 33 items (63%) and 70% to 89% for 13 items (25%). Box (domain) level concordance ranged from 80% (memory) to 99% (personal care). The global score concordance rate was 81%. κ statistics were fair to moderate. Among 206 participants with box and global scores (mean [SD] age, 71.34 [7.68] years; 95 women [46.1%]), eCDR continuous global score was associated with CDR global (categorical) score with an area under the receiver operating characteristic curve of 0.79 (95% CI, 0.70-0.87). Correlations between eCDR and in-clinic UDS assessments were similar to those between CDR sum of box scores and the same in-clinic assessments.

Conclusions and Relevance

These findings suggest that the eCDR is valid and has potential use for screening and assessment of older adults for cognitive and functional decline related to Alzheimer disease. Instrument optimization and validation in diverse cohorts in remote settings are crucial for evaluating scalability and eCDR utility in clinical research, trials, and health care settings.