Pilot Evaluation of the Unsupervised, At-Home Cogstate Brief Battery in ADNI-2

Engagement in online cognitive testing with the Cogstate brief battery among a multinational cohort of people with focal epilepsy

OBJECTIVE

The Human Epilepsy Project (HEP) is a large multinational cohort study of people with newly diagnosed and treated focal epilepsy. HEP utilized the Cogstate Brief Battery (CBB) as a self-directed online assessment to examine cognitive outcomes in study participants. The CBB has previously been validated in healthy individuals and people with various brain disorders, but its use in adults participating in HEP has not been assessed. In this study, we describe how the CBB was used in the HEP cohort and assess factors associated with test completion among study participants.

METHODS

Enrollment data for HEP included 408 participants with comprehensive enrollment records, of whom 249 completed CBB assessments. HEP enrolled cognitively normal-range participants between the ages of 12 and 60 from June 29, 2012, to November 7, 2017, with newly diagnosed focal epilepsy and within 4 months of initial treatment. Baseline participant characteristics were analyzed, including demographics, pre-treatment seizure histories, MRI abnormalities, and the presence of any learning difficulties while in school, including formal learning disability diagnoses, repeated grades, and remediation. HEP participant characteristics for those who completed CBB testing were compared to those who did not using multiple logistic regression.

RESULTS

The analysis of HEP participants who completed CBB testing showed that, after controlling for other factors, male participants were more likely to engage in testing (OR 2.14, 95 % CI 1.29 to 3.5, p < 0.01), Black subjects were less likely (OR 0.45, 95 % CI 0.22 to 0.9, p = 0.02), primary English speakers were more likely (OR 3.1, 95 % CI 1.21 to 7.96, p = 0.02), and those with a history of learning challenges were less likely (OR 0.69, 95 % CI 0.49 to 0.97, p = 0.03). There were no significant associations between completing CBB testing and age, employment (employed or student vs not), education (higher education vs not), diagnostic delay, pre-diagnostic seizure burden, or initial seizure semiology (motor vs non-motor).

SIGNIFICANCE

The findings from this study highlight factors associated with the application of remote and unsupervised assessments of cognition in a prospective cohort of adults with focal epilepsy. These factors can be considered when interpreting performance on the CBB in HEP, as well as assisting the design of future studies that use similar approaches.

Digital cognitive assessments as low-burden markers for predicting future cognitive decline and tau accumulation across the Alzheimer's spectrum

Digital cognitive assessments, particularly those that can be done at home, present as low burden biomarkers for participants and patients alike, but their effectiveness in diagnosis of Alzheimer's or predicting its trajectory is still unclear. Here, we assessed what utility or added value these digital cognitive assessments provide for identifying those at high risk for cognitive decline. We analyzed >500 ADNI participants who underwent a brief digital cognitive assessment and Aβ/tau PET scans, examining their ability to distinguish cognitive status and predict cognitive decline. Performance on the digital cognitive assessment were superior to both cortical Aβ and entorhinal tau in detecting mild cognitive impairment and future cognitive decline, with mnemonic discrimination deficits emerging as the most critical measure for predicting decline and future tau accumulation. Digital assessments are effective in identifying at-risk individuals, supporting their utility as low-burden tools for early Alzheimer's detection and monitoring.

The Alzheimer's Disease Neuroimaging Initiative in the era of Alzheimer's disease treatment: A review of ADNI studies from 2021 to 2022

The Alzheimer's Disease Neuroimaging Initiative (ADNI) aims to improve Alzheimer's disease (AD) clinical trials. Since 2006, ADNI has shared clinical, neuroimaging, and cognitive data, and biofluid samples. We used conventional search methods to identify 1459 publications from 2021 to 2022 using ADNI data/samples and reviewed 291 impactful studies. This review details how ADNI studies improved disease progression understanding and clinical trial efficiency. Advances in subject selection, detection of treatment effects, harmonization, and modeling improved clinical trials and plasma biomarkers like phosphorylated tau showed promise for clinical use. Biomarkers of amyloid beta, tau, neurodegeneration, inflammation, and others were prognostic with individualized prediction algorithms available online. Studies supported the amyloid cascade, emphasized the importance of neuroinflammation, and detailed widespread heterogeneity in disease, linked to genetic and vascular risk, co-pathologies, sex, and resilience. Biological subtypes were consistently observed. Generalizability of ADNI results is limited by lack of cohort diversity, an issue ADNI-4 aims to address by enrolling a diverse cohort.

Retrospective observational study of a novel smartphone app on the management of patients with mild cognitive impairment or mild dementia

Introduction

In this study, we aimed to evaluate the feasibility, utility, and potential effects of LQ-M/D App, a smartphone application developed by Life Quest Inc., Tokyo, Japan, for patients with mild cognitive impairment (MCI) and mild dementia. The app incorporates cognitive and physical exercise training, lifestyle habit acquisition features, and a continuity improvement feature added in the post-update version to enhance user engagement. The continuity improvement feature includes the optimization of training content, and disease education, and enables family monitoring via a family app.

Methods

A retrospective analysis was conducted on app usage, cognitive and exercise training implementation and interruptions, questionnaire response rates, and cognitive assessments in a single institution. A total of 20 patients used the app, with 10 patients using the pre-update version without the continuity improvement feature, and the other 10 patients using the post-update version with the continuity improvement feature.

Results and Conclusion

The results demonstrated that the LQ-M/D App could be effectively used by the study population, and the continuity improvement feature positively influenced app usage in several aspects. Although a potential association between app usage and cognitive ability was suggested, the scatter in the data points warrants cautious interpretation. Limitations of the study included a small sample size, a single institution setting, and the retrospective nature of the study. In the future, a randomized controlled trial design using a larger sample size and multiple institutions to further evaluate the effectiveness of LQ-M/D App in managing MCI and mild dementia should be performed.

Sensitivity of Individual and Composite Test Scores from the Cogstate Brief Battery to Mild Cognitive Impairment and Dementia Due to Alzheimer's Disease

BACKGROUND

The Cogstate Brief Battery (CBB) is a computerized cognitive test battery used commonly to identify cognitive deficits related to Alzheimer's disease (AD). However, AD and normative samples used to understand the sensitivity of the CBB to AD in the clinic have been limited, as have the outcome measures studied.

OBJECTIVE

This study investigated the sensitivity of CBB outcomes, including potential composite scores, to cognitive impairment in mild cognitive impairment (MCI) and dementia due to AD, in carefully selected samples.

METHODS

Samples consisted of 4,871 cognitively unimpaired adults and 184 adults who met clinical criteria for MCI (Clinical Dementia Rating (CDR) = 0.5) or dementia (CDR > 0.5) due to AD and CBB naive. Speed and accuracy measures from each test were examined, and theoretically- and statistically-derived composites were created. Sensitivity and specificity of classification of cognitive impairment were compared between outcomes.

RESULTS

Individual CBB measures of learning and working memory showed high discriminability for AD-related cognitive impairment for CDR 0.5 (AUCs ∼ 0.79-0.88), and CDR > 0.5 (AUCs ∼ 0.89-0.96) groups. Discrimination ability for theoretically derived CBB composite measures was high, particularly for the Learning and Working Memory (LWM) composite (CDR 0.5 AUC = 0.90, CDR > 0.5 AUC = 0.97). As expected, statistically optimized linear composite measures showed strong discrimination abilities albeit similar to the LWM composite.

CONCLUSIONS

In older adults, the CBB is effective for discriminating cognitive impairment due to MCI or AD-dementia from unimpaired cognition with the LWM composite providing the strongest sensitivity.

Associations between Participant Characteristics and Participant Feedback about an Unsupervised Online Cognitive Assessment in a Research Registry

BACKGROUND

This study aims to understand whether and how participant characteristics (age, gender, education, ethnocultural identity) are related to their feedback about taking a remote, unsupervised, online cognitive assessment.

METHODS

The Brain Health Registry is a public online registry which includes cognitive assessments. Multivariable ordinal regressions assessed associations between participant characteristics and feedback responses of older (55+) participants (N=11,553) regarding their Cogstate Brief Battery assessment experience.

RESULTS

Higher age, secondary education or less, Latino identity, and female gender were associated with a poorer assessment experience; higher age and a non-White identity were associated with experiencing the assessment instructions as less clear; and higher age, non-White identity, and secondary education or less were associated with rating additional human support with the assessment as more useful.

DISCUSSION

Our findings highlight the importance of improving the design and instructions of unsupervised, remote, online cognitive assessments to better suit the needs of diverse communities.

Reliability, Validity, and User-Experience of Remote Unsupervised Computerized Neuropsychological Assessments in Community-Living 55- to 75-Year-Olds

BACKGROUND

Self-administered computerized neuropsychological assessments (CNAs) provide lower cost, more accessible alternatives to traditional in-person assessments but lack critical information on psychometrics and subjective experience of older adults in remote testing environments.

OBJECTIVE

We used an online brief battery of computerized tasks selected from the Cogstate Brief Battery (CBB) and Cambridge Brain Sciences (CBS) to 1) determine test-retest reliability in an unsupervised setting; 2) examine convergent validity with a comprehensive 'gold standard' paper-and-pencil neuropsychological test battery administered in-person; and 3) explore user-experience of remote computerized testing and individual tests.

METHODS

Fifty-two participants (mean age 65.8±5.7 years) completed CBB and CBS tests on their own computer, unsupervised from home, on three occasions, and visited a research center for an in-person paper-and-pencil assessment. They also completed a user-experience questionnaire.

RESULTS

Test-retest reliabilities varied for individual measures (ICCs = 0.20 to 0.83). Global cognition composites showed excellent reliability (ICCs > 0.8 over 1-month follow-up). A strong relationship between a combination of CNA measures and paper-and-pencil battery was found (canonical correlation R = 0.87, p = 0.04). Most tests were rated as enjoyable with easy-to-understand instructions. Ratings of general experience with online testing were mostly favorable; few had difficulty concentrating (17%) or using the computer for tasks (10%), although over one-third experienced performance anxiety (38%).

CONCLUSION

A combined brief online battery selected from two CNAs demonstrated robust psychometric standards for reliability (global composite), and convergent validity with a gold standard battery, and mostly good usability and acceptability in the remote testing environment.

Validation of a Remote and Fully Automated Story Recall Task to Assess for Early Cognitive Impairment in Older Adults: Longitudinal Case-Control Observational Study

Background

Story recall is a simple and sensitive cognitive test that is commonly used to measure changes in episodic memory function in early Alzheimer disease (AD). Recent advances in digital technology and natural language processing methods make this test a candidate for automated administration and scoring. Multiple parallel test stimuli are required for higher-frequency disease monitoring.

Objective

This study aims to develop and validate a remote and fully automated story recall task, suitable for longitudinal assessment, in a population of older adults with and without mild cognitive impairment (MCI) or mild AD.

Methods

The “Amyloid Prediction in Early Stage Alzheimer’s disease” (AMYPRED) studies recruited participants in the United Kingdom (AMYPRED-UK: NCT04828122) and the United States (AMYPRED-US: NCT04928976). Participants were asked to complete optional daily self-administered assessments remotely on their smart devices over 7 to 8 days. Assessments included immediate and delayed recall of 3 stories from the Automatic Story Recall Task (ASRT), a test with multiple parallel stimuli (18 short stories and 18 long stories) balanced for key linguistic and discourse metrics. Verbal responses were recorded and securely transferred from participants’ personal devices and automatically transcribed and scored using text similarity metrics between the source text and retelling to derive a generalized match score. Group differences in adherence and task performance were examined using logistic and linear mixed models, respectively. Correlational analysis examined parallel-forms reliability of ASRTs and convergent validity with cognitive tests (Logical Memory Test and Preclinical Alzheimer’s Cognitive Composite with semantic processing). Acceptability and usability data were obtained using a remotely administered questionnaire.

Results

Of the 200 participants recruited in the AMYPRED studies, 151 (75.5%)—78 cognitively unimpaired (CU) and 73 MCI or mild AD—engaged in optional remote assessments. Adherence to daily assessment was moderate and did not decline over time but was higher in CU participants (ASRTs were completed each day by 73/106, 68.9% participants with MCI or mild AD and 78/94, 83% CU participants). Participants reported favorable task usability: infrequent technical problems, easy use of the app, and a broad interest in the tasks. Task performance improved modestly across the week and was better for immediate recall. The generalized match scores were lower in participants with MCI or mild AD (Cohen d=1.54). Parallel-forms reliability of ASRT stories was moderate to strong for immediate recall (mean rho 0.73, range 0.56-0.88) and delayed recall (mean rho=0.73, range=0.54-0.86). The ASRTs showed moderate convergent validity with established cognitive tests.

Conclusions

The unsupervised, self-administered ASRT task is sensitive to cognitive impairments in MCI and mild AD. The task showed good usability, high parallel-forms reliability, and high convergent validity with established cognitive tests. Remote, low-cost, low-burden, and automatically scored speech assessments could support diagnostic screening, health care, and treatment monitoring.

A Paradox in Digital Memory Assessment: Increased Sensitivity With Reduced Difficulty

The One Card Learning Test (OCL80) from the Cogstate Brief Battery-a digital cognitive test used both in-person and remotely in clinical trials and in healthcare contexts to inform health decisions-has shown high sensitivity to changes in memory in early Alzheimer's disease (AD). However, recent studies suggest that OCL sensitivity to memory impairment in symptomatic AD is not as strong as that for other standardized assessments of memory. This study aimed to improve the sensitivity of the OCL80 to AD-related memory impairment by reducing the test difficultly (i.e., OCL48). Experiment 1 showed performance in healthy adults improved on the OCL48 while the pattern separation operations that constrain performance on the OCL80 were retained. Experiment 2 showed repeated administration of the OCL48 at short retest intervals did not induce ceiling or practice effects. Experiment 3 showed that the sensitivity of the OCL48 to AD-related memory impairment (Glass's Δ = 3.11) was much greater than the sensitivity of the OCL80 (Glass's Δ = 1.94). Experiment 4 used data from a large group of cognitively normal older adults to calibrate performance scores between the OCL80 and OCL48 using equipercentile equating. Together these results showed the OCL48 to be a valid and reliable test of learning with greater sensitivity to memory impairment in AD than the OCL80.