Validation of a Computerized Cognitive Test Battery for Detection of Dementia and Mild Cognitive Impairment (Preprint)

The Real-World Usability, Feasibility, and Performance Distributions of Deploying a Digital Toolbox of Computerized Assessments to Remotely Evaluate Brain Health: Development and Usability Study

BACKGROUND

An ongoing global challenge is managing brain health and understanding how performance changes across the lifespan.

OBJECTIVE

We developed and deployed a set of self-administrable, computerized assessments designed to measure key indexes of brain health across the visual and auditory sensory modalities. In this pilot study, we evaluated the usability, feasibility, and performance distributions of the assessments in a home-based, real-world setting without supervision.

METHODS

Potential participants were untrained users who self-registered on an existing brain training app called BrainHQ. Participants were contacted via a recruitment email and registered remotely to complete a demographics questionnaire and 29 unique assessments on their personal devices. We examined participant engagement, descriptive and psychometric properties of the assessments, associations between performance and self-reported demographic variables, cognitive profiles, and factor loadings.

RESULTS

Of the 365,782 potential participants contacted via a recruitment email, 414 (0.11%) registered, of whom 367 (88.6%) completed at least one assessment and 104 (25.1%) completed all 29 assessments. Registered participants were, on average, aged 63.6 (SD 14.8; range 13-107) years, mostly female (265/414, 64%), educated (329/414, 79.5% with a degree), and White (349/414, 84.3% White and 48/414, 11.6% people of color). A total of 72% (21/29) of the assessments showed no ceiling or floor effects or had easily modifiable score bounds to eliminate these effects. When correlating performance with self-reported demographic variables, 72% (21/29) of the assessments were sensitive to age, 72% (21/29) of the assessments were insensitive to gender, 93% (27/29) of the assessments were insensitive to race and ethnicity, and 93% (27/29) of the assessments were insensitive to education-based differences. Assessments were brief, with a mean duration of 3 (SD 1.0) minutes per task. The pattern of performance across the assessments revealed distinctive cognitive profiles and loaded onto 4 independent factors.

CONCLUSIONS

The assessments were both usable and feasible and warrant a full normative study. A digital toolbox of scalable and self-administrable assessments that can evaluate brain health at a glance (and longitudinally) may lead to novel future applications across clinical trials, diagnostics, and performance optimization.

An Exploratory Analysis of Contributors to Cognitive Functioning Among Sexual and Gender Minority Individuals Who Had COVID-19

Sexual and gender minority (SGM) individuals face mental health disparities. However, research analyzing SGM people's mental health after a COVID-19 diagnosis is scarce. In this secondary analysis of a remote study, we 1) examined associations between cognitive and psychosocial health and 2) explored differences between these health outcomes among SGM (n = 14) and heterosexual cisgender (n = 64) U.S. adults who had COVID-19. We used the Patient Reported Outcome Measures Information System (PROMIS) v2.0 to assess subjective cognition and the BrainCheck cognitive test to analyze objective cognition. We administered the Perceived Stress Scale and PROMIS 57 Profile V.2.0 to measure psychosocial health. SGM COVID-19 survivors had worse scores in depression, anxiety, sleep disturbance, pain, stress, and objective cognition than heterosexual cisgender participants (p-values < .05). Objective cognition was associated with age, SGM classification, racial or ethnic minority classification, income, comorbidities, COVID-19 severity, number of symptoms, and pain (|0.137| < r < |0.373|, p-values < .05). Subjective cognition was associated with comorbidities, number of symptoms, depression, anxiety, sleep disturbance, pain, and stress (|0.158| < r < |0.537|, p-values < .05). Additional studies are needed to expand what is known about post-COVID-19 health disparities and to guide policies and interventions that promote cognitive functioning.

Objectively measured cognitive dysfunction in patients with primary hyperparathyroidism improves after parathyroidectomy

BACKGROUND

A relationship between primary hyperparathyroidism (PHPT) and decreased quality of life has been shown using patient-reported outcome measures, including Pasieka's Parathyroid Assessment of Symptoms, SF-36, and PROMIS. Despite this, there remains a paucity of objectively measured data demonstrating cognitive dysfunction in patients with PHPT. We assessed whether parathyroidectomy resulted in quantifiable cognitive improvement.

METHODS

We examined 59 consecutive patients with PHPT who underwent parathyroidectomy at a single institution between 2019 and 2021. We used BrainCheck, a clinically validated objective measure of neurocognition, to assess pre- and postoperative neurocognitive changes and evaluated associations between BrainCheck scores and parathyroidectomy using the Wilcoxon signed-rank test.

RESULTS

Of the 59 patients with PHPT who underwent parathyroidectomy and rapid cognitive assessment with BrainCheck, 72.9% were female, 49.2% were White, and 30.5% were African American. A total of 44.1% of patients preoperatively showed neurocognitive dysfunction relative to the general population compared to 22% postoperatively, representing an improvement in 53% of the cohort. Postoperative scores for the entire cohort were significantly higher than preoperative scores (Z =2.85, P = .004). This association remained significant when the cohort was stratified by sex, as both males (Z =2.02, P = .044) and females (Z =2.09, P = .037) had a significant increase in scores. Domain sub-analysis demonstrated a significant association between parathyroidectomy and improved executive function (P < .01).

CONCLUSION

Patients with PHPT experience objectively measurable cognitive changes associated with PHPT that can be reversed by parathyroidectomy, with improvements observed as early as 2 weeks after surgery. Further research with a larger cohort is needed to corroborate our findings.

Assessment of Mild Cognitive Impairment Using CogEvo: A Computerized Cognitive Function Assessment Tool

INTRODUCTION/OBJECTIVES

To assess the utility of the computerized cognitive function assessment tool, CogEvo, as a screening tool for mild cognitive impairment in primary care, we explored the relationship between CogEvo performance, age, and the severity of cognitive dysfunction evaluated by the Mini-Mental State Examination (MMSE).

METHODS

The observational cross-sectional study included 209 individuals' data (mean age 79.4 ± 8.9 years). We conducted a correlation analysis between CogEvo and MMSE scores, compared the performance among the 3 cognitive function groups (MMSE ≥ 28 group; MMSE24-27 group; MMSE ≤ 23 group) using the MMSE cut-off, and evaluated CogEvo's predictive accuracy for cognitive dysfunction through ROC analysis.

RESULTS

Both total CogEvo and MMSE scores significantly decreased with age. A significant positive correlation was observed between total CogEvo and MMSE scores, but a ceiling effect was detected in MMSE performance. Significant differences were observed in the total CogEvo score, including orientation and spatial cognitive function scores, among the 3 groups. CogEvo showed no educational bias. ROC analyses indicated moderate discrimination between the MMSE ≥ 28 group and the MMSE24-27 and MMSE ≤ 23 groups.

CONCLUSIONS

The computer-administered CogEvo has the advantage of not exhibiting ceiling effects or educational bias like the MMSE, and was found to be able to detect age-related cognitive decline and impairment.

Digital Marker for Early Screening of Mild Cognitive Impairment Through Hand and Eye Movement Analysis in Virtual Reality Using Machine Learning: First Validation Study

BACKGROUND

With the global rise in Alzheimer disease (AD), early screening for mild cognitive impairment (MCI), which is a preclinical stage of AD, is of paramount importance. Although biomarkers such as cerebrospinal fluid amyloid level and magnetic resonance imaging have been studied, they have limitations, such as high cost and invasiveness. Digital markers to assess cognitive impairment by analyzing behavioral data collected from digital devices in daily life can be a new alternative. In this context, we developed a "virtual kiosk test" for early screening of MCI by analyzing behavioral data collected when using a kiosk in a virtual environment.

OBJECTIVE

We aimed to investigate key behavioral features collected from a virtual kiosk test that could distinguish patients with MCI from healthy controls with high statistical significance. Also, we focused on developing a machine learning model capable of early screening of MCI based on these behavioral features.

METHODS

A total of 51 participants comprising 20 healthy controls and 31 patients with MCI were recruited by 2 neurologists from a university hospital. The participants performed a virtual kiosk test-developed by our group-where we recorded various behavioral data such as hand and eye movements. Based on these time series data, we computed the following 4 behavioral features: hand movement speed, proportion of fixation duration, time to completion, and the number of errors. To compare these behavioral features between healthy controls and patients with MCI, independent-samples 2-tailed t tests were used. Additionally, we used these behavioral features to train and validate a machine learning model for early screening of patients with MCI from healthy controls.

RESULTS

In the virtual kiosk test, all 4 behavioral features showed statistically significant differences between patients with MCI and healthy controls. Compared with healthy controls, patients with MCI had slower hand movement speed (t49=3.45; P=.004), lower proportion of fixation duration (t49=2.69; P=.04), longer time to completion (t49=-3.44; P=.004), and a greater number of errors (t49=-3.77; P=.001). All 4 features were then used to train a support vector machine to distinguish between healthy controls and patients with MCI. Our machine learning model achieved 93.3% accuracy, 100% sensitivity, 83.3% specificity, 90% precision, and 94.7% F1-score.

CONCLUSIONS

Our research preliminarily suggests that analyzing hand and eye movements in the virtual kiosk test holds potential as a digital marker for early screening of MCI. In contrast to conventional biomarkers, this digital marker in virtual reality is advantageous as it can collect ecologically valid data at an affordable cost and in a short period (5-15 minutes), making it a suitable means for early screening of MCI. We call for further studies to confirm the reliability and validity of this approach.

Effect of different coronary artery revascularization procedures on cognition: A systematic review

Coronary revascularization interventions have been associated with post-intervention cognitive decline. Hence, this systematic review aims to compare the long-term effects of different coronary revascularization interventions on cognition. The Cochrane Library and MEDLINE databases were searched for articles published between January 2009 and January 2023. Articles on clinical trials and cohort studies that compared at least two different interventions with a minimum three months follow up were included to evaluate the consequences of different intervention techniques on cognition. Each selected study was evaluated using a revised tool to assess the risk of bias in randomized trials (RoB 2), and Risk of Bias In Non-Randomized Studies - of Interventions(ROBINS-1) was used for evaluating non-randomized studies. Five eligible studies, with four different comparisons, were included. Out of these studies, three RCTs and two cohort studies were included A participants gone through different procedures; on-pump and off-pump coronary artery bypass grafting (CABG), Percutaneous coronary intervention (PCI conventional cardiopulmonary bypass (CCPB), the miniaturized cardiopulmonary bypass (MCPB) and endoscopic coronary artery bypass grafting (Endo-CABG). These comparisons showed that different interventions have different effects on cognition; however, there is no solid evidence of correlations between them. Thus, the results of this review suggest that there should be greater focus on comparing interventions and that a reasonable follow-up duration should be set to avoid the influence of confounders. There is also a need to determine the effect of long-term cognitive decline while reducing interference by other variables.

Remote assessment of cognitive dysfunction in hematologic malignancies using web-based neuropsychological testing

BACKGROUND

Cognitive impairment is a frequent adverse effect of cancer and its therapies. As neuropsychological assessment is not often standard of care for patients with non-CNS disease, efficient, practical assessment tools are required to track cognition across the disease course. We examined cognitive functioning using a web-based cognitive testing battery to determine if it could detect differences between patients with cancer and controls.

METHODS

We enrolled 22 patients with multiple myeloma (MM) or non-Hodgkin lymphoma (NHL) and 40 healthy controls (mean age = 56 ± 11 years, 52% male). Participants completed the BrainCheck cognitive testing battery and online versions of select measures from the Patient Reported Outcome Measures Information System (PROMIS) during a video conference. MANOVA was used to compare BrainCheck and PROMIS scores between groups controlling for age and sex. An exploratory linear regression analysis was conducted within the cancer group to determine potential contributors to cognitive functioning.

RESULTS

All participants except for one control completed the online assessment measures without difficulty. Compared to controls, the cancer group demonstrated significantly lower scores in objective and subjective cognitive function, physical functioning, and social role performance and elevated fatigue scores. Corticosteroid treatment, immunotherapy, lower physical functioning, lower income, and older age significantly contributed to lower cognitive function (adjusted R²  = 0.925, F = 19.63, p = 0.002).

CONCLUSION

Remote assessment of cognitive and psychosocial functioning is feasible with patients with cancer following treatments. The BrainCheck cognitive testing battery has the potential to detect differences in cognition between patients with cancer and controls.

Validation of the Computerized Cognitive Assessment Test: NNCT

Population aging brings with it cognitive impairment. One of the challenges of the coming years is the early and accessible detection of cognitive impairment. Therefore, this study aims to validate a neuropsychological screening test, self-administered and in software format, called NAIHA Neuro Cognitive Test (NNCT), designed for elderly people with and without cognitive impairment. This test aims to digitize cognitive assessments to add greater accessibility than classic tests, as well as to present results in real time and reduce costs. To this end, a comparison is made with tests such as MMSE, Clock Drawing Test (CDT) and CAMCOG. For this purpose, the following statistical analyses were performed: correlations, ROC curves, and three ANOVAs. The NNCT test evaluates seven cognitive areas and shows a significant and positive correlation with other tests, at total and subareas levels. Scores are established for the detection of both mild cognitive impairment and dementia, presenting optimal sensitivity and specificity. It is concluded that the NNCT test is a valid method of detection of cognitive impairment.

Digital Cognitive Biomarker for Mild Cognitive Impairments and Dementia: A Systematic Review

The dementia population is increasing as the world’s population is growing older. The current systematic review aims to identify digital cognitive biomarkers from computerized tests for detecting dementia and its risk state of mild cognitive impairment (MCI), and to evaluate the diagnostic performance of digital cognitive biomarkers. A literature search was performed in three databases, and supplemented by a Google search for names of previously identified computerized tests. Computerized tests were categorized into five types, including memory tests, test batteries, other single/multiple cognitive tests, handwriting/drawing tests, and daily living tasks and serious games. Results showed that 78 studies were eligible. Around 90% of the included studies were rated as high quality based on the Newcastle–Ottawa Scale (NOS). Most of the digital cognitive biomarkers achieved comparable or even better diagnostic performance than traditional paper-and-pencil tests. Moderate to large group differences were consistently observed in cognitive outcomes related to memory and executive functions, as well as some novel outcomes measured by handwriting/drawing tests, daily living tasks, and serious games. These outcomes have the potential to be sensitive digital cognitive biomarkers for MCI and dementia. Therefore, digital cognitive biomarkers can be a sensitive and promising clinical tool for detecting MCI and dementia.