A New Remote Guided Method for Supervised Web-Based Cognitive Testing to Ensure High-Quality Data: Development and Usability Study

A digital intervention for cognitive deficits following COVID-19: a randomized clinical trial

Post-COVID-19 cognitive deficits are common, persistent, and disabling. Evidence on effective treatments is limited. The goal of this study was to investigate the efficacy of a digital intervention to reduce cognitive and functional deficits in adults with persistent post-COVID-19 cognitive dysfunction. We used the remotely-delivered intervention in a randomized clinical trial conducted from July 13, 2021 to April 26, 2023. We hypothesized that participants in the intervention group would improve in measures of cognition and daily functioning. Participants were adults with cognitive deficits persisting >4 weeks following acute COVID-19 illness. Of 183 participants screened, 110 were enrolled; 98 participants (78.6% female; mean age = 48.1) completed at least one study visit. Participants were randomized 1:1 to the intervention (AKL-T01) or waitlist control. AKL-T01 is a digital therapeutic using a videogame interface to target attention and executive control. The intervention was delivered remotely for 6 weeks. The primary outcome was change in performance on a sustained attention measure (Digit Symbol Matching Task). The difference in the primary outcome between the intervention (n = 49) and controls (n = 49) was not statistically significant (F [3,261] = 0.12, p = 0.95). Secondary cognitive outcomes of task-switching (F[3,262] = 2.78, p = 0.04) and processing speed (F[3,267] = 4.57, p = 0.004) improved in the intervention relative to control. Secondary measures of functioning also improved in the intervention relative to control, including disability (F[1,82] = 4.02, p = 0.05) and quality of life (F[3,271] = 2.66, p = 0.05). Exploratory analyses showed a greater reduction in total fatigue (F[1,85] = 4.51, p = 0.04), cognitive fatigue (F[1,85] = 7.20, p = 0.009), and anxiety (F[1,87] = 7.42, p = 0.008) in the intervention relative to control. Despite the lack of improvement in sustained attention, select post-COVID-19 cognitive deficits may be ameliorated by targeted cognitive training with AKL-T01, with associated improvements in quality of life and fatigue. If replicated, the scalable nature of this digital intervention may help address substantial need for accessible, effective treatments among individuals with long COVID.

Cut-off point development for the Everyday Memory Questionnaire - Revised in perimenopausal women

OBJECTIVE

Subjective cognitive complaints have been reported in women during perimenopause and the Everyday Memory Questionnaire - Revised (EMQ-R) has been recently evaluated as a standardized instrument to measure subjective cognitive changes. The purpose of this study was to identify potential cut-off points for the EMQ-R retrieval subscale and attentional subscale, and to assess the validity of these cut-off points in detecting objective cognitive changes associated with reported subjective cognitive complaints.

METHOD

After screening, 232 perimenopausal women were included in the analyses. The supervised classification and regression tree was applied to identify optimal cut-off points. Its performance was evaluated by the value of the receiver operating characteristics curve, sensitivity and specificity.

RESULTS

Findings revealed that the optimal cut-off point for the attentional subscale was 7, and for the retrieval subscale was 13. Both cut-off points presented acceptable discrimination performance. An independent t-test indicated that both cut-off points were associated with significant differences in scores on neuropsychological measures of retrieval (episodic memory and verbal fluency) as well as neuropsychological measures of higher-level attention (working memory).

CONCLUSION

The identified cut-off points may be helpful for women to track or quantify their subjective experiences of brain fog or cognitive symptoms during the menopause transition.

Measuring Cognitive Impairments Associated With Schizophrenia in Clinical Practice: Overview of Current Challenges and Future Opportunities

BACKGROUND

Cognitive impairment associated with schizophrenia (CIAS) negatively impacts daily functioning, quality of life, and recovery, yet effective pharmacotherapies and practical assessments for clinical practice are lacking. Despite the pivotal progress made with establishment of the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) Consensus Cognitive Battery (MCCB) for clinical research, implementation of the full MCCB is too time-consuming and cost-ineffective for most clinicians in clinical practice.

STUDY DESIGN

Here we discuss current assessments in relation to delivery format (interview-based and performance-based), validity, ease of use for clinicians and patients, reliability/reproducibility, cost-effectiveness, and suitability for clinical implementation. Key challenges and future opportunities for improving cognitive assessments are also presented.

STUDY RESULTS

Current assessments that require 30 min to complete would have value in clinical settings, but the associated staff training and time required might preclude their application in most clinical settings. Initial profiling of cognitive deficits may require about 30 min to assist in the selection of evidence-based treatments; follow-up monitoring with brief assessments (10-15 min in duration) to detect treatment-related effects on global cognition may complement this approach. Guidance on validated brief cognitive tests for the strategic monitoring of treatment effects on CIAS is necessary.

CONCLUSIONS

With increased advancements in technology-based and remote assessments, development of validated formats of remote and in-person assessment, and the necessary training models and infrastructure required for implementation, are likely to be of increasing clinical relevance for future clinical practice.

Remote Testing of Reading Comprehension in 8-Year-Old Children: Mode and Setting Effects

Proctored remote testing of cognitive abilities in the private homes of test-takers is becoming an increasingly popular alternative to standard psychological assessments in test centers or classrooms. Because these tests are administered under less standardized conditions, differences in computer devices or situational contexts might contribute to measurement biases that impede fair comparisons between test-takers. Because it is unclear whether cognitive remote testing might be a feasible assessment approach for young children, the present study (N = 1,590) evaluated a test of reading comprehension administered to children at the age of 8 years. To disentangle mode from setting effects, the children finished the test either in the classroom on paper or computer or remotely on tablets or laptops. Analyses of differential response functioning found notable differences between assessment conditions for selected items. However, biases in test scores were largely negligible. Only for children with below-average reading comprehension small setting effects between on-site and remote testing were observed. Moreover, response effort was higher in the three computerized test versions, among which, reading on tablets most strongly resembled the paper condition. Overall, these results suggest that, on average, even for young children remote testing introduces little measurement bias.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Potential cognitive and neural benefits of a computerised cognitive training programme based on Structure Learning in healthy adults: study protocol for a randomised controlled trial

BACKGROUND

Cognitive flexibility refers to the capacity to shift between conceptual representations particularly in response to changes in instruction and feedback. It enables individuals to swiftly adapt to changes in their environment and has significant implications for learning. The present study focuses on investigating changes in cognitive flexibility following an intervention programme-Structure Learning training.

METHODS

Participants are pseudo-randomised to either the Training or Control group, while matched on age, sex, intelligence and cognitive flexibility performance. In the Training group, participants undergo around 2 weeks of training (at least 13 sessions) on Structure Learning. In the Control group, participants do not have to undergo any training and are never exposed to the Structure Learning task. The effects of Structure Learning training are investigated at both the behavioural and neural level. We measured covariates that can influence an individual's training performance before the training phase and outcome measures that can potentially show training benefits after the training phase. At the behavioural level, we investigated outcomes in both cognitive and social aspects with a primary focus on executive functions. At the neural level, we employed a multimodality approach and investigated potential changes to functional connectivity patterns, neurometabolite concentration in the frontal brain regions, and brain microstructure and myelination.

DISCUSSION

We reported the development of a novel training programme based on Structure Learning that aims to hone a general learning ability to potentially achieve extensive transfer benefits across various cognitive constructs. Potential transfer benefits can be exhibited through better performance in outcome measures between Training and Control participants, and positive associations between training performance and outcomes after the training in Training participants. Moreover, we attempt to substantiate behavioural findings with evidence of neural changes across different imaging modalities by the Structure Learning training.

TRIAL REGISTRATION

National Institutes of Health U.S. National Library of Medicine ClinicalTrials.gov NCT05611788. Registered on 7 November 2022.

PROTOCOL VERSION

11 May 2023.

Study protocol: How does cognitive flexibility relate to other executive functions and learning in healthy young adults?

BACKGROUND

Cognitive flexibility (CF) enables individuals to readily shift from one concept or mode of practice/thoughts to another in response to changes in the environment and feedback, making CF vital to optimise success in obtaining goals. However, how CF relates to other executive functions (e.g., working memory, response inhibition), mental abilities (e.g., creativity, literacy, numeracy, intelligence, structure learning), and social factors (e.g., multilingualism, tolerance of uncertainty, perceived social support, social decision-making) is less well understood. The current study aims to (1) establish the construct validity of CF in relation to other executive function skills and intelligence, and (2) elucidate specific relationships between CF, structure learning, creativity, career decision making and planning, and other life skills.

METHODS

This study will recruit up to 400 healthy Singaporean young adults (age 18-30) to complete a wide range of cognitive tasks and social questionnaires/tasks. The richness of the task/questionnaire battery and within-participant administration enables us to use computational modelling and structural equation modelling to examine connections between the latent constructs of interest.

SIGNIFICANCE AND IMPACT

The current study is the first systematic investigation into the construct validity of CF and its interrelationship with other important cognitive skills such as learning and creativity, within an Asian context. The study will further explore the concept of CF as a non-unitary construct, a novel theoretical proposition in the field. The inclusion of a structure learning paradigm is intended to inform future development of a novel intervention paradigm to enhance CF. Finally, the results of the study will be useful for informing classroom pedagogy and the design of lifelong learning policies and curricula, as part of the wider remit of the Cambridge-NTU Centre for Lifelong Learning and Individualised Cognition (CLIC).

Validation of a rapid remote digital test for impaired cognition using clinical dementia rating and mini-mental state examination: An observational research study

Background

The Clinical Dementia Rating (CDR) and Mini-Mental State Examination (MMSE) are useful screening tools for mild cognitive impairment (MCI). However, these tests require qualified in-person supervision and the CDR can take up to 60 min to complete. We developed a digital cognitive screening test (M-CogScore) that can be completed remotely in under 5 min without supervision. We set out to validate M-CogScore in head-to-head comparisons with CDR and MMSE.

Methods

To ascertain the validity of the M-CogScore, we enrolled participants as healthy controls or impaired cognition, matched for age, sex, and education. Participants completed the 30-item paper MMSE Second Edition Standard Version (MMSE-2), paper CDR, and smartphone-based M-CogScore. The digital M-CogScore test is based on time-normalised scores from smartphone-adapted Stroop (M-Stroop), digit-symbols (M-Symbols), and delayed recall tests (M-Memory). We used Spearman's correlation coefficient to determine the convergent validity between M-CogScore and the 30-item MMSE-2, and non-parametric tests to determine its discriminative validity with a CDR label of normal (CDR 0) or impaired cognition (CDR 0.5 or 1). M-CogScore was further compared to MMSE-2 using area under the receiver operating characteristic curves (AUC) with corresponding optimal cut-offs.

Results

72 participants completed all three tests. The M-CogScore correlated with both MMSE-2 (rho = 0.54, p < 0.0001) and impaired cognition on CDR (Mann Whitney U = 187, p < 0.001). M-CogScore achieved an AUC of 0.85 (95% bootstrapped CI [0.80, 0.91]), when differentiating between normal and impaired cognition, compared to an AUC of 0.78 [0.72, 0.84] for MMSE-2 (p = 0.21).

Conclusion

Digital screening tests such as M-CogScore are desirable to aid in rapid and remote clinical cognitive evaluations. M-CogScore was significantly correlated with established cognitive tests, including CDR and MMSE-2. M-CogScore can be taken remotely without supervision, is automatically scored, has less of a ceiling effect than the MMSE-2, and takes significantly less time to complete.

'Food for Thought'-The Relationship between Diet and Cognition in Breast and Colorectal Cancer Survivors: A Feasibility Study

Survivors of cancer frequently experience persistent and troublesome cognitive changes. Little is known about the role diet and nutrition plays in survivors' cognition. We explored the feasibility of collecting cross-sectional online data from Australian survivors of breast and colorectal cancer to enable preliminary investigations of the relationships between cognition with fruit and vegetable intake, and the Omega-3 Index (a biomarker of long chain omega 3 fatty acid intake). A total of 76 participants completed online (and postal Omega-3 Index biomarker) data collection (62 breast and 14 colorectal cancer survivors): mean age 57.5 (±10.2) years, mean time since diagnosis 32.6 (±15.6) months. Almost all of the feasibility outcomes were met; however, technical difficulties were reported for online cognitive testing. In hierarchical linear regression models, none of the dietary variables of interest were significant predictors of self-reported or objective cognition. Age, BMI, and length of treatment predicted some of the cognitive outcomes. We demonstrated a viable online/postal data collection method, with participants reporting positive levels of engagement and satisfaction. Fruit, vegetable, and omega-3 intake were not significant predictors of cognition in this sample, however the role of BMI in survivors' cognitive functioning should be further investigated. Future research could adapt this protocol to longitudinally monitor diet and cognition to assess the impact of diet on subsequent cognitive function, and whether cognitive changes impact dietary habits in survivors of cancer.