Status of computerized cognitive testing in aging: a systematic review

Now is the Time to Improve Cognitive Screening and Assessment for Clinical and Research Advancement

Alzheimer’s disease (AD) is the only cause of death ranked in the top ten globally without precise early diagnosis or effective means of prevention or treatment. Further, AD was identified as a pandemic [1] well before COVID-19 was dubbed a 21st century pandemic [2]. And now, with the realization of the prominent secondary impacts of pandemics, there is a growing, widespread recognition of the tremendous magnitude of the impending burden from AD in an aging world population in the coming decades [3]. This appreciation has amplified the growing and pressing need for a new, efficacious, and practical platform to detect and track cognitive decline, beginning in the preliminary (prodromal) phases of the disease, sensitively, accurately, effectively, reliably, efficiently, and remotely [4–7]. Moreover, the parallel necessity of clarifying and understanding risk factors, developing successful prevention strategies [8–17], and discovering and monitoring viable and effective treatments could all benefit from accurate and efficient screening and assessment platforms. Modern recognition of AD [18] as a common affliction of the elderly began in 1968 with a paper by Blessed, Tomlinson, & Roth [19] in which two tests, one a brief assessment of cognitive function and the other a measure of daily function, demonstrated impairment which was associated with the postmortem counts of neurofibrillary tangles, composed mainly of microtubule-associated protein-tau (tau), in the brain, though not to senile plaques, composed mainly of amyloid-β (Aβ). Even in more recent analyses, the tangles correspond with the severity of dementia more than the plaques [20, 21]. Since 1960, a plethora of cognitive tests, paper and pencil [22, 23], simple screening models [24], and computerized [25–27], have been developed to assess the dysfunction associated with AD. However, there has been limited application of Modern Test Theory, which includes Item Characteristic Curve Analysis, used in the technological development of such tools [28–31], along with widespread failure to understand the underlying AD pathological process to guide test development [32, 33]. The lack of such development has likely been a major contributor to the failure of the field to develop timely screening approaches for AD [34, 35], inaccurate assessment of the progression of AD [36], and even now, failure to find an effective approach to stopping AD.

Using Self-Administered Game-Based Cognitive Assessment to Screen for Degenerative Dementia: A Pilot Study

BACKGROUND

The earlier detection of dementia is needed as cases increase yearly in the aging populations of Taiwan and the world. In recent years, the global internet usage rate has gradually increased among older people. To expand dementia screening and provide timely medical intervention, a simple self-administrated assessment tool to assist in easily screening for dementia is needed.

OBJECTIVE

The two-part goal of this pilot study was, first, to develop a Game-Based Cognitive Assessment (GBCA) tool, and then, to evaluate its validity at early screening for patients with cognitive impairment.

METHOD

The researchers recruited 67 patients with neurocognitive disorders (NCDs) and 57 healthy controls (HCs). Each participant underwent the GBCA and other clinical cognitive assessments (CDR, CASI, and MMSE), and filled out a questionnaire evaluating their experience of using the GBCA. Statistical analyses were used to measure the validity of the GBCA at screening for degenerative dementia.

RESULTS

The average GBCA scores of the HC and NCD groups were 87 (SD = 7.9) and 52 (SD = 21.7), respectively. The GBCA correlated well with the CASI (r2 = 0.90, p <  0.001) and with the MMSE (r2 = 0.92, p <  0.001), indicating concurrent validity. The GBCA cut-off of 75/76 corresponded to measurements of sensitivity, specificity, and area under curve of 85.1%, 91.5%, and 0.978, respectively. The positive predictive value was 91.9%, and the negative predictive value was 84.4%. The results of the user-experience questionnaire for the HC and NCD groups were good and acceptable, respectively.

CONCLUSION

The GBCA is an effective and acceptable tool for screening for degenerative dementia.

Efficacy of cannabis-based medications compared to placebo for the treatment of chronic neuropathic pain: a systematic review with meta-analysis

Background

Chronic neuropathic pain (NP) presents therapeutic challenges. Interest in the use of cannabis-based medications has outpaced the knowledge of its efficacy and safety in treating NP. The objective of this review was to evaluate the effectiveness of cannabis-based medications in individuals with chronic NP.

Methods

Randomized placebo-controlled trials using tetrahydrocannabinol (THC), cannabidiol (CBD), cannabidivarin (CBDV), or synthetic cannabinoids for NP treatment were included. The MEDLINE, Cochrane Library, EMBASE, and Web of Science databases were examined. The primary outcome was the NP intensity. The risk of bias analysis was based on the Cochrane handbook.

Results

The search of databases up to 2/1/2021 yielded 379 records with 17 RCTs included (861 patients with NP). Meta-analysis showed that there was a significant reduction in pain intensity for THC/CBD by -6.624 units (P < .001), THC by -8.681 units (P < .001), and dronabinol by -6.0 units (P = .008) compared to placebo on a 0-100 scale. CBD, CBDV, and CT-3 showed no significant differences. Patients taking THC/CBD were 1.756 times more likely to achieve a 30% reduction in pain (P = .008) and 1.422 times more likely to achieve a 50% reduction (P = .37) than placebo. Patients receiving THC had a 21% higher improvement in pain intensity (P = .005) and were 1.855 times more likely to achieve a 30% reduction in pain than placebo (P < .001).

Conclusion

Although THC and THC/CBD interventions provided a significant improvement in pain intensity and were more likely to provide a 30% reduction in pain, the evidence was of moderate-to-low quality. Further research is needed for CBD, dronabinol, CT-3, and CBDV.

Self-Administered Gerocognitive Examination: longitudinal cohort testing for the early detection of dementia conversion

Background

Significant cognitive changes as individuals’ age are not being identified in a timely manner, delaying diagnosis and treatments. Use of brief, multi-domain, self-administered, objective cognitive assessment tools may remove some barriers in assessing and identifying cognitive changes. We compared longitudinal Self-Administered Gerocognitive Examination (SAGE) test scores to non-self-administered Mini-Mental State Examination (MMSE) scores in 5 different diagnostic subgroups.

Methods

A cohort study evaluating annual rates of change was performed on 665 consecutive patients from Ohio State University Memory Disorders Clinic. Patients with at least two visits 6 months apart evaluated with SAGE and MMSE and classified according to standard clinical criteria as subjective cognitive decline (SCD), mild cognitive impairment (MCI), or Alzheimer’s disease (AD) dementia were included. The pattern of change in SAGE scores was compared to MMSE. One way and repeated measures ANOVA and linear regression models were used.

Results

Four hundred twenty-four individuals (40 SCD, 94 MCI non-converters to dementia, 70 MCI converters to dementia (49 to AD dementia and 21 to non-AD dementia), 220 AD dementia) met inclusion criteria. SAGE and MMSE scores declined respectively at annual rates of 1.91 points/year (p < 0.0001) and 1.68 points/year (p < 0.0001) for MCI converters to AD dementia, and 1.82 points/year (p < 0.0001) and 2.38 points/year (p < 0.0001) for AD dementia subjects. SAGE and MMSE scores remained stable for SCD and MCI non-converters. Statistically significant decline from baseline scores in SAGE occurred at least 6 months earlier than MMSE for MCI converters to AD dementia (14.4 vs. 20.4 months), MCI converters to non-AD dementia (14.4 vs. 32.9 months), and AD dementia individuals (8.3 vs. 14.4 months).

Conclusions

SAGE detects MCI conversion to dementia at least 6 months sooner than MMSE. Being self-administered, SAGE also addresses a critical need of removing some barriers in performing cognitive assessments. Limitations of our single-site cohort study include potential referral and sampling biases. Repetitively administering SAGE and identifying stability or decline may provide clinicians with an objective cognitive biomarker impacting evaluation and management choices.

A Virtual Supermarket Program for the Screening of Mild Cognitive Impairment in Older Adults: Diagnostic Accuracy Study

Background

Mild cognitive impairment (MCI) is often a precursor of dementia, and patients with MCI develop dementia at a higher rate than healthy older adults. Early detection of cognitive decline at the MCI stage supports better planning of care and interventions. At present, the use of virtual reality (VR) in screening for MCI in older adults is promising, but there is little evidence regarding the use of virtual supermarkets to screen for MCI.

Objective

The objectives of this study are to validate a VR game–based test, namely, the Virtual Supermarket Program (VSP), for differentiating patients with MCI and healthy controls and to identify cutoff scores for different age levels.

Methods

Subjects were recruited from several nursing homes and communities in Changchun, China. They were divided into a healthy control group (n=64) and an MCI group (n=62). All subjects were administered the VSP and a series of neuropsychological examinations. The study determined the optimal cutoff, discriminating validity, concurrent validity, and retest reliability of the VSP. We used the area under the receiver operating characteristic curve (AUC) to evaluate the discriminating validity and obtain the optimal cutoff values. Pearson correlation analysis and the intraclass correlation coefficient were used to evaluate the concurrent validity and retest reliability, respectively.

Results

A cutoff score of 46.4 was optimal for the entire sample, yielding a sensitivity of 85.9% and specificity of 79.0% for differentiating individuals with MCI and healthy controls, and the AUC was 0.870 (95% CI 0.799-0.924). The median index of VSP score was 51.1 (range 42.6-60.0). There was a moderate positive correlation between the VSP total score and Mini-Mental State Examination score (r=0.429, P<.001). There was a strong positive correlation between VSP total score and Montreal Cognitive Assessment score (r=0.645, P<.001). The retest reliability of the VSP was feasible (r=0.588, P=.048).

Conclusions

The VSP is interesting and feasible for subjects. It shows high sensitivity and specificity for the identification of MCI in older adults, which makes it a promising screening method. The VSP may be generalized to older adults in other countries, although some cultural adaptation may be necessary.

Trial Registration

Chinese Clinical Trial Registry ChiCTR2000040074; https://www.chictr.org.cn/showprojen.aspx?proj=64639

Diagnostic performance of digital cognitive tests for the identification of MCI and dementia: A systematic review

BACKGROUND

The use of digital cognitive tests is getting common nowadays. Older adults or their family members may use online tests for self-screening of dementia. However, the diagnostic performance across different digital tests is still to clarify. The objective of this study was to evaluate the diagnostic performance of digital cognitive tests for MCI and dementia in older adults.

METHODS

Literature searches were systematically performed in the OVID databases. Validation studies that reported the diagnostic performance of a digital cognitive test for MCI or dementia were included. The main outcome was the diagnostic performance of the digital test for the detection of MCI or dementia.

RESULTS

A total of 56 studies with 46 digital cognitive tests were included in this study. Most of the digital cognitive tests were shown to have comparable diagnostic performances with the paper-and-pencil tests. Twenty-two digital cognitive tests showed a good diagnostic performance for dementia, with a sensitivity and a specificity over 0.80, such as the Computerized Visuo-Spatial Memory test and Self-Administered Tasks Uncovering Risk of Neurodegeneration. Eleven digital cognitive tests showed a good diagnostic performance for MCI such as the Brain Health Assessment. However, all the digital tests only had a few validation studies to verify their performance.

CONCLUSIONS

Digital cognitive tests showed good performances for MCI and dementia. The digital test can collect digital data that is far beyond the traditional ways of cognitive tests. Future research is suggested on these new forms of cognitive data for the early detection of MCI and dementia.

Health Effects of Chronic Intermittent Hypoxia at a High Altitude among Chilean Miners: Rationale, Design, and Baseline Results of a Longitudinal Study

OBJECTIVES

This study aims to assess the health effects on mining workers of exposure to chronic intermittent hypoxia (CIH) at high- and very high-altitude mining compared with similar work at lower altitudes in Chile, and it also aims to constitute the baseline of a 5-year follow-up study.

METHODS

We designed a cross-sectional study to assess health conditions in 483 miners working at 2 levels of altitude exposure: 336 working at a very high or high altitude (HA; 247 above 3900-4400 m, and 89 at 3000-3900 m), and 147 below 2400 m. Subjects were randomly selected in two stages. First, a selection of mines from a census of mines in each altitude stratum was made. Secondly, workers with less than 2 years of employment at each of the selected mines were recruited. The main outcomes measured at the baseline were mountain sickness, sleep alterations, hypertension, body mass index, and neurocognitive functions.

RESULTS

Prevalence of acute mountain sickness (AMS) was 28.4% in the very high-altitude stratum (P = 0.0001 compared with the low stratum), and 71.7% experienced sleep disturbance (P = 0.02). The adjusted odds ratio for AMS was 9.2 (95% confidence interval: 5.2-16.3) when compared with the very high- and low-altitude groups. Motor processing speed and spatial working memory score were lower for the high-altitude group. Hypertension was lower in the highest-altitude subjects, which may be attributed to preoccupational screening even though this was not statistically significant.

CONCLUSIONS

Despite longer periods of acclimatization to CIH, subjects continue to present AMS and sleep disturbance. Compromise of executive functions was detected, including working memory at HA. Further rigorous research is warranted to understand long-term health impacts of high-altitude mining, and to provide evidence-based policy recommendations.

Multimodal Prediction of Alzheimer's Disease Severity Level Based on Resting-State EEG and Structural MRI

While several biomarkers have been developed for the detection of Alzheimer's disease (AD), not many are available for the prediction of disease severity, particularly for patients in the mild stages of AD. In this paper, we explore the multimodal prediction of Mini-Mental State Examination (MMSE) scores using resting-state electroencephalography (EEG) and structural magnetic resonance imaging (MRI) scans. Analyses were carried out on a dataset comprised of EEG and MRI data collected from 89 patients diagnosed with minimal-mild AD. Three feature selection algorithms were assessed alongside four machine learning algorithms. Results showed that while MRI features alone outperformed EEG features, when both modalities were combined, improved results were achieved. The top-selected EEG features conveyed information about amplitude modulation rate-of-change, whereas top-MRI features comprised information about cortical area and white matter volume. Overall, a root mean square error between predicted MMSE values and true MMSE scores of 1.682 was achieved with a multimodal system and a random forest regression model.

Primary Progressive Aphasia: Use of Graphical Markers for an Early and Differential Diagnosis

Primary progressive aphasia (PPA) brings together neurodegenerative pathologies whose main characteristic is to start with a progressive language disorder. PPA diagnosis is often delayed in non-specialised clinical settings. With the technologies' development, new writing parameters can be extracted, such as the writing pressure on a touch pad. Despite some studies having highlighted differences between patients with typical Alzheimer's disease (AD) and healthy controls, writing parameters in PPAs are understudied. The objective was to verify if the writing pressure in different linguistic and non-linguistic tasks can differentiate patients with PPA from patients with AD and healthy subjects. Patients with PPA (n = 32), patients with AD (n = 22) and healthy controls (n = 26) were included in this study. They performed a set of handwriting tasks on an iPad® digital tablet, including linguistic, cognitive non-linguistic, and non-cognitive non-linguistic tasks. Average and maximum writing pressures were extracted for each task. We found significant differences in writing pressure, between healthy controls and patients with PPA, and between patients with PPA and AD. However, the classification of performances was dependent on the nature of the tasks. These results suggest that measuring writing pressure in graphical tasks may improve the early diagnosis of PPA, and the differential diagnosis between PPA and AD.

A randomized, multicenter, crossover psychometric evaluation study of an iPad-administered cognitive test battery in participants with major depressive disorder who responded to treatment with oral antidepressants

BACKGROUND

Performance validity and test-retest reliability of ReVeRe.D, an iPad-administered cognitive test battery in major depressive disorder (MDD) were analyzed.

METHODS

Participants aged 18-59 years had DSM-5 diagnosis of MDD with adequate visual and hearing acuity. All had responded to oral antidepressant treatment for a major depressive episode within the most recent 24-months and were stable with no greater than mild depressive symptoms as evidenced by Montgomery Asberg Depression Rating Scale total score <17. Participants were randomly assigned to 1 of 2 test sequences (AABB or BBAA; A=ReVeRe.D; B=examiner-administered tests) in a crossover design.

RESULTS

244 randomized participants (AABB: n=123; BBAA: n=121) had mean age of 38.3 years; 54.9% had a college, baccalaureate, or higher education. At first administration, Pearson correlation coefficients (PCC) for 6/10 pairs of corresponding ReVeRe.D vs examiner-administered tests exceeded the pre-specified acceptance criterion (PCC=0.53) for the primary analysis; 8 test score pairs had PCC exceeding 0.40. At second administration, PCC for 9/10 test scores pairs exceeded PCC=0.53. Together, the series of PCCs supports the concurrent validity for ReVeRe.D. Test-retest reliability for ReVeRe.D test scores was generally moderate to high.

LIMITATIONS

The study included stable participants with MDD who had responded to oral antidepressant treatment, with most in at least partial remission. The sample was limited to English-speaking participants, and skewed towards white, college-educated women. Further studies in acutely ill MDD patients who represent a broader demographic, are warranted.

CONCLUSIONS

iPad-administered ReVeRe.D is a valid and reliable computerized test battery for assessment of cognitive performance in MDD.

Utility of the iPad NIH Toolbox Cognition Battery in a clinical trial of older adults

BACKGROUND

To demonstrate feasibility and utility of the iPad version of the NIH Toolbox Cognition Battery (NIHTB-CB) in a clinical trial of older adults.

METHODS

Fifty-one adults, aged 55 and older without dementia were tested twice on NIHTB-CB and more traditional paper-and-pencil neuropsychological measures after meal ingestion, with approximately a 4-week interval. We also compared performances at Time 1 and Time 2 for significant change. We also extracted the response times and errors for available NIHTB-CB subtests to determine subtle changes in performance.

RESULTS

Over the interval, improvement in fluid cognitive measures was noted at Time 2 (t = -3.07, p = 0.004), whereas crystallized measures were unchanged. Tests of fluid cognition negatively correlated with age, particularly for the second visit. Analysis of the average speed per item showed that, for two of the tests, speed increased at Time 2. Traditional neuropsychological tests correlated with many of the NIHTB-CB measures. Response times for all five timed tests decreased at Time 2, although only statistically significant for Picture Sequence and Picture Vocabulary.

CONCLUSIONS

The iPad version of the NIH Toolbox Cognition Battery appears to be an adequate measure to assess cognitive functioning in a clinical trial of older adults. Psychometric analyses suggest stability in measures of crystallized functioning, whereas measures of fluid abilities revealed improvements over the short time frame of the study. Response times and errors for individual tests revealed intriguing relationships that should be further evaluated to determine the utility in clinical sample analysis, as this could aid identification of subtle cognitive change over short periods. Additional studies with larger sample sizes will be helpful to understanding the reliability, sensitivity, and specificity of the NIHTB-CB sub-scores in older adults. In addition, further evaluations with clinical populations, including individuals with cognitive impairment, are warranted.

Global Perspectives on Brief Cognitive Assessments for Dementia Diagnosis

BACKGROUND

Timely diagnosis of dementia is a global healthcare priority, particularly in low to middle income countries where rapid increases in older adult populations are expected.

OBJECTIVE

To investigate global perspectives on the role of brief cognitive assessments (BCAs) in dementia diagnosis, strengths and limitations of existing measures, and future directions and needs.

METHODS

This is a qualitative study of 18 dementia experts from different areas of the world. Participants were selected using purposeful sampling based on the following criteria: 1) practicing in countries with projected growth of older adult population of over 100%by 2050; 2) expertise in dementia diagnosis and treatment; 3) involvement in clinical practice and training; and 4) recognition as a national dementia expert based on leadership positions within healthcare system, research, and/or policy work. Participants were individually interviewed in their language of choice over secure videoconference sessions. Interviews were analyzed by a multidisciplinary team using theme identification approach.

RESULTS

Four domains with subthemes emerged illustrating participants' perspectives: 1) strengths of BCAs; 2) limitations of BCAs; 3) needs related to the use of BCAs; and 4) characteristics of an ideal BCA. While most experts agreed that BCAs were important and useful for dementia diagnosis, the themes emphasized the need for development and validation of novel measures that are sensitive, psychometrically sound, and culturally appropriate.

CONCLUSION

BCAs are important for guiding diagnosis and care for dementia patients. Findings provide a roadmap for novel BCA development to assist in diagnostic decision making for clinicians serving a rapidly growing and diverse dementia population.

Clinical Outcome Measure Crosswalks in Alzheimer's Disease: A Systematic Review

BACKGROUND

A key challenge in studies that model outcomes, disease progression, and cost-effectiveness of existing and emerging dementia treatments is the lack of conversion criteria to translate, or 'crosswalk', scores on multiple measurement scales. Clinical status in dementia is commonly characterized in the cognitive, functional, and behavioral domains.

OBJECTIVE

We conducted a systematic review of peer-reviewed dementia measure crosswalks in the three domains.

METHODS

We systematically reviewed published literature for crosswalks between scales used to measure cognitive, functional, or behavioral outcomes in Alzheimer's and related dementias. The search was conducted in PubMed, and additional crosswalks were identified through snowballing and expert input from dementia modelers.

RESULTS

Of the reviewed articles, 2,334 were identified through a PubMed search, 842 articles were sourced from backward and forward citation snowballing, and 8 additional articles were recommended through expert input. 31 papers were eligible for inclusion, listing 74 unique crosswalks. Of those, 62 (83.8%) were between endpoints of the cognitive domain and 12 (16.2%) were either between endpoints of the functional domain or were hybrid in nature. Among crosswalks exclusively in the cognitive domain, a majority involved the Mini-Mental State Examination (MMSE) (37 crosswalks) or the Montreal Cognitive Assessment (MoCA) and its variants (25 crosswalks). MMSE was directly compared to MoCA or MoCA variants in 16 crosswalks.

CONCLUSION

Existing crosswalks between measures of dementia focus largely on a limited selection of outcome measures, particularly MMSE and MoCA. Few crosswalks exist in the functional domain, and no crosswalks were identified for solely behavioral measures.

Current advances in digital cognitive assessment for preclinical Alzheimer's disease

There is a pressing need to capture and track subtle cognitive change at the preclinical stage of Alzheimer's disease (AD) rapidly, cost-effectively, and with high sensitivity. Concurrently, the landscape of digital cognitive assessment is rapidly evolving as technology advances, older adult tech-adoption increases, and external events (i.e., COVID-19) necessitate remote digital assessment. Here, we provide a snapshot review of the current state of digital cognitive assessment for preclinical AD including different device platforms/assessment approaches, levels of validation, and implementation challenges. We focus on articles, grants, and recent conference proceedings specifically querying the relationship between digital cognitive assessments and established biomarkers for preclinical AD (e.g., amyloid beta and tau) in clinically normal (CN) individuals. Several digital assessments were identified across platforms (e.g., digital pens, smartphones). Digital assessments varied by intended setting (e.g., remote vs. in-clinic), level of supervision (e.g., self vs. supervised), and device origin (personal vs. study-provided). At least 11 publications characterize digital cognitive assessment against AD biomarkers among CN. First available data demonstrate promising validity of this approach against both conventional assessment methods (moderate to large effect sizes) and relevant biomarkers (predominantly weak to moderate effect sizes). We discuss levels of validation and issues relating to usability, data quality, data protection, and attrition. While still in its infancy, digital cognitive assessment, especially when administered remotely, will undoubtedly play a major future role in screening for and tracking preclinical AD.

A Game a Day Keeps Cognitive Decline Away? A Systematic Review and Meta-Analysis of Commercially-Available Brain Training Programs in Healthy and Cognitively Impaired Older Adults

The rising prevalence rates of age-related cognitive impairment are a worldwide public concern, bringing about a surge in the number of "brain training" programs commercially available to the general public. Numerous companies advertise that their products improve memory and protect against cognitive decline, though researchers have voiced concerns regarding the validity of such claims. To address this issue, the current meta-analytic investigation examined evidence from 43 studies (encompassing 2,636 participants) to evaluate the efficacy of commercial training programs within two separate populations: healthy older adults and older adults with mild cognitive-impairment (MCI). Seven programs were identified: BrainGymmer, BrainHQ, CogMed, CogniFit, Dakim, Lumosity, and MyBrainTrainer. Analyses yielded small, significant near-transfer effects for both healthy and MCI samples. Far-transfer was not observed for the MCI sample, whereas a small, significant effect was found for subjective but not objective measures of far-transfer in the healthy sample. Analyses of individual domains (combining near-and far-transfer outcomes) yielded significant transfer to executive-functioning, memory, and processing-speed in healthy older adults. After adjusting for publication bias, only the effect size for processing speed remained significant. Transfer to attention, objective everyday functioning, fluid-intelligence, and visuospatial domains was not significant. Thus, whilst "brain training" may be suitable for enjoyment and entertainment purposes, there is currently insufficient empirical evidence to support that such training can improve memory, general cognition, or everyday functioning. This area of research is still in its infancy and warrants further investigation to provide more substantial evidence regarding the efficacy of this rapidly expanding industry.

Reliability and Validity of a Home-Based Self-Administered Computerized Test of Learning and Memory Using Speech Recognition

INTRODUCTION

The objective of this study is to evaluate the reliability and validity of the ReVeRe^TM word list recall test (RWLRT), which uses speech recognition, when administered remotely and unsupervised.

METHODS

Prospective cohort study. Participants included 249 cognitively intact community dwelling older adults. Measures included clinician administered neuropsychological assessments at baseline and unsupervised remotely administered tests of cognition from six time-points over six months.

RESULTS

The RWLRT showed acceptable validity. Reliability coefficients varied across time points, with poor reliability between times 1 and 2 and fair-to-good reliability across the remaining five testing sessions. Practice effects were observed with repeated administration as expected.

DISCUSSION

Unsupervised computerized tests of cognition, particularly word list learning and memory tests that use speech recognition, have significant potential for large scale early detection and long-term tracking of cognitive decline due to AD.

Web-Based Assessment of the Phenomenology of Autobiographical Memories in Young and Older Adults

Autobiographical memories (ABMs) produce rich phenomenological experiences. Although few standardized and comprehensive measures of the phenomenology of ABMs have been developed, a web-based assessment of the full range of phenomenological properties is still missing. In the present study, we aimed to fill this gap and tested the psychometric properties of a web-based version of the Assessment of the Phenomenology of Autobiographical Memory (APAM) in a group of young and older adults. Specifically, taking advantage of the flexibility of web-based assessment methodology, we tested the rating consistency of APAM items, asking participants to rate the phenomenology of their ABMs with respect to seven cues, administered in one per day in seven different days. In each session, we also collected ratings of mood and arousal. Using linear mixed modeling (LMM), we could examine whether the phenomenology ratings differed with respect to age group while controlling for sex, age of the memory, arousal, mood, and specificity of the memory. Results revealed an adequate level of consistency of ratings in both young and older adults. Moreover, LMMs revealed a more intense experience of recollection and reliving (i.e., sensory and emotional) and a higher confidence in memory accuracy in older compared to younger adults. The theoretical and practical usefulness of a web-based assessment of the phenomenology of ABMs are discussed.

A Gamification Framework for Cognitive Assessment and Cognitive Training: Qualitative Study

Background

Cognitive tasks designed to measure or train cognition are often repetitive and presented in a monotonous manner, features that lead to participant boredom and disengagement. In this situation, participants do not put forth their best effort to do these tasks well. As a result, neuropsychologists cannot draw accurate conclusions about the data collected, and intervention effects are reduced. It is assumed that greater engagement and motivation will manifest as improved data quality. Gamification, the use of game elements in nongame settings, has been heralded as a potential mechanism for increasing participant engagement in cognitive tasks. Some studies have reported a positive effect of gamification on participant performance, although most studies have shown mixed results. One reason for these contrasting findings is that most studies have applied poor and heterogeneous design techniques to gamify cognitive tasks. Therefore, an appropriate gamification design framework is needed in these tasks.

Objective

This study aimed to propose a framework to guide the design of gamification in cognitive tasks.

Methods

We employed a design science research (DSR) approach to provide a framework for gamifying cognitive assessments and training by synthesizing current gamification design frameworks and gamification works in cognitive assessment and training, as well as incorporating field experiences. The prototypes of the framework were iteratively evaluated with 17 relevant experts.

Results

We proposed a framework consisting of 7 phases: (1) preparation; (2) knowing users; (3) exploring existing tools for assessing or training a targeted cognitive context and determining the suitability of game-up and mapping techniques; (4) ideation; (5) prototyping using the Objects, Mechanics, Dynamics, Emotions (OMDE) design guideline; (6) development; and (7) disseminating and monitoring.

Conclusions

We found that (1) an intermediate design framework is needed to gamify cognitive tasks, which means that game elements should be selected by considering current cognitive assessment or training context characteristics since game elements may impose an irrelevant cognitive load that, in turn, can jeopardize data quality; (2) in addition to developing a new gamified cognitive task from scratch, 2 gamification techniques are widely used (first, adding game elements to an existing cognitive task and second, mapping an existing game to a cognitive function or impairment to assess or train it); and (3) further research is required to investigate the interplay of cognitive processes and game mechanics.

Memory care approaches to better leverage capacity of dementia specialists: a narrative synthesis

Prior research suggests that a scarcity of dementia specialists could hamper access to disease-modifying Alzheimer's treatments. We describe alternative approaches on how to leverage specialist time for memory care in this narrative synthesis based on 17 semi-structured interviews and a targeted literature review on memory care approaches that leverage specialist time. We identified four types of approaches: community primary care practices empowered with better tools and training; primary care memory clinics; specialty memory clinics and; specialty memory centers. Several approaches to use specialist time efficiently have been implemented and some but not all evaluated. The optimal approach may depend on the local context.

Cognitive Screening Tools for Late Career Physicians: A Critical Review

Screening measures are widely used in medicine to assess the increased probability that members of a defined population have a particular condition and therefore require more extensive assessment. The rationale for prospective screening of late career physicians (LCPs) is drawn from the following circumstances: Senior physicians-prone to the vicissitudes of aging-comprise nearly a third of the US physician workforce, physicians are poor at self-evaluation, data suggest many have clinically relevant cognitive decline, and screening is an evidence-based, method to detect individuals at risk and determine whether a comprehensive evaluation is necessary. A handful of professional organizations (eg, surgeons, obstetricians, and a growing number of medical staff credentialing committees) have developed policies in this arena. This focused review compares cognitive screening methods used or recommended for LCPs, with particular attention to the psychometric properties, ease of operational implementation, and appropriate application to physicians-a population selected for high cognitive reserve and skills. Further, we identify gaps in knowledge and practice, including the need for more career-span normative data on physicians' cognitive and work performance. Stakeholders can improve rehabilitation and other supports to LCPs in transition, calling upon the unique expertise of those neuropsychologists who are trained on conducting fitness for duty evaluations, as well as rehabilitation professionals who can assist in developing modifications to practice when indicated or facilitate graceful transitions to retirement when necessary.

The Survey for Memory, Attention, and Reaction Time (SMART): Development and Validation of a Brief Web-Based Measure of Cognition for Older Adults

INTRODUCTION

Brief, Web-based, and self-administered cognitive assessments hold promise for early detection of cognitive decline in individuals at risk for dementia. The current study describes the design, implementation, and convergent validity of a fWeb-based cognitive assessment tool, the Survey for Memory, Attention, and Reaction Time (SMART), for older adults.

METHODS

A community-dwelling sample of older adults (n = 69) was included, classified as cognitively intact (n = 44) or diagnosed with mild cognitive impairment (MCI, n = 25). Participants completed the SMART at home using their computer, tablet, or other Internet-connected device. The SMART consists of 4 face-valid cognitive tasks available in the public domain assessing visual memory, attention/processing speed, and executive functioning. Participants also completed a battery of standardized neuropsychological tests, a cognitive screener, and a daily function questionnaire. Primary SMART outcome measures consisted of subtest completion time (CT); secondary meta-metrics included outcomes indirectly assessed or calculated within the SMART (e.g., click count, total CT, time to complete practice items, and time of day the test was completed).

RESULTS

Regarding validity, total SMART CT, which includes time to complete test items, practice items, and directions, had the strongest relationship with global cognition (β = -0.47, p < 0.01). Test item CT was significantly greater for the MCI group (F = 5.20, p = 0.026). Of the SMART tasks, the executive functioning subtests had the strongest relationship with cognitive status as compared to the attention/processing speed and visual memory subtests. The primary outcome measures demonstrated fair to excellent test-retest reliability (intraclass correlation coefficient = 0.50-0.76).

CONCLUSIONS

This study provides preliminary evidence for the use of the SMART protocol as a feasible, reliable, and valid assessment method to monitor cognitive performance in cognitively intact and MCI older adults.

Middle-aged and older Black adults' experiences completing a traditional paper-and-pencil cognitive battery and two contemporary computerized cognitive batteries

Traditional neuropsychological batteries may account for disparities in education and may produce testing anxiety, particularly for older Black adults. Computerized batteries may be more amenable to use. The current study used mixed-methods content analysis to explore the perceptions of middle-aged and older Black adults (N = 92) about the CogState Brief Battery (CSBB) and Joggle® computerized battery and a traditional paper-and-pencil neuropsychological battery. The data was analyzed using Atlas.ti. Themes were developed and qualitative responses were converted to quantitative counts to make comparisons to thematic differences based on demographics. Results: The majority of participants liked all three batteries. There were no differences based on demographics. Two prevalent themes across all three measures for what participants liked were 1) mental stimulation and memory, and 2) challenging. A disliked theme specific to the computerized batteries was personal competence. In summary, an array of accessible cognitive batteries is necessary to address individual preferences.

Dual-Task Exercise to Improve Cognition and Functional Capacity of Healthy Older Adults

Background

It has been suggested that physical inactivity and lack of stimulating cognitive activity are the two most significant modifiable risk factors to impair cognitive function. Although many studies that investigated the cognitive effects of physical exercise and cognitive stimuli in dual-task conditions showed improved cognitive performance, others have not confirmed these findings. The main aim of the present work is to analyze the effects of a dual-task multimodal physical exercise training, at moderate intensity, and cognitive stimulation on cognitive and physical function in healthy older adults.

Methods

This clinical trial was registered on the Brazilian Registry of Clinical Trials (RBR-9zrx3d). Here we tested the effects of a dual-task multimodal physical exercise training, at moderate intensity, on cognitive and physical function and quality of life in community dwelling older adults. The training protocol included 24 group sessions, 2/week, per 75 min. Cognition was assessed using CANTAB automated neuropsychological tests and Functional Capacity to Exercise tests. Performance was compared from baseline to post intervention and to a non-exercise control group using Mixed Linear Model for repeated measures.

Results

Control (CG) and dual-task (DTEx) groups progressed differentially over time on performance of episodic memory, sustained visual attention, functional mobility, cardiorespiratory fitness, lower limbs strength resistance, agility, quality of life and dual-task performance with significant improved DTEx performance. Control group did not show any significant changes on these tests except for showing a reduction in dual-task performance.

Conclusion

We suggest that the dual-task combination of multisensory cognitive stimulation and multimodal moderate physical exercise training, twice a week, may be adopted as an effective program to reduce progression of age-related cognitive decline and improve physical fitness and quality of life on healthy older adults.

Clinical Trial Registration

Brazilian Registry of Clinical Trials: https://ensaiosclinicos.gov.br/rg/RBR-9zrx3d -UTN code: U1111-1233-6349.

Feasibility and validation of a web-based platform for the self-administered patient collection of demographics, health status, anxiety, depression, and cognition in community dwelling elderly

The coronavirus disease pandemic has brought a new urgency for the development and deployment of web-based applications which complement, and offer alternatives to, traditional one-on-one consultations and pencil-and-paper (PaP) based assessments that currently dominate clinical research. We have recently developed a web-based application that can be used for the self-administered collection of patient demographics, self-rated health, depression and anxiety, and cognition as part of a single platform. In this study we report the findings from a study with 155 cognitively healthy older adults who received established PaP versions, as well as our novel computerized measures of self-rated health, depression and anxiety, and cognition. Moderate to high correlations were observed between PaP and web- based measures of self-rated health (r = 0.77), depression and anxiety (r = 0.72), and preclinical Alzheimer’s disease cognitive composite (PACC) (r = .61). Test-retest correlations were variable with high correlations for a measure of processing speed and a measure of delayed episodic memory. Taken together, these data support the feasibility and validity of utilization of this novel web-based platform as a new alternative for collecting patient demographics and the assessment of self-rated health, depression and anxiety, and cognition in the elderly.

Current State of Self-Administered Brief Computerized Cognitive Assessments for Detection of Cognitive Disorders in Older Adults: A Systematic Review

Early diagnosis of cognitive disorders in older adults is a major healthcare priority with benefits to patients, families, and health systems. Rapid advances in digital technology offer potential for developing innovative diagnostic pathways to support early diagnosis. Brief self-administered computerized cognitive tools in particular hold promise for clinical implementation by minimizing demands on staff time. In this study, we conducted a systematic review of self-administered computerized cognitive assessment measures designed for the detection of cognitive impairment in older adults. Studies were identified via a systematic search of published peer-reviewed literature across major scientific databases. All studies reporting on psychometric validation of brief (≤30 minutes) self-administered computerized measures for detection of MCI and all-cause dementia in older adults were included. Seventeen studies reporting on 10 cognitive tools met inclusion criteria and were subjected to systematic review. There was substantial variability in characteristics of validation samples and reliability and validity estimates. Only 2 measures evaluated feasibility and usability in the intended clinical settings. Similar to past reviews, we found variability across measures with regard to psychometric rigor and potential for widescale applicability in clinical settings. Despite the promise that self-administered cognitive tests hold for clinical implementation, important gaps in scientific rigor in development, validation, and feasibility studies of these measures remain. Developments in technology and biomarker studies provide potential avenues for future directions on the use of digital technology in clinical care.

A Novel Computerized Cognitive Stress Test to Detect Mild Cognitive Impairment

BACKGROUND

The Loewenstein Acevedo Scales of Semantic Interference and Learning (LASSI-L) is a novel and increasingly employed instrument that has outperformed widely used cognitive measures as an early correlate of elevated brain amyloid and neurodegeneration in prodromal Alzheimer's Disease (AD). The LASSI-L has distinguished those with amnestic mild cognitive impairment (aMCI) and high amyloid load from aMCI attributable to other non-AD conditions. The authors designed and implemented a web-based brief computerized version of the instrument, the LASSI-BC, to improve standardized administration, facilitate scoring accuracy, real-time data entry, and increase the accessibility of the measure.

OBJECTIVE

The psychometric properties and clinical utility of the brief computerized version of the LASSI-L was evaluated, together with its ability to differentiate older adults who are cognitively normal (CN) from those with amnestic Mild Cognitive Impairment (aMCI).

METHODS

After undergoing a comprehensive uniform clinical and neuropsychological evaluation using traditional measures, older adults were classified as cognitively normal or diagnosed with aMCI. All participants were administered the LASSI-BC, a computerized version of the LASSI-L. Test-retest and discriminant validity was assessed for each LASSI-BC subscale.

RESULTS

LASSI-BC subscales demonstrated high test-retest reliability, and discriminant validity was attained.

CONCLUSIONS

The LASSI-BC, a brief computerized version of the LASSI-L is a valid and useful cognitive tool for the detection of aMCI among older adults.

A Survey of Alzheimer's Disease Early Diagnosis Methods for Cognitive Assessment

Dementia is a syndrome that is characterised by the decline of different cognitive abilities. A high rate of deaths and high cost for detection, treatments, and patients care count amongst its consequences. Although there is no cure for dementia, a timely diagnosis helps in obtaining necessary support, appropriate medication, and maintenance, as far as possible, of engagement in intellectual, social, and physical activities. The early detection of Alzheimer Disease (AD) is considered to be of high importance for improving the quality of life of patients and their families. In particular, Virtual Reality (VR) is an expanding tool that can be used in order to assess cognitive abilities while navigating through a Virtual Environment (VE). The paper summarises common AD screening and diagnosis techniques focusing on the latest approaches that are based on Virtual Environments, behaviour analysis, and emotions recognition, aiming to provide more reliable and non-invasive diagnostics at home or in a clinical environment. Furthermore, different AD diagnosis evaluation methods and metrics are presented and discussed together with an overview of the different datasets.

Electronic Cognitive Screen Technology for Screening Older Adults With Dementia and Mild Cognitive Impairment in a Community Setting: Development and Validation Study

BACKGROUND

A digital cognitive test can be a useful and quick tool for the screening of cognitive impairment. Previous studies have shown that the diagnostic performance of digital cognitive tests is comparable with that of conventional paper-and-pencil tests. However, the use of commercially available digital cognitive tests is not common in Hong Kong, which may be due to the high cost of the tests and the language barrier. Thus, we developed a brief and user-friendly digital cognitive test called the Electronic Cognitive Screen (EC-Screen) for the detection of mild cognitive impairment (MCI) and dementia of older adults.

OBJECTIVE

The aim of this study was to evaluate the performance of the EC-Screen for the detection of MCI and dementia in older adults.

METHODS

The EC-Screen is a brief digital cognitive test that has been adapted from the Rapid Cognitive Screen test. The EC-Screen uses a cloud-based platform and runs on a tablet. Participants with MCI, dementia, and cognitively healthy controls were recruited from research clinics and the community. The outcomes were the performance of the EC-Screen in distinguishing participants with MCI and dementia from controls, and in distinguishing participants with dementia from those with MCI and controls. The cohort was randomly split into derivation and validation cohorts based on the participants' disease group. In the derivation cohort, the regression-derived score of the EC-Screen was calculated using binomial logistic regression. Two predictive models were produced. The first model was used to distinguish participants with MCI and dementia from controls, and the second model was used to distinguish participants with dementia from those with MCI and controls. Receiver operating characteristic curves were constructed and the areas under the curves (AUCs) were calculated. The performances of the two predictive models were tested using the validation cohorts. The relationship between the EC-Screen and paper-and-pencil Montreal Cognitive Assessment-Hong Kong version (HK-MoCA) was evaluated by the Pearson correlation coefficient.

RESULTS

A total of 126 controls, 54 participants with MCI, and 63 participants with dementia were included in the study. In differentiating participants with MCI and dementia from controls, the AUC of the EC-Screen in the derivation and validation cohorts was 0.87 and 0.84, respectively. The optimal sensitivity and specificity in the derivation cohorts were 0.81 and 0.80, respectively. In differentiating participants with dementia from those with MCI and controls, the AUC of the derivation and validation cohorts was 0.90 and 0.88, respectively. The optimal sensitivity and specificity in the derivation cohort were 0.83 and 0.83, respectively. There was a significant correlation between the EC-Screen and HK-MoCA (r=-0.67, P<.001).

CONCLUSIONS

The EC-Screen is suggested to be a promising tool for the detection of MCI and dementia. This test can be self-administered or assisted by a nonprofessional staff or family member. Therefore, the EC-Screen can be a useful tool for case finding in primary health care and community settings.

Digital pen technology for conducting cognitive assessments: a cross-over study with older adults

Many digitalized cognitive assessments exist to increase reliability, standardization, and objectivity. Particularly in older adults, the performance of digitized cognitive assessments can lead to poorer test results if they are unfamiliar with the computer, mouse, keyboard, or touch screen. In a cross-over design study, 40 older adults (age M = 74.4 ± 4.1 years) conducted the Trail Making Test A and B with a digital pen (digital pen tests, DPT) and a regular pencil (pencil tests, PT) to identify differences in performance. Furthermore, the tests conducted with a digital pen were analyzed manually (manual results, MR) and electronically (electronic results, ER) by an automized system algorithm to determine the possibilities of digital pen evaluation. ICC(2,k) showed a good level of agreement for TMT A (ICC(2,k) = 0.668) and TMT B (ICC(2,k) = 0.734) between PT and DPT. When comparing MR and ER, ICC(2,k) showed an excellent level of agreement in TMT A (ICC(2,k) = 0.999) and TMT B (ICC(2,k) = 0.994). The frequency of pen lifting correlates significantly with the execution time in TMT A (r = 0.372, p = 0.030) and TMT B (r = 0.567, p < 0.001). A digital pen can be used to perform the Trail Making Test, as it has been shown that there is no difference in the results due to the type of pen used. With a digital pen, the advantages of digitized testing can be used without having to accept the disadvantages.

A new computerized assessment battery for cognition (C-ABC) to detect mild cognitive impairment and dementia around 5 min

This study aimed to develop a new computerized assessment battery for cognition (C-ABC) to detect mild cognitive impairment (MCI) and dementia. We performed C-ABC in subjects with dementia (n = 422), MCI (n = 145), and normal cognition (NC; n = 574), and analyzed by age stratum (50s, 60s, and 70–85 years). To distinguish MCI from NC, the C-ABC total combined score, which were calculated by dividing the C-ABC total score by the C-ABC required time, revealed the best area under the curves (AUC) at 0.838 and 0.735 in the 50s and 60s age groups, respectively; notably, this entire procedure took approximately 5 min. To distinguish dementia from NC and MCI, the partial items of C-ABC (items 3 + 6 combined score) revealed the best AUCs at 0.910, 0.874, and 0.882 in the 50s, 60s, and 70–85 age groups, respectively. Furthermore, the items 3 + 6 combined score established the best AUC at 0.794 in the 70–85 age group to distinguish MCI from NC; this entire procedure took around 2 min. Hence, this study suggests that C-ABC could be a useful tool for detecting dementia or MCI in a short time.

The Number Symbol Coding Task: A brief measure of executive function to detect dementia and cognitive impairment

INTRODUCTION

Alzheimer's disease and related dementias (ADRD) affect over 5.7 million Americans and over 35 million people worldwide. Detection of mild cognitive impairment (MCI) and early ADRD is a challenge to clinicians and researchers. Brief assessment tools frequently emphasize memory impairment, however executive dysfunction may be one of the earliest signs of impairment. To address the need for a brief, easy-to-score, open-access test of executive function for use in clinical practice and research, we created the Number Symbol Coding Task (NSCT).

METHODS

This study analyzed 320 consecutive patient-caregiver dyads who underwent a comprehensive evaluation including the Clinical Dementia Rating (CDR), patient and caregiver versions of the Quick Dementia Rating System (QDRS), caregiver ratings of behavior and function, and neuropsychological testing, with a subset undergoing volumetric magnetic resonance imaging (MRI). Estimates of cognitive reserve were calculated using education, combined indices of education and occupation, and verbal IQ. Psychometric properties of the NSCT including data quality, data distribution, floor and ceiling effects, construct and known-groups validity, discriminability, and clinical profiles were determined.

RESULTS

The patients had a mean age of 75.3±9.2 years (range 38-98y) with a mean education of 15.7±2.8 years (range 6-26y) of education. The patients had a mean CDR-SB of 4.8±4.7 (range 0-18) and a mean MoCA score of 18.6±7.1 (range 1-30). The mean NSCT score was 30.1±13.8 and followed a normal distribution. All healthy controls and MCI cases were able to complete the NSCT. The NSCT showed moderate-to-strong correlations with clinical and neuropsychological measures with the strongest association (all p's < .001) for measures with executive components (e.g., Judgement and Problem Solving box of the CDR, Decision Making and Problem Solving domain of the QDRS, Trailmaking B, and Cognigram Attention and Executive Composite Scores). Women slightly outperformed men, and individuals with lower educational attainment and lower education-occupation indices had lower NSCT scores. Decreasing NSCT scores corresponded to older age, worse cognitive scores, higher CDR sum of boxes scores, worse caregiver ratings of function and behavior, worse patient and informant QDRS ratings, and smaller hippocampal volumes and hippocampal occupancy scores. The NSCT provided excellent discrimination (AUC: .866; 95% CI: .82-.91) with a cut-off score of 36 providing the best combination of sensitivity (0.880) and specificity (0.759). Combining the NSCT with patient QDRS and caregiver QDRS ratings improved discrimination (AUC: .908; 95% CI: .87-.94).

DISCUSSION

The NSCT is a brief, 90-second executive task that incorporates attention, planning and set-switching that can be completed by individuals into the moderate-to-severe stages of dementia. The NSCT may be a useful tool for dementia screening, case-ascertainment in epidemiological or community-based ADRD studies, and in busy primary care settings where time is limited. Combining the NSCT with a brief structured interview tool such as the QDRS may provide excellent power to detect cognitive impairment. The NSCT performed well in comparison to standardized scales of a comprehensive cognitive neurology evaluation across a wide array of sociodemographic variables in a brief fashion that could facilitate its use in clinical care and research.

The Active Brains Digital Intervention to Reduce Cognitive Decline in Older Adults: Protocol for a Feasibility Randomized Controlled Trial

BACKGROUND

Increasing physical activity, improving diet, and performing brain training exercises are associated with reduced cognitive decline in older adults.

OBJECTIVE

In this paper, we describe a feasibility trial of the Active Brains intervention, a web-based digital intervention developed to support older adults to make these 3 healthy behavior changes associated with improved cognitive health. The Active Brains trial is a randomized feasibility trial that will test how accessible, acceptable, and feasible the Active Brains intervention is and the effectiveness of the study procedures that we intend to use in the larger, main trial.

METHODS

In the randomized controlled trial (RCT), we use a parallel design. We will be conducting the intervention with 2 populations recruited through GP practices (family practices) in England from 2018 to 2019: older adults with signs of cognitive decline and older adults without any cognitive decline. Trial participants were randomly allocated to 1 of 3 study groups: usual care, the Active Brains intervention, or the Active Brains website plus brief support from a trained coach (over the phone or by email). The main outcomes are performance on cognitive tasks, quality of life (using EuroQol-5D 5 level), Instrumental Activities of Daily Living, and diagnoses of dementia. Secondary outcomes (including depression, enablement, and health care costs) and process measures (including qualitative interviews with participants and supporters) will also be collected. The trial has been approved by the National Health Service Research Ethics Committee (reference 17/SC/0463).

RESULTS

Results will be published in peer-reviewed journals, presented at conferences, and shared at public engagement events. Data collection was completed in May 2020, and the results will be reported in 2021.

CONCLUSIONS

The findings of this study will help us to identify and make important changes to the website, the support received, or the study procedures before we progress to our main randomized phase III trial.

TRIAL REGISTRATION

International Standard Randomized Controlled Trial Number 23758980; http://www.isrctn.com/ISRCTN23758980.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/18929.

CogniSoft: A Platform for the Automation of Cognitive Assessment and Rehabilitation of Multiple Sclerosis

Cognitive disorders remain a major cause of disability in Multiple Sclerosis (MS). They lead to unemployment, the need for daily assistance, and a poor quality of life. The understanding of the origin, factors, processes, and consequences of cognitive disfunction is key to its prevention, early diagnosis, and rehabilitation. The neuropsychological testing and continuous monitoring of cognitive status as part of the overall evaluation of patients with MS in parallel with clinical and paraclinical examinations are highly recommended. In order to improve health and disease understanding, a close linkage between fundamental, clinical, epidemiological, and socio-economic research is required. The effective sharing of data, standardized data processing, and the linkage of such data with large-scale cohort studies is a prerequisite for the translation of research findings into the clinical setting. In this context, this paper proposes a software platform for the cognitive assessment and rehabilitation of patients with MS called CogniSoft. The platform automates the Beck Depression Inventory (BDI-II) test and diagnostic tests for the evaluation of memory and executive functions based on the nature of Brief International Cognitive Assessment for MS (BICAMS), as well as implementing a set of games for cognitive rehabilitation based on BICAMS. The software architecture, core modules, and technologies used for their implementation are presented. Special attention is given to the development of cognitive tests for diagnostics and rehabilitation. Their automation enables better perception, avoids bias as a result of conducting the classic paper tests of various neurophysiologists, provides easy administration, and allows data collection in a uniform manner, which further enables analysis using statistical and machine learning algorithms. The CogniSoft platform is registered as medical software by the Bulgarian Drug Agency and it is currently deployed in the Neurological Clinic of the National Hospital of Cardiology in Sofia, Bulgaria. The first experiments prove the feasibility of the platform, showing that it saves time and financial resources while providing subjectivity in the interpretation of the cognitive test results.

Tracking Cognitive Performance in the General Population and in Patients with Mild Cognitive Impairment with a Self-Applied Computerized Test (Brain on Track)

Repeated measurements could be helpful to identify patients with early cognitive decline. We compare the variation of cognitive performance over one year in patients with mild cognitive impairment (MCI) and healthy individuals using the Brain on Track self-applied computerized test (BoT). The study was initiated 30 patients with probable MCI and 377 controls from a population-based cohort, who performed the BoT test from home every three months for one year. The scores were compared using a linear mixed-effects model. All participants increased their scores in the first tests, after 120 days MCI patients started to decline, with a statistically significant higher rate. The area under the curve to detect MCI was 0.94. We identified a significant decline in cognitive performance over one year in patients with MCI using BoT and the test presented a high discriminative ability.

Patient and clinician experiences of a computerised cognitive battery for use after concussion: a preliminary qualitative study

Objective:

The Cognition Battery of the National Institute of Health (NIH) Toolbox for Assessment of Neurological and Behavioural Function is a computerised neuropsychological battery recommended for clinical practice, neurological research and clinical trials. We investigated the utility of the NIH Toolbox Cognition Battery (NIHTB-CB) for people with concussion.

Methods:

In this small qualitative study, semi-structured interviews were conducted with five adults with concussion who were participating in a larger study using the NIHTB-CB. Three clinician participants and two cultural advisors familiar with the tool were also interviewed. Interview transcripts were analysed using a general thematic approach and qualitative description.

Results:

Participants described both positive and negative experiences with the NIHTB-CB and using qualitative description, their experiences were organised into three broad themes: (1) using technology for cognitive testing made sense, (2) there were some cultural relevance questions and (3) cognitive testing after concussion could have challenges. They were positive about the computerised format and range of domains assessed for the concussion context but identified the contextual relevance of some content as having potential to impact on performances.

Conclusion:

This was a small study examining the experiences of a select group of participants, but nevertheless does suggest a need for future research validating the NIHTB-CB for use in different cultural and clinical contexts.

Digitization of neuropsychological diagnostics: a pilot study to compare three paper-based and digitized cognitive assessments

Background and objective

The number of people suffering from dementia is increasing worldwide and so is the need for reliable and economical diagnostic instruments. Therefore, the aim of this study was to compare the processing times of the neuropsychological tests Trail Making Tests A and B (TMT-A/B) and Color-Word Interference Test (CWIT), which were performed in both digital and paper versions.

Methods

The pilot study was conducted among 50 healthy participants (age 65–83 years) using a randomized crossover design. The correlations and differences in the individual processing times of the two test versions were statistically analyzed. Further research questions concerned the influence of the individual usage of technology and the technology commitment of participants as well as the influence of the assessed usability on participants’ performance.

Results

Between the two versions (paper-based vs. digital) statistically significant correlations were found in all tests, e.g., TMT-A r(48) = 0.63, p < 0.01; TMT-B r_s(48) = 0.77, p < 0.001). The mean value comparison showed statistically significant differences, e.g., interference table (CWIT) t(49) = 11.24, p < 0.01). Correlations with medium effect were found between the differences in processing times and the individual usage of computer (e.g., r_s(48) = − 0.31) and smartphone (r_s(48) =  − 0.29) and between the processing times of the TMT-B and the usability (r_s(48) = 0.29).

Conclusions

The high correlations between the test procedures appear promising. However, the differences found in the processing times of the two test versions require validation and standardization of digitized test procedures before they can be used in practice.

Episodic-Memory Performance in Machine Learning Modeling for Predicting Cognitive Health Status Classification

BACKGROUND

Memory dysfunction is characteristic of aging and often attributed to Alzheimer's disease (AD). An easily administered tool for preliminary assessment of memory function and early AD detection would be integral in improving patient management.

OBJECTIVE

Our primary aim was to utilize machine learning in determining initial viable models to serve as complementary instruments in demonstrating efficacy of the MemTrax online Continuous Recognition Tasks (M-CRT) test for episodic-memory screening and assessing cognitive impairment.

METHODS

We used an existing dataset subset (n = 18,395) of demographic information, general health screening questions (addressing memory, sleep quality, medications, and medical conditions affecting thinking), and test results from a convenience sample of adults who took the M-CRT test. M-CRT performance and participant features were used as independent attributes: true positive/negative, percent responses/correct, response time, age, sex, and recent alcohol consumption. For predictive modeling, we used demographic information and test scores to predict binary classification of the health-related questions (yes/no) and general health status (healthy/unhealthy), based on the screening questions.

RESULTS

ANOVA revealed significant differences among HealthQScore groups for response time true positive (p = 0.000) and true positive (p = 0.020), but none for true negative (p = 0.0551). Both % responses and % correct had significant differences (p = 0.026 and p = 0.037, respectively). Logistic regression was generally the top-performing learner with moderately robust prediction performance (AUC) for HealthQScore (0.648-0.680) and selected general health questions (0.713-0.769).

CONCLUSION

Our novel application of supervised machine learning and predictive modeling helps to demonstrate and validate cross-sectional utility of MemTrax in assessing early-stage cognitive impairment and general screening for AD.

Benefits of Cochlear Implantation in Middle-Aged and Older Adults

Introduction

Nowadays cochlear implantation (CI) is the treatment of choice in adults in case conventional hearing devices fail. Besides speech perception, an improvement in quality of life and in cognitive performance has been reported. Thereby, the study focused on the impact of age.

Participants and Methods

Thirty middle-aged (MA) between 50 and 64 years and 41 older subjects (OA) aged 65 and older with bilateral severe hearing loss performed a comprehensive computer-based neurocognitive test battery (ALAcog) pre- and 12 months post-implantation. Besides, monosyllabic speech perception in quiet (Freiburg monosyllabic speech test), health-related quality of life (HR-QoL, Nijmegen Cochlear Implant Questionnaire) and depressive symptoms (GDS-15) have been assessed.

Results

Both age groups significantly improved in all three categories after 12 months. No differences were evaluated between MA and OA regarding speech perception and HR-QoL pre- and post-operatively. In contrast, cognitive performance differed between the age groups: pre-operatively OA performed worse in most neurocognitive subdomains like working memory (p=0.04), inhibition (p=0.004), processing speed (p=0.003) and mental flexibility (p=0.01), post-operatively MA outperformed OA only in inhibition (p=0.01). Age only slightly influenced cognitive performance in MA, whereas in OA age per se tremendously impacted on working memory (p=0.04), inhibition (p=0.02), memory (p=0.04) and mental flexibility (p=0.01). Educational level also affected processing speed, mental flexibility (p=0.01) and working memory (p=0.01). This was more pronounced in OA. In both age groups, hearing status had a strong effect on attentional tasks (p=0.01). In MA, depressive symptoms were more influential on cognitive functioning and on HR-QoL than in OA. Improvement in quality of life (p=0.0002) and working memory (p=0.001) was greater for those with a higher pre-operative depression score.

Conclusion

Speech perception and HR-QoL improved in hearing impaired, independently of age. Pre-operative differences in cognitive performance between OA and MA clearly attenuated 12 months after CI. Impact of comorbidities differed between age groups.

A Validation Study of the Inbrain CST: a Tablet Computer-based Cognitive Screening Test for Elderly People with Cognitive Impairment

BACKGROUND

Computerized versions of cognitive screening test could have advantages over pencil-and-paper versions by eliminating rater-dependent factors and saving the time required to score the tests and report the results. We developed a computerized cognitive screening test (Inbrain Cognitive Screening Test [Inbrain CST]) that takes about 30 minutes to administer on a touchscreen computer and is composed of neuropsychological tests already shown to be sensitive in detecting early cognitive decline in Alzheimer's disease (AD). The aims of this study were to 1) introduce normative data for Inbrain CST, 2) verify its reliability and validity, 3) assess clinical usefulness, and 4) identify neuroanatomical correlates of Inbrain CST.

METHODS

The Inbrain CST runs on the Microsoft Windows 10 operating system and comprises 7 subtests that encompass 5 cognitive domains: attention, language, visuospatial, memory, and executive functions. First, we recruited 480 cognitively normal elderly people (age 50-90) from communities nationwide to establish normative data for Inbrain CST. Second, we enrolled 97 patients from our dementia clinic (26 with subjective cognitive decline [SCD], 42 with amnestic mild cognitive impairment [aMCI], and 29 with dementia due to AD) and investigated sensitivity and specificity of Inbrain CST for discriminating cognitively impaired patients from those with SCD using receiver operating characteristic (ROC) curve analyses. Third, we compared the Inbrain CST scores with those from another neuropsychological test battery to obtain concurrent validity and assessed test-retest reliability. Finally, magnetic resonance imaging (MRI)-based cortical thickness analyses were performed to provide anatomical substrates for performances on the Inbrain CST.

RESULTS

First, in the normative sample, the total score on the Inbrain CST was significantly affected by age, years of education, and gender. Second, Inbrain CST scores among the three patient groups decreased in the order of SCD, aMCI, and AD dementia, and the ROC curve analysis revealed that Inbrain CST had good discriminative power for differentiating cognitively impaired patients from those with SCD. Third, the Inbrain CST subtests had high concurrent validity and test-retest reliability. Finally, in the cortical thickness analysis, each cognitive domain score and the total score of Inbrain CST showed distinct patterns of anatomical correlates that fit into the previously known brain-behavior relationship.

CONCLUSION

Inbrain CST had good validity, reliability, and clinical usefulness in detecting cognitive impairment in the elderly. Furthermore, it showed neuroanatomical validity through MRI cortical thinning patterns. These results suggest that Inbrain CST is a useful cognitive screening tool with efficiency and validity to detect mild impairments in cognition in clinical settings.

Computerized cognitive performance assessments in the Brooklyn Cognitive Impairments in Health Disparities Pilot Study

INTRODUCTION

Detecting cognitive impairment in diverse, health disparities communities is an urgent health care priority.

METHODS

The Brooklyn Cognitive Impairments in Health Disparities Pilot Study investigated quantitative aspects and liking of a computerized cognitive performance assessment, Cognigram, among individuals ≥ 40 years in traditional and nontraditional primary care settings.

RESULTS

Cognigram was piloted in the Emergency Department, Family Medicine, and Geriatric Psychiatry clinics: 58 adults (23 men, 35 women), 67.9 ± 9.8 years (range 43-91), completed the Cognigram and 5-item liking survey. The observed liking range was 2 to maximum score 5 (67% scored 4-5; no sex or age differences).

DISCUSSION

The Cognigram was well liked in waiting rooms of primary care settings. Assistance from a trained adult and clinic endorsement were keys to success. How the Cognigram performs in a geographically compact, population-dense global setting, such as Brooklyn with high vascular disease risk and a plethora of health disparities, is being tested.

cCOG: A web-based cognitive test tool for detecting neurodegenerative disorders

INTRODUCTION

Web-based cognitive tests have potential for standardized screening in neurodegenerative disorders. We examined accuracy and consistency of cCOG, a computerized cognitive tool, in detecting mild cognitive impairment (MCI) and dementia.

METHODS

Clinical data of 306 cognitively normal, 120 mild cognitive impairment (MCI), and 69 dementia subjects from three European cohorts were analyzed. Global cognitive score was defined from standard neuropsychological tests and compared to the corresponding estimated score from the cCOG tool containing seven subtasks. The consistency of cCOG was assessed comparing measurements administered in clinical settings and in the home environment.

RESULTS

cCOG produced accuracies (receiver operating characteristic-area under the curve [ROC-AUC]) between 0.71 and 0.84 in detecting MCI and 0.86 and 0.94 in detecting dementia when administered at the clinic and at home. The accuracy was comparable to the results of standard neuropsychological tests (AUC 0.69-0.77 MCI/0.91-0.92 dementia).

DISCUSSION

cCOG provides a promising tool for detecting MCI and dementia with potential for a cost-effective approach including home-based cognitive assessments.

A Computerized Assessment of Verbal and Visuospatial Memory (Dys)functions in Patients with Rheumatoid Arthritis

Purpose

Rheumatoid arthritis (RA) is a chronic inflammatory systemic disease associated with various degrees of impairment across different cognitive domains. We aimed to provide a detailed computerized investigation of verbal and visuospatial short-term and working memory (dys)functions in RA patients, assessing both accuracy and response speed, while relating them to age, disease-related activity, affective problems, psychomotor speed and other clinical parameters.

Patients and Methods

The study included 29 RA patients (mean age 50.6 ± 12.3 years, 79% female) and 30 controls (matched according to age, gender and education), assessed with short-term and working memory tasks from the Cambridge Neuropsychological Test Automated Battery (CANTAB) and the Automated Working Memory Assessment (AWMA).

Results

RA patients were significantly slower on the basic processing speed test (Motor Screening Test, p =0.003). Their short-term information storage (verbal and visuospatial) was comparable to controls, yet this similar accuracy came at the expense of a longer response time to retain information correctly (on spatial span, p = 0.04). On tasks with higher executive demands, both visuospatial and verbal working memory were compromised, as RA patients took longer (p = 0.004) and had a higher number of total errors (p = 0.02) when conducting a strategic memory-guided search (Spatial Working Memory), and had a significantly lower verbal working memory span on the backwards digit recall test (p = 0.02).

Conclusion

The findings of this study emphasize the usefulness of performing computerized tests to detect subtle signs of cognitive impairment and of intact performance, which can inform memory training protocols for this vulnerable population.

Older Black Adults' Satisfaction and Anxiety Levels After Completing Alternative Versus Traditional Cognitive Batteries

OBJECTIVE

The objective of this study was to examine satisfaction, test anxiety, and performance using computer-based cognitive batteries versus a paper-and-pencil neuropsychological battery among older Blacks.

METHOD

Self-identified Black adults (n = 87, age range: 55-86; mean education = 14) completed two computer-based tests (CogState and Joggle) and a paper-and-pencil neuropsychological battery. After each battery, participants reported their testing anxiety and satisfaction using the batteries. Descriptive, correlational, and regression analyses compared satisfaction, anxiety, and performance across the batteries.

RESULTS

Majority of the participants reported more satisfaction with the computer-based (Joggle: 66%; CogState: 77%) than the neuropsychological (52%) battery. Participants also reported less testing anxiety after completing the computer-based batteries than the neuropsychological battery, F(2, 172) = 22.96, p < .001. Older adults' familiarity and comfort level with the computer were not associated with their performance on the computer-based tests (p > .05). Although testing anxiety was not associated with performance across the batteries, age and education quality were uniquely associated with performance on the CogState and neuropsychological batteries.

CONCLUSIONS

Computer-based cognitive batteries appear to be less intimidating than the commonly used paper-and-pencil neuropsychological tests for Black adults. Thus, these cognitive batteries may be useful tools for monitoring older Blacks' cognitive status.

Comparing Web-Based and Lab-Based Cognitive Assessment Using the Cambridge Neuropsychological Test Automated Battery: A Within-Subjects Counterbalanced Study

Background

Computerized assessments are already used to derive accurate and reliable measures of cognitive function. Web-based cognitive assessment could improve the accessibility and flexibility of research and clinical assessment, widen participation, and promote research recruitment while simultaneously reducing costs. However, differences in context may influence task performance.

Objective

This study aims to determine the comparability of an unsupervised, web-based administration of the Cambridge Neuropsychological Test Automated Battery (CANTAB) against a typical in-person lab-based assessment, using a within-subjects counterbalanced design. The study aims to test (1) reliability, quantifying the relationship between measurements across settings using correlational approaches; (2) equivalence, the extent to which test results in different settings produce similar overall results; and (3) agreement, by quantifying acceptable limits to bias and differences between measurement environments.

Methods

A total of 51 healthy adults (32 women and 19 men; mean age 36.8, SD 15.6 years) completed 2 testing sessions, which were completed on average 1 week apart (SD 4.5 days). Assessments included equivalent tests of emotion recognition (emotion recognition task [ERT]), visual recognition (pattern recognition memory [PRM]), episodic memory (paired associate learning [PAL]), working memory and spatial planning (spatial working memory [SWM] and one touch stockings of Cambridge), and sustained attention (rapid visual information processing [RVP]). Participants were randomly allocated to one of the two groups, either assessed in-person in the laboratory first (n=33) or with unsupervised web-based assessments on their personal computing systems first (n=18). Performance indices (errors, correct trials, and response sensitivity) and median reaction times were extracted. Intraclass and bivariate correlations examined intersetting reliability, linear mixed models and Bayesian paired sample t tests tested for equivalence, and Bland-Altman plots examined agreement.

Results

Intraclass correlation (ICC) coefficients ranged from ρ=0.23-0.67, with high correlations in 3 performance indices (from PAL, SWM, and RVP tasks; ρ≥0.60). High ICC values were also seen for reaction time measures from 2 tasks (PRM and ERT tasks; ρ≥0.60). However, reaction times were slower during web-based assessments, which undermined both equivalence and agreement for reaction time measures. Performance indices did not differ between assessment settings and generally showed satisfactory agreement.

Conclusions

Our findings support the comparability of CANTAB performance indices (errors, correct trials, and response sensitivity) in unsupervised, web-based assessments with in-person and laboratory tests. Reaction times are not as easily translatable from in-person to web-based testing, likely due to variations in computer hardware. The results underline the importance of examining more than one index to ascertain comparability, as high correlations can present in the context of systematic differences, which are a product of differences between measurement environments. Further work is now needed to examine web-based assessments in clinical populations and in larger samples to improve sensitivity for detecting subtler differences between test settings.

A Comparison of Electronic and Paper Versions of the Montreal Cognitive Assessment

OBJECTIVE

The objective of this study was to investigate older adults' performance on the paper and electronic Montreal Cognitive Assessment (eMoCA).

DESIGN

Repeated measures and correlational design.

PARTICIPANTS

A convenience sample of 40 adults over 65 years of age living in the community.

INTERVENTIONS

Participants completed the eMoCA and paper Montreal Cognitive Assessment (MoCA) in a randomized order during 1 session. Participants reported their touchscreen experience and comfort and indicated their modality preferences.

MAIN OUTCOME MEASURES

The primary outcome measures were paper MoCA and eMoCA total and subscale scores. Secondary outcome measures included participants' reported touchscreen experience and comfort, as well as post-administration preferences.

RESULTS

A moderate statistically significant correlation was found between eMoCA and paper MoCA performance across all participants. Analysis comparing first administration modality only (eMoCA vs. paper MoCA) found no statistically significant difference in total scores; however, there was a statistically significant difference for the visuospatial/executive subscale, which required physical interaction with paper or the tablet. For this subscale, participants scored lower on the eMoCA versus paper MoCA. There was a statistically significant correlation between experience with touchscreen devices and performance on the eMoCA, but not between modality preference and performance.

CONCLUSION

Modality of administration can affect performance on cognitive assessments. Clinicians should consider individuals' level of touchscreen experience before selecting administration modality.

Comparing a visual and verbal semantic memory test on the effects of gender, age and education as assessed in a cognitively healthy sample : A pilot study in the development of the international neuropsychological test profile-a tablet-based cognitive assessment

Background

Due to the increase of dementia diagnoses and individuals interested in monitoring their cognitive status, practical new neuropsychological tests are needed. Tablet-based tests offer a good alternative to traditional paper–pencil tests, as they can be completed remotely and independently. This study assessed two semantic memory tests (verbal and visual memory), in the scope of the creation of a new tablet-based battery—the International Neurocognitive Profil (INCP)—on the influences of demographic variables.

Methods

In all, 46 cognitively healthy participants who recruited at the memory clinic of the Medical University of Vienna were included in this study. They were asked to complete two tests of semantic memory and implicit learning: Capital Knowledge (CK) using verbal input and Flag Knowledge (FK) using visual input. Performance on the two tests was analysed according to influences of gender and age using two analyses of variance. Post hoc comparisons between age and gender groups were performed. In addition, correlational analyses were computed to assess strengths of association with age, gender and education.

Results

FK- and CK-based measures were found to be influenced by demographic variables with semantic memory measures being significantly influenced by gender and education while incidental memory measures were influenced by age. Performances differed between FK and CK showing that the mode of testing (visual, verbal) affected participant’s performance.

Conclusion

These findings are important for the creation of normative samples for both CK and FK. Furthermore, this study underlines the importance of using different testing modes when assessing individuals’ semantic memory.

BHA-CS: A novel cognitive composite for Alzheimer's disease and related disorders

INTRODUCTION

Composite scores based on psychometrically rigorous cognitive assessments are well suited for early diagnosis and disease monitoring.

METHODS

We developed and cross-validated the Brain Health Assessment-Cognitive Score (BHA-CS), based on a brief computerized battery, in 451 cognitively normal (CN) and 399 cognitively impaired (mild cognitive impairment [MCI] or dementia) older adults. We investigated its long-term reliability and reliable change indices at longitudinal follow-up (N = 340), and the association with amyloid beta (Aβ) burden in the CN subgroup with Aβ positron emission tomography (N = 119).

RESULTS

The BHA-CS was accurate at detecting cognitive impairment and exhibited excellent long-term stability. Reliable decline over one year was detected in 75% of participants with dementia, 44% with MCI, and 3% of CN. Among CN, the Aβ-positive group showed worse longitudinal performance on the BHA-CS compared to the Aβ-negative group.

DISCUSSION

The BHA-CS is sensitive to cognitive decline in preclinical and prodromal neurodegenerative disease.

Evidence of Validity for a Newly Developed Digital Cognitive Test Battery

Clinical practice still relies heavily on traditional paper-and-pencil testing to assess a patient’s cognitive functions. Digital technology has the potential to be an efficient and powerful alternative, but for many of the existing digital tests and test batteries the psychometric properties have not been properly established. We validated a newly developed digital test battery consisting of digitized versions of conventional neuropsychological tests. Two confirmatory factor analysis models were specified: a model based on traditional neuropsychological theory and expert consensus and one based on the Cattell-Horn-Carroll (CHC) taxonomy. For both models, the outcome measures of the digital tests loaded on the cognitive domains in the same way as established in the neuropsychological literature. Interestingly, no clear distinction could be made between the CHC model and traditional neuropsychological model in terms of model fit. Taken together, these findings provide preliminary evidence for the structural validity of the digital cognitive test battery.