A brief computerized self-screen for dementia

Validation of a web-based self-administered test for cognitive assessment in a Swedish geriatric setting

Computerized cognitive tests have the potential to cost-effectively detect and monitor cognitive impairments and thereby facilitate treatment for these conditions. However, relatively few of these tests have been validated in a variety of populations. Brain on Track, a self-administered web-based test, has previously been shown to have a good ability to differentiate between healthy individuals and patients with cognitive impairment in Portuguese populations. The objective of this study was to validate the differential ability and evaluate the usability of Brain on Track in a Swedish memory clinic setting. Brain on Track was administered to 30 patients with mild cognitive impairment/mild dementia and 30 healthy controls, all scheduled to perform the test from home after one week and after three months. To evaluate the usability, the patient group was interviewed after completion of the testing phase. Patients scored lower than healthy controls at both the first (median score 42.4 vs 54.1, p<0.001) and the second test (median score 42.3 vs 55.0, p<0.001). The test-retest intra-class correlation was 0.87. A multiple logistic regression model accounting for effects of age, gender and education rendered an ability of Brain on Track to differentiate between the groups with an area under the receiver operation characteristics curve of 0.90 for the first and 0.88 for the second test. In the subjective evaluation, nine patients left positive comments, nine were negative whereas five left mixed comments regarding the test experience. Sixty percent of patients had received help from relatives to log on to the platform. In conclusion, Brain on Track performed well in differentiating healthy controls from patients with cognitive impairment and showed a high test-retest reliability, on par with results from previous studies. However, the substantial proportion of patients needing help to log in could to some extent limit an independent use of the platform.

Using Self-Administered Game-Based Cognitive Assessment to Screen for Degenerative Dementia: A Pilot Study

BACKGROUND

The earlier detection of dementia is needed as cases increase yearly in the aging populations of Taiwan and the world. In recent years, the global internet usage rate has gradually increased among older people. To expand dementia screening and provide timely medical intervention, a simple self-administrated assessment tool to assist in easily screening for dementia is needed.

OBJECTIVE

The two-part goal of this pilot study was, first, to develop a Game-Based Cognitive Assessment (GBCA) tool, and then, to evaluate its validity at early screening for patients with cognitive impairment.

METHOD

The researchers recruited 67 patients with neurocognitive disorders (NCDs) and 57 healthy controls (HCs). Each participant underwent the GBCA and other clinical cognitive assessments (CDR, CASI, and MMSE), and filled out a questionnaire evaluating their experience of using the GBCA. Statistical analyses were used to measure the validity of the GBCA at screening for degenerative dementia.

RESULTS

The average GBCA scores of the HC and NCD groups were 87 (SD = 7.9) and 52 (SD = 21.7), respectively. The GBCA correlated well with the CASI (r2 = 0.90, p <  0.001) and with the MMSE (r2 = 0.92, p <  0.001), indicating concurrent validity. The GBCA cut-off of 75/76 corresponded to measurements of sensitivity, specificity, and area under curve of 85.1%, 91.5%, and 0.978, respectively. The positive predictive value was 91.9%, and the negative predictive value was 84.4%. The results of the user-experience questionnaire for the HC and NCD groups were good and acceptable, respectively.

CONCLUSION

The GBCA is an effective and acceptable tool for screening for degenerative dementia.

Diagnostic performance of digital cognitive tests for the identification of MCI and dementia: A systematic review

BACKGROUND

The use of digital cognitive tests is getting common nowadays. Older adults or their family members may use online tests for self-screening of dementia. However, the diagnostic performance across different digital tests is still to clarify. The objective of this study was to evaluate the diagnostic performance of digital cognitive tests for MCI and dementia in older adults.

METHODS

Literature searches were systematically performed in the OVID databases. Validation studies that reported the diagnostic performance of a digital cognitive test for MCI or dementia were included. The main outcome was the diagnostic performance of the digital test for the detection of MCI or dementia.

RESULTS

A total of 56 studies with 46 digital cognitive tests were included in this study. Most of the digital cognitive tests were shown to have comparable diagnostic performances with the paper-and-pencil tests. Twenty-two digital cognitive tests showed a good diagnostic performance for dementia, with a sensitivity and a specificity over 0.80, such as the Computerized Visuo-Spatial Memory test and Self-Administered Tasks Uncovering Risk of Neurodegeneration. Eleven digital cognitive tests showed a good diagnostic performance for MCI such as the Brain Health Assessment. However, all the digital tests only had a few validation studies to verify their performance.

CONCLUSIONS

Digital cognitive tests showed good performances for MCI and dementia. The digital test can collect digital data that is far beyond the traditional ways of cognitive tests. Future research is suggested on these new forms of cognitive data for the early detection of MCI and dementia.

Current State of Self-Administered Brief Computerized Cognitive Assessments for Detection of Cognitive Disorders in Older Adults: A Systematic Review

Early diagnosis of cognitive disorders in older adults is a major healthcare priority with benefits to patients, families, and health systems. Rapid advances in digital technology offer potential for developing innovative diagnostic pathways to support early diagnosis. Brief self-administered computerized cognitive tools in particular hold promise for clinical implementation by minimizing demands on staff time. In this study, we conducted a systematic review of self-administered computerized cognitive assessment measures designed for the detection of cognitive impairment in older adults. Studies were identified via a systematic search of published peer-reviewed literature across major scientific databases. All studies reporting on psychometric validation of brief (≤30 minutes) self-administered computerized measures for detection of MCI and all-cause dementia in older adults were included. Seventeen studies reporting on 10 cognitive tools met inclusion criteria and were subjected to systematic review. There was substantial variability in characteristics of validation samples and reliability and validity estimates. Only 2 measures evaluated feasibility and usability in the intended clinical settings. Similar to past reviews, we found variability across measures with regard to psychometric rigor and potential for widescale applicability in clinical settings. Despite the promise that self-administered cognitive tests hold for clinical implementation, important gaps in scientific rigor in development, validation, and feasibility studies of these measures remain. Developments in technology and biomarker studies provide potential avenues for future directions on the use of digital technology in clinical care.

Validation of SATURN, a free, electronic, self-administered cognitive screening test

BACKGROUND

Cognitive screening is limited by clinician time and variability in administration and scoring. We therefore developed Self-Administered Tasks Uncovering Risk of Neurodegeneration (SATURN), a free, public-domain, self-administered, and automatically scored cognitive screening test, and validated it on inexpensive (<$100) computer tablets.

METHODS

SATURN is a 30-point test including orientation, word recall, and math items adapted from the Saint Louis University Mental Status test, modified versions of the Stroop and Trails tasks, and other assessments of visuospatial function and memory. English-speaking neurology clinic patients and their partners 50 to 89 years of age were given SATURN, the Montreal Cognitive Assessment (MoCA), and a brief survey about test preferences. For patients recruited from dementia clinics (n = 23), clinical status was quantified with the Clinical Dementia Rating (CDR) scale. Care partners (n = 37) were assigned CDR = 0.

RESULTS

SATURN and MoCA scores were highly correlated (P < .00001; r = 0.90). CDR sum-of-boxes scores were well-correlated with both tests (P < .00001) (r = -0.83 and -0.86, respectively). Statistically, neither test was superior. Most participants (83%) reported that SATURN was easy to use, and most either preferred SATURN over the MoCA (47%) or had no preference (32%).

DISCUSSION

Performance on SATURN-a fully self-administered and freely available (https://doi.org/10.5061/dryad.02v6wwpzr) cognitive screening test-is well-correlated with MoCA and CDR scores.

Brief cognitive screening instruments for early detection of Alzheimer's disease: a systematic review

OBJECTIVES

The objective of this systematic review was (1) to give an overview of the available short screening instruments for the early detection of Alzheimer's disease (AD) and (2) to review the psychometric properties of these instruments.

METHODS

First, a systematic search of titles and abstracts of PubMed and Web of Science was conducted between February and July 2015 and updated in April 2016 and May 2018. Only papers written in English or Dutch were considered. All full-text papers about cognitive screening instruments for the early detection of AD were included, resulting in the identification of 38 pencil and paper tests and 12 computer tests. In a second step, the psychometric quality of these instruments was evaluated. Therefore, the same databases were searched again to identify papers that described the psychometric properties of the instruments meanwhile applying diagnostic criteria for the diagnostic groups included.

RESULTS

Out of 1454 papers, 96 clearly discussed the psychometric properties of the instruments. Eighty-nine papers discussed pencil and paper tests of which 80 were validated in a memory clinic setting. Based on the number of studies (31 articles) and the sensitivity (84%) and specificity (74%) values, the Montreal Cognitive Assessment (MoCA) seems to be a promising (pencil and paper) screening test for memory clinic testing as well as for population screening. Regarding computer tests, validation studies were only available for 7 out of 12 tests.

CONCLUSIONS

A large number of screening tests for AD are available. However, most tests are only validated in a memory clinic setting and description of the psychometric properties of the instruments is limited. Especially, computer tests require further research. The MoCA is a promising instrument, but the specificity to detect early AD is rather low.

A systematic review of the diagnostic accuracy of automated tests for cognitive impairment

OBJECTIVE

The aim of this review is to determine whether automated computerised tests accurately identify patients with progressive cognitive impairment and, if so, to investigate their role in monitoring disease progression and/or response to treatment.

METHODS

Six electronic databases (Medline, Embase, Cochrane, Institute for Scientific Information, PsycINFO, and ProQuest) were searched from January 2005 to August 2015 to identify papers for inclusion. Studies assessing the diagnostic accuracy of automated computerised tests for mild cognitive impairment (MCI) and early dementia against a reference standard were included. Where possible, sensitivity, specificity, positive predictive value, negative predictive value, and likelihood ratios were calculated. The Quality Assessment of Diagnostic Accuracy Studies tool was used to assess risk of bias.

RESULTS

Sixteen studies assessing 11 diagnostic tools for MCI and early dementia were included. No studies were eligible for inclusion in the review of tools for monitoring progressive disease and response to treatment. The overall quality of the studies was good. However, the wide range of tests assessed and the non-standardised reporting of diagnostic accuracy outcomes meant that statistical analysis was not possible.

CONCLUSION

Some tests have shown promising results for identifying MCI and early dementia. However, concerns over small sample sizes, lack of replicability of studies, and lack of evidence available make it difficult to make recommendations on the clinical use of the computerised tests for diagnosing, monitoring progression, and treatment response for MCI and early dementia. Research is required to establish stable cut-off points for automated computerised tests used to diagnose patients with MCI or early dementia.

Automated tests for diagnosing and monitoring cognitive impairment: a diagnostic accuracy review

BACKGROUND

Cognitive impairment is a growing public health concern, and is one of the most distinctive characteristics of all dementias. The timely recognition of dementia syndromes can be beneficial, as some causes of dementia are treatable and are fully or partially reversible. Several automated cognitive assessment tools for assessing mild cognitive impairment (MCI) and early dementia are now available. Proponents of these tests cite as benefits the tests' repeatability and robustness and the saving of clinicians' time. However, the use of these tools to diagnose and/or monitor progressive cognitive impairment or response to treatment has not yet been evaluated.

OBJECTIVES

The aim of this review was to determine whether or not automated computerised tests could accurately identify patients with progressive cognitive impairment in MCI and dementia and, if so, to investigate their role in monitoring disease progression and/or response to treatment.

DATA SOURCES

Five electronic databases (MEDLINE, EMBASE, The Cochrane Library, ISI Web of Science and PsycINFO), plus ProQuest, were searched from 2005 to August 2015. The bibliographies of retrieved citations were also examined. Trial and research registers were searched for ongoing studies and reviews. A second search was run to identify individual test costs and acquisition costs for the various tools identified in the review.

REVIEW METHODS

Two reviewers independently screened all titles and abstracts to identify potentially relevant studies for inclusion in the review. Full-text copies were assessed independently by two reviewers. Data were extracted and assessed for risk of bias by one reviewer and independently checked for accuracy by a second. The results of the data extraction and quality assessment for each study are presented in structured tables and as a narrative summary.

RESULTS

The electronic searching of databases, including ProQuest, resulted in 13,542 unique citations. The titles and abstracts of these were screened and 399 articles were shortlisted for full-text assessment. Sixteen studies were included in the diagnostic accuracy review. No studies were eligible for inclusion in the review of tools for monitoring progressive disease. Eleven automated computerised tests were assessed in the 16 included studies. The overall quality of the studies was good; however, the wide range of tests assessed and the non-standardised reporting of diagnostic accuracy outcomes meant that meaningful synthesis or statistical analysis was not possible.

LIMITATIONS

The main limitation of this review is the substantial heterogeneity of the tests assessed in the included studies. As a result, no meta-analyses could be undertaken.

CONCLUSION

The quantity of information available is insufficient to be able to make recommendations on the clinical use of the computerised tests for diagnosing and monitoring MCI and early dementia progression. The value of these tests also depends on the costs of acquisition, training, administration and scoring.

FUTURE WORK

Research is required to establish stable cut-off points for automated computerised tests that are used to diagnose patients with MCI or early dementia. Additionally, the costs associated with acquiring and using these tests in clinical practice should be estimated.

STUDY REGISTRATION

The study is registered as PROSPERO CRD42015025410.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

Computerized cognitive testing for older adults: a review

OBJECTIVE

This article is a review of computerized tests and batteries used in the cognitive assessment of older adults.

METHOD

A literature search on Medline followed by cross-referencing yielded a total of 76 citations.

RESULTS

Seventeen test batteries were identified and categorized according to their scope. Computerized adaptive testing (CAT) and the Cambridge Cognitive Examination CAT battery as well as 3 experimental batteries and an experimental test are discussed in separate sections. All batteries exhibit strengths associated with computerized testing such as standardization of administration, accurate measurement of many variables, automated record keeping, and savings of time and costs. Discriminant validity and test-retest reliability were well documented for most batteries while documentation of other psychometric properties varied.

CONCLUSION

The large number of available batteries can be beneficial to the clinician or researcher; however, care should be taken in order to choose the correct battery for each application.