Feasibility and validity of the self-administered computerized assessment of mild cognitive impairment with older primary care patients

Touchscreen Cognitive Tools for Mild Cognitive Impairment and Dementia Used in Primary Care Across Diverse Cultural and Literacy Populations: A Systematic Review

BACKGROUND

Touchscreen cognitive tools opened new promising opportunities for the early detection of cognitive impairment; however, most research studies are conducted in English-speaking populations and high-income countries, with a gap in knowledge about their use in populations with cultural, linguistic, and educational diversity.

OBJECTIVE

To review the touchscreen tools used in primary care settings for the cognitive assessment of mild cognitive impairment (MCI) and dementia, with a focus on populations of different cultures, languages, and literacy.

METHODS

This systematic review was conducted following the PRISMA guidelines. Studies were identified by searching across MEDLINE, EMBASE, EBSCO, OVID, SCOPUS, SCIELO, LILACS, and by cross-referencing. All studies that provide a first-level cognitive assessment for MCI and dementia with any touchscreen tools suitable to be used in the context of primary care were included.

RESULTS

Forty-two studies reporting on 30 tools and batteries were identified. Substantial differences among the tools emerged, in terms of theoretical framework, clinical validity, and features related to the application in clinical practice. A small proportion of the tools are available in multiple languages. Only 7 out of the 30 tools have a multiple languages validation. Only two tools are validated in low-educated samples, e.g., IDEA and mSTS-MCI.

CONCLUSION

General practitioners can benefit from touchscreen cognitive tools. However, easy requirements of the device, low dependence on the examiner, fast administration, and adaptation to different cultures and languages are some of the main features that we need to take into consideration when implementing touchscreen cognitive tools in the culture and language of underrepresented populations.

Older Adults' Likelihood of Participating in Home-Based Cognitive Assessment

INTRODUCTION

Timely detection of cognitive impairment among older adults has shown to lead to better health and financial outcomes but is hampered by psychological, financial, and physical barriers to participation in cognitive assessment. Home-based cognitive assessment (HBCA) could help overcome some of these barriers. This study aimed to examine older adults' likelihood of participation in HBCA and identify factors predicting this likelihood.

MATERIALS AND METHODS

A cross-sectional online survey distributed through Amazon Mechanical Turk, was used to collect data from adults aged 50 years or older residing in the USA The survey was designed to gauge attitudes toward technology and cognitive assessment and to measure psychological variables including subjective cognitive decline (SCD), depression, and anxiety. Information on income and geographic location (rural vs. suburban and urban) was also collected. Univariate and hierarchical regression analyses were conducted to examine the contributions of these variables to a composite measure of likelihood of participation in HBCA.

RESULTS

Complete data were obtained on n = 483 (age 50-79). Approximately, two-thirds of respondents described themselves as likely or very likely to participate in HBCA. In univariate analyses, younger age, higher income, higher technology assessment acceptance scores, and higher SCD burden were associated with higher likelihood of participation. Hierarchical regression revealed significant stepwise increments in explained variance: demographic variables 4.1%, technology acceptance 25.2%, assessment acceptance 15.4%, and SCD burden 1.6%. The contribution of SCD was moderated by sex and found for women but not for men.

DISCUSSION/CONCLUSION

A large proportion of adults aged 50 and above described themselves likely to participate in HBCA. Middle-aged, technology-savvy, higher income adults expressed the most positive attitudes toward this type of service. Of interest is that HBCA may be particularly acceptable among older women with SCD, a group known to be at risk of cognitive decline. Our findings support the expansion of cognitive assessment services to the home setting.

Detection of Mild Cognitive Impairment in an At-Risk Group of Older Adults: Can a Novel Self-Administered Serious Game-Based Screening Test Improve Diagnostic Accuracy?

BACKGROUND

Literature supports the use of serious games and virtual environments to assess cognitive functions and detect cognitive decline. This promising assessment method, however, has not yet been translated into self-administered screening instruments for pre-clinical dementia.

OBJECTIVE

The aim of this study is to assess the performance of a novel self-administered serious game-based test, namely the Virtual Supermarket Test (VST), in detecting mild cognitive impairment (MCI) in a sample of older adults with subjective memory complaints (SMC), in comparison with two well-established screening instruments, the Montreal Cognitive Assessment (MoCA) and the Mini-Mental State Examination (MMSE).

METHODS

Two groups, one of healthy older adults with SMC (N = 48) and one of MCI patients (N = 47) were recruited from day centers for cognitive disorders and administered the VST, the MoCA, the MMSE, and an extended pencil and paper neuropsychological test battery.

RESULTS

The VST displayed a correct classification rate (CCR) of 81.91% when differentiating between MCI patients and older adults with SMC, while the MoCA displayed of CCR of 72.04% and the MMSE displayed a CCR of 64.89%.

CONCLUSION

The three instruments assessed in this study displayed significantly different performances in differentiating between healthy older adults with SMC and MCI patients. The VST displayed a good CCR, while the MoCA displayed an average CCR and the MMSE displayed a poor CCR. The VST appears to be a robust tool for detecting MCI in a population of older adults with SMC.

Distance Assessment for Detecting Cognitive Impairment in Older Adults: A Systematic Review of Psychometric Evidence

INTRODUCTION

Distance or remote cognitive assessments, administered via phone or computer platforms, have emerged as possible alternatives to traditional assessments performed during office visits. Distance refers to any nontraditional assessment feature, not only or necessarily location. We conducted a systematic review to examine the psychometric soundness of these approaches.

METHOD

We searched PubMed, PsycINFO, AgeLine, and Academic Search Premier for articles published between January 2008 and June 2020. Studies were included if participants were over the age of 50, a structured assessment of cognitive function in older adults was evaluated, the assessment method was deemed distant, and validity and/or reliability data were reported. Assessment distance was defined as having any of the following features: use of an electronic test interface, nonroutine test location (e.g., home), test self-administered, and test unsupervised. Distance was categorized as low, intermediate, or high.

RESULTS/DISCUSSION

Twenty-six studies met inclusion criteria. Sample sizes ranged from n = 8 to 8,627, and the mean age ranged from 57 to 83. Assessments included screens, brief or full batteries, and were performed via videoconferencing, phone, smartphone, or tablet/computer. Ten studies reported on low distance, 11 on intermediate distance, and 5 studies for high distance assessments. Invalid performance data were observed with older age and cognitive impairment. Convergent validity data were reported consistently and suggested a decline with increasing distance: r = 0.52-0.80 for low, 0.49-0.75 for intermediate, and 0.41-0.53 for high distance. Diagnostic validity estimates presented a similar pattern. Reliability data were reported too inconsistently to allow evaluation.

CONCLUSION

The validity of cognitive assessments with older adults appears supported at lower but not higher distance. Less is known about the reliability of such assessments. Future research should delineate the person and procedure boundaries for valid and reliable test results.

Feasibility and Psychometric Integrity of Mobile Phone-Based Intensive Measurement of Cognition in Older Adults

Background:There is a pressing need for assessment approaches that can be deployed remotely to measure cognitive outcomes in clinical trials and longitudinal aging cohorts. We evaluated the utility of a mobile phone-based intensive measurement study for this purpose. Method:A small cohort of healthy older adults (N = 17, mean age = 73) completed five assessment "bursts" over 12 months, with each measurement burst involving two assessments daily for five consecutive days. Each assessment included brief tests of visual short-term memory and information processing speed, as well as surveys measuring state factors that can affect cognition. Results:At study endpoint we had 94% retention, 97% compliance, and high participant satisfaction. Mobile cognitive test scores demonstrated good reliability, moderate correlations with in-person baseline neuropsychological testing, and significant associations with participant age and education level. Conclusions: Mobile phone-based intensive measurement designs represent a promising assessment approach for measuring cognition longitudinally in older adults.

Web-Based Cognitive Testing of Older Adults in Person Versus at Home: Within-Subjects Comparison Study

Background

Web-based research allows cognitive psychologists to collect high-quality data from a diverse pool of participants with fewer resources. However, web-based testing presents unique challenges for researchers and clinicians working with aging populations. Older adults may be less familiar with computer usage than their younger peers, leading to differences in performance when completing web-based tasks in their home versus in the laboratory under the supervision of an experimenter.

Objective

This study aimed to use a within-subjects design to compare the performance of healthy older adults on computerized cognitive tasks completed at home and in the laboratory. Familiarity and attitudes surrounding computer use were also examined.

Methods

In total, 32 community-dwelling healthy adults aged above 65 years completed computerized versions of the word-color Stroop task, paired associates learning, and verbal and matrix reasoning in 2 testing environments: at home (unsupervised) and in the laboratory (supervised). The paper-and-pencil neuropsychological versions of these tasks were also administered, along with questionnaires examining computer attitudes and familiarity. The order of testing environments was counterbalanced across participants.

Results

Analyses of variance conducted on scores from the computerized cognitive tasks revealed no significant effect of the testing environment and no correlation with computer familiarity or attitudes. These null effects were confirmed with follow-up Bayesian analyses. Moreover, performance on the computerized tasks correlated positively with performance on their paper-and-pencil equivalents.

Conclusions

Our findings show comparable performance on computerized cognitive tasks in at-home and laboratory testing environments. These findings have implications for researchers and clinicians wishing to harness web-based testing to collect meaningful data from older adult populations.

Current State of Self-Administered Brief Computerized Cognitive Assessments for Detection of Cognitive Disorders in Older Adults: A Systematic Review

Early diagnosis of cognitive disorders in older adults is a major healthcare priority with benefits to patients, families, and health systems. Rapid advances in digital technology offer potential for developing innovative diagnostic pathways to support early diagnosis. Brief self-administered computerized cognitive tools in particular hold promise for clinical implementation by minimizing demands on staff time. In this study, we conducted a systematic review of self-administered computerized cognitive assessment measures designed for the detection of cognitive impairment in older adults. Studies were identified via a systematic search of published peer-reviewed literature across major scientific databases. All studies reporting on psychometric validation of brief (≤30 minutes) self-administered computerized measures for detection of MCI and all-cause dementia in older adults were included. Seventeen studies reporting on 10 cognitive tools met inclusion criteria and were subjected to systematic review. There was substantial variability in characteristics of validation samples and reliability and validity estimates. Only 2 measures evaluated feasibility and usability in the intended clinical settings. Similar to past reviews, we found variability across measures with regard to psychometric rigor and potential for widescale applicability in clinical settings. Despite the promise that self-administered cognitive tests hold for clinical implementation, important gaps in scientific rigor in development, validation, and feasibility studies of these measures remain. Developments in technology and biomarker studies provide potential avenues for future directions on the use of digital technology in clinical care.

Validation of SATURN, a free, electronic, self-administered cognitive screening test

BACKGROUND

Cognitive screening is limited by clinician time and variability in administration and scoring. We therefore developed Self-Administered Tasks Uncovering Risk of Neurodegeneration (SATURN), a free, public-domain, self-administered, and automatically scored cognitive screening test, and validated it on inexpensive (<$100) computer tablets.

METHODS

SATURN is a 30-point test including orientation, word recall, and math items adapted from the Saint Louis University Mental Status test, modified versions of the Stroop and Trails tasks, and other assessments of visuospatial function and memory. English-speaking neurology clinic patients and their partners 50 to 89 years of age were given SATURN, the Montreal Cognitive Assessment (MoCA), and a brief survey about test preferences. For patients recruited from dementia clinics (n = 23), clinical status was quantified with the Clinical Dementia Rating (CDR) scale. Care partners (n = 37) were assigned CDR = 0.

RESULTS

SATURN and MoCA scores were highly correlated (P < .00001; r = 0.90). CDR sum-of-boxes scores were well-correlated with both tests (P < .00001) (r = -0.83 and -0.86, respectively). Statistically, neither test was superior. Most participants (83%) reported that SATURN was easy to use, and most either preferred SATURN over the MoCA (47%) or had no preference (32%).

DISCUSSION

Performance on SATURN-a fully self-administered and freely available (https://doi.org/10.5061/dryad.02v6wwpzr) cognitive screening test-is well-correlated with MoCA and CDR scores.

Computerized Cognitive Testing in Primary Care: A Qualitative Study

Computerized cognitive assessment tools may facilitate early identification of dementia in the primary care setting. We investigated primary care physicians' (PCPs') views on advantages and disadvantages of computerized testing based on their experience with the Computer Assessment of Mild Cognitive Impairment (CAMCI). Over a 2-month period, 259 patients, 65 years and older, from the family practice of 13 PCPs completed the CAMCI. Twelve PCPs participated in an individual interview. Generally, PCPs felt that the relationship between them and their patients helped facilitate cognitive testing; however, they thought available paper tests were time consuming and not sufficiently informative. Despite concerns regarding elderly patients' computer literacy, PCPs noticed high completion rates and that their patients had generally positive experiences completing the CAMCI. PCPs appreciated the time-saving advantage of the CAMCI and the immediately generated report, but thought the report should be shortened to 1 page and that PCPs should receive training in its interpretation. Our results suggest that computerized cognitive tools such as the CAMCI can address PCPs' concerns with cognitive testing in their offices. Recommendations to improve the practicality of computerized testing in primary care were suggested.

Cognitive assessment tools for mild cognitive impairment screening

Mild cognitive impairment (MCI) is a clinical condition with a high risk of progression to dementia. Due to lack of effective disease-modifying therapies for advanced dementia, diagnosis and disease intervention at an early stage, particularly at MCI stage, has been widely accepted as a critical strategy in disease management that could potentially affect long-term outcome. However, there is currently no consensus on guidelines for routine screening of MCI, resulting in a considerable number of patients with undiagnosed MCI from community. In addition, the use of different screening guidelines leads to difficulties in comparing different studies. A variety of screening tools have been utilized; however, the sensitivity and specificity vary greatly among these tools. By summarizing the sensitivity, specificity and time efficiency for common MCI screening tools, which are key factors to be taken into consideration when making selections and combinations of screening tools, this review suggests the use of a combination of two self-administered highly sensitive tools, p-AD8 + IQCODE (informant questionnaire on cognitive decline in the elderly individuals) in initial screening, as well as a combination of two highly specific widely covered tools, DemTect + MoCA (Montreal cognitive assessment) or memory and executive screening (MES) + MoCA in secondary screening. In addition, this review also proposes a screening flowchart for MCI, aiming to build a sensitive and time efficient way for recruiting subjects for subsequent investigation and disease differentiation.

Validity of screening tools for dementia and mild cognitive impairment among the elderly in primary health care: a systematic review

OBJECTIVES

This systematic review aims to provide updated and comprehensive evidence on the validity and feasibility of screening tools for mild cognitive impairment (MCI) and dementia among the elderly at primary healthcare level.

STUDY DESIGN

A review of articles was performed.

METHODS

A search strategy was used by using electronic bibliographic databases including PubMed, Embase and CENTRAL for published studies and reference list of published studies. The articles were exported to a bibliographic database for further screening process. Two reviewers worked independently to screen results and extract data from the included studies. Any discrepancies were resolved and confirmed by the consensus of all authors.

RESULTS

There were three screening approaches for detecting MCI and dementia - screening by a healthcare provider, screening by a self-administered questionnaire and caretaker informant screening. Montreal Cognitive Assessment (MoCA) was the most common and preferable tool for MCI screening (sensitivity [Sn]: 81-97%; specificity [Sp]: 60-86%), whereas Addenbrooke's Cognitive Examination (ACE) was the preferable tool for dementia screening (Sn: 79-100%; Sp: 86%).

CONCLUSION

This systematic review found that there are three screening approaches for detecting early dementia and MCI at primary health care. ACE and MoCA are recommended tools for screening of dementia and MCI, respectively.

Use of nonintrusive sensor-based information and communication technology for real-world evidence for clinical trials in dementia

Cognitive function is an important end point of treatments in dementia clinical trials. Measuring cognitive function by standardized tests, however, is biased toward highly constrained environments (such as hospitals) in selected samples. Patient-powered real-world evidence using information and communication technology devices, including environmental and wearable sensors, may help to overcome these limitations. This position paper describes current and novel information and communication technology devices and algorithms to monitor behavior and function in people with prodromal and manifest stages of dementia continuously, and discusses clinical, technological, ethical, regulatory, and user-centered requirements for collecting real-world evidence in future randomized controlled trials. Challenges of data safety, quality, and privacy and regulatory requirements need to be addressed by future smart sensor technologies. When these requirements are satisfied, these technologies will provide access to truly user relevant outcomes and broader cohorts of participants than currently sampled in clinical trials.

A systematic review of the diagnostic accuracy of automated tests for cognitive impairment

OBJECTIVE

The aim of this review is to determine whether automated computerised tests accurately identify patients with progressive cognitive impairment and, if so, to investigate their role in monitoring disease progression and/or response to treatment.

METHODS

Six electronic databases (Medline, Embase, Cochrane, Institute for Scientific Information, PsycINFO, and ProQuest) were searched from January 2005 to August 2015 to identify papers for inclusion. Studies assessing the diagnostic accuracy of automated computerised tests for mild cognitive impairment (MCI) and early dementia against a reference standard were included. Where possible, sensitivity, specificity, positive predictive value, negative predictive value, and likelihood ratios were calculated. The Quality Assessment of Diagnostic Accuracy Studies tool was used to assess risk of bias.

RESULTS

Sixteen studies assessing 11 diagnostic tools for MCI and early dementia were included. No studies were eligible for inclusion in the review of tools for monitoring progressive disease and response to treatment. The overall quality of the studies was good. However, the wide range of tests assessed and the non-standardised reporting of diagnostic accuracy outcomes meant that statistical analysis was not possible.

CONCLUSION

Some tests have shown promising results for identifying MCI and early dementia. However, concerns over small sample sizes, lack of replicability of studies, and lack of evidence available make it difficult to make recommendations on the clinical use of the computerised tests for diagnosing, monitoring progression, and treatment response for MCI and early dementia. Research is required to establish stable cut-off points for automated computerised tests used to diagnose patients with MCI or early dementia.

Automated tests for diagnosing and monitoring cognitive impairment: a diagnostic accuracy review

BACKGROUND

Cognitive impairment is a growing public health concern, and is one of the most distinctive characteristics of all dementias. The timely recognition of dementia syndromes can be beneficial, as some causes of dementia are treatable and are fully or partially reversible. Several automated cognitive assessment tools for assessing mild cognitive impairment (MCI) and early dementia are now available. Proponents of these tests cite as benefits the tests' repeatability and robustness and the saving of clinicians' time. However, the use of these tools to diagnose and/or monitor progressive cognitive impairment or response to treatment has not yet been evaluated.

OBJECTIVES

The aim of this review was to determine whether or not automated computerised tests could accurately identify patients with progressive cognitive impairment in MCI and dementia and, if so, to investigate their role in monitoring disease progression and/or response to treatment.

DATA SOURCES

Five electronic databases (MEDLINE, EMBASE, The Cochrane Library, ISI Web of Science and PsycINFO), plus ProQuest, were searched from 2005 to August 2015. The bibliographies of retrieved citations were also examined. Trial and research registers were searched for ongoing studies and reviews. A second search was run to identify individual test costs and acquisition costs for the various tools identified in the review.

REVIEW METHODS

Two reviewers independently screened all titles and abstracts to identify potentially relevant studies for inclusion in the review. Full-text copies were assessed independently by two reviewers. Data were extracted and assessed for risk of bias by one reviewer and independently checked for accuracy by a second. The results of the data extraction and quality assessment for each study are presented in structured tables and as a narrative summary.

RESULTS

The electronic searching of databases, including ProQuest, resulted in 13,542 unique citations. The titles and abstracts of these were screened and 399 articles were shortlisted for full-text assessment. Sixteen studies were included in the diagnostic accuracy review. No studies were eligible for inclusion in the review of tools for monitoring progressive disease. Eleven automated computerised tests were assessed in the 16 included studies. The overall quality of the studies was good; however, the wide range of tests assessed and the non-standardised reporting of diagnostic accuracy outcomes meant that meaningful synthesis or statistical analysis was not possible.

LIMITATIONS

The main limitation of this review is the substantial heterogeneity of the tests assessed in the included studies. As a result, no meta-analyses could be undertaken.

CONCLUSION

The quantity of information available is insufficient to be able to make recommendations on the clinical use of the computerised tests for diagnosing and monitoring MCI and early dementia progression. The value of these tests also depends on the costs of acquisition, training, administration and scoring.

FUTURE WORK

Research is required to establish stable cut-off points for automated computerised tests that are used to diagnose patients with MCI or early dementia. Additionally, the costs associated with acquiring and using these tests in clinical practice should be estimated.

STUDY REGISTRATION

The study is registered as PROSPERO CRD42015025410.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

ELECTRONIC DEVICES FOR COGNITIVE IMPAIRMENT SCREENING: A SYSTEMATIC LITERATURE REVIEW

OBJECTIVES

The reduction in cognitive decline depends on timely diagnosis. The aim of this systematic review was to analyze the current available information and communication technologies-based instruments for cognitive decline early screening and detection in terms of usability, validity, and reliability.

METHODS

Electronic searches identified 1,785 articles of which thirty-four met the inclusion criteria and were grouped according to their main purpose into test batteries, measures of isolated tasks, behavioral measures, and diagnostic tools.

RESULTS

Thirty one instruments were analyzed. Fifty-two percent were personal computer based, 26 percent tablet, 13 percent laptop, and 1 was mobile phone based. The most common input method was touchscreen (48 percent). The instruments were validated with a total of 4,307 participants: 2,146 were healthy older adults (M = 73.59; SD = 5.12), 1,104 had dementia (M = 74.65; SD = 3.98) and 1,057 mild cognitive impairment (M = 74.84; SD = 4.46). Only 6 percent were administered at home, 19 percent reported outcomes about usability, and 22 percent about understandability. The methodological quality of the studies was good, the weakest methodological area being usability. Most of the instruments obtained acceptable values of specificity and sensitivity.

CONCLUSIONS

It is necessary to create home delivered instruments and to include usability studies in their design. Involvement of people with cognitive decline in all phases of the development process is of great importance to obtain valuable and user-friendly products. It would be advisable for researchers to make an effort to provide cutoff points for their instruments.

Digitally translated Self-Administered Gerocognitive Examination (eSAGE): relationship with its validated paper version, neuropsychological evaluations, and clinical assessments

BACKGROUND

The original paper Self-Administered Gerocognitive Examination (SAGE) is a valid and reliable cognitive assessment tool used to identify individuals with mild cognitive impairment (MCI) or early dementia. We evaluated identical test questions in a digital format (eSAGE) made for tablet use with the goals of calibrating it against SAGE and establishing its association with other neuropsychological tests and clinical assessments of cognitive impairment.

METHODS

Subjects aged 50 and over who had taken SAGE were recruited from community and clinic settings. Subjects were randomly selected to participate in a clinical evaluation including neuropsychological evaluations. SAGE and eSAGE were administered using a crossover design. Subjects were identified as dementia, MCI, or normal based on standard clinical criteria. Associations were investigated using Spearman correlations, linear regression, and sensitivity and specificity measures.

RESULTS

Of the 426 subjects screened, 66 completed the evaluation. eSAGE score correlation to a battery of neuropsychological tests was 0.73 (p < 0.0001) with no significant difference between the paper and digital format. Spearman correlation of SAGE versus eSAGE was 0.88 (p < 0.0001), and they are related by the formula: eSAGE score = -1.05 + 0.99 × SAGE score. Since the slope is very close to 1 (p = 0.86) there is strong evidence that the scaling is identical between eSAGE and SAGE, with no scale bias. Overall, eSAGE scores are lower by an average of 1.21 and the decrease is statistically significant (p < 0.0001). For those subjects familiar with smartphones or tablets (one measure of digital proficiency), eSAGE scores are lower by an average of 0.83 points (p = 0.029). With a score 16 and higher being classified as normal, eSAGE had 90% specificity and 71% sensitivity in detecting those with cognitive impairment from normal subjects.

CONCLUSIONS

Tablet-based eSAGE shows a strong association with the validated paper SAGE and a neuropsychological battery. It shows no scale bias compared to SAGE. Both have the advantage of self-administration, brevity, four interchangeable forms, and high sensitivity and specificity in detecting cognitive impairment from normal subjects. Their potential widespread availability will be a major factor in overcoming the many obstacles in identifying early cognitive changes.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02544074 . Registered on 18 March 2015.

Technologies to Support Community-Dwelling Persons With Dementia: A Position Paper on Issues Regarding Development, Usability, Effectiveness and Cost-Effectiveness, Deployment, and Ethics

BACKGROUND

With the expected increase in the numbers of persons with dementia, providing timely, adequate, and affordable care and support is challenging. Assistive and health technologies may be a valuable contribution in dementia care, but new challenges may emerge.

OBJECTIVE

The aim of our study was to review the state of the art of technologies for persons with dementia regarding issues on development, usability, effectiveness and cost-effectiveness, deployment, and ethics in 3 fields of application of technologies: (1) support with managing everyday life, (2) support with participating in pleasurable and meaningful activities, and (3) support with dementia health and social care provision. The study also aimed to identify gaps in the evidence and challenges for future research.

METHODS

Reviews of literature and expert opinions were used in our study. Literature searches were conducted on usability, effectiveness and cost-effectiveness, and ethics using PubMed, Embase, CINAHL, and PsycINFO databases with no time limit. Selection criteria in our selected technology fields were reviews in English for community-dwelling persons with dementia. Regarding deployment issues, searches were done in Health Technology Assessment databases.

RESULTS

According to our results, persons with dementia want to be included in the development of technologies; there is little research on the usability of assistive technologies; various benefits are reported but are mainly based on low-quality studies; barriers to deployment of technologies in dementia care were identified, and ethical issues were raised by researchers but often not studied. Many challenges remain such as including the target group more often in development, performing more high-quality studies on usability and effectiveness and cost-effectiveness, creating and having access to high-quality datasets on existing technologies to enable adequate deployment of technologies in dementia care, and ensuring that ethical issues are considered an important topic for researchers to include in their evaluation of assistive technologies.

CONCLUSIONS

Based on these findings, various actions are recommended for development, usability, effectiveness and cost-effectiveness, deployment, and ethics of assistive and health technologies across Europe. These include avoiding replication of technology development that is unhelpful or ineffective and focusing on how technologies succeed in addressing individual needs of persons with dementia. Furthermore, it is suggested to include these recommendations in national and international calls for funding and assistive technology research programs. Finally, practitioners, policy makers, care insurers, and care providers should work together with technology enterprises and researchers to prepare strategies for the implementation of assistive technologies in different care settings. This may help future generations of persons with dementia to utilize available and affordable technologies and, ultimately, to benefit from them.

Tablet-Based Frailty Assessments in Emergency Care for Older Adults

The rise in aging populations worldwide places a focus on shifting healthcare needs to match changing demographics. Older adults have a higher risk of becoming frail and losing functional abilities (e.g., walking and bathing) as well as the ability to perform daily activities such as shopping and cooking. Providing care and appropriate interventions to assist older adults with frailty is contingent upon identifying these individuals through effective screening. Frailty is often characterized by self-reports of exhaustion, weakness, slowing, and low physical activity. Older adults at risk of becoming frail often enter the healthcare system through emergency services (e.g., calling 911 or presenting at an emergency department), and screening should target these entry points. This paper discusses the design process, and usability findings associated with a tablet-based battery of frailty measures for assessing functional and cognitive states in elderly adults while being admitted to emergency care. This research is focusing on the use of digital technologies as a medium for physical and mental frailty assessment in emergency care. A diverse group of healthcare users is envisaged including paramedics, physicians, and research personnel, as well as end-users such as elderly patients and their caregivers. We describe the development and usability of the tablet-based frailty assessment system and we report on the concurrent validity of frailty measures.

Computer-based tools for assessing micro-longitudinal patterns of cognitive function in older adults

Patterns of cognitive change over micro-longitudinal timescales (i.e., ranging from hours to days) are associated with a wide range of age-related health and functional outcomes. However, practical issues of conducting high-frequency assessments make investigations of micro-longitudinal cognition costly and burdensome to run. One way of addressing this is to develop cognitive assessments that can be performed by older adults, in their own homes, without a researcher being present. Here, we address the question of whether reliable and valid cognitive data can be collected over micro-longitudinal timescales using unsupervised cognitive tests.In study 1, 48 older adults completed two touchscreen cognitive tests, on three occasions, in controlled conditions, alongside a battery of standard tests of cognitive functions. In study 2, 40 older adults completed the same two computerized tasks on multiple occasions, over three separate week-long periods, in their own homes, without a researcher present. Here, the tasks were incorporated into a wider touchscreen system (Novel Assessment of Nutrition and Ageing (NANA)) developed to assess multiple domains of health and behavior. Standard tests of cognitive function were also administered prior to participants using the NANA system.Performance on the two "NANA" cognitive tasks showed convergent validity with, and similar levels of reliability to, the standard cognitive battery in both studies. Completion and accuracy rates were also very high. These results show that reliable and valid cognitive data can be collected from older adults using unsupervised computerized tests, thus affording new opportunities for the investigation of cognitive.

The Effects of Computerized Cognitive Testing of Older Patients on Primary Care Physicians' Approaches to Care: A Canadian Study

BACKGROUND

We evaluated effects of providing primary care physicians (PCPs) with reports of their patients' results on the Computer Assessment of Mild Cognitive Impairment (CAMCI) by examining their documented care approaches after receipt of the report.

METHODS

Patients were 65 years and above, without a diagnosis or previous workup for dementia, seen consecutively over 2 months by one of 13 PCPs. PCPs indicated whether they, patients, or families had concerns about patients' cognition. A total of 259 patients individually completed the CAMCI and results were provided to the PCP. Two raters blind to CAMCI results recorded care approaches documented by PCPs at the first visit within 3 months of report (n=181).

RESULTS

In total, 28 different care approaches were grouped as related to Cognition or Safety/Self-Care. Negative binomial regression revealed that the number of care approaches was significantly associated with performance on the CAMCI for both Cognition and Safety/Self-care domains. These findings remained significant when covariates included PCPs' cognitive concern before CAMCI results, and patients' age, sex, number of comorbidities, and living arrangements.

CONCLUSIONS

Our findings indicate that PCPs documented more care approaches in patients with greater cognitive impairment based on the CAMCI results and this was independent of their, the patients', or families' prior concerns about their patients' cognition.

A Tablet-PC-Based Cancellation Test Assessing Executive Functions in Older Adults

OBJECTIVE

To examine older adults' performance on a newly developed tablet-PC-based cancellation test (e-CT) and to study its psychometric properties.

METHODS

94 older adults with normal cognitive functioning were recruited. The effects of age, education, sex, and experience with computer-based devices on the e-CT were examined. Construct validity was tested by correlating the e-CT with established measures of executive functions (EF) and episodic memory. Correlation coefficients were used to assess short-term test-retest reliablity.

RESULTS

The mean age of participants was 74.6 (SD: 7.3) years and 78% were women. Sixty-nine percent had higher education level (> high school) and 76% used computer-based devices daily. The correct cancellations (CC) on the e-CT ranged from 18 to 56, with a mean (SD) of 40.3 (5.7). The CC was inversely correlated with advancing age (rs = -0.59, N = 94, p <0.001) and positively associated with higher education level (U(94) = 646.5, p = 0.02). No relationship was observed between the e-CT and sex or computer-based device experience. In multivariate analysis, only age remained significantly associated with CC (β = -0.46, SE = 0.07, t = -6.47, df = 93, p <0.001). The e-CT correlated significantly with most of measures of EF. Highest correlations were found between the e-CT and the K-T test, a paper-and-pencil cancellation test (rs = 0.63, N = 90, p <0.001) and TMT-B (rs = -0.41, N = 85, p <0.001). The e-CT did not correlate with the RL-RI 16 episodic memory test. The correlation between the first and second e-CT indicated good reliability (rs = 0.89, N = 13, p <0.001).

CONCLUSIONS

Results suggested that e-CT has good psychometric properties and may be useful for assessing EF in older adults.

Usability and Validity of a Battery of Computerised Cognitive Screening Tests for Detecting Cognitive Impairment

BACKGROUND

Computerised cognitive screening (CCS) has the potential to detect cognitive impairment in the community, which is important for the early diagnosis of dementia.

OBJECTIVE

The aim of this study was to investigate the ability of older adults with dementia to engage with smart phone and tablet technologies and to determine the accuracy of a battery of CCS tasks to detect cognitive impairment in comparison with the Montreal Cognitive Assessment (MoCA).

METHODS

Patients with mild-moderate dementia (n = 40) attending a university-linked day hospital and normal controls (n = 20) completed (i) a questionnaire detailing the frequency and breadth of their technology use, (ii) three commercially available CCS tasks, and (iii) the MoCA.

RESULTS

The three CCS tasks were completed by 85% (n = 34) of the patients with dementia and all controls; only 4 reported the task as 'hard'. Those with dementia scored significantly lower on the CCS than controls (p < 0.001). CCS scores correlated with total MoCA scores (r = 0.78, p < 0.01). Further, the CCS scores significantly predicted MoCA scores, controlling for the effects of age, gender, educational attainment, and frequency of technology use (β = 0.71, p < 0.001), explaining 65.2% of the variance. Total CCS and MoCA scores (cut-off score <24) had similar sensitivity (94 and 95%, respectively) and accuracy (area under the curve 0.94 and 0.99, respectively, p = 0.5) in discriminating dementia from controls, though the CSS had lower specificity (60 vs. 100% for the MoCA).

CONCLUSION

The participants had little difficulty self-administering the CCS, which is an oft-cited barrier to computerised testing in this population. Our results support the criterion and construct validity of a CCS versus the commonly used MoCA. Although further research is required, CCS for cognitive impairment may be useful in the community and, by prompting referral to specialist services, could lead to an earlier diagnosis of dementia.

Neurocognitive outcomes following successful resuscitation from cardiac arrest

INTRODUCTION

Cardiac arrest commonly results in varying degrees of cognitive injury. Standard outcome measures used in the cardiac arrest cohort do not rigorously evaluate for these injury patterns. We examined the utility of the Computerized Assessment for Mild Cognitive Injury (CAMCI) in cardiac arrest (CA) survivors. We hypothesized that cognitive deficits would be more severe in patients who were comatose on hospital arrival.

METHODS

Prospective cohort of CA survivors at a single tertiary care facility where participants received neurocognitive testing using CAMCI. CAMCI results were subdivided into memory, attention, and executive functions. Scores between subjects who were initially comatose and were not comatose following resuscitation were compared using the Mann-Whitney test.

RESULTS

Of 72 subjects included, the majority (N=44) were initially comatose following resuscitation with mean age of 54 (±14) years. The majority experienced a good neurologic outcome based on Cerebral Performance Category (N=47; 66%) and Modified Rankin Scale (N=38; 53%). Time from resuscitation to CAMCI testing was not associated with total CAMCI score in this cohort (Pearson's r(2) value -0.1941, p=0.20). Initially comatose and not comatose subjects did not differ in their CAMCI overall scores (p=0.33), or in any subtest areas. The not comatose cohort had 1 subtest for which there was a Moderate Risk for mild cognitive impairment (Nonverbal Accuracy), and 2 for which there was a Moderately Low Risk (Verbal Accuracy and Executive Accuracy). The Comatose cohort had 4 subtests, which were deemed Moderately Low Risk for cognitive impairment (Verbal Accuracy, Attention Accuracy, Executive Accuracy and Nonverbal Accuracy).

CONCLUSIONS

In-hospital CAMCI testing suggests memory, attention and executive impairment are commonly in patients following resuscitation from cardiac arrest. Outcome evaluations should test for deficits in memory, attention, and executive function.