A Virtual Supermarket Program for the Screening of Mild Cognitive Impairment in Older Adults: Diagnostic Accuracy Study

Meta-analysis of Montreal cognitive assessment diagnostic accuracy in amnestic mild cognitive impairment

Background

The Montreal Cognitive Assessment (MoCA) is one of the most widely-used cognitive screening instruments and has been translated into several different languages and dialects. Although the original validation study suggested to use a cutoff of ≤26, subsequent studies have shown that lower cutoff values may yield fewer false-positive indications of cognitive impairment. The aim of this study was to summarize the diagnostic accuracy and mean difference of the MoCA when comparing cognitively unimpaired (CU) older adults to those with amnestic mild cognitive impairment (aMCI).

Methods

PubMed and EMBASE databases were searched from inception to 22 February 2022. Meta-analyses for area under the curve (AUC) and standardized mean difference (SMD) values were performed.

Results

Fifty-five observational studies that included 17,343 CU and 8,413 aMCI subjects were selected for inclusion. Thirty-nine studies were used in the AUC analysis while 44 were used in the SMD analysis. The overall AUC value was 0.84 (95% CI: 0.81, 0.87) indicating good diagnostic accuracy and a large effect size was noted for the SMD analysis (Hedge's g = 1.49, 95% CI: 1.33, 1.64). Both analyses had high levels of between-study heterogeneity. The median cutoff score for identifying aMCI was <24.

Discussion and conclusion

The MoCA has good diagnostic accuracy for detecting aMCI across several different languages. The findings of this meta-analysis also support the use of 24 as the optimal cutoff when the MoCA is used to screen for suspected cognitive impairment.

Using Virtual Reality in the Care of Older Adults With Dementia: A Randomized Controlled Trial

There is a shortage of personnel to provide care for older adults with dementia, and traditional teaching methods could be improved. The teaching method used in the Care for Older Adults With Dementia course is mainly theoretical, lacking real-life care scenarios and practical procedural training. In the current study, we developed a virtual reality (VR) teaching system and designed a randomized controlled trial aimed at testing the availability of the VR-assisted teaching system, filling the gap in teaching through care scenarios, enabling students majoring in intelligent health and oldage care service management to have a more positive attitude toward learning, and improving students' knowledge and course satisfaction. This study showed that the developed VR system can meet the initial needs of daily teaching, help students have a more positive attitude toward learning, and improve their academic performance and course satisfaction. [Journal of Gerontological Nursing, 49(11), 25-32.].

Digital Marker for Early Screening of Mild Cognitive Impairment Through Hand and Eye Movement Analysis in Virtual Reality Using Machine Learning: First Validation Study

BACKGROUND

With the global rise in Alzheimer disease (AD), early screening for mild cognitive impairment (MCI), which is a preclinical stage of AD, is of paramount importance. Although biomarkers such as cerebrospinal fluid amyloid level and magnetic resonance imaging have been studied, they have limitations, such as high cost and invasiveness. Digital markers to assess cognitive impairment by analyzing behavioral data collected from digital devices in daily life can be a new alternative. In this context, we developed a "virtual kiosk test" for early screening of MCI by analyzing behavioral data collected when using a kiosk in a virtual environment.

OBJECTIVE

We aimed to investigate key behavioral features collected from a virtual kiosk test that could distinguish patients with MCI from healthy controls with high statistical significance. Also, we focused on developing a machine learning model capable of early screening of MCI based on these behavioral features.

METHODS

A total of 51 participants comprising 20 healthy controls and 31 patients with MCI were recruited by 2 neurologists from a university hospital. The participants performed a virtual kiosk test-developed by our group-where we recorded various behavioral data such as hand and eye movements. Based on these time series data, we computed the following 4 behavioral features: hand movement speed, proportion of fixation duration, time to completion, and the number of errors. To compare these behavioral features between healthy controls and patients with MCI, independent-samples 2-tailed t tests were used. Additionally, we used these behavioral features to train and validate a machine learning model for early screening of patients with MCI from healthy controls.

RESULTS

In the virtual kiosk test, all 4 behavioral features showed statistically significant differences between patients with MCI and healthy controls. Compared with healthy controls, patients with MCI had slower hand movement speed (t49=3.45; P=.004), lower proportion of fixation duration (t49=2.69; P=.04), longer time to completion (t49=-3.44; P=.004), and a greater number of errors (t49=-3.77; P=.001). All 4 features were then used to train a support vector machine to distinguish between healthy controls and patients with MCI. Our machine learning model achieved 93.3% accuracy, 100% sensitivity, 83.3% specificity, 90% precision, and 94.7% F1-score.

CONCLUSIONS

Our research preliminarily suggests that analyzing hand and eye movements in the virtual kiosk test holds potential as a digital marker for early screening of MCI. In contrast to conventional biomarkers, this digital marker in virtual reality is advantageous as it can collect ecologically valid data at an affordable cost and in a short period (5-15 minutes), making it a suitable means for early screening of MCI. We call for further studies to confirm the reliability and validity of this approach.

Virtual reality technology in the detection of mild cognitive impairment: A systematic review and meta-analysis

BACKGROUND

In recent years, virtual reality technology has developed the potential to help in the early detection of mild cognitive impairment (MCI). However, integrative evidence of its detection performance for mild cognitive impairment is lacking, and meta-analysis or systematic reviews are required to further determine the effectiveness of virtual reality technology in screening for MCI.

METHODS

Literature searches were performed for MCI screening tests in the Cochrane Library, Web of Science, PsycINFO, PubMed, EMBASE, CINAHL, and Scopus. The primary outcome was the performance of VR tests for MCI detection. A protocol for this systematic review was registered in PROSPERO (Registration number: CRD42022302139).

RESULTS

A total of 14 studies in 13 reports were eventually included. The combined data with the bivariate random-effects model gave a summary point of 0.89 sensitivity (95 % confidence interval [CI]: 0.82-0.94) and 0.91 specificity (95 % CI: 0.82-0.96). The SROC curve was plotted, the DOR was 79.25 (95 % CI: 22.59-277.99), and the AUC was 0.95 (95 % CI: 0.93-0.97).

CONCLUSIONS

Virtual reality-based tests have shown considerable detection performance in detecting MCI, and therefore, virtual reality-based tests can serve as recommended screening methods. Future studies can consider longitudinal assessment and follow-up programs to identify progressive changes.

Innovations in Neuropsychology: Future Applications in Neurosurgical Patient Care

Over the last century, collaboration between clinical neuropsychologists and neurosurgeons has advanced the state of the science in both disciplines. These advances have provided the field of neuropsychology with many opportunities for innovation in the care of patients prior to, during, and following neurosurgical intervention. Beyond giving a general overview of how present-day advances in technology are being applied in the practice of neuropsychology within a neurological surgery department, this article outlines new developments that are currently unfolding. Improvements in remote platform, computer interface, "real-time" analytics, mobile devices, and immersive virtual reality have the capacity to increase the customization, precision, and accessibility of neuropsychological services. In doing so, such innovations have the potential to improve outcomes and ameliorate health care disparities.

Virtual reality in the diagnostic and therapy for mental disorders: A systematic review

BACKGROUND

Virtual reality (VR) technologies are playing an increasingly important role in the diagnostics and treatment of mental disorders.

OBJECTIVE

To systematically review the current evidence regarding the use of VR in the diagnostics and treatment of mental disorders.

DATA SOURCE

Systematic literature searches via PubMed (last literature update: 9^th of May 2022) were conducted for the following areas of psychopathology: Specific phobias, panic disorder and agoraphobia, social anxiety disorder, generalized anxiety disorder, posttraumatic stress disorder (PTSD), obsessive-compulsive disorder, eating disorders, dementia disorders, attention-deficit/hyperactivity disorder, depression, autism spectrum disorder, schizophrenia spectrum disorders, and addiction disorders.

ELIGIBILITY CRITERIA

To be eligible, studies had to be published in English, to be peer-reviewed, to report original research data, to be VR-related, and to deal with one of the above-mentioned areas of psychopathology.

STUDY EVALUATION

For each study included, various study characteristics (including interventions and conditions, comparators, major outcomes and study designs) were retrieved and a risk of bias score was calculated based on predefined study quality criteria.

RESULTS

Across all areas of psychopathology, k = 9315 studies were inspected, of which k = 721 studies met the eligibility criteria. From these studies, 43.97% were considered assessment-related, 55.48% therapy-related, and 0.55% were mixed. The highest research activity was found for VR exposure therapy in anxiety disorders, PTSD and addiction disorders, where the most convincing evidence was found, as well as for cognitive trainings in dementia and social skill trainings in autism spectrum disorder.

CONCLUSION

While VR exposure therapy will likely find its way successively into regular patient care, there are also many other promising approaches, but most are not yet mature enough for clinical application.

REVIEW REGISTRATION

PROSPERO register CRD42020188436.

FUNDING

The review was funded by budgets from the University of Bonn. No third party funding was involved.

Effects of Serious Games on Depression in Older Adults: Systematic Review and Meta-analysis of Randomized Controlled Trials

BACKGROUND

Depression is a severe psychological concern that negatively affects health in older adults. Serious games applied in various fields are considered appropriate interventions, especially in mental health care. However, there is a lack of evidence regarding the effects of serious games on depression in older adults.

OBJECTIVE

This study aimed to investigate the characteristics and effectiveness of serious games for depression in older adults.

METHODS

A systematic review and meta-analysis of randomized controlled trials were conducted. In total, 5 electronic databases (PubMed, CINAHL, Embase, PsycINFO, and Cochrane Library) were searched to identify relevant studies published until July 6, 2021. A total of 2 reviewers independently conducted study selection, data extraction, and quality appraisals. The risk of bias in the included studies was assessed using the JBI Critical Appraisal Checklist. For the meta-analysis, the effect size was calculated as the standardized mean difference (SMD) by using a random effects model.

RESULTS

A total of 17 studies with 1280 older adults were included in the systematic review, and 15 studies were included in the meta-analysis. Serious game interventions were classified into 3 types: physical activity (PA), cognitive function, and both PA and cognitive function. The meta-analysis demonstrated that serious games reduced depression in older adults (SMD -0.54, 95% CI -0.79 to -0.29; P<.001). Serious games had a more significant effect size in community or home settings (SMD -0.61, 95% CI -0.95 to -0.26; P<.001) than in hospital settings (SMD -0.46, 95% CI -0.85 to -0.08; P=.02); however, the difference between groups was not significant. Among the types of games, games for PA (SMD -0.60, 95% CI -0.95 to -0.25; P<.001) and games for both (SMD -0.73, 95% CI -1.29 to -0.17; P=.01) had a significant effect on reducing depression in older adults. However, no significant correlations were observed between the duration or number of serious games and depression.

CONCLUSIONS

Serious games were beneficial in reducing depression in older adults. Regardless of the study setting, serious games appeared to reduce depression. Particularly, serious games including PA had a significant impact on reducing depression. Furthermore, high-quality randomized controlled trials are needed to establish substantial evidence for the effectiveness of serious games on depression in older adults.

TRIAL REGISTRATION

PROSPERO CRD42021242573; https://tinyurl.com/26xf7ym5.

Veterans Affairs Health Care Provider Perceptions of Virtual Reality: Brief Exploratory Survey

Background

Virtual reality (VR), a simulated experience that can be similar to or completely different from the real world, has become increasingly useful within the psychiatric and medical fields. This VR technology has been applied in medical school trainings, exposure therapy for individuals with posttraumatic stress disorder (PTSD), and reminiscence therapy associated with mood disorders for older adults. Perceptions of VR through the lens of the health care provider require further exploration. VR has grown in popularity; however, this modality continues to be underused in most Veterans Affairs (VA) hospitals.

Objective

A web-based survey was used to explore health care provider perceptions of immersive VR availability and use for older adults and identify potential barriers for immersive VR use in older adults with cognitive impairment.

Methods

An 8-item web-based survey was developed to obtain health care provider feedback. This survey was disseminated throughout a single Veterans Integrated Services Network (VISN). The VR survey was developed via the Survey Monkey platform and distributed through the secure VA email network. Providers were asked to voluntarily participate in the brief, anonymous survey and offer their perceptions of immersive VR use within their patient population. Survey data were reviewed and interpreted using descriptive statistics.

Results

A total of 49 respondents completed the survey over a 15-day period. Of them, 36 respondents (73%) had heard of a VR device, though the majority (n=44, 90%) had never used or prescribed a VR device. Respondents identified several potential barriers to immersive VR use in older adults with cognitive impairment (eg, hearing difficulties, perceptions of technology, cognitive concerns, access to resources, and visual impairment). Despite the barriers identified, providers (n=48, 98%) still reported that they would feel comfortable prescribing immersive VR as an intervention for their patient population.

Conclusions

Survey findings revealed that health care providers within this VISN for VAs have heard of VR, although they may not have actively engaged in its use. Most of the providers reported that they would prescribe the use of an immersive VR intervention for their older adult patients. This key point highlights the desire to implement VR strategies for patient use by their providers. If underlying barriers can be addressed and relatively resolved, this technological intervention has the potential to create substantial breakthroughs in clinical care.

Digital Cognitive Biomarker for Mild Cognitive Impairments and Dementia: A Systematic Review

The dementia population is increasing as the world’s population is growing older. The current systematic review aims to identify digital cognitive biomarkers from computerized tests for detecting dementia and its risk state of mild cognitive impairment (MCI), and to evaluate the diagnostic performance of digital cognitive biomarkers. A literature search was performed in three databases, and supplemented by a Google search for names of previously identified computerized tests. Computerized tests were categorized into five types, including memory tests, test batteries, other single/multiple cognitive tests, handwriting/drawing tests, and daily living tasks and serious games. Results showed that 78 studies were eligible. Around 90% of the included studies were rated as high quality based on the Newcastle–Ottawa Scale (NOS). Most of the digital cognitive biomarkers achieved comparable or even better diagnostic performance than traditional paper-and-pencil tests. Moderate to large group differences were consistently observed in cognitive outcomes related to memory and executive functions, as well as some novel outcomes measured by handwriting/drawing tests, daily living tasks, and serious games. These outcomes have the potential to be sensitive digital cognitive biomarkers for MCI and dementia. Therefore, digital cognitive biomarkers can be a sensitive and promising clinical tool for detecting MCI and dementia.