The Use of Mobile Games to Assess Cognitive Function of Elderly with and without Cognitive Impairment

Effectiveness of Serious Games in Evaluating Cognitive Status of the Elderly: A Systematic Review and Meta-Analysis

Early diagnosis of mild cognitive impairment (MCI) and Alzheimer's disease (AD) is very important in better management of these diseases, and serious games play an effective role in helping to diagnose these diseases more accurately owing to their innovative features. With respect to the diversity of available games, the purpose of this study was to investigate the effectiveness of using serious games to assess the cognitive status of the elderly at risk of MCI/AD. A systematic review was conducted and the correlation of serious game results with cognitive test scores were extracted from eligible studies for meta-analysis. We analyzed the correlation between the results of serious games with the scores of mini-mental state examination (MMSE), Addenbrooke's Cognitive Examination-revised edition (ACE-R), and Montreal Cognitive Assessment (MoCA) tests to evaluate cognitive status of the elderly at risk of MCI/AD, as well as the cognitive aspects examined by these tests. The random-effects model was used to obtain the overall correlation coefficient to assess the relationship between the results of serious games and the above mentioned paper-and-pencil tests. The correlation of game results with the MMSE, ACE-R, and MoCA was 0.604, 0.682, with 0.682, respectively. The correlation between the results of the games with the score of each cognitive aspect was also calculated. Overall, there is a positive correlation between serious game scores in terms of accurate patients' reactions with the scores of MMSE, ACE-R, and MoCA tests. Among the cognitive aspects, the highest correlation was obtained for fluency (0.591). For abstraction, however, the correlation was the lowest (0.036). In all three tests, the correlation was >0.6 and in cognitive aspects was <0.6. Thus, more studies should be conducted to develop serious games that are more in line with cognitive tests.

CoGames: Development of an adaptive smartphone-based and gamified monitoring tool for cognitive function in Multiple Sclerosis

AIM

As part of the development of a smartphone-based app for monitoring MS disease activity and progression (dreaMS, NCT05009160), we developed six gamified tests with multiple difficulty levels as a monitoring tool for cognition. This study quantified the relative difficulty between levels and investigated their reliability, ability to depict practice effects, and user acceptance.

METHODS

Healthy volunteers played each game, covering five cognitive domains, twice per day for 11 consecutive days. Linear mixed models determined the relative difficulty of the levels. Spearman's correlation of the two daily repetitions measured test-retest reliability. Difficulty increased daily except for days 2, 6, and 11, when the easiest level ("Beginner") was repeated to estimate practice effects. Participants rated enjoyment and other components of acceptance on a 5-point scale.

RESULTS

We included 82 participants from April to July 2023 in Basel, Switzerland, of which 76 (51 female, age: 40.3 ± 13.9 years, range 18-69) completed the study according to protocol. Generally, mean performances decreased with higher difficulty levels. Across all levels of all games, the median test-retest correlation was 0.825 (range of medians 0.55-0.9). Mean performance in level "Beginner" improved across all games. The mean enjoyment rating was 3.9 (range: 3.1-4.3).

CONCLUSION

Our study showed that the CoGames yield reliable measures across different cognitive domains and difficulty levels and were enjoyable to play. The observed practice effects must be considered, but also indicate sensitivity to change. These results support the hypothesis that adaptive gamified digital tests can serve as a reliable and well-accepted monitoring tool of cognition in PwMS.

Dementia and Video Games: Systematic and Bibliographic Review

BACKGROUND/OBJECTIVES

This systematic and bibliographic review examines publications in the field of dementia and video game research from 2004 to 2023. The main objective is to assess developments and trends in video game technology for dementia care and detection.

METHODS

The PubMed database was the primary source for publications. PRISMA guidelines were applied to structure this review. Ten variables were defined, investigated, and split into three main categories: bibliographic, medical, and technical.

RESULTS

The results were synthesized using a quantitative approach to reduce bias through interpretation. Of 209 initial results, 77 publications have been included in the investigation. More studies focus on rehabilitation over assessment and detection of dementia. Clinical trials are typically conducted with limited participants. The most populated trials rarely enrol over 300 subjects. On average, around 38 subjects were enrolled in the trials. These studies are commonly supervised by a trainer or technology specialist, suggesting a technology gap in familiarity in the trial demographic.

CONCLUSIONS

Most interventions assessed were custom-designed applications with a specific outcome, focusing on physical activity and cognitive exercises. As the first of its kind, this publication focuses on the technical aspects of applied technologies and development methods. Using video games to treat and detect patients with cognitive impairments like dementia can benefit healthcare professionals, caretakers, and patients.

STASISM: A Versatile Serious Gaming Multi-Sensor Platform for Personalized Telerehabilitation and Telemonitoring

Telemonitoring and telerehabilitation have shown promise in delivering individualized healthcare remotely. We introduce STASISM, a sensor-based telerehabilitation and telemonitoring system, in this work. This platform has been created to facilitate individualized telerehabilitation and telemonitoring for those who need rehabilitation or ongoing monitoring. To gather and analyze pertinent and validated physiological, kinematic, and environmental data, the system combines a variety of sensors and data analytic methodologies. The platform facilitates customized rehabilitation activities based on individual needs, allows for the remote monitoring of a patient's progress, and offers real-time feedback. To protect the security of patient data and to safeguard patient privacy, STASISM also provides secure data transmission and storage. The platform has the potential to significantly improve the accessibility and efficacy of telerehabilitation and telemonitoring programs, enhancing patients' quality of life and allowing healthcare professionals to provide individualized care outside of traditional clinical settings.

Feasibility of common, enjoyable game play for assessing daily cognitive functioning in older adults

Background

Frequent digital monitoring of cognition is a promising approach for assessing endpoints in prevention and treatment trials of Alzheimer's disease and related dementias (ADRD). This study evaluated the feasibility of the MIND GamePack© for recurrent semi-passive assessment of cognition across a longitudinal interval.

Methods

The MIND GamePack consists of four iPad-based games selected to be both familiar and enjoyable: Word Scramble, Block Drop, FreeCell, and Memory Match. Participants were asked to play 20 min/day for 5 days (100 min) for 4 months. Feasibility of use by older adults was assessed by measuring gameplay time and game performance. We also evaluated compliance through semi-structured surveys. A linear generalized estimating equation (GEE) model was used to analyze changes in gameplay time, and a regression tree model was employed to estimate the days it took for game performance to plateau. Subjective and environmental factors associated with gameplay time and performance were examined, including daily self-reported questions of memory and thinking ability, mood, sleep, energy, current location, and distractions prior to gameplay.

Results

Twenty-six cognitively-unimpaired older adults participated (mean age ± SD = 71.9 ± 8.6; 73% female). Gameplay time remained stable throughout the 4-months, with an average compliance rate of 91% ± 11% (1946 days of data across all participants) and weekly average playtime of 210 ± 132 min per participant. We observed an initial learning curve of improving game performance which on average, plateaued after 22-39 days, depending on the game. Higher levels of self-reported memory and thinking ability were associated with more gameplay time and sessions.

Conclusion

MIND GamePack is a feasible and well-designed semi-passive cognitive assessment platform which may provide complementary data to traditional neuropsychological testing in research on aging and dementia.

Assessment of cognitive performance in multiple sclerosis using smartphone-based training games: a feasibility study

BACKGROUND

Cognitive impairment occurs in up to 70% of people with MS (pwMS) and has a large impact on quality of life and working capacity. As part of the development of a smartphone-app (dreaMS) for monitoring MS disease activity and progression, we assessed the feasibility and acceptance of using cognitive games as assessment tools for cognitive domains.

METHODS

We integrated ten cognitive games in the dreaMS app. Participants were asked to play these games twice a week for 5 weeks. All subjects underwent a battery of established neuropsychological tests. User feedback on acceptance was obtained via a five-point Likert-scale questionnaire. We correlated game performance measures with predetermined reference tests (Spearman's rho) and analyzed differences between pwMS and Healthy Controls (rank biserial correlation).

RESULTS

We included 31 pwMS (mean age 43.4 ± 12.0 years; 68% females; median Expanded Disability Status Scale score 3.0, range 1.0-6.0) and 31 age- and sex-matched HC. All but one game showed moderate-strong correlations with their reference tests, (|r_s|= 0.34-0.77). Performance improved in both groups over the 5 weeks. Average ratings for overall impression and meaningfulness were 4.6 (range 4.2-4.9) and 4.7 (range 4.5-4.8), respectively.

CONCLUSION

Moderate-strong correlations with reference tests suggest that adaptive cognitive games may be used as measures of cognitive domains. The practice effects observed suggest that game-derived measures may capture change over time. All games were perceived as enjoyable and meaningful, features crucial for long-term adherence. Our results encourage further validation of adaptive cognitive games as monitoring tools for cognition in larger studies of longer duration.

STUDY REGISTER

ClinicalTrials.gov: NCT04413032.

Evaluation of Processing Speed of Different Cognitive Functions Across the Life Span Using Cognitive Mobile Games

Objective: Processing speed (PS) is an important indicator of cognitive functioning and normal aging. However, the tools used to evaluate these are often rather simplistic and only assess one cognitive component. The aim of this study was to use cognitive mobile games (CMG) to evaluate the evolution of reaction times over the life span during different cognitive tasks. Methodology: We carried out a retrospective observational study in which we obtained anonymized results of 15,000 subjects. Scores of five CMG that train arithmetic, vocabulary, response control, visual attention and recognition, and working memory were analyzed. Results: Overall, we observed a highly statistically significant decrease (P < 0.001) in PS and a decrease of accuracy (P < 0.001) with increasing participant age, indicating that for each cognitive function tested, older participants performed cognitive tasks more slowly than younger participants. We also observed an interaction between the age of the participants and the number of errors. These results are consistent with physiological data with respect to aging and cognition. Conclusion: Owing to their wide availability and ease of use, CMG could be used as a simple tool to monitor cognitive function such as PS. Further studies are needed to study the influence of pathologies on those variables.

Mobile health and neurocognitive domains evaluation through smartphones: A meta-analysis

BACKGROUND

Mobile health (mHealth) have significantly advanced evaluating neurocognitive functions; but, few reports have documented whether they validate neurocognitive impairments as well as paper-and-pencil neuropsychological tests.

OBJECTIVE

To meta-analyze the correlation between mobile applications for neuropsychological tests and validated paper-and-pencil neuropsychological tests for evaluating neurocognitive impairments.

METHOD

We used PubMed, Embase, Cochrane, Web of Science, and IEEE Explorer through January 2020 to identify studies that compared mobile applications for neuropsychological tests vs. paper-and-pencil neurophysiological tests. We used random-effects models via the DerSimonian and Laird method to extract pooled Pearson's correlation coefficients and we stratified by study design.

RESULT

Nine out of 4639 screened articles (one RCT and eight prospective longitudinal case series) were included. For the observational studies, there was a statistically significant strong and direct correlation between mobile applications for neuropsychological test scores and validated paper-and-pencil neuropsychological assessment scores (r = 0.70; 95% CI 0.59, 0.79; I² = 74.5%; p- heterogeneity <0.001). Stronger results were seen for the RCT (r = 0.92; 95% CI 0.77, 0.97).

CONCLUSION

This meta-analysis showed a statistically significant correlation between mobile applications and the validated paper-and-pencil neuropsychological assessments analyzed for the evaluation of neurocognitive impairments.

The Making and Evaluation of Digital Games Used for the Assessment of Attention: Systematic Review

Background

Serious games are now widely used in many contexts, including psychological research and clinical use. One area of growing interest is that of cognitive assessment, which seeks to measure different cognitive functions such as memory, attention, and perception. Measuring these functions at both the population and individual levels can inform research and indicate health issues. Attention is an important function to assess, as an accurate measure of attention can help diagnose many common disorders, such as attention-deficit/hyperactivity disorder and dementia. However, using games to assess attention poses unique problems, as games inherently manipulate attention through elements such as sound effects, graphics, and rewards, and research on adding game elements to assessments (ie, gamification) has shown mixed results. The process for developing cognitive tasks is robust, with high psychometric standards that must be met before these tasks are used for assessment. Although games offer more diverse approaches for assessment, there is no standard for how they should be developed or evaluated.

Objective

To better understand the field and provide guidance to interdisciplinary researchers, we aim to answer the question: How are digital games used for the cognitive assessment of attention made and measured?

Methods

We searched several databases for papers that described a digital game used to assess attention that could be deployed remotely without specialized hardware. We used Rayyan, a systematic review software, to screen the records before conducting a systematic review.

Results

The initial database search returned 49,365 papers. Our screening process resulted in a total of 74 papers that used a digital game to measure cognitive functions related to attention. Across the studies in our review, we found three approaches to making assessment games: gamifying cognitive tasks, creating custom games based on theories of cognition, and exploring potential assessment properties of commercial games. With regard to measuring the assessment properties of these games (eg, how accurately they assess attention), we found three approaches: comparison to a traditional cognitive task, comparison to a clinical diagnosis, and comparison to knowledge of cognition; however, most studies in our review did not evaluate the game’s properties (eg, if participants enjoyed the game).

Conclusions

Our review provides an overview of how games used for the assessment of attention are developed and evaluated. We further identified three barriers to advancing the field: reliance on assumptions, lack of evaluation, and lack of integration and standardization. We then recommend the best practices to address these barriers. Our review can act as a resource to help guide the field toward more standardized approaches and rigorous evaluation required for the widespread adoption of assessment games.

Brain training using cognitive apps can improve cognitive performance and processing speed in older adults

Managing age-related decrease of cognitive function is an important public health challenge, especially in the context of the global aging of the population. Over the last years several Cognitive Mobile Games (CMG) have been developed to train and challenge the brain. However, currently the level of evidence supporting the benefits of using CMG in real-life use is limited in older adults, especially at a late age. In this study we analyzed game scores and the processing speed obtained over the course of 100 sessions in 12,000 subjects aged 60 to over 80 years. Users who trained with the games improved regardless of age in terms of scores and processing speed throughout the 100 sessions, suggesting that old and very old adults can improve their cognitive performance using CMG in real-life use.

Novel integrative rehabilitation system for the upper extremity: Design and usability evaluation

PURPOSE

Design and test the usability of a novel virtual rehabilitation system for bimanual training of gravity supported arms, pronation/supination, grasp strengthening, and finger extension.

METHODS

A robotic rehabilitation table, therapeutic game controllers, and adaptive rehabilitation games were developed. The rehabilitation table lifted/lowered and tilted up/down to modulate gravity loading. Arms movement was measured simultaneously, allowing bilateral training. Therapeutic games adapted through a baseline process. Four healthy adults performed four usability evaluation sessions each, and provided feedback using the USE questionnaire and custom questions. Participant's game play performance was sampled and analyzed, and system modifications made between sessions.

RESULTS

Participants played four sessions of about 50 minutes each, with training difficulty gradually increasing. Participants averaged a total of 6,300 arm repetitions, 2,200 grasp counts, and 2,100 finger extensions when adding counts for each upper extremity. USE questionnaire data averaged 5.1/7 rating, indicative of usefulness, ease of use, ease of learning, and satisfaction with the system. Subjective feedback on the custom evaluation form was 84% favorable.

CONCLUSIONS

The novel system was well-accepted, induced high repetition counts, and the usability study helped optimize it and achieve satisfaction. Future studies include examining effectiveness of the novel system when training patients acute post-stroke.

Impact of Game-Based Interventions on Health-Related Outcomes in Hospitalized Older Patients: A Systematic Review

OBJECTIVES

To examine the effectiveness of game-based interventions compared with usual care on health-related outcomes for acutely hospitalized older patients.

DESIGN

Systematic review of randomized controlled trials (RCT) and nonrandomized trials.

SETTING AND PARTICIPANTS

Adults aged 65 years or older admitted to an Acute Care for Elderly unit were selected.

MEASURES

Health-related outcomes (eg, functional capacity, quality of life, adherence to treatment).

RESULTS

Four RCTs were included in the review. The interventions were based on the implementation of serious-game programs using Nintendo Wii in acute medical patients. Across the included studies, no significant differences were observed between groups on functional capacity and health-related quality of life. Significant differences were found between groups on the adherence to treatment (in favor of the control group), but no differences were obtained in other outcomes such as enjoyment and motivation.

CONCLUSIONS AND IMPLICATIONS

In general, there is very limited evidence for the efficacy to reach conclusions about the effects of game-based interventions on health-related outcomes in acutely hospitalized older patients. Future studies are needed to improve our knowledge in the field; however, we consider that these strategies should be considered in the future complementary to usual care.

Age-Associated Capacity to Progress When Playing Cognitive Mobile Games: Ecological Retrospective Observational Study

Background

The decline of cognitive function is an important issue related to aging. Over the last few years, numerous mobile apps have been developed to challenge the brain with cognitive exercises; however, little is currently known about how age influences capacity for performance improvement when playing cognitive mobile games.

Objective

The objective of this study was to analyze the score data of cognitive mobile games over a period of 100 gaming sessions to determine age-related learning ability for new cognitive tasks by measuring the level of score improvement achieved by participants of different ages.

Methods

Scores from 9000 individuals of different ages for 7 cognitive mobile games over 100 gaming sessions were analyzed. Scores from the first session were compared between age groups using one-way analysis of variance. Mixed models were subsequently used to investigate the progression of scores over 100 sessions.

Results

Statistically significant differences were found between age groups for the initial scores of 6 of the 7 games (linear trend, P<.001). Cognitive mobile game scores increased for all participants (P<.001) suggesting that all participants were able to improve their performance. The rate of improvement was, however, strongly influenced by the age of the participant with slower progression for older participants (P<.001).

Conclusions

This study provides evidence to support two interesting insights—cognitive mobile game scores appear to be sensitive to the changes in cognitive ability that occur with advancing age; therefore, these games could be a convenient way to monitor cognitive function over long-term follow-up, and users who train with the cognitive mobile games improve regardless of age.

The use of cognitive mobile games to assess the interaction of cognitive function and breath-hold

The relationship between cognitive function and breath-holding time is in need of further investigation. We aim to determine whether cognitive mobile games (CMG) are sensitive enough to assess the link between cognition and breath-holding time in non-trained subjects. Thirty-one healthy subjects participated in this study. A set of 3 short CMG: Must Sort (response control), Rush Back (attention, working memory) and True Color (mental flexibility, inhibition) was used. Apneic time was recorded in three different conditions: Total Lung Capacity (TLC): 88 ± 35 s, Functional Residual Capacity (FRC): 49 ± 17 s, and Residual Volume (RV): 32 ± 14 s. In males, breath-holding time at RV was correlated with True Color (r = 0.48) and Rush Back (r = 0.65) and at TLC with True Color (r = 0.45). In women, breath-holding time at TLC and FRC was inversely correlated with Must Sort (r = -0.59 and r = -0.49 respectively). Males and females appeared to differ in their use of cognitive resources during different breath-holding conditions.