Puzzling with online games (BAM-COG): reliability, validity, and feasibility of an online self-monitor for cognitive performance in aging adults

Development of a self-administered online battery for remote assessment of executive functions and verbal memory: equivalence with face-to-face administration, preliminary norms, and acceptance

OBJECTIVES

Interest in teleneuropsychology services increased considerably after the COVID-19 pandemic. However, the utility of unsupervised administration of computerized tests remains largely unexplored. In the present study, we developed a brief computerized battery that assesses self-reported cognitive abilities and performances on executive functioning and verbal memory. We investigated the equivalence of the self-administration online (SAO) procedure and the face-to-face (FTF) administration. Preliminary normative data were developed and the acceptance of the SAO procedure was explored.

METHODS

A community sample of 169 Greek adults [94 women; mean age: 41.95 (SD = 13.40) years, mean years of education: 15.10 (SD = 2.65)] completed the SAO assessment. A subgroup of 40 participants was tested in a counterbalanced way both with SAO and FTF. Participants' performances were compared with paired sample t-tests and the agreement between the two methods was estimated with intraclass correlation coefficients (ICCs). Multiple linear regression analyses were applied to investigate the effect of demographic characteristics on SAO measures.

RESULTS

No difference between SAO and FTF scores was observed. ICCs indicated moderate to good agreement (.418-.848) for most measures. Age was positively associated with self-reported cognitive state and negatively with neuropsychological performances and the level of acceptance of the SAO procedure. Approximately 80% of participants reported satisfaction from the SAO assessment, 69% good compliance with the instructions, but less than 30% belief that the FTF assessment could be adequately replaced.

CONCLUSION

SAO testing is feasible and well accepted among Greek adults yielding equivalent results with FTF testing. Despite the wide satisfaction, though, notable reluctance was noted for the substitution of FTF with SAO procedures.

Participation and engagement in online cognitive testing

Web-based testing of cognitive abilities allows for large-scale assessments without geographical constraints. Yet, the extent to which it can reach populations beyond the typical demographic groups recruited for cognitive studies is unclear. This study focused on comparing the characteristics of individuals from a general population study (HUNT4) who chose to participate in a cognitive study (HUNT4-Hjernetrim) with those who did not. Additionally, we investigated participants' engagement and user experience. We obtained data on socio-demographics, health conditions (both physical and mental), self-reported cognitive or learning difficulties, and lifestyle factors of Hjernetrim participants and non-participants from the HUNT4 database. Hjernetrim involved 13 cognitive tests, administered through the online platform Memoro. We used logistic regressions to assess participation biases and linear regressions to assess participants' engagement and user experience. Of 65,851 HUNT4 participants invited via regular mail to Hjernetrim, 5634 (9.4%, aged 13-97, 54% women) participated. The best represented in the sample were 50-79-year-olds, women, tertiary educated, living alone, from urban areas, not occupationally active, and reporting memory complaints. Individuals who were aged 80+, had motor or vision impairments, and teenagers with learning disabilities, were underrepresented. Participants were more likely to have mental health problems, have or survived cancer and less likely to have cardiovascular disease. Participants logged on mainly during weekdays, the preferred time of day varied by age. On average, participants used 42 min and completed 78% of the tasks. Using PCs provided the most complete data. In terms of user experiences, 65% were positive while 14% were negative or reported technical difficulties. Overall, the study demonstrated that web-based methodology allowed for a relatively well-represented sample that included groups typically difficult to reach. The presence of somatic and mental diseases had a variable influence on participation. Participants finished most tests and reported positive experiences overall.

Supervised, Self-Administered Tablet-Based Cognitive Assessment in Neurodegenerative Disorders and Stroke

INTRODUCTION

As the population ages, the prevalence of cognitive impairment is expanding. Given the recent pandemic, there is a need for remote testing modalities to assess cognitive deficits in individuals with neurological disorders. Self-administered, remote, tablet-based cognitive assessments would be clinically valuable if they can detect and classify cognitive deficits as effectively as traditional in-person neuropsychological testing.

METHODS

We tested whether the Miro application, a tablet-based neurocognitive platform, measured the same cognitive domains as traditional pencil-and-paper neuropsychological tests. Seventy-nine patients were recruited and then randomized to either undergo pencil-and-paper or tablet testing first. Twenty-nine age-matched healthy controls completed the tablet-based assessments. We identified Pearson correlations between Miro tablet-based modules and corresponding neuropsychological tests in patients and compared scores of patients with neurological disorders with those of healthy controls using t tests.

RESULTS

Statistically significant Pearson correlations between the neuropsychological tests and their tablet equivalents were found for all domains with moderate (r > 0.3) or strong (r > 0.7) correlations in 16 of 17 tests (p < 0.05). All tablet-based subtests differentiated healthy controls from neurologically impaired patients by t tests except for the spatial span forward and finger tapping modules. Participants reported enjoyment of the tablet-based testing, denied that it provoked anxiety, and noted no preference between modalities.

CONCLUSIONS

This tablet-based application was found to be widely acceptable to participants. This study supports the validity of these tablet-based assessments in the differentiation of healthy controls from patients with neurocognitive deficits in a variety of cognitive domains and across multiple neurological disease etiologies.

The survey for memory, attention, and reaction time (SMART): Preliminary normative online panel data and user attitudes for a brief web-based cognitive performance measure

ObjectiveThe Survey for Memory, Attention, and Reaction Time (SMART) was recently introduced as a brief (<5 min), self-administered, web-based measure of cognitive performance in older adults. The purpose of this study was threefold: (1) to develop preliminary norms on the SMART; (2) to examine the relationship between demographic variables (i.e. age, sex, education), device type used, and SMART performance; and (3) to assess user attitudes of the SMART. Method A sample of 1,050 community-dwelling adults (M age =59.5 (15.2), M education = 16.5 (2.1), 67.1% female, 96% white) was recruited from an ongoing web-based research cohort. Participants completed the SMART, which consists of four face-valid cognitive tasks assessing visual memory, attention/processing speed, and executive functioning. SMART performance outcome metrics were subtest completion time (CT), click count, and total CT. Participants provided demographic information and completed a survey of user attitudes toward the SMART (i.e. usability, acceptability). Results Older age was the only demographic variable associated with slower SMART total CT (r = .60, p <.001). Education was not associated with SMART CT or click counts overall (p > .05). Male sex was generally associated with longer SMART CT (p < .001, partial eta squared = .14) on all sub-tests. Regarding acceptability, 97.3% indicated willingness to take the SMART again, with more than half willing to complete it on a weekly basis. Conclusion The preliminary normative data on the SMART indicates that it is a feasible and well-accepted web-based cognitive assessment tool that can be administered on multiple device platforms.

FISHERMAN: A Serious Game for Executive Function Assessment of Older Adults

Executive functions (EFs) are essential for daily living activities but decline with age. Convenient assessment and timely intervention have particular significance for older adults. However, the traditional laboratory tasks of EFs are typically monotonous and inconvenient. The current study aimed to develop an interesting and convenient supplementary tool to assess EFs for older adults. According to the theory of EFs, we developed a serious game, FISHERMAN, to assess EFs. The game includes three subgames, Cautious Fisherman, Agile Fisherman, and Wise Fisherman, targeting core components of inhibition, shifting, and working memory, respectively. The current study aims to verify the reliability and validity of the game. One hundred and eight healthy older adults participated in this study and were tested through the FISHERMAN game and a battery of cognitive tests. The results show that the FISHERMAN game has high internal consistency reliability and good construct validity as well as criterion-related validity, suggesting that the game design is valid and can be used in EFs assessment for older adults. Future studies are warranted to establish the norm of the FISHERMAN game in older adults and investigate whether the FISHERMAN game can be generalized to other populations.

Screening for Mild Cognitive Impairment in the Preoperative Setting: A Narrative Review

Cognitive impairment predisposes patients to the development of delirium and postoperative cognitive dysfunction. In particular, in older patients, the adverse sequelae of cognitive decline in the perioperative period may contribute to adverse outcomes after surgical procedures. Subtle signs of cognitive impairment are often not previously diagnosed. Therefore, the aim of this review is to describe the available cognitive screeners suitable for preoperative screening and their psychometric properties for identifying mild cognitive impairment, as preoperative workup may improve perioperative care for patients at risk for postoperative cognitive dysfunction. Electronic systematic and snowball searches of PubMed, PsycInfo, ClinicalKey, and ScienceDirect were conducted for the period 2015–2020. Major inclusion criteria for articles included those that discussed a screener that included the cognitive domain ‘memory’, that had a duration time of less than 15 min, and that reported sensitivity and specificity to detect mild cognitive impairment. Studies about informant-based screeners were excluded. We provided an overview of the characteristics of the cognitive screener, such as interrater and test-retest reliability correlations, sensitivity and specificity for mild cognitive impairment and cognitive impairment, and duration of the screener and cutoff points. Of the 4775 identified titles, 3222 were excluded from further analysis because they were published prior to 2015. One thousand four hundred and forty-eight titles did not fulfill the inclusion criteria. All abstracts of 52 studies on 45 screeners were examined of which 10 met the inclusion criteria. For these 10 screeners, a further snowball search was performed to obtain related studies, resulting in 20 articles. Screeners included in this review were the Mini-Cog, MoCA, O3DY, AD8, SAGE, SLUMS, TICS(-M), QMCI, MMSE2, and Mini-ACE. The sensitivity and specificity range to detect MCI in an older population is the highest for the MoCA, with a sensitivity range of 81–93% and a specificity range of 74–89%. The MoCA, with the highest combination of sensitivity and specificity, is a feasible and valid routine screening of pre-surgical cognitive function. This warrants further implementation and validation studies in surgical pathways with a large proportion of older patients.

The Cognitive Online Self-Test Amsterdam (COST-A): Establishing norm scores in a community-dwelling population

BACKGROUND

Heightened public awareness about Alzheimer's disease and dementia increases the need for at-home cognitive self-testing. We offered Cognitive Online Self-Test Amsterdam (COST-A) to independent groups of cognitively normal adults and investigated the robustness of a norm-score formula and cutoff.

METHODS

Three thousand eighty-eight participants (mean age ± standard deviation = 61 ± 12 years, 70% female) completed COST-A and evaluated it. Demographically adjusted norm scores were the difference between expected COST-A scores, based on age, gender, and education, and actual scores. We applied the resulting norm-score formula to two independent cohorts.

RESULTS

Participants evaluated COST-A to be of adequate difficulty and duration. Our norm-score formula was shown to be robust: ≈8% of participants in two cognitively normal cohorts had abnormal scores. A cutoff of -1.5 standard deviations proved optimal for distinguishing normal from impaired cognition.

CONCLUSION

With robust norm scores, COST-A is a promising new tool for research and clinical practice, providing low cost and minimally invasive remote assessment of cognitive functioning.

A Gamification Framework for Cognitive Assessment and Cognitive Training: Qualitative Study

Background

Cognitive tasks designed to measure or train cognition are often repetitive and presented in a monotonous manner, features that lead to participant boredom and disengagement. In this situation, participants do not put forth their best effort to do these tasks well. As a result, neuropsychologists cannot draw accurate conclusions about the data collected, and intervention effects are reduced. It is assumed that greater engagement and motivation will manifest as improved data quality. Gamification, the use of game elements in nongame settings, has been heralded as a potential mechanism for increasing participant engagement in cognitive tasks. Some studies have reported a positive effect of gamification on participant performance, although most studies have shown mixed results. One reason for these contrasting findings is that most studies have applied poor and heterogeneous design techniques to gamify cognitive tasks. Therefore, an appropriate gamification design framework is needed in these tasks.

Objective

This study aimed to propose a framework to guide the design of gamification in cognitive tasks.

Methods

We employed a design science research (DSR) approach to provide a framework for gamifying cognitive assessments and training by synthesizing current gamification design frameworks and gamification works in cognitive assessment and training, as well as incorporating field experiences. The prototypes of the framework were iteratively evaluated with 17 relevant experts.

Results

We proposed a framework consisting of 7 phases: (1) preparation; (2) knowing users; (3) exploring existing tools for assessing or training a targeted cognitive context and determining the suitability of game-up and mapping techniques; (4) ideation; (5) prototyping using the Objects, Mechanics, Dynamics, Emotions (OMDE) design guideline; (6) development; and (7) disseminating and monitoring.

Conclusions

We found that (1) an intermediate design framework is needed to gamify cognitive tasks, which means that game elements should be selected by considering current cognitive assessment or training context characteristics since game elements may impose an irrelevant cognitive load that, in turn, can jeopardize data quality; (2) in addition to developing a new gamified cognitive task from scratch, 2 gamification techniques are widely used (first, adding game elements to an existing cognitive task and second, mapping an existing game to a cognitive function or impairment to assess or train it); and (3) further research is required to investigate the interplay of cognitive processes and game mechanics.

The Survey for Memory, Attention, and Reaction Time (SMART): Development and Validation of a Brief Web-Based Measure of Cognition for Older Adults

INTRODUCTION

Brief, Web-based, and self-administered cognitive assessments hold promise for early detection of cognitive decline in individuals at risk for dementia. The current study describes the design, implementation, and convergent validity of a fWeb-based cognitive assessment tool, the Survey for Memory, Attention, and Reaction Time (SMART), for older adults.

METHODS

A community-dwelling sample of older adults (n = 69) was included, classified as cognitively intact (n = 44) or diagnosed with mild cognitive impairment (MCI, n = 25). Participants completed the SMART at home using their computer, tablet, or other Internet-connected device. The SMART consists of 4 face-valid cognitive tasks available in the public domain assessing visual memory, attention/processing speed, and executive functioning. Participants also completed a battery of standardized neuropsychological tests, a cognitive screener, and a daily function questionnaire. Primary SMART outcome measures consisted of subtest completion time (CT); secondary meta-metrics included outcomes indirectly assessed or calculated within the SMART (e.g., click count, total CT, time to complete practice items, and time of day the test was completed).

RESULTS

Regarding validity, total SMART CT, which includes time to complete test items, practice items, and directions, had the strongest relationship with global cognition (β = -0.47, p < 0.01). Test item CT was significantly greater for the MCI group (F = 5.20, p = 0.026). Of the SMART tasks, the executive functioning subtests had the strongest relationship with cognitive status as compared to the attention/processing speed and visual memory subtests. The primary outcome measures demonstrated fair to excellent test-retest reliability (intraclass correlation coefficient = 0.50-0.76).

CONCLUSIONS

This study provides preliminary evidence for the use of the SMART protocol as a feasible, reliable, and valid assessment method to monitor cognitive performance in cognitively intact and MCI older adults.

Web-Based Cognitive Testing of Older Adults in Person Versus at Home: Within-Subjects Comparison Study

Background

Web-based research allows cognitive psychologists to collect high-quality data from a diverse pool of participants with fewer resources. However, web-based testing presents unique challenges for researchers and clinicians working with aging populations. Older adults may be less familiar with computer usage than their younger peers, leading to differences in performance when completing web-based tasks in their home versus in the laboratory under the supervision of an experimenter.

Objective

This study aimed to use a within-subjects design to compare the performance of healthy older adults on computerized cognitive tasks completed at home and in the laboratory. Familiarity and attitudes surrounding computer use were also examined.

Methods

In total, 32 community-dwelling healthy adults aged above 65 years completed computerized versions of the word-color Stroop task, paired associates learning, and verbal and matrix reasoning in 2 testing environments: at home (unsupervised) and in the laboratory (supervised). The paper-and-pencil neuropsychological versions of these tasks were also administered, along with questionnaires examining computer attitudes and familiarity. The order of testing environments was counterbalanced across participants.

Results

Analyses of variance conducted on scores from the computerized cognitive tasks revealed no significant effect of the testing environment and no correlation with computer familiarity or attitudes. These null effects were confirmed with follow-up Bayesian analyses. Moreover, performance on the computerized tasks correlated positively with performance on their paper-and-pencil equivalents.

Conclusions

Our findings show comparable performance on computerized cognitive tasks in at-home and laboratory testing environments. These findings have implications for researchers and clinicians wishing to harness web-based testing to collect meaningful data from older adult populations.

Efficacy of a Web App for Cognitive Training (MeMo) Regarding Cognitive and Behavioral Performance in People With Neurocognitive Disorders: Randomized Controlled Trial

BACKGROUND

Cognitive and behavioral symptoms are the clinical hallmarks of neurocognitive disorders. Cognitive training may be offered to reduce the risks of cognitive decline and dementia and to reduce behavioral symptoms, such as apathy. Information and communication technology approaches, including serious games, can be useful in improving the playful aspect of computerized cognitive training and providing motivating solutions in elderly patients.

OBJECTIVE

The objective of this study was to assess the effectiveness of employing the MeMo (Memory Motivation) Web app with regard to cognitive and behavioral symptoms in patients with neurocognitive disorders.

METHODS

MeMo is a Web app that can be used on any Web browser (computer or tablet). The training activities proposed in MeMo are divided into the following two parts: memory and mental flexibility/attention. The study included 46 individuals (mean age 79.4 years) with a diagnosis of neurocognitive disorders at the Institut Claude Pompidou Memory Center in Nice. This randomized controlled study compared the evolution of cognition and behavior between patients not using MeMo (control group) and patients using MeMo (MeMo group) for 12 weeks (four sessions per week). Patients underwent memory and attention tests, as well as an apathy assessment at baseline, week 12 (end of the training period), and week 24 (12 weeks after the end of the training sessions). In addition, to assess the impact of high and low game uses, the MeMo group was divided into patients who used MeMo according to the instructions (about once every 2 days; active MeMo group) and those who used it less (nonactive MeMo group).

RESULTS

When comparing cognitive and behavioral scores among baseline, week 12, and week 24, mixed model analysis for each cognitive and behavioral score indicated no significant interaction between testing time and group. On comparing the active MeMo group (n=9) and nonactive MeMo group (n=13), there were significant differences in two attention tests (Trial Making Test A [P=.045] and correct Digit Symbol Substitution Test items [P=.045]) and in the Apathy Inventory (AI) (P=.02). Mixed analysis (time: baseline, week 12, and week 24 × number of active days) indicated only one significant interaction for the AI score (P=.01), with a significant increase in apathy in the nonactive MeMo group.

CONCLUSIONS

This study indicates that the cognitive and behavioral efficacies of MeMo, a Web-based training app, can be observed only with regular use of the app. Improvements were observed in attention and motivation.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04142801; https://clinicaltrials.gov/ct2/show/NCT04142801.

Do-It-Yourself Gamified Cognitive Training: Viewpoint

Cognitive decline is an important nonmotor symptom in Parkinson disease (PD). Unfortunately, very few treatment options are available. Recent research pointed to small positive effects of nonpharmacological cognitive training in PD. Most of these trainings are performed under supervision and solely computerized versions of (traditional) paper-pencil cognitive training programs, lacking rewarding gamification stimulants that could help to promote adherence. By describing 3 different self-invented ways of cognitive gaming in patients with PD, we aimed to raise awareness for the potential of gamified cognitive training in PD patients. In addition, we hoped to inspire the readers with our case descriptions, highlighting the importance of both personalization and cocreation in the development of games for health. In this viewpoint, we have presented 3 PD patients with different ages, with different disease stages, and from various backgrounds, who all used self-invented cognitive training, including elements of personalization and gamification. To indicate generalization into a larger PD population, the recruitment results from a recent cognitive game trial are added. The presented cases show similarities in terms of awareness of their cognitive decline and the ways this process could potentially be counteracted, by looking for tools to train their cognition. On the basis of the response of the recruitment procedure, there seems to be interest in gamified cognitive training in a larger PD population too. Gamification may add to traditional therapies in terms of personalization and adherence. Positive results have already been found with gamified trainings in other populations, and the cases described here suggest that PD is also an attractive area to develop and test gamified cognitive trainings. However, no results of gamified cognitive trainings in PD have been published to date. This suggests an unmet need in this area and may justify the development of gamified cognitive training and its evaluation, for which our considerations can be used.

Touchscreen games to detect cognitive impairment in senior adults. A user-interaction pilot study

INTRODUCTION

Alzheimer's disease is a degenerative brain disease and the most common cause of dementia. Today, 47 million people live with dementia worldwide. This number is projected to increase to more than 131 million by 2050, as populations age. Therefore, the World Health Organization considers serious cognitive deterioration a public health priority.

OBJECTIVES

Advanced cognitive evaluation mechanisms are needed to help make an early diagnosis. These new mechanisms should overcome the limitations of current neuropsychological tests, including delayed detection; being perceived as intrusive; being non-ecological; being dependent on confounding factors; or their administration being expensive, among others. A promising novel approach consists of the introduction of serious games based on virtual reality and machine learning able to assess cognitive traits relevant to the diagnosis of mild cognitive impairment and Alzheimer's disease.

METHODS

As a result of a preliminary pilot experiment, promising evidence was obtained about the predictive power of this solution. However, for these new serious games to be effective, evidence has to be gathered on the player experience by senior adults, avoiding the limitations of traditional tests at the same time. This study addresses these aspects with the participation of 74 senior users and 15 test administrators.

RESULTS

Main findings confirm the usability and playability of Panoramix, a game battery designed according to the principles discussed above, its technological acceptability and its accessibility. For example, in relation to acceptability, the game battery was scored 4.39 in a 5-point scale, while its average usability score was 4.45 regardless of socio-cultural level or previous experience with digital technologies. In addition, health professionals confirm both, usability and playability, levels with an average score of 6.5 in a 7-point scale. Participants' willingness of using this kind of systems for cognitive evaluation was also confirmed.

CONCLUSION

Promising results obtained pave the way for additional work to confirm the diagnostic validity according to clinical standards of these new cognitive assessment tools.

Web-Based Multidomain Lifestyle Programs for Brain Health: Comprehensive Overview and Meta-Analysis

BACKGROUND

The number of people living with dementia is increasing worldwide, mainly because of aging of the population. To date, there is no pharmaceutical intervention to delay or treat cognitive decline or dementia. As an estimated one-third of dementia cases might be attributable to modifiable lifestyle factors (such as cognitive and physical activity), multidomain lifestyle interventions are a promising way to maintain or improve brain health. Offering programs online would enable large-scale implementation. An overview of multidomain Web-based lifestyle programs for brain health would facilitate comparison and improvement of such programs to develop effective and sustainable interventions.

OBJECTIVE

This study aimed to (1) provide a comprehensive overview of Web-based multidomain lifestyle programs aimed at optimizing brain health in healthy adult populations and (2) describe the programs and targeted lifestyle factors, availability, and evaluation of adherence and user experience. In addition, a meta-analysis was performed to evaluate the effectiveness of these programs.

METHODS

Electronic databases (PubMed, EMBASE, and PsycINFO) were searched for Web-based lifestyle programs that were included when the program (1) aimed to optimize brain health, (2) focused on multiple lifestyle factors, (3) was completely Web-based (website, Web application or mobile app), (4) consisted of multiple sessions, and (5) focused on a healthy adult population. Program characteristics (target population, duration, frequency, tailoring, platform, and availability) and results of program evaluations (effectiveness, user evaluations, and adherence) were extracted and compared. Studies using a controlled design were included in a random-effects meta-analysis on the effectiveness on brain health outcomes. Study quality was assessed using the physiotherapy evidence database (PEDro) scale.

RESULTS

The electronic searches yielded 44 documents describing 14 Web-based lifestyle programs; physical and cognitive activities were targeted in all programs. Four programs (4/14, 29%) were publicly available and free of charge, whereas others were restricted to research settings (5/14, 36%), available after payment (1/14, 7%), or not available at all (2/14, 14%). User evaluations were reported for 8 (57%) of the 14 programs. Reported dropout of the intervention groups ranged from 2% to 52%. Overall, 3 studies evaluated the effectiveness of a program using a controlled design and were included in the meta-analysis (moderate-to-high quality). Pooled results showed a significant small-to-medium effect of the Web-based multidomain lifestyle interventions on outcome measures for brain health (global cognition score, subjective cognitive score, and lifestyle risk score; standard mean difference=0.45; 95% CI 0.12-0.78), with a high degree heterogeneity across studies (I²=75%; P=.02).

CONCLUSIONS

In total, 14 Web-based multidomain lifestyle programs aimed at optimizing brain health were found. The programs showed heterogeneity in both characteristics and effectiveness evaluation. Despite this heterogeneity, this meta-analysis suggests that Web-based lifestyle programs can positively influence brain health outcomes and have the potential to contribute to the prevention of dementia.

Physical Activity Throughout the Adult Life Span and Domain-Specific Cognitive Function in Old Age: A Systematic Review of Cross-Sectional and Longitudinal Data

BACKGROUND

A growing body of literature suggests that physical activity might alleviate the age-related neurodegeneration and decline of cognitive function. However, most of this evidence is based on data investigating the association of exercise interventions or current physical activity behavior with cognitive function in elderly subjects.

OBJECTIVE

We performed a systematic review and hypothesize that physical activity during the adult life span is connected with maintained domain-specific cognitive functions during late adulthood defined as age 60+ years.

METHODS

We performed a systematic literature search up to November 2017 in PubMed, Web of Science, and Google Scholar without language limitations for studies analyzing the association of leisure physical activity during the adult life span (age 18+ years) and domain-specific cognitive functions in older adults (age 60+ years).

RESULTS

The literature review yielded 14,294 articles and after applying inclusion and exclusion criteria, nine cross-sectional and 14 longitudinal studies were included. Moderate- and vigorous-intensity leisure physical activity was associated with global cognitive function and specific cognitive domains including executive functions and memory but not attention or working memory. Most studies assessed mid- to late-adulthood physical activity, thus information concerning the influence of young adult life-span physical activity is currently lacking.

CONCLUSIONS

Observational evidence that moderate- and vigorous-intensity leisure physical activity is beneficially associated with maintained cognitive functions during old age is accumulating. Further studies are necessary to confirm a causal link by assessing objective physical activity data and the decline of cognitive functions at multiple time points during old age.

Episodix: a serious game to detect cognitive impairment in senior adults. A psychometric study

Introduction

Assessment of episodic memory is traditionally used to evaluate potential cognitive impairments in senior adults. The present article discusses the capabilities of Episodix, a game to assess the aforementioned cognitive area, as a valid tool to discriminate among mild cognitive impairment (MCI), Alzheimer’s disease (AD) and healthy individuals (HC); that is, it studies the game’s psychometric validity study to assess cognitive impairment.

Materials and Methods

After a preliminary study, a new pilot study, statistically significant for the Galician population, was carried out from a cross-sectional sample of senior adults as target users. A total of 64 individuals (28 HC, 16 MCI, 20 AD) completed the experiment from an initial sample of 74. Participants were administered a collection of classical pen-and-paper tests and interacted with the games developed. A total of six machine learning classification techniques were applied and four relevant performance metrics were computed to assess the classification power of the tool according to participants’ cognitive status.

Results

According to the classification performance metrics computed, the best classification result is obtained using the Extra Trees Classifier (F1 = 0.97 and Cohen’s kappa coefficient = 0.97). Precision and recall values are also high, above 0.9 for all cognitive groups. Moreover, according to the standard interpretation of Cohen’s kappa index, classification is almost perfect (i.e., 0.81–1.00) for the complete dataset for all algorithms.

Limitations

Weaknesses (e.g., accessibility, sample size or speed of stimuli) detected during the preliminary study were addressed and solved. Nevertheless, additional research is needed to improve the resolution of the game for the identification of specific cognitive impairments, as well as to achieve a complete validation of the psychometric properties of the digital game.

Conclusion

Promising results obtained about psychometric validity of Episodix, represent a relevant step ahead towards the introduction of serious games and machine learning in regular clinical practice for detecting MCI or AD. However, more research is needed to explore the introduction of item response theory in this game and to obtain the required normative data for clinical validity.

Online Self-Administered Cognitive Testing Using the Amsterdam Cognition Scan: Establishing Psychometric Properties and Normative Data

Background

Online tests enable efficient self-administered assessments and consequently facilitate large-scale data collection for many fields of research. The Amsterdam Cognition Scan is a new online neuropsychological test battery that measures a broad variety of cognitive functions.

Objective

The aims of this study were to evaluate the psychometric properties of the Amsterdam Cognition Scan and to establish regression-based normative data.

Methods

The Amsterdam Cognition Scan was self-administrated twice from home—with an interval of 6 weeks—by 248 healthy Dutch-speaking adults aged 18 to 81 years.

Results

Test-retest reliability was moderate to high and comparable with that of equivalent traditional tests (intraclass correlation coefficients: .45 to .80; .83 for the Amsterdam Cognition Scan total score). Multiple regression analyses indicated that (1) participants’ age negatively influenced all (12) cognitive measures, (2) gender was associated with performance on six measures, and (3) education level was positively associated with performance on four measures. In addition, we observed influences of tested computer skills and of self-reported amount of computer use on cognitive performance. Demographic characteristics that proved to influence Amsterdam Cognition Scan test performance were included in regression-based predictive formulas to establish demographically adjusted normative data.

Conclusions

Initial results from a healthy adult sample indicate that the Amsterdam Cognition Scan has high usability and can give reliable measures of various generic cognitive ability areas. For future use, the influence of computer skills and experience should be further studied, and for repeated measurements, computer configuration should be consistent. The reported normative data allow for initial interpretation of Amsterdam Cognition Scan performances.

Smart Aging Platform for Evaluating Cognitive Functions in Aging: A Comparison with the MoCA in a Normal Population

Background: Smart Aging is a Serious games (SGs) platform in a 3D virtual environment in which users perform a set of screening tests that address various cognitive skills. The tests are structured as 5 tasks of activities of daily life in a familiar environment. The main goal of the present study is to compare a cognitive evaluation made with Smart Aging with those of a classic standardized screening test, the Montreal Cognitive Assessment (MoCA).

Methods: One thousand one-hundred thirty-one healthy adults aged between 50 and 80 (M = 64.3 ± 8.3) were enrolled in the study. They received a cognitive evaluation with the MoCA and the Smart Aging platform. Participants were grouped according to their MoCA global and specific cognitive domain (i.e., memory, executive functions, working memory, visual spatial elaboration, language, and orientation) scores and we explored differences among these groups in the Smart Aging indices.

Results: One thousand eighty-six older adults (M = 64.0 ± 8.0) successfully completed the study and were stratified according to their MoCA score: Group 1 with MoCA < 27 (n = 360); Group 2 with 27 ≥ MoCA < 29 (n = 453); and Group 3 with MoCA ≥ 29 (n = 273). MoCA groups significantly differed in most of the Smart Aging indices considered, in particular as concerns accuracy (ps < 0.001) and time (ps < 0.001) for completing most of the platform tasks. Group 1 was outperformed by the other two Groups and was slower than them in these tasks, which were those supposed to assess memory and executive functions. In addition, significant differences across groups also emerged when considering the single cognitive domains of the MoCA and the corresponding performances in each Smart Aging task. In particular, this platform seems to be a good proxy for assessing memory, executive functions, working memory, and visual spatial processes.

Conclusion: These findings demonstrate the validity of Smart Aging for assessing cognitive functions in normal aging. Future studies will validate this platform also in the clinical aging populations.

Designing Serious Computer Games for People With Moderate and Advanced Dementia: Interdisciplinary Theory-Driven Pilot Study

Background

The field of serious games for people with dementia (PwD) is mostly driven by game-design principals typically applied to games created by and for younger individuals. Little has been done developing serious games to help PwD maintain cognition and to support functionality.

Objectives

We aimed to create a theory-based serious game for PwD, with input from a multi-disciplinary team familiar with aging, dementia, and gaming theory, as well as direct input from end users (the iterative process). Targeting enhanced self-efficacy in daily activities, the goal was to generate a game that is acceptable, accessible and engaging for PwD.

Methods

The theory-driven game development was based on the following learning theories: learning in context, errorless learning, building on capacities, and acknowledging biological changes—all with the aim to boost self-efficacy. The iterative participatory process was used for game screen development with input of 34 PwD and 14 healthy community dwelling older adults, aged over 65 years. Development of game screens was informed by the bio-psychological aging related disabilities (ie, motor, visual, and perception) as well as remaining neuropsychological capacities (ie, implicit memory) of PwD. At the conclusion of the iterative development process, a prototype game with 39 screens was used for a pilot study with 24 PwD and 14 healthy community dwelling older adults. The game was played twice weekly for 10 weeks.

Results

Quantitative analysis showed that the average speed of successful screen completion was significantly longer for PwD compared with healthy older adults. Both PwD and controls showed an equivalent linear increase in the speed for task completion with practice by the third session (P<.02). Most important, the rate of improved processing speed with practice was not statistically different between PwD and controls. This may imply that some form of learning occurred for PwD at a nonsignificantly different rate than for controls. Qualitative results indicate that PwD found the game engaging and fun. Healthy older adults found the game too easy. Increase in self-reported self-efficacy was documented with PwD only.

Conclusions

Our study demonstrated that PwD’s speed improved with practice at the same rate as healthy older adults. This implies that when tasks are designed to match PwD’s abilities, learning ensues. In addition, this pilot study of a serious game, designed for PwD, was accessible, acceptable, and enjoyable for end users. Games designed based on learning theories and input of end users and a multi-disciplinary team familiar with dementia and aging may have the potential of maintaining capacity and improving functionality of PwD. A larger longer study is needed to confirm our findings and evaluate the use of these games in assessing cognitive status and functionality.

Recommendations for the Use of Serious Games in Neurodegenerative Disorders: 2016 Delphi Panel

The use of Serious Games (SG) in the health domain is expanding. In the field of neurodegenerative disorders (ND) such as Alzheimer’s disease, SG are currently employed both to support and improve the assessment of different functional and cognitive abilities, and to provide alternative solutions for patients’ treatment, stimulation, and rehabilitation. As the field is quite young, recommendations on the use of SG in people with ND are still rare. In 2014 we proposed some initial recommendations (Robert et al., 2014). The aim of the present work was to update them, thanks to opinions gathered by experts in the field during an expert Delphi panel. Results confirmed that SG are adapted to elderly people with mild cognitive impairment (MCI) and dementia, and can be employed for several purposes, including assessment, stimulation, and improving wellbeing, with some differences depending on the population (e.g., physical stimulation may be better suited for people with MCI). SG are more adapted for use with trained caregivers (both at home and in clinical settings), with a frequency ranging from 2 to 4 times a week. Importantly, the target of SG, their frequency of use and the context in which they are played depend on the SG typology (e.g., Exergame, cognitive game), and should be personalized with the help of a clinician.

Reliability and validity of a self-administered tool for online neuropsychological testing: The Amsterdam Cognition Scan

INTRODUCTION

To facilitate large-scale assessment of a variety of cognitive abilities in clinical studies, we developed a self-administered online neuropsychological test battery: the Amsterdam Cognition Scan (ACS). The current studies evaluate in a group of adult cancer patients: test-retest reliability of the ACS and the influence of test setting (home or hospital), and the relationship between our online and a traditional test battery (concurrent validity).

METHOD

Test-retest reliability was studied in 96 cancer patients (57 female; M_age = 51.8 years) who completed the ACS twice. Intraclass correlation coefficients (ICCs) were used to assess consistency over time. The test setting was counterbalanced between home and hospital; influence on test performance was assessed by repeated measures analyses of variance. Concurrent validity was studied in 201 cancer patients (112 female; M_age = 53.5 years) who completed both the online and an equivalent traditional neuropsychological test battery. Spearman or Pearson correlations were used to assess consistency between online and traditional tests.

RESULTS

ICCs of the online tests ranged from .29 to .76, with an ICC of .78 for the ACS total score. These correlations are generally comparable with the test-retest correlations of the traditional tests as reported in the literature. Correlating online and traditional test scores, we observed medium to large concurrent validity (r/ρ = .42 to .70; total score r = .78), except for a visuospatial memory test (ρ = .36). Correlations were affected-as expected-by design differences between online tests and their offline counterparts.

CONCLUSIONS

Although development and optimization of the ACS is an ongoing process, and reliability can be optimized for several tests, our results indicate that it is a highly usable tool to obtain (online) measures of various cognitive abilities. The ACS is expected to facilitate efficient gathering of data on cognitive functioning in the near future.

Design process and preliminary psychometric study of a video game to detect cognitive impairment in senior adults

INTRODUCTION

Assessment of episodic memory has been traditionally used to evaluate potential cognitive impairments in senior adults. Typically, episodic memory evaluation is based on personal interviews and pen-and-paper tests. This article presents the design, development and a preliminary validation of a novel digital game to assess episodic memory intended to overcome the limitations of traditional methods, such as the cost of its administration, its intrusive character, the lack of early detection capabilities, the lack of ecological validity, the learning effect and the existence of confounding factors.

MATERIALS AND METHODS

Our proposal is based on the gamification of the California Verbal Learning Test (CVLT) and it has been designed to comply with the psychometric characteristics of reliability and validity. Two qualitative focus groups and a first pilot experiment were carried out to validate the proposal.

RESULTS

A more ecological, non-intrusive and better administrable tool to perform cognitive assessment was developed. Initial evidence from the focus groups and pilot experiment confirmed the developed game's usability and offered promising results insofar its psychometric validity is concerned. Moreover, the potential of this game for the cognitive classification of senior adults was confirmed, and administration time is dramatically reduced with respect to pen-and-paper tests.

LIMITATIONS

Additional research is needed to improve the resolution of the game for the identification of specific cognitive impairments, as well as to achieve a complete validation of the psychometric properties of the digital game.

CONCLUSION

Initial evidence show that serious games can be used as an instrument to assess the cognitive status of senior adults, and even to predict the onset of mild cognitive impairments or Alzheimer's disease.

Physical Activity and Cognitive Function of Long-Distance Walkers: Studying Four Days Marches Participants

Studies show physical activity to be beneficial for cognitive function. However, studies usually included individuals who were not particularly inclined to exercise. Following research among master athletes, we examined associations between physical activity and cognitive function in participants of the International Nijmegen Four Days Marches. These individuals are also inclined to exercise. On 4 consecutive days >40,000 participants walk a daily distance of 30-50 km (120-200 km or 75-125 miles in total). Four Days Marches participants and less active or inactive control participants from the Nijmegen Exercise Study were examined. Self-reported current and lifelong physical activities were quantified in Metabolic Equivalent of Task minutes/day, and training walking speed was estimated in km/h. Cognitive functioning in the domains of working memory, executive function, and visuospatial short-term memory was assessed using the validated Brain Aging Monitor. Data from 521 participants (mean age 54.7, standard deviation 12.9) showed neither positive associations between lifelong physical activity and working memory, executive function, and visuospatial short-term memory nor positive associations between current physical activity and cognitive functioning in these domains (p-values >0.05). However, a positive association between training walking speed and working memory was revealed (age adjusted β = 0.18, p-value <0.01). Walking speed as a surrogate marker of fitness, but not lifelong and current physical activity levels was associated with cognitive function. Therefore, walking speed deserves more attention in research aimed at unraveling associations between physical activity and cognitive function.

The acceptability of TV-based game platforms as an instrument to support the cognitive evaluation of senior adults at home

Introduction

The computing capabilities of state-of-the-art television sets and media centres may facilitate the introduction of computer-assisted evaluation at home. This approach would help to overcome the drawbacks of traditional pen-and-paper evaluations administered in clinical facilities, as they could be performed in a more comfortable environment, the subject’s home, and they would be more flexible for designing complex environments for the evaluation of neuropsychological constructs that are difficult to assess through traditional testing. The objective of this work was to obtain some initial evidence about the technical acceptance by senior adults of serious games played at home on the TV set and therefore about the convenience of further investigating such an approach to cognitive assesment.

Materials and Methods

We developed a collection of games to be deployed on a TV environment. These games were tried by a group of senior adults at their homes. The Technology Acceptance Model (TAM) was used to validate this approach. Surveys were performed to study the perceived usefulness and perceived ease of use of such technical setting as an instrument for their cognitive evaluation; that is, its technical acceptance. Subjective information collected from participants was correlated with actual interaction data captured. An additional survey was performed 36 months after pilot testing to have an indication about the long-term perceptions about usefulness and ease of use.

Results

More than 90% of participating subjects perceived cognitive games on TV as useful or very useful. The majority of participants selected the TV set as their preferred option to interact with serious games at home, when compared to other devices such as smartphones, tablets or PCs. This result correlates with the number of participants perceiving them as easily usable or very easy to use, and also with automatically captured interaction data. Three out of four seniors expressed their interest in keeping the system at home after the pilot. Besides, these perceptions are fairly stable in time as shown by the survey performed 36 months after pilot testing.

Limitations

Although participating users are a representative sample of the Galician population, which in turn is comparable to the population of most rural areas in Europe, a larger and more diverse user sample would be needed to obtain significant results for a wider population profile.

Conclusion

The study confirmed the technical acceptance, that is, the perceived usefulness and perceived ease of use, of the TV-based home technical setting introduced as a means of cognitive evaluation. This study provides initial evidence on the viability of a TV-based serious games approach for cognitive longitudinal screening at home with little intervention of clinical professionals, thus contributing to the early detection of cognitive impairments in the senior population.

Trends on the application of serious games to neuropsychological evaluation: A scoping review

BACKGROUND

The dramatic technological advances witnessed in recent years have resulted in a great opportunity for changing the way neuropsychological evaluations may be performed in clinical practice. Particularly, serious games have been posed as the cornerstone of this still incipient paradigm-shift, as they have characteristics that make them especially advantageous in trying to overcome limitations associated with traditional pen-and-paper based neuropsychological tests: they can be easily administered and they can feature complex environments for the evaluation of neuropsychological constructs that are difficult to evaluate through traditional tests. The objective of this study was to conduct a scoping literature review in order to map rapidly the key concepts underpinning this research area during the last 25years on the use of serious games for neuropsychological evaluation.

METHODS

MEDLINE, PsycINFO, Scopus and IEEE Xplore databases were systematically searched. The main eligibility criteria were to select studies published in a peer-reviewed journal; written in English; published in the last 25years; focused on the human population, and classified in the neuropsychological field. Moreover, to avoid risk of bias, studies were selected by consensus of experts, focusing primarily in psychometric properties. Therefore, selected studies were analyzed in accordance with a set of dimensions of analysis commonly used for evaluating neuropsychological tests.

RESULTS

After applying the selected search strategy, 57 studies -including 54 serious games- met our selection criteria. The selected studies deal with visuospatial capabilities, memory, attention, executive functions, and complex neuropsychological constructs such as Mild Cognitive Impairment (MCI). Results show that the implementation of serious games for neuropsychological evaluation is tackled in several different ways in the selected studies, and that studies have so far been mainly exploratory, just aiming at testing the feasibility of the proposed approaches.

DISCUSSION

It may be argued that the limited number of databases used might compromise this study. However, we think that the finally included sample is representative, in spite of how difficult is to achieve an optimum and maximum scope. Indeed, this review identifies other research issues related to the development of serious games beyond their reliability and validity. The main conclusion of this review is that there is a great interest in the research community in the use of serious games for neuropsychological evaluation. This scoping review is pertinent, in accordance with the increasing number of studies published in the last three years, they demonstrate its potential as a serious alternative to classic neuropsychological tests. Nevertheless, more research is needed in order to implement serious games that are reliable, valid, and ready to be used in the everyday clinical practice.

Use of the Internet as a prevention tool against cognitive decline in normal aging

Recent demographic trends indicate that older people appear to be one of the fastest growing population groups worldwide. In the year 2000, people older than 65 years represented 12.4% of the population. This number is expected to rise to 19% by 2030, particularly in developed countries. Therefore, there is sustained effort at both national and international levels to prolong the active life of these people as long as possible. Since the present older generation at the age of 55 years is already digitally literate, the use of technologies is one of the solutions. The purpose of this study is to discuss the role of the Internet in the prevention of cognitive decline in normal aging. The author examines clinical studies that exploit the use of the Internet, including online training programs, in the prevention of cognitive decline in healthy older individuals. The findings of the clinical studies indicate that the use of the Internet, especially online cognitive training programs, may have a positive effect on the improvement of cognitive functions in healthy older adults. Nevertheless, larger sample longitudinal randomized controlled clinical trials aimed at the prevention of cognitive decline among healthy older adults are needed.

Gamification of Cognitive Assessment and Cognitive Training: A Systematic Review of Applications and Efficacy

Background

Cognitive tasks are typically viewed as effortful, frustrating, and repetitive, which often leads to participant disengagement. This, in turn, may negatively impact data quality and/or reduce intervention effects. However, gamification may provide a possible solution. If game design features can be incorporated into cognitive tasks without undermining their scientific value, then data quality, intervention effects, and participant engagement may be improved.

Objectives

This systematic review aims to explore and evaluate the ways in which gamification has already been used for cognitive training and assessment purposes. We hope to answer 3 questions: (1) Why have researchers opted to use gamification? (2) What domains has gamification been applied in? (3) How successful has gamification been in cognitive research thus far?

Methods

We systematically searched several Web-based databases, searching the titles, abstracts, and keywords of database entries using the search strategy (gamif* OR game OR games) AND (cognit* OR engag* OR behavi* OR health* OR attention OR motiv*). Searches included papers published in English between January 2007 and October 2015.

Results

Our review identified 33 relevant studies, covering 31 gamified cognitive tasks used across a range of disorders and cognitive domains. We identified 7 reasons for researchers opting to gamify their cognitive training and testing. We found that working memory and general executive functions were common targets for both gamified assessment and training. Gamified tests were typically validated successfully, although mixed-domain measurement was a problem. Gamified training appears to be highly engaging and does boost participant motivation, but mixed effects of gamification on task performance were reported.

Conclusions

Heterogeneous study designs and typically small sample sizes highlight the need for further research in both gamified training and testing. Nevertheless, careful application of gamification can provide a way to develop engaging and yet scientifically valid cognitive assessments, and it is likely worthwhile to continue to develop gamified cognitive tasks in the future.

Changing Behavioral Lifestyle Risk Factors Related to Cognitive Decline in Later Life Using a Self-Motivated eHealth Intervention in Dutch Adults

Background

Our labor force is aging, but aged workers are not yet coached on how to stay cognitively fit for the job.

Objective

In this study, we tested whether a self-motivated, complex eHealth intervention could improve multiple health-related behaviors that are associated with cognitive aging among working Dutch adults.

Methods

This quasi-experimental prospective study with a pre-post design was conducted with employees of Dutch medium to large companies. All employees with Internet access, a good understanding of the Dutch language, and who provided digital informed consent were eligible to participate. In total, 2972 participants (2110/2972, 71.11% females) with a mean (standard deviation, SD) age of 51.8 (SD 12.9) years were recruited; 2305 became active users of the intervention, and 173 completed the 1-year follow-up. This self-motivated eHealth lifestyle intervention stimulates participants to set personally relevant, monthly health behavior change goals using Goal Attainment Scaling and to realize these goals by implementing behavior change techniques grounded in behavior change theory. The primary outcomes were the goal-setting success rate and the change in overall lifestyle score from baseline to the 1-year follow-up; the score was based on physical activity, diet, smoking, alcohol, sleep, and stress scores. The secondary outcomes were the changes in body weight, body mass index, specific lifestyle characteristics, and website usage.

Results

A total of 1212 participants set 2620 behavior change goals; 392 participants assessed 1089 (1089/2288, 47.59%) goals and successfully achieved 422 (422/1089, 38.75%) of these goals. Among the goal-setting participants in follow-up, this led to a +0.81-point improvement (95% CI 0.49-1.13, P<.001) in overall lifestyle (d=0.32) and weight loss of 0.62 kg (95% CI −1.16 to −0.07, P=.03). These participants also showed significant improvement in 8 out of 11 specific lifestyle components.

Conclusions

Among an adult Dutch population, this eHealth intervention resulted in lifestyle changes in behavioral risk factors associated with cognitive decline, and these improvements lasted over the period of 1 year. Given the general aging of our workforce, this eHealth intervention opens new avenues for the widespread use of cost-effective self-motivated prevention programs aimed at prevention of early-stage cognitive decline and more self-management of their risk factors.

Trial Registration

Nederlands Trial Register: NTR4144; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4144 (Archived by WebCite at http://www.webcitation.org/6cZzwZSg3).

Using an eHealth Intervention to Stimulate Health Behavior for the Prevention of Cognitive Decline in Dutch Adults: A Study Protocol for the Brain Aging Monitor

Background

Internet-delivered intervention programs are an effective way of changing health behavior in an aging population. The same population has an increasing number of people with cognitive decline or cognitive impairments. Modifiable lifestyle risk factors such as physical activity, nutrition, smoking, alcohol consumption, sleep, and stress all influence the probability of developing neurodegenerative diseases such as Alzheimer’s disease.

Objective

This study aims to answer two questions: (1) Is the use of a self-motivated, complex eHealth intervention effective in changing multiple health behaviors related to cognitive aging in Dutch adults in the work force, especially those aged 40 and over? and (2) Does this health behavior change result in healthier cognitive aging patterns and contribute to preventing or delaying future onset of neurodegenerative syndromes?

Methods

The Brain Aging Monitor study uses a quasi-experimental 2-year pre-posttest design. The Brain Aging Monitor is an online, self-motivated lifestyle intervention program. Recruitment is done both in medium to large organizations and in the Dutch general population over the age of 40. The main outcome measure is the relationship between lifestyle change and cognitive aging. The program uses different strategies and modalities such as Web content, email, online newsletters, and online games to aid its users in behavior change. To build self-regulatory skills, the Brain Aging Monitor offers its users goal-setting activities, skill-building activities, and self-monitoring.

Results

Study results are expected to be published in early 2016.

Conclusions

This study will add to the body of evidence on the effectiveness of eHealth intervention programs with the combined use of state-of-the-art applied games and established behavior change techniques. This will lead to new insights on how to use behavior change techniques and theory in multidimensional lifestyle eHealth research, and how these techniques and theories apply when they are used in a setting where no professional back-end is available.

Trial Registration

Nederlands Trial Register: NTR4144; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4144 (Archived by WebCite at http://www.webcitation.org/6cZzwZSg3)