Feasibility and validity of ecological momentary cognitive testing among older adults with mild cognitive impairment

Integration of sex/gender and utilization of ecological Momentary assessment of cognition in clinical populations: A scoping review

Objectives: We aimed to describe the methods of smartphone-based cognitive ecological momentary assessment designs in clinical populations, with an intention to evaluate how the role of sex and/or gender has been considered in the design and analyses, particularly including female-specific physiology. Methods: This scoping review was conducted based on JBI scoping review methodology. On March 2nd, 2023, we searched for literature across four databases. Screening of the results and data extraction were conducted in duplicate according to the a priori methods in the pre-registered protocol. Results: 31 articles were included in this review. Participants ranged in age from 15-85 years old with various clinical disorders. Prompts were given between 1-7 times per day for 7-84 days. Executive function was the most frequently assessed cognitive domain. Over half the studies (n = 17, 55%) did not investigate the effects of sex and/or gender, and only one study considered the impact of hormonal therapy. Many studies (n = 14, 45%) used sex and gender interchangeably or incorrectly. Conclusions: Studies varied in design, with heterogeneity in the reporting of methodological information. The lack of attention to sex/gender on neuropsychological outcomes can lead to confusion and contradiction regarding its potential impact on cognition in clinical populations. This may hinder the identification of effective interventions for those assigned female at birth who have been overlooked or considered indistinguishable from their male counterparts. Given the well-documented impact of sex/gender on cognition, it is essential that future neuropsychological research, especially EMA-based studies, prioritize investigating sex/gender to ensure better outcomes for all.

Digital Neuropsychology beyond Computerized Cognitive Assessment: Applications of Novel Digital Technologies

Compared with other health disciplines, there is a stagnation in technological innovation in the field of clinical neuropsychology. Traditional paper-and-pencil tests have a number of shortcomings, such as low-frequency data collection and limitations in ecological validity. While computerized cognitive assessment may help overcome some of these issues, current computerized paradigms do not address the majority of these limitations. In this paper, we review recent literature on the applications of novel digital health approaches, including ecological momentary assessment, smartphone-based assessment and sensors, wearable devices, passive driving sensors, smart homes, voice biomarkers, and electronic health record mining, in neurological populations. We describe how each digital tool may be applied to neurologic care and overcome limitations of traditional neuropsychological assessment. Ethical considerations, limitations of current research, as well as our proposed future of neuropsychological practice are also discussed.

Remote Self-Administration of Cognitive Screeners for Older Adults Prior to a Primary Care Visit: Pilot Cross-Sectional Study of the Reliability and Usability of the MyCog Mobile Screening App

BACKGROUND

Routine cognitive screening is essential in the early detection of dementia, but time constraints in primary care settings often limit clinicians' ability to conduct screenings. MyCog Mobile is a newly developed cognitive screening system that patients can self-administer on their smartphones before a primary care visit, which can help save clinics' time, encourage broader screening practices, and increase early detection of cognitive decline.

OBJECTIVE

The goal of this pilot study was to examine the feasibility, acceptability, and initial psychometric properties of MyCog Mobile. Research questions included (1) Can older adults complete MyCog Mobile remotely without staff support? (2) Are the internal consistency and test-retest reliability of the measures acceptable? and (3) How do participants rate the user experience of MyCog Mobile?

METHODS

A sample of adults aged 65 years and older (N=51) self-administered the MyCog Mobile measures remotely on their smartphones twice within a 2- to 3-week interval. The pilot version of MyCog Mobile includes 4 activities: MyFaces measures facial memory, MySorting measures executive functioning, MySequences measures working memory, and MyPictures measures episodic memory. After their first administration, participants also completed a modified version of the Simplified System Usability Scale (S-SUS) and 2 custom survey items.

RESULTS

All participants in the sample passed the practice items and completed each measure. Findings indicate that the Mobile Toolbox assessments measure the constructs well (internal consistency 0.73 to 0.91) and are stable over an approximately 2-week delay (test-retest reliability 0.61 to 0.71). Participants' rating of the user experience (mean S-SUS score 73.17, SD 19.27) indicated that older adults found the usability of MyCog Mobile to be above average. On free-response feedback items, most participants provided positive feedback or no feedback at all, but some indicated a need for clarity in certain task instructions, concerns about participants' abilities, desire to be able to contact a support person or use in-app technical support, and desire for additional practice items.

CONCLUSIONS

Pilot evidence suggests that the MyCog Mobile cognitive screener can be reliably self-administered by older adults on their smartphones. Participants in our study generally provided positive feedback about the MyCog Mobile experience and rated the usability of the app highly. Based on participant feedback, we will conduct further usability research to improve support functionality, optimize task instructions and practice opportunities, and ensure that patients feel comfortable using MyCog Mobile. The next steps include a clinical validation study that compares MyCog Mobile to gold-standard assessments and tests the sensitivity and specificity of the measures for identifying dementia.

Digital and precision clinical trials: innovations for testing mental health medications, devices, and psychosocial treatments

Mental health treatment advances - including neuropsychiatric medications and devices, psychotherapies, and cognitive treatments - lag behind other fields of clinical medicine such as cardiovascular care. One reason for this gap is the traditional techniques used in mental health clinical trials, which slow the pace of progress, produce inequities in care, and undermine precision medicine goals. Newer techniques and methodologies, which we term digital and precision trials, offer solutions. These techniques consist of (1) decentralized (i.e., fully-remote) trials which improve the speed and quality of clinical trials and increase equity of access to research, (2) precision measurement which improves success rate and is essential for precision medicine, and (3) digital interventions, which offer increased reach of, and equity of access to, evidence-based treatments. These techniques and their rationales are described in detail, along with challenges and solutions for their utilization. We conclude with a vignette of a depression clinical trial using these techniques.

Web-based cognitive assessment in older adults: Where do we stand?

PURPOSE OF REVIEW

The use of digital tools for remote cognitive measurement of older adults is generating increasing interest due to the numerous advantages offered for accessibility and scalability. However, these tools also pose distinctive challenges, necessitating a thorough analysis of their psychometric properties, feasibility and acceptability.

RECENT FINDINGS

In this narrative review, we present the recent literature on the use of web-based cognitive assessment to characterize cognition in older adults and to contribute to the diagnosis of age-related neurodegenerative diseases. We present and discuss three types of web-based cognitive assessments: conventional cognitive tests administered through videoconferencing; unsupervised web-based assessments conducted on a computer; and unsupervised web-based assessments performed on smartphones.

SUMMARY

There have been considerable progress documenting the properties, strengths and limitations of web-based cognitive assessments. For the three types of assessments reported here, the findings support their promising potential for older adults. However, certain aspects, such as the construct validity of these tools and the development of robust norms, remain less well documented. Nonetheless, the beneficial potential of these tools, and their current validation and feasibility data, justify their application [see Supplementary Digital Content (SDC), http://links.lww.com/CONR/A69 ].

A Review on Smartphone Keystroke Dynamics as a Digital Biomarker for Understanding Neurocognitive Functioning

Can digital technologies provide a passive unobtrusive means to observe and study cognition outside of the laboratory? Previously, cognitive assessments and monitoring were conducted in a laboratory or clinical setting, allowing for a cross-sectional glimpse of cognitive states. In the last decade, researchers have been utilizing technological advances and devices to explore ways of assessing cognition in the real world. We propose that the virtual keyboard of smartphones, an increasingly ubiquitous digital device, can provide the ideal conduit for passive data collection to study cognition. Passive data collection occurs without the active engagement of a participant and allows for near-continuous, objective data collection. Most importantly, this data collection can occur in the real world, capturing authentic datapoints. This method of data collection and its analyses provide a more comprehensive and potentially more suitable insight into cognitive states, as intra-individual cognitive fluctuations over time have shown to be an early manifestation of cognitive decline. We review different ways passive data, centered around keystroke dynamics, collected from smartphones, have been used to assess and evaluate cognition. We also discuss gaps in the literature where future directions of utilizing passive data can continue to provide inferences into cognition and elaborate on the importance of digital data privacy and consent.

Assessing cancer-related cognitive function in the context of everyday life using ecological mobile cognitive testing: A protocol for a prospective quantitative study

Objective

Millions of cancer survivors are at risk for cancer-related cognitive impairment (CRCI), yet accurate and accessible assessments of cognitive functioning remain limited. Ecological mobile cognitive testing (EMCT) could offer a solution. This paper presents the protocol for a study that aims to (1) establish the reliability and validity of EMCT to assess CRCI in breast cancer survivors, and (2) prospectively evaluate within-person processes (and interactions) among context, mood, and behavior that explain cognitive variability, everyday functioning, and quality of life of cancer survivors.

Methods

Participants will include breast cancer survivors (>21 years old) who are within 5 years of completing chemotherapy treatment. Participants will complete two virtual visits (baseline, follow-up) 2 months apart to assess self-reported cognitive symptoms and cognitive performance, sociodemographic characteristics, clinical history, everyday functioning, and quality of life. Between virtual visits, EMCT will be used to sample cognitive functioning every other day (28 times total). We will use linear mixed-effect regressions and single-level multiple regression models to analyze the data.

Results

We anticipate a minimum of 124 breast cancer survivors enrolling and completing data collection. Study results will be published in peer-reviewed scientific journals.

Conclusions

Our findings will have broad implications for assessing CRCI in an ecologically valid and person-centered way using EMCT. We aim to provide this protocol to aid researchers who would like to apply this approach to their studies.

Remote monitoring of cognition in cirrhosis and encephalopathy: future opportunity and challenge

Hepatic Encephalopathy (HE) is a critically important complication of chronic liver disease and portal hypertension, but especially in early covert stages remains underdiagnosed and a common cause of hospitalization and morbidity. Defined by often subtle neuropsychiatric changes, significant cognitive deficits have been extensively described. While traditional methods of assessment remain underutilized in practice and subject to significant confounding with other diseases, mobile technology has emerged as a potential future tool to provide simple and dynamic cognitive assessments. This review discusses the proliferation of cognitive assessment tools, describing possible applications in encephalopathy and the challenges such an implementation may face. There are significant potential advantages to assessing cognition in real time in order to aid early detection and intervention and provide a more realistic measurement of real-world function. Despite this, there are issues with reliability, privacy, applicability and more which must be addressed prior to wide proliferation and acceptance for clinical use. Regardless, the rapid uptake of mobile technology in healthcare is likely to have significant implications for the future management of encephalopathy and liver disease at large.