Validation of the mobile verbal learning test: Illustration of its use for age and disease-related cognitive deficits

Integration of sex/gender and utilization of ecological Momentary assessment of cognition in clinical populations: A scoping review

Objectives: We aimed to describe the methods of smartphone-based cognitive ecological momentary assessment designs in clinical populations, with an intention to evaluate how the role of sex and/or gender has been considered in the design and analyses, particularly including female-specific physiology. Methods: This scoping review was conducted based on JBI scoping review methodology. On March 2nd, 2023, we searched for literature across four databases. Screening of the results and data extraction were conducted in duplicate according to the a priori methods in the pre-registered protocol. Results: 31 articles were included in this review. Participants ranged in age from 15-85 years old with various clinical disorders. Prompts were given between 1-7 times per day for 7-84 days. Executive function was the most frequently assessed cognitive domain. Over half the studies (n = 17, 55%) did not investigate the effects of sex and/or gender, and only one study considered the impact of hormonal therapy. Many studies (n = 14, 45%) used sex and gender interchangeably or incorrectly. Conclusions: Studies varied in design, with heterogeneity in the reporting of methodological information. The lack of attention to sex/gender on neuropsychological outcomes can lead to confusion and contradiction regarding its potential impact on cognition in clinical populations. This may hinder the identification of effective interventions for those assigned female at birth who have been overlooked or considered indistinguishable from their male counterparts. Given the well-documented impact of sex/gender on cognition, it is essential that future neuropsychological research, especially EMA-based studies, prioritize investigating sex/gender to ensure better outcomes for all.

Concurrent validity and reliability of at-home teleneuropsychological evaluations among people with and without HIV

OBJECTIVE

To determine the reliability of teleneuropsychological (TNP) compared to in-person assessments (IPA) in people with HIV (PWH) and without HIV (HIV-).

METHODS

Participants included 80 PWH (Mage = 58.7, SDage = 11.0) and 23 HIV- (Mage = 61.9, SDage = 16.7). Participants completed two comprehensive neuropsychological IPA before one TNP during the COVID-19 pandemic (March-December 2020). The neuropsychological tests included: Hopkins Verbal Learning Test-Revised (HVLT-R Total and Delayed Recall), Controlled Oral Word Association Test (COWAT; FAS-English or PMR-Spanish), Animal Fluency, Action (Verb) Fluency, Wechsler Adult Intelligence Scale 3rd Edition (WAIS-III) Symbol Search and Letter Number Sequencing, Stroop Color and Word Test, Paced Auditory Serial Addition Test (Channel 1), and Boston Naming Test. Total raw scores and sub-scores were used in analyses. In the total sample and by HIV status, test-retest reliability and performance-level differences were evaluated between the two consecutive IPA (i.e., IPA1 and IPA2), and mean in-person scores (IPA-M), and TNP.

RESULTS

There were statistically significant test-retest correlations between IPA1 and IPA2 (r or ρ = .603-.883, ps < .001), and between IPA-M and TNP (r or ρ = .622-.958, ps < .001). In the total sample, significantly lower test-retest scores were found between IPA-M and TNP on the COWAT (PMR), Stroop Color and Word Test, WAIS-III Letter Number Sequencing, and HVLT-R Total Recall (ps < .05). Results were similar in PWH only.

CONCLUSIONS

This study demonstrates reliability of TNP in PWH and HIV-. TNP assessments are a promising way to improve access to traditional neuropsychological services and maintain ongoing clinical research studies during the COVID-19 pandemic.

Feasibility and validity of ecological momentary cognitive testing among older adults with mild cognitive impairment

It is critical to intervene early in the mild cognitive impairment (MCI) stage of the Alzheimer's disease trajectory, but traditional cognitive testing methods are costly, burdensome, and difficult to access. We examined adherence and validity data to a 30-day self-administered ecological momentary cognitive testing protocol among a sample of older adults with MCI and cognitively normal controls to evaluate feasibility, tolerability, and initial validity in comparison to standard neuropsychological tests. Participants included 48 participants with MCI (Mean age = 72 years, SD = 7 years) and 46 demographically-matched cognitively normal (NC) control participants (Mean age = 70 years, SD = 7 years). Participants completed traditional neuropsychological testing to determine MCI status, followed by 30 days of remote ecological momentary cognitive testing. Ecological momentary assessment (EMA) surveys were administered 3 times per day for 30 days (possible total = 90), and mobile cognitive tests were administered every other day (for a total of 15 administrations). Mobile cognitive tests included the Variable Difficulty List Memory Test (VLMT; measure of learning and memory), Memory Matrix (measure of visual working memory), and the Color Trick Test (measure of executive function). EMA and mobile cognitive test adherence, fatigue effects, mobile cognitive test performance and group differences, and psychometrics (reliability, convergent validity, ceiling effects, and practice effects) were examined. Overall mean-level adherence to the mobile cognitive tests was 85% and did not differ by MCI status. The reliability of stable between-person individual differences for the VLMT and Memory Matrix were very high. Moreover, although the reliability of within-person change for Memory Matrix was adequate, the corresponding reliability for VLMT was somewhat low. Averaged performance on the mobile cognitive tests was correlated with lab-based tests measuring the same construct. Participants with MCI performed worse than NCs on the VLMT and Color Trick Test, and there was no evidence of fatigue effects for these two tests. These findings support the feasibility and potential for ecological momentary cognitive testing to support clinical trials and for measuring cognitive changes over time in persons with increased risk for Alzheimer's disease such as those with MCI.

Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study

BACKGROUND

As smartphone technology has become nearly ubiquitous, there is a growing body of literature suggesting that ecological momentary cognitive testing (EMCT) offers advantages over traditional pen-and-paper psychological assessment. We introduce a newly developed platform for the self-administration of cognitive tests in ecologically valid ways.

OBJECTIVE

The aim of this study is to develop a Health Insurance Portability and Accountability Act-compliant EMCT smartphone-based platform for the frequent and repeated testing of cognitive abilities in everyday life. This study examines the psychometric properties of 7 mobile cognitive tests covering domains of processing speed, visual working memory, recognition memory, and response inhibition within our platform among persons with and without bipolar disorder (BD). Ultimately, if shown to have adequate psychometric properties, EMCTs may be useful in research on BD and other neurological and psychiatric illnesses.

METHODS

A total of 45 persons with BD and 21 demographically comparable healthy volunteer participants (aged 18-65 years) completed smartphone-based EMCTs 3 times daily for 14 days. Each EMCT session lasted approximately 1.5 minutes. Only 2 to 3 tests were administered in any given session, no test was administered more than once per day, and alternate test versions were administered in each session.

RESULTS

The mean adherence to the EMCT protocol was 69.7% (SD 20.5%), resulting in 3965 valid and complete tests across the full sample. Participants were significantly more likely to miss tests on later versus earlier study days. Adherence did not differ by diagnostic status, suggesting that BD does not interfere with EMCT participation. In most tests, age and education were related to EMCT performance in expected directions. The average performances on most EMCTs were moderately to strongly correlated with the National Institutes of Health Toolbox Cognition Battery. Practice effects were observed in 5 tests, with significant differences in practice effects by BD status in 3 tests.

CONCLUSIONS

Although additional reliability and validity data are needed, this study provides initial psychometric support for EMCTs in the assessment of cognitive performance in real-world contexts in BD.

Daily Level Association of Physical Activity and Performance on Ecological Momentary Cognitive Tests in Free-living Environments: A Mobile Health Observational Study

BACKGROUND

Research suggests that physical activity (PA) has both acute and chronic beneficial effects on cognitive function in laboratory settings and under supervised conditions. Mobile health technologies make it possible to reliably measure PA and cognition in free-living environments, thus increasing generalizability and reach. Research is needed to determine whether the benefits of PA on cognitive function extend from the laboratory to real-world contexts.

OBJECTIVE

This observational study aims to examine the association between daily fluctuations in PA and cognitive performance using mobile health technologies in free-living environments.

METHODS

A total of 90 adults (mean age 59, SD 6.3 years; 65/90, 72% men) with various comorbidities (eg, cardiovascular risk and HIV) and different levels of baseline cognition (ranging from cognitively normal to impaired) completed ecological momentary cognitive tests (EMCTs) on a smartphone twice daily while wearing an accelerometer to capture PA levels for 14 days. Linear mixed-effects models examined the daily associations of PA with executive function and verbal learning EMCTs. Moderation analyses investigated whether the relationship between daily PA and daily performance on EMCTs changed as a function of baseline cognition, cardiovascular risk, and functional status (independent vs dependent).

RESULTS

Days with greater PA were associated with better (faster) performance on an executive function EMCT after covariate adjustment (estimate -0.013; β=-.16; P=.04). Moderation analyses (estimate 0.048; β=.58; P=.001) indicated that days with greater PA were associated with better (faster) executive function performance in individuals who were functionally dependent (effect size -0.53; P<.001) and not in functionally independent adults (effect size -0.01; P=.91).

CONCLUSIONS

EMCTs may be a sensitive tool for capturing daily-level PA-related fluctuations in cognitive performance in real-world contexts and could be a promising candidate for tracking cognitive performance in digital health interventions aimed at increasing PA. Further research is needed to determine individual characteristics that may moderate the association between daily PA and EMCT performance in free-living environments.

Use of digital health technologies to examine subjective and objective sleep with next-day cognition and daily indicators of health in persons with and without HIV

Most previous studies investigating sleep's association with health outcomes have relied on averaged sleep quality and laboratory-based health measures. This study examines the dynamic within-person relationships between subjective (Ecological Momentary Assessment) and objective sleep (actigraphy) on next-day cognition (subjective and objective), mood, and engagement in daily activities using linear mixed-effects regression modeling. Participants included 94 individuals (59 people with HIV, 35 HIV-) aged 50-74, assessed daily for 14 consecutive days/nights. Subjective and objective sleep were well correlated and were both associated with subjective ratings of cognition, but not objective cognition. Worse subjective sleep was associated with next-day lower happiness and higher depressed mood, and more pain, but was not related to next-day daily activities. Objective sleep was associated with next-day depressed mood and feelings of worry, and was positively associated with next-day television watching. Results provide evidence to support the utility of real-time assessment for sleep and functional outcomes that may lead to potential personalized interventions for individuals with and without HIV.