When New Technology is an Answer for Old Problems: The Use of Videoconferencing in Cognitive Aging Assessment

Feasibility of Remote Administration of the Uniform Data Set-Version 3 for Assessment of Older Adults With Mild Cognitive Impairment and Alzheimer's Disease

OBJECTIVE

Assess the feasibility and concurrent validity of a modified Uniform Data Set version 3 (UDSv3) for remote administration for individuals with normal cognition (NC), mild cognitive impairment (MCI), and early dementia.

METHOD

Participants (N = 93) (age: 72.8 [8.9] years; education: 15.6 [2.5] years; 72% female; 84% White) were enrolled from the Wake Forest ADRC. Portions of the UDSv3 cognitive battery, plus the Rey Auditory Verbal Learning Test, were completed by telephone or video within ~6 months of participant's in-person visit. Adaptations for phone administration (e.g., Oral Trails for Trail Making Test [TMT] and Blind Montreal Cognitive Assessment [MoCA] for MoCA) were made. Participants reported on the pleasantness, difficulty, and preference for each modality. Staff provided validity ratings for assessments. Participants' remote data were adjudicated by cognitive experts blinded to the in person-diagnosis (NC [N = 44], MCI [N = 35], Dementia [N = 11], or other [N = 3]).

RESULTS

Remote assessments were rated as pleasant as in-person assessments by 74% of participants and equally difficult by 75%. Staff validity rating (video = 92%; phone = 87.5%) was good. Concordance between remote/in-person scores was generally moderate to good (r = .3 -.8; p < .05) except for TMT-A/OTMT-A (r = .3; p > .05). Agreement between remote/in-person adjudicated cognitive status was good (k = .61-.64).

CONCLUSIONS

We found preliminary evidence that older adults, including those with cognitive impairment, can be assessed remotely using a modified UDSv3 research battery. Adjudication of cognitive status that relies on remotely collected data is comparable to classifications using in-person assessments.

Needs for Successful Engagement in Telemedicine Among Rural Older US Veterans and Their Caregivers: Qualitative Study

BACKGROUND

Telemedicine is an important option for rural older adults who often must travel far distances to clinics or forgo essential care. In 2014, the Geriatric Research, Education, and Clinical Centers (GRECC) of the US Veterans Health Administration (VA) established a national telemedicine network called GRECC Connect. This network increased access to geriatric specialty care for the 1.4 million rural VA-enrolled veterans aged 65 years or older. The use of telemedicine skyrocketed during the COVID-19 pandemic, which disproportionately impacted older adults, exacerbating disparities in specialty care access as overburdened systems shut down in-person services. This surge presented a unique opportunity to study the supports necessary for those who would forgo telemedicine if in-person care were available.

OBJECTIVE

In spring 2021, we interviewed veterans and their informal caregivers to (1) elicit their experiences attempting to prepare for a video visit with a GRECC Connect geriatric specialist and (2) explore facilitators and barriers to successful engagement in a telemedicine visit.

METHODS

We conducted a cross-sectional qualitative evaluation with patients and their caregivers who agreed to participate in at least 1 GRECC Connect telemedicine visit in the previous 3 months. A total of 30 participants from 6 geographically diverse GRECC Connect hub sites agreed to participate. Semistructured interviews were conducted through telephone or the VA's videoconference platform for home telemedicine visits (VA Video Connect) per participant preference. We observed challenges and, when needed, provided real-time technical support to facilitate VA Video Connect use for interviews. All interviews were recorded with permission and professionally transcribed. A team of 5 researchers experienced in qualitative research analyzed interview transcripts using rapid qualitative analysis.

RESULTS

From 30 participant interviews, we identified the following 4 categories of supports participants described regarding successful engagement in telemedicine, as defined by visit completion, satisfaction, and willingness to engage in telemedicine in the future: (1) caregiver presence to facilitate technology setup and communication; (2) flexibility in visit modality (eg, video from home or a clinic or telephone); (3) technology support (eg, determining device compatibility or providing instruction and on-demand assistance); and (4) assurance of comfort with web-based communication, including orientation to features like closed captioning. Supports were needed at multiple points before the visit, and participants stressed the importance of eliciting the varying needs and preferences of each patient-caregiver dyad. Though many initially agreed to a telemedicine visit because of pandemic-related clinic closures, participants were satisfied with telemedicine and willing to use it for other types of health care visits.

CONCLUSIONS

To close gaps in telemedicine use among rural older adults, supports must be tailored to individuals, accounting for technology availability and comfort, as well as availability of and need for caregiver involvement. Comprehensive scaffolding of support starts well before the first telemedicine visit.

Telemedicine-Based Cognitive Examinations During COVID-19 and Beyond: Perspective of the Massachusetts General Hospital Behavioral Neurology & Neuropsychiatry Group

Telehealth and telemedicine have encountered explosive growth since the beginning of the COVID-19 pandemic, resulting in increased access to care for patients located far from medical centers and clinics. Subspecialty clinicians in behavioral neurology & neuropsychiatry (BNNP) have implemented the use of telemedicine platforms to perform cognitive examinations that were previously office based. In this perspective article, BNNP clinicians at Massachusetts General Hospital (MGH) describe their experience performing cognitive examinations via telemedicine. The article reviews the goals, prerequisites, advantages, and potential limitations of performing a video- or telephone-based telemedicine cognitive examination. The article shares the approaches used by MGH BNNP clinicians to examine cognitive and behavioral areas, such as orientation, attention and executive functions, language, verbal learning and memory, visual learning and memory, visuospatial function, praxis, and abstract abilities, as well as to survey for neuropsychiatric symptoms and assess activities of daily living. Limitations of telemedicine-based cognitive examinations include limited access to and familiarity with telecommunication technologies on the patient side, limitations of the technology itself on the clinician side, and the limited psychometric validation of virtual assessments. Therefore, an in-person examination with a BNNP clinician or a formal in-person neuropsychological examination with a neuropsychologist may be recommended. Overall, this article emphasizes the use of standardized cognitive and behavioral assessment instruments that are either in the public domain or, if copyrighted, are nonproprietary and do not require a fee to be used by the practicing BNNP clinician.

Teleneuropsychology for vascular cognitive impairment: Which tools do we have?

The halt of clinical activities imposed during the COVID-19 pandemic forced clinicians to find alternative strategies to provide continuity of care and services, and led to a renewed interest in use of teleneuropsychology (TNP) to remotely assess patients. Recent TNP guidelines recommend maximizing the reproduction of standard in-person assessment, particularly through videoconferences. However, consistency of the adaptations of usual cognitive tests to videoconference needs further elucidation. This review aims at critical reviewing which cognitive tests could be recommended for a remote evaluation of patients with vascular cognitive impairment (VCI) among those widely recognized as reference standards. Current evidence supports the use of global cognitive efficiency (MMSE and MoCA), verbal memory (Revised Hopkins Verbal Learning Test), and language tests (phonemic and semantic verbal fluencies, Boston Naming Test), while there is a lack of strong validity support for measures of visuospatial functions (Rey-Osterreith Complex Figure), and executive functioning and processing speed (Trail making Test, and Digit symbol or Symbol digit tests). This represents a major limitation in the evaluation of VCI because its cognitive profile in often characterized by attention and executive deficits. At present, a videoconference TNP visit appears useful for a brief evaluation of global cognitive efficiency, and to 'triage' patients towards a second level in person evaluation. In future, hybrid models of TNP based on data collected across multiple modalities, incorporating both adaptation of usual cognitive tools and new computerized tools in the supervised videoconference setting, are likely to become the best option for a comprehensive remote cognitive assessment.

Working Group Recommendations for the Practice of Teleneuropsychology in Latin America

OBJECTIVE

Teleneuropsychology (teleNP) could potentially expand access to services for patients who are confined, have limited personal access to healthcare, or live in remote areas. The emergence of the COVID-19 pandemic has significantly increased the use of teleNP for cognitive assessments. The main objective of these recommendations is to identify which procedures can be potentially best adapted to the practice of teleNP in Latin America, and thereby facilitate professional decision-making in the region.

METHOD

Steps taken to develop these recommendations included (1) formation of an international working group with representatives from 12 Latin American countries; (2) assessment of rationale, scope, and objectives; (3) formulation of clinical questions; (4) evidence search and selection; (5) evaluation of existing evidence and summary; and (6) formulation of recommendations. Levels of evidence were graded following the Oxford Centre for Evidence-Based Medicine system. Databases examined included PubMed, WHO-IRIS, WHO and PAHO-IRIS, Índice Bibliográfico Español en Ciencias de la Salud (IBCS), and LILACS.

RESULTS

Working group members reviewed 18,400 titles and 422 abstracts and identified 19 articles meeting the criteria for level of evidence, categorization, and elaboration of recommendations. The vast majority of the literature included teleNP tests in the English language. The working group proposed a series of recommendations that can be potentially best adapted to the practice of teleNP in Latin America.

CONCLUSIONS

There is currently sufficient evidence to support the use of videoconferencing technology for remote neuropsychological assessments. These recommendations will likely contribute to the advancement of teleNP research and practice in the region.

Reliability of Telephone and Videoconference Methods of Cognitive Assessment in Older Adults with and without Dementia

BACKGROUND

Telephone and videoconference administration of cognitive tests introduce additional sources of variance compared to in-person testing. Reviews of test-retest reliability have included mixed neurocognitive and psychiatric populations with limited consideration of methodological and statistical contributions.

OBJECTIVE

We reviewed reliability estimates from comparison studies of older adults with and without dementia, considering test-retest analyses and study methods.

METHODS

Medline, Embase, PsycINFO, and Web of Science were systematically searched from 1 January 2000 to 9 June 2020 for original articles comparing telephone or videoconference administered cognitive instruments to in-person administration in older adults with and without dementia or mild cognitive impairment.

RESULTS

Of 4,125 articles, 23 were included: 11 telephone (N = 2 dementia cohorts) and 12 videoconference (N = 4 dementia cohorts). Telephone administered subtest scores trended in the same direction as in-person with comparable means. Person-level data were scarce. Data on dementia was only available for MMSE, with resulting subtle modality bias. MMSE, SMMSE, Letter Fluency, and HVLT-R in healthy to mild-moderate Alzheimer's disease were particularly reliable for videoconference administration. Other tests show promise but require more observations and comprehensive analyses. Most studies used high-speed stable videoconferencing hardware resulting in a lack of ecological validity for home administration.

CONCLUSION

Remote administration is often consistent with in-person administration but variable and limited at the person/test level. Improved statistical design and inclusion of dementia related cohorts in telephone studies is recommended. Reliability evidence is stronger for videoconferencing but with limited applicability to home administration and severe dementia. Improved reporting of administrative procedures is recommended.

Clinical Trials and Tribulations in the COVID-19 Era

Advances in treating and preventing Alzheimer disease and other neurocognitive disorders of aging arise from rigorous preclinical and clinical research, with randomized controlled treatment trials as the last and definitive test. The COVID-19 pandemic has greatly disrupted ongoing interventional studies and researchers are scrambling to find ways to safely continue this critical work amidst rapidly shifting guidelines from sponsors, institutions, and state and federal guidelines. Here the authors describe novel approaches and work-flow adaptations to study visits, drug delivery and interim and endpoint safety and outcomes assessments to avoid sacrificing years of preparation and substantial financial investments, to work in the best interest of participants and their caregivers, and to continue on the path toward discovering disease-modifying treatments for the millions of individuals impacted by major neurocognitive disorders.

A Validation Study of the Remotely Administered Montreal Cognitive Assessment Tool in the Elderly Japanese Population

Background: In an aging society, neuropsychological testing using video teleconferencing (VTC) is increasingly important. Despite the potential benefit of a VTC-administered Montreal Cognitive Assessment Tool (MoCA) to detect cognitive decline, only a limited number of studies have investigated this tool's reliability. Therefore, we aimed to evaluate the reliability of VTC-administered MoCA compared with face-to-face (FTF)-administered MoCA among elderly Japanese participants. Moreover, we examined participants' satisfaction with VTC-administered MoCA. Methods: Participants ≥60 years of age with and without cognitive impairment (i.e., those with mild cognitive impairment [MCI], those with dementia, and healthy controls [HC]) were assessed with VTC- and FTF-administered MoCA at an interval of >2 weeks and <3 months. The order effect (VTC first vs. FTF first) and time effect (first vs. second testing session), as well as several covariates such as age and years of education were controlled. Intraclass correlation coefficients (ICCs) were calculated using a mixed-effects model to assess the agreement between the two (VTC- vs. FTF-administered) groups. Participants' satisfaction with VTC-administered MoCA was examined using a Likert scale asking seven questions. Results: We included 73 participants in the study (36 men; age, 76.3 ± 7.5 years). The ICC for the MoCA total score was high in the entire sample (0.85), whereas ICCs were moderate to high for the subgroups (MCI: 0.82, dementia: 0.82, and HC: 0.53). Furthermore, we found good overall participant satisfaction with VTC-administered MoCA. Discussion: VTC-administered MoCA appears viable as an alternative to FTF-administered MoCA, although further replication studies with larger sample sizes are needed.

Remote neuropsychological assessment of elderly Japanese population using the Alzheimer’s Disease Assessment Scale: A validation study

Introduction

Studies have demonstrated the high agreement of several remote neuropsychological tests using video teleconferencing (VTC) with face-to-face (FTF) tests. However, the reliability of the remotely administered Alzheimer’s Disease Assessment Scale cognitive subscale (ADAS-cog), one of the most commonly used neuropsychological tests to detect cognitive decline, has not been substantially elucidated, particularly in Japanese populations. Therefore, this study aimed to evaluate the reliability of the remotely administered ADAS-cog compared with FTF-administered ADAS-cog among elderly Japanese participants.

Methods

Participants aged ≥60 years with and without cognitive impairment, i.e. those with mild cognitive impairment (MCI), those with dementia and healthy controls (HCs), were assessed with the ADAS-cog using VTC and FTF testing at an interval of >2 weeks and <3 months. The assessment order (VTC or FTF) was randomized by participants. Participants’ scores were compared among the entire sample, as well as subgroups, using intra-class correlation coefficients (ICCs) in a mixed-effects model.

Results

A total of 73 participants were included in the study (36 men; age, 76.3 ± 7.6 years). The ICC for the ADAS-cog total score was high in the entire sample (0.86), whereas ICCs were moderate to high for the subgroups (MCI: 0.63, dementia: 0.80 and HC: 0.74).

Discussion

The results indicate that a VTC-administered ADAS-cog could be an alternative for an FTF-administered ADAS-cog, although further replication studies with larger sample sizes and a wider range of cognitive functionalities are warranted.

The Impact of the Virtual Cognitive Health Program on the Cognition and Mental Health of Older Adults: Pre-Post 12-Month Pilot Study

Background

Face-to-face multidomain lifestyle interventions have shown to be effective for improving or maintaining cognitive function in older adults at risk for dementia. Remotely delivered interventions could increase access to such solutions but first require evidence to support that these programs can successfully impact health outcomes.

Objective

The objective of this study was to evaluate the impact of a remotely delivered multidomain lifestyle intervention, the virtual cognitive health (VC Health) program, on the cognitive function and mental health of older adults with subjective cognitive decline (SCD).

Methods

A 52-week, prospective, single-arm, pre-post, remote nationwide clinical trial was conducted to measure the change in cognitive function, depression, and anxiety levels for older adults at risk of developing dementia who participated in the VC Health program. A Web-based study platform was used to screen, consent, and enroll participants across the United States. Participants completed the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) test and Web-based assessments (which included the Patient Health Questionnaire [PHQ-9] and Generalized Anxiety Disorder [GAD-7] surveys) at baseline and weeks 12, 24, and 52; all data were collected remotely. Changes in RBANS, PHQ-9, and GAD-7 were assessed using 2-tailed paired t tests and nonparametric signed-rank tests.

Results

Participants (N=82) were, on average, aged 64 years (range 60.0-74.9 years), 74% (61/82) female, 88% (72/82) white, and 67% (55/82) had a college degree or higher. At baseline, participants had a mean and median RBANS Total Index score of 95.9 (SD 11.1) and 95.5 (interquartile range, IQR=13). Participants experienced a mean and median increase of 5.8 (SD 7.4) and 6 (IQR=11) in RBANS Total Index score from baseline to week 52 (P<.001). Participants had a mean and median PHQ-9 score of 8.5 (SD 4.9) and 8 (IQR=6) at baseline and experienced a mean and median decrease of 3.8 (SD 4.1) and 4 (IQR=6) units in PHQ-9 score from baseline to week 52 (P<.001). At baseline, participants had a mean and median GAD-7 score of 6.2 (SD 4.5) and 5.5 (IQR=6) and experienced a mean and median decrease of 2.9 (SD 4.1) and 2 (IQR=5) units in GAD-7 score from baseline to week 52 (P<.001). Participants were engaged and very satisfied with various program components.

Conclusions

In this study, older adults with SCD who were at risk for dementia experienced statistically significant improvements in their cognitive function, depression, and anxiety levels. These findings serve as initial evidence for the overall feasibility and effectiveness of the VC Health program to improve or maintain cognitive function in older adults who are experiencing SCD. Further research should be conducted to understand the degree to which the improvements are attributable to specific components of the intervention.

Trial Registration

ClinicalTrials.gov NCT02969460; https://clinicaltrials.gov/ct2/show/NCT02969460 (Archived by WebCite at http://www.webcitation.org/73XOph9Qm)