Remote assessment of verbal memory in MS patients using the California Verbal Learning Test

Development of a self-administered online battery for remote assessment of executive functions and verbal memory: equivalence with face-to-face administration, preliminary norms, and acceptance

OBJECTIVES

Interest in teleneuropsychology services increased considerably after the COVID-19 pandemic. However, the utility of unsupervised administration of computerized tests remains largely unexplored. In the present study, we developed a brief computerized battery that assesses self-reported cognitive abilities and performances on executive functioning and verbal memory. We investigated the equivalence of the self-administration online (SAO) procedure and the face-to-face (FTF) administration. Preliminary normative data were developed and the acceptance of the SAO procedure was explored.

METHODS

A community sample of 169 Greek adults [94 women; mean age: 41.95 (SD = 13.40) years, mean years of education: 15.10 (SD = 2.65)] completed the SAO assessment. A subgroup of 40 participants was tested in a counterbalanced way both with SAO and FTF. Participants' performances were compared with paired sample t-tests and the agreement between the two methods was estimated with intraclass correlation coefficients (ICCs). Multiple linear regression analyses were applied to investigate the effect of demographic characteristics on SAO measures.

RESULTS

No difference between SAO and FTF scores was observed. ICCs indicated moderate to good agreement (.418-.848) for most measures. Age was positively associated with self-reported cognitive state and negatively with neuropsychological performances and the level of acceptance of the SAO procedure. Approximately 80% of participants reported satisfaction from the SAO assessment, 69% good compliance with the instructions, but less than 30% belief that the FTF assessment could be adequately replaced.

CONCLUSION

SAO testing is feasible and well accepted among Greek adults yielding equivalent results with FTF testing. Despite the wide satisfaction, though, notable reluctance was noted for the substitution of FTF with SAO procedures.

Early reduction of retinal thickness predicts physical and cognitive disability in newly diagnosed multiple sclerosis patients: results from a cross-sectional study

INTRODUCTION

Retinal nerve fiber layer (RNFL) thickness is a promising biomarker of axonal loss and a potential outcome predictor in Multiple Sclerosis (MS). Cognitive impairment (CoI) exhibits a high prevalence in patients with MS (pwMS), even in the early phases of the disease. Our aim was to explore the role of RNFL thickness as a predictor of physical and cognitive disability in pwMS.

METHODS

All newly diagnosed pwMS referred to the MS centre of the University-Hospital "Policlinico-San Marco" between 2015-2019 were evaluated at baseline and at 3 years. RNFL and ganglion cell layer (GCL) thickness for right (r.e.) and left eyes (l.e.) were measured with Optical Coherence Tomography (OCT). Disability level and cognitive profile were assessed, using the Expanded Disability Status Scale (EDSS) and the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) battery, respectively.

RESULTS

We consecutively enrolled 487 pwMS, including 68 (14.0%) with primary progressive MS (PPMS). At baseline, RNFL and GCL were bilaterally thinner in PPMS (r.e. 90.4 ± 12.7; l.e. 90.2 ± 13.5, and r.e. 80.1 ± 11.2; l.e. 80.3 ± 12.6, respectively) compared to relapsing-remitting MS (RRMS) (r.e. 94.6 ± 13.1; l.e. 94.3 ± 14.8, and r.e. 85.1 ± 9.5; l.e. 84.9 ± 9.3, respectively) (p < 0.01). Both groups exhibited reduced RNFL and GCL thickness, worse cognitive performance and higher EDSS scores at 3-years follow-up compared with baseline. RNFL thickness ≤ 88.0 μm was an independent predictor of CoI (OR = 5.32; 95% CI = 1.84-9.12; p = 0.02) and disability worsening (OR = 3.18; 95% CI = 1.21-10.33; p = 0.05).

DISCUSSION

RNFL thickness, as a biomarker of neurodegeneration, could be considered a predictive biomarker of cognitive degeneration and physical disability in MS.

Konectom™ cognitive processing speed test enables reliable remote, unsupervised cognitive assessment in people with multiple sclerosis: Exploring the use of substitution time as a novel digital outcome measure

BACKGROUND

The Konectom™ smartphone-based cognitive processing speed (CPS) test is designed to assess processing speed and account for impact of visuomotor function on performance.

OBJECTIVE

Evaluate reliability and validity of Konectom CPS Test, performed in clinic and remotely.

METHODS

Data were collected from people with multiple sclerosis (PwMS) aged 18-64 years and healthy control participants (HC) matched for age, sex, and education. Remote test-retest reliability (intraclass correlation coefficients, ICC); correlation with established clinical measures (Spearman correlation coefficients); group analyses between cognitively impaired/unimpaired PwMS; and influence of age, sex, education, and upper limb motor function on CPS Test measures were assessed.

RESULTS

Eighty PwMS and 66 HC participated. CPS Test measures from remote tests had good test-retest reliability (ICC of 0.67-0.87) and correlated with symbol digit modalities test (highest |ρ| = 0.80, p < 0.0001). Remote measures were stable (change from baseline < 5%) and correlated with MS disability (highest |ρ| = 0.39, p = 0.0004) measured by Expanded Disability Status Scale. CPS Test measures displayed sensitivity to cognitive impairment (highest d = 1.47). Demographics and motor function had the lowest impact on CPS Test substitution time, a measure accounting for visuomotor function.

CONCLUSION

Konectom CPS Test measures provide valid, reliable remote measurements of cognitive processing speed in PwMS.

Feasibility of remotely delivered and supported aerobic walking exercise training for cognitive processing speed impairment in fully-ambulatory persons with multiple sclerosis

PURPOSE

The current pilot, single-blind, randomized controlled trial (RCT) examined the feasibility of remotely-delivered and supported aerobic walking exercise training compared with an active control condition on cognitive processing speed (CPS) in 19 fully-ambulatory persons with multiple sclerosis (pwMS) who were pre-screened for impaired CPS.

METHODS

Feasibility was assessed in the domains of process (e.g., recruitment), resource (e.g., monetary costs), management (e.g., time requirements), and scientific outcomes (i.e., treatment effect). Fully-ambulatory, but CPS-impaired pwMS were randomly assigned into either 16-weeks of home-based aerobic walking exercise or home-based stretching and range-of-motion activities. Both conditions involved delivery of informational newsletters and one-on-one, online video chats with a behavior coach. Participants across both conditions tracked their activity using highly accurate wearable motion sensors. Treatment-blinded assessors administered the Symbol Digit Modalities Test (SDMT) remotely before and after the 16-week study period.

RESULTS

The study was cost-effective, accessible, and acceptable. The intervention further was safe. Adherence and compliance rates across both conditions exceeded 80%. There was an overall moderate effect for change in SDMT score between the conditions (d = 0.42). The intervention was associated with a 4.8-point improvement in SDMT scores (d = 0.70; 10% increase) compared with a 1-point improvement for the control condition (d = 0.09; 2% increase).

CONCLUSIONS

This remotely-delivered and supported aerobic walking exercise training intervention was safe and feasible for fully-ambulatory, CPS-impaired pwMS. The pattern of results, including the promising effects on CPS, support the design and implementation of an appropriately-powered RCT on this approach for managing CPS impairment in a large MS sample.

Remote neuropsychological assessment: Acceptability and feasibility of direct-to-home teleneuropsychology methodology during the COVID-19 pandemic

OBJECTIVE

To determine the acceptability and feasibility of telephone and video-conference calls to complete cognitive assessments during the COVID-19 pandemic.

METHOD

In rapid response to the pandemic, evidence-based adaptations were made to routine face-to-face (FTF) practice, delivering teleneuropsychology (TNP) within a National Health Service (NHS) Scotland neuropsychology service. Caldicott guardian approval was obtained to complete a six month study (April to October 2020) from the early stages of the first United Kingdom (UK) lockdown. Assessments were completed with patients in their own homes (direct-to-home) via remote connections. Neuropsychology clinicians, service-users and referring agents were approached for structured feedback and qualitative comment.

RESULTS

Data was captured for 212 referrals assessed by seven clinical psychologists; with responses from 70 (33%) service-users and 14 (58%) referring agents. 94% of referrals were assessed remotely and discharged. TNP reduced defaulted appointment discharge rates. Gender, socioeconomic deprivation and age did not affect access to information technology (IT) equipment.Clinicians agreed that remote assessment allowed them to complete initial interview (96%) and formulate (77%) cases appropriately. Service-users agreed they were comfortable with equipment (84%), the process was straightforward (74%), and would recommend TNP to others (68%). Referring agents were satisfied with the service provided (100%). Limitations included evidence-based remote test availability, technical issues and home distractions.

CONCLUSIONS

Study findings evidence the acceptability and efficiency of TNP; increasing service accessibility, while reducing infection risk, defaulted appointments and travel. The results advocate for a post-pandemic mixed model of service delivery encompassing both FTF and TNP approaches.

Brain volumetric correlates of remotely versus in-person administered symbol digit modalities test in multiple sclerosis

BACKGROUND

Prior studies in multiple sclerosis (MS) support reliability of telehealth-delivered cognitive batteries, although, to date, none have reported relationships of cognitive test performance to neural correlates across administration modalities. In this study we aimed to compare brain-behavior relationships, using the Symbol Digit Modalities Test (SDMT), the most reliable and sensitive cognitive measure in MS, measured from patients seen via telehealth versus in-person.

METHODS

SDMT was administered to individuals with MS either in-person (N=60, mean age=39.7) or remotely via video conference (N=51, mean age=47.4). Magnetic resonance imaging (MRI) data was collected in 3-Tesla scanners. Using 3-dimensional T1 images cerebral, cortical, deep gray, cerebral white matter and thalamic nuclei volumes were calculated. Using a meta-analysis approach with an interaction term for participant group, individual regression models were run for each MRI measure having SDMT scores as the outcome variable in each model. In addition, the correlation and average difference between In-person and Remote group associations across the MRI measures were calculated. Finally, for each MRI variable I² score was quantified to test the heterogeneity between the groups.

RESULTS

Administration modality did not affect the association of SDMT performance with MRI measures. Brain tissue volumes showing high associations with the SDMT scores in one group also showed high associations in the other (r = 0.83; 95% CI = [0.07, 0.86]). The average difference between the In-person and the Remote group associations was not significant (β_Remote - β_In-person = 0.14, 95% CI = [-0.04, 0.34]). Across MRI measures, the average I² value was 14%, reflecting very little heterogeneity in the relationship of SDMT performance to brain volume.

CONCLUSION

We found consistent relationships to neural correlates across in-person and remote SDMT administration modalities. Hence, our study extended the findings of the previous studies demonstrating the feasibility of remote administration of the SDMT.

Preliminary Findings from a Telephone-Based Cognitive Screening of an Adult HIV Research Cohort during the COVID-19 Pandemic

Objectives

Few publications have documented the utility of in-home telephone-based cognitive screeners during COVID-19. This manuscript describes the adaptation of select face-to-face (FTF) neuropsychological tests to telephonic administration in a longitudinal cohort of people with HIV (PWH). Using the cohort’s pre-pandemic neuropsychological data, we explore the utility of telephonic administration in this population.

Methods

Of a longitudinal cohort of 170 adult PWH, 59 completed telephonic medical and cognitive screenings with comparable pre-pandemic FTF data. Telephone screeners and FTF evaluations were compared using repeated measures ANCOVAs to examine whether test performance differed between administration types and levels of pre-pandemic cognitive performance. Individuals with pre-pandemic test scores more than a standard deviation below the demographically-corrected mean were categorized as “below average” cognitive performance (n = 23), and the remainder as “average” (n = 36).

Results

Over 90% of participants gave positive feedback about the telephone encounter. The average cognitive performance group scored higher than the below average group on all measures across both administration types. Telephone and FTF test scores did not differ significantly for measures of category fluency, letter fluency, and verbal learning. However, the below average group scored higher on a verbal memory measure administered via telephone compared with FTF.

Conclusions

Support for telephonic adaptation of select FTF measures in longitudinal research is mixed, with verbal fluency tasks showing the strongest equivalency. When employed carefully with a clear understanding of their limitations, telephone adaptations can provide an opportunity to continue study objectives, promote equity, and monitor participant well-being during times of duress.

Remote administration of BICAMS measures and the Trail-Making Test to assess cognitive impairment in multiple sclerosis

Reliable remote cognitive testing could provide a safer assessment of cognitive impairment in multiple sclerosis (MS) during the COVID-19 pandemic and thereafter. Here we aimed to investigate the reliability and feasibility of administering Brief International Cognitive Assessment for MS (BICAMS) and the Trail-Making Test (TMT) to people with MS online. Between-group differences on BICAMS and the TMT were examined in a sample of 68 participants. Group 1 (N = 34) was tested in-person pre-pandemic. Group 2 was tested remotely. Within-group differences for in-person and virtual administrations were examined for Group 1. No significant differences between virtual and in-person administrations of the CVLT-II and SDMT were detected. BVMT-R scores were significantly higher for virtual administrations (M = 20.59, SD = 6.65) compared to in-person administrations (M = 16.35, SD = 6.05), possibly indicating inter-rater differences. Strong positive correlations were found for in-person and virtual scores within Group 1 on the CVLT-II (r = .84), SDMT (r = .85), TMT-A (r = .88), TMT-B (r = .76) and BVMT-R (r = .72). No significant differences between in-person and remote administrations of CVLT-II and SDMT in people living with MS were detected. Recommendations for future studies employing the TMT and BVMT-R online are provided.

Digital Biomarkers in Multiple Sclerosis

For incurable diseases, such as multiple sclerosis (MS), the prevention of progression and the preservation of quality of life play a crucial role over the entire therapy period. In MS, patients tend to become ill at a younger age and are so variable in terms of their disease course that there is no standard therapy. Therefore, it is necessary to enable a therapy that is as personalized as possible and to respond promptly to any changes, whether with noticeable symptoms or symptomless. Here, measurable parameters of biological processes can be used, which provide good information with regard to prognostic and diagnostic aspects, disease activity and response to therapy, so-called biomarkers Increasing digitalization and the availability of easy-to-use devices and technology also enable healthcare professionals to use a new class of digital biomarkers-digital health technologies-to explain, influence and/or predict health-related outcomes. The technology and devices from which these digital biomarkers stem are quite broad, and range from wearables that collect patients' activity during digitalized functional tests (e.g., the Multiple Sclerosis Performance Test, dual-tasking performance and speech) to digitalized diagnostic procedures (e.g., optical coherence tomography) and software-supported magnetic resonance imaging evaluation. These technologies offer a timesaving way to collect valuable data on a regular basis over a long period of time, not only once or twice a year during patients' routine visit at the clinic. Therefore, they lead to real-life data acquisition, closer patient monitoring and thus a patient dataset useful for precision medicine. Despite the great benefit of such increasing digitalization, for now, the path to implementing digital biomarkers is widely unknown or inconsistent. Challenges around validation, infrastructure, evidence generation, consistent data collection and analysis still persist. In this narrative review, we explore existing and future opportunities to capture clinical digital biomarkers in the care of people with MS, which may lead to a digital twin of the patient. To do this, we searched published papers for existing opportunities to capture clinical digital biomarkers for different functional systems in the context of MS, and also gathered perspectives on digital biomarkers under development or already existing as a research approach.

Managing Cognitive Dysfunction in Multiple Sclerosis: A Snapshot of Changes in Screening, Assessment, and Treatment Practices

Background: Cognitive dysfunction is prevalent in multiple sclerosis (MS) and can have a negative effect on several aspects of the daily lives of persons with MS. In 2010, members of the Consortium of Multiple Sclerosis Centers (CMSC) were surveyed to understand MS clinicians’ screening, assessment, and treatment practices for cognitive problems. Given the advancements made in the field in the past decade, it was deemed time to reevaluate how cognitive dysfunction is managed in the clinical setting.

Methods: An online questionnaire was completed by 56 CMSC members in which they were asked to describe their clinical practices, procedures for screening and further evaluation, and treatment recommendations for cognitive dysfunction. Participants were also asked whether their practice had changed in terms of the number of cognitive screenings, prescriptions for cognitive problems, and referrals for neuropsychological assessment and cognitive remediation in the past 5 years to allow for clinicians who had not been in practice for 10 years.

Results: Participants reported an increase in the number of cognitive screenings and referrals for neuropsychological assessments and cognitive remediation during the past 5 years. Compared with 2010, participants endorsed greater use of person-administered screening measures, such as the Symbol Digit Modalities Test, and fewer prescriptions for medications to improve cognitive functioning.

Conclusions: Clinical practices are becoming more in line with the literature, with increased use of cognitive screening and remediation. Continued attention to cognitive problems will be an ongoing important component of MS-related care.

Cognitive Assessment via Telephone: A Scoping Review of Instruments

OBJECTIVE

Telephone-based cognitive assessment (TBCA) has long been studied but less widely adopted in routine neuropsychological practice. Increased interest in remote neuropsychological assessment techniques in the face of the coronavirus 2019 (COVID-19) pandemic warrants an updated review of relevant remote assessment literature. While recent reviews of videoconference-based neuropsychological applications have been published, no updated compilation of empirical TBCA research has been completed. Therefore, this scoping review offers relevant empirical research to inform clinical decision-making specific to teleneuropsychology.

METHOD

Peer-reviewed studies addressing TBCA were included. Broad search terms were related to telephone, cognitive, or neuropsychological assessment and screening. After systematic searching of the PubMed and EBSCO databases, 139 relevant articles were retained.

RESULTS

In total, 17 unique cognitive screening measures, 20 cognitive batteries, and 6 single-task measures were identified as being developed or adapted specifically for telephone administration. Tables summarizing the identified cognitive assessments, information on diagnostic accuracy, and comparisons to face-to-face cognitive assessment are included in supplementary materials.

CONCLUSIONS

Overall, literature suggests that TBCA is a viable modality for identifying cognitive impairment in various populations. However, the mode of assessment selected clinically should reflect an understanding of the purpose, evidence, and limitations for various tests and populations. Most identified measures were developed for research application to support gross cognitive characterization and to help determine when more comprehensive testing was needed. While TBCA is not meant to replace gold-standard, face-to-face evaluation, if appropriately utilized, it can expand scope of practice, particularly when barriers to standard neuropsychological assessment occur.

InterOrganizational practice committee recommendations/guidance for teleneuropsychology (TeleNP) in response to the COVID-19 pandemic

Objective: The Inter Organizational Practice Committee (IOPC) convened a workgroup to provide rapid guidance about teleneuropsychology (TeleNP) in response to the COVID-19 pandemic.Method: A collaborative panel of experts from major professional organizations developed provisional guidance for neuropsychological practice during the pandemic. The stakeholders included the American Academy of Clinical Neuropsychology/American Board of Clinical Neuropsychology, the National Academy of Neuropsychology, Division 40 of the American Psychological Association, the American Board of Professional Neuropsychology, and the American Psychological Association Services, Inc. The group reviewed literature, collated federal, regional and state regulations and information from insurers, and surveyed practitioners to identify best practices.Results: Literature indicates that TeleNP may offer reliable and valid assessments, but clinicians need to consider limitations, develop new informed consent procedures, report modifications of standard procedures, and state limitations to diagnostic conclusions and recommendations. Specific limitations affect TeleNP assessments of older adults, younger children, individuals with limited access to technology, and individuals with other individual, cultural, and/or linguistic differences. TeleNP may be contraindicated or infeasible given specific patient characteristics, circumstances, and referral questions. Considerations for billing TeleNP services are offered with reservations that clinicians must verify procedures independently. Guidance about technical issues and "tips" for TeleNP procedures are provided.Conclusion: This document provides provisional guidance with links to resources and established guidelines for telepsychology. Specific recommendations extend these practices to TeleNP. These recommendations may be revised as circumstances evolve, with updates posted continuously at OPC.online.

Cognitive impairment in multiple sclerosis: clinical management, MRI, and therapeutic avenues

Multiple sclerosis is a chronic, demyelinating disease of the CNS. Cognitive impairment is a sometimes neglected, yet common, sign and symptom with a profound effect on instrumental activities of daily living. The prevalence of cognitive impairment in multiple sclerosis varies across the lifespan and might be difficult to distinguish from other causes in older age. MRI studies show that widespread changes to brain networks contribute to cognitive dysfunction, and grey matter atrophy is an early sign of potential future cognitive decline. Neuropsychological research suggests that cognitive processing speed and episodic memory are the most frequently affected cognitive domains. Narrowing evaluation to these core areas permits brief, routine assessment in the clinical setting. Owing to its brevity, reliability, and sensitivity, the Symbol Digit Modalities Test, or its computer-based analogues, can be used to monitor episodes of acute disease activity. The Symbol Digit Modalities Test can also be used in clinical trials, and data increasingly show that cognitive processing speed and memory are amenable to cognitive training interventions.

Inter Organizational Practice Committee Recommendations/Guidance for Teleneuropsychology in Response to the COVID-19 Pandemic†

OBJECTIVE

The Inter Organizational Practice Committee convened a workgroup to provide rapid guidance about teleneuropsychology (TeleNP) in response to the COVID-19 pandemic.

METHOD

A collaborative panel of experts from major professional organizations developed provisional guidance for neuropsychological practice during the pandemic. The stakeholders included the American Academy of Clinical Neuropsychology/American Board of Clinical Neuropsychology, the National Academy of Neuropsychology, Division 40 of the American Psychological Association, the American Board of Professional Neuropsychology, and the American Psychological Association Services, Inc. The group reviewed literature; collated federal, regional, and state regulations and information from insurers; and surveyed practitioners to identify best practices.

RESULTS

Literature indicates that TeleNP may offer reliable and valid assessments, but clinicians need to consider limitations, develop new informed consent procedures, report modifications of standard procedures, and state limitations to diagnostic conclusions and recommendations. Specific limitations affect TeleNP assessments of older adults, younger children, individuals with limited access to technology, and individuals with other individual, cultural, and/or linguistic differences. TeleNP may be contraindicated or infeasible given specific patient characteristics, circumstances, and referral questions. Considerations for billing TeleNP services are offered with reservations that clinicians must verify procedures independently. Guidance about technical issues and "tips" for TeleNP procedures are provided.

CONCLUSION

This document provides provisional guidance with links to resources and established guidelines for telepsychology. Specific recommendations extend these practices to TeleNP. These recommendations may be revised as circumstances evolve, with updates posted continuously at IOPC.online.

A validation study for remote testing of cognitive function in multiple sclerosis

OBJECTIVES

Determine the validity and reliability of a remote, technician-guided cognitive assessment for multiple sclerosis (MS), incorporating the Symbol Digit Modalities Test (SDMT) and the California Verbal Learning Test, Second Edition (CVLT-II).

METHODS

In 100 patients, we compared conventional in-person testing to remote, web-assisted assessments, and in 36 patients, we assessed test-retest reliability using two equivalent, alternative forms.

RESULTS

In-person and remote-administered SDMT (r = 0.85) and CVLT-II (r = 0.71) results were very similar. Reliability was adequate and alternative forms of SDMT (r = 0.92) and CVLT-II (r = 0.81) produced similar results.

CONCLUSIONS

Findings indicate remote assessment can provide valid, reliable measures of cognitive function in MS.