How, when, and for whom: decisions regarding remote neuropsychological assessment during the 2020 COVID-19 pandemic

VA psychologists' professional practices and attitudes toward tele-neuropsychology among a tele-neuropsychology interest group within the Veterans Health Administration

OBJECTIVE

To provide understanding of practices and attitudes toward tele-neuropsychology (teleNP) among Veterans Health Administration (VA) psychologists who have joined a related community of practice.

METHODS

Several VA psychologists (the authors) developed this survey to better understand dissemination of teleNP and attitudes toward teleNP among those involved in a VA teleNP community of practice. We contacted VA psychologists within this group to complete the survey. The survey was open from July to August 2021, during which time a total of 62 VA psychologists participated.

RESULTS

Response rate was estimated to be 41% of those receiving the survey (62 respondents). Approximately two thirds of those completing the survey reported current practice of teleNP (68%; n = 42). In contrast, only 25% of the entire sample (n = 15) conducted any teleNP pre-pandemic. Job satisfaction related to being able to perform teleNP is high. Support for continued and increased use of teleNP is high, with most respondents (84%) indicating they will be at least somewhat likely to practice teleNP post-pandemic.

CONCLUSIONS

The survey provides increased support for the use of teleNP by VA psychologists who responded to the survey, with significantly increased adoption since the Covid-19 pandemic, and greater likelihood of intention to use teleNP post pandemic.

Tele-neuropsychology in memory clinic settings: Reliability and usability of videoconference-based neuropsychological testing

OBJECTIVE

Neuropsychological assessment through VideoTeleConferencing (VTC) can help improve access to diagnostic and follow-up care in memory clinics. This study investigated the stability of performance on VTC assessment in relation to in-person assessment using a test-retest design and explored user experiences of VTC assessment.

MATERIALS AND METHODS

Thirty-one patients (62 ± 6.7 years, 45% female, 58% Subjective Cognitive Decline, 42% Mild Cognitive Impairment/dementia diagnosis) were included from the Amsterdam Dementia Cohort between August 2020 and February 2021. Patients underwent a face-to-face neuropsychological assessment followed by a VTC assessment using the same test protocol within 4 months. Reliability coefficients were calculated using intraclass correlation coefficients (ICC). For each test, the proportion of clinically relevant differences in performances between assessment modalities was calculated. User experiences of patients and neuropsychologists were assessed with questionnaires (User Satisfaction and Ease of use [USE] questionnaire and System Usability Scale [SUS]). Neuropsychologists also participated in a focus group.

RESULTS

ICC values were moderate to excellent (0.63-0.93) for all test measures in the total sample. On all tests, most patients did not show clinically relevant performance differences between modalities. Patients and neuropsychologists reported overall positive VTC system usability, although neuropsychologists indicated in the focus group that patients without cognitive impairment required less training for the system and were more independent.

CONCLUSION

VTC assessment showed adequate to excellent test-retest reliability for a broad range of neuropsychological tests commonly used in practice. Assessment through VTC may be a user friendly method in the memory clinic, especially to monitor individuals at risk for future cognitive decline.

User Experience of a (Semi-) Automated Cognitive Phone-Based Assessment Within a Memory Clinic Population

OBJECTIVE

We examined the user experience in different modalities (face-to-face, semi-automated phone-based, and fully automated phone-based) of cognitive testing in people with subjective cognitive decline and mild cognitive impairment.

METHOD

A total of 67 participants from the memory clinic of the Maastricht University Medical Center+ participated in the study. The study consisted of cognitive tests in different modalities, namely, face-to-face, semi-automated phone-based guided by a researcher, and fully automated phone-based without the involvement of a researcher. After each assessment, a user experience questionnaire was administered, including questions about, for example, satisfaction, simplicity, and missing personal contact, on a seven-point Likert scale. Non-parametric tests were used to compare user experiences across different modalities.

RESULTS

In all modalities, user experiences were rated above average. The face-to-face ratings were comparable to the ratings of the semi-automated phone-based assessment, except for the satisfaction and recommendation items, which were rated higher for the face-to-face assessment. The face-to-face assessment was preferred above the fully automated phone-based assessment on all items. In general, the semi- and fully automated phone-based assessments were comparable (simplicity, conceivability, quality of sound, visiting the hospital, and missing personal contact), while on all the other items, the semi-automated phone-based assessment was preferred.

CONCLUSIONS

User experience was rated high within all modalities. Simplicity, conceivability, comfortability, and participation scores were comparable in the semi-automated phone-based and face-to-face assessment. Based on these findings and earlier research on validation of the semi-automated phone-based assessment, the semi-automated assessment could be useful for screening for clinical trials, and after more research, in clinical practice.

Remote neuropsychological evaluation of older adults

The use of technological means in the process of neuropsychological assessment has been proposed as a technique with promising results in the field of detection of neurocognitive disorders for community-dwelling older adults. Especially during the pandemic period due to COVID-19, telemedicine assumed to be vital in the field of early diagnosis of cognitive disorders and highlighted the clinical utility of remote methods of neuropsychological assessmentby video-conference. This descriptive study presents the development of a remote neuropsychological assessment protocol by selecting appropriate validated tests as part of a more comprehensive evaluation for older adults dwelling in the community. We recruited participants from the Athens Alzheimer's Association center in collaboration with the Hellenic Neuropsychological Society, in Athens, Greece, regarding the period between April 2020 and October 2021. 90 individuals, tested for the first time, were categorized into three groups according to their diagnosis which included: (a) Mild Cognitive Impairment (MCI), (b) Alzheimer's disease, (c) cognitively healthy older adults. The presented protocol outlines the main considerations of a framework about remote neuropsychological assessment, which can maximize the effectiveness of interventions and continuity regarding the care of older adults. The recommendations outlined in the presented protocol highlight strengths and limitations that should be taken into account in remote control procedures. Although the protocol was created in response to pandemic restrictions, tele-neuropsychology shows promise as a way to improve access opportunity to neurodiagnostic services for rural aging and underserved populations, which lack specialized healthcare services. Further application to different populations will add validity to the presented descriptive protocol.

Remote Neuropscyhological Assessment: Teleneuropsychology

Introduction

Teleneuropsychology, which includes the remote application of neuropsychological tests to patients via telephone or videoconferencing, can expand access to health services for patients who reside in distant areas or have mobility restrictions. With the emergence of the COVID-19 pandemic, there has been a significant increase in the use of teleneuropsychology in cognitive assessment. In this review, the aim was to critically review the results of studies conducted in the field of teleneuropsychology and the fundamental principles related to tele-neuropsychological assessment. Additionally, the "guideline for home-based teleneuropsychology" developed for Türkiye's practices is outlined in this review.

Method

A literature search was conducted using the Web of Science and PubMed databases to include all types of articles related to the subject.

Results

The results of studies on in-clinic and home-based teleneuropsychological assessment indicate that tests that assess cognitive functions such as attention, memory, executive functions, and language, particularly those based on verbal administration, can be reliably applied through teleneuropsychological assessment. However, there are factors to consider when referring patients for teleneuropsychological assessment, selecting tests for assessment, and making ethical considerations. Additionally, it is important to follow recommended steps for both the clinician and the patient and/or their caregiver before and during the interview in order for the assessment to be carried out effectively.

Conclusion

Although direct contact with the patient is an essential element in clinical neuropsychology practice, when necessary, teleneuropsychological assessment performed by trained experts following appropriate application procedures can be a good alternative to face-to-face evaluations.

Evaluation of telehealth administration of MMPI symptom validity scales

INTRODUCTION

Telehealth assessment (TA) is a quickly emerging practice, offered with increasing frequency across many different clinical contexts. TA is also well-received by most patients, and there are numerous guidelines and training opportunities which can support effective telehealth practice. Although there are extensive recommended practices, these guidelines have rarely been evaluated empirically, particularly on personality measures. While existing research is limited, it does generally support the idea that TA and in-person assessment (IA) produce fairly equitable test scores. The MMPI-3, a recently released and highly popular personality and psychopathology measure has been the subject of several of those experimental or student (non-client) based studies; however, no study to date has evaluated these trends within a clinical sample. This study empirically tests for differences in TA and IA test scores on the MMPI-3 validity scores when following recommended administration procedures.

METHOD

Data were from a retrospective chart review. Veterans (n = 550) who underwent psychological assessment in a Veterans Affairs Medical Center ADHD evaluation clinic were contrasted between in person and telehealth assessment modalities on the MMPI-2-RF and MMPI-3. Groups were compared using t tests, chi square, and base rates.

RESULTS

Results suggest that there were minimal differences in elevation rates or mean scores across modality, supporting the use of TA.

CONCLUSIONS

This study's findings support the use of the MMPI via TA with ADHD evaluations, Veterans, and in neuro/psychological evaluation settings more generally. Observed elevation rates and mean scores of this study were notably different from those seen in other VA service clinics sampled nationally, which is an area of future investigation.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Teleneuropsychology during the COVID-19 pandemic in Mexico: the perspective from a middle-income country

INTRODUCTION

The use of teleneuropsychology (TeleNP) increased as a result of the COVID-19 pandemic; however, there have been no studies of the benefits and difficulties with this modality in middle-income countries. This study aimed to assess the current use of TeleNP in Mexico.

METHOD

Mexican neuropsychologists were invited to participate in an online survey regarding the use of TeleNP during the COVID-19 pandemic. The survey was based on issues from a literature review and consisted of 36 questions requiring yes/no, multiple choice, or ordinal answers. The survey was created using Google Forms and asked respondents to provide informed consent. A total of 107 clinical neuropsychologists completed the survey.

RESULTS

82% of participants currently use TeleNP, and most reported learning about TeleNP through personal experience, literature research, and colleagues. Brief evaluations, delivery of results, and intervention were the principal services provided, most frequently on a home-to-home basis. Almost 30% of clinicians reported not requiring informed consent for use of the modality. Consultations included children, adolescents, and adults in similar numbers; older adults were less frequent. Technological limitations were the most frequent reason for ruling out the modality with particular patients. Perceived benefits included the ability to continue consultations despite social distancing measures, lesser risk of COVID-19 infection, and the possibility of seeing patients with limited access to neuropsychological services. Reasons for not using TeleNP included a lack of standardized instruments, not feeling comfortable with the modality, and lack of technological resources and skills.

CONCLUSIONS

Despite the socioeconomic differences between Mexico and high-income countries, most of our findings were similar to reports from those countries. However, technological limitations were common, and smartphones were commonly used, contrary to recommendations in the literature. The future use of TeleNP in Mexico should include formal training and ethical guidelines.

Validation of an Automated Speech Analysis of Cognitive Tasks within a Semiautomated Phone Assessment

Introduction

We studied the accuracy of the automatic speech recognition (ASR) software by comparing ASR scores with manual scores from a verbal learning test (VLT) and a semantic verbal fluency (SVF) task in a semiautomated phone assessment in a memory clinic population. Furthermore, we examined the differentiating value of these tests between participants with subjective cognitive decline (SCD) and mild cognitive impairment (MCI). We also investigated whether the automatically calculated speech and linguistic features had an additional value compared to the commonly used total scores in a semiautomated phone assessment.

Methods

We included 94 participants from the memory clinic of the Maastricht University Medical Center+ (SCD N = 56 and MCI N = 38). The test leader guided the participant through a semiautomated phone assessment. The VLT and SVF were audio recorded and processed via a mobile application. The recall count and speech and linguistic features were automatically extracted. The diagnostic groups were classified by training machine learning classifiers to differentiate SCD and MCI participants.

Results

The intraclass correlation for inter-rater reliability between the manual and the ASR total word count was 0.89 (95% CI 0.09-0.97) for the VLT immediate recall, 0.94 (95% CI 0.68-0.98) for the VLT delayed recall, and 0.93 (95% CI 0.56-0.97) for the SVF. The full model including the total word count and speech and linguistic features had an area under the curve of 0.81 and 0.77 for the VLT immediate and delayed recall, respectively, and 0.61 for the SVF.

Conclusion

There was a high agreement between the ASR and manual scores, keeping the broad confidence intervals in mind. The phone-based VLT was able to differentiate between SCD and MCI and can have opportunities for clinical trial screening.

Tele-Neurorehabilitation During the COVID-19 Pandemic: Implications for Practice in Low- and Middle-Income Countries

The importance of neurorehabilitation services for people with disabilities is getting well-recognized in low- and middle-income countries (LMICs) recently. However, accessibility to the same has remained the most significant challenge, in these contexts. This is especially because of the non-availability of trained specialists and the availability of neurorehabilitation centers only in urban cities owned predominantly by private healthcare organizations. In the current COVID-19 pandemic, the members of the Task Force for research at the Indian Federation of Neurorehabilitation (IFNR) reviewed the context for tele-neurorehabilitation (TNR) and have provided the contemporary implications for practicing TNR during COVID-19 for people with neurological disabilities (PWNDs) in LMICs. Neurorehabilitation is a science that is driven by rigorous research-based evidence. The current pandemic implies the need for systematically developed TNR interventions that is evaluated for its feasibility and acceptability and that is informed by available evidence from LMICs. Given the lack of organized systems in place for the provision of neurorehabilitation services in general, there needs to be sufficient budgetary allocations and a sector-wide approach to developing policies and systems for the provision of TNR services for PWNDs. The pandemic situation provides an opportunity to optimize the technological innovations in health and scale up these innovations to meet the growing burden of neurological disability in LMICs. Thus, this immense opportunity must be tapped to build capacity for safe and effective TNR services provision for PWNDs in these settings.