Teleneuropsychology practice survey during COVID-19 within the United States

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Feasibility of Remote Administration of the Uniform Data Set-Version 3 for Assessment of Older Adults With Mild Cognitive Impairment and Alzheimer's Disease

OBJECTIVE

Assess the feasibility and concurrent validity of a modified Uniform Data Set version 3 (UDSv3) for remote administration for individuals with normal cognition (NC), mild cognitive impairment (MCI), and early dementia.

METHOD

Participants (N = 93) (age: 72.8 [8.9] years; education: 15.6 [2.5] years; 72% female; 84% White) were enrolled from the Wake Forest ADRC. Portions of the UDSv3 cognitive battery, plus the Rey Auditory Verbal Learning Test, were completed by telephone or video within ~6 months of participant's in-person visit. Adaptations for phone administration (e.g., Oral Trails for Trail Making Test [TMT] and Blind Montreal Cognitive Assessment [MoCA] for MoCA) were made. Participants reported on the pleasantness, difficulty, and preference for each modality. Staff provided validity ratings for assessments. Participants' remote data were adjudicated by cognitive experts blinded to the in person-diagnosis (NC [N = 44], MCI [N = 35], Dementia [N = 11], or other [N = 3]).

RESULTS

Remote assessments were rated as pleasant as in-person assessments by 74% of participants and equally difficult by 75%. Staff validity rating (video = 92%; phone = 87.5%) was good. Concordance between remote/in-person scores was generally moderate to good (r = .3 -.8; p < .05) except for TMT-A/OTMT-A (r = .3; p > .05). Agreement between remote/in-person adjudicated cognitive status was good (k = .61-.64).

CONCLUSIONS

We found preliminary evidence that older adults, including those with cognitive impairment, can be assessed remotely using a modified UDSv3 research battery. Adjudication of cognitive status that relies on remotely collected data is comparable to classifications using in-person assessments.

A review of the reliability of remote neuropsychological assessment

The provision of clinical neuropsychological services has predominately been undertaken by way of standardized administration in a face-to-face setting. Interpretation of psychometric findings in this context is dependent on the use of normative comparison. When the standardization in which such psychometric measures are employed deviates from how they were employed in the context of the development of its associated norms, one is left to question the reliability and hence, validity of any such findings and in turn, diagnostic decision making. In light of the current COVID-19 pandemic and resultant social distancing direction, face-to-face neuropsychological assessment has been challenging to undertake. As such, remote (i.e., virtual) neuropsychological assessment has become an obvious solution. Here, and before the results from remote neuropsychological assessment can be said to stand on firm scientific grounds, it is paramount to ensure that results garnered remotely are reliable and valid. To this end, we undertook a review of the literature and present an overview of the landscape. To date, the literature shows evidence for the reliability of remote administration and the clinical implications are paramount. When and where needed, neuropsychologists, psychometric technicians and examinees may no longer need to be in the same physical space to undergo an assessment. These findings are most relevant given the physical distancing practices because of COVID-19. And whilst remote assessment should never supplant face-to-face neuropsychological assessments, it does serve as a valid alternative when necessary.

Clinical utility of teleneuropsychology among pediatric patients with broadly average and low intellectual functioning

The reliability of teleneuropsychology (teleNP) within pediatric populations, particularly those with low intellectual functioning (LIF; i.e., Intellectual Quotient <80), is largely unknown. This repeated-measures study compared performance on WISC-V and WAIS-IV subtests administered in-person before the COVID-19 pandemic and via teleNP during the pandemic in individuals with LIF versus broadly average (BA) intellectual functioning in a clinically referred pediatric cohort. Data were collected from a retrospective chart review of 35 pediatric patients who underwent in-person neuropsychological evaluation at an academic medical center before the pandemic (Mage = 10.10 years, SD = 2.93) and videoconference teleNP assessment during the pandemic (Mage = 13.47 years, SD = 2.88). Participants completed the Similarities, Matrix Reasoning, and Digit Span subtests from the WISC-V or WAIS-IV at both time points. After controlling for test-retest time interval, partial correlations showed relatively strong associations in test-retest performance across subtests in the whole sample and among the subset of LIF patients. Distribution of significant reliable change indices (RCI) between the LIF and BA groups were similar. Strong correlations were observed between performances on select Wechsler subtests administered in-person and via teleNP. Results lend initial support toward the utility of teleNP administration of these measures in children with a broad range of intellectual functioning.

Comparing online and face-to-face administration of a neuropsychological computerized attention test: Assessment modality does not influence performance

Background

The cognitive impairment associated with the COVID-19 pandemic highlighted the need for teleneuropsychology (1). Moreover, neurologic diseases associated with mental deterioration usually require the use of the same neuropsychological instrument to assess cognitive changes across time. Therefore, in such cases, a learning effect upon retesting is not desired. Attention and its subdomains can be measured using Go/no-go tests, such as, the Continuous Visual Attention Test (CVAT). Here, we administered the CVAT to investigate the effect of modality (online vs. face-to-face) on attentional performance. The variables of the CVAT measures four attention domains: focused-attention, behavioral-inhibition, intrinsic-alertness (reaction time, RT), and sustained-attention (intra-individual variability of RTs, VRT).

Methods

The CVAT was applied face-to face and online in 130 adult Americans and 50 adult Brazilians. Three different study designs were used: (1) Between-subjects design: healthy Americans were tested face-to-face (n = 88) or online (n = 42). We verified if there were any differences between the two modalities. (2) Within-subjects design: Brazilians participants (n = 50) were tested twice (online and face-to-face). For each CVAT variable, repeated measures ANCOVAs were performed to verify whether modality or first vs. second tests differ. Agreement was analyzed using Kappa, intraclass correlation coefficients, and Bland-Altman plots. (3) Paired comparisons: we compared Americans vs. Brazilians, pairing subjects by age, sex, and level of education, grouping by modality.

Results

Assessment modality did not influence performance using two independent samples (between-subjects design) or the same individual tested twice (within-subjects design). The second test and the first test did not differ. Data indicated significant agreements for the VRT variable. Based on paired samples, Americans did not differ from Brazilians and a significant agreement was found for the VRT variable.

Conclusion

The CVAT can be administered online or face-to-face without learning upon retesting. The data on agreement (online vs. face-to-face, test vs. retest, Americans vs. Brazilians) indicate that VRT is the most reliable variable.

Limitations

High educational level of the participants and absence of a perfect balanced within-subjects design.

Teleneuropsychology during the COVID-19 pandemic in Mexico: the perspective from a middle-income country

INTRODUCTION

The use of teleneuropsychology (TeleNP) increased as a result of the COVID-19 pandemic; however, there have been no studies of the benefits and difficulties with this modality in middle-income countries. This study aimed to assess the current use of TeleNP in Mexico.

METHOD

Mexican neuropsychologists were invited to participate in an online survey regarding the use of TeleNP during the COVID-19 pandemic. The survey was based on issues from a literature review and consisted of 36 questions requiring yes/no, multiple choice, or ordinal answers. The survey was created using Google Forms and asked respondents to provide informed consent. A total of 107 clinical neuropsychologists completed the survey.

RESULTS

82% of participants currently use TeleNP, and most reported learning about TeleNP through personal experience, literature research, and colleagues. Brief evaluations, delivery of results, and intervention were the principal services provided, most frequently on a home-to-home basis. Almost 30% of clinicians reported not requiring informed consent for use of the modality. Consultations included children, adolescents, and adults in similar numbers; older adults were less frequent. Technological limitations were the most frequent reason for ruling out the modality with particular patients. Perceived benefits included the ability to continue consultations despite social distancing measures, lesser risk of COVID-19 infection, and the possibility of seeing patients with limited access to neuropsychological services. Reasons for not using TeleNP included a lack of standardized instruments, not feeling comfortable with the modality, and lack of technological resources and skills.

CONCLUSIONS

Despite the socioeconomic differences between Mexico and high-income countries, most of our findings were similar to reports from those countries. However, technological limitations were common, and smartphones were commonly used, contrary to recommendations in the literature. The future use of TeleNP in Mexico should include formal training and ethical guidelines.

Tracking cognition with the T-MoCA in a racially/ethnically diverse older adult cohort

Introduction

We investigated the utility of the Telephone-Montreal Cognitive Assessment (T-MoCA) to track cognition in a diverse sample from the Einstein Aging Study.

Methods

Telephone and in-person MoCA data, collected annually, were used to evaluate longitudinal cognitive performance. Joint models of T-MoCA and in-person MoCA compared changes, variance, and test-retest reliability measured by intraclass correlation coefficient by racial/ethnic group.

Results

There were no significant differences in baseline performance or longitudinal changes across three study waves for both MoCA formats. T-MoCA performance improved over waves 1-3 but declined afterward. Test-retest reliability was lower for the T-MoCA than for the in-person MoCA. In comparison with non-Hispanic Whites, non-Hispanic Blacks and Hispanics performed worse at baseline on both MoCA formats and showed lower correlations between T-MoCA and in-person versions.

Conclusions

The T-MoCA provides valuable information on cognitive change, despite racial/ethnic disparities and practice effects. We discuss implications for health disparity populations.

Highlights

We assessed the comparability of Telephone-Montreal Cognitive Assessment (T-MoCA) and in-person MoCA for tracking cognition.Changes within 3 years in T-MoCA were similar to that for the in-person MoCA.T-MoCA is subject to practice effects and shows difference in performance by race/ethnicity.Test-retest reliability of T-MoCA is lower than that for in-person MoCA.

Neuropsychological assessment with lesbian, gay, bisexual, transgender, and queer/questioning (LGBTQ+) individuals: Practice, education, and training survey

Objective: We sought to describe the LGBTQ + related education, training, and clinical practice of independently licensed neuropsychologists in the United States and to identify factors that predict affirmative neuropsychological practices. We hypothesized that LGBTQ + identity, female gender, more recent training, and extent of LGBTQ + education/training would predict use of LGBTQ + practice guidelines. Method: A workgroup of clinical psychologists with experience in LGBTQ + psychology and neuropsychology developed a survey to identify personal and professional factors that predict affirmative neuropsychological testing practices. The survey was distributed through professional organizations and listservs between August and September 2021 with 118 responses meeting inclusionary criteria. Results: The majority of participants identified as heterosexual (70.3%) and cisgender (97.5%), and most (48-63%) received LGBTQ + training post-licensure. Between 19% and 32% of participants reported never completing LGBTQ + specific education. Consistent with our hypotheses, factors predicting affirmative clinical practice behaviors were LGBTQ + education/training, and personal background (sexual minority status, female/feminine gender, and years since degree). Other significant factors included prior experience with LGBTQ + patients and primary patient population (child vs. adult). Qualitative responses indicated varying values, attitudes, and knowledge regarding collection of LGBTQ + information and modification of clinical practice. Conclusions: Neuropsychologists underutilize affirming practices as evidenced by low rates of querying pronouns, knowing whether LGBTQ + health information is available at their institutions, and adjusting evaluation and feedback approaches. We provide specific training and education recommendations to increase knowledge and skills and to address beliefs about LGBTQ + health that can serve to promote affirmative neuropsychological practice.

The Italian telephone-based Verbal Fluency Battery (t-VFB): standardization and preliminary clinical usability evidence

Background

This study aimed at standardizing and providing preliminary evidence on the clinical usability of the Italian telephone-based Verbal Fluency Battery (t-VFB), which includes phonemic (t-PVF), semantic (t-SVF) and alternate (t-AVF) verbal fluency tasks.

Methods

Three-hundred and thirty-five Italian healthy participants (HPs; 140 males; age range = 18-96 years; education range = 4-23 years) and 27 individuals with neurodegenerative or cerebrovascular diseases were administered the t-VFB. Switch number and cluster size were computed via latent semantic analyses. HPs underwent the telephone-based Mental State Examination (MMSE) and Backward Digit Span (BDS). Construct validity, factorial structure, internal consistency, test-retest and inter-rater reliability and equivalence with the in-person Verbal Fluency tasks were assessed. Norms were derived via Equivalent Scores. Diagnostic accuracy against clinical populations was assessed.

Results

The majority of t-VFB scores correlated among each other and with the BDS, but not with the MMSE. Switch number correlated with t-PVF, t-SVF, t-AVF scores, whilst cluster size with the t-SVF and t-AVF scores only. The t-VFB was underpinned by a mono-component structure and was internally consistent (Cronbach's α = 0.91). Test-retest (ICC = 0.69-0.95) and inter-rater reliability (ICC = 0.98-1) were optimal. Each t-VFB test was statistically equivalent to its in-person version (equivalence bounds yielding a p < 0.05). Education predicted all t-VFB scores, whereas age t-SVF and t-AVF scores and sex only some t-SVF scores. Diagnostic accuracy against clinical samples was optimal (AUC = 0.81-0.86).

Discussion

The t-VFB is a valid, reliable and normed telephone-based assessment tool for language and executive functioning, equivalent to the in-person version; results show promising evidence of its diagnostic accuracy in neurological populations.

Survey Findings About the Experiences, Challenges, and Practical Advice/Solutions Regarding Teleneuropsychological Assessment in Adults

OBJECTIVE

In the wake of the coronavirus pandemic, teleneuropsychology utilization has increased. There is a need to characterize the first-hand experiences of individuals using teleneuropsychology, identify the common teleneuropsychology challenges, and devise practical strategies for mitigating/resolving these challenges.

METHOD

Survey data were collected from U.S. based neuropsychologists and other individuals (e.g., graduate students and research assistants) who were engaged in remote cognitive assessment with adults (n = 87). Frequency analyses were conducted to examine: how respondents used teleneuropsychology (e.g., duration of use, types of measures and devices/technology platforms used); challenges that were encountered with different technology platforms and teleneuropsychology use; and advice for navigating these challenges.

RESULTS

Most respondents began using teleneuropsychology relatively recently in the context of the coronavirus pandemic, with home-to-home or clinic-to-home settings being the most frequently reported teleneuropsychology settings. Zoom®, Doxy.Me®, and MyChart® were the most frequently used platforms, largely due to workplace mandates and/or Health Insurance Portability and Accountability Act-compliant features. Common challenges with teleneuropsychology included internet connection issues and environmental distractions in examinees' homes, and examinees having limited-to-no access to technologies requisite for teleneuropsychology. Providing clear instructions to the examinee prior to the teleneuropsychology visit was the most common advice for ensuring a successful teleneuropsychology evaluation. Similar response patterns were generally noted for those who used TeleNP for clinical or research purposes.

CONCLUSIONS

These survey results reflect common experiences and challenges with teleneuropsychology and identify priority targets for increasing its feasibility, reliability, and validity. Findings provide context for the development of formal teleneuropsychology competencies.

Cognitive Stabilization Intervention during the Era of COVID-19

As COVID-19 halted traditional neuropsychological assessment due to infection risk, neuropsychologists considered alternative practice models. Cognitive stabilization intervention (CSI) via telehealth, was developed to stabilize cognition in advance of neuropsychological assessment. It incorporates elements of evidence-based treatments, including cognitive training, sleep training, and medication adherence training within a motivational interview framework. Two case vignettes are described. One vignette describes an elder man who received CSI to manage sleep difficulties, forgetfulness, and mood symptoms. Another vignette describes a woman who completed CSI following an autoimmune disorder episode to improve sleep, organization, and attention. The benefits and limitations of CSI are discussed.

How, when, and for whom: decisions regarding remote neuropsychological assessment during the 2020 COVID-19 pandemic

Neuropsychological assessment provides crucial information about cognitive, behavioral, and socioemotional functioning in medical, educational, legal, and social contexts. During the 2020 COVID-19 pandemic, the Israeli Ministry of Health initially mandated that all psychological assessments be postponed. However, as referrals to time-sensitive, high-need, and high-stakes assessments began to accumulate, it became necessary to consider remote solutions. In the current paper, we describe the considerations that affected the transition to remote activity in a prominent Israeli provider of neuropsychological assessment and rehabilitation services, referring to technological and environmental conditions, cognitive requirements, and tasks, as well as to legal, regulatory, and funding issues. After discussing how assessments should be conducted to maximize feasibility and validity while minimizing risks to clients and clinicians, we propose a preliminary model for deciding whether specific referrals warrant remote administration. The model delineates key factors in decisions regarding remote assessment, emphasizing the distinct roles of the referring clinician and the neuropsychologist who conducts the assessment, and highlighting the need for collaboration between them. The abrupt need for remote assessments during the pandemic required a quick response with little preparation. The lessons learned from this process can be applied in the future, so that the need for remote services can be met with greater certainty and uniformity.