Emory university telehealth neuropsychology development and implementation in response to the COVID-19 pandemic

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

A survey of neuropsychological assessment feedback practices among neuropsychologists

OBJECTIVE

Feedback on neuropsychological assessment is a critical part of clinical practice, but there are few empirical papers on neuropsychological feedback practices. We sought to fill this gap in the literature by surveying practicing neuropsychologists in the United States. Questions addressed how they provide verbal and written feedback to patients and referral sources. Survey questions also addressed billing practices and training in the provision of feedback.

METHODS

A survey was developed using Qualtrics XM to survey currently licensed, independently practicing clinical neuropsychologists in the United States about their feedback practices. The survey was completed by 184 individuals.

RESULTS

Nearly all respondents reported that they provide verbal feedback to patients, most often in-person, within three weeks following testing. Typically, verbal feedback sessions with patients last 45 min. Verbal feedback was provided to referrals by about half of our sample, typically via a brief phone call. Most participants also reported providing written feedback to both the patient and referring provider, most commonly via the written report within three weeks after testing. Regarding billing, most respondents use neuropsychological testing evaluation codes. The COVID-19 pandemic appeared to have had a limited impact on the perceived effectiveness and quality of verbal feedback sessions. Finally, respondents reported that across major stages of professional development, training in the provision of feedback gradually increased but was considered inadequate by many participants.

CONCLUSIONS

Results provide an empirical summary of the "state of current practice" for providing neuropsychological assessment feedback. Further experimental research is needed to develop an evidence-base for effective feedback practices.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Telemedicine-Based Cognitive Examinations During COVID-19 and Beyond: Perspective of the Massachusetts General Hospital Behavioral Neurology & Neuropsychiatry Group

Telehealth and telemedicine have encountered explosive growth since the beginning of the COVID-19 pandemic, resulting in increased access to care for patients located far from medical centers and clinics. Subspecialty clinicians in behavioral neurology & neuropsychiatry (BNNP) have implemented the use of telemedicine platforms to perform cognitive examinations that were previously office based. In this perspective article, BNNP clinicians at Massachusetts General Hospital (MGH) describe their experience performing cognitive examinations via telemedicine. The article reviews the goals, prerequisites, advantages, and potential limitations of performing a video- or telephone-based telemedicine cognitive examination. The article shares the approaches used by MGH BNNP clinicians to examine cognitive and behavioral areas, such as orientation, attention and executive functions, language, verbal learning and memory, visual learning and memory, visuospatial function, praxis, and abstract abilities, as well as to survey for neuropsychiatric symptoms and assess activities of daily living. Limitations of telemedicine-based cognitive examinations include limited access to and familiarity with telecommunication technologies on the patient side, limitations of the technology itself on the clinician side, and the limited psychometric validation of virtual assessments. Therefore, an in-person examination with a BNNP clinician or a formal in-person neuropsychological examination with a neuropsychologist may be recommended. Overall, this article emphasizes the use of standardized cognitive and behavioral assessment instruments that are either in the public domain or, if copyrighted, are nonproprietary and do not require a fee to be used by the practicing BNNP clinician.

It's complicated: Executive functioning moderates impacts of daily busyness on everyday functioning in community-dwelling older adults

OBJECTIVE

Research shows that cognitively healthy older adults with mild executive function (EF) weaknesses are vulnerable to the negative impacts of life complexity (or daily busyness) when performing instrumental activities of daily living (IADLs). However, past research assessed life complexity only at one timepoint, not capturing daily fluctuations. Importantly, fluctuations in busyness can themselves have deleterious impacts on functioning. This study extended past research by examining whether (1) variability in daily busyness would be more detrimental than level of busyness to performance of IADLs, and (2) EF assessed at home would moderate deleterious impact of busyness on IADLs.

METHOD

Fifty-two community-dwelling older adults aged 60 to 95 completed daily IADL tasks and daily measures of EF and busyness via ecological momentary assessment, independently at home for 18 days.

RESULTS

(1) In a subset of participants with mild EF weaknesses, high variability in busyness across days was associated with fewer tasks completed correctly; and (2) across all participants (regardless of EF), high levels of daily busyness were associated with fewer tasks completed on time.

CONCLUSIONS

Findings indicate that high variability in daily busyness, potentially reflecting a lack of daily routine, was associated with IADL errors among cognitively healthy older adults with mild EF weaknesses. Additionally, consistently high levels of busyness were associated with failures to complete tasks, or failures to complete them on time, regardless of EF. These results further support the Contextually Valid Executive Assessment (ConVExA) model, which posits that EF and contextual factors interact to predict functional outcomes.

Serial position effects and mild cognitive impairment: a comparison of measures and scoring approaches

INTRODUCTION

Serial position effects (SPEs) have shown promise as predictors of future cognitive decline and conversion from mild cognitive impairment (MCI) to Alzheimer's disease (AD), even when accounting for total learning and memory scores. However, conflicting results have been found in the literature, which may be at least partially related to the many ways in which SPEs are calculated. The current study aimed to address the discrepancies in the literature by examining whether one method of analyzing SPEs is more sensitive at distinguishing those with and without psychometrically defined MCI.

METHOD

86 older adult participants (57 healthy comparison, 29 MCI) completed the California Verbal Learning Test, Third Edition (CVLT3) and the Rey Auditory Verbal Learning Test (RAVLT), along with measures assessing multiple cognitive domains. Each participant completed two visits, between 3 and 9 days apart, with a different memory measure administered on each day. The standard scoring approach and the regional scoring approach to calculating SPEs were compared.

RESULTS

Results showed that, when significant differences were found, SPEs were always reduced in the MCI group compared to the healthy comparison group when using regional scoring; however, results were not as consistent when using standard scoring. Further, lower primacy than recency scores were only consistently seen in the MCI group when using the RAVLT but not the CVLT3. ROC analyses showed that only regional scoring of SPEs from delayed recall of the RAVLT and the CVLT3 accurately discriminated between those with and without MCI.

CONCLUSION

Regional scoring of SPEs may be more sensitive at identifying subtle cognitive decline compared to standard scoring. However, the specific measure that is used to analyze SPEs can impact the interpretation of findings.

Cognition, Academic Achievement, Adaptive Behavior, and Quality of Life in Child and Adolescent Boys with Klinefelter Syndrome

OBJECTIVE

Klinefelter syndrome (KS; 47, XXY), the most common sex chromosome aneuploidy in males, is characterized by testicular failure and testosterone deficiency as well as a variety of cognitive, social, and emotional challenges. In the current study, we aimed to clarify the cognitive-behavioral profile of peripubertal boys with KS using measures of cognition, academic achievement, adaptive behavior, and quality of life.

METHOD

We compared 47 boys with KS (7-16 years of age) with 55 performance IQ-matched boys without KS on measures of cognition (WISC-V), executive function (BRIEF-2), academic achievement (KTEA-3), adaptive behavior (Vineland-3), and quality of life (PROMIS). In exploratory analyses, we examined associations among these measures and potential associations with pubertal metrics.

RESULTS

Boys with KS demonstrated a significantly different profile of cognition, behavioral ratings of executive function, academic achievement, adaptive behavior, and quality of life compared with their typically developing peers, with, on average, lower functioning. The groups showed significantly different correlations between cognition and aspects of quality of life. No associations were observed between behavior and pubertal development.

CONCLUSION

Taken together, these findings indicated that boys with KS are at increased risk for cognitive difficulties, which may affect academic achievement, adaptive behavior, and quality of life. Although initial exploratory analyses indicated that the magnitude of these alterations was not correlated with severity of testicular failure, longitudinal analyses currently being conducted by our group may help clarify the trajectory of these difficulties through the pubertal transition and testosterone replacement.

Telehealth equivalence of the Montreal cognitive assessment (MoCA): Results from the Emory healthy brain study (EHBS)

BACKGROUND

We investigated potential differences between in-person cognitive testing and video telehealth administration of the Montreal Cognitive Assessment (MoCA). In addition to the MoCA, the Patient Health Questionnaire-8 (PHQ-8) and Generalized Anxiety Disorder-7 (GAD-7) were administered.

METHODS

MoCA scores from participants in the Emory Health Brain Study (EHBS) were contrasted based upon whether they were administered the MoCA in the standard face-to-face (F2F) assessment setting (n = 1205) or using a video telehealth administration (n = 491). All EHBS participants were self-reported to be cognitively normal.

RESULTS

MoCA scores did not differ across administration method (F2F MoCA = 26.6, SD = 2.4; telehealth MoCA = 26.5, SD = 2.4). The 95% confidence interval for difference in administration was small (CI = -0.16 to 0.34). When examining MoCA domain scores, administration differences were either associated with no statistically significant effect, or if present due to large sample sizes, were associated with small effects and differences <0.5 point. Telehealth patients reported slightly lower PHQ-8 scores (F2F PHQ-8 = 2.0, SD = 2.5; telehealth PHQ-8 = 1.6, SD = 2.1), although these scores are well within the normal range. No group difference in GAD-7 scores was present (F2F GAD-7 = 1.4, SD = 2.4; telehealth PHQ-8 = 1.4, SD = 2.4).

DISCUSSION

This report with its large sample size and between subject cohort provides complementary evidence to smaller test-retest studies, further supporting equivalence of MoCA telehealth testing to F2F MoCA administration. These findings provide additional reassurance that administration mode does not introduce systematic performance differences for MoCA test administration, thereby permitting telehealth MoCA testing to be applied confidently for both clinical and research applications.

The use of the cambridge neuropsychological test automated battery for people born with Down syndrome and those born premature: A comparative systematic review

This review aimed to investigate the use of the Cambridge Neuropsychological Automated Testing Battery (CANTAB) for people at risk of cognitive impairment, especially those born with Down syndrome and those born preterm. Six databases were searched according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) standards, in addition to the bibliography index listed in the CANTAB site. Twenty four studies regarding Down syndrome and 17 regarding prematurity were reviewed and are here described. Both cognitive profiles were described, and their performance was compared on specific tasks and CANTAB tests. In this battery of tests, people with Down syndrome usually present impaired key cognitive domains, such as episodic memory and recognition memory. Results were presented considering general aspects described in the studies, specific findings such as dementia, the role of genetics, and cognitive profile, among other descriptions. Comparability between both populations in future studies is discussed.

The Rey Auditory Verbal Learning Test: Cross-validation of Mayo Normative Studies (MNS) demographically corrected norms with confidence interval estimates

OBJECTIVE

The Mayo Normative Studies (MNS) represents a robust dataset that provides demographically corrected norms for the Rey Auditory Verbal Learning Test. We report MNS application to an independent cohort to evaluate whether MNS norms accurately adjust for age, sex, and education differences in subjects from a different geographic region of the country. As secondary goals, we examined item-level patterns, recognition benefit compared to delayed free recall, and derived Auditory Verbal Learning Test (AVLT) confidence intervals (CIs) to facilitate clinical performance characterization.

METHOD

Participants from the Emory Healthy Brain Study (463 women, 200 men) who were administered the AVLT were analyzed to demonstrate expected demographic group differences. AVLT scores were transformed using MNS normative correction to characterize the success of MNS demographic adjustment.

RESULTS

Expected demographic effects were observed across all primary raw AVLT scores. Depending on sample size, MNS normative adjustment either eliminated or minimized all observed statistically significant AVLT differences. Estimated CIs yielded broad CI ranges exceeding the standard deviation of each measure. The recognition performance benefit across age ranged from 2.7 words (SD = 2.3) in the 50-54-year-old group to 4.7 words (SD = 2.7) in the 70-75-year-old group.

CONCLUSIONS

These findings demonstrate generalizability of MNS normative correction to an independent sample from a different geographic region, with demographic adjusted performance differences close to overall performance levels near the expected value of T = 50. A large recognition performance benefit is commonly observed in the normal aging process and by itself does not necessarily suggest a pathological retrieval deficit.

COVID-19 and Integrated Multidisciplinary Care Model in Parkinson's Disease: Literature Review & Future Perspectives

Clinical diversity and multi-systemic manifestations of Parkinson's disease (PD) necessitate the involvement of several healthcare professionals from different disciplines for optimal care. Clinical guidelines recommend that all persons with PD should have access to a broad range of medical and allied health professionals to implement an efficient and effective multidisciplinary care model. This is well supported by growing evidence showing the benefits of multidisciplinary interventions on improving quality of life and disease progression in PD. However, a "multidisciplinary" approach requires gathering healthcare professionals from different disciplines into an integrative platform for collaborative teamwork. With the Coronavirus Disease 2019 (COVID-19) pandemic, implementation of such a multidisciplinary care model has become increasingly challenging due to social distancing mandates, isolation and quarantine, clinics cancellation, among others. To address this problem, multidisciplinary teams are developing innovate virtual platforms to maintain care of people with PD. In the present review, we cover aspects on how SARS-CoV-2 has affected people with PD, their caregivers, and care team members. We also review current evidence on the importance of maintaining patient-centered care in the era of social distancing, and how can we utilize telehealth and innovative virtual platforms for multidisciplinary care in PD.

Pandemic parenting: A pilot study of in-person versus internet-DOCS K-5 for caregivers of school-age children with disruptive behaviors

Behavioral parent training (BPT) programs are needed to address disruptive behavior disorders among school-aged children. Given the prolonged COVID-19 pandemic and associated mental health consequences, adapting BPTs to telehealth modalities is necessary to ensure continued services to children and families. This pilot study evaluated the use of a telehealth vs in-person modality to deliver the Developing Our Children's Skills K-5 (DOCS K-5) BPT. Participants were caregivers of children enrolled in elementary school exhibiting disruptive behaviors who participated in either in-person DOCS K-5 (n = 21) or internet-DOCS K-5 (i-DOCS K-5; n = 34). Pre- and post-intervention outcome measures were collected for child disruptive behavior, parenting stress, and caregiver symptoms of depression while consumer satisfaction was assessed at post-test only. Multiple linear and Poisson regression models were performed to assess the effect of session modality on the outcomes. Child disruptive behavior, parenting stress and depression, and consumer satisfaction scores were not significantly different across groups, even after adjusting for baseline characteristics. The results of this study provide preliminary evidence that the i-DOCS K-5 modality is as effective as the in-person program. Study findings may be beneficial to practitioners treating school-age children and utilizing telehealth interventions during the COVID-19 pandemic and onward.

Feasibility and Acceptance of Direct-to-Home Tele-neuropsychology Services during the COVID-19 Pandemic

OBJECTIVE

Neuropsychological assessment via video conferencing has been proposed during the COVID-19 pandemic. Existing literature has demonstrated feasibility and acceptance of neuropsychological measures administered by videoconference, although few studies have examined feasibility and patient acceptance of TNP visits directly to patients' homes (DTH-TNP).

METHODS

We modified a previously published patient satisfaction survey for DTH-TNP and developed a clinician feasibility survey to examine experiences during DTH-TNP.

RESULTS

Seventy-two patients (age range: preschool-geriatric) evaluated by DTH-TNP for cognitive problems at an academic medical center responded to voluntary surveys between April 20, 2020, and August 19, 2020, and 100% indicated satisfaction. Fifty-nine percent of patients reported limitations (e.g., technological concern) during the appointment. 134 clinician surveys were collected and indicated that clinicians achieved the goal of their appointment in 90% of encounters.

CONCLUSIONS

These qualitative data suggest that patients and clinicians found DTH-TNP to be satisfactory during the COVID-19 pandemic, while also recognizing limitations of the practice. These results are limited in that voluntary surveys are subject to bias. They support the growing body of literature suggesting that DTH-TNP provides a valuable service, though additional research to establish reliability and validity is needed.

Feasibility of administering the WAIS-IV using a home-based telehealth videoconferencing model

Use of telehealth to deliver neuropsychological services has proven to be a feasible approach, however, there is limited research which has examined the reliability of home-based assessment models using a comprehensive intelligence test. The aim of this study was to examine the reliability and feasibility of a home-based videoconferencing administration of the Wechsler Adult Intelligence Scales-4^th Edition (WAIS-IV).

Thirty healthy participants (aged 18-40 years) completed the WAIS-IV both in-person and via home-based videoconferencing utilizing a randomized counter-balanced methodology to attempt to control for an order effect. Paper record forms for Coding/Symbol Search and Blocks were sent and returned via tamper proof courier packs. Participants completed an online survey of their experiences of TNP following completion of their assessments. Group mean comparisons, intra class correlation coefficients (ICCs) and Bland-Altman measures of bias were calculated.

Findings from both modalities were highly concordant across all WAIS-IV subtests and indices, with all ICCs rated as "excellent," (≥0.9). There were no significant mean group differences and no evidence of proportional bias. The majority of participants were very satisfied with the use of videoconferencing as an application for cognitive assessment and high levels of participant compliance were observed.

In this non-clinical cohort home-based videoconference administration of the WAIS-IV was feasible, reliable and acceptable. TNP may offer an alternative for those consumers where there are challenges in accessing a face-to-face service delivery model, thereby improving equity, and enabling continuation of service delivery. Future research is needed with a larger and more ethnically diverse clinical population.

A nonrandomized trial of a behavioral parent training intervention for parents with children with challenging behaviors: In-person versus internet-HOT DOCS

Behavioral parent training (BPT) programs are the first-line interventions for childhood disruptive behaviors. In light of the COVID-19 pandemic, adapting these programs to telehealth modalities is necessary to ensure continued services to children and families. This study evaluates the use of telehealth versus in-person modality to deliver the Helping Our Toddlers, Developing Our Children's Skills (HOT DOCS) BPT. The study design was quasi-experimental with two nonequivalent groups: in-person HOT DOCS (n = 152) and internet-HOT DOCS (n = 46). Participants were caregivers of children ages 2-5 exhibiting disruptive behaviors. Pre- and post-intervention outcome measures were collected for child disruptive behavior and parenting stress and post-test only for consumer satisfaction. Multiple linear and Poisson regression models were performed to assess the effect of class modality on the outcomes. Child disruptive behavior and parenting stress post-test scores for in-person and telehealth groups were not significantly different, even after adjusting for baseline characteristics. Consumer satisfaction scores were significantly more positive for the in-person group. The results of this study provide preliminary evidence for the i-HOT DOCS modality as being as effective as the in-person program. Study findings may be beneficial to practitioners utilizing telehealth interventions during the COVID-19 pandemic and onward.

Survey Findings About the Experiences, Challenges, and Practical Advice/Solutions Regarding Teleneuropsychological Assessment in Adults

OBJECTIVE

In the wake of the coronavirus pandemic, teleneuropsychology utilization has increased. There is a need to characterize the first-hand experiences of individuals using teleneuropsychology, identify the common teleneuropsychology challenges, and devise practical strategies for mitigating/resolving these challenges.

METHOD

Survey data were collected from U.S. based neuropsychologists and other individuals (e.g., graduate students and research assistants) who were engaged in remote cognitive assessment with adults (n = 87). Frequency analyses were conducted to examine: how respondents used teleneuropsychology (e.g., duration of use, types of measures and devices/technology platforms used); challenges that were encountered with different technology platforms and teleneuropsychology use; and advice for navigating these challenges.

RESULTS

Most respondents began using teleneuropsychology relatively recently in the context of the coronavirus pandemic, with home-to-home or clinic-to-home settings being the most frequently reported teleneuropsychology settings. Zoom®, Doxy.Me®, and MyChart® were the most frequently used platforms, largely due to workplace mandates and/or Health Insurance Portability and Accountability Act-compliant features. Common challenges with teleneuropsychology included internet connection issues and environmental distractions in examinees' homes, and examinees having limited-to-no access to technologies requisite for teleneuropsychology. Providing clear instructions to the examinee prior to the teleneuropsychology visit was the most common advice for ensuring a successful teleneuropsychology evaluation. Similar response patterns were generally noted for those who used TeleNP for clinical or research purposes.

CONCLUSIONS

These survey results reflect common experiences and challenges with teleneuropsychology and identify priority targets for increasing its feasibility, reliability, and validity. Findings provide context for the development of formal teleneuropsychology competencies.

The development and implementation of teleneuropsychology in an academic lifespan neuropsychology center: Lessons learned from the COVID-19 pandemic

INTRODUCTION

Teleneuropsychology (TNP) became a critical means for providing care during the COVID-19 pandemic and may continue as an option for delivery of neuropsychological services. To understand how patient characteristics impact clinician decisions and service models, this study examines practice patterns within a lifespan outpatient neuropsychology center before, during and post-pandemic.

METHODS

Patient volume, demographics, and characteristics were compared across four, 3-month time intervals in 2019-2020. Two baseline intervals when the center was physically open (PO) were compared to one interval when the center was physically closed (PC) (all evaluations were conducted via direct-to-home TNP) and a fourth interval when the center was physically reopened (RO) and evaluations were conducted in one of the three modalities: in-person, virtual only or hybrid (both virtual/in-person).

RESULTS

A total of 1,459 total neuropsychological evaluations were conducted with a 64.6% reduction during PC. At RO, the number of evaluations returned to pre-COVID baseline during which in-person (72.4%) evaluations were conducted at a higher rate than hybrid (7.1%) or virtual only (20.4%). Across the lifespan, mean number of appointments to complete evaluations was significantly greater during PC (p< .001) than at other time intervals, and during RO, hybrid evaluations required significantly more appointments (p < .001) than in-person and virtual. The majority of evaluations were conducted with adult patients (71.4%). For adult patients, neurodegenerative/memory disorders received TNP evaluations at a higher rate during PC and RO. Pediatric patients were significantly older during PC (p < .001); neurodevelopmental referrals received more hybrid and virtual evaluations.

CONCLUSIONS

Results indicate that patient characteristics, especially age and referral categories, impact the feasibility of TNP. Data from the RO period suggest that in-person evaluations not surprisingly remain the mainstay; however, for adult patients, and especially older adults with neurodegenerative/memory disorders, TNP may provide an important option for delivery of neuropsychological evaluations.

Opportunities and Challenges of Telehealth in Disease Management during COVID-19 Pandemic: A Scoping Review

OBJECTIVE

The novel coronavirus disease 2019 (COVID-19) pandemic is an unexpected universal problem that has changed health care access across the world. Telehealth is an effective solution for health care delivery during disasters and public health emergencies. This study was conducted to summarize the opportunities and challenges of using telehealth in health care delivery during the COVID-19 pandemic.

METHODS

A structured search was performed in the Web of Science, PubMed, Science Direct, and Scopus databases, as well as the Google Scholar search engine, for studies published until November 4, 2020. The reviewers analyzed 112 studies and identified opportunities and challenges. This review followed the Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) protocols. Quality appraisal was done according to the Mixed Methods Appraisal Tool (MMAT) version 2018. Thematic analysis was applied for data analysis.

RESULTS

A total of 112 unique opportunities of telehealth application during the pandemic were categorized into 4 key themes, such as (1) clinical, (2) organizational, (3) technical, and (4) social, which were further divided into 11 initial themes and 26 unique concepts. Furthermore, 106 unique challenges were categorized into 6 key themes, such as (1) legal, (2) clinical, (3) organizational, (40 technical, (5) socioeconomic, and (6) data quality, which were divided into 16 initial themes and 37 unique concepts altogether. The clinical opportunities and legal challenges were the most frequent opportunities and challenges, respectively.

CONCLUSION

The COVID-19 pandemic significantly accelerated the use of telehealth. This study could offer useful information to policymakers about the opportunities and challenges of implementing telehealth for providing accessible, safe, and efficient health care delivery to the patient population during and after COVID-19. Furthermore, it can assist policymakers to make informed decisions on implementing telehealth in response to the COVID-19 pandemic by addressing the obstacles ahead.

Cancer, cognition, and COVID: delivering direct-to-home teleneuropsychology services to neuro-oncology patients

BACKGROUND

The COVID-19 pandemic induced rapid adoption of telemedicine services for neuro-oncology patients at an increased risk of infection. Neuropsychological assessment is important to neuro-oncology care yet challenging to complete outside of a structured testing environment. Teleneuropsychology (TNP) has been explored in limited populations and proven feasible and reliable. Conducting TNP visits directly to patients' home (DTH) had minimal prior study.

METHODS

We used two voluntary surveys to examine acceptance (patients) and feasibility (providers) of DTH-TNP at two regionally diverse medical institutions providing neuropsychological services to neuro-oncology patients from April to September 2020.

RESULTS

A total of 119 patients were scheduled during the study period, 79 of whom completed neuropsychological testing via DTH-TNP. Neuropsychology providers completed surveys on 68 of these encounters (86%). In 98% of cases, neuropsychologists were able to achieve or partially achieve the individually defined goals of their assessment. Common problems reported included patient dysregulation (16%) and slow/unreliable internet (15%). Of the 52 patients who responded, 98% were satisfied with the DTH-TNP experience, and 92% would recommend the virtual visit to others. All respondents felt understood by the examiner (100%) and the majority denied technical difficulties (90%), communication challenges (94%), or privacy concerns (98%). Patients reported reduced risk of infection and saved travel time as favorable aspects of DTH-TNP.

CONCLUSIONS

These preliminary results suggest neuro-oncology patients find DTH-TNP acceptable and neuropsychologists find it a feasible practice, while also recognizing its limitations. Results suggest that further study of DTH-TNP (eg, reliability, validity) for neuro-oncology patients is warranted.

Cross-cultural considerations for teleneuropsychology with Asian patients

OBJECTIVE

Recent teleneuropsychology (TeleNP) models provide some degree of guidance in the application of telecommunication technologies toward the practice of neuropsychology. However, there remains a paucity of peer-reviewed data on TeleNP practices with culturally diverse patients, including Asian patients. This manuscript describes the challenges related to TeleNP practices with Asian patients and offers practical recommendations to complement existing TeleNP guidelines.

METHOD

Based on extant literature on multicultural applications of neuropsychology, weprovide recommendations for TeleNP services with Asian patients that pertain to specific components of a TeleNP evaluation, such as a) pre-evaluation preparation, b) determining the appropriateness of the referral, c) determining language proficiency, d) working with interpreters, e) informed consent and confidentiality issues, f) conducting a culturally sensitive clinical interview, g) behavioral observations and communication, h) test selection, and i) interpreting data and writing reports.

CONCLUSIONS

Our recommendations for TeleNP services with Asian patients highlight the need for flexibility to accommodate cultural differences and commitment to the complex nature of working with patients requiring interpretation services, while also recognizing the importance of preserving the validity of neuropsychological methods. Moving forward, it is imperative that the field of neuropsychology increases the training and accessibility of neuropsychologists who are knowledgeable in providing TeleNP services to Asian patients, and promotes research on the validation of TeleNP for Asian and other ethnic minority groups.

How, when, and for whom: decisions regarding remote neuropsychological assessment during the 2020 COVID-19 pandemic

Neuropsychological assessment provides crucial information about cognitive, behavioral, and socioemotional functioning in medical, educational, legal, and social contexts. During the 2020 COVID-19 pandemic, the Israeli Ministry of Health initially mandated that all psychological assessments be postponed. However, as referrals to time-sensitive, high-need, and high-stakes assessments began to accumulate, it became necessary to consider remote solutions. In the current paper, we describe the considerations that affected the transition to remote activity in a prominent Israeli provider of neuropsychological assessment and rehabilitation services, referring to technological and environmental conditions, cognitive requirements, and tasks, as well as to legal, regulatory, and funding issues. After discussing how assessments should be conducted to maximize feasibility and validity while minimizing risks to clients and clinicians, we propose a preliminary model for deciding whether specific referrals warrant remote administration. The model delineates key factors in decisions regarding remote assessment, emphasizing the distinct roles of the referring clinician and the neuropsychologist who conducts the assessment, and highlighting the need for collaboration between them. The abrupt need for remote assessments during the pandemic required a quick response with little preparation. The lessons learned from this process can be applied in the future, so that the need for remote services can be met with greater certainty and uniformity.

The Wisconsin Card Sorting Test: Split-Half Reliability Estimates for a Self-Administered Computerized Variant

Self-administered computerized assessment has the potential to increase the reach of neuropsychological assessment. The present study reports the first split-half reliability estimates for a self-administered computerized variant of the Wisconsin Card Sorting Test (WCST), which is considered as a gold standard for the neuropsychological assessment of executive functions. We analyzed data from a large sample of young volunteers (N = 375). Split-half reliability estimates for perseveration errors, set-loss errors, and inference errors were all above 0.90. Split-half reliability estimates for response time measures on switch and repeat trials exceeded 0.95. Our results indicated sufficient split-half reliability for a self-administered computerized WCST, paving the way for an advanced digital assessment of executive functions. We discuss potential effects of test formats, administration variants, and sample characteristics on split-half reliability.

Validity of In-Home Teleneuropsychological Testing in the Wake of COVID-19

OBJECTIVE

Teleneuropsychology (TNP) has been shown to be a valid assessment method compared with in-person neuropsychological evaluations. Interest in delivering TNP directly to patients' homes has arisen in response to the coronavirus disease 2019 (COVID-19) pandemic. However, prior research has typically involved patients tested in clinical settings, and the validity of in-home TNP testing has not yet been established. The present study aims to explore the validity and clinical utility of in-home TNP testing in a mixed clinical sample in the wake of COVID-19.

METHODS

Test profiles for 111 in-home TNP patients were retrospectively compared with 120 patients who completed in-person evaluations. The TNP test battery consisted of tests measuring attention/processing speed, verbal memory, naming, verbal fluency, and visuoconstruction. TNP scores of cognitively normal (CN) patients were compared with patients with neurocognitive disorders (NCD), and score profiles were examined among suspected diagnostic groups of Alzheimer's disease (AD), Parkinson's disease (PD), and vascular disease (VaD).

RESULTS

TNP test scores did not significantly differ from in-person testing across all tests except the Hopkins Verbal Learning Test-Revised Discrimination Index. Within the TNP group, significant differences between the CN and NCD groups were found for all tests, and the memory and semantic fluency tests yielded large effect sizes (d ≥ 0.8). Score profiles among the AD, PD, and VaD groups were explored.

CONCLUSIONS

These findings support the validity of in-home TNP testing compared with in-person neuropsychological testing. Practice considerations, limitations, and future directions are discussed.

Teleneuropsychology practice survey during COVID-19 within the United States

OBJECTIVE

Identify factors influencing service delivery changes during COVID-19 and examine barriers and provider satisfaction with teleneuropsychology (teleNP).

METHOD

Licensed clinical neuropsychologists within the United States recruited via neuropsychology-specific listservs (July-August 2020) to complete an online survey.

RESULTS

A total of 261 individuals completed the survey. Most (76%) reported delivering in-person testing in some capacity at the time of our survey. Relatively more private practitioners identified concerns with privacy/confidentiality (45.2% vs. 17.9%; χ²(2) = 6.99, p < 0.05), legal issues (47.6% vs. 17.9%; χ²(2) = 8.06, p < 0.05), and an undesirable precedent for legal/forensic cases (59.5% vs. 15.4%; χ²(2) = 17.54, p < 0.001) compared to hospital or other medical (non-VA) practitioners. Multiple resources informed teleNP protocols, such as organization guidelines (87.6%), literature review (75.9%), webinars (72.4%), and consultation (68%). Several factors influenced test selection, including availability of normative data (70.1%), test familiarity (66.4%), administration time (63.5%), and evidence base (60.6%). Reported barriers to continuing teleNP after COVID-19 included need for improved teleNP norms (85.9%), domain coverage (84.7%), improved patient access to technology (74.1%) and further validation studies (84.1%).

CONCLUSION

TeleNP may not be feasible in all settings and/or referrals. Respondents employed multiple resources in aggregating teleNP protocols and considered several factors when selecting tests. Results highlight the complex and varied decision-making processes utilized by respondents to adapt to service delivery changes. Considering the many benefits of teleNP, future research addressing some of the potentially modifiable factors (e.g., technology access, attitudes regarding teleNP) and significant development needs for teleNP itself (i.e., improved teleNP norms, further validation studies, etc.) is warranted.

Neuropsychologists' practice adjustments: The impact of COVID-19

Objective: The field of neuropsychology's response to the COVID-19 pandemic was characterized by a rapid change in clinical practice secondary to physical distancing policies and orders. The current study aimed to further characterize the change in neuropsychologists' professional practice, specifically related to teleneuropsychology (TNP) service provision, and also provide novel data regarding the impact of the pandemic on providers' emotional health. Method: This study surveyed 142 neuropsychologists between 3/30/2020 and 4/10/2020, who worked within a variety of settings (e.g., academic medical centers, general hospitals, Veterans Affairs medical centers, rehabilitation hospitals) across all four U.S. geographic regions. Mixed-model analyses of variance (ANOVAs) were conducted to assess for differences in neuropsychological practice (i.e., total number of patients and proportion of TNP seen per week) across time points (i.e., late February and early April) by practice setting and region. Descriptive statistics were conducted to describe respondents' perceptions of TNP, emotional responses to the pandemic, and perceptions of institutional/employers'/practices' responses. Results: Nearly all respondents (∼98%) reported making practice alterations, with ∼73% providing at least some TNP. Neuropsychologists across all settings and regions reported performing a higher proportion of TNP evaluations by April 2020. On average, respondents reported a medium amount of distress/anxiety related to COVID-19, which had a "somewhat small impact" on their ability to practice overall. Conclusions: The current study further elucidated neuropsychologists' provision of TNP services and offered initial data related to their emotional response to the pandemic. Future research is needed to examine the viability and sustainability of TNP practice.

Rapid Telehealth Implementation during the COVID-19 Global Pandemic: A Rapid Review

The implementation and continued expansion of telehealth services assists a variety of health care organizations in the delivery of care during the current COVID-19 global pandemic. However, limited research has been conducted on recent, rapid telehealth implementation and expansion initiatives regarding facilitators and barriers surrounding the provision of quality patient care. Our rapid review evaluated the literature specific to rapid telehealth implementation during the current COVID-19 pandemic from three research databases between January 2020 and May 2020 and reported using preferred reporting items for systematic reviews and meta-analyses (PRISMA). The results indicate the rapid implementation and enhanced use of telehealth during the COVID-19 pandemic in the United States surrounding the facilitators and barriers to the provision of patient care, which are categorized into three identified themes: (1) descriptive process-oriented implementations, (2) the interpretation and infusion of the CARES Act of 2020 telehealth exemptions related to the relaxation of patient privacy and security (HIPAA) protocols, and (3) the standard of care protocols and experiences addressing organizational liability and the standard of care. While the study limitation of sample size exists (n = 21), an identification of rapid telehealth implementation advancements and challenges during the current pandemic may assist health care organizations in the delivery of ongoing quality care during the COVID-19 pandemic.

Teleneuropsychology in the time of COVID-19: The experience of The Australian Epilepsy Project

PURPOSE

Traditional neuropsychological testing carries elevated COVID-19 risk for both examinee and examiner. Here we describe how the pilot study of the Australian Epilepsy Project (AEP) has transitioned to tele-neuropsychology (teleNP), enabling continued safe operations during the pandemic.

METHODS

The AEP includes adults (age 18-60) with a first unprovoked seizure, new diagnosis of epilepsy or drug resistant focal epilepsy. Shortly after launching the study, COVID-related restrictions necessitated adaptation to teleNP, including delivery of verbal tasks via videoconference; visual stimulus delivery via document camera; use of web-hosted, computerised assessment; substitution of oral versions for written tests; online delivery of questionnaires; and discontinuation of telehealth incompatible tasks.

RESULTS

To date, we have completed 24 teleNP assessments: 18 remotely (participant in own home) and six on-site (participant using equipment at research facility). Five face-to-face assessments were conducted prior to the transition to teleNP. Eight of 408 tests administered via teleNP (1.9 %) have been invalidated, for a variety of reasons (technical, procedural, environmental). Data confirm typical patterns of epilepsy-related deficits (p < .05) affecting processing speed, executive function, language and memory. Questionnaire responses indicate elevated rates of patients at high risk of mood (34 %) and anxiety disorder (38 %).

CONCLUSION

Research teleNP assessments reveal a typical pattern of impairments in epilepsy. A range of issues must be considered when introducing teleNP, such as technical and administrative set up, test selection and delivery, and cohort suitability. TeleNP enables large-scale neuropsychological research during periods of social distancing (and beyond), and offers an opportunity to expand the reach and breadth of neuropsychological services.

Remote cognitive and behavioral assessment: Report of the Alzheimer Society of Canada Task Force on dementia care best practices for COVID-19

INTRODUCTION

Despite the urgent need for remote neurobehavioral assessment of individuals with cognitive impairment, guidance is lacking. Our goal is to provide a multi-dimensional framework for remotely assessing cognitive, functional, behavioral, and physical aspects of people with cognitive impairment, along with ethical and technical considerations.

METHODS

Literature review on remote cognitive assessment and multidisciplinary expert opinion from behavioral neurologists, neuropsychiatrists, neuropsychologists, and geriatricians was integrated under the auspices of the Alzheimer Society of Canada Task Force on Dementia Care Best Practices for COVID-19. Telephone and video approaches to assessments were considered.

RESULTS

Remote assessment is shown to be acceptable to patients and caregivers. Informed consent, informant history, and attention to privacy and autonomy are paramount. A range of screening and domain-specific instruments are available for telephone or video assessment of cognition, function, and behavior. Some neuropsychological tests administered by videoconferencing show good agreement with in-person assessment but still lack validation and norms. Aspects of the remote dementia-focused neurological examination can be performed reliably.

DISCUSSION

Despite challenges, current literature and practice support implementation of telemedicine assessments for patients with cognitive impairment. Convergence of data across the clinical interview, reliable and brief remote cognitive tests, and remote neurological exam increase confidence in clinical interpretation and diagnosis.