A survey of international clinical teleneuropsychology service provision prior to and in the context of COVID-19

Investigating Equivalence of In-Person and Telehealth-Based Neuropsychological Assessment Performance for Individuals Being Investigated for Younger Onset Dementia

OBJECTIVE

Given the rapid shift to in-home teleneuropsychology models, more research is needed to investigate the equivalence of non-facilitator models of teleneuropsychology delivery for people with younger onset dementia (YOD). This study aimed to determine whether equivalent performances were observed on neuropsychological measures administered in-person and via teleneuropsychology in a sample of people being investigated for YOD.

METHOD

Using a randomized counterbalanced cross-over design, 43 participants (Mage = 60.26, SDage = 7.19) with a possible or probable YOD diagnosis completed 14 neuropsychological tests in-person and via teleneuropsychology, with a 2-week interval. Repeated measures t-tests, intraclass correlation coefficients (ICC), and Bland Altman analyses were used to investigate equivalence across the administration conditions.

RESULTS

No statistical differences were found between in-person and teleneuropsychology conditions, except for the Hospital Anxiety and Depression Scale Anxiety subtest. Small to negligible effect sizes were observed (ranging from .01 to .20). ICC estimates ranged from .71 to .97 across the neuropsychological measures. Bland Altman analyses revealed that the Wechsler Adult Intelligence Scale-Fourth Edition Block Design subtest had slightly better overall performance in the in-person condition and participants reported higher levels of anxiety symptoms during the teleneuropsychology condition; however, average anxiety symptoms remained within the clinically normal range. Participants reported a high level of acceptability for teleneuropsychology assessments.

CONCLUSIONS

These results suggest that performances are comparable between in-person and teleneuropsychology assessment modalities. Our findings support teleneuropsychology as a feasible alternative to in-person neuropsychological services for people under investigation of YOD, who face significant barriers in accessing timely diagnoses and treatment options.

Development of a self-administered online battery for remote assessment of executive functions and verbal memory: equivalence with face-to-face administration, preliminary norms, and acceptance

OBJECTIVES

Interest in teleneuropsychology services increased considerably after the COVID-19 pandemic. However, the utility of unsupervised administration of computerized tests remains largely unexplored. In the present study, we developed a brief computerized battery that assesses self-reported cognitive abilities and performances on executive functioning and verbal memory. We investigated the equivalence of the self-administration online (SAO) procedure and the face-to-face (FTF) administration. Preliminary normative data were developed and the acceptance of the SAO procedure was explored.

METHODS

A community sample of 169 Greek adults [94 women; mean age: 41.95 (SD = 13.40) years, mean years of education: 15.10 (SD = 2.65)] completed the SAO assessment. A subgroup of 40 participants was tested in a counterbalanced way both with SAO and FTF. Participants' performances were compared with paired sample t-tests and the agreement between the two methods was estimated with intraclass correlation coefficients (ICCs). Multiple linear regression analyses were applied to investigate the effect of demographic characteristics on SAO measures.

RESULTS

No difference between SAO and FTF scores was observed. ICCs indicated moderate to good agreement (.418-.848) for most measures. Age was positively associated with self-reported cognitive state and negatively with neuropsychological performances and the level of acceptance of the SAO procedure. Approximately 80% of participants reported satisfaction from the SAO assessment, 69% good compliance with the instructions, but less than 30% belief that the FTF assessment could be adequately replaced.

CONCLUSION

SAO testing is feasible and well accepted among Greek adults yielding equivalent results with FTF testing. Despite the wide satisfaction, though, notable reluctance was noted for the substitution of FTF with SAO procedures.

A digital teleneuropsychology platform for the diagnosis of mild cognitive impairment: from concept to certification as a medical device

BACKGROUND

Innovative digital solutions are shaping a new concept of dementia care, opening additional venues for prevention, diagnosis, monitoring and treatment. Hereby, we report the development of a tablet-based teleneuropsychology platform (Tenèpsia®), from concept to certification as Medical Device (MD) Class IIA, as per new MD regulation 745/2017.

METHODS

The platform was designed for the remote cognitive evaluation and created thanks to the effort of a collaborative working group including experts from three Italian scientific societies and Biogen Italia S.r.l. (hereafter "Biogen"), and developers from Xenia Reply and Inside AI. The development strategy was guided by converting traditional paper-and-pencil tests into digital versions while maintaining comparable neuropsychological features and optimizing patient accessibility and user experience. The experts focused on the choice and adaptation of traditional neuropsychology measures for a 45-min teleneuropsychology assessment.

RESULTS

The developers created a web and a mobile interface, respectively, for the professional (neuropsychologist) and non-professional (patient and caregiver) use. Recording of voice, drawing and typing information was enabled. Instant dashboards provide a quick overview of the patient's condition. Simulation activities were performed to obtain MD certification, valid across Europe.

CONCLUSION

Neuropsychology services will benefit from the implementation in clinics of harmonized digital tools with adequate scientific and technological standards. The use of digital cognitive testing for the diagnosis of mild cognitive impairment is expected to enhance patient and clinician outcomes through simplified, digital objective data collection, sparing of time and resources, with a positive impact on healthcare costs and access to treatments, reducing inequalities and delays in diagnosis and cure.

Using the MMPI-2-RF, IOP-29, IOP-M, and FIT in the In-Person and Remote Administration Formats: A Simulation Study on Feigned mTBI

Our study compared the impact of administering Symptom Validity Tests (SVTs) and Performance Validity Tests (PVTs) in in-person versus remote formats and assessed different approaches to combining validity test results. Using the MMPI-2-RF, IOP-29, IOP-M, and FIT, we assessed 164 adults, with half instructed to feign mild traumatic brain injury (mTBI) and half to respond honestly. Within each subgroup, half completed the tests in person, and the other half completed them online via videoconferencing. Results from 2 ×2 analyses of variance showed no significant effects of administration format on SVT and PVT scores. When comparing feigners to controls, the MMPI-2-RF RBS exhibited the largest effect size (d = 3.05) among all examined measures. Accordingly, we conducted a series of two-step hierarchical logistic regression models by entering the MMPI-2-RF RBS first, followed by each other SVT and PVT individually. We found that the IOP-29 and IOP-M were the only measures that yielded incremental validity beyond the effects of the MMPI-2-RF RBS in predicting group membership. Taken together, these findings suggest that administering these SVTs and PVTs in-person or remotely yields similar results, and the combination of MMPI and IOP indexes might be particularly effective in identifying feigned mTBI.

Diagnostic certainty during in-person and telehealth autism evaluations

Background

Many diagnostic evaluations abruptly shifted to telehealth during the COVID-19 pandemic; however, little is known about the impact on diagnosis patterns for children evaluated for autism spectrum disorder (ASD). The purpose of this clinical research study was to examine (1) the frequency of diagnoses evaluated beyond ASD; (2) the frequency of diagnoses made, including ASD; and (3) clinician diagnostic certainty for all diagnoses evaluated for children who received an evaluation due to primary concerns about ASD via telehealth during the pandemic compared to those evaluated in person before the pandemic at an ASD specialty clinic.

Methods

The sample included 2192 children, 1-17 years (M = 6.5 years; SD = 3.9), evaluated by a physician/psychologist at an ASD specialty center. A total of 649 children were evaluated in-person September 1, 2019-March 13, 2020 (pre-pandemic) and 1543 were evaluated via telehealth March 14, 2020-July 26, 2021 (during pandemic). Upon completion of each evaluation, clinicians provided a final diagnostic determination (i.e., "Yes," "No," "Possible," or "Not Assessed") for the following DSM-5 conditions: ASD, attention-deficit/hyperactivity disorder (ADHD), intellectual developmental disorder (IDD), anxiety (ANX), depression (DEP), and behavioral disorder (BD). "Possible" indicated lower certainty and the diagnosis was not provided. "Not Assessed" indicated the disorder was not evaluated.

Results

Diagnostic certainty for ASD and ADHD was lower and clinicians evaluated for and made diagnoses of IDD less often during evaluations that occurred via telehealth during the pandemic versus in person before the pandemic. DEP and BD were diagnosed more frequently, diagnostic certainty of DEP was lower, and no differences in the frequency of ANX diagnoses emerged during evaluations conducted via telehealth during the pandemic compared to those conducted in person before the pandemic.

Conclusions

Differences emerged in the frequency of diagnoses evaluated and made and diagnostic certainty for evaluations conducted via telehealth during the pandemic compared to in person before the pandemic, which likely impacted patients and reflect real-word challenges. Future work should examine whether these patterns are generalizable and the mechanisms that contribute to these differences.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Evaluation of the Uniform Data Set version 3 teleneuropsychological measures

OBJECTIVE

Few studies have evaluated in-home teleneuropsychological (teleNP) assessment and none, to our knowledge, has evaluated the National Alzheimer's Coordinating Center's (NACC) Uniform Data Set version 3 tele-adapted test battery (UDS v3.0 t-cog). The current study evaluates the reliability of the in-home UDS v3.0 t-cog with a prior in-person UDS v3.0 evaluation.

METHOD

One hundred and eighty-one cognitively unimpaired or cognitively impaired participants from a longitudinal study of memory and aging completed an in-person UDS v3.0 and a subsequent UDS v3.0 t-cog evaluation (∼16 months apart) administered either via video conference (n = 122) or telephone (n = 59).

RESULTS

We calculated intraclass correlation coefficients (ICCs) between each time point for the entire sample. ICCs ranged widely (0.01-0.79) but were generally indicative of "moderate" (i.e., ICCs ranging from 0.5-0.75) to "good" (i.e., ICCs ranging from 0.75-0.90) agreement. Comparable ICCs were evident when looking only at those with stable diagnoses. However, relatively stronger ICCs (Range: 0.35-0.87) were found between similarly timed in-person UDS v3.0 evaluations.

CONCLUSIONS

Our findings suggest that most tests on the UDS v3.0 t-cog battery may serve as a viable alternative to its in-person counterpart, though reliability may be attenuated relative to the traditional in-person format. More tightly controlled studies are needed to better establish the reliability of these measures.

Clinical utility of teleneuropsychology among pediatric patients with broadly average and low intellectual functioning

The reliability of teleneuropsychology (teleNP) within pediatric populations, particularly those with low intellectual functioning (LIF; i.e., Intellectual Quotient <80), is largely unknown. This repeated-measures study compared performance on WISC-V and WAIS-IV subtests administered in-person before the COVID-19 pandemic and via teleNP during the pandemic in individuals with LIF versus broadly average (BA) intellectual functioning in a clinically referred pediatric cohort. Data were collected from a retrospective chart review of 35 pediatric patients who underwent in-person neuropsychological evaluation at an academic medical center before the pandemic (Mage = 10.10 years, SD = 2.93) and videoconference teleNP assessment during the pandemic (Mage = 13.47 years, SD = 2.88). Participants completed the Similarities, Matrix Reasoning, and Digit Span subtests from the WISC-V or WAIS-IV at both time points. After controlling for test-retest time interval, partial correlations showed relatively strong associations in test-retest performance across subtests in the whole sample and among the subset of LIF patients. Distribution of significant reliable change indices (RCI) between the LIF and BA groups were similar. Strong correlations were observed between performances on select Wechsler subtests administered in-person and via teleNP. Results lend initial support toward the utility of teleNP administration of these measures in children with a broad range of intellectual functioning.

Tele-Global Examination of Mental State (Tele-GEMS): an open tool for the remote neuropsychological screening

Tele-neuropsychology, i.e., the application of remote audio-visual technologies to neuropsychological evaluation or rehabilitation, has become increasingly popular and widespread during and after the COVID-19 pandemic. New tools with updated normative data and appropriate methodological developments are necessary. We present Tele-GEMS, a telephone-based cognitive screening developed on N = 601 Italian participants. It yields a global score tapping on orientation, memory, spatial representation, language, and pragmatic abilities. Its administration lasts about 10 min. Clinical cut-offs are provided, accounting for demographic variables (age, education, and sex) and also for a comprehensive index taking into account cognitively stimulating life experiences that can build up a cognitive reserve. Tele-GEMS shows good internal consistency and a good inter-rater agreement. The test includes the thresholds for estimating a significant change after repeated measurements. Tele-GEMS has a good construct validity as assessed with MoCA and a suitable criterion validity assessed with its in-person version (GEMS). All the materials and the instructions, including scripts and an online Application for the automatic calculation of cut-offs, are accessible on OSF at https://osf.io/t3bma/ under a Creative Commons license.

Perspectives of telehealth access and implementation in people recovering from serious transport injury, health care providers and compensation system staff during the COVID-19 pandemic in Australia

INTRODUCTION

Before the COVID-19 pandemic, few injury compensation schemes supported access to service-delivery via telehealth. The aim of this qualitative study was to explore the perspectives of people recovering from serious transport injury, health care providers, and senior staff of a transport injury compensation scheme, in relation to the uptake and implementation of telehealth during the COVID-19 pandemic, and its ongoing use.

METHODS

Semi-structured interviews were undertaken with 35 participants, including 15 seriously injured patients, 16 health care providers and 4 compensation scheme staff. A thematic analysis was performed using a framework approach.

RESULTS

Themes identified included the need to provide continuity of care via telehealth during the pandemic for patients recovering from injury, and the associated organisational and technical support needs. It was noted that some types of services worked well via telehealth, including psychology, while others did not, including physical assessments. The convenience of telehealth was highlighted, in relation to reduced travel. However, there were often safety fears relating to falls, and communication issues with injured people.

CONCLUSIONS

This research found that the majority of injured patients and health care providers had benefitted from the introduction of service delivery via telehealth during the pandemic for some types of services. Participants saw opportunities for continued benefit post-pandemic, particularly for improving equity of access to health care for people with barriers to mobility and travel.

Improved parent self-efficacy following pediatric evaluation: Evidence for value of a telemedicine approach in psychological and neuropsychological assessment

Objective: While considerable inquiry is currently underway into the comparability of psychological test results obtained in onsite/in-person settings versus telemedicine settings, there has been less attention given to the comparability of the impact/outcome of the assessment process across settings. The current quality improvement study conceptualized impact/outcome according to the model of Austin et al. and sought to determine whether the prior finding of increased parent self-efficacy following onsite neuropsychological assessment was also observed when psychological and neuropsychological assessment was conducted via a telemedicine modality. Method: In the course of standard care delivery, ratings from Austin et al.'s four parent self-efficacy items were obtained at time 1 prior to patients' assessment visits and then again at time 2 either (1) following their last assessment/feedback visit (the Complete Assessment group; n = 157) or (2) in the middle of the assessment process prior to the last planned visit (the Incomplete Assessment group; n = 117). Results: Analyses revealed significant findings for time and time × group. Parent self-efficacy ratings improved over time in both groups, with significantly higher ratings in the Complete Assessment group at time 2. When compared to reference means from the in-person/onsite Austin et al. study, ratings from the current study found comparable improvement in parent self-efficacy achieved via telemedicine assessment in the Complete Assessment group. Conclusions: These data support the use of telemedicine based psychological and neuropsychological evaluation and provide preliminary evidence that the impact/outcome is comparable with in-person/onsite assessment.

Tele-neuropsychological Assessment of Children and Young People: A Systematic Review

The coronavirus pandemic identified a clinical need for pediatric tele-neuropsychology (TeleNP) assessment. However, due to limited research, clinicians have had little information to develop, adapt, or select reliable pediatric assessments for TeleNP. This preliminary systematic review aimed to examine the feasibility of pediatric TeleNP assessment alongside (1) patient/family acceptability, (2) reliability, and (3) the quality of the literature. Between May 2021 and November 2022, manual searches of PubMed, PsycINFO, and Google Scholar were conducted using terms related to "pediatric" and "tele-neuropsychology." After extracting relevant papers with samples aged 0-22 years, predefined exclusion criteria were applied. Quality assessment was completed using the AXIS appraisal tool (91% rater-agreement). Twenty-one studies were included in the review, with reported qualitative and quantitative data on the feasibility, reliability, and acceptability extracted. Across included studies, TeleNP was completed via telephone/video conference with participants either at home, in a local setting accompanied by an assistant, or in a different room but in the same building as the assessor. Pediatric TeleNP was generally reported to be feasible (e.g., minimal behavioral differences) and acceptable (e.g., positive feedback). Nineteen studies conducted some statistical analyses to assess reliability. Most observed no significant difference between in-person and TeleNP for most cognitive domains (i.e., IQ), with a minority finding variable reliability for some tests (e.g., attention, speech, visuo-spatial). Limited reporting of sex-assigned birth, racialized identity, and ethnicity reduced the quality and generalizability of the literature. To aid clinical interpretations, studies should assess underexamined cognitive domains (e.g., processing speed) with larger, more inclusive samples.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40817-023-00144-6.

Teleneuropsychology during the COVID-19 pandemic in Mexico: the perspective from a middle-income country

INTRODUCTION

The use of teleneuropsychology (TeleNP) increased as a result of the COVID-19 pandemic; however, there have been no studies of the benefits and difficulties with this modality in middle-income countries. This study aimed to assess the current use of TeleNP in Mexico.

METHOD

Mexican neuropsychologists were invited to participate in an online survey regarding the use of TeleNP during the COVID-19 pandemic. The survey was based on issues from a literature review and consisted of 36 questions requiring yes/no, multiple choice, or ordinal answers. The survey was created using Google Forms and asked respondents to provide informed consent. A total of 107 clinical neuropsychologists completed the survey.

RESULTS

82% of participants currently use TeleNP, and most reported learning about TeleNP through personal experience, literature research, and colleagues. Brief evaluations, delivery of results, and intervention were the principal services provided, most frequently on a home-to-home basis. Almost 30% of clinicians reported not requiring informed consent for use of the modality. Consultations included children, adolescents, and adults in similar numbers; older adults were less frequent. Technological limitations were the most frequent reason for ruling out the modality with particular patients. Perceived benefits included the ability to continue consultations despite social distancing measures, lesser risk of COVID-19 infection, and the possibility of seeing patients with limited access to neuropsychological services. Reasons for not using TeleNP included a lack of standardized instruments, not feeling comfortable with the modality, and lack of technological resources and skills.

CONCLUSIONS

Despite the socioeconomic differences between Mexico and high-income countries, most of our findings were similar to reports from those countries. However, technological limitations were common, and smartphones were commonly used, contrary to recommendations in the literature. The future use of TeleNP in Mexico should include formal training and ethical guidelines.

The Evolving Need for Neuropsychology in Neurosurgical Settings: Challenges Facing Transformative Care

Clinical neuropsychology has been a valuable asset to neurologic surgery, contributing to lateralization and localization of pathologic brain tissue, identification of eloquent cortex, and evaluation of postoperative neuropsychological functioning. Moreover, neuropsychologists provide empirically driven interventions aimed at supporting preparation and/or recovery of neurosurgery patients. Nonetheless, several challenges may limit the reliability, validity, and generalizability of the assessment data obtained and reduce the usefulness of other neuropsychological services provided. Specifically, linguistic, cultural, educational, and other biases associated with demographic characteristics can lead to a narrowed view of an individual's life experiences, which must be confronted to fulfill the mission of ensuring that all patients have access to care that is appropriate to their needs. Instead of perceiving these challenges as insurmountable barriers, such issues can be viewed as opportunities to catalyze change and foster innovation for the future of neuropsychological care in neurosurgical settings. In addition to reviewing the possible mechanisms of these obstacles, the current article offers tangible solutions at both a macro level (e.g., discipline-wide transformations) and micro level (e.g., individualized patient-centric approaches). Outlined are practical techniques to potentially improve consensus and standardization of methods, advance and globalize research, expand representativeness of measures and practices to serve diverse individuals, and increase treatment adherence through engagement of patients and their families.

Understanding Clinician's Experiences with Implementation of a Younger Onset Dementia Telehealth Service

The successful implementation of telehealth services depends largely on clinician acceptance of telehealth as a viable healthcare option and their adoption of telehealth methods into their clinical practice. While growing research supports the feasibility of telehealth services, no research has evaluated clinicians' experiences during the implementation of a younger onset dementia telehealth service. Semi-structured group interviews were conducted with 7 metropolitan (hub) clinicians and 16 rural (spoke) clinicians during the pre-and post-implementation phases of a novel Younger onset dementia (YOD) telehealth service. Reflexive thematic analysis identified five themes at pre-implementation: clinical need, previous experiences and views, potential telehealth barriers, solutions to potential telehealth barriers, and potential clinical outcomes. At post-implementation, nine themes were identified: clinical need, clinical relationships, concerns about the future of rural healthcare, clinical practice and resourcing factors, patient suitability, difficulties with technology, service quality, the way forward, and the impact of COVID-19. Most clinicians held positive views regarding the service, particularly the ability to provide more options to rural-dwelling patients. However, some concerns about threats to rural healthcare and the validity of telehealth assessments remained. Overall, this study has identified service implementation barriers and facilitators and contributes to the long-term sustainability of current and future telehealth YOD services.

VA psychologists' professional practices and attitudes toward tele-neuropsychology among a tele-neuropsychology interest group within the Veterans Health Administration

OBJECTIVE

To provide understanding of practices and attitudes toward tele-neuropsychology (teleNP) among Veterans Health Administration (VA) psychologists who have joined a related community of practice.

METHODS

Several VA psychologists (the authors) developed this survey to better understand dissemination of teleNP and attitudes toward teleNP among those involved in a VA teleNP community of practice. We contacted VA psychologists within this group to complete the survey. The survey was open from July to August 2021, during which time a total of 62 VA psychologists participated.

RESULTS

Response rate was estimated to be 41% of those receiving the survey (62 respondents). Approximately two thirds of those completing the survey reported current practice of teleNP (68%; n = 42). In contrast, only 25% of the entire sample (n = 15) conducted any teleNP pre-pandemic. Job satisfaction related to being able to perform teleNP is high. Support for continued and increased use of teleNP is high, with most respondents (84%) indicating they will be at least somewhat likely to practice teleNP post-pandemic.

CONCLUSIONS

The survey provides increased support for the use of teleNP by VA psychologists who responded to the survey, with significantly increased adoption since the Covid-19 pandemic, and greater likelihood of intention to use teleNP post pandemic.

At-distance neurocognitive rehabilitation during COVID-19 pandemic: A first glance of patients' perspectives about the process and an online platform

Despite the use of digital communication technologies in neurocognitive rehabilitation has been widely used in face-to-face interventions, the difficulties of using ICT-based tools to provide rehabilitation services and the unfamiliarity of the neuropsychologists with internet interventions limited the use of these kinds of interventions in their clinical practices. The lockdown and mitigating measures associated with the COVID-19 pandemic, on the other hand, forced the use of at-distance and online interventions as a means to mitigate the impact of those measures on the mental health and rehabilitation processes of people with neurological disorders. Overall, little is known about the perspectives of patients with acquired neurological conditions about rehabilitation services delivered at distance. Therefore, the main goal of this study was to explore the perceptions that patients with neurological disorders have on at-distance online neurocognitive rehabilitation, namely during the COVID-19 pandemic. Sixteen patients with acquired neurological conditions attending an online neurocognitive rehabilitation program in a Portuguese rehabilitation center filled in an online questionnaire during the mandatory lockdown. The results of this study highlight the potential of delivering rehabilitation services at distance, presenting its advantages and limitations from patients' perspectives, as well as suggestions for improving both neurorehabilitation processes and the online rehabilitation platform used.

Preliminary Findings from a Telephone-Based Cognitive Screening of an Adult HIV Research Cohort during the COVID-19 Pandemic

Objectives

Few publications have documented the utility of in-home telephone-based cognitive screeners during COVID-19. This manuscript describes the adaptation of select face-to-face (FTF) neuropsychological tests to telephonic administration in a longitudinal cohort of people with HIV (PWH). Using the cohort’s pre-pandemic neuropsychological data, we explore the utility of telephonic administration in this population.

Methods

Of a longitudinal cohort of 170 adult PWH, 59 completed telephonic medical and cognitive screenings with comparable pre-pandemic FTF data. Telephone screeners and FTF evaluations were compared using repeated measures ANCOVAs to examine whether test performance differed between administration types and levels of pre-pandemic cognitive performance. Individuals with pre-pandemic test scores more than a standard deviation below the demographically-corrected mean were categorized as “below average” cognitive performance (n = 23), and the remainder as “average” (n = 36).

Results

Over 90% of participants gave positive feedback about the telephone encounter. The average cognitive performance group scored higher than the below average group on all measures across both administration types. Telephone and FTF test scores did not differ significantly for measures of category fluency, letter fluency, and verbal learning. However, the below average group scored higher on a verbal memory measure administered via telephone compared with FTF.

Conclusions

Support for telephonic adaptation of select FTF measures in longitudinal research is mixed, with verbal fluency tasks showing the strongest equivalency. When employed carefully with a clear understanding of their limitations, telephone adaptations can provide an opportunity to continue study objectives, promote equity, and monitor participant well-being during times of duress.

Clinical utility of Phototest via teleneuropsychology in Chilean rural older adults

The COVID-19 pandemic has shown the need for neuropsychological care for older adults with memory complaints in different contexts, including rural areas or areas with difficult access.

Objective

This study aimed to analyze the clinical utility of the Phototest, through telemedicine, to identify mild cognitive impairment in rural older adults with memory complaints, during the COVID-19 pandemic.

Methods

We performed a cross-sectional, case-control, and clinical utility comparison of brief cognitive tests (BCTs). The sample included 111 rural elderly people with mild cognitive impairment (MCI) and 130 healthy controls from the Los Lagos region, Chile. The instruments adopted were modified Mini-Mental State Examination (MMSEm) and adapted version of the Phototest (PT) for Chile.

Results

To identify mild cognitive impairment, using a cutoff score of 27-28 points, the Phototest showed a sensitivity of 96.6% and a specificity of 81.8%; indicators superior to those of the MMSEm.

Conclusions

The Phototest is more accurate than the MMSEm in identifying cognitive alterations in rural older adults with cognitive memory complaints through telemedicine. Therefore, its use in primary care is recommended in order to perform early detection of preclinical cognitive alterations in mild cognitive impairment or neurodegenerative diseases.

Predicting daily functioning with the modified Telephone Interview for Cognitive Status

Background

The modified Telephone Interview for Cognitive Status (mTICS) is a frequently used telephone-based cognitive screening measure that can distinguish between normal aging, mild cognitive impairment (MCI), and dementia. Although it has been used to predict current and future cognitive function in older adults, no studies have examined if the mTICS can predict daily functioning.

Aims

The current study sought to examine the relationship between the mTICS and a performance-based measure of daily functioning.

Methods

The mTICS and demographic information (age, sex, education) were collected during a telephone screening visit for 149 older adults (65–91 years in age) with amnestic MCI. Three subscales of the Independent Living Scales (ILS; Managing Money, Managing Home and Transportation, Health and Safety) were collected during a baseline visit and during a 16 month follow-up visit in a subsample of 93 individuals.

Results

Using simple hierarchical regression, baseline mTICS total score combined with demographic variables significantly predicted 19–22% of baseline ILS subscale scores. Similarly, in a subsample of 93 participants with 16 month follow-up data, baseline mTICS and demographic information predicted 9–31% of ILS subscale scores at follow-up.

Conclusions

The mTICS appears able to predict daily functioning in older individuals with MCI. Remote tracking of cognition and daily functioning in this at-risk group seems particularly beneficial to geriatricians and other providers, especially during COVID-19.

The Relationship between Health Literacy and Comfort with Teleneuropsychology in a Veteran Sample

OBJECTIVE

Health literacy is a strong psychosocial determinant of health disparities and has been found to relate to various aspects of health-related technology use. With the increased implementation of neuropsychological services performed via telehealth during the coronavirus disease 2019 pandemic, the relationship between health literacy and comfort with teleneuropsychology warrants further investigation.

METHOD

The present study examined 77 Veterans participating in neuropsychological evaluations as a part of standard clinical care. The sample was diverse in terms of age ethnicity, and psychiatric and neurocognitive diagnoses. In addition to a fixed-flexible neuropsychological battery, the Brief Health Literacy Screening Tool (BRIEF) was administered to evaluate health literacy. Self-reported comfort with the teleneuropsychological evaluation was assessed using an informal 10-point scale, and qualitative comfort responses were also recorded.

RESULTS

Independent samples t-tests revealed older adults were more likely to participate in the evaluation via telephone than with VA Video Connect. Although health literacy was not related to telehealth modality, it was correlated with comfort with the teleneuropsychological evaluation (r = .34, p < .01), although it is notable that average comfort levels were high across modalities (M = 8.16, SD = 2.50).

CONCLUSIONS

Findings support the notion that teleneuropsychological services may feasibly be implemented with a diverse group of patients, although flexibility with modality may be necessary. Those performing these services should also be aware that patients with lower health literacy may feel less comfortable with teleneuropsychology as they seek to build rapport and optimize evaluation engagement.

Tele-neuropsychological assessment tools in Italy: a systematic review on psychometric properties and usability

Background

The current COVID-19 pandemic has abruptly catalysed a shift towards remote assessment in neuropsychological practice (tele-neuropsychology, t-NPs). Although the validity of t-NPs diagnostics is gaining recognition worldwide, little is known about its implementation in Italy. The present review by the Italian working group on tele-neuropsychology (TELA) aims at describing the availability, psychometric properties, and feasibility of t-NPs tools currently available in Italy.

Methods

Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. This work was pre-registered on the Prospective Register of Systematic Reviews (PROSPERO; CRD42021239687). Observational studies reporting telephone-, videoconference- or web-based assessment of cognition/behaviour in Italian both healthy participants (HPs) and patients were included. Bias assessment was performed through ad hoc scales.

Results

Fourteen studies were included from an initial N = 895 (4 databases searched). Studies were subdivided into those focused on psychometric properties and those characterized by a predominant applied nature. The majority of studies addressed either adult/elderly HPs or neurological/internal patients. Multi-domain screening tools for cognition, behaviour, mood/anxiety and quality of life were the most represented. Findings regarding validity, reliability, sensitivity, specificity and clinical usability were reported for cognitive screenings — the telephone- and videoconference-based Mini-Mental State Examination and the Telephone Interview for Cognitive Status.

Discussion

Positive albeit preliminary evidence regarding psychometric properties and feasibility in both clinical and non-clinical populations of Italian t-NPs brief screening tools are herewith provided. Further studies exploring clinical usability of t-NPs and psychometric properties/feasibility of tests for the in-depth assessment of specific cognitive domains are necessary.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10072-021-05719-9.

Investigating Clinician Experiences of Teleneuropsychology Service Implementation within Rural Inpatient Rehabilitation Settings: A Mixed Method Approach

OBJECTIVE

The aim of this study was to understand clinicians' experiences of teleneuropsychology service implementation within rural inpatient rehabilitation settings and the variability of those experiences across rural settings and clinical disciplines.

METHOD

Clinicians (n = 56 from four rehabilitation settings) who were involved in a hub-and-spoke teleneuropsychology service completed surveys throughout service implementation. A purposive sample of 16 clinicians then completed semi-structured interviews at the conclusion of the service implementation period. Quantitative data were analyzed descriptively and qualitative data were analyzed using thematic analysis, prior to the results being converged.

RESULTS

Four themes characterizing clinicians' experiences were identified. Pre- and early-implementation considerations included factors such as early collaboration and consultation, which were identified as important for service integration into rural settings. Facilitators/barriers included factors such as technology usability, which positively or negatively influenced service implementation. Benefits and outcomes included perceptions on the impact of the service, such as improved equity and quality of care in rural settings. Finally, future applications encapsulated what the clinicians envisaged for the future of teleneuropsychology services, such as hybrid teleneuropsychology/in-person services. Some differences were identified in clinicians' experiences across rural settings and disciplines, including preferences for technology infrastructure and satisfaction with teleneuropsychology sessions.

CONCLUSIONS

Most clinicians reported positive experiences and acceptability of the teleneuropsychology service. Facilitators and barriers, which can guide the successful establishment of future teleneuropsychology services, were identified. These findings may be used to contribute to improving equity and quality of care for people living with neuropsychological impairments, especially those living in rural areas.

Survey Findings About the Experiences, Challenges, and Practical Advice/Solutions Regarding Teleneuropsychological Assessment in Adults

OBJECTIVE

In the wake of the coronavirus pandemic, teleneuropsychology utilization has increased. There is a need to characterize the first-hand experiences of individuals using teleneuropsychology, identify the common teleneuropsychology challenges, and devise practical strategies for mitigating/resolving these challenges.

METHOD

Survey data were collected from U.S. based neuropsychologists and other individuals (e.g., graduate students and research assistants) who were engaged in remote cognitive assessment with adults (n = 87). Frequency analyses were conducted to examine: how respondents used teleneuropsychology (e.g., duration of use, types of measures and devices/technology platforms used); challenges that were encountered with different technology platforms and teleneuropsychology use; and advice for navigating these challenges.

RESULTS

Most respondents began using teleneuropsychology relatively recently in the context of the coronavirus pandemic, with home-to-home or clinic-to-home settings being the most frequently reported teleneuropsychology settings. Zoom®, Doxy.Me®, and MyChart® were the most frequently used platforms, largely due to workplace mandates and/or Health Insurance Portability and Accountability Act-compliant features. Common challenges with teleneuropsychology included internet connection issues and environmental distractions in examinees' homes, and examinees having limited-to-no access to technologies requisite for teleneuropsychology. Providing clear instructions to the examinee prior to the teleneuropsychology visit was the most common advice for ensuring a successful teleneuropsychology evaluation. Similar response patterns were generally noted for those who used TeleNP for clinical or research purposes.

CONCLUSIONS

These survey results reflect common experiences and challenges with teleneuropsychology and identify priority targets for increasing its feasibility, reliability, and validity. Findings provide context for the development of formal teleneuropsychology competencies.

The COVID-19 pandemic altered the modality, but not the frequency, of formal cognitive assessment

PURPOSE

We investigated the impacts of the COVID-19 pandemic on the modality of formal cognitive assessments (in-person versus remote assessments).

MATERIALS AND METHODS

We created a web-based survey with 34 items and collected data from 114 respondents from a range of health care professions and settings. We established the proportion of cognitive assessments which were face-to-face or via video or telephone conferencing, both pre- and post-March 2020. Further, we asked respondents about the assessment tools used and perceived barriers, challenges, and facilitators for the remote assessment of cognition. In addition, we asked questions specifically about the use of the Oxford Cognitive Screen.

RESULTS

We found that the frequency of assessing cognition was stable compared to pre-pandemic levels. Use of telephone and video conferencing cognitive assessments increased by 10% and 18% respectively. Remote assessment increased accessibility to participants and safety but made observing the subtleties of behaviour during test administration difficult. The respondents called for an increase in the availability of standardised, validated, and normed assessments.

CONCLUSIONS

We conclude that the pandemic has not been detrimental to the frequency of cognitive assessments. In addition, a shift in clinical practice to include remote cognitive assessments is clear and wider availability of validated and standardised remote assessments is necessary.IMPLICATIONS FOR REHABILITATIONWe caution the wider use and interpretation of remote formal cognitive assessments due to lack of validated, standardised, and normed assessments in a remote format.Clinicians should seek out the latest validation and normative data papers to ensure they are using the most up to date tests and respective cut offs.Support is needed for individuals who lack knowledge/have anxiety over the use of technology in formal cognitive assessments.

The development and implementation of teleneuropsychology in an academic lifespan neuropsychology center: Lessons learned from the COVID-19 pandemic

INTRODUCTION

Teleneuropsychology (TNP) became a critical means for providing care during the COVID-19 pandemic and may continue as an option for delivery of neuropsychological services. To understand how patient characteristics impact clinician decisions and service models, this study examines practice patterns within a lifespan outpatient neuropsychology center before, during and post-pandemic.

METHODS

Patient volume, demographics, and characteristics were compared across four, 3-month time intervals in 2019-2020. Two baseline intervals when the center was physically open (PO) were compared to one interval when the center was physically closed (PC) (all evaluations were conducted via direct-to-home TNP) and a fourth interval when the center was physically reopened (RO) and evaluations were conducted in one of the three modalities: in-person, virtual only or hybrid (both virtual/in-person).

RESULTS

A total of 1,459 total neuropsychological evaluations were conducted with a 64.6% reduction during PC. At RO, the number of evaluations returned to pre-COVID baseline during which in-person (72.4%) evaluations were conducted at a higher rate than hybrid (7.1%) or virtual only (20.4%). Across the lifespan, mean number of appointments to complete evaluations was significantly greater during PC (p< .001) than at other time intervals, and during RO, hybrid evaluations required significantly more appointments (p < .001) than in-person and virtual. The majority of evaluations were conducted with adult patients (71.4%). For adult patients, neurodegenerative/memory disorders received TNP evaluations at a higher rate during PC and RO. Pediatric patients were significantly older during PC (p < .001); neurodevelopmental referrals received more hybrid and virtual evaluations.

CONCLUSIONS

Results indicate that patient characteristics, especially age and referral categories, impact the feasibility of TNP. Data from the RO period suggest that in-person evaluations not surprisingly remain the mainstay; however, for adult patients, and especially older adults with neurodegenerative/memory disorders, TNP may provide an important option for delivery of neuropsychological evaluations.

Cognitive Stabilization Intervention during the Era of COVID-19

As COVID-19 halted traditional neuropsychological assessment due to infection risk, neuropsychologists considered alternative practice models. Cognitive stabilization intervention (CSI) via telehealth, was developed to stabilize cognition in advance of neuropsychological assessment. It incorporates elements of evidence-based treatments, including cognitive training, sleep training, and medication adherence training within a motivational interview framework. Two case vignettes are described. One vignette describes an elder man who received CSI to manage sleep difficulties, forgetfulness, and mood symptoms. Another vignette describes a woman who completed CSI following an autoimmune disorder episode to improve sleep, organization, and attention. The benefits and limitations of CSI are discussed.

Clinical neuropsychology in Canada: results from the 2020 AACN, NAN, SCN professional practice and "salary survey"

Objective: The current study summarizes the results of a 2020 survey that solicited information regarding backgrounds, beliefs, practices, and incomes of clinical neuropsychologists who practice in Canada. Methods: Clinical neuropsychologists who practice in Canada were invited to participate in an online survey that was available from 1/17/20 to 4/02/20. Available survey findings were obtained from 111 respondents, which reflects a response rate of 51.3% of the 216 doctoral-level Canadian neuropsychologists identified in at least one major North American or international professional organization membership list (AACN, INS, NAN, or SCN). Results: Most of the current respondents were White/Caucasian women who identified as adult providers and worked full-time in urban institutional settings. Four Canadian provinces (Alberta, British Columbia, Ontario, Quebec) accounted for more than 91% of the current respondent sample. Incomes and career satisfactions were largely encouraging, though some important variations were noted by province, work setting, and professional identity. Incomes were significantly associated with forensic practices and years of clinical experience. Most respondents made use of technician support in their practices, largely to increase productivity and patient volume. Only a small minority of respondents were board-certified and there was generally limited interest in future board certification. Conclusions: While important similarities were observed in the current Canadian sample relative to recent survey findings obtained in a U.S. sample, results also reveal a number of important differences that serve as important areas of future consideration.

How, when, and for whom: decisions regarding remote neuropsychological assessment during the 2020 COVID-19 pandemic

Neuropsychological assessment provides crucial information about cognitive, behavioral, and socioemotional functioning in medical, educational, legal, and social contexts. During the 2020 COVID-19 pandemic, the Israeli Ministry of Health initially mandated that all psychological assessments be postponed. However, as referrals to time-sensitive, high-need, and high-stakes assessments began to accumulate, it became necessary to consider remote solutions. In the current paper, we describe the considerations that affected the transition to remote activity in a prominent Israeli provider of neuropsychological assessment and rehabilitation services, referring to technological and environmental conditions, cognitive requirements, and tasks, as well as to legal, regulatory, and funding issues. After discussing how assessments should be conducted to maximize feasibility and validity while minimizing risks to clients and clinicians, we propose a preliminary model for deciding whether specific referrals warrant remote administration. The model delineates key factors in decisions regarding remote assessment, emphasizing the distinct roles of the referring clinician and the neuropsychologist who conducts the assessment, and highlighting the need for collaboration between them. The abrupt need for remote assessments during the pandemic required a quick response with little preparation. The lessons learned from this process can be applied in the future, so that the need for remote services can be met with greater certainty and uniformity.

Validity of In-Home Teleneuropsychological Testing in the Wake of COVID-19

OBJECTIVE

Teleneuropsychology (TNP) has been shown to be a valid assessment method compared with in-person neuropsychological evaluations. Interest in delivering TNP directly to patients' homes has arisen in response to the coronavirus disease 2019 (COVID-19) pandemic. However, prior research has typically involved patients tested in clinical settings, and the validity of in-home TNP testing has not yet been established. The present study aims to explore the validity and clinical utility of in-home TNP testing in a mixed clinical sample in the wake of COVID-19.

METHODS

Test profiles for 111 in-home TNP patients were retrospectively compared with 120 patients who completed in-person evaluations. The TNP test battery consisted of tests measuring attention/processing speed, verbal memory, naming, verbal fluency, and visuoconstruction. TNP scores of cognitively normal (CN) patients were compared with patients with neurocognitive disorders (NCD), and score profiles were examined among suspected diagnostic groups of Alzheimer's disease (AD), Parkinson's disease (PD), and vascular disease (VaD).

RESULTS

TNP test scores did not significantly differ from in-person testing across all tests except the Hopkins Verbal Learning Test-Revised Discrimination Index. Within the TNP group, significant differences between the CN and NCD groups were found for all tests, and the memory and semantic fluency tests yielded large effect sizes (d ≥ 0.8). Score profiles among the AD, PD, and VaD groups were explored.

CONCLUSIONS

These findings support the validity of in-home TNP testing compared with in-person neuropsychological testing. Practice considerations, limitations, and future directions are discussed.

Addressing Pediatric Mental Health Using Telehealth During Coronavirus Disease-2019 and Beyond: A Narrative Review

The pediatrician serves as a frontline provider addressing patients' medical and mental health needs, yet coronavirus disease-2019 (COVID-19) is reshaping the way physicians deliver care. Pediatricians are increasingly faced with the challenge of delivering care, including mental health care, remotely. Given the rapidly evolving literature, we performed a narrative review of the use of telehealth for mental health care for pediatric populations during the COVID-19 pandemic. Areas of focus included 1) pediatric primary care settings, 2) special pediatric populations (eg, eating disorders, autism), 3) access and engagement in telehealth care, and 4) training opportunities available for mental health providers. Themes that emerged across studies included the importance of meeting patients' needs (eg, access to technological resources) to optimize success in using telehealth tools and challenges around provider access to support tools for use during telehealth. Thus, we provided a summary of evidence-based tools (including COVID-19 specific resources) for improving the remote delivery of mental health care by pediatricians. We also reviewed future directions including trials currently underway to enhance understanding of future telehealth applications for pediatric mental health care.

Professional practices, beliefs, and incomes of U.S. neuropsychologists: The AACN, NAN, SCN 2020 practice and "salary survey"

OBJECTIVE

This portion of the 2020 survey updates practice information, beliefs, and income data of clinical neuropsychologists who practice within the United States. Methods: Doctoral-level neuropsychology practitioners were invited via numerous methods, with multiple reminders, to participate in a web-based survey from January 17 through April 2, 2020. The useable U.S. sample of 1677 doctoral-level practitioners was 6.2% larger than the comparable group in the prior 2015 practice survey. Results: Whereas women practitioners predominate, which continues a steeply increasing trend across time, increases in overall ethnic/racial diversity continue at a slow pace. Median age has remained very similar over the last 30 years, reflecting a continuous influx of young practitioners. A relatively small minority of neuropsychologists work part time. The proportion of board-certified neuropsychologists continues to show meaningful increase; interest in subspecialization certification is relatively high. Reliance on technicians remains popular, especially for neuropsychologists who work in institutions or are board certified. Although implementation of new CPT codes in 2019 and related payor policies appear to have had more negative than positive effects, psychology-related annual incomes of neuropsychologists have again increased compared to prior surveys. Variables such as specific work setting, state, region, years in practice, forensic practice hours, board certification, and basis for determining income (e.g. hours billed, revenue collected, relative value units) have an impact on income. More than half of practitioners engage in forensic neuropsychology, with the number of related practice hours per week again increasing. There is very high agreement regarding the use of response validity measures in clinical practice and forensic practice. Neurologists remain the number one referral source whether working in an institution, private practice, or a combination of both, and regardless of maintaining a pediatric, adult, or lifespan practice. Career satisfaction ratings for income, job, and work-life balance remain high, with the majority of ratings regarding the future of the specialty in the positive range. Additional data summaries related to a wide range of professional and practice topics are provided. Conclusions: Updating and comparing survey information at five-year intervals continues to provide insights and perspectives regarding relative stabilities and changes in practice activities, beliefs, and incomes of U.S. clinical neuropsychologists. Such information also provides guidance regarding the future of the specialty.

Neuropsychologists' practice adjustments: The impact of COVID-19

Objective: The field of neuropsychology's response to the COVID-19 pandemic was characterized by a rapid change in clinical practice secondary to physical distancing policies and orders. The current study aimed to further characterize the change in neuropsychologists' professional practice, specifically related to teleneuropsychology (TNP) service provision, and also provide novel data regarding the impact of the pandemic on providers' emotional health. Method: This study surveyed 142 neuropsychologists between 3/30/2020 and 4/10/2020, who worked within a variety of settings (e.g., academic medical centers, general hospitals, Veterans Affairs medical centers, rehabilitation hospitals) across all four U.S. geographic regions. Mixed-model analyses of variance (ANOVAs) were conducted to assess for differences in neuropsychological practice (i.e., total number of patients and proportion of TNP seen per week) across time points (i.e., late February and early April) by practice setting and region. Descriptive statistics were conducted to describe respondents' perceptions of TNP, emotional responses to the pandemic, and perceptions of institutional/employers'/practices' responses. Results: Nearly all respondents (∼98%) reported making practice alterations, with ∼73% providing at least some TNP. Neuropsychologists across all settings and regions reported performing a higher proportion of TNP evaluations by April 2020. On average, respondents reported a medium amount of distress/anxiety related to COVID-19, which had a "somewhat small impact" on their ability to practice overall. Conclusions: The current study further elucidated neuropsychologists' provision of TNP services and offered initial data related to their emotional response to the pandemic. Future research is needed to examine the viability and sustainability of TNP practice.