"You can't touch this": Delivery of inpatient neuropsychological assessment in the era of COVID-19 and beyond

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

A validation study for wide-range remote assessment of cognitive functions in the healthy older Japanese population: a pilot randomised crossover trial

BACKGROUND

The assessment of a wide range of cognitive functions using video teleconference (VTC) systems cannot be applied in practice yet. We aimed to determine the feasibility and reliability of previously unvalidated remote cognitive function tests in Japan using common information and communication technology (ICT) devices, software, and VTC systems compared with face-to-face (FTF) assessment.

METHODS

The sample consisted of 26 participants from senior citizens clubs and an employment service centre in Sapporo Japan, including 11 females and 15 males (age averaged 78.6 ± 6.8 years). Tests included the RCPM, Story recall, 10/36 spatial recall, selective reminding test, SDMT, PASAT, FAB, TMT-A, TMT-B, visual cancellation task, digit span, tapping span. The experimental design was a counterbalanced crossover randomised controlled trial. Intraclass correlations (ICCs), paired-samples t-tests, Cohen's Kappa (κ) coefficients, and Wilcoxon signed-rank test were calculated to compare the scores between VTC and FTF assessments.

RESULTS

All ICCs were significant and ranged from 0.47 (RCPM time) to 0.92 (RCPM score and PASAT), with a mean ICC of 0.75. Digit span using Cohen's Kappa (κ) coefficient was significant, but the tapping span was not. Paired samples t-test showed statistically significant differences in SDMT, RCPM time, and cancellation time.

CONCLUSIONS

The results suggest that remote video conference-based neuropsychological tests even using familiar devices and software may be able to assess a wide range of cognitive functions in the Japanese older population. As for the processing speed tasks, we need to create our own standards for the remote condition. For the tapping span, we should consider increasing the number of trials.

Teleneuropsychology during the COVID-19 pandemic in Mexico: the perspective from a middle-income country

INTRODUCTION

The use of teleneuropsychology (TeleNP) increased as a result of the COVID-19 pandemic; however, there have been no studies of the benefits and difficulties with this modality in middle-income countries. This study aimed to assess the current use of TeleNP in Mexico.

METHOD

Mexican neuropsychologists were invited to participate in an online survey regarding the use of TeleNP during the COVID-19 pandemic. The survey was based on issues from a literature review and consisted of 36 questions requiring yes/no, multiple choice, or ordinal answers. The survey was created using Google Forms and asked respondents to provide informed consent. A total of 107 clinical neuropsychologists completed the survey.

RESULTS

82% of participants currently use TeleNP, and most reported learning about TeleNP through personal experience, literature research, and colleagues. Brief evaluations, delivery of results, and intervention were the principal services provided, most frequently on a home-to-home basis. Almost 30% of clinicians reported not requiring informed consent for use of the modality. Consultations included children, adolescents, and adults in similar numbers; older adults were less frequent. Technological limitations were the most frequent reason for ruling out the modality with particular patients. Perceived benefits included the ability to continue consultations despite social distancing measures, lesser risk of COVID-19 infection, and the possibility of seeing patients with limited access to neuropsychological services. Reasons for not using TeleNP included a lack of standardized instruments, not feeling comfortable with the modality, and lack of technological resources and skills.

CONCLUSIONS

Despite the socioeconomic differences between Mexico and high-income countries, most of our findings were similar to reports from those countries. However, technological limitations were common, and smartphones were commonly used, contrary to recommendations in the literature. The future use of TeleNP in Mexico should include formal training and ethical guidelines.

Validation of an Automated Speech Analysis of Cognitive Tasks within a Semiautomated Phone Assessment

Introduction

We studied the accuracy of the automatic speech recognition (ASR) software by comparing ASR scores with manual scores from a verbal learning test (VLT) and a semantic verbal fluency (SVF) task in a semiautomated phone assessment in a memory clinic population. Furthermore, we examined the differentiating value of these tests between participants with subjective cognitive decline (SCD) and mild cognitive impairment (MCI). We also investigated whether the automatically calculated speech and linguistic features had an additional value compared to the commonly used total scores in a semiautomated phone assessment.

Methods

We included 94 participants from the memory clinic of the Maastricht University Medical Center+ (SCD N = 56 and MCI N = 38). The test leader guided the participant through a semiautomated phone assessment. The VLT and SVF were audio recorded and processed via a mobile application. The recall count and speech and linguistic features were automatically extracted. The diagnostic groups were classified by training machine learning classifiers to differentiate SCD and MCI participants.

Results

The intraclass correlation for inter-rater reliability between the manual and the ASR total word count was 0.89 (95% CI 0.09-0.97) for the VLT immediate recall, 0.94 (95% CI 0.68-0.98) for the VLT delayed recall, and 0.93 (95% CI 0.56-0.97) for the SVF. The full model including the total word count and speech and linguistic features had an area under the curve of 0.81 and 0.77 for the VLT immediate and delayed recall, respectively, and 0.61 for the SVF.

Conclusion

There was a high agreement between the ASR and manual scores, keeping the broad confidence intervals in mind. The phone-based VLT was able to differentiate between SCD and MCI and can have opportunities for clinical trial screening.

A Systematic Review and a Latin American Clinical Model for Teleneuropsychological Assessment

OBJECTIVE

The objective of this study is to propose a TeleNP model for remote assessment and offer practical recommendations for clinical practice with patients in Mexico and Latin America, based on a systematic literature review and clinical experience.

METHOD

A systematic review of studies from 2011 to 2021 in English and Spanish used TeleNP, teleneuropsychology, telepsychology, online, assessment, teleneuropsicología, and evaluación for the search; the databases examined included PubMed, BiDi UNAM, ScienceDirect, Google Scholar, and Wiley One Library; the Oxford Centre for Evidence-Based Medicine system was used to grade the levels of evidence. The experience of the last two years of students and faculty in the Master's and Doctoral Programs in Psychology, Clinical Neuropsychology Residency Program, was also used as a basis for this guide.

RESULTS

We propose a clinical model for TeleNP assessment in Mexico and Latin America based on the review of 31 articles and the practice of professors and students of clinical neuropsychology.

CONCLUSION

The proposed model describes a procedure and adaptations for home-to-home clinical practice in the neuropsychological assessment of Mexican patients that could also be used in other Latin American countries. Its reliability remains to be assessed, but this model and the suggestions proposed could be used in future studies and clinical trials for Mexican and Latin American populations.

The Italian telephone-based Verbal Fluency Battery (t-VFB): standardization and preliminary clinical usability evidence

Background

This study aimed at standardizing and providing preliminary evidence on the clinical usability of the Italian telephone-based Verbal Fluency Battery (t-VFB), which includes phonemic (t-PVF), semantic (t-SVF) and alternate (t-AVF) verbal fluency tasks.

Methods

Three-hundred and thirty-five Italian healthy participants (HPs; 140 males; age range = 18-96 years; education range = 4-23 years) and 27 individuals with neurodegenerative or cerebrovascular diseases were administered the t-VFB. Switch number and cluster size were computed via latent semantic analyses. HPs underwent the telephone-based Mental State Examination (MMSE) and Backward Digit Span (BDS). Construct validity, factorial structure, internal consistency, test-retest and inter-rater reliability and equivalence with the in-person Verbal Fluency tasks were assessed. Norms were derived via Equivalent Scores. Diagnostic accuracy against clinical populations was assessed.

Results

The majority of t-VFB scores correlated among each other and with the BDS, but not with the MMSE. Switch number correlated with t-PVF, t-SVF, t-AVF scores, whilst cluster size with the t-SVF and t-AVF scores only. The t-VFB was underpinned by a mono-component structure and was internally consistent (Cronbach's α = 0.91). Test-retest (ICC = 0.69-0.95) and inter-rater reliability (ICC = 0.98-1) were optimal. Each t-VFB test was statistically equivalent to its in-person version (equivalence bounds yielding a p < 0.05). Education predicted all t-VFB scores, whereas age t-SVF and t-AVF scores and sex only some t-SVF scores. Diagnostic accuracy against clinical samples was optimal (AUC = 0.81-0.86).

Discussion

The t-VFB is a valid, reliable and normed telephone-based assessment tool for language and executive functioning, equivalent to the in-person version; results show promising evidence of its diagnostic accuracy in neurological populations.

The Wisconsin Card Sorting Test: Split-Half Reliability Estimates for a Self-Administered Computerized Variant

Self-administered computerized assessment has the potential to increase the reach of neuropsychological assessment. The present study reports the first split-half reliability estimates for a self-administered computerized variant of the Wisconsin Card Sorting Test (WCST), which is considered as a gold standard for the neuropsychological assessment of executive functions. We analyzed data from a large sample of young volunteers (N = 375). Split-half reliability estimates for perseveration errors, set-loss errors, and inference errors were all above 0.90. Split-half reliability estimates for response time measures on switch and repeat trials exceeded 0.95. Our results indicated sufficient split-half reliability for a self-administered computerized WCST, paving the way for an advanced digital assessment of executive functions. We discuss potential effects of test formats, administration variants, and sample characteristics on split-half reliability.