Video Teleconference Administration of the Repeatable Battery for the Assessment of Neuropsychological Status

Development of a self-administered online battery for remote assessment of executive functions and verbal memory: equivalence with face-to-face administration, preliminary norms, and acceptance

OBJECTIVES

Interest in teleneuropsychology services increased considerably after the COVID-19 pandemic. However, the utility of unsupervised administration of computerized tests remains largely unexplored. In the present study, we developed a brief computerized battery that assesses self-reported cognitive abilities and performances on executive functioning and verbal memory. We investigated the equivalence of the self-administration online (SAO) procedure and the face-to-face (FTF) administration. Preliminary normative data were developed and the acceptance of the SAO procedure was explored.

METHODS

A community sample of 169 Greek adults [94 women; mean age: 41.95 (SD = 13.40) years, mean years of education: 15.10 (SD = 2.65)] completed the SAO assessment. A subgroup of 40 participants was tested in a counterbalanced way both with SAO and FTF. Participants' performances were compared with paired sample t-tests and the agreement between the two methods was estimated with intraclass correlation coefficients (ICCs). Multiple linear regression analyses were applied to investigate the effect of demographic characteristics on SAO measures.

RESULTS

No difference between SAO and FTF scores was observed. ICCs indicated moderate to good agreement (.418-.848) for most measures. Age was positively associated with self-reported cognitive state and negatively with neuropsychological performances and the level of acceptance of the SAO procedure. Approximately 80% of participants reported satisfaction from the SAO assessment, 69% good compliance with the instructions, but less than 30% belief that the FTF assessment could be adequately replaced.

CONCLUSION

SAO testing is feasible and well accepted among Greek adults yielding equivalent results with FTF testing. Despite the wide satisfaction, though, notable reluctance was noted for the substitution of FTF with SAO procedures.

Telehealth practice in aphasia: A survey of UK speech and language therapists, with a focus on assessment

BACKGROUND AND OBJECTIVES

Evidence suggests telehealth in speech and language therapy can enhance access to care, cost-effectiveness and satisfaction. However, little is known about use of telehealth in the United Kingdom. Moreover, many assessments/outcome measures for aphasia have been tested for face-to-face administration only, posing challenges to reliable use within the telehealth context. We explored the experiences and views of speech and language therapists (SLTs) working with people with aphasia on using telehealth to conduct assessments/outcome measures, perceived barriers and facilitators in telehealth, and their priorities for research in telehealth aphasia assessment.

METHOD

We explored views of UK SLTs through an online cross-sectional survey (2021) delivered through the Qualtrics platform. The survey covered three main areas: (i) participant demographics; (ii) experience of using telehealth and doing telehealth assessments with people with aphasia post-stroke during the COVID-19 pandemic; and (iii) plans for telehealth post-pandemic. Response formats included yes/no, multiple choice, 5-point Likert scales and open-ended text responses. The survey was expected to take no more than 10 min to complete. Survey data were analysed through descriptive statistics and content analysis of open-ended questions.

RESULTS

One hundred twenty-four SLTs responded to the survey. The majority (>80%) used telehealth during the COVID-19 pandemic and >90% planned to continue to use telehealth in the future. The most used platforms were Zoom, Microsoft Teams and Attend Anywhere. Access to internet and telehealth platforms, and practical problems (e.g., difficulties sharing resources online, limited functionality of telehealth platforms for assessment) were common barriers. Therapists highlighted that training, resources and materials that assist the administration of assessments were important. Most participants responded that there was a need for existing measures to be tested for administration via telehealth (n = 68, 70.8%). Participants overall felt there was a need for online interactive assessments, more online resources that have been trialled for use via telehealth, accessible formats for resources for people with aphasia and clear instructions for how people with aphasia can access resources.

CONCLUSIONS

This study provides new insights into the current use of telehealth assessment with people with aphasia in the United Kingdom and directions for future research. Barriers and facilitators identified can support the implementation of telehealth assessment in SLT services.

WHAT THIS PAPER ADDS

What is already known on the subject The use of telehealth in speech and language therapy has advantages in terms of access to care, cost-effectiveness and satisfaction with care. However, little is known about the use of telehealth in aphasia rehabilitation in the United Kingdom, especially in the area of assessment and outcome measurement. What this paper adds to existing knowledge This study identified that the majority (>80%) of aphasia therapists used telehealth during the COVID-19 pandemic and >90% planned to continue to use telehealth in the future. A need was identified for existing measures to be tested for administration via telehealth and for training, resources (e.g., online interactive assessments) and materials (e.g., accessible formats for people with aphasia). What are the potential or actual clinical implications of this work? To facilitate the successful implementation of telehealth assessment, there is a need for measures validated for use via telehealth and more online resources that have been trialled for use via telehealth.

Chronotype, Time of Day, and Children's Cognitive Performance in Remote Neuropsychological Assessment

Research on the influence of chronotype and time of day (TOD) on cognitive performance, especially in children, is limited. We explored potential interactive effects, hypothesizing that performance differs when comparing preferred vs. non-preferred TOD. In total, 76 morning-type (MT = 37) or evening-type (ET = 39) children from the third and fourth grades (48.7% girls; M age = 8.05; SD age = 0.51), identified through the Children Chronotype Questionnaire, completed two 30-min neuropsychological assessment sessions via videoconference on the first (9:00) or last hour (16:00) of the school day. The protocol included neuropsychological tests targeting memory, language, and attention/executive domains. The results revealed an interactive effect of medium size between chronotype and TOD on a Rapid Alternating Stimulus (Naming) Task. MT and ET performed faster in asynchrony conditions (morning for ET; afternoon for MT). Additionally, ET outperformed MT in a Backward Digit Span Task, irrespective of TOD. TOD also influenced performance on an Alternating Verbal Fluency Task, with both MT and ET children performing better in the morning. These results underscore the importance of chronotype and TOD in children's cognitive performance, particularly in working memory and verbal fluency. Children assessed during non-preferred TOD exhibited better performance on some cognitive tasks, challenging the assumption that optimal times always yield superior results.

Telehealth administration of narrative and procedural discourse: A UK and US comparison of traumatic brain injury and matched controls

BACKGROUND

Impaired discourse production is commonly reported for individuals with traumatic brain injury (TBI). Discourse deficits can negatively impact community integration, return to employment and quality of life. COVID-19 restrictions have reduced in-person assessment services for people with communication impairments. Advances in telehealth may help speech and language therapists (SLTs) to assess monologic discourse more systematically and improve access to services for patients who may find it difficult to attend in-person.

AIMS

To examine the feasibility of telehealth administration of narrative and procedural discourse tasks with individuals with TBI and matched controls.

METHODS & PROCEDURES

A total of 20 individuals with TBI and 20 healthy controls, aged 18-55 years, were directly recruited from the UK and indirectly recruited from the US. For participants with TBI, time post-injury was at least 3 months with no diagnosis of aphasia. Control participants were matched for sex and as closely as possible for age. Feasibility of measures was based upon the time to administer both narrative tasks, the report of any technological problems, and participant feed. Discourse samples were transcribed verbatim and analysed using story grammar analysis (for narrative discourse) and identification of propositions (for procedural discourse). Interrater reliability was calculated using percentage agreement for 50% of the data. Non-parametric analyses were used to analyse the performance of the two groups.

OUTCOMES & RESULTS

Narrative and procedural discourse samples were collected via telehealth in approximately 10 min with no reported technical difficulties or complaints from any participants. For narrative discourse performance, there were significant differences for the TBI and control groups for measures of complete episodes (p < 0.001) and missing episodes (p = 0.005). No significant group differences were noted for any of the procedural discourse measures.

CONCLUSIONS & IMPLICATIONS

Results support the feasibility of collecting discourse samples via telehealth. Although the participants' discourse performance distinguished the TBI and control groups on the narrative task, no differences between the groups were noted for the procedural task. The narrative discourse task may have been more difficult than the procedural task, or video cue support reduced the cognitive load of the procedural task. This finding suggests the use of more complex procedural tasks without video cue support may be needed.

WHAT THIS PAPER ADDS

What is already known on this subject Although little research has explored the feasibility of administering discourse assessments for individuals with TBI via telehealth, some studies have found that discourse interventions can be feasibly administered via telehealth. It is also well established that individuals with TBI struggle with the supra-structural and macro-linguistic elements of discourse production. Both procedural and narrative discourse tasks have been found to differentiate individuals with TBI from healthy controls. What this paper adds to existing knowledge Few studies have investigated the feasibility of, and procedures for, administering discourse tasks via telehealth. Additionally, the inclusion of multiple types of discourse tasks to parse cognitive-communication abilities is lacking in the current literature. Findings from this study support that narrative and procedural discourse can be feasibly sampled via telehealth and that international collaboration for research on this topic can facilitate such studies. Individuals with TBI performed more poorly on three measures of narrative discourse. No differences between groups were identified for the procedural task. What are the potential or actual clinical implications of this work? Telehealth assessment for discourse provides flexibility for both the individual with TBI and the speech-language therapist and does not compromise the quality of data collected. The administration of discourse tasks and collection of data was not time-consuming and was well accepted by the study participants. Additionally, international research collaboration not only expands potential participation in research but increases the opportunity to recruit and study more diverse groups.

Virtual INSIGHT: Improving natural social interaction: Group reHabilitation after traumatic brain injury

BACKGROUND

There is a growing body of literature that indicates positive outcomes of group treatment approaches to intervention for communication difficulties in chronic traumatic brain injury (TBI). The published research to date examines face-to-face group intervention.

AIM

This study draws on one of these approaches, 'Improving Natural Social Interaction: Group reHabilitation after Traumatic brain injury' (INSIGHT), and examines the adaptation of this program to a virtual setting. The principles underlying the program, which involved providing an authentic contextualised and natural environment for group interactions and enhancing opportunities for identity expression, were maintained.

METHODS & PROCEDURES

Six participants with mild to severe TBI and cognitive communication difficulties participated in an 8-week pilot program of the virtual INSIGHT program. Goal Attainment Scaling (GAS) scores completed over the course of the intervention served as the primary outcome measure. Secondary outcomes measures included The Repeatable Battery for the Assessment of Neuropsychological Status Update, The Awareness of Social Inference Test-Revised, the La Trobe Communication Questionnaire and the Satisfaction with Life Scale.

OUTCOMES & RESULTS

A mixed multilevel analysis revealed significant improvement in GAS scores. A Wilcoxon signed rank test revealed no significant changes in secondary measures.

CONCLUSIONS & IMPLICATIONS

There is a growing potential for this group treatment approach, in an online medium, and progress towards individualised goals was clear. The data have implications for examining the assessment measures typically used to document functional outcomes in clinical intervention. Future directions indicate a need to pursue more ecologically valid assessment methods.

WHAT THIS PAPER ADDS

What is already known on the subject Recent literature has focused on the benefits of group intervention for cognitive communication diffuclties after traumatic brain injury (TBI). However, research to date examines only face-to-face group rehabilitation. As there has been a demand for a shift in the way we communicate worldwide, we must make adaptations to current intervention procedures to continue to serve individuals with diverse communication needs. What this paper adds to existing knowledge This study contributes new information about the feasibility of a virtual communication skills group for individuals with TBI. This virtual INSIGHT (Improving Natural Social Interaction: Group ehabilitation after Traumatic brain injury) group intervention facilitates progress towards collaboratively set communication goals and the online setting has the potential to increase the accessibility of these services. What are the potential or actual clinical implications of this work? Progress towards cognitive and social communication goals can be facilitated by an online group intervention. However, this progress was not correlated with scores on standard assessments of cognitive communication, social communication and quality of life. This has implications for the evaluation of the assessments typically used and their ecological validity and applicability to the communication context.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Factors perpetuating functional cognitive symptoms after mild traumatic brain injury

INTRODUCTION

Self-reported memory difficulties (forgetting familiar names, misplacing objects) often persist long after a mild traumatic brain injury (mTBI), despite normal neuropsychological test performance. This clinical presentation may be a manifestation of a functional cognitive disorder (FCD). Several mechanisms underlying FCD have been proposed, including metacognitive impairment, memory perfectionism, and misdirected attention, as well as depression or anxiety-related explanations. This study aims to explore these candidate perpetuating factors in mTBI, to advance our understanding of why memory symptoms frequently persist following mTBI.

METHODS

A cross-sectional study of 67 adults (n = 39 with mTBI mean = 25 months ago and n = 28 healthy controls). Participants completed standardized questionnaires (including the Functional Memory Disorder Inventory), a metacognitive task (to quantify discrepancies between their trial-by-trial accuracy and confidence), and a brief neuropsychological test battery. We assessed candidate mechanisms in two ways: (1) between-groups, comparing participants with mTBI to healthy controls, and (2) within-group, examining their associations with functional memory symptom severity (FMDI) in the mTBI group.

RESULTS

Participants with mTBI performed similarly to controls on objective measures of memory ability but reported experiencing much more frequent memory lapses in daily life. Contrary to expectations, metacognitive efficiency did not differentiate the mTBI and control groups and was not associated with functional memory symptoms. Memory perfectionism was strongly associated with greater functional memory symptoms among participants with mTBI but did not differ between groups when accounting for age. Depression and checking behaviors produced consistent results across between-groups and within-group analyses: these factors were greater in the mTBI group compared to the control group and were associated with greater functional memory symptoms within the mTBI group.

CONCLUSIONS

This study highlights promising (e.g., depression, checking behaviors) and unlikely (e.g., metacognitive impairment) mechanisms underlying functional memory symptoms after mTBI, to guide future research and treatment.

A review of the reliability of remote neuropsychological assessment

The provision of clinical neuropsychological services has predominately been undertaken by way of standardized administration in a face-to-face setting. Interpretation of psychometric findings in this context is dependent on the use of normative comparison. When the standardization in which such psychometric measures are employed deviates from how they were employed in the context of the development of its associated norms, one is left to question the reliability and hence, validity of any such findings and in turn, diagnostic decision making. In light of the current COVID-19 pandemic and resultant social distancing direction, face-to-face neuropsychological assessment has been challenging to undertake. As such, remote (i.e., virtual) neuropsychological assessment has become an obvious solution. Here, and before the results from remote neuropsychological assessment can be said to stand on firm scientific grounds, it is paramount to ensure that results garnered remotely are reliable and valid. To this end, we undertook a review of the literature and present an overview of the landscape. To date, the literature shows evidence for the reliability of remote administration and the clinical implications are paramount. When and where needed, neuropsychologists, psychometric technicians and examinees may no longer need to be in the same physical space to undergo an assessment. These findings are most relevant given the physical distancing practices because of COVID-19. And whilst remote assessment should never supplant face-to-face neuropsychological assessments, it does serve as a valid alternative when necessary.

A validation study for wide-range remote assessment of cognitive functions in the healthy older Japanese population: a pilot randomised crossover trial

BACKGROUND

The assessment of a wide range of cognitive functions using video teleconference (VTC) systems cannot be applied in practice yet. We aimed to determine the feasibility and reliability of previously unvalidated remote cognitive function tests in Japan using common information and communication technology (ICT) devices, software, and VTC systems compared with face-to-face (FTF) assessment.

METHODS

The sample consisted of 26 participants from senior citizens clubs and an employment service centre in Sapporo Japan, including 11 females and 15 males (age averaged 78.6 ± 6.8 years). Tests included the RCPM, Story recall, 10/36 spatial recall, selective reminding test, SDMT, PASAT, FAB, TMT-A, TMT-B, visual cancellation task, digit span, tapping span. The experimental design was a counterbalanced crossover randomised controlled trial. Intraclass correlations (ICCs), paired-samples t-tests, Cohen's Kappa (κ) coefficients, and Wilcoxon signed-rank test were calculated to compare the scores between VTC and FTF assessments.

RESULTS

All ICCs were significant and ranged from 0.47 (RCPM time) to 0.92 (RCPM score and PASAT), with a mean ICC of 0.75. Digit span using Cohen's Kappa (κ) coefficient was significant, but the tapping span was not. Paired samples t-test showed statistically significant differences in SDMT, RCPM time, and cancellation time.

CONCLUSIONS

The results suggest that remote video conference-based neuropsychological tests even using familiar devices and software may be able to assess a wide range of cognitive functions in the Japanese older population. As for the processing speed tasks, we need to create our own standards for the remote condition. For the tapping span, we should consider increasing the number of trials.

Developing a Digital Health Intervention for Conversation Skills After Brain Injury (convers-ABI-lity) Using a Collaborative Approach: Mixed Methods Study

BACKGROUND

People with acquired brain injury (ABI) experience communication breakdown in everyday interactions many years after injury, negatively impacting social and vocational relationships. Communication partner training (CPT) is a recommended intervention approach in communication rehabilitation after ABI. Access to long-term services is essential, both in rural and remote locations. Digital health has potential to overcome the challenges of travel and improve cost efficiencies, processes, and clinical outcomes.

OBJECTIVE

We aimed to collaboratively develop a novel, multimodal web-based CPT intervention (convers-ABI-lity) with key stakeholders and evaluate its feasibility for improving conversation skills after brain injury.

METHODS

This mixed methods study consisted of 3 key stages guided by the Integrate, Design, Assess, and Share (IDEAS) framework for developing effective digital health interventions. Stage 1 included the integration of current end-user needs and perspectives with key treatment and theoretical components of existing evidence-based interventions, TBI Express and TBIconneCT. Stage 2 included the iterative design of convers-ABI-lity with feedback from end-user interviews (n=22) analyzed using content analysis. Participants were individuals with ABI, family members, health professionals, and paid support workers. Stage 3 included the evaluation of the feasibility through a proof-of-concept study (n=3). A total of 3 dyads (a person with ABI and their communication partner [CP]) completed 7 weeks of convers-ABI-lity, guided by a clinician. The outcome measures included blinded ratings of conversation samples and self-report measures. We analyzed postintervention participant interviews using content analysis to inform further intervention refinement and development.

RESULTS

Collaborative and iterative design and development during stages 1 and 2 resulted in the development of convers-ABI-lity. Results in stage 3 indicated positive changes in the blinded ratings of conversation samples for the participants with traumatic brain injury and their CPs. Statistically reliable positive changes were also observed in the self-report measures of social communication skills and quality of life. Intervention participants endorsed aspects of convers-ABI-lity, such as its complementary nature, self-guided web-based modules, clinician sessions, engaging content, and novel features. They reported the intervention to be relevant to their personal experience with cognitive-communication disorders.

CONCLUSIONS

This study presents the outcome of using the IDEAS framework to guide the development of a web-based multimodal CPT intervention with input from key stakeholders. The results indicate promising outcomes for improving the conversation skills of people with ABI and their CPs. Further evaluation of intervention effectiveness and efficacy using a larger sample size is required.

Effect of inhaled anaesthetics on cognitive and psychiatric outcomes in critically ill adults: a systematic review and meta-analysis

BACKGROUND

Sedation of critically ill patients with inhaled anaesthetics may reduce lung inflammation, time to extubation, and ICU length of stay compared with intravenous (i.v.) sedatives. However, the impact of inhaled anaesthetics on cognitive and psychiatric outcomes in this population is unclear. In this systematic review, we aimed to summarise the effect of inhaled anaesthetics on cognitive and psychiatric outcomes in critically ill adults.

METHODS

We searched MEDLINE, EMBASE, and PsycINFO for case series, retrospective, and prospective studies in critically ill adults sedated with inhaled anaesthetics. Outcomes included delirium, psychomotor and neurological recovery, long-term cognitive dysfunction, ICU memories, anxiety, depression, post-traumatic stress disorder (PTSD), and instruments used for assessment.

RESULTS

Thirteen studies were included in distinct populations of post-cardiac arrest survivors (n=4), postoperative noncardiac patients (n=3), postoperative cardiac patients (n=2), and mixed medical-surgical patients (n=4). Eight studies reported delirium incidence, two neurological recovery, and two ICU memories. One study reported on psychomotor recovery, long-term cognitive dysfunction, anxiety, depression, and PTSD. A meta-analysis of five trials found no difference in delirium incidence between inhaled and i.v. sedatives (relative risk 0.95 [95% confidence interval: 0.59-1.54]). Compared with i.v. sedatives, inhaled anaesthetics were associated with fewer hallucinations and faster psychomotor recovery but no differences in other outcomes. There was heterogeneity in the instruments used and timing of these assessments.

CONCLUSIONS

Based on the limited evidence available, there is no difference in cognitive and psychiatric outcomes between adults exposed to volatile sedation or intravenous sedation in the ICU. Future studies should incorporate outcome assessment with validated tools during and after hospital stay.

SYSTEMATIC REVIEW PROTOCOL

PROSPERO CRD42021236455.

Recommendations for the Use of Telepsychology in Psychology-Law Practice and Research: A Statement by American Psychology-Law Society (APA Division 41)

In response to the COVID-19 pandemic and subsequent impact on psychological work, Division 41 of the American Psychological Association convened a taskforce to provide guidance to its membership regarding the use of technology for practice and research at the intersection of psychology and law. Drawing from existing research in psychology-law and beyond, as well as the first-hand experience of taskforce members, this document outlines foundational guidance to apply technology to forensic and correctional work while acknowledging these settings provide unique challenges to ethical practice. The recommendations provide support for psychologists involved in assessment, treatment, training, and research. However, these recommendations may not exhaustively apply to all areas of psycholegal practice or all forms of technology. Further, these recommendations are intended to be consulted in conjunction with other professional practice guidelines, emerging research, and policy changes that impact the integration of technologies into this work.

Video Teleconference Administration of the Addenbrooke's Cognitive Examination-III for the Assessment of Neuropsychological Status: An Experience in Indian Subjects with Cognitive Dysfunction

Objective

To determine the feasibility, reliability, and acceptability of video teleconference (VTC)-based neuropsychological assessment using Addenbrooke's cognitive examination-III (ACE-III).

Methods

This study was performed from January 2022 to April 2022, during the third wave of the COVID-19 pandemic in India. We administered ACE-III using video-teleconferencing and compared the scores to face-to-face (FTF) testing for the eligible participants. We also conducted a participant's satisfaction survey of VTC-administered ACE-III compared to FTF-administered ACE-III, using a 7-point Likert scale.

Results

We screened 37 participants and 24 (64.9%) successfully underwent ACE-III testing through VTC. We included 20 patients (mean age: 62.7 ± 10 years, mean education: 12.0 ± 4.6 years, 85% men) for final analysis, (who completed both VTC and FTF-administered ACE-III). Nine patients had major neurocognitive disorder (dementia), eight had mild neurocognitive disorder (MCI), and three had subjective cognitive decline (SCD). The two tests were administered at a median gap of 36 (18,74.5) days. The Intraclass correlation coefficients (ICC) of ACE-3 total scores (0.97) and the subdomain scores was high (>0.8). There was "very low" to "no" bias on the Bland-Altman plots, across all domains. The mean overall satisfaction score was 4.1, indicating that VTC is "as good as" FTF.

Conclusions

Results support the feasibility and acceptability of remote administration of ACE-III via VTC. There is a good agreement between the ACE-III scores across VTC and in-person conditions.

Remote Assessment: Origins, Benefits, and Concerns

Although guidelines surrounding COVID-19 have relaxed and school-aged students are no longer required to wear masks and social distance in schools, we have become, as a nation and as a society, more comfortable working from home, learning online, and using technology as a platform to communicate ubiquitously across ecological environments. In the school psychology community, we have also become more familiar with assessing students virtually, but at what cost? While there is research suggesting score equivalency between virtual and in-person assessment, score equivalency alone is not sufficient to validate a measure or an adaptation thereof. Furthermore, the majority of psychological measures on the market are normed for in-person administration. In this paper, we will not only review the pitfalls of reliability and validity but will also unpack the ethics of remote assessment as an equitable practice.

Attitudes of Mental Health Professionals towards Telepsychology during the Pandemic: A Pilot Study

OBJECTIVE

This pilot study investigated mental health professionals' attitudes towards remote psychological consultations and internet-based interventions.

METHODS

An online survey in Italian and English was administered to a sample of 191 psychologists and psychotherapists to collect detailed information about their professional experience providing online psychological interventions a year and a half after the beginning of the SARS-CoV-2 pandemic.

RESULTS

The results did not reveal a statistically significant association between the participants' theoretical approaches and the number of patients treated via the online modality. Overall, most of the participants found advantages to the online setting but also noted critical issues regarding privacy and the ease of integrating new technology into their clinical practice.

CONCLUSIONS

According to the participants, despite the challenges that must be addressed, telehealth is a viable psychological therapeutic option that is destined to grow in importance in the near future.

Remote neuropsychological assessment: Acceptability and feasibility of direct-to-home teleneuropsychology methodology during the COVID-19 pandemic

OBJECTIVE

To determine the acceptability and feasibility of telephone and video-conference calls to complete cognitive assessments during the COVID-19 pandemic.

METHOD

In rapid response to the pandemic, evidence-based adaptations were made to routine face-to-face (FTF) practice, delivering teleneuropsychology (TNP) within a National Health Service (NHS) Scotland neuropsychology service. Caldicott guardian approval was obtained to complete a six month study (April to October 2020) from the early stages of the first United Kingdom (UK) lockdown. Assessments were completed with patients in their own homes (direct-to-home) via remote connections. Neuropsychology clinicians, service-users and referring agents were approached for structured feedback and qualitative comment.

RESULTS

Data was captured for 212 referrals assessed by seven clinical psychologists; with responses from 70 (33%) service-users and 14 (58%) referring agents. 94% of referrals were assessed remotely and discharged. TNP reduced defaulted appointment discharge rates. Gender, socioeconomic deprivation and age did not affect access to information technology (IT) equipment.Clinicians agreed that remote assessment allowed them to complete initial interview (96%) and formulate (77%) cases appropriately. Service-users agreed they were comfortable with equipment (84%), the process was straightforward (74%), and would recommend TNP to others (68%). Referring agents were satisfied with the service provided (100%). Limitations included evidence-based remote test availability, technical issues and home distractions.

CONCLUSIONS

Study findings evidence the acceptability and efficiency of TNP; increasing service accessibility, while reducing infection risk, defaulted appointments and travel. The results advocate for a post-pandemic mixed model of service delivery encompassing both FTF and TNP approaches.

A Systematic Review of Physical Examination Components Adapted for Telemedicine

Introduction: The COVID-19 pandemic ushered in a rapid, transformative adoption of telemedicine to maintain patient access to care. As clinicians made the shift from in-person to virtual practice, they faced a paucity of established and reliable clinical examination standards for virtual care settings. In this systematic review, we summarize the accuracy and reliability of virtual assessments compared with traditional in-person examination tools. Methods: We searched PubMed, Embase, Web of Science, and CINAHL from inception through September 2019 and included additional studies from handsearching of reference lists. We included studies that compared synchronous video (except allowing for audio-only modality for cardiopulmonary exams) with in-person clinical assessments of patients in various settings. We excluded behavioral health and dermatological assessments. Two investigators abstracted data using a predefined protocol. Results: A total of 64 studies were included and categorized into 5 clinical domains: neurological (N = 41), HEENT (head, eyes, ears, nose, and throat; N = 5), cardiopulmonary (N = 5), musculoskeletal (N = 8), and assessment of critically ill patients (N = 5). The cognitive assessment within the neurological exam was by far the most studied (N = 19) with the Mini-Mental Status Exam found to be highly reliable in multiple settings. Most studies showed relatively good reliability of the virtual assessment, although sample sizes were often small (<50 participants). Conclusions: Overall, virtual assessments performed similarly to in-person exam components for diagnostic accuracy but had a wide range of interrater reliability. The high heterogeneity in population, setting, and outcomes reported across studies render it difficult to draw broad conclusions on the most effective exam components to adopt into clinical practice. Further work is needed to identify virtual exam components that improve diagnostic accuracy.

A Systematic Review and a Latin American Clinical Model for Teleneuropsychological Assessment

OBJECTIVE

The objective of this study is to propose a TeleNP model for remote assessment and offer practical recommendations for clinical practice with patients in Mexico and Latin America, based on a systematic literature review and clinical experience.

METHOD

A systematic review of studies from 2011 to 2021 in English and Spanish used TeleNP, teleneuropsychology, telepsychology, online, assessment, teleneuropsicología, and evaluación for the search; the databases examined included PubMed, BiDi UNAM, ScienceDirect, Google Scholar, and Wiley One Library; the Oxford Centre for Evidence-Based Medicine system was used to grade the levels of evidence. The experience of the last two years of students and faculty in the Master's and Doctoral Programs in Psychology, Clinical Neuropsychology Residency Program, was also used as a basis for this guide.

RESULTS

We propose a clinical model for TeleNP assessment in Mexico and Latin America based on the review of 31 articles and the practice of professors and students of clinical neuropsychology.

CONCLUSION

The proposed model describes a procedure and adaptations for home-to-home clinical practice in the neuropsychological assessment of Mexican patients that could also be used in other Latin American countries. Its reliability remains to be assessed, but this model and the suggestions proposed could be used in future studies and clinical trials for Mexican and Latin American populations.

Equivalency of In-Person Versus Remote Assessment: WISC-V and KTEA-3 Performance in Clinically Referred Children and Adolescents

OBJECTIVE

Teletesting has the potential to reduce numerous barriers to patient care which have only become exacerbated during the COVID-19 pandemic. Although telehealth is commonly utilized throughout medicine and mental health practices, teletesting has remained limited within cognitive and academic evaluations. This may be largely due to concern for the validity of test administration via remote assessment. This cross-sectional study examined the equivalency of cognitive [Wechsler Intelligence Scales for Children - Fifth Edition (WISC-V)] and academic [Kaufman Test of Educational Achievement - Third Edition (KTEA-3)] subtests administered via either teletesting or traditional in-person testing within clinically referred youth.

METHOD

Chart review using a retrospective, cross-sectional design included a total of 893 children and adolescents, ranging from 4 to 17 years (Mean age = 10.2 years, SD = 2.9 years) who were administered at least one subtest from the aforementioned cognitive or academic assessments. Of these, 285 received teletesting, with the remaining (n = 608) receiving in-person assessment. A total of seven subtests (five from the WISC-V and two from the KTEA-3) were examined. A series of inverse probability of exposure weighted (IPEW) linear regression models examined differences between groups for each of the seven subtests after adjustment for numerous demographic, diagnostic, and parent-reported symptom variables.

RESULTS

Only two significant differences were found, such that WISC-V Visual Puzzles (p < .01) and KTEA-3 Math Concepts (p = .03) scores were slightly higher in the teletesting versus in-person groups. However, these differences were quite small in magnitude (WISC-V Visual Puzzles, d = .33, KTEA-3 Math Concepts, d = .18).

CONCLUSIONS

Findings indicate equivalency across methods of service delivery without clinically meaningful differences in scores among referred pediatric patients.

Memory for forgetting in adults with persistent symptoms following concussion

INTRODUCTION

Persistent memory complaints following concussion often do not coincide with evidence of objective memory impairment. To the extent this clinical presentation represents Functional Cognitive Disorder (FCD), we would expect preservation or even enhancement of memory for instances of forgetting, based on two lines of prior evidence. First, emotional arousal enhances autobiographical memory. People who experience memory lapses as worrisome may better remember them. Second, individuals with FCD can paradoxically provide detailed accounts of memory lapses compared to patients with neurodegenerative disease, who tend to provide vague examples. The current study aimed to better characterize the recall of forgetting events in people with subjective memory problems following concussion.

METHODS

The study sample consisted of adults with chronic post-concussion symptoms (N = 37, M = 42.7 years old; 70.27% women; M = 24.9 months post-injury) and normal-range performance on conventional neuropsychological tests. Participants completed a measure of memory complaint severity and the Autobiographical Interview (AI). The AI was used to quantify the richness of narrative recollections of recent instances when they forgot something and (control) personal events that did not involve forgetting. Linear regression modeling assessed the relationship between memory complaint severity and AI variables, including narrative details, valence, arousal, and rehearsal of memories.

RESULTS

There was no association between memory complaint severity and memory for forgetting vs. control events. We further found no association between memory complaint severity and AI performance overall (collapsing across forgetting and control events). Participants with greater memory complaints experienced past memory lapses as more negative than control memories, but did not consistently differ on other AI phenomenological variables.

CONCLUSION

Autobiographical recall of memory lapses appears preserved but not selectively heightened in people who report experiencing severe memory problems long after concussion. This inconsistency supports conceptualization of persistent memory complaints after concussion as FCD.

Comparison of Neuropsychological Assessment by Videoconference and Face to Face

OBJECTIVE

To compare the administration of neuropsychological tests by teleneuropsychology (TeleNP) and face to face (F-F) in order to determine the feasibility and reliability of TeleNP.

METHOD

At the inclusion visit, all participants underwent a traditional F-F neuropsychological assessment as part of their standard care. Four months after inclusion, they were randomized to undergo an additional neuropsychological assessment either by F-F administration or by TeleNP.

RESULTS

A total of 150 adults with cognitive complaints, but with no major cognitive or sensorial impairment were included. At 4 months, 69 participants were randomized in the F-F arm and 71 in TeleNP arm (10 lost in the follow-up). The overall satisfaction was high: 87.1% in the TeleNP arm were "very satisfied", and 82.9% indicated no preference between F-F and TeleNP. In agreement with previous data from the literature, neuropsychological assessments gave similar results across both administration conditions for a large majority of tests [Mini-Mental State Examination (MMSE), Free and Cued Selective Reminding Test (FCSRT) French version, Mahieux gestural praxis battery, Frontal Assessment Battery (FAB), time of completion of the Trail making Test (TMT) A and B, number of errors of the TMT B, Rey complex figure test, categorical et phonological verbal fluency tests] and minor differences for others [80-picture naming test (DO-80), FAB, Digit Span forward and backward and number of errors in the TMT A].

CONCLUSIONS

TeleNP is a promising method to be able to test patients as an alternative to F-F condition. Before this procedure can be generalized, it is now necessary to standardize the adaptation of certain tests and to test them in populations with more significant cognitive disorders.

Can the Rorschach be Administered Remotely? A Review of Options and a Pilot Study Using a Newly Developed R-PAS App

The ongoing COVID-19 pandemic has required psychologists to adopt measures like physical distancing and mask wearing, though other safety procedures such as travel restrictions or prohibitions on in-person practice and research have fostered the use of tele-health tools. In this article, we review options for using the Rorschach task via videoconference and provide preliminary data from using a new electronic app for remote R-PAS administration to determine whether the remote administration in an electronic form yields different information than in-person administration with the cards in hand. As a pilot study, our focus is on the "first factor" of all Rorschach scores, i.e., complexity. Data were collected from 60 adult Italian community volunteers, and statistical analyses evaluated the extent to which the average complexity score significantly departed from R-PAS normative expectations (SS = 100), accompanied by Bayesian likelihoods for supporting the null hypothesis. Results suggest that the general level of complexity shown by the test-takers when administered the Rorschach remotely with the new R-PAS app closely resembles that previously observed using "standard" in-person procedures. Tentative analyses of other R-PAS scores suggested normative departures that could be due to the effects of the app, testing at home, or responses to the pandemic. We offer recommendations for future research and discuss practical implications.

Tele-Assessments in Rural and Remote Schools – Perspectives of Support Teachers

Tele-assessments may enable specialist evaluation of students in schools and their progress following intervention. The aim of this project was to evaluate the feasibility of using videoconferencing technology to assess students with reading difficulties in the school setting and obtain the perspectives of teachers supporting the students during the assessment. Teachers ( n = 57) of 71 primary school age students participated in the study. Teachers provided feedback on the tele-assessment by completing questionnaires about students’ behaviours and the quality of the technology and assessment process. Randomly selected teachers ( n = 24) were invited to participate in a semi-structured interview to provide qualitative feedback. Tele-assessments were completed in 93.4% of the sample. Support teachers reported satisfaction with the audio and visual quality as well as the assessment process. The majority of students completed the tele-assessment with good compliance, engagement and attention. Feedback from support teachers also reflected the strengths of tele-assessments, such as better access to service, cost saving and convenience. Barriers to tele-assessments included technical difficulties, assessment limitations and equipment issues at schools. Tele-assessment is a feasible method of objectively measuring outcomes of students following an intervention. Tele-assessment at school is largely accepted by teachers who supported students in this study. Feedback obtained from this research may be used to offer guidance on undertaking tele-assessments with students in the school setting.

Integrating Neuropsychology into Interprofessional Geriatrics Clinics

Interprofessional healthcare teams are increasingly viewed as a clinical approach to meet the complex medical, psychological, and psychosocial needs of older adult patients. Despite the fact that older adults are at risk for cognitive difficulties, neuropsychologists are not routinely included on Geriatrics consult teams. The primary aim of this paper is to highlight the utility of neuropsychology within an interprofessional Geriatrics consult clinic. To address this aim, we describe specific benefits to patient care that may be associated with the inclusion of neuropsychologists on Geriatrics consult teams, including differential diagnosis, enhanced patient care, and reduced barriers to care. We provide a description of the integration of neuropsychology within a Veterans Health Administration (VA) interprofessional Geriatrics consult clinic team in order to illustrate the implementation of this model.

Integrating Telehealth Into Neurodevelopmental Assessment: A Model From the Cardiac Neurodevelopmental Outcome Collaborative

Objective

In the wake of the COVID-19 pandemic, psychologists were pushed to look beyond traditional in-person models of neurodevelopmental assessment to maintain continuity of care. A wealth of data demonstrates that telehealth is efficacious for pediatric behavioral intervention; however, best practices for incorporating telehealth into neurodevelopmental assessment are yet to be developed. In this topical review, we propose a conceptual model to demonstrate how telehealth can be incorporated into various components of neurodevelopmental assessment.

Methods

Harnessing existing literature and expertise from a multidisciplinary task force comprised of clinicians, researchers, and patient/parent representatives from the subspecialty of cardiac neurodevelopmental care, a conceptual framework for telehealth neurodevelopmental assessment was developed. Considerations for health equity and access to care are discussed, as well as general guidelines for clinical implementation and gaps in existing literature.

Results

There are opportunities to integrate telehealth within each stage of neurodevelopmental assessment, from intake to testing, through to follow-up care. Further research is needed to determine whether telehealth mitigates or exacerbates disparities in access to care for vulnerable populations as well as to provide evidence of validity for a wider range of neurodevelopmental measures to be administered via telehealth.

Conclusions

While many practices are returning to traditional, face-to-face neurodevelopmental assessment services, psychologists have a unique opportunity to harness the momentum for telehealth care initiated during the pandemic to optimize the use of clinical resources, broaden service delivery, and increase access to care for pediatric neurodevelopmental assessment.

Driving Performance in Older Adults: Current Measures, Findings, and Implications for Roadway Safety

Background and Objectives

Over 10,000 people a day turn 65 in the United States. For many older adults, driving represents an essential component of independence and is one of the most important factors in overall mobility. Recent survey studies in older adults suggest that up to 60% of older adult drivers with mild cognitive impairment, and up to 30% with dementia, continue to drive. The purpose of this review is to provide a comprehensive and detailed resource on the topics of cognition and driving for clinicians, researchers, and policymakers working on efforts related to older adult drivers.

Research Design and Methods

Publications on PubMed and Medline and discussions with experts working in geriatrics, technology, driving policy, psychology, and diverse aspects of driving performance were utilized to inform the current review.

Results

Research indicates that there is a complex and inverse correlation between multiple cognitive measures, driving performance, and risky driving behaviors. The fragmented nature of available peer-reviewed literature, and a reliance on correlative data, do not currently allow for the identification of the temporal and reciprocal nature of the interplay between cognition and driving endpoints.

Discussion and Implications

There are currently no widely accepted definitions, conceptual models, or uniform set of analyses for conducting geriatric research that is focused on driving. Establishing conventions for conducting research that harmonizes the fields of geriatrics, cognition, and driving research is critical for the development of the evidence base that will inform clinical practice and road safety policy.

Tele-assessment of cognitive functions in children: a systematic review

Cognitive Tele-Assessment approach (CTA) has been widely used in adults for clinical, research, and screening purposes. In the last decades, it has been considered a useful tool for evaluating child development in both clinical and educational settings and new instruments for CTA in children have been developed. In comparison to In Person Assessment (IPA), CTA can have several advantages, such as increasing accessibility, cutting waiting lists, reducing time and travel costs, and assisting with infection control by minimizing face-to-face contact in times of pandemic. Nevertheless, several issues related to the feasibility and reliability of using CTA to evaluate cognitive development are still open. The present systematic review has a twofold aim: 1. to describe the cognitive functions that are most frequently measured by CTA in children, the procedures used, and the characteristics of the samples investigated; 2. to investigate the agreement between CTA and IPA scores in children.In the present systematic review, 23 studies using CTA in children, with typical or atypical development, have been selected and analyzed. Results support the similarities in performance scores between IPA and CTA and good compliance by children and their families in participating in CTA. Nonetheless, most studies suggest that several methodological precautions must be taken to manage technical and procedural characteristics that may represent challenges for CTA of children. Suggestions for a correct use of CTA, factors affecting the validity of the results and directions for future research are discussed.

Working Group Recommendations for the Practice of Teleneuropsychology in Latin America

OBJECTIVE

Teleneuropsychology (teleNP) could potentially expand access to services for patients who are confined, have limited personal access to healthcare, or live in remote areas. The emergence of the COVID-19 pandemic has significantly increased the use of teleNP for cognitive assessments. The main objective of these recommendations is to identify which procedures can be potentially best adapted to the practice of teleNP in Latin America, and thereby facilitate professional decision-making in the region.

METHOD

Steps taken to develop these recommendations included (1) formation of an international working group with representatives from 12 Latin American countries; (2) assessment of rationale, scope, and objectives; (3) formulation of clinical questions; (4) evidence search and selection; (5) evaluation of existing evidence and summary; and (6) formulation of recommendations. Levels of evidence were graded following the Oxford Centre for Evidence-Based Medicine system. Databases examined included PubMed, WHO-IRIS, WHO and PAHO-IRIS, Índice Bibliográfico Español en Ciencias de la Salud (IBCS), and LILACS.

RESULTS

Working group members reviewed 18,400 titles and 422 abstracts and identified 19 articles meeting the criteria for level of evidence, categorization, and elaboration of recommendations. The vast majority of the literature included teleNP tests in the English language. The working group proposed a series of recommendations that can be potentially best adapted to the practice of teleNP in Latin America.

CONCLUSIONS

There is currently sufficient evidence to support the use of videoconferencing technology for remote neuropsychological assessments. These recommendations will likely contribute to the advancement of teleNP research and practice in the region.

Feasibility of administering the WAIS-IV using a home-based telehealth videoconferencing model

Use of telehealth to deliver neuropsychological services has proven to be a feasible approach, however, there is limited research which has examined the reliability of home-based assessment models using a comprehensive intelligence test. The aim of this study was to examine the reliability and feasibility of a home-based videoconferencing administration of the Wechsler Adult Intelligence Scales-4^th Edition (WAIS-IV).

Thirty healthy participants (aged 18-40 years) completed the WAIS-IV both in-person and via home-based videoconferencing utilizing a randomized counter-balanced methodology to attempt to control for an order effect. Paper record forms for Coding/Symbol Search and Blocks were sent and returned via tamper proof courier packs. Participants completed an online survey of their experiences of TNP following completion of their assessments. Group mean comparisons, intra class correlation coefficients (ICCs) and Bland-Altman measures of bias were calculated.

Findings from both modalities were highly concordant across all WAIS-IV subtests and indices, with all ICCs rated as "excellent," (≥0.9). There were no significant mean group differences and no evidence of proportional bias. The majority of participants were very satisfied with the use of videoconferencing as an application for cognitive assessment and high levels of participant compliance were observed.

In this non-clinical cohort home-based videoconference administration of the WAIS-IV was feasible, reliable and acceptable. TNP may offer an alternative for those consumers where there are challenges in accessing a face-to-face service delivery model, thereby improving equity, and enabling continuation of service delivery. Future research is needed with a larger and more ethnically diverse clinical population.

Tele-Neuropsychological Assessment of Alzheimer's Disease

Background: Because of the new pandemic caused by the novel coronavirus disease (COVID-19), the demand for telemedicine and telemonitoring solutions has been exponentially raised. Because of its special advantage to treat patients in an emergency without physical presence at a hospital via video conferencing, telemedicine has been used to overcome distance barriers and to improve access to special domains like neurology. In these pandemic times, telemedicine has been also employed as a support for the diagnosis and treatment of adult-onset dementia disorders including Alzheimer’s disease. Objective: In this study, we carried out a systematic literature analysis to clarify if the neuropsychological tests traditionally employed in face-to-face (FTF) contexts are reliable via telemedicine. Methods: A systematic literature search for the past 20 years (2001–2020) was carried out through the medical databases PubMed (Medline) and the Cumulative Index to Nursing and Allied Health Literature (CINAHL). The quality assessment was conducted by adopting the Newcastle Ottawa Scale (NOS) and only studies with a NOS ≥ 7 were included in this review. Results: The Mini-Mental State Examination (MMSE) results do not differ when tests are administered in the traditional FTF modality or by videoconference, and only negligible minor changes in the scoring system were noticeable. Other neuropsychological tests used to support the diagnosis of AD and dementia such as the Token Test, the Comprehension of Words and Phrases (ACWP), the Controlled Oral Word Association Test showed high reliability between the two modalities considered. No differences in the reliability concerning the living setting or education of the subjects were reported. Conclusions: The MMSE, which is the main screening test for dementia, can be administered via telemedicine with minor adaptation in the scoring system. Telemedicine use for other neuropsychological tests also resulted in general reliability and enough accuracy. Cognitive assessment by videoconference is accepted and appreciated and therefore can be used for dementia diagnosis in case of difficulties to performing FTF assessments. This approach can be useful given a personalized medicine approach for the treatment of adult-onset dementia disorders.

Distance Assessment for Detecting Cognitive Impairment in Older Adults: A Systematic Review of Psychometric Evidence

INTRODUCTION

Distance or remote cognitive assessments, administered via phone or computer platforms, have emerged as possible alternatives to traditional assessments performed during office visits. Distance refers to any nontraditional assessment feature, not only or necessarily location. We conducted a systematic review to examine the psychometric soundness of these approaches.

METHOD

We searched PubMed, PsycINFO, AgeLine, and Academic Search Premier for articles published between January 2008 and June 2020. Studies were included if participants were over the age of 50, a structured assessment of cognitive function in older adults was evaluated, the assessment method was deemed distant, and validity and/or reliability data were reported. Assessment distance was defined as having any of the following features: use of an electronic test interface, nonroutine test location (e.g., home), test self-administered, and test unsupervised. Distance was categorized as low, intermediate, or high.

RESULTS/DISCUSSION

Twenty-six studies met inclusion criteria. Sample sizes ranged from n = 8 to 8,627, and the mean age ranged from 57 to 83. Assessments included screens, brief or full batteries, and were performed via videoconferencing, phone, smartphone, or tablet/computer. Ten studies reported on low distance, 11 on intermediate distance, and 5 studies for high distance assessments. Invalid performance data were observed with older age and cognitive impairment. Convergent validity data were reported consistently and suggested a decline with increasing distance: r = 0.52-0.80 for low, 0.49-0.75 for intermediate, and 0.41-0.53 for high distance. Diagnostic validity estimates presented a similar pattern. Reliability data were reported too inconsistently to allow evaluation.

CONCLUSION

The validity of cognitive assessments with older adults appears supported at lower but not higher distance. Less is known about the reliability of such assessments. Future research should delineate the person and procedure boundaries for valid and reliable test results.

From Face-to-Face to Home-to-Home: Validity of a Teleneuropsychological Battery

Background:

Over the last decade, teleneuropsychology has increased substantially. There is a need for valid neuropsychological batteries to be administered home-to-home. Since 2006, the neuropsychological battery of Fundació ACE (NBACE) has been administered face-to-face in our clinical settings. Recently, we adapted the NBACE for teleneuropsychology use to be administered home-to-home (NBACEtn).

Objective:

The aims of the present study are: 1) to determine the home-to-home NBACE equivalence compared to its original face-to-face version; and 2) to examine home-to-home NBACE discriminant capacity by differentiating among cognitively healthy, mild cognitive impairment, or mild dementia subjects and comparing it with the face-to-face version.

Methods:

Data from 338 individuals assessed home-to-home (NBACEtn) were contrasted with 7,990 participants assessed with its face-to-face version (NBACE). Exploratory and confirmatory factorial structure, and invariance analysis of the two versions of the battery were performed.

Results:

Exploratory and confirmatory factor analysis supported the four-factor model (attention, memory, executive, and visuospatial/constructional functions). Configural, metric, and scalar measurement invariance was found between home-to-home and face-to-face NBACE versions. Significant differences in most of the neuropsychological variables assessed were observed between the three clinical groups in both versions of administration. No differences were found between the technological devices used by participants (computer or tablet and mobile devices).

Conclusion:

For the first time, invariance analysis findings were addressed by determining a teleneuropsychological battery’s equivalence in comparison with its face-to-face version. This study amplifies the neuropsychological assessment’s applicability using a home-to-home format, maintaining the original measure’s structure, interpretability, and discriminant capacity.

Verbal Short-Form FSIQ Estimations for Possible Use With Individuals With Motor and Visual Impairment or in Virtual Environments

OBJECTIVE

Abbreviated and virtual neuropsychological assessment practices are growing in popularity and viable alternatives to traditional testing methods are needed, especially in the face of global health concerns. This study generated and examined short form (SF) full-scale IQ (FSIQ) estimations, which lend themselves to virtual test administration.

METHODS

Archival data were procured from 318 concurrent cognitive evaluations at a university clinic. Twenty-six unique SF combinations, including dyads, triads, tetrads, and pentads, were created from Wechsler Adult Intelligence Scale, 4th edition (WAIS-IV) subtests within verbal comprehension and working memory indices due to these tests' ability to be administered without visual stimuli or psychomotor involvement.

RESULTS

Stepwise regression analyses revealed 9 SF combinations (i.e., 1 pentad, 3 tetrads, 2 triads, and 3 dyads) that significantly accounted for unique variance in FSIQ scores and provided good accuracy estimating FSIQ.

CONCLUSION

Results suggest the potential viability of verbal WAIS-IV SF FSIQ estimations for clinical use when assessing patients with motor or visual impairments, as well as performing tele-neuropsychological services.

Reliability of Telephone and Videoconference Methods of Cognitive Assessment in Older Adults with and without Dementia

BACKGROUND

Telephone and videoconference administration of cognitive tests introduce additional sources of variance compared to in-person testing. Reviews of test-retest reliability have included mixed neurocognitive and psychiatric populations with limited consideration of methodological and statistical contributions.

OBJECTIVE

We reviewed reliability estimates from comparison studies of older adults with and without dementia, considering test-retest analyses and study methods.

METHODS

Medline, Embase, PsycINFO, and Web of Science were systematically searched from 1 January 2000 to 9 June 2020 for original articles comparing telephone or videoconference administered cognitive instruments to in-person administration in older adults with and without dementia or mild cognitive impairment.

RESULTS

Of 4,125 articles, 23 were included: 11 telephone (N = 2 dementia cohorts) and 12 videoconference (N = 4 dementia cohorts). Telephone administered subtest scores trended in the same direction as in-person with comparable means. Person-level data were scarce. Data on dementia was only available for MMSE, with resulting subtle modality bias. MMSE, SMMSE, Letter Fluency, and HVLT-R in healthy to mild-moderate Alzheimer's disease were particularly reliable for videoconference administration. Other tests show promise but require more observations and comprehensive analyses. Most studies used high-speed stable videoconferencing hardware resulting in a lack of ecological validity for home administration.

CONCLUSION

Remote administration is often consistent with in-person administration but variable and limited at the person/test level. Improved statistical design and inclusion of dementia related cohorts in telephone studies is recommended. Reliability evidence is stronger for videoconferencing but with limited applicability to home administration and severe dementia. Improved reporting of administrative procedures is recommended.

How, when, and for whom: decisions regarding remote neuropsychological assessment during the 2020 COVID-19 pandemic

Neuropsychological assessment provides crucial information about cognitive, behavioral, and socioemotional functioning in medical, educational, legal, and social contexts. During the 2020 COVID-19 pandemic, the Israeli Ministry of Health initially mandated that all psychological assessments be postponed. However, as referrals to time-sensitive, high-need, and high-stakes assessments began to accumulate, it became necessary to consider remote solutions. In the current paper, we describe the considerations that affected the transition to remote activity in a prominent Israeli provider of neuropsychological assessment and rehabilitation services, referring to technological and environmental conditions, cognitive requirements, and tasks, as well as to legal, regulatory, and funding issues. After discussing how assessments should be conducted to maximize feasibility and validity while minimizing risks to clients and clinicians, we propose a preliminary model for deciding whether specific referrals warrant remote administration. The model delineates key factors in decisions regarding remote assessment, emphasizing the distinct roles of the referring clinician and the neuropsychologist who conducts the assessment, and highlighting the need for collaboration between them. The abrupt need for remote assessments during the pandemic required a quick response with little preparation. The lessons learned from this process can be applied in the future, so that the need for remote services can be met with greater certainty and uniformity.

Effect of Early High-Dose Vitamin D3 Repletion on Cognitive Outcomes in Critically Ill Adults

BACKGROUND

Long-term cognitive impairment frequently occurs after critical illness; no treatments are known to improve long-term cognition.

RESEARCH QUESTION

Does a single high-dose (540,000 International Units) enteral treatment of vitamin D3 given shortly after hospital admission in critically ill patients who are vitamin D deficient improve long-term global cognition or executive function?

STUDY DESIGN AND METHODS

This study evaluated long-term cognitive outcomes among patients enrolled in a multicenter, blinded, randomized clinical trial comparing vitamin D3 treatment vs placebo in critically ill adults with vitamin D deficiency. Global cognition was measured by the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). Executive function was measured with a composite score derived from three Delis-Kaplan Executive Function System subscales. Outcomes were assessed at a median of 443 days (interquartile range, 390-482 days) after randomization and were compared using multivariate proportional odds regression. Adjusted ORs of > 1.0 would indicate better outcomes in the vitamin D3 group compared with the placebo group.

RESULTS

Ninety-five patients were enrolled, including 47 patients randomized to vitamin D3 treatment and 48 patients randomized to placebo. The adjusted median RBANS score at follow-up was 79.6 (95% CI, 73.0-84.0) in the vitamin D3 group and 82.1 (95% CI, 74.7-84.6) in the placebo group (adjusted OR, 0.83; 95% CI, 0.50-1.38). The adjusted median executive function composite scores were 8.1 (95% CI, 6.8-9.0) and 8.7 (95% CI, 7.4-9.3), respectively (adjusted OR, 0.72; 95% CI, 0.36-1.42).

INTERPRETATION

In vitamin D-deficient, critically-ill adults, a large dose of enteral vitamin D3 did not improve long-term global cognition or executive function.

TRIAL REGISTRY

ClinicalTrials.gov; No.: NCT03733418; URL: www.clinicaltrials.gov.

Telehealth in Neurodegenerative Diseases: Opportunities and Challenges for Patients and Physicians

Telehealth, by definition, is distributing health-related services while using electronic technologies. This narrative Review describes the technological health services (telemedicine and telemonitoring) for delivering care in neurodegenerative diseases, Alzheimer's disease, Parkinson's Disease, and amyotrophic lateral Sclerosis, among others. This paper aims to illustrate this approach's primary experience and application, highlighting the strengths and weaknesses, with the goal of understanding which could be the most useful application for each one, in order to facilitate telehealth improvement and use in standard clinical practice. We also described the potential role of the COVID-19 pandemic to speed up this service's use, avoiding a sudden interruption of medical care.

Home-Based Pediatric Teleneuropsychology: A validation study

OBJECTIVE

To evaluate home-based teleneuropsychology in a pediatric cohort to determine if assessment via in-person and home-based videoconference yield similar results. The second objective was to determine the level of satisfaction with videoconference-based assessment among participants and caregivers.

METHOD

Fifty-eight participants, aged 6-20 years, were recruited through specialty programs for pediatric demyelinating disorders. Each participant was administered the same brief neuropsychological battery of common measures twice, once during an in-person session and once during a remote home-based videoconference session. Order of sessions was counterbalanced and time between assessments ranged from 1 to 50 days. It was hypothesized that results obtained through in-person vs. remote videoconference sessions would not be significantly different and that most participants and caregivers would rate the experience with teleneuropsychology as satisfactory.

RESULTS

Mann-Whitney U tests showed no significant differences in results obtained in the in-person first vs. remote videoconference first sessions or the change in performance across sessions. Satisfaction ratings by participants and caregivers were largely favorable for the use of the videoconference testing format.

CONCLUSIONS

The current study is the first to validate home-based teleneuropsychology and is the first to validate teleneuropsychological assessment in a pediatric sample. Future studies should replicate these findings as well as expand on sample size, diversity of populations evaluated, and the assessment tools administered. Careful consideration of ethical and practical factors should be given before providing pediatric teleneuropsychology services.

Teleneuropsychology in the time of COVID-19: The experience of The Australian Epilepsy Project

PURPOSE

Traditional neuropsychological testing carries elevated COVID-19 risk for both examinee and examiner. Here we describe how the pilot study of the Australian Epilepsy Project (AEP) has transitioned to tele-neuropsychology (teleNP), enabling continued safe operations during the pandemic.

METHODS

The AEP includes adults (age 18-60) with a first unprovoked seizure, new diagnosis of epilepsy or drug resistant focal epilepsy. Shortly after launching the study, COVID-related restrictions necessitated adaptation to teleNP, including delivery of verbal tasks via videoconference; visual stimulus delivery via document camera; use of web-hosted, computerised assessment; substitution of oral versions for written tests; online delivery of questionnaires; and discontinuation of telehealth incompatible tasks.

RESULTS

To date, we have completed 24 teleNP assessments: 18 remotely (participant in own home) and six on-site (participant using equipment at research facility). Five face-to-face assessments were conducted prior to the transition to teleNP. Eight of 408 tests administered via teleNP (1.9 %) have been invalidated, for a variety of reasons (technical, procedural, environmental). Data confirm typical patterns of epilepsy-related deficits (p < .05) affecting processing speed, executive function, language and memory. Questionnaire responses indicate elevated rates of patients at high risk of mood (34 %) and anxiety disorder (38 %).

CONCLUSION

Research teleNP assessments reveal a typical pattern of impairments in epilepsy. A range of issues must be considered when introducing teleNP, such as technical and administrative set up, test selection and delivery, and cohort suitability. TeleNP enables large-scale neuropsychological research during periods of social distancing (and beyond), and offers an opportunity to expand the reach and breadth of neuropsychological services.

InterOrganizational practice committee recommendations/guidance for teleneuropsychology (TeleNP) in response to the COVID-19 pandemic

Objective: The Inter Organizational Practice Committee (IOPC) convened a workgroup to provide rapid guidance about teleneuropsychology (TeleNP) in response to the COVID-19 pandemic.Method: A collaborative panel of experts from major professional organizations developed provisional guidance for neuropsychological practice during the pandemic. The stakeholders included the American Academy of Clinical Neuropsychology/American Board of Clinical Neuropsychology, the National Academy of Neuropsychology, Division 40 of the American Psychological Association, the American Board of Professional Neuropsychology, and the American Psychological Association Services, Inc. The group reviewed literature, collated federal, regional and state regulations and information from insurers, and surveyed practitioners to identify best practices.Results: Literature indicates that TeleNP may offer reliable and valid assessments, but clinicians need to consider limitations, develop new informed consent procedures, report modifications of standard procedures, and state limitations to diagnostic conclusions and recommendations. Specific limitations affect TeleNP assessments of older adults, younger children, individuals with limited access to technology, and individuals with other individual, cultural, and/or linguistic differences. TeleNP may be contraindicated or infeasible given specific patient characteristics, circumstances, and referral questions. Considerations for billing TeleNP services are offered with reservations that clinicians must verify procedures independently. Guidance about technical issues and "tips" for TeleNP procedures are provided.Conclusion: This document provides provisional guidance with links to resources and established guidelines for telepsychology. Specific recommendations extend these practices to TeleNP. These recommendations may be revised as circumstances evolve, with updates posted continuously at OPC.online.

Remote cognitive and behavioral assessment: Report of the Alzheimer Society of Canada Task Force on dementia care best practices for COVID-19

INTRODUCTION

Despite the urgent need for remote neurobehavioral assessment of individuals with cognitive impairment, guidance is lacking. Our goal is to provide a multi-dimensional framework for remotely assessing cognitive, functional, behavioral, and physical aspects of people with cognitive impairment, along with ethical and technical considerations.

METHODS

Literature review on remote cognitive assessment and multidisciplinary expert opinion from behavioral neurologists, neuropsychiatrists, neuropsychologists, and geriatricians was integrated under the auspices of the Alzheimer Society of Canada Task Force on Dementia Care Best Practices for COVID-19. Telephone and video approaches to assessments were considered.

RESULTS

Remote assessment is shown to be acceptable to patients and caregivers. Informed consent, informant history, and attention to privacy and autonomy are paramount. A range of screening and domain-specific instruments are available for telephone or video assessment of cognition, function, and behavior. Some neuropsychological tests administered by videoconferencing show good agreement with in-person assessment but still lack validation and norms. Aspects of the remote dementia-focused neurological examination can be performed reliably.

DISCUSSION

Despite challenges, current literature and practice support implementation of telemedicine assessments for patients with cognitive impairment. Convergence of data across the clinical interview, reliable and brief remote cognitive tests, and remote neurological exam increase confidence in clinical interpretation and diagnosis.

Feasibility of Videophone-Assisted Neuropsychological Testing For Intensive Care Unit Survivors

BACKGROUND

Most hospitals lack neuropsychologists, and this lack has hampered the conduct of large-scale, multicenter clinical trials to evaluate the effect of interventions on long-term cognition in patients in intensive care units (ICUs).

OBJECTIVE

To evaluate the feasibility of videophone-assisted neuropsychological testing administered by using an inexpensive high-definition web camera and a laptop.

METHODS

This prospective, single-center observational study, conducted at a tertiary care academic hospital, included ICU survivors aged 18 years or older. Participants were seated in a quiet room with a proctor who provided neuropsychological testing forms and addressed technical difficulties. The neuropsychological rater was in a room 100 yd (90 m) from the participant. Skype was used for videoconferencing via a wireless connection. After the testing session was completed, participants completed surveys.

RESULTS

In April 2017, 10 ICU survivors (median age, 63 years; range, 51-73 years) were enrolled. All indicated that "Videophone-assisted neuropsychological testing is reasonable to use in research studies." When asked "What made the videophone-assisted cognitive testing difficult?" 1 participant (10%) reported occasionally becoming frustrated with the testing because the wireless internet speed was slower than usual and reduced the resolution of visual stimuli. Three participants (30%) reported difficulty with the line orientation task because the lines were "shaky" and the images were "hard to see."

CONCLUSION

Videophone-assisted neuropsychological testing is feasible for evaluating cognition in multicenter studies of ICU patients. Feedback provided will be used to refine this telemedicine approach to neuropsychological testing.

Inter Organizational Practice Committee Recommendations/Guidance for Teleneuropsychology in Response to the COVID-19 Pandemic†

OBJECTIVE

The Inter Organizational Practice Committee convened a workgroup to provide rapid guidance about teleneuropsychology (TeleNP) in response to the COVID-19 pandemic.

METHOD

A collaborative panel of experts from major professional organizations developed provisional guidance for neuropsychological practice during the pandemic. The stakeholders included the American Academy of Clinical Neuropsychology/American Board of Clinical Neuropsychology, the National Academy of Neuropsychology, Division 40 of the American Psychological Association, the American Board of Professional Neuropsychology, and the American Psychological Association Services, Inc. The group reviewed literature; collated federal, regional, and state regulations and information from insurers; and surveyed practitioners to identify best practices.

RESULTS

Literature indicates that TeleNP may offer reliable and valid assessments, but clinicians need to consider limitations, develop new informed consent procedures, report modifications of standard procedures, and state limitations to diagnostic conclusions and recommendations. Specific limitations affect TeleNP assessments of older adults, younger children, individuals with limited access to technology, and individuals with other individual, cultural, and/or linguistic differences. TeleNP may be contraindicated or infeasible given specific patient characteristics, circumstances, and referral questions. Considerations for billing TeleNP services are offered with reservations that clinicians must verify procedures independently. Guidance about technical issues and "tips" for TeleNP procedures are provided.

CONCLUSION

This document provides provisional guidance with links to resources and established guidelines for telepsychology. Specific recommendations extend these practices to TeleNP. These recommendations may be revised as circumstances evolve, with updates posted continuously at IOPC.online.

Transition from physical to virtual visit format for a longitudinal brain aging study, in response to the Covid-19 pandemic. Operationalizing adaptive methods and challenges

The COVID-19 pandemic necessitated adaptations to standard operations and management of clinical studies, after lockdown measures put in place by several governments to reduce the spread of SARS-COV-2. In this paper, we describe our telehealth strategy developed for transitioning our dementia prevention clinical observational prospective study from face-to-face visits to virtual visits, to ensure the ongoing collection of longitudinal data. We share the lessons learned in terms of challenges experienced and solutions implemented to achieve successful administration of study assessments. Our methods will be useful for informing longitudinal observational or interventional studies that require a feasible model for remote data collection, in cognitively unimpaired adults.