Comparing Performance Across In-person and Videoconference-Based Administrations of Common Neuropsychological Measures in Community-Based Survivors of Stroke

Core components of project-based intervention after acquired brain injury: Delivering meaningful groups online

BACKGROUND

Rehabilitation for cognitive-communication impairments following brain injury can be complex given the heterogenous nature of impairments post injury. Project-based intervention has the potential to improve communication skills and create a meaningful real-life context where individuals collaborate to develop a concrete product, which benefits others. While evidence for this intervention is emerging, the COVID-19 pandemic prompted increased use of telehealth interventions to serve people with brain injury. This paper aims to describe a framework for the delivery of project-based intervention via telehealth within community rehabilitation settings; and present several case studies of telehealth groups completed in the United Kingdom and the United States during the COVID-19 pandemic.

METHODS

A working group was formed to map the components of project-based intervention onto the rehabilitation treatment specification system (RTSS). This system is a conceptual framework that helps to explain the link between treatment theory and ingredients, allowing a clinician to clearly understand how and why a treatment works. First, a literature search was completed to identify eligible studies on project-based intervention after brain injury. Second, those studies were thematically mapped onto the RTSS to identify important intervention components. Third, the presence of these components was assessed for community brain injury groups delivered via telehealth in the United Kingdom and United States. These groups were further described using a taxonomy of social activities that help to describe the degree of meaningful social engagement.

RESULTS

The literature was described with a thematic RTSS summary. Treatment aims focus on skills training and self-efficacy, advocacy and self-empowerment, emotional well-being and quality of life, and collaboration and community belonging. Treatment ingredients involve a range of cognitive and behavioural supports to deliver meaningful activities and contexts to complete a project. Mechanisms of action involve learning by doing and cognitive and affective information processing. All four telehealth groups conducted in the United Kingdom and United States involved at least three treatment aims, >7 targets, and >8 treatment ingredients. All groups reported positive experiences from activities that involve working collaboratively to help others and contribute to society.

CONCLUSIONS

Project-based intervention delivered via telehealth has the potential for supporting people with acquired brain injury to improve their communication skills and engage in meaningful, collaborative activity. Application of the RTSS helps clinicians to understand the aims and therapeutic ingredients (or clinician activities) through which a person with brain injury may achieve specific treatment targets during the rehabilitation process.

WHAT THIS PAPER ADDS

What is already known on the subject Project-based interventions have the potential to improve cognitive, self-regulatory, behavioural and social communication skills, renegotiate identity and reaffirm sense of self, providing a positive impact on quality of life for persons with acquired brain injuries. Projects serve as a context for meaningful engagement for individuals in the chronic phase of traumatic brain injury recovery, without fulfilling work, family or social responsibilities. However, most published research has involved in-person projects and few projects have been delivered via telehealth. What this paper adds to existing knowledge While past published works have shared core principles of intervention, a variety of projects, durations, dosages and methods have been employed. The current paper provides a framework to support more consistent implementation. By mapping previous project-based interventions to the RTSS, clinicians will have a better understanding of the aims, targets, ingredients and theoretical underpinnings of project-based interventions. In the wake of the COVID-19 pandemic, the shift to telehealth moved interventions to a virtual context. The four case projects in this paper demonstrate that it is possible to conduct project-based interventions via telehealth and provides a clear description to guide clinicians in their delivery. What are the potential or actual clinical implications of this work? This work begins to build the foundation for more rigorous, empirical examination of project-based interventions. By mapping project-based interventions to the RTSS, core aims, targets and ingredients are established that can be objectively examined. This investigation also provides a road map for clinicians who wish to implement this complex intervention.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Investigating Equivalence of In-Person and Telehealth-Based Neuropsychological Assessment Performance for Individuals Being Investigated for Younger Onset Dementia

OBJECTIVE

Given the rapid shift to in-home teleneuropsychology models, more research is needed to investigate the equivalence of non-facilitator models of teleneuropsychology delivery for people with younger onset dementia (YOD). This study aimed to determine whether equivalent performances were observed on neuropsychological measures administered in-person and via teleneuropsychology in a sample of people being investigated for YOD.

METHOD

Using a randomized counterbalanced cross-over design, 43 participants (Mage = 60.26, SDage = 7.19) with a possible or probable YOD diagnosis completed 14 neuropsychological tests in-person and via teleneuropsychology, with a 2-week interval. Repeated measures t-tests, intraclass correlation coefficients (ICC), and Bland Altman analyses were used to investigate equivalence across the administration conditions.

RESULTS

No statistical differences were found between in-person and teleneuropsychology conditions, except for the Hospital Anxiety and Depression Scale Anxiety subtest. Small to negligible effect sizes were observed (ranging from .01 to .20). ICC estimates ranged from .71 to .97 across the neuropsychological measures. Bland Altman analyses revealed that the Wechsler Adult Intelligence Scale-Fourth Edition Block Design subtest had slightly better overall performance in the in-person condition and participants reported higher levels of anxiety symptoms during the teleneuropsychology condition; however, average anxiety symptoms remained within the clinically normal range. Participants reported a high level of acceptability for teleneuropsychology assessments.

CONCLUSIONS

These results suggest that performances are comparable between in-person and teleneuropsychology assessment modalities. Our findings support teleneuropsychology as a feasible alternative to in-person neuropsychological services for people under investigation of YOD, who face significant barriers in accessing timely diagnoses and treatment options.

Long-term psychological outcomes following stroke: the OX-CHRONIC study

BACKGROUND

Stroke survivors rate longer-term (> 2 years) psychological recovery as their top priority, but data on how frequently psychological consequences occur is lacking. Prevalence of cognitive impairment, depression/anxiety, fatigue, apathy and related psychological outcomes, and whether rates are stable in long-term stroke, is unknown.

METHODS

N = 105 long-term stroke survivors (M [SD] age = 72.92 [13.01]; M [SD] acute NIH Stroke Severity Score = 7.39 [6.25]; 59.0% Male; M [SD] years post-stroke = 4.57 [2.12]) were recruited (potential N = 208). Participants completed 3 remote assessments, including a comprehensive set of standardized cognitive neuropsychological tests comprising domains of memory, attention, language, and executive function, and questionnaires on emotional distress, fatigue, apathy and other psychological outcomes. Ninety participants were re-assessed one year later. Stability of outcomes was assessed by Cohen's d effect size estimates and percent Minimal Clinically Important Difference changes between time points.

RESULTS

On the Montreal Cognitive Assessment 65.3% scored < 26. On the Oxford Cognitive Screen 45.9% had at least one cognitive impairment. Attention (27.1%) and executive function (40%) were most frequently impaired. 23.5% and 22.5% had elevated depression/anxiety respectively. Fatigue (51.4%) and apathy (40.5%) rates remained high, comparable to estimates in the first-year post-stroke. Attention (d = -0.12; 85.8% stable) and depression (d = 0.09, 77.1% stable) were the most stable outcomes. Following alpha-adjustments, only perceptuomotor abilities (d = 0.69; 40.4% decline) and fatigue (d = -0.33; 45.3% decline) worsened over one year. Cognitive impairment, depression/anxiety, fatigue and apathy all correlated with worse quality of life.

CONCLUSION

Nearly half of participants > 2 years post-event exhibited psychological difficulties including domains of cognition, mood, and fatigue, which impact long-term quality of life. Stroke is a chronic condition with highly prevalent psychological needs, which require monitoring and intervention development.

A review of the reliability of remote neuropsychological assessment

The provision of clinical neuropsychological services has predominately been undertaken by way of standardized administration in a face-to-face setting. Interpretation of psychometric findings in this context is dependent on the use of normative comparison. When the standardization in which such psychometric measures are employed deviates from how they were employed in the context of the development of its associated norms, one is left to question the reliability and hence, validity of any such findings and in turn, diagnostic decision making. In light of the current COVID-19 pandemic and resultant social distancing direction, face-to-face neuropsychological assessment has been challenging to undertake. As such, remote (i.e., virtual) neuropsychological assessment has become an obvious solution. Here, and before the results from remote neuropsychological assessment can be said to stand on firm scientific grounds, it is paramount to ensure that results garnered remotely are reliable and valid. To this end, we undertook a review of the literature and present an overview of the landscape. To date, the literature shows evidence for the reliability of remote administration and the clinical implications are paramount. When and where needed, neuropsychologists, psychometric technicians and examinees may no longer need to be in the same physical space to undergo an assessment. These findings are most relevant given the physical distancing practices because of COVID-19. And whilst remote assessment should never supplant face-to-face neuropsychological assessments, it does serve as a valid alternative when necessary.

Teleneuropsychology for vascular cognitive impairment: Which tools do we have?

The halt of clinical activities imposed during the COVID-19 pandemic forced clinicians to find alternative strategies to provide continuity of care and services, and led to a renewed interest in use of teleneuropsychology (TNP) to remotely assess patients. Recent TNP guidelines recommend maximizing the reproduction of standard in-person assessment, particularly through videoconferences. However, consistency of the adaptations of usual cognitive tests to videoconference needs further elucidation. This review aims at critical reviewing which cognitive tests could be recommended for a remote evaluation of patients with vascular cognitive impairment (VCI) among those widely recognized as reference standards. Current evidence supports the use of global cognitive efficiency (MMSE and MoCA), verbal memory (Revised Hopkins Verbal Learning Test), and language tests (phonemic and semantic verbal fluencies, Boston Naming Test), while there is a lack of strong validity support for measures of visuospatial functions (Rey-Osterreith Complex Figure), and executive functioning and processing speed (Trail making Test, and Digit symbol or Symbol digit tests). This represents a major limitation in the evaluation of VCI because its cognitive profile in often characterized by attention and executive deficits. At present, a videoconference TNP visit appears useful for a brief evaluation of global cognitive efficiency, and to 'triage' patients towards a second level in person evaluation. In future, hybrid models of TNP based on data collected across multiple modalities, incorporating both adaptation of usual cognitive tools and new computerized tools in the supervised videoconference setting, are likely to become the best option for a comprehensive remote cognitive assessment.

Virtual (Zoom) Interactions Alter Conversational Behavior and Interbrain Coherence

A growing number of social interactions are taking place virtually on videoconferencing platforms. Here, we explore potential effects of virtual interactions on observed behavior, subjective experience, and neural "single-brain" and "interbrain" activity via functional near-infrared spectroscopy neuroimaging. We scanned a total of 36 human dyads (72 participants, 36 males, 36 females) who engaged in three naturalistic tasks (i.e., problem-solving, creative-innovation, socio-emotional task) in either an in-person or virtual (Zoom) condition. We also coded cooperative behavior from audio recordings. We observed reduced conversational turn-taking behavior during the virtual condition. Given that conversational turn-taking was associated with other metrics of positive social interaction (e.g., subjective cooperation and task performance), this measure may be an indicator of prosocial interaction. In addition, we observed altered patterns of averaged and dynamic interbrain coherence in virtual interactions. Interbrain coherence patterns that were characteristic of the virtual condition were associated with reduced conversational turn-taking. These insights can inform the design and engineering of the next generation of videoconferencing technology.SIGNIFICANCE STATEMENT Videoconferencing has become an integral part of our lives. Whether this technology impacts behavior and neurobiology is not well understood. We explored potential effects of virtual interaction on social behavior, brain activity, and interbrain coupling. We found that virtual interactions were characterized by patterns of interbrain coupling that were negatively implicated in cooperation. Our findings are consistent with the perspective that videoconferencing technology adversely affects individuals and dyads during social interaction. As virtual interactions become even more necessary, improving the design of videoconferencing technology will be crucial for supporting effective communication.

Concurrent validity and reliability of at-home teleneuropsychological evaluations among people with and without HIV

OBJECTIVE

To determine the reliability of teleneuropsychological (TNP) compared to in-person assessments (IPA) in people with HIV (PWH) and without HIV (HIV-).

METHODS

Participants included 80 PWH (Mage = 58.7, SDage = 11.0) and 23 HIV- (Mage = 61.9, SDage = 16.7). Participants completed two comprehensive neuropsychological IPA before one TNP during the COVID-19 pandemic (March-December 2020). The neuropsychological tests included: Hopkins Verbal Learning Test-Revised (HVLT-R Total and Delayed Recall), Controlled Oral Word Association Test (COWAT; FAS-English or PMR-Spanish), Animal Fluency, Action (Verb) Fluency, Wechsler Adult Intelligence Scale 3rd Edition (WAIS-III) Symbol Search and Letter Number Sequencing, Stroop Color and Word Test, Paced Auditory Serial Addition Test (Channel 1), and Boston Naming Test. Total raw scores and sub-scores were used in analyses. In the total sample and by HIV status, test-retest reliability and performance-level differences were evaluated between the two consecutive IPA (i.e., IPA1 and IPA2), and mean in-person scores (IPA-M), and TNP.

RESULTS

There were statistically significant test-retest correlations between IPA1 and IPA2 (r or ρ = .603-.883, ps < .001), and between IPA-M and TNP (r or ρ = .622-.958, ps < .001). In the total sample, significantly lower test-retest scores were found between IPA-M and TNP on the COWAT (PMR), Stroop Color and Word Test, WAIS-III Letter Number Sequencing, and HVLT-R Total Recall (ps < .05). Results were similar in PWH only.

CONCLUSIONS

This study demonstrates reliability of TNP in PWH and HIV-. TNP assessments are a promising way to improve access to traditional neuropsychological services and maintain ongoing clinical research studies during the COVID-19 pandemic.

Telemedicine for neurological diseases: A systematic review and meta-analysis

BACKGROUND AND PURPOSE

The aim was to systematically review the effectiveness and safety of telemedicine combined with usual care (in-person visits) compared to usual care for the therapeutic management and follow-up assessment of neurological diseases.

METHODS

The electronic databases MEDLINE, Embase, Web of Science and Cochrane Central Register of Controlled Trials were searched (June 2021). Randomized controlled trials (RCTs) on patients of any age with neurological diseases were considered. Two reviewers screened and abstracted data in duplicate and independently and assessed risk of bias using the Cochrane risk-of-bias tool for randomized trials (RoB 2). When possible, pooled effect estimates were calculated.

RESULTS

Of a total of 3018 records initially retrieved, 25 RCTs (n = 2335) were included: 11 (n = 804) on stroke, four (n = 520) on Parkinson's disease, three (n = 110) on multiple sclerosis, two (n = 320) on epilepsy, one (n = 63) on dementia, one (n = 23) on spina bifida, one (n = 40) on migraine, one (n = 22) on cerebral palsy and one (n = 433) on brain damage. Types of telemedicine assessed were online visits (11 studies), tele-rehabilitation (seven studies), telephone calls (three), smartphone apps (two) and online computer software (two). The evidence was quite limited except for stroke. Compared to usual care alone, telemedicine plus usual care was found to improve depressive symptoms, functional status, motor function, executive function, generic quality of life, healthcare utilization and healthy lifestyle in patients in post-stroke follow-up.

CONCLUSIONS

Well-designed and executed RCTs are needed to confirm our findings on stroke and to have more scientific evidence available for the other neurological diseases.

A Systematic Review and a Latin American Clinical Model for Teleneuropsychological Assessment

OBJECTIVE

The objective of this study is to propose a TeleNP model for remote assessment and offer practical recommendations for clinical practice with patients in Mexico and Latin America, based on a systematic literature review and clinical experience.

METHOD

A systematic review of studies from 2011 to 2021 in English and Spanish used TeleNP, teleneuropsychology, telepsychology, online, assessment, teleneuropsicología, and evaluación for the search; the databases examined included PubMed, BiDi UNAM, ScienceDirect, Google Scholar, and Wiley One Library; the Oxford Centre for Evidence-Based Medicine system was used to grade the levels of evidence. The experience of the last two years of students and faculty in the Master's and Doctoral Programs in Psychology, Clinical Neuropsychology Residency Program, was also used as a basis for this guide.

RESULTS

We propose a clinical model for TeleNP assessment in Mexico and Latin America based on the review of 31 articles and the practice of professors and students of clinical neuropsychology.

CONCLUSION

The proposed model describes a procedure and adaptations for home-to-home clinical practice in the neuropsychological assessment of Mexican patients that could also be used in other Latin American countries. Its reliability remains to be assessed, but this model and the suggestions proposed could be used in future studies and clinical trials for Mexican and Latin American populations.

Evidence for the reliability and validity of a Spanish translation of the Medication Management Ability Assessment administered via tele-assessment

We translated the Medication Management Ability Assessment (MMAA) from English to Spanish for use via tele-assessment and examined its reliability and validity. Following International Test Commission Guidelines for Translating and Adapting Tests, we used translation/back-translation and a small focus group (n = 6) to adapt a Spanish version of the MMAA. Eighty-six Spanish-speaking adults completed the adapted MMAA via tele-assessment at baseline and at a two-week follow-up visit. Participants also completed several self-report and performance-based cognitive and functional measures. The internal consistency of the MMAA was excellent (standardized Cronbach's α = 0.90). Performance-based functional assessments (PBFAs) and objective cognition were positively associated with the MMAA at small to medium effect sizes. Self-report measures of daily function and cognition, measures of health literacy, and estimates of premorbid intellectual functioning were not significantly associated with MMAA performance. The test-retest reliability of the MMAA was good (CCC = 0.73, 95% CI [0.62, 0.81]; rs = 0.37, p < 0.001) and demonstrated a small practice effect (Cohen's d = 0.36, p = 0.001). Preliminary evidence for the construct validity of a Spanish-language MMAA administered via tele-assessment further expands the potential clinical utility of PBFAs in culturally diverse, Spanish-speaking populations.

Implementation of a Hybrid Teleneuropsychology Method to Assess Middle Aged and Older Adults During the COVID-19 Pandemic

Objective

Hybrid teleneuropsychology has emerged as a useful assessment method to manage physical distancing requirements during the COVID-19 pandemic. We describe the development of a hybrid teleneuropsychology clinic and compare results of six neuropsychological tasks across testing modalities, as well as a participant experience survey.

Method

Healthy middle-aged and older adults completed a face-to-face assessment two years previously. Participants either completed reassessment face-to-face or via the hybrid setup. Results were compared across time points and delivery modality.

Results

There were no significant differences in scores at reassessment between face-to-face and a hybrid setup on nonverbal fluid intelligence, verbal memory, visual memory, language, working memory or verbal initiation. Retest reliability was moderate to excellent for verbal and visual memory, attention and naming. Results of an anonymous survey indicated that participants felt comfortable and established good rapport with the examiner.

Conclusions

This hybrid method of teleneuropsychology can be used to obtain high quality and reliable results including on tasks yet to be evaluated for teleneuropsychology, including the Graded Naming Test and the Topographical Recognition Memory Test.

Investigating Clinician Experiences of Teleneuropsychology Service Implementation within Rural Inpatient Rehabilitation Settings: A Mixed Method Approach

OBJECTIVE

The aim of this study was to understand clinicians' experiences of teleneuropsychology service implementation within rural inpatient rehabilitation settings and the variability of those experiences across rural settings and clinical disciplines.

METHOD

Clinicians (n = 56 from four rehabilitation settings) who were involved in a hub-and-spoke teleneuropsychology service completed surveys throughout service implementation. A purposive sample of 16 clinicians then completed semi-structured interviews at the conclusion of the service implementation period. Quantitative data were analyzed descriptively and qualitative data were analyzed using thematic analysis, prior to the results being converged.

RESULTS

Four themes characterizing clinicians' experiences were identified. Pre- and early-implementation considerations included factors such as early collaboration and consultation, which were identified as important for service integration into rural settings. Facilitators/barriers included factors such as technology usability, which positively or negatively influenced service implementation. Benefits and outcomes included perceptions on the impact of the service, such as improved equity and quality of care in rural settings. Finally, future applications encapsulated what the clinicians envisaged for the future of teleneuropsychology services, such as hybrid teleneuropsychology/in-person services. Some differences were identified in clinicians' experiences across rural settings and disciplines, including preferences for technology infrastructure and satisfaction with teleneuropsychology sessions.

CONCLUSIONS

Most clinicians reported positive experiences and acceptability of the teleneuropsychology service. Facilitators and barriers, which can guide the successful establishment of future teleneuropsychology services, were identified. These findings may be used to contribute to improving equity and quality of care for people living with neuropsychological impairments, especially those living in rural areas.

Survey Findings About the Experiences, Challenges, and Practical Advice/Solutions Regarding Teleneuropsychological Assessment in Adults

OBJECTIVE

In the wake of the coronavirus pandemic, teleneuropsychology utilization has increased. There is a need to characterize the first-hand experiences of individuals using teleneuropsychology, identify the common teleneuropsychology challenges, and devise practical strategies for mitigating/resolving these challenges.

METHOD

Survey data were collected from U.S. based neuropsychologists and other individuals (e.g., graduate students and research assistants) who were engaged in remote cognitive assessment with adults (n = 87). Frequency analyses were conducted to examine: how respondents used teleneuropsychology (e.g., duration of use, types of measures and devices/technology platforms used); challenges that were encountered with different technology platforms and teleneuropsychology use; and advice for navigating these challenges.

RESULTS

Most respondents began using teleneuropsychology relatively recently in the context of the coronavirus pandemic, with home-to-home or clinic-to-home settings being the most frequently reported teleneuropsychology settings. Zoom®, Doxy.Me®, and MyChart® were the most frequently used platforms, largely due to workplace mandates and/or Health Insurance Portability and Accountability Act-compliant features. Common challenges with teleneuropsychology included internet connection issues and environmental distractions in examinees' homes, and examinees having limited-to-no access to technologies requisite for teleneuropsychology. Providing clear instructions to the examinee prior to the teleneuropsychology visit was the most common advice for ensuring a successful teleneuropsychology evaluation. Similar response patterns were generally noted for those who used TeleNP for clinical or research purposes.

CONCLUSIONS

These survey results reflect common experiences and challenges with teleneuropsychology and identify priority targets for increasing its feasibility, reliability, and validity. Findings provide context for the development of formal teleneuropsychology competencies.