1
|
DesRuisseaux LA, Gereau Mora M, Suchy Y. Computerized assessment of executive functioning: Validation of the CNS Vital Signs executive functioning scores in a sample of community-dwelling older adults. Clin Neuropsychol 2024:1-23. [PMID: 38763890 DOI: 10.1080/13854046.2024.2354953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Accepted: 05/09/2024] [Indexed: 05/21/2024]
Abstract
Objective: Computerized assessment of cognitive functioning has gained significant popularity over recent years, yet options for clinical assessment of executive functioning (EF) are lacking. One computerized testing platform, CNS Vital Signs (CNS-VS), offers tests designed to measure EF but requires further validation. The goal of the present study was to validate CNS-VS executive scores against standard clinical measures of EF. We also sought to determine whether a modified CNS-VS composite score that included variables purported to measure inhibition, switching, and working memory would outperform the currently available CNS-VS Executive Function Index. Method: A sample of 73 cognitively healthy older adults completed four tests from the Delis-Kaplan Executive Function System, the Digit Span subtest from the Wechsler Adult Intelligence Scale-fourth edition, and three CNS-VS tasks purported to measure inhibition, switching, and working memory. Results: Performances on the CNS-VS tests were predicted by performances on standard paper-and-pencil measures. Although the currently available CNS-VS Executive Function Index predicted unique variance in a well-validated paper-and-pencil EF composite score, our Modified CNS-VS EF composite accounted for unique variance above and beyond the original CNS-VS Executive Function Index, while the reverse was not true. Conclusions: The present results support the construct validity of CNS-VS EF tests but also suggest that modifications to their current composite scores would improve the prediction of EF performance.
Collapse
Affiliation(s)
| | | | - Yana Suchy
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| |
Collapse
|
2
|
Bettencourt C, Pires L, Almeida F, Vilar M, Cruz H, Leitão J, Allen Gomes A. Chronotype, Time of Day, and Children's Cognitive Performance in Remote Neuropsychological Assessment. Behav Sci (Basel) 2024; 14:310. [PMID: 38667106 PMCID: PMC11047315 DOI: 10.3390/bs14040310] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2024] [Revised: 04/06/2024] [Accepted: 04/08/2024] [Indexed: 04/29/2024] Open
Abstract
Research on the influence of chronotype and time of day (TOD) on cognitive performance, especially in children, is limited. We explored potential interactive effects, hypothesizing that performance differs when comparing preferred vs. non-preferred TOD. In total, 76 morning-type (MT = 37) or evening-type (ET = 39) children from the third and fourth grades (48.7% girls; M age = 8.05; SD age = 0.51), identified through the Children Chronotype Questionnaire, completed two 30-min neuropsychological assessment sessions via videoconference on the first (9:00) or last hour (16:00) of the school day. The protocol included neuropsychological tests targeting memory, language, and attention/executive domains. The results revealed an interactive effect of medium size between chronotype and TOD on a Rapid Alternating Stimulus (Naming) Task. MT and ET performed faster in asynchrony conditions (morning for ET; afternoon for MT). Additionally, ET outperformed MT in a Backward Digit Span Task, irrespective of TOD. TOD also influenced performance on an Alternating Verbal Fluency Task, with both MT and ET children performing better in the morning. These results underscore the importance of chronotype and TOD in children's cognitive performance, particularly in working memory and verbal fluency. Children assessed during non-preferred TOD exhibited better performance on some cognitive tasks, challenging the assumption that optimal times always yield superior results.
Collapse
Affiliation(s)
- Catarina Bettencourt
- Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115 Coimbra, Portugal; (L.P.); (F.A.); (M.V.); (J.L.); (A.A.G.)
- Centre for Research in Neuropsychology and Cognitive Behavioral Intervention, University of Coimbra, 3000-115 Coimbra, Portugal
- Laboratory of Chronopsychology and Cognitive Systems (ChronCog), University of Coimbra, 3000-115 Coimbra, Portugal
| | - Luís Pires
- Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115 Coimbra, Portugal; (L.P.); (F.A.); (M.V.); (J.L.); (A.A.G.)
- Centre for Research in Neuropsychology and Cognitive Behavioral Intervention, University of Coimbra, 3000-115 Coimbra, Portugal
- Laboratory of Chronopsychology and Cognitive Systems (ChronCog), University of Coimbra, 3000-115 Coimbra, Portugal
- Department of Psychology and Education, Faculty of Human and Social Sciences, University of Beira Interior, 6200-209 Covilhã, Portugal
| | - Filipa Almeida
- Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115 Coimbra, Portugal; (L.P.); (F.A.); (M.V.); (J.L.); (A.A.G.)
- Centre for Research in Neuropsychology and Cognitive Behavioral Intervention, University of Coimbra, 3000-115 Coimbra, Portugal
- Laboratory of Chronopsychology and Cognitive Systems (ChronCog), University of Coimbra, 3000-115 Coimbra, Portugal
| | - Manuela Vilar
- Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115 Coimbra, Portugal; (L.P.); (F.A.); (M.V.); (J.L.); (A.A.G.)
- Centre for Research in Neuropsychology and Cognitive Behavioral Intervention, University of Coimbra, 3000-115 Coimbra, Portugal
| | - Hugo Cruz
- Interdisciplinary Research Centre for Education and Development (CeiED), Lusófona University, 1700-284 Lisboa, Portugal;
| | - José Leitão
- Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115 Coimbra, Portugal; (L.P.); (F.A.); (M.V.); (J.L.); (A.A.G.)
- Centre for Research in Neuropsychology and Cognitive Behavioral Intervention, University of Coimbra, 3000-115 Coimbra, Portugal
- Laboratory of Chronopsychology and Cognitive Systems (ChronCog), University of Coimbra, 3000-115 Coimbra, Portugal
| | - Ana Allen Gomes
- Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115 Coimbra, Portugal; (L.P.); (F.A.); (M.V.); (J.L.); (A.A.G.)
- Centre for Research in Neuropsychology and Cognitive Behavioral Intervention, University of Coimbra, 3000-115 Coimbra, Portugal
- Laboratory of Chronopsychology and Cognitive Systems (ChronCog), University of Coimbra, 3000-115 Coimbra, Portugal
| |
Collapse
|
3
|
Gierzynski TF, Gregoire A, Reader JM, Pantis R, Campbell S, Bhaumik A, Rahman-Filipiak A, Heidebrink J, Giordani B, Paulson H, Hampstead BM. Evaluation of the Uniform Data Set version 3 teleneuropsychological measures. J Int Neuropsychol Soc 2024; 30:183-193. [PMID: 37366070 PMCID: PMC10751395 DOI: 10.1017/s1355617723000383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Abstract
OBJECTIVE Few studies have evaluated in-home teleneuropsychological (teleNP) assessment and none, to our knowledge, has evaluated the National Alzheimer's Coordinating Center's (NACC) Uniform Data Set version 3 tele-adapted test battery (UDS v3.0 t-cog). The current study evaluates the reliability of the in-home UDS v3.0 t-cog with a prior in-person UDS v3.0 evaluation. METHOD One hundred and eighty-one cognitively unimpaired or cognitively impaired participants from a longitudinal study of memory and aging completed an in-person UDS v3.0 and a subsequent UDS v3.0 t-cog evaluation (∼16 months apart) administered either via video conference (n = 122) or telephone (n = 59). RESULTS We calculated intraclass correlation coefficients (ICCs) between each time point for the entire sample. ICCs ranged widely (0.01-0.79) but were generally indicative of "moderate" (i.e., ICCs ranging from 0.5-0.75) to "good" (i.e., ICCs ranging from 0.75-0.90) agreement. Comparable ICCs were evident when looking only at those with stable diagnoses. However, relatively stronger ICCs (Range: 0.35-0.87) were found between similarly timed in-person UDS v3.0 evaluations. CONCLUSIONS Our findings suggest that most tests on the UDS v3.0 t-cog battery may serve as a viable alternative to its in-person counterpart, though reliability may be attenuated relative to the traditional in-person format. More tightly controlled studies are needed to better establish the reliability of these measures.
Collapse
Affiliation(s)
| | - Allyson Gregoire
- Department of Neurology, University of Michigan, Ann Arbor, MI, USA
| | | | - Rebecca Pantis
- Department of Neurology, University of Michigan, Ann Arbor, MI, USA
| | - Stephen Campbell
- Department of Neurology, University of Michigan, Ann Arbor, MI, USA
| | - Arijit Bhaumik
- Department of Neurology, University of Michigan, Ann Arbor, MI, USA
| | | | | | - Bruno Giordani
- Department of Neurology, University of Michigan, Ann Arbor, MI, USA
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, USA
| | - Henry Paulson
- Department of Neurology, University of Michigan, Ann Arbor, MI, USA
| | - Benjamin M. Hampstead
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, USA
- VA Ann Arbor Healthcare System, Mental Health Service, Ann Arbor, MI, USA
| |
Collapse
|
4
|
Brown T, Zakzanis KK. A review of the reliability of remote neuropsychological assessment. Appl Neuropsychol Adult 2023:1-7. [PMID: 38000083 DOI: 10.1080/23279095.2023.2279208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/26/2023]
Abstract
The provision of clinical neuropsychological services has predominately been undertaken by way of standardized administration in a face-to-face setting. Interpretation of psychometric findings in this context is dependent on the use of normative comparison. When the standardization in which such psychometric measures are employed deviates from how they were employed in the context of the development of its associated norms, one is left to question the reliability and hence, validity of any such findings and in turn, diagnostic decision making. In light of the current COVID-19 pandemic and resultant social distancing direction, face-to-face neuropsychological assessment has been challenging to undertake. As such, remote (i.e., virtual) neuropsychological assessment has become an obvious solution. Here, and before the results from remote neuropsychological assessment can be said to stand on firm scientific grounds, it is paramount to ensure that results garnered remotely are reliable and valid. To this end, we undertook a review of the literature and present an overview of the landscape. To date, the literature shows evidence for the reliability of remote administration and the clinical implications are paramount. When and where needed, neuropsychologists, psychometric technicians and examinees may no longer need to be in the same physical space to undergo an assessment. These findings are most relevant given the physical distancing practices because of COVID-19. And whilst remote assessment should never supplant face-to-face neuropsychological assessments, it does serve as a valid alternative when necessary.
Collapse
Affiliation(s)
- Tyler Brown
- Graduate Department of Psychological Clinical Science, University of Toronto, Toronto, ON, Canada
| | - Konstantine K Zakzanis
- Graduate Department of Psychological Clinical Science, University of Toronto, Toronto, ON, Canada
- Department of Psychology, University of Toronto, Scarborough, ON, Canada
| |
Collapse
|
5
|
Smith V, Younes K, Poston KL, Mormino EC, Young CB. Reliability of remote National Alzheimer's Coordinating Center Uniform Data Set data. Alzheimers Dement (Amst) 2023; 15:e12498. [PMID: 38034852 PMCID: PMC10687343 DOI: 10.1002/dad2.12498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 10/14/2023] [Accepted: 10/19/2023] [Indexed: 12/02/2023]
Abstract
INTRODUCTION The National Alzheimer's Coordinating Center (NACC) Uniform Data Set (UDS) neuropsychological battery is being used to track cognition in participants across the country, but it is unknown if scores obtained through remote administration can be combined with data obtained in person. METHODS The remote UDS battery includes the blind version of the Montreal Cognitive Assessment (MoCA), Number Span, Semantic and Phonemic Fluency, and Craft Story. For these tests, we assessed intraclass correlation coefficients (ICCs) between in-person and remote scores in 3838 participants with both in-person and remote UDS assessments, and we compared annual score changes between modalities in a subset that had two remote assessments. RESULTS All tests exhibited moderate to good reliability between modalities (ICCs = 0.590-0.787). Annual score changes were also comparable between modalities except for Craft Story Immediate Recall, Semantic Fluency, and Phonemic Fluency. DISCUSSION Our findings generally support combining remote and in-person scores for the majority of UDS tests.
Collapse
Affiliation(s)
- Viktorija Smith
- Department of Neurology and Neurological SciencesStanford University School of MedicinePalo AltoCaliforniaUSA
| | - Kyan Younes
- Department of Neurology and Neurological SciencesStanford University School of MedicinePalo AltoCaliforniaUSA
| | - Kathleen L. Poston
- Department of Neurology and Neurological SciencesStanford University School of MedicinePalo AltoCaliforniaUSA
| | - Elizabeth C. Mormino
- Department of Neurology and Neurological SciencesStanford University School of MedicinePalo AltoCaliforniaUSA
| | - Christina B. Young
- Department of Neurology and Neurological SciencesStanford University School of MedicinePalo AltoCaliforniaUSA
| |
Collapse
|
6
|
Raimo S, Santangelo G, Cropano M, Gaita M, Ammendola L, Malangone D, Lus G, Signoriello E. Comparing face-to-face and videoconference assessment of the Brief Repeatable Battery of Neuropsychological Tests in people with multiple sclerosis. Mult Scler 2023; 29:1337-1339. [PMID: 37602442 DOI: 10.1177/13524585231192469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/22/2023]
Abstract
BACKGROUND The COVID-19 pandemic has underlined the need to evaluate cognitive profile via videoconferencing (teleneuropsychology, TeleNP) as a suitable alternative to face-to-face assessment (F-F). OBJECTIVE To evaluate the feasibility and the reliability of Rao's Brief Repeatable Battery of Neuropsychological Tests (R-BRB) remote administration in people with multiple sclerosis (PwMS). METHODS Sixty PwMS underwent R-BRB in two conditions: F-F and TeleNP, 1 month apart. RESULTS Cognitive test performance was similar, regardless of the administration type, but visuospatial test performance was better in F-F. CONCLUSION These data suggest that TeleNP is feasible and highly reliable in MS clinical practice.
Collapse
Affiliation(s)
- Simona Raimo
- Department of Medical and Surgical Sciences, "Magna Graecia" University of Catanzaro, Catanzaro, Italy
| | - Gabriella Santangelo
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Maria Cropano
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
- Department of Precision Medicine, University of Campania "Luigi Vanvitelli," Napoli, Italy
| | - Mariachiara Gaita
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Lidia Ammendola
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Daniela Malangone
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Giacomo Lus
- Multiple Sclerosis Center, II Neurological Clinic, University of Campania "Luigi Vanvitelli," Napoli, Italy
- Department of Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli," Napoli, Italy
| | - Elisabetta Signoriello
- Multiple Sclerosis Center, II Neurological Clinic, University of Campania "Luigi Vanvitelli," Napoli, Italy
- Department of Medical and Surgical Sciences, University of Campania "Luigi Vanvitelli," Napoli, Italy
| |
Collapse
|
7
|
Negrini D, Schmidt SL. Comparing online and face-to-face administration of a neuropsychological computerized attention test: Assessment modality does not influence performance. Front Psychol 2023; 14:1134047. [PMID: 37179859 PMCID: PMC10169630 DOI: 10.3389/fpsyg.2023.1134047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 03/29/2023] [Indexed: 05/15/2023] Open
Abstract
Background The cognitive impairment associated with the COVID-19 pandemic highlighted the need for teleneuropsychology (1). Moreover, neurologic diseases associated with mental deterioration usually require the use of the same neuropsychological instrument to assess cognitive changes across time. Therefore, in such cases, a learning effect upon retesting is not desired. Attention and its subdomains can be measured using Go/no-go tests, such as, the Continuous Visual Attention Test (CVAT). Here, we administered the CVAT to investigate the effect of modality (online vs. face-to-face) on attentional performance. The variables of the CVAT measures four attention domains: focused-attention, behavioral-inhibition, intrinsic-alertness (reaction time, RT), and sustained-attention (intra-individual variability of RTs, VRT). Methods The CVAT was applied face-to face and online in 130 adult Americans and 50 adult Brazilians. Three different study designs were used: (1) Between-subjects design: healthy Americans were tested face-to-face (n = 88) or online (n = 42). We verified if there were any differences between the two modalities. (2) Within-subjects design: Brazilians participants (n = 50) were tested twice (online and face-to-face). For each CVAT variable, repeated measures ANCOVAs were performed to verify whether modality or first vs. second tests differ. Agreement was analyzed using Kappa, intraclass correlation coefficients, and Bland-Altman plots. (3) Paired comparisons: we compared Americans vs. Brazilians, pairing subjects by age, sex, and level of education, grouping by modality. Results Assessment modality did not influence performance using two independent samples (between-subjects design) or the same individual tested twice (within-subjects design). The second test and the first test did not differ. Data indicated significant agreements for the VRT variable. Based on paired samples, Americans did not differ from Brazilians and a significant agreement was found for the VRT variable. Conclusion The CVAT can be administered online or face-to-face without learning upon retesting. The data on agreement (online vs. face-to-face, test vs. retest, Americans vs. Brazilians) indicate that VRT is the most reliable variable. Limitations High educational level of the participants and absence of a perfect balanced within-subjects design.
Collapse
Affiliation(s)
- Daniel Negrini
- Department of Anesthesiology, Federal University of the State of Rio de Janeiro, Rio de Janeiro, Brazil
- School of Medicine, Fluminense Federal University, Niterói, Brazil
| | - Sergio L. Schmidt
- Department of Neurology, Federal University of the State of Rio de Janeiro, Rio de Janeiro, Brazil
| |
Collapse
|
8
|
Brown AD, Kelso W, Velakoulis D, Farrand S, Stolwyk RJ. Understanding Clinician's Experiences with Implementation of a Younger Onset Dementia Telehealth Service. J Geriatr Psychiatry Neurol 2022:8919887221141653. [PMID: 36433702 DOI: 10.1177/08919887221141653] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
The successful implementation of telehealth services depends largely on clinician acceptance of telehealth as a viable healthcare option and their adoption of telehealth methods into their clinical practice. While growing research supports the feasibility of telehealth services, no research has evaluated clinicians' experiences during the implementation of a younger onset dementia telehealth service. Semi-structured group interviews were conducted with 7 metropolitan (hub) clinicians and 16 rural (spoke) clinicians during the pre-and post-implementation phases of a novel Younger onset dementia (YOD) telehealth service. Reflexive thematic analysis identified five themes at pre-implementation: clinical need, previous experiences and views, potential telehealth barriers, solutions to potential telehealth barriers, and potential clinical outcomes. At post-implementation, nine themes were identified: clinical need, clinical relationships, concerns about the future of rural healthcare, clinical practice and resourcing factors, patient suitability, difficulties with technology, service quality, the way forward, and the impact of COVID-19. Most clinicians held positive views regarding the service, particularly the ability to provide more options to rural-dwelling patients. However, some concerns about threats to rural healthcare and the validity of telehealth assessments remained. Overall, this study has identified service implementation barriers and facilitators and contributes to the long-term sustainability of current and future telehealth YOD services.
Collapse
Affiliation(s)
- Aimee D Brown
- Turner Institute for Brain and Mental Health, 2541School of Psychological Sciences, Monash University, Melbourne, Australia.,Monash-Epworth Rehabilitation Research Centre, Monash University, Melbourne, Australia
| | - Wendy Kelso
- Neuropsychiatry, North Western Mental Health, Royal Melbourne Hospital, Parkville, Victoria, Australia
| | - Dennis Velakoulis
- Neuropsychiatry, North Western Mental Health, Royal Melbourne Hospital, Parkville, Victoria, Australia
| | - Sarah Farrand
- Neuropsychiatry, North Western Mental Health, Royal Melbourne Hospital, Parkville, Victoria, Australia
| | - Renerus J Stolwyk
- Turner Institute for Brain and Mental Health, 2541School of Psychological Sciences, Monash University, Melbourne, Australia.,Monash-Epworth Rehabilitation Research Centre, Monash University, Melbourne, Australia
| |
Collapse
|
9
|
Fox-Fuller JT, Ngo J, Pluim CF, Kaplan RI, Kim DH, Anzai JAU, Yucebas D, Briggs SM, Aduen PA, Cronin-Golomb A, Quiroz YT. Initial investigation of test-retest reliability of home-to-home teleneuropsychological assessment in healthy, English-speaking adults. Clin Neuropsychol 2022; 36:2153-2167. [PMID: 34311660 PMCID: PMC8789947 DOI: 10.1080/13854046.2021.1954244] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Prior teleneuropsychological research has assessed the reliability between in-person and remote administration of cognitive assessments. Few, if any, studies have examined the test-retest reliability of cognitive assessments conducted in sequential clinic-to-home or home-to-home teleneuropsychological evaluations - a critical issue given the state of clinical practice during the COVID-19 pandemic. This study examined this key psychometric question for several cognitive tests administered over repeated videoconferencing visits 4-6 months apart in a sample of healthy English-speaking adults. A total of 44 participants (ages 18-75) completed baseline and follow-up cognitive testing 4-6 months apart. Testing was conducted in a home-to-home setting over HIPAA-compliant videoconferencing meetings on participants' audio-visual enabled laptop or desktop computers. The following measures were repeated at both virtual visits: the Controlled Oral Word Association Test (FAS), Category Fluency (Animals), and Digit Span Forward and Backward from the Wechsler Adult Intelligence Scale, Fourth Edition. Intraclass correlation coefficients (ICC), Pearson correlations, root mean square difference (RMSD), and concordance correlation coefficients (CCC) were calculated as test-retest reliability metrics, and practice effects were assessed using paired-samples t-tests. Some tests exhibited small practice effects, and test-retest reliability was marginal or worse for all measures except FAS, which had adequate reliability (based on ICC and r). Reliability estimates with RMSD suggested that change within +/- 1 SD on these measures may reflect typical test-retest variability. The included cognitive measures exhibited questionable reliability over repeated home-to-home videoconferencing evaluations. Future teleneuropsychology test-retest reliability research is needed with larger, more diverse samples and in clinical populations.
Collapse
Affiliation(s)
- Joshua T. Fox-Fuller
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA,Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Julie Ngo
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Celina F. Pluim
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA,Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Rini I. Kaplan
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Dong-Ho Kim
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Juliana A. U. Anzai
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Defne Yucebas
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Soibifaa M. Briggs
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Paula A. Aduen
- Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Alice Cronin-Golomb
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Yakeel T. Quiroz
- Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, USA,Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
10
|
Cian V, De Laurenzis A, Siri C, Gusmeroli A, Canesi M. Cognitive and Neuropsychiatric Features of COVID-19 Patients After Hospital Dismission: An Italian Sample. Front Psychol 2022; 13:908363. [PMID: 35686079 PMCID: PMC9173000 DOI: 10.3389/fpsyg.2022.908363] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Accepted: 05/02/2022] [Indexed: 11/17/2022] Open
Abstract
Background and Aims Recent studies suggest cognitive, emotional, and behavioral impairments occur in patients after SARS-CoV-2 infection. However, studies are limited to case reports or case series and, to our knowledge, few of them have control groups. This study aims to assess the prevalence of neuropsychological and neuropsychiatric impairment in patients after hospitalization. Methods We enrolled 29 COVID+ patients (M/F: 17/12; age 58.41 ± 10.00 years; education 11.07 ± 3.77 years, 2 left handers) who needed hospitalization but no IC, about 20 days post-dismission, and 29 COVID- healthy matched controls. Neuropsychological and neuropsychiatric assessments were conducted via teleneuropsychology using the following tests: MMSE, CPM47, RAVLT, CDT, Digit-Span Forward/Backward, Verbal fluencies; BDI-II, STAI. People with previous reported cognitive impairment and neurological or psychiatric conditions were excluded. Clinical and demographics were collected. Comparison between groups was conducted using parametric or non-parametric tests according to data distribution (T-test, Mann Withney-U test; Chi-square goodness of fit). Within COVID+ group, we also evaluated the correlation between the cognitive and behavioral assessment scores and clinical variables collected. Results Among COVID+, 62% had at least one pathological test (vs. 13% in COVID-; p = 0.000) and significantly worst performances than COVID- in RAVLT learning (42.55 ± 10.44 vs. 47.9 ± 8.29, p = 0.035), RAVLT recall (8.79 ± 3.13 vs. 10.38 ± 2.19, p = 0.03), and recognition (13.69 ± 1.47 vs. 14.52 ± 0.63, p = 0.07). STAI II was higher in COVID- (32.69 ± 7.66 vs. 39.14 ± 7.7, p = 0.002). Chi-square on dichotomous values (normal/pathological) showed a significant difference between groups in Digit backward test (pathological 7/29 COVID+ vs. 0/29 COVID-; p = 0.005). Conclusions Patients COVID+ assessed by teleneuropsychology showed a vulnerability in some memory and executive functions (working memory, learning, delayed recall, and recognition). Intriguingly, anxiety was higher in the control group. Our findings therefore confirm the impact of COVID-19 on cognition even in patients who did not need IC. Follow-up is needed to evaluate the evolution of COVID-19-related cognitive deficit. Clinical Trial Registration [ClinicalTrials.gov], identifier [NCT05143320].
Collapse
Affiliation(s)
- Veronica Cian
- Parkinson’s Disease Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
- Movement Disorders Rehabilitation Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
| | - Alessandro De Laurenzis
- Parkinson’s Disease Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
- Movement Disorders Rehabilitation Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
| | - Chiara Siri
- Parkinson’s Disease Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
- Movement Disorders Rehabilitation Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
| | - Anna Gusmeroli
- Parkinson’s Disease Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
- Movement Disorders Rehabilitation Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
| | - Margherita Canesi
- Parkinson’s Disease Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
- Movement Disorders Rehabilitation Department, Moriggia-Pelascini Hospital, Gravedona ed Uniti, Italy
| |
Collapse
|
11
|
Van Patten R. Introduction to the Special Issue - Neuropsychology from a distance: Psychometric properties and clinical utility of remote neurocognitive tests. J Clin Exp Neuropsychol 2022; 43:767-773. [PMID: 35133240 DOI: 10.1080/13803395.2021.2021645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Ryan Van Patten
- Department of Psychiatry and Human Behavior, Alpert Medical School of Brown, University, Providence, RI, USA.,Providence VA Medical Center, Providence, RI, USA
| |
Collapse
|
12
|
Singh S, Strong RW, Jung L, Li FH, Grinspoon L, Scheuer LS, Passell EJ, Martini P, Chaytor N, Soble JR, Germine L. The TestMyBrain Digital Neuropsychology Toolkit: Development and Psychometric Characteristics. J Clin Exp Neuropsychol 2021; 43:786-795. [PMID: 34907842 DOI: 10.1080/13803395.2021.2002269] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
INTRODUCTION To allow continued administration of neuropsychological evaluations remotely during the pandemic, tests from the not-for-profit platform, TestMyBrain.org (TMB), were used to develop the TMB Digital Neuropsychology Toolkit (DNT). This study details the psychometric characteristics of the DNT, as well as the infrastructure and development of the DNT. METHOD The DNT was primarily distributed for clinical use, with (72.8%) of individuals requesting access for clinical purposes. To assess reliability and validity of the DNT, anonymous data from DNT test administrations were analyzed and compared to a large, non-clinical normative sample from TMB. RESULTS DNT test scores showed acceptable to very good split-half reliability (.68-.99). Factor analysis revealed three latent factors, corresponding to processing speed, working memory, and a broader general cognitive ability factor that included perceptual reasoning and episodic memory. Average test scores were slightly poorer for the DNT sample than for the TMB comparison sample, as expected given the clinical use of the DNT. CONCLUSIONS Initial estimates of reliability and validity of DNT tests support their use as digital measures of neuropsychological functioning. Tests within cognitive domains correlated highly with each other and demonstrated good reliability and validity. Future work will seek to validate DNT tests in specific clinical populations and determine best practices for using DNT outcome measures to assess engagement and psychological symptomatology.
Collapse
Affiliation(s)
- Shifali Singh
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Roger W Strong
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Laneé Jung
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Frances Haofei Li
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Liz Grinspoon
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Luke S Scheuer
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Eliza J Passell
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Paolo Martini
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Naomi Chaytor
- Elson S. Floyd College of Medicine, Washington State University, Spokane, WA, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| | - Laura Germine
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
13
|
Abstract
PURPOSE We investigated the impacts of the COVID-19 pandemic on the modality of formal cognitive assessments (in-person versus remote assessments). MATERIALS AND METHODS We created a web-based survey with 34 items and collected data from 114 respondents from a range of health care professions and settings. We established the proportion of cognitive assessments which were face-to-face or via video or telephone conferencing, both pre- and post-March 2020. Further, we asked respondents about the assessment tools used and perceived barriers, challenges, and facilitators for the remote assessment of cognition. In addition, we asked questions specifically about the use of the Oxford Cognitive Screen. RESULTS We found that the frequency of assessing cognition was stable compared to pre-pandemic levels. Use of telephone and video conferencing cognitive assessments increased by 10% and 18% respectively. Remote assessment increased accessibility to participants and safety but made observing the subtleties of behaviour during test administration difficult. The respondents called for an increase in the availability of standardised, validated, and normed assessments. CONCLUSIONS We conclude that the pandemic has not been detrimental to the frequency of cognitive assessments. In addition, a shift in clinical practice to include remote cognitive assessments is clear and wider availability of validated and standardised remote assessments is necessary.IMPLICATIONS FOR REHABILITATIONWe caution the wider use and interpretation of remote formal cognitive assessments due to lack of validated, standardised, and normed assessments in a remote format.Clinicians should seek out the latest validation and normative data papers to ensure they are using the most up to date tests and respective cut offs.Support is needed for individuals who lack knowledge/have anxiety over the use of technology in formal cognitive assessments.
Collapse
Affiliation(s)
- Sam S Webb
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Eirini Kontou
- School of Medicine, University of Nottingham, Nottingham, UK.,Nottinghamshire Healthcare NHS Foundation Trust, Nottingham, UK
| | - Nele Demeyere
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| |
Collapse
|
14
|
Pulsifer MB, Grieco JA, Burstein SM, Parsons MW, Gardner MM, Sherman JC. The development and implementation of teleneuropsychology in an academic lifespan neuropsychology center: Lessons learned from the COVID-19 pandemic. J Clin Exp Neuropsychol 2021; 43:774-785. [PMID: 34384335 DOI: 10.1080/13803395.2021.1963683] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
INTRODUCTION Teleneuropsychology (TNP) became a critical means for providing care during the COVID-19 pandemic and may continue as an option for delivery of neuropsychological services. To understand how patient characteristics impact clinician decisions and service models, this study examines practice patterns within a lifespan outpatient neuropsychology center before, during and post-pandemic. METHODS Patient volume, demographics, and characteristics were compared across four, 3-month time intervals in 2019-2020. Two baseline intervals when the center was physically open (PO) were compared to one interval when the center was physically closed (PC) (all evaluations were conducted via direct-to-home TNP) and a fourth interval when the center was physically reopened (RO) and evaluations were conducted in one of the three modalities: in-person, virtual only or hybrid (both virtual/in-person). RESULTS A total of 1,459 total neuropsychological evaluations were conducted with a 64.6% reduction during PC. At RO, the number of evaluations returned to pre-COVID baseline during which in-person (72.4%) evaluations were conducted at a higher rate than hybrid (7.1%) or virtual only (20.4%). Across the lifespan, mean number of appointments to complete evaluations was significantly greater during PC (p< .001) than at other time intervals, and during RO, hybrid evaluations required significantly more appointments (p < .001) than in-person and virtual. The majority of evaluations were conducted with adult patients (71.4%). For adult patients, neurodegenerative/memory disorders received TNP evaluations at a higher rate during PC and RO. Pediatric patients were significantly older during PC (p < .001); neurodevelopmental referrals received more hybrid and virtual evaluations. CONCLUSIONS Results indicate that patient characteristics, especially age and referral categories, impact the feasibility of TNP. Data from the RO period suggest that in-person evaluations not surprisingly remain the mainstay; however, for adult patients, and especially older adults with neurodegenerative/memory disorders, TNP may provide an important option for delivery of neuropsychological evaluations.
Collapse
Affiliation(s)
- Margaret B Pulsifer
- Department of Psychiatry/Harvard Medical School, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Julie A Grieco
- Department of Psychiatry/Harvard Medical School, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Sarah M Burstein
- Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Michael W Parsons
- Department of Psychiatry/Harvard Medical School, Massachusetts General Hospital, Boston, Massachusetts, USA.,Stephen E. & Catherine Pappas Center for Neuro-Oncology, Boston, Massachusetts, USA
| | - Melissa M Gardner
- Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Janet C Sherman
- Department of Psychiatry/Harvard Medical School, Massachusetts General Hospital, Boston, Massachusetts, USA
| |
Collapse
|
15
|
Gardner MM, Aslanzadeh FJ, Zarrella GV, Braun SE, Loughan AR, Parsons MW. Cancer, cognition, and COVID: delivering direct-to-home teleneuropsychology services to neuro-oncology patients. Neurooncol Pract 2021; 8:485-496. [PMID: 34267923 PMCID: PMC8083492 DOI: 10.1093/nop/npab021] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
BACKGROUND The COVID-19 pandemic induced rapid adoption of telemedicine services for neuro-oncology patients at an increased risk of infection. Neuropsychological assessment is important to neuro-oncology care yet challenging to complete outside of a structured testing environment. Teleneuropsychology (TNP) has been explored in limited populations and proven feasible and reliable. Conducting TNP visits directly to patients' home (DTH) had minimal prior study. METHODS We used two voluntary surveys to examine acceptance (patients) and feasibility (providers) of DTH-TNP at two regionally diverse medical institutions providing neuropsychological services to neuro-oncology patients from April to September 2020. RESULTS A total of 119 patients were scheduled during the study period, 79 of whom completed neuropsychological testing via DTH-TNP. Neuropsychology providers completed surveys on 68 of these encounters (86%). In 98% of cases, neuropsychologists were able to achieve or partially achieve the individually defined goals of their assessment. Common problems reported included patient dysregulation (16%) and slow/unreliable internet (15%). Of the 52 patients who responded, 98% were satisfied with the DTH-TNP experience, and 92% would recommend the virtual visit to others. All respondents felt understood by the examiner (100%) and the majority denied technical difficulties (90%), communication challenges (94%), or privacy concerns (98%). Patients reported reduced risk of infection and saved travel time as favorable aspects of DTH-TNP. CONCLUSIONS These preliminary results suggest neuro-oncology patients find DTH-TNP acceptable and neuropsychologists find it a feasible practice, while also recognizing its limitations. Results suggest that further study of DTH-TNP (eg, reliability, validity) for neuro-oncology patients is warranted.
Collapse
Affiliation(s)
- Melissa M Gardner
- Department of Psychiatry, Psychology Assessment Center, Massachusetts General Hospital/Harvard Medical School, Boston, Massachusetts, USA
- William James College, Newton, Massachusetts, USA
| | - Farah J Aslanzadeh
- Department of Psychology, Virginia Commonwealth University, Richmond, Virginia, USA
| | - Giuliana V Zarrella
- Department of Psychiatry, Psychology Assessment Center, Massachusetts General Hospital/Harvard Medical School, Boston, Massachusetts, USA
| | - Sarah E Braun
- School of Medicine, Department of Neurology, Division of Neuro-Oncology, Virginia Commonwealth University, Richmond, Virginia, USA
- Massey Cancer Center, Richmond, Virginia, USA
| | - Ashlee R Loughan
- School of Medicine, Department of Neurology, Division of Neuro-Oncology, Virginia Commonwealth University, Richmond, Virginia, USA
- Massey Cancer Center, Richmond, Virginia, USA
| | - Michael W Parsons
- Department of Psychiatry, Psychology Assessment Center, Massachusetts General Hospital/Harvard Medical School, Boston, Massachusetts, USA
- Stephen and Catherine Pappas Center for Neuro-Oncology, Massachusetts General Hospital/Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
16
|
Alegret M, Espinosa A, Ortega G, Pérez-Cordón A, Sanabria Á, Hernández I, Marquié M, Rosende-Roca M, Mauleón A, Abdelnour C, Vargas L, de Antonio EE, López-Cuevas R, Tartari JP, Alarcón-Martín E, Tárraga L, Ruiz A, Boada M, Valero S. From Face-to-Face to Home-to-Home: Validity of a Teleneuropsychological Battery. J Alzheimers Dis 2021; 81:1541-1553. [PMID: 33935075 PMCID: PMC8293645 DOI: 10.3233/jad-201389] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
Background: Over the last decade, teleneuropsychology has increased substantially. There is a need for valid neuropsychological batteries to be administered home-to-home. Since 2006, the neuropsychological battery of Fundació ACE (NBACE) has been administered face-to-face in our clinical settings. Recently, we adapted the NBACE for teleneuropsychology use to be administered home-to-home (NBACEtn). Objective: The aims of the present study are: 1) to determine the home-to-home NBACE equivalence compared to its original face-to-face version; and 2) to examine home-to-home NBACE discriminant capacity by differentiating among cognitively healthy, mild cognitive impairment, or mild dementia subjects and comparing it with the face-to-face version. Methods: Data from 338 individuals assessed home-to-home (NBACEtn) were contrasted with 7,990 participants assessed with its face-to-face version (NBACE). Exploratory and confirmatory factorial structure, and invariance analysis of the two versions of the battery were performed. Results: Exploratory and confirmatory factor analysis supported the four-factor model (attention, memory, executive, and visuospatial/constructional functions). Configural, metric, and scalar measurement invariance was found between home-to-home and face-to-face NBACE versions. Significant differences in most of the neuropsychological variables assessed were observed between the three clinical groups in both versions of administration. No differences were found between the technological devices used by participants (computer or tablet and mobile devices). Conclusion: For the first time, invariance analysis findings were addressed by determining a teleneuropsychological battery’s equivalence in comparison with its face-to-face version. This study amplifies the neuropsychological assessment’s applicability using a home-to-home format, maintaining the original measure’s structure, interpretability, and discriminant capacity.
Collapse
Affiliation(s)
- Montserrat Alegret
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Ana Espinosa
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Gemma Ortega
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Alba Pérez-Cordón
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain
| | - Ángela Sanabria
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Isabel Hernández
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Marta Marquié
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Maitée Rosende-Roca
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain
| | - Ana Mauleón
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain
| | - Carla Abdelnour
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Liliana Vargas
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain
| | - Ester Esteban de Antonio
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain
| | - Rogelio López-Cuevas
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain
| | - Juan Pablo Tartari
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain
| | - Emilio Alarcón-Martín
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain
| | - Lluís Tárraga
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Agustín Ruiz
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Mercè Boada
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| | - Sergi Valero
- Research Center and Memory Clinic, Fundació ACE, Institut Català de Neurociències Aplicades, Universitat Internacional de Catalunya - Barcelona, Barcelona, Spain.,Networking Research Center on Neurodegenerative Diseases (CIBERNED), Instituto de Salud Carlos III, Madrid, Spain
| |
Collapse
|
17
|
Abstract
The COVID-19 pandemic has significantly impacted the provision of mental health care services and the ability to provide neuropsychological evaluations. The inability to conduct traditional evaluations has left neuropsychologists with the unprecedented task of determining how to modify existing paradigms while balancing the need to provide services and adhere to safety parameters. The COVID-19 literature suggests clinicians are modifying their evaluations based on the following models: (1) continuing to administer in-person evaluations; (2) discontinuing all evaluations due to issues related to standardization, test security, and patient-specific characteristics; (3) conducting virtual evaluations; and/or (4) adopting a hybrid model incorporating both traditional and technology-based modalities. Given the challenges with models 1-3, along with the modifications in telehealth guidelines and insurance reimbursement rates, neuropsychologists are more poised than ever to solidify the implementation of a hybrid model that lasts beyond COVID-19. We introduce the term Hybrid Neuropsychology, a model for the future of neuropsychological evaluations that includes three Action Items: (1) building a technology-based practice; (2) integrating data science; and (3) engaging with innovators in other fields. Hybrid Neuropsychology will enable clinicians to effectively modernize their practice, improve health care equity, and ensure neuropsychology secures its place in a technology-based world.
Collapse
Affiliation(s)
- Shifali Singh
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Laura Germine
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.,Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
18
|
Kitaigorodsky M, Loewenstein D, Curiel Cid R, Crocco E, Gorman K, González-Jiménez C. A Teleneuropsychology Protocol for the Cognitive Assessment of Older Adults During COVID-19. Front Psychol 2021; 12:651136. [PMID: 34054655 PMCID: PMC8155705 DOI: 10.3389/fpsyg.2021.651136] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Accepted: 04/16/2021] [Indexed: 12/21/2022] Open
Abstract
The Coronavirus Disease 2019 (COVID-19) pandemic prompted the need for a teleneuropsychology protocol for the cognitive assessment of older adults, who are at increased risk for both COVID-19 and dementia. Prior recommendations for teleneuropsychological assessment did not consider many of the unique challenges posed by COVID-19. The field is still in need of clear guidelines and standards of care for the assessment of older adults under the current circumstances. Advantages of teleneuropsychological assessment during the COVID-19 pandemic include reduced risk of contracting the virus, eliminating travel time and reducing cost, and more rapid access to needed services. Challenges include disparities in technology access among patients, reduced control over the testing environment, impeded ability to make behavioral observations, and limited research on valid and reliable cognitive assessment measures. The aim of this perspective review is to propose a teleneuropsychological protocol to facilitate neuropsychological assessment utilizing a virtual platform. The proposed protocol has been successful with our clinical and research populations and may help neuropsychologists implement teleneuropsychology services without compromising validity or reliability. However, there is increasing need for research on teleneuropsychological assessment options for both clinical and research purposes.
Collapse
Affiliation(s)
- Marcela Kitaigorodsky
- Department of Psychiatry and Behavioral Sciences, Center for Cognitive Neuroscience and Aging, University of Miami, Miami, FL, United States
| | - David Loewenstein
- Department of Psychiatry and Behavioral Sciences, Center for Cognitive Neuroscience and Aging, University of Miami, Miami, FL, United States
| | - Rosie Curiel Cid
- Department of Psychiatry and Behavioral Sciences, Center for Cognitive Neuroscience and Aging, University of Miami, Miami, FL, United States
| | - Elizabeth Crocco
- Department of Psychiatry and Behavioral Sciences, Center for Cognitive Neuroscience and Aging, University of Miami, Miami, FL, United States
| | - Katherine Gorman
- Department of Psychiatry and Behavioral Sciences, Center for Cognitive Neuroscience and Aging, University of Miami, Miami, FL, United States
| | - Christian González-Jiménez
- Department of Psychiatry and Behavioral Sciences, Center for Cognitive Neuroscience and Aging, University of Miami, Miami, FL, United States
| |
Collapse
|
19
|
Eilam-Stock T, Shaw MT, Sherman K, Krupp LB, Charvet LE. Remote administration of the symbol digit modalities test to individuals with multiple sclerosis is reliable: A short report. Mult Scler J Exp Transl Clin 2021; 7:2055217321994853. [PMID: 33643663 PMCID: PMC7890734 DOI: 10.1177/2055217321994853] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2020] [Revised: 01/19/2021] [Accepted: 01/25/2021] [Indexed: 11/15/2022] Open
Abstract
Background The Symbol Digit Modalities Test (SDMT) is the gold standard for cognitive screening in multiple sclerosis (MS). Objective Due to the recent COVID-19 pandemic and the increased need for virtual clinical visits, we examined the reliability of remote administration of the SDMT vs. standard in-person administration to individuals with MS. Methods Pearson’s correlation analysis was performed between SDMT scores on the in-person and remote administrations. Results For n = 132 participants, remote and in-person SDMT scores were strongly correlated (r = .80, p = .000). Conclusion Remote administration of the SDMT is a reliable cognitive screening approach in MS.
Collapse
Affiliation(s)
| | - Michael T Shaw
- Departmernt of Psychology, Binghamton University, Binghamton, USA
| | | | | | - Leigh E Charvet
- Department of Neurology, NYU Grossman School of Medicine, New York, USA
| |
Collapse
|
20
|
Rochette AD, Rahman-Filipiak A, Spencer RJ, Marshall D, Stelmokas JE. Teleneuropsychology practice survey during COVID-19 within the United States. Appl Neuropsychol Adult 2021; 29:1312-1322. [PMID: 33471555 DOI: 10.1080/23279095.2021.1872576] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
OBJECTIVE Identify factors influencing service delivery changes during COVID-19 and examine barriers and provider satisfaction with teleneuropsychology (teleNP). METHOD Licensed clinical neuropsychologists within the United States recruited via neuropsychology-specific listservs (July-August 2020) to complete an online survey. RESULTS A total of 261 individuals completed the survey. Most (76%) reported delivering in-person testing in some capacity at the time of our survey. Relatively more private practitioners identified concerns with privacy/confidentiality (45.2% vs. 17.9%; χ2(2) = 6.99, p < 0.05), legal issues (47.6% vs. 17.9%; χ2(2) = 8.06, p < 0.05), and an undesirable precedent for legal/forensic cases (59.5% vs. 15.4%; χ2(2) = 17.54, p < 0.001) compared to hospital or other medical (non-VA) practitioners. Multiple resources informed teleNP protocols, such as organization guidelines (87.6%), literature review (75.9%), webinars (72.4%), and consultation (68%). Several factors influenced test selection, including availability of normative data (70.1%), test familiarity (66.4%), administration time (63.5%), and evidence base (60.6%). Reported barriers to continuing teleNP after COVID-19 included need for improved teleNP norms (85.9%), domain coverage (84.7%), improved patient access to technology (74.1%) and further validation studies (84.1%). CONCLUSION TeleNP may not be feasible in all settings and/or referrals. Respondents employed multiple resources in aggregating teleNP protocols and considered several factors when selecting tests. Results highlight the complex and varied decision-making processes utilized by respondents to adapt to service delivery changes. Considering the many benefits of teleNP, future research addressing some of the potentially modifiable factors (e.g., technology access, attitudes regarding teleNP) and significant development needs for teleNP itself (i.e., improved teleNP norms, further validation studies, etc.) is warranted.
Collapse
Affiliation(s)
- Amber D Rochette
- Mental Health Service, VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Department of Psychiatry, University of Michigan Health System, Ann Arbor, MI, USA
| | | | - Robert J Spencer
- Mental Health Service, VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Department of Psychiatry, University of Michigan Health System, Ann Arbor, MI, USA
| | - David Marshall
- Department of Psychiatry, University of Michigan Health System, Ann Arbor, MI, USA
| | - Julija E Stelmokas
- Mental Health Service, VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Department of Psychiatry, University of Michigan Health System, Ann Arbor, MI, USA.,VA Ann Arbor Geriatric Research Education and Clinical Center, Ann Arbor, MI, USA
| |
Collapse
|
21
|
Abstract
Objective: The field of neuropsychology's response to the COVID-19 pandemic was characterized by a rapid change in clinical practice secondary to physical distancing policies and orders. The current study aimed to further characterize the change in neuropsychologists' professional practice, specifically related to teleneuropsychology (TNP) service provision, and also provide novel data regarding the impact of the pandemic on providers' emotional health. Method: This study surveyed 142 neuropsychologists between 3/30/2020 and 4/10/2020, who worked within a variety of settings (e.g., academic medical centers, general hospitals, Veterans Affairs medical centers, rehabilitation hospitals) across all four U.S. geographic regions. Mixed-model analyses of variance (ANOVAs) were conducted to assess for differences in neuropsychological practice (i.e., total number of patients and proportion of TNP seen per week) across time points (i.e., late February and early April) by practice setting and region. Descriptive statistics were conducted to describe respondents' perceptions of TNP, emotional responses to the pandemic, and perceptions of institutional/employers'/practices' responses. Results: Nearly all respondents (∼98%) reported making practice alterations, with ∼73% providing at least some TNP. Neuropsychologists across all settings and regions reported performing a higher proportion of TNP evaluations by April 2020. On average, respondents reported a medium amount of distress/anxiety related to COVID-19, which had a "somewhat small impact" on their ability to practice overall. Conclusions: The current study further elucidated neuropsychologists' provision of TNP services and offered initial data related to their emotional response to the pandemic. Future research is needed to examine the viability and sustainability of TNP practice.
Collapse
Affiliation(s)
| | - Nicholas S Thaler
- UCLA Semel Institute for Neuroscience & Human Behavior, Los Angeles, CA
| | - Shannon E Reilly
- Department of Neurology, University of Virginia, Charlottesville, VA
| | - James J Mahoney
- Department of Behavioral Medicine and Psychiatry, West Virginia University School of Medicine, Rockefeller Neuroscience Institute, Morgantown, WV.,Department of Neuroscience, West Virginia University School of Medicine, Rockefeller Neuroscience Institute, Morgantown, WV
| | - David M Scarisbrick
- Department of Behavioral Medicine and Psychiatry, West Virginia University School of Medicine, Rockefeller Neuroscience Institute, Morgantown, WV.,Department of Neuroscience, West Virginia University School of Medicine, Rockefeller Neuroscience Institute, Morgantown, WV
| |
Collapse
|
22
|
Loman M, Vogt E, Miller L, Landsman R, Duong P, Kasten J, DeFrancisco D, Koop J, Heffelfinger A. "How to" operate a pediatric neuropsychology practice during the COVID-19 pandemic: Real tips from one practice's experience. Child Neuropsychol 2020; 27:251-279. [PMID: 33059534 DOI: 10.1080/09297049.2020.1830962] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
This paper aims to provide pediatric neuropsychologists with suggested processes and procedures to continue to provide neuropsychology services during the COVID-19 global pandemic. Our practice is located within an academic medical center/children's hospital, and setting-specific recommendations may not extend to all practices, though our hope is that others find guidance from our approach to providing pediatric neuropsychology evaluations when physical distancing is required. With consideration of ethics, equity, and assessment validity, we provide suggestions for a) modifying practices around seeing patients during COVID-19, b) tele-health for the pediatric neuropsychologist, c) safety standards and requirements, and d) working with special populations (e.g., Autism Spectrum Disorder, bilingual populations, immunocompromised patients, and acute inpatient assessment).
Collapse
Affiliation(s)
- Michelle Loman
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| | - Elisabeth Vogt
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| | - Lauren Miller
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| | - Rachel Landsman
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| | - Priscilla Duong
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| | - Jessica Kasten
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| | - Danielle DeFrancisco
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| | - Jennifer Koop
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| | - Amy Heffelfinger
- Department of Neurology, Medical College of Wisconsin/Children's Wisconsin , Milwaukee, WI, USA
| |
Collapse
|
23
|
Abstract
In Ghana, the services of psychologists, particularly clinical psychologists and neuropsychologists, remain largely inaccessible to a large proportion of those in need. Emphasis has been placed on "physical wellness" even among patients with cognitive and behavioral problems needing psychological attention. The small number of clinical psychologists and neuropsychologists, the deplorable nature of road networks and transport systems, geopolitical factors, and a reliance on the face-to-face method in providing neuropsychological services have further complicated the accessibility problem. One way of expanding and making neuropsychological services available and accessible is through the use of information communication technology to provide these services, and this is often termed teleneuropsychology. Drawing on relevant literature, this article discusses how computerized neurocognitive assessment and videoconferencing could help in rendering clinical neuropsychological services to patients, particularly those in rural, underserved, and disadvantaged areas in Ghana. The article further proposes recommendations on how teleneuropsychology could be made achievable and sustainable in Ghana.
Collapse
Affiliation(s)
- Samuel Adjorlolo
- a Department of Psychology, Faculty of Social Studies , University of Ghana , Legon , Accra , Ghana
| |
Collapse
|
24
|
Munro Cullum C, Hynan LS, Grosch M, Parikh M, Weiner MF. Teleneuropsychology: evidence for video teleconference-based neuropsychological assessment. J Int Neuropsychol Soc 2014; 20:1028-33. [PMID: 25343269 DOI: 10.1017/S1355617714000873] [Citation(s) in RCA: 151] [Impact Index Per Article: 15.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
The use of videoconference technology to deliver health care diagnostics and treatment continues to grow at a rapid pace. Telepsychiatry and telepsychology applications are well-accepted by patients and providers, and both diagnostic and treatment outcomes have generally been similar to traditional face-to-face interactions. Preliminary applications of videoconference-based neuropsychological assessment (teleneuropsychology) have yielded promising results in the feasibility and reliability of several standard tests, although large-scale studies are lacking. This investigation was conducted to determine the reliability of video teleconference (VTC) - based neuropsychological assessment using a brief battery of standard neuropsychological tests commonly used in the evaluation of known or suspected dementia. Tests included the Mini-Mental State Examination (MMSE), Hopkins Verbal Learning Test-Revised, Digit Span forward and backward, short form Boston Naming Test, Letter and Category Fluency, and Clock Drawing. Tests were administered via VTC and in-person to subjects, counterbalanced using alternate test forms and standard instructions. Two hundred two adult subjects were tested in both rural and urban settings, including 83 with cognitive impairment and 119 healthy controls. We found highly similar results across VTC and in-person conditions, with significant intraclass correlations (mean=.74; range: 0.55-0.91) between test scores. Findings remained consistent in subjects with or without cognitive impairment and in persons with MMSE scores as low as 15. VTC-based neuropsychological testing is a valid and reliable alternative to traditional face-to-face assessment using selected measures. More VTC-based studies using additional tests in different populations are needed to fully explore the utility of this new testing medium.
Collapse
|