1
|
Finley JCA, Leese MI, Roseberry JE, Hill SK. Multivariable utility of the Memory Integrated Language and Making Change Test. APPLIED NEUROPSYCHOLOGY. ADULT 2024:1-8. [PMID: 39073594 DOI: 10.1080/23279095.2024.2385439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
Recent reports indicate that the Memory Integrated Language Test (MIL) and Making Change Test Abbreviated Index (MCT-AI), two web-based performance validity tests (PVTs), have good sensitivity and specificity when used independently. This study investigated whether using these PVTs together could improve the detection of invalid performance in a mixed neuropsychiatric sample. Participants were 129 adult outpatients who underwent a neuropsychological evaluation and were classified into valid (n = 104) or invalid (n = 25) performance groups based on several commonly used PVTs. Using cut scores of ≤41 on the MIL and ≥1.05 on the MCT-AI together enhanced classification accuracy, yielding an area under the curve of .84 (95% CI: .75, .93). As compared to using the MIL and MCT-AI independently, the combined use increased the sensitivity from .10-.31 to.70 while maintaining ≥.90 specificity. Findings also indicated that failing either the MIL or MCT-AI was associated with somewhat lower cognitive test scores, but failing both was associated with markedly lower scores. Overall, using the MIL and MCT-AI together may be an effective way to identify invalid test performance during a neuropsychological evaluation. Furthermore, pairing these tests is consistent with current practice guidelines to include multiple PVTs in a neuropsychological test battery.
Collapse
Affiliation(s)
- John-Christopher A Finley
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Mira I Leese
- Department of Psychology, Rosalind Franklin University of Medicine and Science, Chicago, IL, USA
| | | | - S Kristian Hill
- Department of Psychology, Rosalind Franklin University of Medicine and Science, Chicago, IL, USA
| |
Collapse
|
2
|
Kubo K, Hama S, Furui A, Mizuguchi T, Soh Z, Yanagawa A, Kandori A, Sakai H, Morisako Y, Orino Y, Hamai M, Fujita K, Yamawaki S, Tsuji T. Cognitive screening test for rehabilitation using spatiotemporal data extracted from a digital trail making test part-A. Heliyon 2024; 10:e33135. [PMID: 39035550 PMCID: PMC11259799 DOI: 10.1016/j.heliyon.2024.e33135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 06/13/2024] [Accepted: 06/14/2024] [Indexed: 07/23/2024] Open
Abstract
We investigated a newly developed digitized Trail Making Test using an iPad (iTMT) as a brief cognitive function screening test. We found that the iTMT part-A (iTMT-A) can estimate generalized cognitive function in rehabilitation inpatients examined using the Mini-Mental State Examination (MMSE). Forty-two hospitalized participants undergoing rehabilitation (rehab participants), 30 of whom had cerebral infarction/hemorrhage (stroke participants), performed the iTMT five times (first three times: iTMT-A; fourth: paper version of TMT-A; fifth: the inverse version of iTMT-A) and the MMSE once. Each iTMT-A trial's completion time was divided into the move and dwell times. A linear mixed model following post-hoc tests revealed that the completion time of the third and fourth iTMT-A was faster compared to that of the first iTMT-A, suggesting the presence of a learning effect. In the partial least squares (PLS) regression analysis, the coefficient of determination for estimating the MMSE score was increased by using the dwell and move times extracted from the repeated iTMT-A and the availability of TMT-B, even for subjects with low MMSE scores. These findings indicate that the dwell time of iTMT-A may be important for estimating cognitive function. The iTMT-A extracts significant factors temporally and spatially, and by incorporating the learning effect of repeated trials, it may be possible to screen cognitive and physical functions for rehabilitation patients.
Collapse
Affiliation(s)
- Kouki Kubo
- Department of Rehabilitation, Hibino Hospital, Hiroshima, Hiroshima, Japan
| | - Seiji Hama
- Department of Rehabilitation, Hibino Hospital, Hiroshima, Hiroshima, Japan
- Center for Brain, Mind and KANSEI Sciences Research, Hiroshima University, Hiroshima, Hiroshima, Japan
| | - Akira Furui
- Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi-Hiroshima, Hiroshima, 739-8527, Japan
| | - Tomohiko Mizuguchi
- New Business Producing Division, Business Development Department, Maxell, Ltd., Tokyo, Japan
| | - Zu Soh
- Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi-Hiroshima, Hiroshima, 739-8527, Japan
| | - Akiko Yanagawa
- Department of Rehabilitation, Hibino Hospital, Hiroshima, Hiroshima, Japan
| | - Akihiko Kandori
- Center for Exploratory Research, Research and Development Group, Hitachi Ltd., Tokyo, Japan
| | - Hiroto Sakai
- Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi-Hiroshima, Hiroshima, 739-8527, Japan
| | - Yutaro Morisako
- Department of Rehabilitation, Hibino Hospital, Hiroshima, Hiroshima, Japan
| | - Yuki Orino
- Department of Rehabilitation, Hibino Hospital, Hiroshima, Hiroshima, Japan
| | - Maho Hamai
- Department of Rehabilitation, Hibino Hospital, Hiroshima, Hiroshima, Japan
| | - Kasumi Fujita
- Department of Rehabilitation, Hibino Hospital, Hiroshima, Hiroshima, Japan
| | - Shigeto Yamawaki
- Center for Brain, Mind and KANSEI Sciences Research, Hiroshima University, Hiroshima, Hiroshima, Japan
| | - Toshio Tsuji
- Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi-Hiroshima, Hiroshima, 739-8527, Japan
| |
Collapse
|
3
|
Schmerwitz C, Kopp B. The future of neuropsychology is digital, theory-driven, and Bayesian: a paradigmatic study of cognitive flexibility. Front Psychol 2024; 15:1437192. [PMID: 39070581 PMCID: PMC11276732 DOI: 10.3389/fpsyg.2024.1437192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 06/24/2024] [Indexed: 07/30/2024] Open
Abstract
Introduction This study explores the transformative potential of digital, theory-driven, and Bayesian paradigms in neuropsychology by combining digital technologies, a commitment to evaluating theoretical frameworks, and Bayesian statistics. The study also examines theories of executive function and cognitive flexibility in a large sample of neurotypical individuals (N = 489). Methods We developed an internet-based Wisconsin Card-Sorting Task (iWCST) optimized for online assessment of perseveration errors (PE). Predictions of the percentage of PE, PE (%), in non-repetitive versus repetitive situations were derived from the established supervisory attention system (SAS) theory, non-repetitive PE (%) < repetitive PE (%), and the novel goal-directed instrumental control (GIC) theory, non-repetitive PE (%) > repetitive PE (%). Results Bayesian t-tests revealed the presence of a robust error suppression effect (ESE) indicating that PE are less likely in repetitive situations than in non-repetitive situations, contradicting SAS theory with posterior model probability p < 0.001 and confirming GIC theory with posterior model probability p > 0.999. We conclude that repetitive situations support cognitive set switching in the iWCST by facilitating the retrieval of goal-directed, instrumental memory that associates stimulus features, actions, and outcomes, thereby generating the ESE in neurotypical individuals. We also report exploratory data analyses, including a Bayesian network analysis of relationships between iWCST measures. Discussion Overall, this study serves as a paradigmatic model for combining digital technologies, theory-driven research, and Bayesian statistics in neuropsychology. It also provides insight into how this integrative, innovative approach can advance the understanding of executive function and cognitive flexibility and inform future research and clinical applications.
Collapse
Affiliation(s)
| | - Bruno Kopp
- Cognitive Neuropsychology, Department of Neurology, Hannover Medical School, Hannover, Germany
| |
Collapse
|
4
|
Mejía C, Herrera-Marmolejo A, Rosero-Pérez M, Quimbaya J, Cardona JF. Design of a video game for assessment of executive functions in deaf and hearing children. APPLIED NEUROPSYCHOLOGY. CHILD 2024:1-8. [PMID: 38359416 DOI: 10.1080/21622965.2024.2311096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/17/2024]
Abstract
This study investigates the effectiveness of a computerized cognitive test battery embedded within a video game to assess executive functions (EF) in deaf and hearing children. We evaluated a diverse cohort of 290 elementary school students aged 5 to 13 years (mean age = 8.86, SD = 1.96), comprising 74 sign language users, 14 Spanish-speaking deaf participants, 23 children with mixed communication methods, and 179 typically hearing individuals. Our statistical analysis focused on item discrimination, reliability, and criterion validation of the game-based assessments. The results indicated high reliability and effective discrimination of EF across the game's three primary stages. External validation was conducted using the Matrices Test, educational attainment, and age as variables. A significant positive correlation (r = 0.377, p < 0.001) was observed between the Matrices Test scores and game-based achievement scores. Furthermore, linear regression analysis revealed education (Standardized Beta = 0.339) and age (Standardized Beta = 0.179) as significant predictors of performance in these scores. This study underscores the value of integrating computerized cognitive assessments within a video game environment for comprehensive neuropsychological evaluations, highlighting its potential in diverse child populations.
Collapse
Affiliation(s)
- César Mejía
- Facultad de Psicología, Universidad del Valle, Santiago de Cali, Colombia
- Facultad de Ciencias Humanas y Sociales, Universidad de San Buenaventura, Cali, Colombia
| | | | | | - Jorge Quimbaya
- Departamento de Ciencia y Tecnología, Vortex Psychometrics, Santiago de Cali, Colombia
| | - Juan F Cardona
- Facultad de Psicología, Universidad del Valle, Santiago de Cali, Colombia
| |
Collapse
|
5
|
Laera G, Hering A, Kliegel M. Assessing time-based prospective memory online: A comparison study between laboratory-based and web-based testing. Q J Exp Psychol (Hove) 2024:17470218231220578. [PMID: 38053325 DOI: 10.1177/17470218231220578] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2023]
Abstract
Prospective memory (PM, i.e., the ability to remember and perform future intentions) is assessed mainly within laboratory settings; however, in the last two decades, several studies have started testing PM online. Most part of those studies focused on event-based PM (EBPM), and only a few assessed time-based PM (TBPM), possibly because time keeping is difficult to control or standardise without experimental control. Thus, it is still unclear whether time monitoring patterns in online studies replicate typical patterns obtained in laboratory tasks. In this study, we therefore aimed to investigate whether the behavioural outcome measures obtained from the traditional TBPM paradigm in the laboratory-accuracy and time monitoring-are comparable with an online version in a sample of 101 younger adults. Results showed no significant difference in TBPM performance in the laboratory versus online setting, as well as no difference in time monitoring. However, we found that participants were somewhat faster and more accurate at the ongoing task during the laboratory assessment, but those differences were not related to holding an intention in mind. The findings suggest that, although participants seemed generally more distracted when tested remotely, online assessment yielded similar results in key temporal characteristics and behavioural performance as for the laboratory assessment. The results are discussed in terms of possible conceptual and methodological implications for online testing.
Collapse
Affiliation(s)
- Gianvito Laera
- Cognitive Aging Lab (CAL), Faculty of Psychology and Educational Sciences, University of Geneva, Geneva, Switzerland
- Centre for the Interdisciplinary Study of Gerontology and Vulnerability, University of Geneva, Geneva, Switzerland
- LIVES-Overcoming Vulnerability: Life Course Perspectives, Swiss National Centre of Competence in Research, Lausanne, Switzerland
| | - Alexandra Hering
- Cognitive Aging Lab (CAL), Faculty of Psychology and Educational Sciences, University of Geneva, Geneva, Switzerland
- Centre for the Interdisciplinary Study of Gerontology and Vulnerability, University of Geneva, Geneva, Switzerland
- Department of Developmental Psychology, Tilburg School for Social and Behavioral Sciences, Tilburg University, Tilburg, The Netherlands
| | - Matthias Kliegel
- Cognitive Aging Lab (CAL), Faculty of Psychology and Educational Sciences, University of Geneva, Geneva, Switzerland
- Centre for the Interdisciplinary Study of Gerontology and Vulnerability, University of Geneva, Geneva, Switzerland
- LIVES-Overcoming Vulnerability: Life Course Perspectives, Swiss National Centre of Competence in Research, Lausanne, Switzerland
| |
Collapse
|
6
|
Roca-Ventura A, Solana-Sánchez J, Heras E, Anglada M, Missé J, Ulloa E, García-Molina A, Opisso E, Bartrés-Faz D, Pascual-Leone A, Tormos-Muñoz JM, Cattaneo G. "Guttmann Cognitest ®," a digital solution for assessing cognitive performance in adult population: A feasibility and usability pilot study. Digit Health 2024; 10:20552076231224246. [PMID: 38188861 PMCID: PMC10768632 DOI: 10.1177/20552076231224246] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Accepted: 12/15/2023] [Indexed: 01/09/2024] Open
Abstract
Background As the world population continues to age, the prevalence of neurological diseases, such as dementia, poses a significant challenge to society. Detecting cognitive impairment at an early stage is vital in preserving and enhancing cognitive function. Digital tools, particularly mHealth, offer a practical solution for large-scale population screening and prompt follow-up assessments of cognitive function, thus overcoming economic and time limitations. Objective In this work, two versions of a digital solution called Guttmann Cognitest® were tested. Methods Two hundred and one middle-aged adults used the first version (Group A), while 132 used the second one, which included improved tutorials and practice screens (Group B). This second version was also validated in an older age group (Group C). Results This digital solution was found to be highly satisfactory in terms of usability and feasibility, with good acceptability among all three groups. Specifically for Group B, the system usability scale score obtained classifies the solution as the best imaginable in terms of usability. Conclusions Guttmann Cognitest® has been shown to be effective and well-perceived, with a high potential for sustained engagement in tracking changes in cognitive function.
Collapse
Affiliation(s)
- Alba Roca-Ventura
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, Badalona, Spain
- Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, Badalona, Barcelona, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Javier Solana-Sánchez
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, Badalona, Spain
- Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, Badalona, Barcelona, Spain
- Universitat Autònoma de Barcelona, Bellaterra, Spain
| | - Eva Heras
- Servei Envelliment i Salut Servei Andorrà d’Atenció Sanitària, Escaldes-Engordany, Andorra
| | - Maria Anglada
- Servei Envelliment i Salut Servei Andorrà d’Atenció Sanitària, Escaldes-Engordany, Andorra
| | - Jan Missé
- Servei Envelliment i Salut Servei Andorrà d’Atenció Sanitària, Escaldes-Engordany, Andorra
| | - Encarnació Ulloa
- Servei Envelliment i Salut Servei Andorrà d’Atenció Sanitària, Escaldes-Engordany, Andorra
| | - Alberto García-Molina
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, Badalona, Spain
- Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, Badalona, Barcelona, Spain
- Universitat Autònoma de Barcelona, Bellaterra, Spain
| | - Eloy Opisso
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, Badalona, Spain
- Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, Badalona, Barcelona, Spain
- Universitat Autònoma de Barcelona, Bellaterra, Spain
| | - David Bartrés-Faz
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, Badalona, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Alvaro Pascual-Leone
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, Badalona, Spain
- Hinda and Arthur Marcus Institute for Aging Research, Hebrew SeniorLife, Boston, MA, USA
- Deanna and Sidney Wolk Center for Memory Health, Hebrew SeniorLife, Boston, MA, USA
- Department of Neurology, Harvard Medical School, Boston, MA, USA
| | - Josep M. Tormos-Muñoz
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, Badalona, Spain
- Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, Badalona, Barcelona, Spain
- Universitat Autònoma de Barcelona, Bellaterra, Spain
| | - Gabriele Cattaneo
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, Badalona, Spain
- Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, Badalona, Barcelona, Spain
- Universitat Autònoma de Barcelona, Bellaterra, Spain
| |
Collapse
|
7
|
Okada NS, McNeely-White KL, Cleary AM, Carlaw BN, Drane DL, Parsons TD, McMahan T, Neisser J, Pedersen NP. A virtual reality paradigm with dynamic scene stimuli for use in memory research. Behav Res Methods 2023:10.3758/s13428-023-02243-w. [PMID: 37845424 PMCID: PMC11018716 DOI: 10.3758/s13428-023-02243-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/15/2023] [Indexed: 10/18/2023]
Abstract
Episodic memory may essentially be memory for one's place within a temporally unfolding scene from a first-person perspective. Given this, pervasively used static stimuli may only capture one small part of episodic memory. A promising approach for advancing the study of episodic memory is immersing participants within varying scenes from a first-person perspective. We present a pool of distinct scene stimuli for use in virtual environments and a paradigm that is implementable across varying levels of immersion on multiple virtual reality (VR) platforms and adaptable to studying various aspects of scene and episodic memory. In our task, participants are placed within a series of virtual environments from a first-person perspective and guided through a virtual tour of scenes during a study phase and a test phase. In the test phase, some scenes share a spatial layout with studied scenes; others are completely novel. In three experiments with varying degrees of immersion, we measure scene recall, scene familiarity-detection during recall failure, the subjective experience of déjà vu, the ability to predict the next turn on a tour, the subjective sense of being able to predict the next turn on a tour, and the factors that influence memory search and the inclination to generate candidate recollective information. The level of first-person immersion mattered to multiple facets of episodic memory. The paradigm presents a useful means of advancing mechanistic understanding of how memory operates in realistic dynamic scene environments, including in combination with cognitive neuroscience methods such as functional magnetic resonance imaging and electrophysiology.
Collapse
Affiliation(s)
- Noah S Okada
- Department of Neurology, Emory University, Atlanta, GA, 30322, USA.
| | | | - Anne M Cleary
- Department of Psychology, Colorado State University, Fort Collins, CO, 80523, USA
| | - Brooke N Carlaw
- Department of Psychology, Colorado State University, Fort Collins, CO, 80523, USA
| | - Daniel L Drane
- Department of Neurology, Emory University, Atlanta, GA, 30322, USA
- Department of Pediatrics, Emory University School of Medicine, Atlanta, GA, 30322, USA
- Department of Neurology, University of Washington School of Medicine, Seattle, WA, 98105, USA
| | - Thomas D Parsons
- Grace Center, Arizona State University, Tempe, AZ, 85281, USA
- Computational Neuropsychology & Simulation (CNS) Laboratory, Arizona State University, Tempe, AZ, 85281, USA
| | - Timothy McMahan
- Department of Learning Technologies, University of North Texas, Denton, TX, 76203, USA
| | - Joseph Neisser
- Department of Philosophy, Grinnell College, Grinnell, IA, 50112, USA
| | - Nigel P Pedersen
- Department of Neurology, Emory University, Atlanta, GA, 30322, USA.
- Department of Neurology, University of California Davis, Sacramento, CA, 95816, USA.
| |
Collapse
|
8
|
Faria AL, Latorre J, Silva Cameirão M, Bermúdez i Badia S, Llorens R. Ecologically valid virtual reality-based technologies for assessment and rehabilitation of acquired brain injury: a systematic review. Front Psychol 2023; 14:1233346. [PMID: 37711328 PMCID: PMC10497882 DOI: 10.3389/fpsyg.2023.1233346] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 08/03/2023] [Indexed: 09/16/2023] Open
Abstract
Purpose A systematic review was conducted to examine the state of the literature regarding using ecologically valid virtual environments and related technologies to assess and rehabilitate people with Acquired Brain Injury (ABI). Materials and methods A literature search was performed following the PRISMA guidelines using PubMed, Web of Science, ACM and IEEE databases. The focus was on assessment and intervention studies using ecologically valid virtual environments (VE). All studies were included if they involved individuals with ABI and simulated environments of the real world or Activities of Daily Living (ADL). Results Seventy out of 363 studies were included in this review and grouped and analyzed according to the nature of its simulation, prefacing a total of 12 kitchens, 11 supermarkets, 10 shopping malls, 16 streets, 11 cities, and 10 other everyday life scenarios. These VE were mostly presented on computer screens, HMD's and laptops and patients interacted with them primarily via mouse, keyboard, and joystick. Twenty-five out of 70 studies had a non-experimental design. Conclusion Evidence about the clinical impact of ecologically valid VE is still modest, and further research with more extensive samples is needed. It is important to standardize neuropsychological and motor outcome measures to strengthen conclusions between studies. Systematic review registration identifier CRD42022301560, https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=301560.
Collapse
Affiliation(s)
- Ana Lúcia Faria
- Faculdade de Artes e Humanidades, Universidade da Madeira, Funchal, Portugal
- NOVA Laboratory for Computer Science and Informatics, Lisbon, Portugal
- Agência Regional para o Desenvolvimento da Investigação, Tecnologia e Inovação, Funchal, Portugal
| | - Jorge Latorre
- Neurorehabilitation and Brain Research Group, Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, Valencia, Spain
- NEURORHB, Servicio de Neurorrehabilitación de Hospitales Vithas, Valencia, Spain
| | - Mónica Silva Cameirão
- NOVA Laboratory for Computer Science and Informatics, Lisbon, Portugal
- Agência Regional para o Desenvolvimento da Investigação, Tecnologia e Inovação, Funchal, Portugal
- Faculdade de Ciências Exatas e da Engenharia, Universidade da Madeira, Funchal, Portugal
| | - Sergi Bermúdez i Badia
- NOVA Laboratory for Computer Science and Informatics, Lisbon, Portugal
- Agência Regional para o Desenvolvimento da Investigação, Tecnologia e Inovação, Funchal, Portugal
- Faculdade de Ciências Exatas e da Engenharia, Universidade da Madeira, Funchal, Portugal
| | - Roberto Llorens
- Neurorehabilitation and Brain Research Group, Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, Valencia, Spain
- NEURORHB, Servicio de Neurorrehabilitación de Hospitales Vithas, Valencia, Spain
| |
Collapse
|
9
|
Wolff B, Franco VR, Magiati I, Pestell CF, Glasson EJ. Neurocognitive and self-reported psychosocial and behavioral functioning in siblings of individuals with neurodevelopmental conditions: a study using remote self-administered testing. J Clin Exp Neuropsychol 2023; 45:513-536. [PMID: 37779193 DOI: 10.1080/13803395.2023.2259042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 09/10/2023] [Indexed: 10/03/2023]
Abstract
OBJECTIVE This study compared and explored the neurocognitive profiles of siblings of persons with and without neurodevelopmental conditions (NDCs) and associations between objective test performance and self-reported psychosocial functioning. METHODS Siblings of persons with and without NDCs (64 NDC and 64 control siblings; mean age 19.88 years, range 11-27 years, 73.44% female, 75.78% White Caucasian) completed self-report questionnaires and self-administered computerized neurocognitive tests of executive functioning (EF). Using Bayesian analyses, we examined cross-sectional associations between self-reported psychosocial functioning and cognitive test performance, and predictors of EF over 15 months. RESULTS NDC siblings had poorer working memory, inhibition, attention, and shifting compared to controls, as measured by experimental paradigms on the backward Corsi span, N-Back 2-back task, Stop Signal Task, Sustained Attention to Response Task, and the Wisconsin Card Sorting Test (effect size δ ranging 0.49 to 0.64). Bayesian cross-sectional networks revealed negative emotion reactivity and working memory difficulties were central to the NDC sibling network. Over 15 months, poorer EF (k low test scores) was predicted by negative emotion reactivity, sleep problems, and anxiety, over and above effects of age and subclinical autistic and ADHD traits. Siblings of autistic individuals and persons with fetal alcohol spectrum disorder had higher rates of neurocognitive and psychiatric difficulties than other NDCs and controls (Bayes factors >20). CONCLUSIONS Neurocognitive difficulties were associated with transdiagnostic vulnerability to poorer wellbeing in NDC siblings. These findings demonstrate the feasibility of remote online cognitive testing and highlight the importance of individualized prevention and intervention for NDC siblings.
Collapse
Affiliation(s)
- Brittany Wolff
- School of Psychological Science, The University of Western Australia, Perth, Australia
- Telethon Kids Institute, Centre for Child Health Research, The University of Western Australia, Perth, Australia
| | | | - Iliana Magiati
- School of Psychological Science, The University of Western Australia, Perth, Australia
| | - Carmela F Pestell
- School of Psychological Science, The University of Western Australia, Perth, Australia
| | - Emma J Glasson
- Telethon Kids Institute, Centre for Child Health Research, The University of Western Australia, Perth, Australia
- Discipline of Psychiatry, Medical School, The University of Western Australia, Perth, WA, Australia
| |
Collapse
|
10
|
Del Giovane M, Trender WR, Bălăeţ M, Mallas EJ, Jolly AE, Bourke NJ, Zimmermann K, Graham NS, Lai H, Losty EJ, Oiarbide GA, Hellyer PJ, Faiman I, Daniels SJ, Batey P, Harrison M, Giunchiglia V, Kolanko MA, David MC, Li LM, Demarchi C, Friedland D, Sharp DJ, Hampshire A. Computerised cognitive assessment in patients with traumatic brain injury: an observational study of feasibility and sensitivity relative to established clinical scales. EClinicalMedicine 2023; 59:101980. [PMID: 37152359 PMCID: PMC10154960 DOI: 10.1016/j.eclinm.2023.101980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 03/28/2023] [Accepted: 04/12/2023] [Indexed: 05/09/2023] Open
Abstract
Background Online technology could potentially revolutionise how patients are cognitively assessed and monitored. However, it remains unclear whether assessments conducted remotely can match established pen-and-paper neuropsychological tests in terms of sensitivity and specificity. Methods This observational study aimed to optimise an online cognitive assessment for use in traumatic brain injury (TBI) clinics. The tertiary referral clinic in which this tool has been clinically implemented typically sees patients a minimum of 6 months post-injury in the chronic phase. Between March and August 2019, we conducted a cross-group, cross-device and factor analyses at the St. Mary's Hospital TBI clinic and major trauma wards at Imperial College NHS trust and St. George's Hospital in London (UK), to identify a battery of tasks that assess aspects of cognition affected by TBI. Between September 2019 and February 2020, we evaluated the online battery against standard face-to-face neuropsychological tests at the Imperial College London research centre. Canonical Correlation Analysis (CCA) determined the shared variance between the online battery and standard neuropsychological tests. Finally, between October 2020 and December 2021, the tests were integrated into a framework that automatically generates a results report where patients' performance is compared to a large normative dataset. We piloted this as a practical tool to be used under supervised and unsupervised conditions at the St. Mary's Hospital TBI clinic in London (UK). Findings The online assessment discriminated processing-speed, visual-attention, working-memory, and executive-function deficits in TBI. CCA identified two significant modes indicating shared variance with standard neuropsychological tests (r = 0.86, p < 0.001 and r = 0.81, p = 0.02). Sensitivity to cognitive deficits after TBI was evident in the TBI clinic setting under supervised and unsupervised conditions (F (15,555) = 3.99; p < 0.001). Interpretation Online cognitive assessment of TBI patients is feasible, sensitive, and efficient. When combined with normative sociodemographic models and autogenerated reports, it has the potential to transform cognitive assessment in the healthcare setting. Funding This work was funded by a National Institute for Health Research (NIHR) Invention for Innovation (i4i) grant awarded to DJS and AH (II-LB-0715-20006).
Collapse
Affiliation(s)
- Martina Del Giovane
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - William R. Trender
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Maria Bălăeţ
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Emma-Jane Mallas
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Amy E. Jolly
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
- Department of Neuroinflammation, UCL Queen Square Institute of Neurology, Faculty of Brain Sciences, Queen Square, WC1N 3BG, London, United Kingdom
| | - Niall J. Bourke
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, 16 De Crespigny Park, SE5 8AB, London, United Kingdom
| | - Karl Zimmermann
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Neil S.N. Graham
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Helen Lai
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Ethan J.F. Losty
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Garazi Araña Oiarbide
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Peter J. Hellyer
- Institute of Psychiatry, Psychology and Neuroscience, King’s College London, 16 De Crespigny Park, SE5 8AF, London, United Kingdom
| | - Irene Faiman
- Clinical Neuropsychology Service, St George's University Hospital NHS Foundation Trust, Blackshaw Road, SW17 0QT, London, United Kingdom
| | - Sarah J.C. Daniels
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Philippa Batey
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- The Helix Centre, Imperial College London, and the Royal College of Arts, St. Mary’s Hospital, 3rd Floor Paterson Building, 20 South Wharf Road, Paddington, W2 1PE, London, United Kingdom
| | - Matthew Harrison
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- The Helix Centre, Imperial College London, and the Royal College of Arts, St. Mary’s Hospital, 3rd Floor Paterson Building, 20 South Wharf Road, Paddington, W2 1PE, London, United Kingdom
| | - Valentina Giunchiglia
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Magdalena A. Kolanko
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Michael C.B. David
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Lucia M. Li
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Célia Demarchi
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Daniel Friedland
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - David J. Sharp
- UK Dementia Research Institute, Care Research & Technology Centre, Imperial College and the University of Surrey, 9th Floor, Sir Michael Uren Hub, 86 Wood Ln, W12 0BZ, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| | - Adam Hampshire
- Department of Brain Sciences, Imperial College London, London, United Kingdom. Burlington Danes, The Hammersmith Hospital, Du Cane Road, W12 0NN, London, United Kingdom
| |
Collapse
|
11
|
DuBord AY, Paolillo EW, Staffaroni AM. Remote Digital Technologies for the Early Detection and Monitoring of Cognitive Decline in Patients With Type 2 Diabetes: Insights From Studies of Neurodegenerative Diseases. J Diabetes Sci Technol 2023:19322968231171399. [PMID: 37102472 DOI: 10.1177/19322968231171399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/28/2023]
Abstract
Type 2 diabetes (T2D) is a risk factor for cognitive decline. In neurodegenerative disease research, remote digital cognitive assessments and unobtrusive sensors are gaining traction for their potential to improve early detection and monitoring of cognitive impairment. Given the high prevalence of cognitive impairments in T2D, these digital tools are highly relevant. Further research incorporating remote digital biomarkers of cognition, behavior, and motor functioning may enable comprehensive characterizations of patients with T2D and may ultimately improve clinical care and equitable access to research participation. The aim of this commentary article is to review the feasibility, validity, and limitations of using remote digital cognitive tests and unobtrusive detection methods to identify and monitor cognitive decline in neurodegenerative conditions and apply these insights to patients with T2D.
Collapse
Affiliation(s)
- Ashley Y DuBord
- Department of Neurology, Memory and Aging Center, Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA
- Diabetes Technology Society, Burlingame, CA, USA
| | - Emily W Paolillo
- Department of Neurology, Memory and Aging Center, Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA
| | - Adam M Staffaroni
- Department of Neurology, Memory and Aging Center, Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA
| |
Collapse
|
12
|
Martínez-Pernía D, Olavarría L, Fernández-Manjón B, Cabello V, Henríquez F, Robert P, Alvarado L, Barría S, Antivilo A, Velasquez J, Cerda M, Farías G, Torralva T, Ibáñez A, Parra MA, Gilbert S, Slachevsky A. The limitations and challenges in the assessment of executive dysfunction associated with real-world functioning: The opportunity of serious games. APPLIED NEUROPSYCHOLOGY. ADULT 2023:1-17. [PMID: 36827177 PMCID: PMC11177293 DOI: 10.1080/23279095.2023.2174438] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/25/2023]
Abstract
Nowadays, there is a broad range of methods for detecting and evaluating executive dysfunction ranging from clinical interview to neuropsychological evaluation. Nevertheless, a critical issue of these assessments is the lack of correspondence of the neuropsychological test's results with real-world functioning. This paper proposes serious games as a new framework to improve the neuropsychological assessment of real-world functioning. We briefly discuss the contribution and limitations of current methods of evaluation of executive dysfunction (paper-and-pencil tests, naturalistic observation methods, and Information and Communications Technologies) to inform on daily life functioning. Then, we analyze what are the limitations of these methods to predict real-world performance: (1) A lack of appropriate instruments to investigate the complexity of real-world functioning, (2) the vast majority of neuropsychological tests assess well-structured tasks, and (3) measurement of behaviors are based on simplistic data collection and statistical analysis. This work shows how serious games offer an opportunity to develop more efficient tools to detect executive dysfunction in everyday life contexts. Serious games provide meaningful narrative stories and virtual or real environments that immerse the user in natural and social environments with social interactions. In those highly interactive game environments, the player needs to adapt his/her behavioral performance to novel and ill-structured tasks which are suited for collecting user interaction evidence. Serious games offer a novel opportunity to develop better tools to improve diagnosis of the executive dysfunction in everyday life contexts. However, more research is still needed to implement serious games in everyday clinical practice.
Collapse
Affiliation(s)
- David Martínez-Pernía
- Center for Social and Cognitive Neuroscience (CSCN), School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
- Geroscience Center for Brain Health and Metabolism (GERO), Santiago, Chile
- Memory and Neuropsychiatric Center (CMYN), Memory Unit - Neurology Department, Hospital del Salvador and Faculty of Medicine, University of Chile, Santiago, Chile
| | - Loreto Olavarría
- Memory and Neuropsychiatric Center (CMYN), Memory Unit - Neurology Department, Hospital del Salvador and Faculty of Medicine, University of Chile, Santiago, Chile
| | | | - Victoria Cabello
- Neuropsychology and Clinical Neuroscience Laboratory (LANNEC), Physiopathology Department - Biomedical Science Institute, Neuroscience and East Neuroscience Departments, Faculty of Medicine, University of Chile, Santiago, Chile
| | - Fernando Henríquez
- Geroscience Center for Brain Health and Metabolism (GERO), Santiago, Chile
- Memory and Neuropsychiatric Center (CMYN), Memory Unit - Neurology Department, Hospital del Salvador and Faculty of Medicine, University of Chile, Santiago, Chile
- Neuropsychology and Clinical Neuroscience Laboratory (LANNEC), Physiopathology Department - Biomedical Science Institute, Neuroscience and East Neuroscience Departments, Faculty of Medicine, University of Chile, Santiago, Chile
- Laboratory for Cognitive and Evolutionary Neuroscience (LaNCE), Department of Psychiatry, Faculty of Medicine, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Philippe Robert
- Cognition Behavior Technology (CoBTeK) Lab, FRIS-Université Côte d'Azur, Nice, France
| | - Luís Alvarado
- Departamento de Psiquiatría y Salud Mental Norte, Universidad de Chile, Santiago, Chile
| | - Silvia Barría
- Departamento de Ciencias Neurologicas Oriente, Facultad de Medicina, Universidad de Chile, and Servicio de Neurología, Hospital del Salvador, Santiago, Chile
| | - Andrés Antivilo
- Departamento de Ciencias Neurologicas Oriente, Facultad de Medicina, Universidad de Chile, and Servicio de Neurología, Hospital del Salvador, Santiago, Chile
| | - Juan Velasquez
- Facultad de Ciencias Físicas y Matemáticas, Web Intelligence Center, Universidad de Chile, Santiago, Chile
- Department of Industrial Engineering, Faculty of Physical and Mathematical Sciences, Instituto Sistemas Complejos de Ingeniería (ISCI), University of Chile, Santiago, Chile
| | - Mauricio Cerda
- Integrative Biology Program, Institute of Biomedical Sciences, and Center for Medical Informatics and Telemedicine, Faculty of Medicine, and Biomedical Neuroscience Institute, Facultad de Medicina, Universidad de Chile, Santiago, Chile
| | - Gonzalo Farías
- Department of Neurology North, Faculty of Medicine, University of Chile, Santiago, Chile
- Center for advanced clinical research (CICA), Hospital Clínico Universidad de Chile, Chile
| | - Teresa Torralva
- Institute of Cognitive and Translational Neuroscience (INCYT), Instituto de Neurología Cognitiva Foundation, Favaloro University, Buenos Aires, Argentina
| | - Agustín Ibáñez
- Latin American Brain Health Institute (BrainLat), Universidad Adolfo Ibáñez, Santiago, Chile
- Cognitive Neuroscience Center (CNC), Universidad de San Andrés, National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA
- Trinity College Dublin (TCD), Dublin, Ireland
| | - Mario A Parra
- School of Psychological Sciences and Health, University of Strathclyde, Glasgow, UK
| | - Sam Gilbert
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Andrea Slachevsky
- Geroscience Center for Brain Health and Metabolism (GERO), Santiago, Chile
- Memory and Neuropsychiatric Center (CMYN), Memory Unit - Neurology Department, Hospital del Salvador and Faculty of Medicine, University of Chile, Santiago, Chile
- Neuropsychology and Clinical Neuroscience Laboratory (LANNEC), Physiopathology Department - Biomedical Science Institute, Neuroscience and East Neuroscience Departments, Faculty of Medicine, University of Chile, Santiago, Chile
- Department of Neurology and Psychiatry, Clínica Alemana-Universidad del Desarrollo, Santiago, Chile
| |
Collapse
|
13
|
Marques-Costa C, Simões MR, Almiro PA, Prieto G, Salomé Pinho M. Integrating Technology in Neuropsychological Assessment. EUROPEAN PSYCHOLOGIST 2022. [DOI: 10.1027/1016-9040/a000484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Abstract. Although neuropsychological assessments include some measures that are administered, scored, or interpreted using new technologies, most researchers in this area advocate that more technology should be integrated. The current situation in neuropsychological assessment may be conceptualized as triggering a crisis leading to a paradigm shift, as there is some resistance to adopting more technology. In this paper, the context of the present crisis in neuropsychological assessment, the main obstacles, and new developments will be discussed. An example of a new computerized assessment tool, the NIH Toolbox, is highlighted. Also addressed are potential issues: in the assessment with tablets illustrating it with the older adult population and how to ensure the compatibility of data collected through these devices within the framework of the European General Data Protection Regulation (GDPR). Recommendations for research, test development, and clinical practice are also provided.
Collapse
Affiliation(s)
- Catarina Marques-Costa
- Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal
- Center for Research in Neuropsychology and Cognitive and Behavioral Intervention (CINEICC), University of Coimbra, Portugal
- Psychological Assessment and Psychometrics Laboratory (PsyAssessmentLab), University of Coimbra, Portugal
| | - Mário R. Simões
- Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal
- Center for Research in Neuropsychology and Cognitive and Behavioral Intervention (CINEICC), University of Coimbra, Portugal
- Psychological Assessment and Psychometrics Laboratory (PsyAssessmentLab), University of Coimbra, Portugal
| | - Pedro A. Almiro
- Center for Research in Neuropsychology and Cognitive and Behavioral Intervention (CINEICC), University of Coimbra, Portugal
- Psychological Assessment and Psychometrics Laboratory (PsyAssessmentLab), University of Coimbra, Portugal
- Research Centre for Psychology (CIP), Autonomous University Lisbon, Portugal
| | - Gerardo Prieto
- Psychological Assessment and Psychometrics Laboratory (PsyAssessmentLab), University of Coimbra, Portugal
- Faculty of Psychology, University of Salamanca, Spain
| | - Maria Salomé Pinho
- Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal
- Center for Research in Neuropsychology and Cognitive and Behavioral Intervention (CINEICC), University of Coimbra, Portugal
- Memory, Language, and Executive Functions Laboratory, University of Coimbra, Portugal
| |
Collapse
|
14
|
Leese MI, Mattek N, Bernstein JPK, Dorociak KE, Gothard S, Kaye J, Hughes AM. The survey for memory, attention, and reaction time (SMART): Preliminary normative online panel data and user attitudes for a brief web-based cognitive performance measure. Clin Neuropsychol 2022:1-19. [PMID: 35930438 PMCID: PMC9899293 DOI: 10.1080/13854046.2022.2103033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
ObjectiveThe Survey for Memory, Attention, and Reaction Time (SMART) was recently introduced as a brief (<5 min), self-administered, web-based measure of cognitive performance in older adults. The purpose of this study was threefold: (1) to develop preliminary norms on the SMART; (2) to examine the relationship between demographic variables (i.e. age, sex, education), device type used, and SMART performance; and (3) to assess user attitudes of the SMART. Method A sample of 1,050 community-dwelling adults (M age =59.5 (15.2), M education = 16.5 (2.1), 67.1% female, 96% white) was recruited from an ongoing web-based research cohort. Participants completed the SMART, which consists of four face-valid cognitive tasks assessing visual memory, attention/processing speed, and executive functioning. SMART performance outcome metrics were subtest completion time (CT), click count, and total CT. Participants provided demographic information and completed a survey of user attitudes toward the SMART (i.e. usability, acceptability). Results Older age was the only demographic variable associated with slower SMART total CT (r = .60, p <.001). Education was not associated with SMART CT or click counts overall (p > .05). Male sex was generally associated with longer SMART CT (p < .001, partial eta squared = .14) on all sub-tests. Regarding acceptability, 97.3% indicated willingness to take the SMART again, with more than half willing to complete it on a weekly basis. Conclusion The preliminary normative data on the SMART indicates that it is a feasible and well-accepted web-based cognitive assessment tool that can be administered on multiple device platforms.
Collapse
Affiliation(s)
- Mira I. Leese
- Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Nora Mattek
- Oregon Center for Aging & Technology, Portland, OR, USA,Oregon Health & Science University, Portland, OR, USA
| | | | | | - Sarah Gothard
- Oregon Center for Aging & Technology, Portland, OR, USA,Oregon Health & Science University, Portland, OR, USA
| | - Jeffrey Kaye
- Oregon Center for Aging & Technology, Portland, OR, USA,Oregon Health & Science University, Portland, OR, USA
| | - Adriana M. Hughes
- Oregon Center for Aging & Technology, Portland, OR, USA,Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA,Minneapolis VA Health Care System, Minneapolis, MN, USA
| |
Collapse
|
15
|
Boujelbane MA, Trabelsi K, Boukhris O, Kacem FH, Ammar A, Charfi I, Turki M, Charfeddine S, Bouaziz B, Hakim A, Frikha H, Chabchoub MA, Chtourou H, Glenn JM, Myers JR. The Use of Digital Technology to Assess Cognitive Function in Tunisian Adults. J Alzheimers Dis 2022; 88:1545-1552. [DOI: 10.3233/jad-220398] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
Background: There has been increasing evidence and support for the use of digital technology in the cognitive health field. Despite the growing use of innovative digital technology to assess cognitive function, such technology remains scarce in Arabic countries, particularly in Tunisia. Objective: To investigate the effectiveness of a digitally delivered cognitive assessment battery in differentiating varying degrees of cognitive function in older Tunisian adults. Methods: One hundred fifty-five Tunisian older adults (age: 62.24±7.52 years) were assigned to one of four groups: healthy controls (HC), at-risk (AR), mild cognitive impairment (MCI), and Alzheimer’s disease (AD). Participants completed a translated version of the Neurotrack digital cognitive battery. Results: The AD group performed significantly lower on the associative learning (p = 0.01) and associative memory assessments (p = 0.002), than the HC and AR groups. The AD group also performed worse on the inhibition measure (p = 0.008) than the HC, AR, and MCI groups. For recognition memory, the was a significant difference between all four groups (p < 0.0005), with AD having the lowest scores followed by the MCI, AR, and HC groups, respectively. There were no significant differences observed on attention, executive function and processing speed performance between the four groups (p > 0.05). Conclusion: The use of digital technology appears to be a viable solution to current cognitive assessment challenges for assessing cognitive function in a Tunisian population. These findings provide further support for the use of digital technology in cognitive assessment, particularly in understudied populations.
Collapse
Affiliation(s)
| | - Khaled Trabelsi
- High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
- Research Laboratory: Education, Motricité, Sport et Santé, EM2S, LR19JS01, High Institute of Sport and Physical Education of Sfax, University of Sfax, Sfax, Tunisia
| | - Omar Boukhris
- High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
- Physical Activity, Sport, and Health, UR18JS01, National Observatory of Sport, Tunis, Tunisia
| | - Faten Hadj Kacem
- Department of Endocrinology, Hedi Chaker Hospital, Sfax, Tunisia
| | - Achraf Ammar
- Department of Training and Movement Science, Institute of Sport Science, Johannes Gutenberg-University Mainz, Mainz, Germany
- Interdisciplinary Laboratory in Neurosciences, Physiology and Psychology: Physical Activity, Health and Learning (LINP2), UPL, UFR STAPS (Faculty of Sport Sciences), Paris Nanterre University, Nanterre, France
| | - Ichrak Charfi
- Diagnostic and Therapeutic Unit for Alzheimer’s Disease and Related Dementias “La Trêve”, Errachid Polyclinic, Sfax, Tunisia
| | - Mouna Turki
- Department of Biochemistry, Faculty of Medicine, Habib Bourguiba University Hospital, University of Sfax, Sfax, Tunisia
| | - Salma Charfeddine
- Department of Cardiology, Hédi Chaker University Hospital, Faculty of Medicine of Sfax, University of Sfax, Sfax, Tunisia
| | - Bassem Bouaziz
- Higher Institute of Computer Science and Multimedia of Sfax, University of Sfax, Sfax, Tunisia
| | - Ahmed Hakim
- Laboratory of Pharmacology, Faculty of Medicine, University of Sfax, Sfax, Tunisia
| | - Hamdi Frikha
- Department of Endocrinology, Hedi Chaker Hospital, Sfax, Tunisia
| | | | - Hamdi Chtourou
- High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
- Physical Activity, Sport, and Health, UR18JS01, National Observatory of Sport, Tunis, Tunisia
| | - Jordan M. Glenn
- Neurotrack Technologies, Redwood City, CA, USA
- Exercise Science Research Center, Department of Health, Human Performance and Recreation, University of Arkansas, Fayetteville, AR, USA
| | | |
Collapse
|
16
|
Van Patten R. Introduction to the Special Issue - Neuropsychology from a distance: Psychometric properties and clinical utility of remote neurocognitive tests. J Clin Exp Neuropsychol 2022; 43:767-773. [PMID: 35133240 DOI: 10.1080/13803395.2021.2021645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Ryan Van Patten
- Department of Psychiatry and Human Behavior, Alpert Medical School of Brown, University, Providence, RI, USA.,Providence VA Medical Center, Providence, RI, USA
| |
Collapse
|
17
|
Toups R, Chirles TJ, Ehsani JP, Michael JP, Bernstein JPK, Calamia M, Parsons TD, Carr DB, Keller JN. Driving Performance in Older Adults: Current Measures, Findings, and Implications for Roadway Safety. Innov Aging 2022; 6:igab051. [PMID: 35028434 DOI: 10.1093/geroni/igab051] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2021] [Indexed: 11/13/2022] Open
Abstract
Background and Objectives Over 10,000 people a day turn 65 in the United States. For many older adults, driving represents an essential component of independence and is one of the most important factors in overall mobility. Recent survey studies in older adults suggest that up to 60% of older adult drivers with mild cognitive impairment, and up to 30% with dementia, continue to drive. The purpose of this review is to provide a comprehensive and detailed resource on the topics of cognition and driving for clinicians, researchers, and policymakers working on efforts related to older adult drivers. Research Design and Methods Publications on PubMed and Medline and discussions with experts working in geriatrics, technology, driving policy, psychology, and diverse aspects of driving performance were utilized to inform the current review. Results Research indicates that there is a complex and inverse correlation between multiple cognitive measures, driving performance, and risky driving behaviors. The fragmented nature of available peer-reviewed literature, and a reliance on correlative data, do not currently allow for the identification of the temporal and reciprocal nature of the interplay between cognition and driving endpoints. Discussion and Implications There are currently no widely accepted definitions, conceptual models, or uniform set of analyses for conducting geriatric research that is focused on driving. Establishing conventions for conducting research that harmonizes the fields of geriatrics, cognition, and driving research is critical for the development of the evidence base that will inform clinical practice and road safety policy.
Collapse
Affiliation(s)
- Robert Toups
- Pennington Biomedical Research Center, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Theresa J Chirles
- Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
| | - Johnathon P Ehsani
- Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
| | - Jeffrey P Michael
- Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
| | | | - Matthew Calamia
- Department of Clinical Psychology, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Thomas D Parsons
- Department of Psychology, University of North Texas, Denton, Texas, USA.,Computational Neuropsychology and Simulation Laboratory, University of North Texas, Denton, Texas, USA
| | - David B Carr
- Department of Medicine and Neurology, Washington University School of Medicine, St Louis, Missouri, USA
| | - Jeffrey N Keller
- Pennington Biomedical Research Center, Louisiana State University, Baton Rouge, Louisiana, USA
| |
Collapse
|
18
|
Kourtesis P, MacPherson SE. An ecologically valid examination of event-based and time-based prospective memory using immersive virtual reality: The influence of attention, memory, and executive function processes on real-world prospective memory. Neuropsychol Rehabil 2021; 33:255-280. [PMID: 34856886 DOI: 10.1080/09602011.2021.2008983] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
Studies on prospective memory (PM) predominantly assess either event- or time-based PM by implementing non-ecological laboratory-based tasks. The results deriving from these paradigms have provided findings that are discrepant with ecologically valid research paradigms that converge on the complexity and cognitive demands of everyday tasks. The Virtual Reality Everyday Assessment Lab (VR-EAL), an immersive virtual reality (VR) neuropsychological battery with enhanced ecological validity, was implemented to assess everyday event- and time-based PM, as well as the influence of other cognitive functions on everyday PM functioning. The results demonstrated the role of delayed recognition, planning, and visuospatial attention on everyday PM. Delayed recognition and planning ability were found to be central in event- and time-based PM respectively. In order of importance, delayed recognition, visuospatial attention speed, and planning ability were found to be involved in event-based PM functioning. Comparably, planning, visuospatial attention accuracy, delayed recognition, and multitasking/task-shifting ability were found to be involved in time-based PM functioning. These findings further suggest the importance of ecological validity in the study of PM, which may be achieved using immersive VR paradigms.
Collapse
Affiliation(s)
- Panagiotis Kourtesis
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, UK.,Department of Psychology, University of Edinburgh, Edinburgh, UK.,Lab of Experimental Psychology, Suor Orsola Benincasa University of Naples, Naples, Italy.,Interdepartmental Centre for Planning and Research "Scienza Nuova", Suor Orsola Benincasa University of Naples, Naples, Italy.,National Research Institute of Computer Science and Automation, INRIA, Rennes, France.,Univ Rennes, Rennes, France.,Research Institute of Computer Science and Random Systems, IRISA, Rennes, France.,French National Centre for Scientific Research, CNRS, Rennes, France
| | - Sarah E MacPherson
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, UK.,Department of Psychology, University of Edinburgh, Edinburgh, UK
| |
Collapse
|
19
|
Wang T, Thielen H, De Preter E, Vangkilde S, Gillebert CR. Encouraging Digital Technology in Neuropsychology: The Theory of Visual Attention on Tablet Devices. Arch Clin Neuropsychol 2021; 36:1450–1464. [PMID: 33621327 DOI: 10.1093/arclin/acab007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/28/2021] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVE Visual attention helps us to selectively process relevant information and is crucial in our everyday interactions with the environment. Not surprisingly, it is one of the cognitive domains that is most frequently affected by acquired brain injury. Reliable assessment of attention deficits is pivotal to neuropsychological examination and helps to optimize individual rehabilitation plans. Compared with conventional pen-and-paper tests, computerized tasks borrowed from the field of experimental psychology bring many benefits, but lab-based experimental setups cannot be easily incorporated in clinical practice. Light-weight and portable mobile tablet devices may facilitate the translation of computerized tasks to clinical settings. One such task is based on the Theory of Visual Attention (TVA), a mathematical model of visual attention. TVA-based paradigms have been widely used to investigate several aspects of visual attention in both fundamental and clinical research, and include measures for general processing capacity as well as stimulus-specific attentional parameters. METHODS This article discusses the benefits of TVA-based assessments compared with frequently used neuropsychological tests of visual attention, and examines the reliability of a tablet-based TVA-based assessment in 59 neurologically healthy participants. RESULTS Pearson's correlations indicate that the tablet-based TVA assessment and the conventional lab-based TVA assessment have a comparable parallel-form (range: .67-.93), test-retest (range: .61-.78), and internal reliability (range: .56-.97). CONCLUSION Our results suggest that tablet-based TVA assessment may be a promising tool to acquire clinical measures of visual attention at low cost at the bedside of the patient.
Collapse
Affiliation(s)
- Tianlu Wang
- Department of Brain and Cognition, KU Leuven, Leuven, Belgium
| | - Hella Thielen
- Department of Brain and Cognition, KU Leuven, Leuven, Belgium
| | - Erik De Preter
- Department of Brain and Cognition, KU Leuven, Leuven, Belgium
| | - Signe Vangkilde
- Department of Psychology, University of Copenhagen, Copenhagen, Denmark
| | | |
Collapse
|
20
|
LaPlume AA, Paterson TSE, Gardner S, Stokes KA, Freedman M, Levine B, Troyer AK, Anderson ND. Interindividual and intraindividual variability in amnestic mild cognitive impairment (aMCI) measured with an online cognitive assessment. J Clin Exp Neuropsychol 2021; 43:796-812. [PMID: 34556008 DOI: 10.1080/13803395.2021.1982867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
INTRODUCTION Mean cognitive performance is worse in amnestic mild cognitive impairment (aMCI) compared to control groups. However, studies on variability of cognitive performance in aMCI have yielded inconclusive results, with many differences in variability measures and samples from one study to another. METHODS We examined variability in aMCI using an existing older adult sample (n = 91; 51 with aMCI, 40 with normal cognition for age), measured with an online self-administered computerized cognitive assessment (Cogniciti's Brain Health Assessment). Our methodology extended past findings by using pure measures of variability (controlling for confounding effects of group performance or practice), and a clinically representative aMCI sample (reflecting the continuum of cognitive performance between normal cognition and aMCI). RESULTS Between-group t-tests showed significantly greater between-person variability (interindividual variability or diversity) in overall cognitive performance in aMCI than controls, although the effect size was with a small to moderate effect size, d = 0.44. No significant group differences were found in within-person variability (intraindividual variability) across cognitive tasks (dispersion) or across trials of a response time task (inconsistency), which may be because we used a sample measuring the continuum of cognitive performance. Exploratory correlation analyses showed that a worse overall score was associated with greater inter- and intraindividual variability, and that variability measures were correlated with each other, indicating people with worse cognitive performance were more variable. DISCUSSION The current study demonstrates that self-administered online tests can be used to remotely assess different types of variability in people at risk of Alzheimer`s. Our findings show small but significantly more interindividual differences in people with aMCI. This diversity is considered as "noise" in standard assessments of mean performance, but offers an interesting and cognitively informative "signal" in itself.
Collapse
Affiliation(s)
- Annalise A LaPlume
- Rotman Research Institute, Baycrest (Fully Affiliated with the University of Toronto), Toronto, Canada
| | - Theone S E Paterson
- Department of Psychology, University of Victoria, Victoria, Canada.,Neuropsychology and Cognitive Health Program, Baycrest, Toronto, Canada
| | - Sandra Gardner
- Rotman Research Institute, Baycrest (Fully Affiliated with the University of Toronto), Toronto, Canada.,Biostatistics Division, Dalla Lana School of Public Health, University of Toronto, Toronto, Canada
| | - Kathryn A Stokes
- Neuropsychology and Cognitive Health Program, Baycrest, Toronto, Canada
| | - Morris Freedman
- Rotman Research Institute, Baycrest (Fully Affiliated with the University of Toronto), Toronto, Canada.,Division of Neurology, Baycrest, Toronto, Canada.,Department of Medicine, Division of Neurology, Mt. Sinai Hospital, Toronto, ON, Canada.,Department of Medicine (Neurology), University of Toronto, Toronto, Canada
| | - Brian Levine
- Rotman Research Institute, Baycrest (Fully Affiliated with the University of Toronto), Toronto, Canada.,Department of Medicine (Neurology), University of Toronto, Toronto, Canada.,Department of Psychology, University of Toronto, Toronto, Canada
| | - Angela K Troyer
- Neuropsychology and Cognitive Health Program, Baycrest, Toronto, Canada.,Department of Psychology, University of Toronto, Toronto, Canada
| | - Nicole D Anderson
- Rotman Research Institute, Baycrest (Fully Affiliated with the University of Toronto), Toronto, Canada.,Department of Psychology, University of Toronto, Toronto, Canada.,Department of Psychiatry, University of Toronto, Toronto, Canada
| |
Collapse
|
21
|
Tsoy E, Sideman AB, Piña Escudero SD, Pintado-Caipa M, Kanjanapong S, Al-Rousan T, Mbakile-Mahlanza L, de Oliveira MO, De la Cruz Puebla M, Zygouris S, Mohamed AA, Ibrahim H, Goode CA, Miller BL, Valcour V, Possin KL. Global Perspectives on Brief Cognitive Assessments for Dementia Diagnosis. J Alzheimers Dis 2021; 82:1001-1013. [PMID: 34120897 DOI: 10.3233/jad-201403] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Timely diagnosis of dementia is a global healthcare priority, particularly in low to middle income countries where rapid increases in older adult populations are expected. OBJECTIVE To investigate global perspectives on the role of brief cognitive assessments (BCAs) in dementia diagnosis, strengths and limitations of existing measures, and future directions and needs. METHODS This is a qualitative study of 18 dementia experts from different areas of the world. Participants were selected using purposeful sampling based on the following criteria: 1) practicing in countries with projected growth of older adult population of over 100%by 2050; 2) expertise in dementia diagnosis and treatment; 3) involvement in clinical practice and training; and 4) recognition as a national dementia expert based on leadership positions within healthcare system, research, and/or policy work. Participants were individually interviewed in their language of choice over secure videoconference sessions. Interviews were analyzed by a multidisciplinary team using theme identification approach. RESULTS Four domains with subthemes emerged illustrating participants' perspectives: 1) strengths of BCAs; 2) limitations of BCAs; 3) needs related to the use of BCAs; and 4) characteristics of an ideal BCA. While most experts agreed that BCAs were important and useful for dementia diagnosis, the themes emphasized the need for development and validation of novel measures that are sensitive, psychometrically sound, and culturally appropriate. CONCLUSION BCAs are important for guiding diagnosis and care for dementia patients. Findings provide a roadmap for novel BCA development to assist in diagnostic decision making for clinicians serving a rapidly growing and diverse dementia population.
Collapse
Affiliation(s)
- Elena Tsoy
- Department of Neurology, Memory and Aging Center, University of California, San Francisco, San Francisco, CA, USA
| | - Alissa Bernstein Sideman
- Department of Humanities and Social Sciences, University of California, San Francisco, San Francisco, CA, USA.,Philip R. Lee Institute for Health Policy Studies, University of California, San Francisco, San Francisco, CA, USA.,Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Stefanie D Piña Escudero
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Maritza Pintado-Caipa
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Suchanan Kanjanapong
- Division of Geriatrics, Department of Preventive Medicine, Faculty of Medicine Siriraj Hospital, Mahidol University, Bangkok, Thailand
| | - Tala Al-Rousan
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Lingani Mbakile-Mahlanza
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Maira Okada de Oliveira
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Myriam De la Cruz Puebla
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Stelios Zygouris
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Aya Ashour Mohamed
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Hany Ibrahim
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Collette A Goode
- Department of Neurology, Memory and Aging Center, University of California, San Francisco, San Francisco, CA, USA
| | - Bruce L Miller
- Department of Neurology, Memory and Aging Center, University of California, San Francisco, San Francisco, CA, USA.,Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Victor Valcour
- Department of Neurology, Memory and Aging Center, University of California, San Francisco, San Francisco, CA, USA.,Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| | - Katherine L Possin
- Department of Neurology, Memory and Aging Center, University of California, San Francisco, San Francisco, CA, USA.,Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.,Trinity College Dublin, Ireland
| |
Collapse
|
22
|
How immersive virtual reality methods may meet the criteria of the National Academy of Neuropsychology and American Academy of Clinical Neuropsychology: A software review of the Virtual Reality Everyday Assessment Lab (VR-EAL). COMPUTERS IN HUMAN BEHAVIOR REPORTS 2021. [DOI: 10.1016/j.chbr.2021.100151] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
|
23
|
Ferrar J, Griffith GJ, Skirrow C, Cashdollar N, Taptiklis N, Dobson J, Cree F, Cormack FK, Barnett JH, Munafò MR. Developing Digital Tools for Remote Clinical Research: How to Evaluate the Validity and Practicality of Active Assessments in Field Settings. J Med Internet Res 2021; 23:e26004. [PMID: 34142972 PMCID: PMC8277353 DOI: 10.2196/26004] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 03/23/2021] [Accepted: 05/04/2021] [Indexed: 01/27/2023] Open
Abstract
The ability of remote research tools to collect granular, high-frequency data on symptoms and digital biomarkers is an important strength because it circumvents many limitations of traditional clinical trials and improves the ability to capture clinically relevant data. This approach allows researchers to capture more robust baselines and derive novel phenotypes for improved precision in diagnosis and accuracy in outcomes. The process for developing these tools however is complex because data need to be collected at a frequency that is meaningful but not burdensome for the participant or patient. Furthermore, traditional techniques, which rely on fixed conditions to validate assessments, may be inappropriate for validating tools that are designed to capture data under flexible conditions. This paper discusses the process for determining whether a digital assessment is suitable for remote research and offers suggestions on how to validate these novel tools.
Collapse
Affiliation(s)
- Jennifer Ferrar
- School of Psychological Science, Faculty of Life Sciences, University of Bristol, Bristol, United Kingdom.,Medical Research Council Integrative Epidemiology Unit, University of Bristol, Bristol, United Kingdom
| | - Gareth J Griffith
- Medical Research Council Integrative Epidemiology Unit, University of Bristol, Bristol, United Kingdom.,Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
| | - Caroline Skirrow
- School of Psychological Science, Faculty of Life Sciences, University of Bristol, Bristol, United Kingdom.,Cambridge Cognition Ltd, Cambridge, United Kingdom
| | - Nathan Cashdollar
- Cambridge Cognition Ltd, Cambridge, United Kingdom.,Cambridge Cognition Ltd, Cambridge, MA, United States
| | | | - James Dobson
- Cambridge Cognition Ltd, Cambridge, United Kingdom
| | - Fiona Cree
- Cambridge Cognition Ltd, Cambridge, United Kingdom
| | | | - Jennifer H Barnett
- Cambridge Cognition Ltd, Cambridge, United Kingdom.,Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | - Marcus R Munafò
- School of Psychological Science, Faculty of Life Sciences, University of Bristol, Bristol, United Kingdom.,Medical Research Council Integrative Epidemiology Unit, University of Bristol, Bristol, United Kingdom
| |
Collapse
|
24
|
Esopenko C, Meyer J, Wilde EA, Marshall AD, Tate DF, Lin AP, Koerte IK, Werner KB, Dennis EL, Ware AL, de Souza NL, Menefee DS, Dams-O'Connor K, Stein DJ, Bigler ED, Shenton ME, Chiou KS, Postmus JL, Monahan K, Eagan-Johnson B, van Donkelaar P, Merkley TL, Velez C, Hodges CB, Lindsey HM, Johnson P, Irimia A, Spruiell M, Bennett ER, Bridwell A, Zieman G, Hillary FG. A global collaboration to study intimate partner violence-related head trauma: The ENIGMA consortium IPV working group. Brain Imaging Behav 2021; 15:475-503. [PMID: 33405096 PMCID: PMC8785101 DOI: 10.1007/s11682-020-00417-0] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/02/2020] [Indexed: 12/11/2022]
Abstract
Intimate partner violence includes psychological aggression, physical violence, sexual violence, and stalking from a current or former intimate partner. Past research suggests that exposure to intimate partner violence can impact cognitive and psychological functioning, as well as neurological outcomes. These seem to be compounded in those who suffer a brain injury as a result of trauma to the head, neck or body due to physical and/or sexual violence. However, our understanding of the neurobehavioral and neurobiological effects of head trauma in this population is limited due to factors including difficulty in accessing/recruiting participants, heterogeneity of samples, and premorbid and comorbid factors that impact outcomes. Thus, the goal of the Enhancing NeuroImaging Genetics through Meta-Analysis (ENIGMA) Consortium Intimate Partner Violence Working Group is to develop a global collaboration that includes researchers, clinicians, and other key community stakeholders. Participation in the working group can include collecting harmonized data, providing data for meta- and mega-analysis across sites, or stakeholder insight on key clinical research questions, promoting safety, participant recruitment and referral to support services. Further, to facilitate the mega-analysis of data across sites within the working group, we provide suggestions for behavioral surveys, cognitive tests, neuroimaging parameters, and genetics that could be used by investigators in the early stages of study design. We anticipate that the harmonization of measures across sites within the working group prior to data collection could increase the statistical power in characterizing how intimate partner violence-related head trauma impacts long-term physical, cognitive, and psychological health.
Collapse
Affiliation(s)
- Carrie Esopenko
- Department of Rehabilitation & Movement Sciences, School of Health Professions, Rutgers Biomedical and Health Sciences, Newark, NJ, 07107, USA.
- Department of Health Informatics, School of Health Professions, Rutgers Biomedical and Health Sciences, Newark, NJ, 07107, USA.
| | - Jessica Meyer
- Department of Psychiatry, Summa Health System, Akron, OH, 44304, USA
| | - Elisabeth A Wilde
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, UT, 84148, USA
| | - Amy D Marshall
- Department of Psychology, Pennsylvania State University, University Park, PA, 16802, USA
| | - David F Tate
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, UT, 84148, USA
| | - Alexander P Lin
- Department of Clinical Spectroscopy, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, 02115, USA
| | - Inga K Koerte
- Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, Ludwig-Maximilians-Universität, 80336, Munich, Germany
- Psychiatry Neuroimaging Laboratory, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, 02115, USA
| | - Kimberly B Werner
- College of Nursing, University of Missouri, St. Louis, MO, 63121, USA
| | - Emily L Dennis
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, UT, 84148, USA
| | - Ashley L Ware
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- Department of Psychology, University of Calgary, Calgary, AB, T2N 1N4, Canada
| | - Nicola L de Souza
- School of Graduate Studies, Biomedical Sciences, Rutgers, The State University of New Jersey, Newark, NJ, 07103, USA
| | | | - Kristen Dams-O'Connor
- Department of Rehabilitation Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA
- Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA
| | - Dan J Stein
- Department of Psychiatry and Neuroscience Institute, South African Medical Research Council Unit on Risk & Resilience in Mental Disorders, University of Cape Town, Cape Town, 7501, South Africa
| | - Erin D Bigler
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- Department of Psychology, Brigham Young University, Provo, UT, 84602, USA
| | - Martha E Shenton
- College of Nursing, University of Missouri, St. Louis, MO, 63121, USA
- Departments of Psychiatry and Radiology, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, 02115, USA
- Veterans Affairs, Boston Healthcare System, Boston, MA, 02130, USA
| | - Kathy S Chiou
- Department of Psychology, University of Nebraska-Lincoln, Lincoln, NE, 68588, USA
| | - Judy L Postmus
- School of Social Work, University of Maryland, Baltimore, USA
| | - Kathleen Monahan
- School of Social Welfare, Stony Brook University, Stony Brook, NY, 11794-8231, USA
| | | | - Paul van Donkelaar
- School of Health and Exercise Sciences, University of British Columbia, Kelowna, BC, V1V 1V7, Canada
| | - Tricia L Merkley
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- Department of Psychology, Brigham Young University, Provo, UT, 84602, USA
- Department of Physical Medicine and Rehabilitation, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Carmen Velez
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
| | - Cooper B Hodges
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, UT, 84148, USA
- Department of Psychology, Brigham Young University, Provo, UT, 84602, USA
| | - Hannah M Lindsey
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, UT, 84148, USA
- Department of Psychology, Brigham Young University, Provo, UT, 84602, USA
| | - Paula Johnson
- Traumatic Brain Injury and Concussion Center, Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132, USA
- George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, UT, 84148, USA
- Neuroscience Center, Brigham Young University, Provo, UT, 84602, USA
| | - Andrei Irimia
- Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA, 90089, USA
- Denney Research Center Department of Biomedical Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Matthew Spruiell
- Department of Physical Medicine and Rehabilitation, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Esther R Bennett
- Rutgers University School of Social Work, New Brunswick, NJ, 08901, USA
| | - Ashley Bridwell
- Barrow Concussion and Brain Injury Center, Barrow Neurological Institute, Phoenix, AZ, USA
| | - Glynnis Zieman
- Barrow Concussion and Brain Injury Center, Barrow Neurological Institute, Phoenix, AZ, USA
| | - Frank G Hillary
- Department of Psychology, Pennsylvania State University, University Park, PA, 16802, USA
- Social Life and Engineering Sciences Imaging Center, University Park, PA, 16802, USA
| |
Collapse
|
25
|
Kourtesis P, Collina S, Doumas LAA, MacPherson SE. An ecologically valid examination of event-based and time-based prospective memory using immersive virtual reality: the effects of delay and task type on everyday prospective memory. Memory 2021; 29:486-506. [PMID: 33761841 DOI: 10.1080/09658211.2021.1904996] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Recent research has focused on assessing either event- or time-based prospective memory (PM) using laboratory tasks. Yet, the findings pertaining to PM performance on laboratory tasks are often inconsistent with the findings on corresponding naturalistic experiments. Ecologically valid neuropsychological tasks resemble the complexity and cognitive demands of everyday tasks, offer an adequate level of experimental control, and allow a generalisation of the findings to everyday performance. The Virtual Reality Everyday Assessment Lab (VR-EAL), an immersive virtual reality neuropsychological battery with enhanced ecological validity, was implemented to comprehensively assess everyday PM (i.e., focal and non-focal event-based, and time-based). The effects of the length of delay between encoding and initiating the PM intention and the type of PM task on everyday PM performance were examined. The results revealed that everyday PM performance was affected by the length of delay rather than the type of PM task. The effect of the length of delay differentially affected performance on the focal, non-focal, and time-based tasks and was proportional to the PM cue focality (i.e., semantic relationship with the intended action). This study also highlighted methodological considerations such as the differentiation between functioning and ability, distinction of cue attributes, and the necessity of ecological validity.
Collapse
Affiliation(s)
- Panagiotis Kourtesis
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, UK.,Department of Psychology, University of Edinburgh, Edinburgh, UK.,Lab of Experimental Psychology, Suor Orsola Benincasa University of Naples, Naples, Italy.,Interdepartmental Centre for Planning and Research "Scienza Nuova", Suor Orsola Benincasa University of Naples, Naples, Italy.,National Research Institute of Computer Science and Automation, INRIA, Rennes, France.,Univ Rennes, Rennes, France.,Research Institute of Computer Science and Random Systems, IRISA, Rennes, France.,French National Centre for Scientific Research, CNRS, Rennes, France
| | - Simona Collina
- Lab of Experimental Psychology, Suor Orsola Benincasa University of Naples, Naples, Italy.,Interdepartmental Centre for Planning and Research "Scienza Nuova", Suor Orsola Benincasa University of Naples, Naples, Italy
| | | | - Sarah E MacPherson
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, UK.,Department of Psychology, University of Edinburgh, Edinburgh, UK
| |
Collapse
|
26
|
Validation of the Virtual Reality Everyday Assessment Lab (VR-EAL): An Immersive Virtual Reality Neuropsychological Battery with Enhanced Ecological Validity. J Int Neuropsychol Soc 2021; 27:181-196. [PMID: 32772948 DOI: 10.1017/s1355617720000764] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
OBJECTIVE The assessment of cognitive functions such as prospective memory, episodic memory, attention, and executive functions benefits from an ecologically valid approach to better understand how performance outcomes generalize to everyday life. Immersive virtual reality (VR) is considered capable of simulating real-life situations to enhance ecological validity. The present study attempted to validate the Virtual Reality Everyday Assessment Lab (VR-EAL), an immersive VR neuropsychological battery, against an extensive paper-and-pencil neuropsychological battery. METHODS Forty-one participants (21 females) were recruited: 18 gamers and 23 non-gamers who attended both an immersive VR and a paper-and-pencil testing session. Bayesian Pearson's correlation analyses were conducted to assess construct and convergent validity of the VR-EAL. Bayesian t-tests were performed to compare VR and paper-and-pencil testing in terms of administration time, similarity to real-life tasks (i.e., ecological validity), and pleasantness. RESULTS VR-EAL scores were significantly correlated with their equivalent scores on the paper-and-pencil tests. The participants' reports indicated that the VR-EAL tasks were significantly more ecologically valid and pleasant than the paper-and-pencil neuropsychological battery. The VR-EAL battery also had a shorter administration time. CONCLUSION The VR-EAL appears as an effective neuropsychological tool for the assessment of everyday cognitive functions, which has enhanced ecological validity, a highly pleasant testing experience, and does not induce cybersickness.
Collapse
|
27
|
Parsons TD. Ethical Challenges of Using Virtual Environments in the Assessment and Treatment of Psychopathological Disorders. J Clin Med 2021; 10:378. [PMID: 33498255 PMCID: PMC7863955 DOI: 10.3390/jcm10030378] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Revised: 01/13/2021] [Accepted: 01/14/2021] [Indexed: 12/17/2022] Open
Abstract
Clinicians are increasingly interested in the potential of virtual environments for research and praxes. Virtual environments include both immersive and non-immersive simulations of everyday activities. Moreover, algorithmic devices and adaptive virtual environments allow clinicians a medium for personalizing technologies to their patients. There is also increasing recognition of social virtual environments that connect virtual environments to social networks. Although there has been a great deal of deliberation on these novel technologies for assessment and treatment, less discourse has occurred around the ethical challenges that may ensue when these technologies are applied clinically. In this paper, some of the ethical issues involved in the clinical use of novel technologies are discussed.
Collapse
Affiliation(s)
- Thomas D. Parsons
- iCenter for Affective Technologies (iCAN), University of North Texas, Denton, TX 76207, USA;
- Computational Neuropsychology and Simulation (CNS), University of North Texas, Denton, TX 76207, USA
- College of Information, University of North Texas, Denton, TX 76207, USA
| |
Collapse
|
28
|
Tsoy E, Zygouris S, Possin KL. Current State of Self-Administered Brief Computerized Cognitive Assessments for Detection of Cognitive Disorders in Older Adults: A Systematic Review. JPAD-JOURNAL OF PREVENTION OF ALZHEIMERS DISEASE 2021; 8:267-276. [PMID: 34101783 PMCID: PMC7987552 DOI: 10.14283/jpad.2021.11] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
Early diagnosis of cognitive disorders in older adults is a major healthcare priority with benefits to patients, families, and health systems. Rapid advances in digital technology offer potential for developing innovative diagnostic pathways to support early diagnosis. Brief self-administered computerized cognitive tools in particular hold promise for clinical implementation by minimizing demands on staff time. In this study, we conducted a systematic review of self-administered computerized cognitive assessment measures designed for the detection of cognitive impairment in older adults. Studies were identified via a systematic search of published peer-reviewed literature across major scientific databases. All studies reporting on psychometric validation of brief (≤30 minutes) self-administered computerized measures for detection of MCI and all-cause dementia in older adults were included. Seventeen studies reporting on 10 cognitive tools met inclusion criteria and were subjected to systematic review. There was substantial variability in characteristics of validation samples and reliability and validity estimates. Only 2 measures evaluated feasibility and usability in the intended clinical settings. Similar to past reviews, we found variability across measures with regard to psychometric rigor and potential for widescale applicability in clinical settings. Despite the promise that self-administered cognitive tests hold for clinical implementation, important gaps in scientific rigor in development, validation, and feasibility studies of these measures remain. Developments in technology and biomarker studies provide potential avenues for future directions on the use of digital technology in clinical care.
Collapse
Affiliation(s)
- E Tsoy
- Katherine L. Possin, PhD, Associate Professor in Residence, Department of Neurology, University of California San Francisco, Memory and Aging Center, Box 1207, 675 Nelson Rising Lane, Suite 190, San Francisco, CA 94158, Tel: 415-476-1889, E-mail:
| | | | | |
Collapse
|
29
|
Parsons T, Duffield T. Paradigm Shift Toward Digital Neuropsychology and High-Dimensional Neuropsychological Assessments: Review. J Med Internet Res 2020; 22:e23777. [PMID: 33325829 PMCID: PMC7773516 DOI: 10.2196/23777] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Revised: 10/26/2020] [Accepted: 10/28/2020] [Indexed: 12/29/2022] Open
Abstract
Neuropsychologists in the digital age have increasing access to emerging technologies. The National Institutes of Health (NIH) initiatives for behavioral and social sciences have emphasized these developing scientific and technological potentials (eg, novel sensors) for augmented characterization of neurocognitive, behavioral, affective, and social processes. Perhaps these innovative technologies will lead to a paradigm shift from disintegrated and data-poor behavioral science to cohesive and data-rich science that permits improved translation from bench to bedside. The 4 main advances influencing the scientific priorities of a recent NIH Office of Behavioral and Social Sciences Research strategic plan include the following: integration of neuroscience into behavioral and social sciences, transformational advances in measurement science, digital intervention platforms, and large-scale population cohorts and data integration. This paper reviews these opportunities for novel brain-behavior characterizations. Emphasis is placed on the increasing concern of neuropsychology with these topics and the need for development in these areas to maintain relevance as a scientific discipline and advance scientific developments. Furthermore, the effects of such advancements necessitate discussion and modification of training as well as ethical and legal mandates for neuropsychological research and praxes.
Collapse
Affiliation(s)
- Thomas Parsons
- Computational Neuropsychology & Simulation, University of North Texas, Denton, TX, United States
| | - Tyler Duffield
- Oregon Health & Science University, Portland, OR, United States
| |
Collapse
|
30
|
Patient and clinician experiences of a computerised cognitive battery for use after concussion: a preliminary qualitative study. BRAIN IMPAIR 2020. [DOI: 10.1017/brimp.2020.14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractObjective:The Cognition Battery of the National Institute of Health (NIH) Toolbox for Assessment of Neurological and Behavioural Function is a computerised neuropsychological battery recommended for clinical practice, neurological research and clinical trials. We investigated the utility of the NIH Toolbox Cognition Battery (NIHTB-CB) for people with concussion.Methods:In this small qualitative study, semi-structured interviews were conducted with five adults with concussion who were participating in a larger study using the NIHTB-CB. Three clinician participants and two cultural advisors familiar with the tool were also interviewed. Interview transcripts were analysed using a general thematic approach and qualitative description.Results:Participants described both positive and negative experiences with the NIHTB-CB and using qualitative description, their experiences were organised into three broad themes: (1) using technology for cognitive testing made sense, (2) there were some cultural relevance questions and (3) cognitive testing after concussion could have challenges. They were positive about the computerised format and range of domains assessed for the concussion context but identified the contextual relevance of some content as having potential to impact on performances.Conclusion:This was a small study examining the experiences of a select group of participants, but nevertheless does suggest a need for future research validating the NIHTB-CB for use in different cultural and clinical contexts.
Collapse
|
31
|
Arrieux JP, Roberson BL, Russell KN, Ivins BJ, Cole WR. An Investigation of the Accuracy of Reaction Time Measurements on ANAM4 TBI-MIL Across Three Computer Platforms. Arch Clin Neuropsychol 2020; 35:1145–1153. [PMID: 32483600 DOI: 10.1093/arclin/acaa032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/16/2020] [Indexed: 02/28/2024] Open
Abstract
STUDY DESIGN Using two observational methods and a within-subjects, counterbalanced design, this study aimed to determine if a computer's hardware and software settings significantly affected reaction time (RT) on the Automated Neuropsychological Assessment Metrics (Version 4) Traumatic Brain Injury Military (ANAM4 TBI-MIL). METHODS Three computer platforms were investigated: Platform 1-older computers recommended for ANAM4 TBI-MIL administration, Platform 2-newer computers with settings downgraded to run like the older computers, and Platform 3-newer computers with default settings. Two observational methods were used to compare measured RT to observed RT on all three platforms: 1, a high-speed video analysis to compare the timing of stimulus onset and response to the measured RT and 2, comparing a preset RT delivered by a robotic key actuator activated by optic detector to the measured RT. Additionally, healthy active duty service members (n = 169) were administered a brief version of the ANAM4 TBI-MIL battery on each of the three platforms. RESULTS RT differences were observed with both the high-speed video and robotic arm analyses across all three computer platforms, with the smallest discrepancies between observed and measured RT on Platform 1, followed by Platform 2, then Platform 3. When simple reaction time (SRT) raw and standardized scores obtained from the participants were compared across platforms, statistically significant and clinically meaningful differences were seen, especially between Platforms 1 and 3. CONCLUSIONS A computer's configurations have a meaningful impact on ANAM SRT scores. The difference in an individual's performance across platforms could be misinterpreted as clinically meaningful change.
Collapse
Affiliation(s)
- Jacques P Arrieux
- Defense and Veterans Brain Injury Center, Fort Bragg, NC, USA
- Intrepid Spirit Center, Department of Brain Injury Medicine, Womack Army Medical Center, Fort Bragg, NC, USA
- General Dynamics Information Technology, Fairfax, VA, USA
| | - Brittney L Roberson
- Defense and Veterans Brain Injury Center, Fort Bragg, NC, USA
- Intrepid Spirit Center, Department of Brain Injury Medicine, Womack Army Medical Center, Fort Bragg, NC, USA
- General Dynamics Information Technology, Fairfax, VA, USA
| | - Katie N Russell
- Defense and Veterans Brain Injury Center, Fort Bragg, NC, USA
- Intrepid Spirit Center, Department of Brain Injury Medicine, Womack Army Medical Center, Fort Bragg, NC, USA
- General Dynamics Information Technology, Fairfax, VA, USA
| | - Brian J Ivins
- Defense and Veterans Brain Injury Center, Silver Spring, MD, USA
- General Dynamics Information Technology, Fairfax, VA, USA
| | - Wesley R Cole
- Defense and Veterans Brain Injury Center, Fort Bragg, NC, USA
- Intrepid Spirit Center, Department of Brain Injury Medicine, Womack Army Medical Center, Fort Bragg, NC, USA
- General Dynamics Information Technology, Fairfax, VA, USA
| |
Collapse
|
32
|
Backx R, Skirrow C, Dente P, Barnett JH, Cormack FK. Comparing Web-Based and Lab-Based Cognitive Assessment Using the Cambridge Neuropsychological Test Automated Battery: A Within-Subjects Counterbalanced Study. J Med Internet Res 2020; 22:e16792. [PMID: 32749999 PMCID: PMC7435628 DOI: 10.2196/16792] [Citation(s) in RCA: 53] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2019] [Revised: 05/15/2020] [Accepted: 06/11/2020] [Indexed: 12/22/2022] Open
Abstract
Background Computerized assessments are already used to derive accurate and reliable measures of cognitive function. Web-based cognitive assessment could improve the accessibility and flexibility of research and clinical assessment, widen participation, and promote research recruitment while simultaneously reducing costs. However, differences in context may influence task performance. Objective This study aims to determine the comparability of an unsupervised, web-based administration of the Cambridge Neuropsychological Test Automated Battery (CANTAB) against a typical in-person lab-based assessment, using a within-subjects counterbalanced design. The study aims to test (1) reliability, quantifying the relationship between measurements across settings using correlational approaches; (2) equivalence, the extent to which test results in different settings produce similar overall results; and (3) agreement, by quantifying acceptable limits to bias and differences between measurement environments. Methods A total of 51 healthy adults (32 women and 19 men; mean age 36.8, SD 15.6 years) completed 2 testing sessions, which were completed on average 1 week apart (SD 4.5 days). Assessments included equivalent tests of emotion recognition (emotion recognition task [ERT]), visual recognition (pattern recognition memory [PRM]), episodic memory (paired associate learning [PAL]), working memory and spatial planning (spatial working memory [SWM] and one touch stockings of Cambridge), and sustained attention (rapid visual information processing [RVP]). Participants were randomly allocated to one of the two groups, either assessed in-person in the laboratory first (n=33) or with unsupervised web-based assessments on their personal computing systems first (n=18). Performance indices (errors, correct trials, and response sensitivity) and median reaction times were extracted. Intraclass and bivariate correlations examined intersetting reliability, linear mixed models and Bayesian paired sample t tests tested for equivalence, and Bland-Altman plots examined agreement. Results Intraclass correlation (ICC) coefficients ranged from ρ=0.23-0.67, with high correlations in 3 performance indices (from PAL, SWM, and RVP tasks; ρ≥0.60). High ICC values were also seen for reaction time measures from 2 tasks (PRM and ERT tasks; ρ≥0.60). However, reaction times were slower during web-based assessments, which undermined both equivalence and agreement for reaction time measures. Performance indices did not differ between assessment settings and generally showed satisfactory agreement. Conclusions Our findings support the comparability of CANTAB performance indices (errors, correct trials, and response sensitivity) in unsupervised, web-based assessments with in-person and laboratory tests. Reaction times are not as easily translatable from in-person to web-based testing, likely due to variations in computer hardware. The results underline the importance of examining more than one index to ascertain comparability, as high correlations can present in the context of systematic differences, which are a product of differences between measurement environments. Further work is now needed to examine web-based assessments in clinical populations and in larger samples to improve sensitivity for detecting subtler differences between test settings.
Collapse
Affiliation(s)
- Rosa Backx
- Cambridge Cognition Ltd, Cambridge, United Kingdom
| | - Caroline Skirrow
- Cambridge Cognition Ltd, Cambridge, United Kingdom.,School of Psychological Science, University of Bristol, Bristol, United Kingdom
| | | | - Jennifer H Barnett
- Cambridge Cognition Ltd, Cambridge, United Kingdom.,Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | | |
Collapse
|
33
|
Gómez-Tello MF, Rosetti MF, Galicia-Alvarado M, Maya C, Apiquian R. Neuropsychological screening with TOWI: Performance in 6- to 12-year-old children. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 11:115-124. [PMID: 32429822 DOI: 10.1080/21622965.2020.1764357] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Videogames represent an exciting development in neuropsychological assessment of cognitive function. Here, we used TOWI, a series of games based on standardized tests, to evaluate the cognitive performance of a large sample of school-age children. We compared the metrics produced by TOWI with the performance metrics reported for the standardized tests that inspired each of these tasks. We found ascending values together with age for scores reflecting correct answers and descending values together with age for scores reflecting completion times, mistakes or missed entries. Sensitivity to developmental changes, similarities with standardized tests of task metrics contribute to the validity of TOWI as a screening tool.
Collapse
Affiliation(s)
- Maria F Gómez-Tello
- Kognisi, Mexico City, Mexico.,Areté Proyectos y Administración, Mexico City, Mexico
| | - Marcos F Rosetti
- Instituto de Investigaciones Biomédicas, Universidad Nacional Autónoma de México, Mexico City, Mexico.,Instituto Nacional de Psiquiatría Ramón de la Fuente Muñiz, Mexico City, Mexico
| | | | - César Maya
- Instituto de Investigaciones Biomédicas, Universidad Nacional Autónoma de México, Mexico City, Mexico
| | - Rogelio Apiquian
- Areté Proyectos y Administración, Mexico City, Mexico.,Facultad de Ciencias de la Salud, Universidad Anáhuac Campus Norte, Mexico City, Mexico
| |
Collapse
|
34
|
Kourtesis P, Korre D, Collina S, Doumas LAA, MacPherson SE. Guidelines for the Development of Immersive Virtual Reality Software for Cognitive Neuroscience and Neuropsychology: The Development of Virtual Reality Everyday Assessment Lab (VR-EAL), a Neuropsychological Test Battery in Immersive Virtual Reality. FRONTIERS IN COMPUTER SCIENCE 2020. [DOI: 10.3389/fcomp.2019.00012] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
35
|
McKinney TL, Euler MJ, Butner JE. It’s about time: The role of temporal variability in improving assessment of executive functioning. Clin Neuropsychol 2019; 34:619-642. [DOI: 10.1080/13854046.2019.1704434] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Affiliation(s)
- Ty L. McKinney
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| | - Matthew J. Euler
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| | | |
Collapse
|
36
|
Kourtesis P, Collina S, Doumas LAA, MacPherson SE. Validation of the Virtual Reality Neuroscience Questionnaire: Maximum Duration of Immersive Virtual Reality Sessions Without the Presence of Pertinent Adverse Symptomatology. Front Hum Neurosci 2019; 13:417. [PMID: 31849627 PMCID: PMC6901952 DOI: 10.3389/fnhum.2019.00417] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Accepted: 11/11/2019] [Indexed: 12/01/2022] Open
Abstract
There are major concerns about the suitability of immersive virtual reality (VR) systems (i.e., head-mounted display; HMD) to be implemented in research and clinical settings, because of the presence of nausea, dizziness, disorientation, fatigue, and instability (i.e., VR induced symptoms and effects; VRISE). Research suggests that the duration of a VR session modulates the presence and intensity of VRISE, but there are no suggestions regarding the appropriate maximum duration of VR sessions. The implementation of high-end VR HMDs in conjunction with ergonomic VR software seems to mitigate the presence of VRISE substantially. However, a brief tool does not currently exist to appraise and report both the quality of software features and VRISE intensity quantitatively. The Virtual Reality Neuroscience Questionnaire (VRNQ) was developed to assess the quality of VR software in terms of user experience, game mechanics, in-game assistance, and VRISE. Forty participants aged between 28 and 43 years were recruited (18 gamers and 22 non-gamers) for the study. They participated in 3 different VR sessions until they felt weary or discomfort and subsequently filled in the VRNQ. Our results demonstrated that VRNQ is a valid tool for assessing VR software as it has good convergent, discriminant, and construct validity. The maximum duration of VR sessions should be between 55 and 70 min when the VR software meets or exceeds the parsimonious cut-offs of the VRNQ and the users are familiarized with the VR system. Also, the gaming experience does not seem to affect how long VR sessions should last. Also, while the quality of VR software substantially modulates the maximum duration of VR sessions, age and education do not. Finally, deeper immersion, better quality of graphics and sound, and more helpful in-game instructions and prompts were found to reduce VRISE intensity. The VRNQ facilitates the brief assessment and reporting of the quality of VR software features and/or the intensity of VRISE, while its minimum and parsimonious cut-offs may appraise the suitability of VR software for implementation in research and clinical settings. The findings of this study contribute to the establishment of rigorous VR methods that are crucial for the viability of immersive VR as a research and clinical tool in cognitive neuroscience and neuropsychology.
Collapse
Affiliation(s)
- Panagiotis Kourtesis
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom.,Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom.,Lab of Experimental Psychology, Suor Orsola Benincasa University of Naples, Naples, Italy.,Interdepartmental Centre for Planning and Research "Scienza Nuova", Suor Orsola Benincasa University of Naples, Naples, Italy
| | - Simona Collina
- Lab of Experimental Psychology, Suor Orsola Benincasa University of Naples, Naples, Italy.,Interdepartmental Centre for Planning and Research "Scienza Nuova", Suor Orsola Benincasa University of Naples, Naples, Italy
| | - Leonidas A A Doumas
- Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom
| | - Sarah E MacPherson
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom.,Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom
| |
Collapse
|
37
|
Kourtesis P, Collina S, Doumas LAA, MacPherson SE. Technological Competence Is a Pre-condition for Effective Implementation of Virtual Reality Head Mounted Displays in Human Neuroscience: A Technological Review and Meta-Analysis. Front Hum Neurosci 2019; 13:342. [PMID: 31632256 PMCID: PMC6783565 DOI: 10.3389/fnhum.2019.00342] [Citation(s) in RCA: 57] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2019] [Accepted: 09/18/2019] [Indexed: 11/13/2022] Open
Abstract
Immersive virtual reality (VR) emerges as a promising research and clinical tool. However, several studies suggest that VR induced adverse symptoms and effects (VRISE) may undermine the health and safety standards, and the reliability of the scientific results. In the current literature review, the technical reasons for the adverse symptomatology are investigated to provide suggestions and technological knowledge for the implementation of VR head-mounted display (HMD) systems in cognitive neuroscience. The technological systematic literature indicated features pertinent to display, sound, motion tracking, navigation, ergonomic interactions, user experience, and computer hardware that should be considered by the researchers. Subsequently, a meta-analysis of 44 neuroscientific or neuropsychological studies involving VR HMD systems was performed. The meta-analysis of the VR studies demonstrated that new generation HMDs induced significantly less VRISE and marginally fewer dropouts. Importantly, the commercial versions of the new generation HMDs with ergonomic interactions had zero incidents of adverse symptomatology and dropouts. HMDs equivalent to or greater than the commercial versions of contemporary HMDs accompanied with ergonomic interactions are suitable for implementation in cognitive neuroscience. In conclusion, researchers' technological competency, along with meticulous methods and reports pertinent to software, hardware, and VRISE, are paramount to ensure the health and safety standards and the reliability of neuroscientific results.
Collapse
Affiliation(s)
- Panagiotis Kourtesis
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom.,Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom.,Lab of Experimental Psychology, Suor Orsola Benincasa University of Naples, Naples, Italy.,Interdepartmental Centre for Planning and Research "Scienza Nuova", Suor Orsola Benincasa University of Naples, Naples, Italy
| | - Simona Collina
- Lab of Experimental Psychology, Suor Orsola Benincasa University of Naples, Naples, Italy.,Interdepartmental Centre for Planning and Research "Scienza Nuova", Suor Orsola Benincasa University of Naples, Naples, Italy
| | - Leonidas A A Doumas
- Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom
| | - Sarah E MacPherson
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom.,Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom
| |
Collapse
|
38
|
Nyamayaro P, Chibanda D, Robbins RN, Hakim J, Gouse H. Assessment of neurocognitive deficits in people living with HIV in Sub Saharan Africa: A systematic review. Clin Neuropsychol 2019; 33:1-26. [PMID: 31043112 DOI: 10.1080/13854046.2019.1606284] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
Objective: People living with HIV (PLWH) are at risk for HIV-Associated Neurocognitive Disorders (HAND)/Neurocognitive Impairment (NCI). HIV prevalence in Sub-Saharan Africa (SSA) is high, but neuropsychological screening and testing for NCI among HIV-infected individuals is not done frequently. This systematic review aims to establish how NCI among HIV-infected individuals is being assessed in SSA, if and how the tests are adapted, if norms exist and identify personnel who administer them.Method: We searched PubMed, Medline, EBSCO, PsycINFO, and Web of Science. Two reviewers screened the articles for inclusion and risk of bias. We included studies from SSA with a comprehensive neuropsychological assessment battery.Results: We retrieved 212 articles and 23 articles met inclusion criteria. The most commonly used tests were the Color Trails Test 1, Color Trails Test 2, and the WAIS III Digit Symbol Test. Some tests were translated into French (Cameroon), Luganda (Uganda), Chichewa (Malawi), isiXhosa (South Africa), and Afrikaans (South Africa). Some verbal learning tests were adapted to reflect culturally appropriate language. Test administrators were either non-specialized personnel supervised by clinical neuropsychologists or clinical psychologists.Conclusion: Overall, the tests used are similar to the tests being used globally to assess NCI among HIV-infected individuals and there is a general consistency across countries. However, there is generally a lack of norms for the tests and the process of adaptation is not always well described. Future research should establish whether these tests measure neuropsychological constructs as successfully as they do in western populations where the tests were developed.
Collapse
Affiliation(s)
| | - Dixon Chibanda
- Department of Psychiatry, University of Zimbabwe, Harare, Zimbabwe.,Centre for Global Mental Health, London School of Hygiene and Tropical Medicine, London, United Kingdom
| | - Reuben N Robbins
- New York State Psychiatric Institute, Columbia University, New York, United States
| | - James Hakim
- Department of Medicine, University of Zimbabwe, Harare, Zimbabwe
| | - Hetta Gouse
- Department of Psychiatry and Mental Health, University of Cape Town, Cape Town, South Africa
| |
Collapse
|
39
|
Parsons TD, Duffield T. National Institutes of Health initiatives for advancing scientific developments in clinical neuropsychology. Clin Neuropsychol 2019; 33:246-270. [PMID: 30760117 DOI: 10.1080/13854046.2018.1523465] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
OBJECTIVE The current review briefly addresses the history of neuropsychology as a context for discussion of developmental milestones that have advanced the profession, as well as areas where the progression has lagged. More recently in the digital/information age, utilization and incorporation of emerging technologies has been minimal, which has stagnated ongoing evolution of the practice of neuropsychology despite technology changing many aspects of daily living. These authors advocate for embracing National Institutes of Health (NIH) initiatives, or interchangeably referred to as transformative opportunities, for the behavioral and social sciences. These initiatives address the need for neuropsychologists to transition from fragmented and data-poor approaches to integrated and data-rich scientific approaches that ultimately improve translational applications. Specific to neuropsychology is the need for the adoption of novel means of brain-behavior characterizations. METHOD Narrative review Conclusions: Clinical neuropsychology has reached a developmental plateau where it is ready to embrace the measurement science and technological advances which have been readily adopted by the human neurosciences. While there are ways in which neuropsychology is making inroads into these areas, a great deal of growth is needed to maintain relevance as a scientific discipline (see Figures 1, 2, and 3) consistent with NIH initiatives to advance scientific developments. Moreover, implications of such progress require discussion and modification of training, ethical, and legal mandates of the practice of neuropsychology.
Collapse
Affiliation(s)
- Thomas D Parsons
- a NetDragon Digital Research Centre , Denton , Texas.,b Computational Neuropsychology and Simulation (CNS) Laboratory , Denton , Texas.,c College of Information , Denton , Texas
| | - Tyler Duffield
- d Department of Family/Sports Medicine , Oregon Health and Science University , Portland , Oregon , USA
| |
Collapse
|
40
|
Faria AL, Pinho MS, Bermúdez I Badia S. Capturing Expert Knowledge for the Personalization of Cognitive Rehabilitation: Study Combining Computational Modeling and a Participatory Design Strategy. JMIR Rehabil Assist Technol 2018; 5:e10714. [PMID: 30522994 PMCID: PMC6318149 DOI: 10.2196/10714] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2018] [Revised: 09/29/2018] [Accepted: 10/23/2018] [Indexed: 01/17/2023] Open
Abstract
Background Cognitive impairments after stroke are not always given sufficient attention despite the critical limitations they impose on activities of daily living (ADLs). Although there is substantial evidence on cognitive rehabilitation benefits, its implementation is limited because of time and human resource’s demands. Moreover, many cognitive rehabilitation interventions lack a robust theoretical framework in the selection of paper-and-pencil tasks by the clinicians. In this endeavor, it would be useful to have a tool that could generate standardized paper-and-pencil tasks, parameterized according to patients' needs. Objective In this study, we aimed to present a framework for the creation of personalized cognitive rehabilitation tasks based on a participatory design strategy. Methods We selected 11 paper-and-pencil tasks from standard clinical practice and parameterized them with multiple configurations. A total of 67 tasks were assessed according to their cognitive demands (attention, memory, language, and executive functions) and overall difficulty by 20 rehabilitation professionals. Results After assessing the internal consistency of the data—that is, alpha values from .918 to .997—we identified the parameters that significantly affected cognitive functions and proposed specific models for each task. Through computational modeling, we operationalized the tasks into their intrinsic parameters and developed a Web tool that generates personalized paper-and-pencil tasks—the Task Generator (TG). Conclusions Our framework proposes an objective and quantitative personalization strategy tailored to each patient in multiple cognitive domains (attention, memory, language, and executive functions) derived from expert knowledge and materialized in the TG app, a cognitive rehabilitation Web tool.
Collapse
Affiliation(s)
- Ana Lúcia Faria
- Madeira Interactive Technologies Institute, Funchal, Portugal.,Faculdade de Psicologia e de Ciências da Educação, Universidade de Coimbra, Coimbra, Portugal
| | - Maria Salomé Pinho
- Faculdade de Psicologia e de Ciências da Educação, Universidade de Coimbra, Coimbra, Portugal.,Laboratório de Memória, Linguagem e Funções Executivas, Coimbra, Portugal
| | - Sergi Bermúdez I Badia
- Madeira Interactive Technologies Institute, Funchal, Portugal.,Centro de Ciências Exatas e da Engenharia, Universidade da Madeira, Funchal, Portugal
| |
Collapse
|
41
|
Stricker NH, Lundt ES, Edwards KK, Machulda MM, Kremers WK, Roberts RO, Knopman DS, Petersen RC, Mielke MM. Comparison of PC and iPad administrations of the Cogstate Brief Battery in the Mayo Clinic Study of Aging: Assessing cross-modality equivalence of computerized neuropsychological tests. Clin Neuropsychol 2018; 33:1102-1126. [PMID: 30417735 DOI: 10.1080/13854046.2018.1519085] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Objective: Computerized neuropsychological assessments are increasingly used in clinical practice, population studies of cognitive aging and clinical trial enrichment. Subtle, but significant, performance differences have been demonstrated across different modes of test administration and require further investigation. Method: Participants included cognitively unimpaired adults aged 50 and older from the Mayo Clinic Study of Aging who completed the Cogstate Brief Battery and Cogstate's Groton Maze Learning Test (GMLT) on an iPad or a personal computer (PC) in the clinic. Mode of administration differences and test-retest reliability coefficients were examined across 3 cohorts: a demographically matched test-retest cohort completing PC and iPad administrations the same day (N = 168); a test naïve cohort comparing baseline PC (n = 1820) and iPad (n =605) performance; and a demographically matched longitudinal cohort completing 3 Cogstate visits over 15 months on either the PC (n =63) or iPad (n =63). Results: Results showed a small but statistically significant and consistent finding for faster performance on PC relative to iPad for several Cogstate Brief Battery measures. Measures of accuracy generally did not differ or differences were very small. The GMLT showed faster performance and higher total errors on iPad. Most Cogstate variables showed no difference in the rate of change across PC and iPad administrations. Conclusions: There are small, but significant, differences in performance when giving the same cognitive tests on a PC or an iPad. Future studies are needed to better understand if these small differences impact the clinical interpretation of results and research outcomes.
Collapse
Affiliation(s)
- Nikki H Stricker
- a Division of Neurocognitive Disorders, Department of Psychiatry and Psychology , Mayo Clinic , Rochester , MN , USA
| | - Emily S Lundt
- b Division of Biomedical Statistics and Informatics, Department of Health Sciences Research , Mayo Clinic , Rochester , MN , USA
| | - Kelly K Edwards
- b Division of Biomedical Statistics and Informatics, Department of Health Sciences Research , Mayo Clinic , Rochester , MN , USA
| | - Mary M Machulda
- a Division of Neurocognitive Disorders, Department of Psychiatry and Psychology , Mayo Clinic , Rochester , MN , USA
| | - Walter K Kremers
- b Division of Biomedical Statistics and Informatics, Department of Health Sciences Research , Mayo Clinic , Rochester , MN , USA
| | - Rosebud O Roberts
- c Division of Epidemiology, Department of Health Sciences Research , Mayo Clinic , Rochester , MN , USA.,d Department of Neurology , Mayo Clinic , Rochester , MN , USA
| | - David S Knopman
- d Department of Neurology , Mayo Clinic , Rochester , MN , USA
| | | | - Michelle M Mielke
- c Division of Epidemiology, Department of Health Sciences Research , Mayo Clinic , Rochester , MN , USA.,d Department of Neurology , Mayo Clinic , Rochester , MN , USA
| |
Collapse
|
42
|
Berg CA, Wiebe DJ, Suchy Y, Turner SL, Butner J, Munion A, Lansing AH, White PC, Murray M. Executive Function Predicting Longitudinal Change in Type 1 Diabetes Management During the Transition to Emerging Adulthood. Diabetes Care 2018; 41:2281-2288. [PMID: 30131398 PMCID: PMC6196825 DOI: 10.2337/dc18-0351] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2018] [Accepted: 07/19/2018] [Indexed: 02/03/2023]
Abstract
OBJECTIVE The objective of this study was to examine 1) whether teens' glycemic control and adherence to type 1 diabetes treatment regimen worsen during the transition from late adolescence to emerging adulthood, and 2) whether teens' executive function (EF), as measured by performance and self-reported problems with EF, is predictive of these changes (after controlling for general intelligence). RESEARCH DESIGN AND METHODS High school seniors with type 1 diabetes (N = 236; mean age 17.74 years) were assessed at three yearly time points. At baseline, during the senior year of high school, participants completed a self-report measure of problems with EF and performance-based measures of EF and general intelligence (IQ). Glycemic control was determined on the basis of results collected from HbA1c assay kits, and teens reported their adherence at all three time points. RESULTS HbA1c increased significantly across the three time points and adherence declined. EF performance was not associated with adherence or HbA1c at baseline, nor with changes in adherence over time. However, better EF performance predicted slower increases in HbA1c over time (i.e., slope) while controlling for IQ. Teens' self-reported problems with EF were associated with worse glycemic control and poorer adherence at baseline (i.e., intercept), but they did not predict changes in either HbA1c or adherence over time (i.e., slope). CONCLUSIONS Abilities involved in performance on EF tests may be one resource for maintaining better glycemic control during the transition to emerging adulthood. Assessment of such EF abilities may allow for the identification of individuals who are most at risk for deterioration of glycemic control during this transition.
Collapse
Affiliation(s)
- Cynthia A Berg
- Department of Psychology, University of Utah, Salt Lake City, UT
| | - Deborah J Wiebe
- Psychological Sciences and Health Sciences Research Institute, University of California, Merced, Merced, CA
- The University of Texas Southwestern Medical Center, Dallas, TX
| | - Yana Suchy
- Department of Psychology, University of Utah, Salt Lake City, UT
| | - Sara L Turner
- Department of Psychology, University of Utah, Salt Lake City, UT
| | - Jonathan Butner
- Department of Psychology, University of Utah, Salt Lake City, UT
| | - Ascher Munion
- Department of Psychology, University of Utah, Salt Lake City, UT
| | | | - Perrin C White
- The University of Texas Southwestern Medical Center, Dallas, TX
| | - Mary Murray
- Department of Pediatrics, University of Utah Medical School, Salt Lake City, UT
| |
Collapse
|