1
|
Baruzzo E, Terruzzi S, Feder B, Papagno C, Smirni D. Verbal and non-verbal recognition memory assessment: validation of a computerized version of the Recognition Memory Test. Neurol Sci 2024; 45:1979-1988. [PMID: 38129589 PMCID: PMC11021307 DOI: 10.1007/s10072-023-07171-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 10/30/2023] [Indexed: 12/23/2023]
Abstract
BACKGROUND The use of computerized devices for neuropsychological assessment (CNADs) as an effective alternative to the traditional pencil-and-paper modality has recently increased exponentially, both in clinical practice and research, especially due to the pandemic. However, several authors underline that the computerized modality requires the same psychometric validity as "in-presence" tests. The current study aimed at building and validating a computerized version of the verbal and non-verbal recognition memory test (RMT) for words, unknown faces and buildings. METHODS Seventy-two healthy Italian participants, with medium-high education and ability to proficiently use computerized systems, were enrolled. The sample was subdivided into six groups, one for each age decade. Twelve neurological patients with mixed aetiology, age and educational level were also recruited. Both the computerized and the paper-and-pencil versions of the RMT were administered in two separate sessions. RESULTS In healthy participants, the computerized and the paper-and-pencil versions of the RMT showed statistical equivalence for words, unknown faces and buildings. In the neurological patients, no statistical difference was found between the performance at the two versions of the RMT. A moderate-to-good inter-rater reliability between the two versions was also found in both samples. Finally, the computerized version of the RMT was perceived as acceptable by both healthy participants and neurological patients at System Usability Scale (SUS). CONCLUSION The computerized version of the RMT can be used as a reliable alternative to the traditional version.
Collapse
Affiliation(s)
- Elena Baruzzo
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy.
| | - Stefano Terruzzi
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Beatrice Feder
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Costanza Papagno
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Daniela Smirni
- Department of Psychology, Educational Science and Human Movement, University of Palermo, Palermo, Italy
| |
Collapse
|
2
|
Nolin SA, Cowart H, Merritt S, McInerney K, Bharadwaj PK, Franchetti MK, Raichlen DA, Jessup CJ, Hishaw GA, Van Etten EJ, Trouard TP, Geldmacher DS, Wadley VG, Porges ES, Woods AJ, Cohen RA, Levin BE, Rundek T, Alexander GE, Visscher KM. Validity of the NIH toolbox cognitive battery in a healthy oldest-old 85+ sample. J Int Neuropsychol Soc 2023; 29:605-614. [PMID: 36239453 PMCID: PMC11172394 DOI: 10.1017/s1355617722000443] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE To evaluate the construct validity of the NIH Toolbox Cognitive Battery (NIH TB-CB) in the healthy oldest-old (85+ years old). METHOD Our sample from the McKnight Brain Aging Registry consists of 179 individuals, 85 to 99 years of age, screened for memory, neurological, and psychiatric disorders. Using previous research methods on a sample of 85 + y/o adults, we conducted confirmatory factor analyses on models of NIH TB-CB and same domain standard neuropsychological measures. We hypothesized the five-factor model (Reading, Vocabulary, Memory, Working Memory, and Executive/Speed) would have the best fit, consistent with younger populations. We assessed confirmatory and discriminant validity. We also evaluated demographic and computer use predictors of NIH TB-CB composite scores. RESULTS Findings suggest the six-factor model (Vocabulary, Reading, Memory, Working Memory, Executive, and Speed) had a better fit than alternative models. NIH TB-CB tests had good convergent and discriminant validity, though tests in the executive functioning domain had high inter-correlations with other cognitive domains. Computer use was strongly associated with higher NIH TB-CB overall and fluid cognition composite scores. CONCLUSION The NIH TB-CB is a valid assessment for the oldest-old samples, with relatively weak validity in the domain of executive functioning. Computer use's impact on composite scores could be due to the executive demands of learning to use a tablet. Strong relationships of executive function with other cognitive domains could be due to cognitive dedifferentiation. Overall, the NIH TB-CB could be useful for testing cognition in the oldest-old and the impact of aging on cognition in older populations.
Collapse
Affiliation(s)
- Sara A Nolin
- University of Alabama at Birmingham, Heersink School of Medicine, Evelyn F. McKnight Brain Institute, Birmingham, AL, USA
| | - Hannah Cowart
- University of Alabama at Birmingham, Heersink School of Medicine, Evelyn F. McKnight Brain Institute, Birmingham, AL, USA
| | - Stacy Merritt
- University of Miami, Miller School of Medicine, Evelyn F. McKnight Brain Institute, Miami, FL, USA
| | - Katalina McInerney
- University of Miami, Miller School of Medicine, Evelyn F. McKnight Brain Institute, Miami, FL, USA
| | - P K Bharadwaj
- University of Arizona, Evelyn F. McKnight Brain Institute, Tucson, AZ, USA
| | | | | | - Cortney J Jessup
- University of Arizona, Evelyn F. McKnight Brain Institute, Tucson, AZ, USA
| | - G Alex Hishaw
- University of Arizona, Evelyn F. McKnight Brain Institute, Tucson, AZ, USA
| | - Emily J Van Etten
- University of Arizona, Evelyn F. McKnight Brain Institute, Tucson, AZ, USA
| | - Theodore P Trouard
- University of Arizona, Evelyn F. McKnight Brain Institute, Tucson, AZ, USA
| | - David S Geldmacher
- University of Alabama at Birmingham, Heersink School of Medicine, Evelyn F. McKnight Brain Institute, Birmingham, AL, USA
| | - Virginia G Wadley
- University of Alabama at Birmingham, Heersink School of Medicine, Evelyn F. McKnight Brain Institute, Birmingham, AL, USA
| | - Eric S Porges
- University of Florida, Evelyn F. and William L. McKnight Brain Institute, Gainesville, FL, USA
| | - Adam J Woods
- University of Florida, Evelyn F. and William L. McKnight Brain Institute, Gainesville, FL, USA
| | - Ron A Cohen
- University of Florida, Evelyn F. and William L. McKnight Brain Institute, Gainesville, FL, USA
| | - Bonnie E Levin
- University of Miami, Miller School of Medicine, Evelyn F. McKnight Brain Institute, Miami, FL, USA
| | - Tatjana Rundek
- University of Miami, Miller School of Medicine, Evelyn F. McKnight Brain Institute, Miami, FL, USA
| | - Gene E Alexander
- University of Arizona, Evelyn F. McKnight Brain Institute, Tucson, AZ, USA
| | - Kristina M Visscher
- University of Alabama at Birmingham, Heersink School of Medicine, Evelyn F. McKnight Brain Institute, Birmingham, AL, USA
| |
Collapse
|
3
|
Bracken MR, Mazur-Mosiewicz A, Glazek K. Trail Making Test: Comparison of paper-and-pencil and electronic versions. APPLIED NEUROPSYCHOLOGY-ADULT 2018; 26:522-532. [DOI: 10.1080/23279095.2018.1460371] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Affiliation(s)
- Magdalene R. Bracken
- Department of Psychiatry, Allegheny General Hospital, Pittsburgh, Pennsylvania, USA
| | - Anya Mazur-Mosiewicz
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University, Tulsa, Oklahoma, USA
- The Chicago School of Professional Psychology, Los Angeles, California, USA
| | - Kuba Glazek
- The Chicago School of Professional Psychology, Los Angeles, California, USA
| |
Collapse
|
4
|
Alizai PH, Akkerman MK, Kaemmer D, Ulmer F, Klink CD, Ernst S, Mathiak K, Neumann UP, Perlitz V. Presurgical assessment of bariatric patients with the Patient Health Questionnaire (PHQ)--a screening of the prevalence of psychosocial comorbidity. Health Qual Life Outcomes 2015; 13:80. [PMID: 26059334 PMCID: PMC4460674 DOI: 10.1186/s12955-015-0278-5] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2014] [Accepted: 05/28/2015] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Bariatric surgery has gained increasing relevance due to the dramatic rise in morbid obesity prevalence. A sound body of scientific literature demonstrates positive long-term outcome of bariatric surgery in decreasing mental and physical health morbidity. Still, there is a need for a manageable presurgical screening to assess major mental disorders. The aim of this study was to assess the frequency of common psychiatric syndromes in bariatric surgery candidates using a computerized version of the Patient Health Questionnaire (PHQ). METHODS In a prospective cohort study from August 2009 to July 2011 morbidly obese individuals seeking bariatric treatment were evaluated for mental health disorders using the PHQ (computerized German version). RESULTS A total of 159 patients were included in this study. The median age of participants was 42 years, the median BMI was 49 kg/m(2). The PHQ revealed a prevalence of 84 % for mental health disorders, 50 % of the participants had three or more mental health disorders. A high somatic symptom burden (46 %), depressive syndromes (62 %) and anxiety disorders (29 %) were the most frequent psychiatric syndromes. The median number of psychiatric syndromes was 3 for women and 1 for men (p = 0.007). No correlation between BMI and a single syndrome or the sum of syndromes was observed. CONCLUSION 84 % of the patients seeking bariatric treatment were screened positive for at least one mental health disorder. The computerized PHQ with automated reporting appears to be a useful instrument for presurgical assessment of bariatric patients in routine medical settings.
Collapse
Affiliation(s)
- Patrick H Alizai
- Department of General-, Visceral- and Transplantation Surgery, RWTH Aachen University Hospital, Pauwelsstr. 30, 52074, Aachen, Germany.
| | - Maren K Akkerman
- Department of Medicine, Luisenhospital Aachen, Academic teaching hospital of the RWTH Aachen University, Boxgraben 99, 52064, Aachen, Germany.
| | - Daniel Kaemmer
- Department of Surgery, St. Elisabeth Hospital Geilenkirchen, Martin-Heyden-Str. 32, 52511, Geilenkirchen, Germany.
| | - Florian Ulmer
- Department of General-, Visceral- and Transplantation Surgery, RWTH Aachen University Hospital, Pauwelsstr. 30, 52074, Aachen, Germany.
| | - Christian D Klink
- Department of General-, Visceral- and Transplantation Surgery, RWTH Aachen University Hospital, Pauwelsstr. 30, 52074, Aachen, Germany.
| | - Sabine Ernst
- Institute of Medical Statistics, RWTH Aachen University Hospital, Pauwelsstr. 30, 52074, Aachen, Germany.
| | - Klaus Mathiak
- Department of Psychiatry, Psychotherapy and Psychosomatics, RWTH Aachen University Hospital, Pauwelsstr. 30, 52074, Aachen, Germany.
| | - Ulf P Neumann
- Department of General-, Visceral- and Transplantation Surgery, RWTH Aachen University Hospital, Pauwelsstr. 30, 52074, Aachen, Germany.
| | - Volker Perlitz
- Department of General-, Visceral- and Transplantation Surgery, RWTH Aachen University Hospital, Pauwelsstr. 30, 52074, Aachen, Germany.
| |
Collapse
|
5
|
Computerized and on-line neuropsychological testing for late-life cognition and neurocognitive disorders: are we there yet? Curr Opin Psychiatry 2015; 28:165-72. [PMID: 25602241 DOI: 10.1097/yco.0000000000000141] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
PURPOSE OF REVIEW Cost-effective, valid, efficient and accessible tests for the detection of late-life neurocognitive disorders are crucial, as early identification facilitates appropriate early intervention. Proponents of computerized neuropsychological assessment devices (CNADs) assert that technology-based assessments improve upon traditional neuropsychological tests. However, there remain fundamental questions of validity, reliability, normative data and administration, raising the question of whether CNADs are appropriate alternatives. RECENT FINDINGS Since publication of the 2012 American Academy of Clinical Neuropsychology and National Academy of Neuropsychology joint position paper outlining appropriate standards for CNAD development, the field has not significantly advanced, with the majority of recommendations inadequately addressed. SUMMARY Whilst there is a pressing need for innovative and readily applicable cognitive tests, these requirements do not outweigh the necessity for valid measures. Overall, the psychometric quality, standardization, normative data and administration advice of CNADs for neurocognitive disorders are lacking. Therefore, the risk of diagnostic errors is potentially high and poor clinical decisions could potentially arise, having significant impact upon individuals in terms of their well being and access to treatment. We recommend clinicians and researchers make informed decisions about CNAD suitability for their clients and their individual requirements based upon published psychometric and other test information.
Collapse
|
6
|
The Human-Computer Interface in Computer-Based Concussion Assessment. JOURNAL OF CLINICAL SPORT PSYCHOLOGY 2012. [DOI: 10.1123/jcsp.6.4.385] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Recent progress in technology has allowed for the development and validation of computer-based adaptations of existing pencil-and-paper neuropsychological measures and comprehensive cognitive test batteries. These computer-based assessments are frequently implemented in the field of clinical sports psychology to evaluate athletes’ functioning postconcussion. These tests provide practical and psychometric advantages over their pencil-and-paper counterparts in this setting; however, these tests also provide clinicians with unique challenges absent in paper-and-pencil testing. The purpose of this article is to present advantages and disadvantages of computer-based testing, generally, as well as considerations for the use of computer-based assessments for the evaluation of concussion among athletes. Furthermore, the paper provides suggestions for further development of computerized assessment of sports concussion given the limitations of the current technology.
Collapse
|