1
|
Urban J, Scherrer V, Strobel A, Preckel F. Continuous Norming Approaches: A Systematic Review and Real Data Example. Assessment 2024:10731911241260545. [PMID: 39066602 DOI: 10.1177/10731911241260545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/28/2024]
Abstract
Norming of psychological tests is decisive for test score interpretation. However, conventional norming based on subgroups results either in biases or require very large samples to gather precise norms. Continuous norming methods, namely inferential, semi-parametric, and (simplified) parametric norming, propose to solve those issues. This article provides a systematic review of continuous norming. The review includes 121 publications with overall 189 studies. The main findings indicate that most studies used simplified parametric norming, not all studies considered essential distributional assumptions, and the evidence comparing different norming methods is inconclusive. In a real data example, using the standardization sample of the Need for Cognition-KIDS scale, we compared the precision of conventional, semi-parametric, and parametric norms. A hierarchy in terms of precision emerged with conventional norms being least precise, followed by semi-parametric norms, and parametric norms being most precise. We discuss these findings by comparing our findings and methods to previous studies.
Collapse
Affiliation(s)
- Julian Urban
- University of Trier, Germany
- GESIS -Leibniz Institute for the Social Sciences, Mannheim, Germany
| | | | | | | |
Collapse
|
2
|
Volfart A, Rossion B. The neuropsychological evaluation of face identity recognition. Neuropsychologia 2024; 198:108865. [PMID: 38522782 DOI: 10.1016/j.neuropsychologia.2024.108865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 03/14/2024] [Accepted: 03/18/2024] [Indexed: 03/26/2024]
Abstract
Facial identity recognition (FIR) is arguably the ultimate form of recognition for the adult human brain. Even if the term prosopagnosia is reserved for exceptionally rare brain-damaged cases with a category-specific abrupt loss of FIR at adulthood, subjective and objective impairments or difficulties of FIR are common in the neuropsychological population. Here we provide a critical overview of the evaluation of FIR both for clinicians and researchers in neuropsychology. FIR impairments occur following many causes that should be identified objectively by both general and specific, behavioral and neural examinations. We refute the commonly used dissociation between perceptual and memory deficits/tests for FIR, since even a task involving the discrimination of unfamiliar face images presented side-by-side relies on cortical memories of faces in the right-lateralized ventral occipito-temporal cortex. Another frequently encountered confusion is between specific deficits of the FIR function and a more general impairment of semantic memory (of people), the latter being most often encountered following anterior temporal lobe damage. Many computerized tests aimed at evaluating FIR have appeared over the last two decades, as reviewed here. However, despite undeniable strengths, they often suffer from ecological limitations, difficulties of instruction, as well as a lack of consideration for processing speed and qualitative information. Taking into account these issues, a recently developed behavioral test with natural images manipulating face familiarity, stimulus inversion, and correct response times as a key variable appears promising. The measurement of electroencephalographic (EEG) activity in the frequency domain from fast periodic visual stimulation also appears as a particularly promising tool to complete and enhance the neuropsychological assessment of FIR.
Collapse
Affiliation(s)
- Angélique Volfart
- School of Psychology and Counselling, Faculty of Health, Queensland University of Technology, Australia.
| | - Bruno Rossion
- Centre for Biomedical Technologies, Queensland University of Technology, Australia; Université de Lorraine, CNRS, IMoPA, F-54000, Nancy, France.
| |
Collapse
|
3
|
Kiselica AM, Karr JE, Mikula CM, Ranum RM, Benge JF, Medina LD, Woods SP. Recent Advances in Neuropsychological Test Interpretation for Clinical Practice. Neuropsychol Rev 2024; 34:637-667. [PMID: 37594687 DOI: 10.1007/s11065-023-09596-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 04/28/2023] [Indexed: 08/19/2023]
Abstract
Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.
Collapse
Affiliation(s)
- Andrew M Kiselica
- Department of Health Psychology, University of Missouri, 115 Business Loop 70 W, Columbia, MO, 65203, USA.
| | - Justin E Karr
- Department of Psychology, University of Kentucky, Lexington, KY, USA
| | - Cynthia M Mikula
- Institute of Human Nutrition, Columbia University, New York, NY, USA
| | - Rylea M Ranum
- Department of Health Psychology, University of Missouri, 115 Business Loop 70 W, Columbia, MO, 65203, USA
| | - Jared F Benge
- Department of Neurology, University of Texas-Austin, TX, Austin, USA
| | - Luis D Medina
- Department of Psychology, University of Houston, Houston, TX, USA
| | | |
Collapse
|
4
|
Burns EJ, Gaunt E, Kidane B, Hunter L, Pulford J. A new approach to diagnosing and researching developmental prosopagnosia: Excluded cases are impaired too. Behav Res Methods 2023; 55:4291-4314. [PMID: 36459376 PMCID: PMC9718472 DOI: 10.3758/s13428-022-02017-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/25/2022] [Indexed: 12/04/2022]
Abstract
Developmental prosopagnosia is characterized by severe, lifelong difficulties when recognizing facial identity. Unfortunately, the most common diagnostic assessment (Cambridge Face Memory Test) misses 50-65% of individuals who believe that they have this condition. This results in such excluded cases' absence from scientific knowledge, effect sizes of impairment potentially overestimated, treatment efficacy underrated, and may elicit in them a negative experience of research. To estimate their symptomology and group-level impairments in face processing, we recruited a large cohort who believes that they have prosopagnosia. Matching prior reports, 56% did not meet criteria on the Cambridge Face Memory Test. However, the severity of their prosopagnosia symptoms and holistic perception deficits were comparable to those who did meet criteria. Excluded cases also exhibited face perception and memory impairments that were roughly one standard deviation below neurotypical norms, indicating the presence of objective problems. As the prosopagnosia index correctly classified virtually every case, we propose it should be the primary method for providing a diagnosis, prior to subtype categorization. We present researchers with a plan on how they can analyze these excluded prosopagnosia cases in their future work without negatively impacting their traditional findings. We anticipate such inclusion will enhance scientific knowledge, more accurately estimate effect sizes of impairments and treatments, and identify commonalities and distinctions between these different forms of prosopagnosia. Owing to their atypicalities in visual perception, we recommend that the prosopagnosia index should be used to screen out potential prosopagnosia cases from broader vision research.
Collapse
Affiliation(s)
- Edwin J Burns
- Department of Psychology, Edge Hill University, Ormskirk, UK.
| | - Elizabeth Gaunt
- Department of Psychology, Edge Hill University, Ormskirk, UK
| | - Betiel Kidane
- Department of Psychology, Edge Hill University, Ormskirk, UK
| | - Lucy Hunter
- Department of Psychology, Edge Hill University, Ormskirk, UK
| | - Jaylea Pulford
- Department of Psychology, Edge Hill University, Ormskirk, UK
| |
Collapse
|
5
|
Mühlbäck A, Mana J, Wallner M, Frank W, Lindenberg KS, Hoffmann R, Klempířová O, Klempíř J, Landwehrmeyer GB, Bezdicek O. Establishing normative data for the evaluation of cognitive performance in Huntington's disease considering the impact of gender, age, language, and education. J Neurol 2023; 270:4903-4913. [PMID: 37347292 PMCID: PMC10511566 DOI: 10.1007/s00415-023-11823-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Revised: 06/13/2023] [Accepted: 06/14/2023] [Indexed: 06/23/2023]
Abstract
BACKGROUND A declining cognitive performance is a hallmark of Huntington's disease (HD). The neuropsychological battery of the Unified HD Rating Scale (UHDRS'99) is commonly used for assessing cognition. However, there is a need to identify and minimize the impact of confounding factors, such as language, gender, age, and education level on cognitive decline. OBJECTIVES Aim is to provide appropriate, normative data to allow clinicians to identify disease-associated cognitive decline in diverse HD populations by compensating for the impact of confounding factors METHODS: Sample data, N = 3267 (60.5% females; mean age of 46.9 years (SD = 14.61, range 18-86) of healthy controls were used to create a normative dataset. For each neuropsychological test, a Bayesian generalized additive model with age, education, gender, and language as predictors was constructed to appropriately stratify the normative dataset. RESULTS With advancing age, there was a non-linear decline in cognitive performance. In addition, performance was dependent on educational levels and language in all tests. Gender had a more limited impact. Standardized scores have been calculated to ease the interpretation of an individual's test outcome. A web-based online tool has been created to provide free access to normative data. CONCLUSION For defined neuropsychological tests, the impact of gender, age, education, and language as factors confounding disease-associated cognitive decline can be minimized at the level of a single patient examination.
Collapse
Affiliation(s)
- Alžbeta Mühlbäck
- Department of Neurology, Ulm University, Oberer Eselsberg 45, 89081, Ulm, Germany.
- Huntington Center South, kbo-Isar-Amper-Klinikum, Taufkirchen, Germany.
- Department of Neurology and Center of Clinical Neuroscience, 1st Faculty of Medicine, Charles University and General University Hospital in Prague, Prague, Czechia.
| | - Josef Mana
- Department of Neurology and Center of Clinical Neuroscience, 1st Faculty of Medicine, Charles University and General University Hospital in Prague, Prague, Czechia
| | | | - Wiebke Frank
- Department of Neurology, Ulm University, Oberer Eselsberg 45, 89081, Ulm, Germany
| | - Katrin S Lindenberg
- Department of Neurology, Ulm University, Oberer Eselsberg 45, 89081, Ulm, Germany
| | - Rainer Hoffmann
- Huntington Center South, kbo-Isar-Amper-Klinikum, Taufkirchen, Germany
| | - Olga Klempířová
- Department of Neurology and Center of Clinical Neuroscience, 1st Faculty of Medicine, Charles University and General University Hospital in Prague, Prague, Czechia
| | - Jiří Klempíř
- Department of Neurology and Center of Clinical Neuroscience, 1st Faculty of Medicine, Charles University and General University Hospital in Prague, Prague, Czechia
| | | | - Ondrej Bezdicek
- Department of Neurology and Center of Clinical Neuroscience, 1st Faculty of Medicine, Charles University and General University Hospital in Prague, Prague, Czechia
| |
Collapse
|
6
|
Zagury-Orly I, Kroeck MR, Soussand L, Li Cohen A. Face-Processing Performance is an Independent Predictor of Social Affect as Measured by the Autism Diagnostic Observation Schedule Across Large-Scale Datasets. J Autism Dev Disord 2022; 52:674-688. [PMID: 33743118 PMCID: PMC9747289 DOI: 10.1007/s10803-021-04971-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/10/2021] [Indexed: 02/03/2023]
Abstract
Face-processing deficits, while not required for the diagnosis of autism spectrum disorder (ASD), have been associated with impaired social skills-a core feature of ASD; however, the strength and prevalence of this relationship remains unclear. Across 445 participants from the NIMH Data Archive, we examined the relationship between Benton Face Recognition Test (BFRT) performance and Autism Diagnostic Observation Schedule-Social Affect (ADOS-SA) scores. Lower BFRT scores (worse face-processing performance) were associated with higher ADOS-SA scores (higher ASD severity)-a relationship that held after controlling for other factors associated with face processing, i.e., age, sex, and IQ. These findings underscore the utility of face discrimination, not just recognition of facial emotion, as a key covariate for the severity of symptoms that characterize ASD.
Collapse
Affiliation(s)
- Ivry Zagury-Orly
- Department of Neurology, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA,Faculty of Medicine, Université de Montréal, Montreal, QC, CA
| | - Mallory R. Kroeck
- Department of Neurology, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Louis Soussand
- Department of Neurology, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Alexander Li Cohen
- Department of Neurology, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA,Computational Radiology Laboratory, Department of Radiology, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA,Center for Brain Circuit Therapeutics, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
7
|
DeGutis J, Li X, Yosef B, Mishra MV. Not so fast! Response times in the computerized Benton Face Recognition Test may not reflect face recognition ability. Cogn Neuropsychol 2022; 39:155-169. [PMID: 36202620 PMCID: PMC9557987 DOI: 10.1080/02643294.2022.2114824] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
Response times (RTs) are commonly used to assess cognitive abilities, though it is unclear whether face processing RTs predict recognition ability beyond accuracy. In the current study, we examined accuracy and RT on a widely used face matching assessment modified to collect meaningful RT data, the computerized Benton Facial Recognition Test (BFRT-c), and measured whether RTs predicted face recognition ability and developmental prosopagnosia (DP) vs. control group membership. 62 controls and 36 DPs performed the BFRT-c as well as validated measures of face recognition ability: the Cambridge Face Memory Test (CFMT) and a Famous Faces Memory Test (FFMT). In controls, BFRT-c accuracy robustly predicted CFMT (r = .49, p < .001), FFMT (r = .43, p < .001), and a CFMT-FFMT composite (r = .54, p < .001), whereas BFRT-c RT was not significantly associated with these measures (all r's .21). We also found that BFRT-c accuracy significantly differed between DPs and controls, but RT failed to differentiate the groups.
Collapse
Affiliation(s)
- Joseph DeGutis
- Department of Psychiatry, Harvard Medical school, Boston,
MA, USA.,Boston Attention and Learning Laboratory, VA Boston
Healthcare, Jamaica Plain Division, 150 S Huntington Ave., Boston, MA, USA
| | - Xian Li
- Department of Psychiatry, Harvard Medical school, Boston,
MA, USA.,Boston Attention and Learning Laboratory, VA Boston
Healthcare, Jamaica Plain Division, 150 S Huntington Ave., Boston, MA, USA.,Department of Psychological and Brain Sciences, Johns
Hopkins University, Baltimore, MD, USA
| | - Bar Yosef
- Department of Psychiatry, Harvard Medical school, Boston,
MA, USA.,Boston Attention and Learning Laboratory, VA Boston
Healthcare, Jamaica Plain Division, 150 S Huntington Ave., Boston, MA, USA
| | - Maruti V. Mishra
- Active Perception Lab, Center for Visual Science,
University of Rochester, Rochester, NY, USA
| |
Collapse
|