1
|
Suchy Y, DesRuisseaux LA, Gereau Mora M, Brothers SL, Niermeyer MA. Conceptualization of the term "ecological validity" in neuropsychological research on executive function assessment: a systematic review and call to action. J Int Neuropsychol Soc 2024; 30:499-522. [PMID: 38251679 DOI: 10.1017/s1355617723000735] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/23/2024]
Abstract
OBJECTIVE "Ecological validity" (EV) is classically defined as test's ability to predict real-world functioning, either alone or together with test's similarity to real-world tasks. In neuropsychological literature on assessment of executive functions (EF), EV is conceptualized inconsistently, leading to misconceptions about the utility of tests. The goal of this systematic review was to examine how EV is conceptualized in studies of EF tests described as ecologically valid. METHOD MEDLINE and PsychINFO Databases were searched. PRISMA guidelines were observed. After applying inclusion and exclusion criteria, this search yielded 90 articles. Deductive content analysis was employed to determine how the term EV was used. RESULTS About 1/3 of the studies conceptualized EV as the test's ability to predict functional outcomes, 1/3 as both the ability to predict functional outcome and similarity to real-world tasks, and 1/3 were either unclear about the meaning of the term or relied on notions unrelated to classical definitions (e.g., similarity to real-world tasks alone, association with other tests, or the ability to discriminate between populations). CONCLUSIONS Conceptualizations of the term EV in literature on EF assessment vary grossly, subsuming the notions of criterion, construct, and face validity, as well as sensitivity/specificity. Such inconsistency makes it difficult to interpret clinical utility of tests that are described as ecologically valid. We call on the field to require that, at minimum, the term EV be clearly defined in all publications, or replaced with more concrete terminology (e.g., criterion validity).
Collapse
Affiliation(s)
- Yana Suchy
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| | | | | | | | - Madison A Niermeyer
- Department of Physical Medicine and Rehabilitation, University of Utah, Salt Lake City, UT, USA
| |
Collapse
|
2
|
Cholet J, Rousselet M, Donnio Y, Burlot M, Pere M, Lambert S, Rocher B, Chirio-Espitalier M, Eyzop E, Grall-Bronnec M. Evaluation of cognitive impairment in a French sample of patients with restrictive anorexia nervosa: two distinct profiles emerged with differences in impaired functions and psychopathological symptoms. Eat Weight Disord 2021; 26:1559-1570. [PMID: 32767255 PMCID: PMC8128741 DOI: 10.1007/s40519-020-00981-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2020] [Accepted: 07/31/2020] [Indexed: 12/13/2022] Open
Abstract
PURPOSE The cognitive profiles of patients suffering from anorexia nervosa (AN) are currently explored as potential facilitating and/or maintenance factors. Specific data in restrictive AN (AN-R) remain contradictory. This study focused on women with AN-R to evaluate their cognitive functions to develop a more specific cognitive remediation program. METHODS Female patients older than 15 years who were suffering from AN-R were recruited in a specialized unit for eating disorder management. Female healthy control (HC) participants were recruited who were matched with AN patients on age. All participants completed a cognitive evaluation (premorbid intelligence quotient (IQ), planning, information processing speed, cognitive flexibility) and a clinical evaluation (impulsivity, anxiety, depression). RESULTS A total of 122 participants were included. Patients suffering from AN-R had significant impairment in information processing speed and planning. Patients exhibited significantly better cognitive flexibility than did the HC group when adjustments were made for other cognitive functions and impulsivity. Two distinct subgroups of patients were identified. The first subgroup had more marked cognitive impairment and fewer psychopathological symptoms than did the second subgroup of patients and the HC group. CONCLUSION Our results highlight cognitive impairment in patients with AN who had normal premorbid IQ. Two distinct profiles emerge. In clinical practice, these results open up perspectives for the development of more specific cognitive remediation programs (one specific program for cold cognitions and another specific program targeting emotions and hot cognitions). These results warrant confirmation by larger studies with a more specific evaluation of the impact of emotional status. Trial registration NTC02381639, Date of registration. March 6, 2015.
Collapse
Affiliation(s)
- J Cholet
- Clinical Investigation Unit BALANCED "BehaviorAL AddictioNs and ComplEx Mood Disorders", Addictology and Psychiatry Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France
| | - M Rousselet
- Clinical Investigation Unit BALANCED "BehaviorAL AddictioNs and ComplEx Mood Disorders", Addictology and Psychiatry Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France. .,U1246 SPHERE "methodS in Patient-Centered Outcomes and HEalth ResEarch", INSERM, University of Nantes and Tours, 22 Boulevard Benoni-Goullin, 44200, Nantes, France.
| | - Y Donnio
- Clinical Investigation Unit BALANCED "BehaviorAL AddictioNs and ComplEx Mood Disorders", Addictology and Psychiatry Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France
| | - M Burlot
- Clinical Investigation Unit BALANCED "BehaviorAL AddictioNs and ComplEx Mood Disorders", Addictology and Psychiatry Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France
| | - M Pere
- Biostatistics Unit, Research Board, Nantes University Hospital, 5 Allées de l'île Gloriette, 44093, Nantes Cedex 1, France
| | - S Lambert
- Clinical Investigation Unit BALANCED "BehaviorAL AddictioNs and ComplEx Mood Disorders", Addictology and Psychiatry Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France
| | - B Rocher
- Clinical Investigation Unit BALANCED "BehaviorAL AddictioNs and ComplEx Mood Disorders", Addictology and Psychiatry Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France
| | - M Chirio-Espitalier
- Reference Centre for Therapeutic Education and Cognitive Remediation Care (CReSERC), Psychiatry and Mental Health Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France
| | - E Eyzop
- Clinical Investigation Unit BALANCED "BehaviorAL AddictioNs and ComplEx Mood Disorders", Addictology and Psychiatry Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France
| | - M Grall-Bronnec
- Clinical Investigation Unit BALANCED "BehaviorAL AddictioNs and ComplEx Mood Disorders", Addictology and Psychiatry Department, University Hospital of Nantes, 85 Rue Saint Jacques, 44093, Nantes Cedex 1, France.,U1246 SPHERE "methodS in Patient-Centered Outcomes and HEalth ResEarch", INSERM, University of Nantes and Tours, 22 Boulevard Benoni-Goullin, 44200, Nantes, France
| |
Collapse
|
3
|
Dann KM, Hay P, Touyz S. Are poor set-shifting and central coherence associated with everyday function in anorexia nervosa? A systematic review. J Eat Disord 2021; 9:40. [PMID: 33781337 PMCID: PMC8008586 DOI: 10.1186/s40337-021-00392-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2020] [Accepted: 03/02/2021] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND There is increasing interest in associations between cognitive impairments and clinical symptoms in Anorexia Nervosa (AN), however, the relationship with everyday function is unclear. The current review synthesizes existing data regarding associations between scores on tests of set-shifting and central coherence and functional outcome measures for individuals with AN. METHOD A systematic electronic database search yielded 13 studies which included participants with current or lifetime AN where scores on a neuropsychological test of set-shifting or central coherence were directly or indirectly compared to a functional outcome measure. RESULTS Associations between set-shifting and central coherence performance measures and functional outcomes were limited in number and noted only in adult or mixed-age cohorts. Associations were noted at subscale level, suggesting they are specific in nature. In younger cohorts, assessments of executive functioning in everyday life appear sensitive to cognitive-behavioral flexibility issues. CONCLUSIONS Associations between cognitive performance and functional outcome have not been as systematically assessed in AN as in other psychiatric disorders. Key factors to address in future research include: (a) the use of function measures which are sensitive to both the level of impairment, and specific rather than general impairments (b) the ecological validity of measures, (c) the task impurity problem, especially in regard to cognitive flexibility assessment, and (d) the need to measure both cognitive deficits and strengths, because tests of specific cognitive processes may underestimate the ability to function in daily life due to compensatory strategies.
Collapse
Affiliation(s)
- Kelly M Dann
- School of Psychology, University of Sydney, Sydney, Australia.
| | - Phillipa Hay
- School of Medicine, Western Sydney University, Sydney, Australia
| | - Stephen Touyz
- InsideOut Institute and School of Psychology, University of Sydney, Sydney, Australia
| |
Collapse
|
4
|
Howard M, Gregertsen EC, Hindocha C, Serpell L. Impulsivity and compulsivity in anorexia and bulimia nervosa: A systematic review. Psychiatry Res 2020; 293:113354. [PMID: 32781364 DOI: 10.1016/j.psychres.2020.113354] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Revised: 07/27/2020] [Accepted: 08/01/2020] [Indexed: 01/14/2023]
Abstract
This study aimed to systematically appraise cross-sectional research that compared the cognitive performance of individuals in the acute phase of BN and/or AN to HCs on measures of impulsivity and compulsivity. The results of the systematic review showed support for the trans-diagnostic approach to eating disorders. There was no strong evidence to support the characterisation of AN as high in compulsivity (and low in impulsivity), nor to support the characterisation of BN as high in impulsivity (and low in compulsivity). There appeared to be mixed findings for both impulsivity and compulsivity across AN and BN. Results were highly variable due to the heterogeneous tasks used, and lack of replication across studies. There was no consensus amongst the included studies on the most appropriate task and/or outcome measures that should be used to study the constructs of impulsivity and compulsivity.
Collapse
Affiliation(s)
- Maxine Howard
- Department of Clinical, Educational, and Health Psychology, University College London, London, United Kingdom
| | - Eva C Gregertsen
- Department of Clinical, Educational, and Health Psychology, University College London, London, United Kingdom.
| | - Chandni Hindocha
- Department of Clinical, Educational, and Health Psychology, University College London, London, United Kingdom
| | - Lucy Serpell
- Department of Clinical, Educational, and Health Psychology, University College London, London, United Kingdom
| |
Collapse
|
6
|
An ecological approach to the behavioral assessment of executive functions in anorexia nervosa. Psychiatry Res 2018; 259:283-288. [PMID: 29091830 DOI: 10.1016/j.psychres.2017.10.029] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/26/2017] [Revised: 09/23/2017] [Accepted: 10/21/2017] [Indexed: 11/21/2022]
Abstract
The use of ecological tests to assess executive functions (EFs) in patients with anorexia nervosa (AN) has not examined extensively. The objective of this study was to analyze and compare the performance of patients with AN and healthy controls (HCs) on standard versus ecologically valid tests on EFs. Sixty-two females aged between 16 and 42 who were diagnosed with AN and 70 matched HCs completed 2 neuropsychological test batteries: standard tests (WCST, TMT, Stroop, ToL, fluency test) and the Behavioral Assessment of Dysexecutive Syndrome (BADS). On the standard tests, patients with AN produced more perseverative response and were slower than HCs in the TMT; in contrast, they scored as well as HCs on tasks that assessed categorization, interference in color naming, planning and semantic fluency. Conversely, there were differences in the ecological tests with patients with AN systematically slower in the resolution of complex tasks. Results demonstrated the power of ecological tests in capturing selective impairments in multifaceted and unstructured tests. Patients with AN experienced systematic deceleration in the resolution of ecological tasks. Also, the increased time needed to solve the tasks, was not reflected in overall improvement in performance. This evidence is further discussed with respect to central coherence.
Collapse
|