1
|
Garcia-Rosales A, Cortese S, Vitoratou S. Measurement invariance of Attention Deficit/Hyperactivity Disorder symptom criteria as rated by parents and teachers in children and adolescents: A systematic review. PLoS One 2024; 19:e0293677. [PMID: 38394179 PMCID: PMC10889893 DOI: 10.1371/journal.pone.0293677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Accepted: 10/17/2023] [Indexed: 02/25/2024] Open
Abstract
This systematic review aimed to establish the extent to which each Attention Deficit/Hyperactivity Disorder (ADHD) symptom criterion is being assessed without being influenced (biased) by factors such as informant, sex/gender, and age. Measurement invariance (MI) testing using confirmatory factor analysis (CFA) is the prime statistical method to ascertain how these factors may affect the measurement and colour the perception or interpretation of symptom criteria. Such effects (non-invariance) can be operationalised in the form of altered association of a symptom criterion with the measured trait (expressed via variations in CFA loadings which represent the weight of each symptom criterion) due to the factor(s) and/or artificially alter the probability of endorsement of a particular symptom criterion (expressed via variations in the CFA threshold(s) representing how mild or severe a given symptom is). Based on a pre-registered protocol (CRD42022276105), we searched PubMed, Global Health, Embase and PsycInfo up to 21-02-23 for studies that included MI assessments on specific ADHD symptom criteria in individuals aged 0-18 years old, using parental and/or teacher report. Self-reports were excluded, given the poor reliability of self-report in ADHD. All included studies met specific COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) criteria. Results were synthesised in tabular form, grouping results by factors (e.g. informant) from 44 studies retained. Most comparisons indicated both metric (same loadings) and scalar invariance (same thresholds) with regard to informant, gender, age, temporal (repeated assessments) and co-morbidity. Therefore, the available evidence supports the current diagnostic criteria. However, findings could have been improved by systematic reporting of the direction of bias and its effect size. There appears to be a bias towards reporting MI instead of non-invariance. More studies in the literature are needed where the amalgamation of information provided by different informs and the association of specific symptoms with comorbidity are analysed.
Collapse
Affiliation(s)
- Alexandra Garcia-Rosales
- MRC Social Genetic Developmental and Psychiatry Centre, King’s College London, Institute of Psychiatry, Psychology, and Neurosciences, London, United Kingdom
- Psychometrics and Measurement Lab, Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology, and Neurosciences, King’s College, London, United Kingdom
- Universidad Autónoma de Madrid, Madrid, Spain
- Kensington & Chelsea Child and Adolescent Mental Health Service, Central and North West London NHS Foundation Trust, London, United Kingdom
| | - Samuele Cortese
- School of Psychology, Centre for Innovation in Mental Health (CIMH), Faculty of Environmental and Life Sciences, University of Southampton, Southampton, United Kingdom
- Hassenfeld Children’s Hospital at NYU Langone, New York University Child Study Center, New York, New York, United States of America
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, United Kingdom
- Horizon Centre, CAMHS West, Solent NHS Trust, Southampton, United Kingdom
| | - Silia Vitoratou
- Psychometrics and Measurement Lab, Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology, and Neurosciences, King’s College, London, United Kingdom
| |
Collapse
|
2
|
Trejo S, Chamorro Y, Bolaños MDL, Matute E. Utility for Clinical Practice of a Bifactor ADHD Model in an Elementary School Population in Mexico. Child Psychiatry Hum Dev 2023:10.1007/s10578-023-01633-7. [PMID: 37955801 DOI: 10.1007/s10578-023-01633-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/06/2023] [Indexed: 11/14/2023]
Abstract
We assessed the appropriateness of the bifactor model for a Mexican ADHD symptom questionnaire (BMQ-ADHD) applied to parents and teachers of elementary school children. With a sample of 765 reports of children's behavior (48.7% with ADHD A1 criteria, 42.6% girls, mean age 8.5 years [± 1.6 sd]), we examined construct validity, measurement invariance, differences for gender and school level, and the appropriateness of using summed scores. The BMQ-ADHD questionnaire was characterized by good construct validity for the bifactor model for parents' and teachers' reports. For both corpora, we detected invariance for gender and school level. There were differences in ADHD symptoms by gender, but not by school year. The summed scores may represent the factors accurately for females but may present difficulty for males in the parents' questionnaires. The present study revealed good BMQ-ADHD psychometric properties for a unidimensional-hierarchical ADHD scale segregated by gender for parents' and teachers' reports.
Collapse
Affiliation(s)
- Salvador Trejo
- Facultad de Medicina y Psicología, Universidad Autónoma de Baja California, Tijuana, México
| | - Yaira Chamorro
- Instituto de Neurociencias, Centro Universitario de Ciencias Biológicas y Agropecuarias, Universidad de Guadalajara, Guadalajara, México
| | - María de Lourdes Bolaños
- Instituto de Neurociencias, Centro Universitario de Ciencias Biológicas y Agropecuarias, Universidad de Guadalajara, Guadalajara, México
| | - Esmeralda Matute
- Instituto de Neurociencias, Centro Universitario de Ciencias Biológicas y Agropecuarias, Universidad de Guadalajara, Guadalajara, México.
- Departamento de Estudios en Educación, Centro Universitario de Ciencias Sociales y Humanidades, Universidad de Guadalajara, Guadalajara, México.
| |
Collapse
|
3
|
Vitoratou S, Garcia-Rosales A, Banaschewski T, Sonuga-Barke E, Buitelaar J, Oades RD, Rothenberger A, Steinhausen HC, Taylor E, Faraone SV, Chen W. Is the endorsement of the Attention Deficit Hyperactivity Disorder symptom criteria ratings influenced by informant assessment, gender, age, and co-occurring disorders? A measurement invariance study. Int J Methods Psychiatr Res 2019; 28:e1794. [PMID: 31310449 PMCID: PMC7649942 DOI: 10.1002/mpr.1794] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/21/2019] [Revised: 04/29/2019] [Accepted: 05/05/2019] [Indexed: 11/09/2022] Open
Abstract
OBJECTIVES This study aims to ascertain whether the differences of prevalence and severity of attention deficit hyperactivity disorder (ADHD) are true or whether children are perceived and rated differently by parent and teacher informant assessments (INFAs) according to gender, age, and co-occurring disorders, even at equal levels of latent ADHD traits. METHODS Use of latent trait models (for binary responses) to evaluate measurement invariance in children with ADHD and their siblings from the International Multicenter ADHD Gene data. RESULTS Substantial measurement noninvariance between parent and teacher INFAs was detected for seven out of nine inattention (IA) and six out of nine hyperactivity/impulsivity (HI) items; the correlations between parent and teacher INFAs for six IA and four HI items were not significantly different from zero, which suggests that parent and teacher INFAs are essentially rating different kinds of behaviours expressed in different settings, instead of measurement bias. However, age and gender did not affect substantially the endorsement probability of either IA or HI symptom criteria, regardless of INFA. For co-occurring disorders, teacher INFA ratings were largely unaffected by co-morbidity; conversely, parental endorsement of HI symptoms is substantially influenced by co-occurring oppositional defiant disorder. CONCLUSIONS Our findings suggest general robustness of Diagnostic and Statistical Manual of Mental Disorders ADHD diagnostic items in relation to age and gender. Further research on classroom presentations is needed.
Collapse
Affiliation(s)
- Silia Vitoratou
- Psychometrics and Measurement Lab, Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology, and Neurosciences, King's College London, London, UK
| | - Alexandra Garcia-Rosales
- MRC Social Genetic Developmental and Psychiatry Centre, Institute of Psychiatry, Psychology, and Neurosciences, King's College London, London, UK.,Psychiatry Department, Universidad Autónoma de Madrid, Madrid, Spain
| | - Tobias Banaschewski
- Department of Child and Adolescent Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim/Heidelberg University, Mannheim, Germany
| | - Edmund Sonuga-Barke
- MRC Social Genetic Developmental and Psychiatry Centre, Institute of Psychiatry, Psychology, and Neurosciences, King's College London, London, UK
| | - Jan Buitelaar
- Department of Cognitive Neuroscience, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Robert D Oades
- Clinic for Child and Adolescent Psychiatry and Psychotherapy, University of Duisburg-Essen, Essen, Germany
| | - Aribert Rothenberger
- Clinic for Child and Adolescent Psychiatry and Psychotherapy, University Medical Center, Göttingen, Germany
| | - Hans-Christoph Steinhausen
- Department of Child and Adolescent Psychiatry, University of Zurich, Zurich, Switzerland.,Clinical Psychology and Epidemiology, Department of Psychology, University of Basel, Basel, Switzerland.,Child and Adolescent Mental Health Center, Capital Region Psychiatry, Copenhagen, Denmark.,Department of Child and Adolescent Psychiatry, Southern Denmark University, Odense, Denmark
| | - Eric Taylor
- MRC Social Genetic Developmental and Psychiatry Centre, Institute of Psychiatry, Psychology, and Neurosciences, King's College London, London, UK
| | - Stephen V Faraone
- Departments of Psychiatry and of Neuroscience and Physiology, SUNY Upstate Medical University, Syracuse, New York, USA
| | - Wai Chen
- MRC Social Genetic Developmental and Psychiatry Centre, Institute of Psychiatry, Psychology, and Neurosciences, King's College London, London, UK.,Complex Attention and Hyperactivity Disorders Service (CAHDS), Specialised Child and Adolescent Mental Health Services (CAMHS), WA Department of Health, Perth, Western Australia, Australia.,Centre and Discipline of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, School of Medicine, Division of Paediatrics and Child Health and Division of Psychiatry and Clinical Neurosciences, The University of Western Australia, Perth, Western Australia, Australia
| |
Collapse
|