1
|
Elsman EBM, Mokkink LB, Abma IL, Aiyegbusi OL, Chiarotto A, Haywood KL, Matvienko-Sikar K, Oosterveer DM, Pool JJM, Swinkels-Meewisse IEJ, Offringa M, Terwee CB. Methodological quality of 100 recent systematic reviews of health-related outcome measurement instruments: an overview of reviews. Qual Life Res 2024; 33:2593-2609. [PMID: 38961010 PMCID: PMC11452433 DOI: 10.1007/s11136-024-03706-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/29/2024] [Indexed: 07/05/2024]
Abstract
PURPOSE Systematic reviews evaluating and comparing the measurement properties of outcome measurement instruments (OMIs) play an important role in OMI selection. Earlier overviews of review quality (2007, 2014) evidenced substantial concerns with regards to alignment to scientific standards. This overview aimed to investigate whether the quality of recent systematic reviews of OMIs lives up to the current scientific standards. METHODS One hundred systematic reviews of OMIs published from June 1, 2021 onwards were randomly selected through a systematic literature search performed on March 17, 2022 in MEDLINE and EMBASE. The quality of systematic reviews was appraised by two independent reviewers. An updated data extraction form was informed by the earlier studies, and results were compared to these earlier studies' findings. RESULTS A quarter of the reviews had an unclear research question or aim, and in 22% of the reviews the search strategy did not match the aim. Half of the reviews had an incomprehensive search strategy, because relevant search terms were not included. In 63% of the reviews (compared to 41% in 2014 and 30% in 2007) a risk of bias assessment was conducted. In 73% of the reviews (some) measurement properties were evaluated (58% in 2014 and 55% in 2007). In 60% of the reviews the data were (partly) synthesized (42% in 2014 and 7% in 2007); evaluation of measurement properties and data syntheses was not conducted separately for subscales in the majority. Certainty assessments of the quality of the total body of evidence were conducted in only 33% of reviews (not assessed in 2014 and 2007). The majority (58%) did not make any recommendations on which OMI (not) to use. CONCLUSION Despite clear improvements in risk of bias assessments, measurement property evaluation and data synthesis, specifying the research question, conducting the search strategy and performing a certainty assessment remain poor. To ensure that systematic reviews of OMIs meet current scientific standards, more consistent conduct and reporting of systematic reviews of OMIs is needed.
Collapse
Affiliation(s)
- Ellen B M Elsman
- Department of Epidemiology & Data Science, Amsterdam UMC, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, De Boelelaan 1089a, 1081 HV, Amsterdam, The Netherlands
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, ON, Canada
| | - Lidwine B Mokkink
- Department of Epidemiology & Data Science, Amsterdam UMC, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, De Boelelaan 1089a, 1081 HV, Amsterdam, The Netherlands
| | - Inger L Abma
- IQ Health, Radboud Institute of Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Olalekan Lee Aiyegbusi
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Alessandro Chiarotto
- Department of General Practice, Erasmus MC, University Medical Center, Rotterdam, The Netherlands
| | - Kirstie L Haywood
- Warwick Applied Health, Warwick Medical School, University of Warwick, Coventry, UK
| | | | | | - Jan J M Pool
- University of Applied Sciences, Utrecht, The Netherlands
| | | | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, ON, Canada
| | - Caroline B Terwee
- Department of Epidemiology & Data Science, Amsterdam UMC, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, De Boelelaan 1089a, 1081 HV, Amsterdam, The Netherlands.
| |
Collapse
|
2
|
Cavadini T, Riviere E, Gentaz E. An Eye-Tracking Study on Six Early Social-Emotional Abilities in Children Aged 1 to 3 Years. CHILDREN (BASEL, SWITZERLAND) 2024; 11:1031. [PMID: 39201965 PMCID: PMC11352975 DOI: 10.3390/children11081031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Revised: 07/29/2024] [Accepted: 08/12/2024] [Indexed: 09/03/2024]
Abstract
BACKGROUND The experimental evaluation of young children's socio-emotional abilities is limited by the lack of existing specific measures to assess this population and by the relative difficulty for researchers to adapt measures designed for the general population. METHODS This study examined six early social-emotional abilities in 86 typically developing children aged 1 to 3 years using an eye-tracking-based experimental paradigm that combined visual preference tasks adapted from pre-existing infant studies. OBJECTIVES The aim of this study is to obtain developmental norms in six early social-emotional abilities in typical children aged 1 to 3 years that would be promising for an understanding of disorders of mental development. These developmental standards are essential to enable comparative assessments with children with atypical development, such as children with Profound Intellectual and Multiple Disabilities (PIMD). RESULTS The participants had greater spontaneous visual preferences for biological (vs. non-biological) motion, socially salient (vs. non-social) stimuli, the eye (vs. mouth) area of emotional expressions, angry (vs. happy) faces, and objects of joint attention (vs. non-looked-at ones). Interestingly, although the prosocial (vs. antisocial) scene of the socio-moral task was preferred, both the helper and hinderer characters were equally gazed at. Finally, correlational analyses revealed that performance was neither related to participants' age nor to each other (dismissing the hypothesis of a common underpinning process). CONCLUSION Our revised experimental paradigm is possible in infants aged 1 to 3 years and thus provides additional scientific proof on the direct assessment of these six socio-emotional abilities in this population.
Collapse
Affiliation(s)
- Thalia Cavadini
- Department of Psychology, University of Geneva, 1205 Geneva, Switzerland; (T.C.); (E.R.)
| | - Elliot Riviere
- Department of Psychology, University of Geneva, 1205 Geneva, Switzerland; (T.C.); (E.R.)
- Univ. Lille, ULR 4072–PSITEC–Psychologie: Interactions Temps Emotions Cognition, F-59000 Lille, France
| | - Edouard Gentaz
- Department of Psychology, University of Geneva, 1205 Geneva, Switzerland; (T.C.); (E.R.)
- Swiss Center for Affective Sciences, University of Geneva, 1205 Geneva, Switzerland
- Centre National de la Recherche Scientifique, F-38400 Grenoble, France
| |
Collapse
|