Psychometric Properties of Standardized Instruments that are Used to Measure Pragmatic Intervention Effects in Children with Developmental Language Disorder: A Systematic Review

Methodological quality of 100 recent systematic reviews of health-related outcome measurement instruments: an overview of reviews

PURPOSE

Systematic reviews evaluating and comparing the measurement properties of outcome measurement instruments (OMIs) play an important role in OMI selection. Earlier overviews of review quality (2007, 2014) evidenced substantial concerns with regards to alignment to scientific standards. This overview aimed to investigate whether the quality of recent systematic reviews of OMIs lives up to the current scientific standards.

METHODS

One hundred systematic reviews of OMIs published from June 1, 2021 onwards were randomly selected through a systematic literature search performed on March 17, 2022 in MEDLINE and EMBASE. The quality of systematic reviews was appraised by two independent reviewers. An updated data extraction form was informed by the earlier studies, and results were compared to these earlier studies' findings.

RESULTS

A quarter of the reviews had an unclear research question or aim, and in 22% of the reviews the search strategy did not match the aim. Half of the reviews had an incomprehensive search strategy, because relevant search terms were not included. In 63% of the reviews (compared to 41% in 2014 and 30% in 2007) a risk of bias assessment was conducted. In 73% of the reviews (some) measurement properties were evaluated (58% in 2014 and 55% in 2007). In 60% of the reviews the data were (partly) synthesized (42% in 2014 and 7% in 2007); evaluation of measurement properties and data syntheses was not conducted separately for subscales in the majority. Certainty assessments of the quality of the total body of evidence were conducted in only 33% of reviews (not assessed in 2014 and 2007). The majority (58%) did not make any recommendations on which OMI (not) to use.

CONCLUSION

Despite clear improvements in risk of bias assessments, measurement property evaluation and data synthesis, specifying the research question, conducting the search strategy and performing a certainty assessment remain poor. To ensure that systematic reviews of OMIs meet current scientific standards, more consistent conduct and reporting of systematic reviews of OMIs is needed.

Current practices of Portuguese speech-language pathologists with preschool-age children with pragmatic impairment: A cross-sectional survey

This study aims to investigate the practice patterns used by Portuguese speech-language pathologists (SLPs) with preschool-age children with pragmatic impairment and to identify the actual need(s) perceived by SLPs in this field. A total of 351 SLPs responded. The results reveal that 81.5 per cent of the respondents (n=286) reported working or had previously worked with preschool-age children with pragmatic impairment arising from autism spectrum disorder, developmental language disorder, or both. Considering the clinical practice, similarities and differences were found, many of which are due not to the inherent characteristics of each disorder but to the scarcity of research in clinical pragmatics. These results are also reflected in the needs perceived by SLPs and the degree of confidence with which they work with these children. Implications for clinical practice and directions for future research are discussed.