Outcome choice and definition in systematic reviews leads to few eligible studies included in meta-analyses: a case study

Outcome Heterogeneity in Prehabilitation Trials-Are We Comparing Apples and Oranges?

INTRODUCTION

Over the last decade, the number of prehabilitation randomised controlled trials (RCTs) has increased significantly. Therefore, this review aimed to describe the outcomes reported in prehabilitation RCTs in patients undergoing cancer surgery.

METHODS

A search was conducted in Embase, Allied and Complementary Medicine Database, The Cochrane Library, PsycINFO, MEDLINE, and Cumulated Index to Nursing and Allied Health Literature from inception to July 2021. We included RCTs evaluating the effectiveness of preoperative exercise, nutrition, and psychological interventions on postoperative complications and length of hospital stay in adult oncology patients who underwent thoracic and gastrointestinal cancer surgery. The verbatim outcomes reported in each article were extracted, and each outcome was assessed to determine whether it was defined and measured using a validated tool. Verbatim outcomes were grouped into standardized outcomes and categorized into domains. The quality of outcome reporting in each identified article was assessed using the Harman tool (score range 0-6, where 0 indicated the poorest quality).

RESULTS

A total of 74 RCTs were included, from which 601 verbatim outcomes were extracted. Only 110 (18.3%) of the verbatim outcomes were defined and 270 (44.9%) were labeled as either "primary" or "secondary" outcomes. Verbatim outcomes were categorized into 119 standardized outcomes and assigned into one of five domains (patient-reported outcomes, surgical outcomes, physical/functional outcomes, disease activity, and intervention delivery). Surgical outcomes were the most common outcomes reported (n = 71 trials, 95.9%). The overall quality of the reported outcomes was poor across trials (median score: 2.0 [IQR = 0.00-3.75]).

CONCLUSIONS

Prehabilitation RCTs display considerable heterogeneity in outcome reporting, and low outcome reporting quality. The development of standardized core outcome sets may help improve article quality and enhance the clinical utility of prehabilitation following cancer surgery.

Synbiotics in Oncology: A Scoping Review Protocol on Their Impact and Outcomes in Cancer Care

Symptom management remains challenging in cancer care. Emerging from nutritional science, nutritional metabolomics has seen exponential growth over recent years, aiming to discern the relationship between dietary habits and health consequences. This protocol aims to present the rationale and methodology for conducting a scoping review to summarize the extent of evidence on synbiotics utilization in cancer symptom management among adults. The scoping review will be undertaken in accordance with the Joanna Briggs Institute (JBI) principles and the research process guided by the PRISMA 2020 scoping reviews extension. The following electronic databases will be searched from the inception: PubMed, Cinahl, Web of Science and Scopus. The authors expect to map the literature regarding the clinical outcomes, including patient-report measures and patient-experience measures, on which the effects of probiotics were tested, and identify potential gaps. This protocol presents a rigorous methodological approach to map the literature on the clinical outcomes that the utilization of synbiotics might improve. This analysis will shape future researchers to examine the efficacy of probiotics on specific clinical outcomes in oncology care. Nurses are uniquely positioned to influence cancer symptom management through the selection and use of appropriate interventions in the field of nutritional supplements, along with nutritional counseling.

Primary outcome reporting in clinical trials for older adults with depression

BACKGROUND

Findings from randomised controlled trials (RCTs) are synthesised through meta-analyses, which inform evidence-based decision-making. When key details regarding trial outcomes are not fully reported, knowledge synthesis and uptake of findings into clinical practice are impeded.

AIMS

Our study assessed reporting of primary outcomes in RCTs for older adults with major depressive disorder (MDD).

METHOD

Trials published between 2011 and 2021, which assessed any intervention for adults aged ≥65 years with a MDD diagnosis, and that specified a single primary outcome were considered for inclusion in our study. Outcome reporting assessment was conducted independently and in duplicate with a 58-item checklist, used in developing the CONSORT-Outcomes statement, and information in each RCT was scored as 'fully reported', 'partially reported' or 'not reported', as applicable.

RESULTS

Thirty-one of 49 RCTs reported one primary outcome and were included in our study. Most trials (71%) did not fully report over half of the 58 checklist items. Items pertaining to outcome analyses and interpretation were fully reported by 65% or more of trials. Items reported less frequently included: outcome measurement instrument properties (varied from 3 to 30%) and justification of the criteria used to define clinically meaningful change (23%).

CONCLUSIONS

There is variability in how geriatric depression RCTs report primary outcomes, with omission of details regarding measurement, selection, justification and definition of clinically meaningful change. Outcome reporting deficiencies may hinder replicability and synthesis efforts that inform clinical guidelines and decision-making. The CONSORT-Outcomes guideline should be used when reporting geriatric depression RCTs.

Protocol for the development of a core outcome set for neonatal sepsis (NESCOS)

Neonatal sepsis is a serious public health problem; however, there is substantial heterogeneity in the outcomes measured and reported in research evaluating the effectiveness of the treatments. Therefore, we aim to develop a Core Outcome Set (COS) for studies evaluating the effectiveness of treatments for neonatal sepsis. Since a systematic review of key outcomes from randomised trials of therapeutic interventions in neonatal sepsis was published recently, we will complement this with a qualitative systematic review of the key outcomes of neonatal sepsis identified by parents, other family members, parent representatives, healthcare providers, policymakers, and researchers. We will interpret the outcomes of both studies using a previously established framework. Stakeholders across three different groups i.e., (1) researchers, (2) healthcare providers, and (3) patients' parents/family members and parent representatives will rate the importance of the outcomes in an online Real-Time Delphi Survey. Afterwards, consensus meetings will be held to agree on the final COS through online discussions with key stakeholders. This COS is expected to minimize outcome heterogeneity in measurements and publications, improve comparability and synthesis, and decrease research waste.

Outcomes reporting in systematic reviews on revitalization: A scoping review for the development of a core outcome set

BACKGROUND

Revitalization is a type of regenerative endodontic treatment (RET) that offers the exciting prospect of revitalizing damaged tissue, therefore improving outcomes for non-vital immature teeth. To evaluate its potential, there needs to be consistency in outcome reporting of clinical studies investigating revitalization to allow for evidence synthesis and inform clinical decision making.

OBJECTIVES

The aim of this scoping review was to identify outcomes that are reported in systematic reviews on revitalization including how and when these outcomes are measured. Additionally, evidence of selective reporting bias in the reviews was assessed.

METHODS

A comprehensive electronic search of healthcare databases and grey literature was conducted to identify systematic reviews published in the English language reporting outcomes of revitalization in permanent immature teeth. There was no restriction on the date of publication. Outcome data was extracted by four reviewers independently and mapped with a healthcare taxonomy into five core areas: survival, clinical/physiological changes, life impact, resource use and adverse events. Selective reporting bias and how it was measured was assessed independently by two reviewers.

RESULTS

Twenty-six systematic reviews were included in this scoping review. There was lack of standardization in reporting and significant heterogeneity across reviews in outcome endpoints. The outcomes reported could be aligned within the five core areas of the taxonomy including tooth survival which was reported in nine reviews. Patient-reported outcomes were generally limited and no review reported on Oral Health Related Quality of Life. Many of the reviews reporting on randomized control trials were at low risk of selective reporting bias whilst other study designs were at higher risk.

DISCUSSION

Consistency in outcome reporting is necessary to realize the benefits of old but particularly novel therapies. Data from this review confirmed heterogeneity in reporting outcomes of revitalization and the need for development of a core outcome set (COS).

CONCLUSIONS

Several important outcomes including survival, root development, tooth discolouration and periapical healing have been identified in this review which could inform the development of a COS in this area.

REGISTRATION

Core Outcome Measures in Effectiveness Trials (COMET) database (registration no. 1879).

Which Types of Body-Oriented Interventions Promote Preschoolers' Social-Emotional Competence? A Systematic Review

There has been a recent increase in body-oriented interventions implemented in educational contexts. Body-oriented interventions are grounded on the body-mind relationship, involving body and movement awareness and expression. In this systematic review of the literature on body-oriented interventions implemented in preschool contexts, we review the scope and quality of the quantitative evidence of each type of body-oriented intervention regarding social-emotional competence. Seven databases were searched for randomized controlled trials (RCTs) and quasi-RCTs. Seven core body-oriented intervention programs were found (e.g., play, relaxation, and psychomotricity). Play programs were the most studied and appear to be the most effective to improve social-emotional competence. Nevertheless, the level of scientific evidence was compromised by the lack of studies with high methodological quality.

Core outcomes were rarely reported overall in systematic reviews on acupuncture for osteoarthritis: a cross-sectional meta-epidemiological study

OBJECTIVE

To identify a comprehensive list of outcomes and explore the reporting rate of core outcome sets (COS) and related factors in systematic reviews (SRs) of acupuncture for osteoarthritis (OA).

STUDY DESIGN AND SETTING

Databases were searched for the relative SRs. Descriptive statistics were calculated as frequencies and percentages. Binary logistic regression was used to explore the factors affecting the reporting rate of COS.

RESULTS

We included 59 SRs. Outcome measures reported in the SRs were classified into 11 domains and 67 unique outcomes. No SR completely reported COS. In COS released in 2016, 75% of outcomes (6/8) were only reported by ⩽5% SRs. In COS released in 2019, the reporting rate was very low (from 0% to 17%) for 73.3% of outcomes (11/15). SRs published in the most recent 5 years had a significantly greater possibility of reporting COS (odds ratio (OR) = 4.74, 95% confidence interval (CI) = 1.33 to 16.88, p = 0.016).

CONCLUSION

Core outcomes were rarely reported in systematic reviews of acupuncture for OA, with considerable heterogeneity in the use of outcomes. The publication of COS in the COMET (Core Outcome Measures in Effectiveness Trials) database may help promote the reporting of COS. We encourage systematic reviewers to use relevant COS.

Outcomes reporting in systematic reviews on vital pulp treatment: A scoping review for the development of a core outcome set

Background

A large number of research reports on vital pulp treatment (VPT) has been published over the last two decades. However, heterogeneity in reporting outcomes of VPT is a significant challenge for evidence synthesis and clinical decision‐making.

Objectives

To identify outcomes assessed in VPT studies and to evaluate how and when outcomes are measured. A subsidiary aim was to assess evidence for selective reporting bias in the included studies. The results of this review will be used to inform the development of a core outcome set (COS) for endodontic treatments.

Methods

Multiple healthcare bibliographic databases, including PubMed/MEDLINE, Ovid EMBASE, Scopus, Cochrane Database of Systematic Reviews and Web of Science were searched for systematic reviews published between 1990 and 2020, reporting on VPT. Screening, data extraction and risk of bias assessment were completed independently by two reviewers. Outcomes' information was extracted and aligned with a healthcare taxonomy into five core areas: survival, clinical/physiological changes, life impact, resource use and adverse events.

Results

Thirty‐six systematic reviews were included, 10 reporting on indirect pulp capping or selective caries removal, nine on direct pulp capping, eight on pulpotomy and nine on combined VPTs. There was considerable variation in the outcomes reported in these reviews and their included studies. Clinician‐reported outcomes were used considerably more often than patient‐reported outcomes. A range of instruments and time points were used for measuring outcomes. Several of the reviews were assessed as having low risk of selective reporting bias, but many did not specifically report this domain, whilst others did not provide risk of bias assessment at all.

Discussion

Considerable variation in selection of outcomes and how and when they are measured and reported was evident, and this heterogeneity has implications for evidence synthesis and clinical decision‐making.

Conclusions

Whilst there is a lack of consistency, several potentially important outcomes for VPT, including pulp survival, incidence of post‐operative pain and need for further intervention, have been identified which could inform the development of a COS for endodontic treatment.

Registration

Core Outcome Measures in Effectiveness Trials (COMET) (No. 1879).

Steroid use for established bronchopulmonary dysplasia: study protocol for a systematic review and meta-analysis

INTRODUCTION

Postnatal steroids during the first few weeks of life have been demonstrated to be effective in decreasing the incidence of bronchopulmonary dysplasia (BPD), a serious chronic respiratory condition affecting preterm infants. However, this preventive option is limited by the concern of neurological side effects. Steroids are used to treat established BPD in an attempt to reduce mortality, and length of stay and home oxygen therapy, both of which associated with high levels of parental stress and healthcare costs. Moreover, a late timing for steroid treatment may show a more favourable safety profile in terms of neurodevelopment outcomes, considering the added postnatal brain maturation of these infants. Here, we report a protocol for a systematic review, which aims to determine the efficacy and long-term safety of postnatal steroids for the treatment of established BPD in preterm infants.

METHODS AND ANALYSIS

MEDLINE, Embase, Cochrane databases and sources of grey literature for conference abstracts and trial registrations will be searched with no time or language restriction. We will include case-control studies, cohort studies and non-randomised or randomised trials that evaluate postnatal steroids for infants diagnosed with moderate or severe established BPD at 36 weeks' postmenstrual age. We will pool data from studies that are sufficiently similar to make this appropriate. Data extraction forms will be developed a priori. Observational studies and non-randomised and randomised clinical trials will be analysed separately. We will combine OR with 95% CI for dichotomous outcomes and the mean difference (95% CI) for continuous outcomes. We will account for the expected heterogeneity by using a random-effects model. We will perform subgroup analysis based on the a priori determined covariate of interest.

ETHICS AND DISSEMINATION

Systematic reviews are exempted from approval by an ethics committee. Attempts will be sought to publish all results.

PROSPERO REGISTRATION NUMBER

CRD42021218881.

Impact of social protection on gender equality in low- and middle-income countries: A systematic review of reviews

Background

More than half of the global population is not effectively covered by any type of social protection benefit and women's coverage lags behind. Most girls and boys living in low-resource settings have no effective social protection coverage. Interest in these essential programmes in low and middle-income settings is rising and in the context of the COVID-19 pandemic the value of social protection for all has been undoubtedly confirmed. However, evidence on whether the impact of different social protection programmes (social assistance, social insurance and social care services and labour market programmes) differs by gender has not been consistently analysed. Evidence is needed on the structural and contextual factors that determine differential impacts. Questions remain as to whether programme outcomes vary according to intervention implementation and design.

Objectives

This systematic review aims to collect, appraise, and synthesise the evidence from available systematic reviews on the differential gender impacts of social protection programmes in low and middle-income countries. It answers the following questions: 1.What is known from systematic reviews on the gender-differentiated impacts of social protection programmes in low and middle-income countries?2.What is known from systematic reviews about the factors that determine these gender-differentiated impacts?3.What is known from existing systematic reviews about design and implementation features of social protection programmes and their association with gender outcomes?

Search Methods

We searched for published and grey literature from 19 bibliographic databases and libraries. The search techniques used were subject searching, reference list checking, citation searching and expert consultations. All searches were conducted between 10 February and 1 March 2021 to retrieve systematic reviews published within the last 10 years with no language restrictions.

Selection Criteria

We included systematic reviews that synthesised evidence from qualitative, quantitative or mixed-methods studies and analysed the outcomes of social protection programmes on women, men, girls, and boys with no age restrictions. The reviews included investigated one or more types of social protection programmes in low and middle-income countries. We included systematic reviews that investigated the effects of social protection interventions on any outcomes within any of the following six core outcome areas of gender equality: economic security and empowerment, health, education, mental health and psychosocial wellbeing, safety and protection and voice and agency.

Data Collection and Analysis

A total of 6265 records were identified. After removing duplicates, 5250 records were screened independently and simultaneously by two reviewers based on title and abstract and 298 full texts were assessed for eligibility. Another 48 records, identified through the initial scoping exercise, consultations with experts and citation searching, were also screened. The review includes 70 high to moderate quality systematic reviews, representing a total of 3289 studies from 121 countries. We extracted data on the following areas of interest: population, intervention, methodology, quality appraisal, and findings for each research question. We also extracted the pooled effect sizes of gender equality outcomes of meta-analyses. The methodological quality of the included systematic reviews was assessed, and framework synthesis was used as the synthesis method. To estimate the degree of overlap, we created citation matrices and calculated the corrected covered area.

Main Results

Most reviews examined more than one type of social protection programme. The majority investigated social assistance programmes (77%, N = 54), 40% (N = 28) examined labour market programmes, 11% (N = 8) focused on social insurance interventions and 9% (N = 6) analysed social care interventions. Health was the most researched (e.g., maternal health; 70%, N = 49) outcome area, followed by economic security and empowerment (e.g., savings; 39%, N = 27) and education (e.g., school enrolment and attendance; 24%, N = 17). Five key findings were consistent across intervention and outcomes areas: (1) Although pre-existing gender differences should be considered, social protection programmes tend to report higher impacts on women and girls in comparison to men and boys; (2) Women are more likely to save, invest and share the benefits of social protection but lack of family support is a key barrier to their participation and retention in programmes; (3) Social protection programmes with explicit objectives tend to demonstrate higher effects in comparison to social protection programmes without broad objectives; (4) While no reviews point to negative impacts of social protection programmes on women or men, adverse and unintended outcomes have been attributed to design and implementation features. However, there are no one-size-fits-all approaches to design and implementation of social protection programmes and these features need to be gender-responsive and adapted; and (5) Direct investment in individuals and families' needs to be accompanied by efforts to strengthen health, education, and child protection systems. Social assistance programmes may increase labour participation, savings, investments, the utilisation of health care services and contraception use among women, school enrolment among boys and girls and school attendance among girls. They reduce unintended pregnancies among young women, risky sexual behaviour, and symptoms of sexually transmitted infections among women. Social insurance programmes increase the utilisation of sexual, reproductive, and maternal health services, and knowledge of reproductive health; improve changes in attitudes towards family planning; increase rates of inclusive and early initiation of breastfeeding and decrease poor physical wellbeing among mothers. Labour market programmes increase labour participation among women receiving benefits, savings, ownership of assets, and earning capacity among young women. They improve knowledge and attitudes towards sexually transmitted infections, increase self-reported condom use among boys and girls, increase child nutrition and overall household dietary intake, improve subjective wellbeing among women. Evidence on the impact of social care programmes on gender equality outcomes is needed.

Authors' Conclusions

Although effectiveness gaps remain, current programmatic interests are not matched by a rigorous evidence base demonstrating how to appropriately design and implement social protection interventions. Advancing current knowledge of gender-responsive social protection entails moving beyond effectiveness studies to test packages or combinations of design and implementation features that determine the impact of these interventions on gender equality. Systematic reviews investigating the impact of social care programmes, old age pensions and parental leave on gender equality outcomes in low and middle-income settings are needed. Voice and agency and mental health and psychosocial wellbeing remain under-researched gender equality outcome areas.

Harms in Systematic Reviews Paper 3: Given the same data sources, systematic reviews of gabapentin have different results for harms

OBJECTIVE

In this methodologic study (Part 2 of 2), we examined the overlap in sources of evidence and the corresponding results for harms in systematic reviews for gabapentin.

STUDY DESIGN & SETTING

We extracted all citations referenced as sources of evidence for harms of gabapentin from 70 systematic reviews, as well as the harms assessed and numerical results. We assessed consistency of harms between pairs of reviews with a high degree of overlap in sources of evidence (>50%) as determined by corrected covered area (CCA).

RESULTS

We found 514 reports cited across 70 included reviews. Most reports (244/514, 48%) were not cited in more than one review. Among 18 pairs of reviews, we found reviews had differences in which harms were assessed and their choice to meta-analyze estimates or present descriptive summaries. When a specific harm was meta-analyzed in a pair of reviews, we found similar effect estimates.

CONCLUSION

Differences in harms results across reviews can occur because the choice of harms is driven by reviewer preferences, rather than standardized approaches to selecting harms for assessment. A paradigm shift is needed in the current approach to synthesizing harms.

Effects of Body-Oriented Interventions on Preschoolers' Social-Emotional Competence: A Systematic Review

OBJECTIVE

A growing body of evidence supports the effectiveness of body-oriented interventions (BOI) in educational contexts, showing positive influences on social-emotional competence. Nevertheless, there is a lack of systematization of the evidence regarding preschool years. This is a two-part systematic review. In this first part, we aim to examine the effects of BOI on preschoolers' social-emotional competence outcomes.

DATA SOURCES

Searches were conducted in Pubmed, Scopus, PsycInfo, ERIC, Web of Science, Portal Regional da BVS and CINAHL.

ELIGIBILITY CRITERIA

English, French and Portuguese language articles published between January 2000 and October 2020, that evaluated the effects of BOI implemented in educational contexts on social-emotional competence of preschool children. Only randomized controlled trials (RCT) or quasi-RCT were included.

DATA EXTRACTION AND SYNTHESIS

Two reviewers independently completed data extraction and risk-of-bias assessment. The level of scientific evidence was measured through the Best Evidence Synthesis.

RESULTS

Nineteen studies were included. There was strong evidence that BOI do not improve anger/aggression, delay of gratification and altruism. Nevertheless, there was moderate evidence that BOI effectively improve other social-emotional outcomes, such as empathy, social interaction, social independence, general internalizing behaviors, and general externalizing behaviors. The lack of scientific evidence was compromised by the methodological quality of the studies.

CONCLUSION

BOI effectively improve specific social-emotional competences of preschool children.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO, identifier CRD42020172248.

More than half of systematic reviews have relevant core outcome sets

OBJECTIVES

Using recent systematic reviews (SRs), our objectives were to: (1) develop a framework to assess whether a given COS is relevant to the scope of a SR; (2) examine the proportion of SRs for which relevant COS exist; and (3) for SRs for which COS exist, examine the extent to which outcomes in the COS and outcomes in the SR match.

STUDY DESIGN AND SETTING

We included a sample of SRs published by the Agency for Healthcare Research and Quality Evidence-based Practice Center Program between January 1, 2018 and October 12, 2020. We searched for potentially relevant COS from the Core Outcome Measures for Effectiveness Trials (COMET) database. We assessed the matching between outcomes recommended by COS and those included in corresponding SRs. When outcomes were matched, we considered matches to be specific (i.e., exact) or general (i.e., non-specific).

RESULTS

Sixty-seven SRs met criteria. We found relevant COS for 36 of 67 SRs (54%). Our framework for comparing the scope of a SR and a COS describes 16 scenarios arising when the breadth of the populations and the interventions are considered. The framework guides systematic reviewers to determine whether a COS is very likely to be relevant, may be relevant, or unlikely to be relevant. Sixty-two percent of outcomes in COS (interquartile range, 40% - 80%) were either specific or general matches to outcomes in SRs.

CONCLUSION

We found a COS with relevant scope for more than half of the SRs in our sample, with almost two-thirds of the recommended core outcomes matched to outcomes chosen for the SRs. Consideration of COS appears relevant for SR planning and our framework for assessing relevance of a given COS may help with this process.

Mobile health strategies for blood pressure self-management in urban populations with digital barriers: systematic review and meta-analyses

Mobile health (mHealth) technologies improve hypertension outcomes, but it is unknown if this benefit applies to all populations. This review aimed to describe the impact of mHealth interventions on blood pressure outcomes in populations with disparities in digital health use. We conducted a systematic search to identify studies with systolic blood pressure (SBP) outcomes located in urban settings in high-income countries that included a digital health disparity population, defined as mean age ≥65 years; lower educational attainment (≥60% ≤high school education); and/or racial/ethnic minority (<50% non-Hispanic White for US studies). Interventions were categorized using an established self-management taxonomy. We conducted a narrative synthesis; among randomized clinical trials (RCTs) with a six-month SBP outcome, we conducted random-effects meta-analyses. Twenty-nine articles (representing 25 studies) were included, of which 15 were RCTs. Fifteen studies used text messaging; twelve used mobile applications. Studies were included based on race/ethnicity (14), education (10), and/or age (6). Common intervention components were: lifestyle advice (20); provision of self-monitoring equipment (17); and training on digital device use (15). In the meta-analyses of seven RCTs, SBP reduction at 6-months in the intervention group (mean SBP difference = -4.10, 95% CI: [-6.38, -1.83]) was significant, but there was no significant difference in SBP change between the intervention and control groups (p = 0.48). The use of mHealth tools has shown promise for chronic disease management but few studies have included older, limited educational attainment, or minority populations. Additional robust studies with these populations are needed to determine what interventions work best for diverse hypertensive patients.

PROTOCOL: Impact of social protection on gender equality in low- and middle-income countries: A systematic review of reviews

This is the protocol for a Campbell review. The review aims to systematically collect, appraise, map and synthesise the evidence from systematic reviews on the differential gender impacts of social protection programmes in Low- and Middle-Income Countries (LMICs). Therefore, it will answer the following questions: (1) What is known from systematic reviews on the gender-differentiated impacts of social protection programmes in LMICs? (2) What is known from systematic reviews about the factors that determine these gender-differentiated impacts? (3) What is known from existing systematic reviews about design and implementation features of social protection programmes and their association with gender outcomes?

Evaluating the quality of evidence for gaming disorder: A summary of systematic reviews of associations between gaming disorder and depression or anxiety

Gaming disorder has been described as an urgent public health problem and has garnered many systematic reviews of its associations with other health conditions. However, review methodology can contribute to bias in the conclusions, leading to research, policy, and patient care that are not truly evidence-based. This study followed a pre-registered protocol (PROSPERO 2018 CRD42018090651) with the objective of identifying reliable and methodologically-rigorous systematic reviews that examine the associations between gaming disorder and depression or anxiety in any population. We searched PubMed and PsycInfo for published systematic reviews and the gray literature for unpublished systematic reviews as of June 24, 2020. Reviews were classified as reliable according to several quality criteria, such as whether they conducted a risk of bias assessment of studies and whether they clearly described how outcomes from each study were selected. We assessed possible selective outcome reporting among the reviews. Seven reviews that included a total of 196 studies met inclusion criteria. The overall number of participants was not calculable because not all reviews reported these data. All reviews specified eligibility criteria for studies, but not for outcomes within studies. Only one review assessed risk of bias. Evidence of selective outcome reporting was found in all reviews-only one review incorporated any of the null findings from studies it included. Thus, none were classified as reliable according to prespecified quality criteria. Systematic reviews related to gaming disorder do not meet methodological standards. As clinical and policy decisions are heavily reliant on reliable, accurate, and unbiased evidence synthesis; researchers, clinicians, and policymakers should consider the implications of selective outcome reporting. Limitations of the current summary include using counts of associations and restricting to systematic reviews published in English. Systematic reviewers should follow established guidelines for review conduct and transparent reporting to ensure evidence about technology use disorders is reliable.

Assessing the relevance and uptake of core outcome sets (an agreed minimum collection of outcomes to measure in research studies) in Cochrane systematic reviews: a review

OBJECTIVES

A core outcome set (COS) is an agreed standardised minimum collection of outcomes that should be measured and reported in research in a specific area of health. Cochrane systematic reviews ('reviews') are rigorous reviews on health-related topics conducted under the auspices of Cochrane. This study examines the use of existing COS to inform the choice of outcomes in Cochrane systematic reviews ('reviews') and investigates the views of the coordinating editors of Cochrane Review Groups (CRGs) on this topic.

METHODS

A cohort of 100 recently published or updated Cochrane reviews were assessed for reference to a COS being used to inform the choice of outcomes for the review. Existing COS, published 2 or more years before the review publication, were then identified to assess how often a reviewer could have used a relevant COS if it was available. We asked 52 CRG coordinating editors about their involvement in COS development, how outcomes are selected for reviews in their CRG and their views of the advantages and challenges surrounding the standardisation of outcomes within their CRG.

RESULTS

In the cohort of reviews from 2019, 40% (40/100) of reviewers noted problems due to outcome inconsistency across the included studies. In 7% (7/100) of reviews, a COS was referenced in relation to the choice of outcomes for the review. Relevant existing COS could be considered for a review update in 35% of the others (33/93). Most editors who responded (31/36, 86%) thought that COS should definitely or possibly be used to inform the choice of outcomes in a review.

CONCLUSIONS

Systematic reviewers are continuing to note outcome heterogeneity but are starting to use COS to inform their reviews. There is potential for greater uptake of COS in Cochrane reviews.