Can AMSTAR also be applied to systematic reviews of non-randomized studies?

An Umbrella Review of Meta-Analyses Evaluating Associations between Human Health and Exposure to Major Classes of Plastic-Associated Chemicals

Background: Epidemiological research investigating the impact of exposure to plastics, and plastic-associated chemicals, on human health is critical, especially given exponentially increasing plastic production. In parallel with increasing production, academic research has also increased exponentially both in terms of the primary literature and ensuing systematic reviews with meta-analysis. However, there are few overviews that capture a broad range of chemical classes to present a state of play regarding impacts on human health. Methods: We undertook an umbrella review to review the systematic reviews with meta-analyses. Given the complex composition of plastic and the large number of identified plastic-associated chemicals, it was not possible to capture all chemicals that may be present in, and migrate from, plastic materials. We therefore focussed on a defined set of key exposures related to plastics. These were microplastics, due to their ubiquity and potential for human exposure, and the polymers that form the matrix of consumer plastics. We also included plasticisers and flame retardants as the two classes of functional additive with the highest concentration ranges in plastic. In addition, we included bisphenols and per- and polyfluoroalkyl substances (PFAS) as two other major plastic-associated chemicals with significant known exposure through food contact materials. Epistemonikos and PubMed were searched for systematic reviews with meta-analyses, meta-analyses, and pooled analyses evaluating the association of plastic polymers, particles (microplastics) or any of the selected groups of high-volume plastic-associated chemicals above, measured directly in human biospecimens, with human health outcomes. Results: Fifty-two systematic reviews were included, with data contributing 759 meta-analyses. Most meta-analyses (78%) were from reviews of moderate methodological quality. Across all the publications retrieved, only a limited number of plastic-associated chemicals within each of the groups searched had been evaluated in relevant meta-analyses, and there were no meta-analyses evaluating polymers, nor microplastics. Synthesised estimates of the effects of plastic-associated chemical exposure were identified for the following health outcome categories in humans: birth, child and adult reproductive, endocrine, child neurodevelopment, nutritional, circulatory, respiratory, skin-related and cancers. Bisphenol A (BPA) is associated with decreased anoclitoral distance in infants, type 2 diabetes (T2D) in adults, insulin resistance in children and adults, polycystic ovary syndrome, obesity and hypertension in children and adults and cardiovascular disease (CVD); other bisphenols have not been evaluated. Phthalates, the only plasticisers identified, are associated with spontaneous pregnancy loss, decreased anogenital distance in boys, insulin resistance in children and adults, with additional associations between certain phthalates and decreased birth weight, T2D in adults, precocious puberty in girls, reduced sperm quality, endometriosis, adverse cognitive development and intelligence quotient (IQ) loss, adverse fine motor and psychomotor development and elevated blood pressure in children and asthma in children and adults. Polychlorinated biphenyls (PCBs), polybrominated diphenyl ethers (PBDEs) but not other flame retardants, and some PFAS were identified and are all associated with decreased birth weight. In general populations, PCBs are associated with T2D in adults and endometriosis, bronchitis in infants, CVD, non-Hodgkin's lymphoma (NHL) and breast cancer. In PCB-poisoned populations, exposure is associated with overall mortality, mortality from hepatic disease (men), CVD (men and women) and several cancers. PBDEs are adversely associated with children's cognitive development and IQ loss. PBDEs and certain PFAS are associated with changes in thyroid function. PFAS exposure is associated with increased body mass index (BMI) and overweight in children, attention deficit hyperactive disorder (ADHD) in girls and allergic rhinitis. Potential protective associations were found, namely abnormal pubertal timing in boys being less common with higher phthalate exposure, increased high-density lipoprotein (HDL) with exposure to mono(2-ethyl-5-oxohexyl) phthalate (MEOHP) and reduced incidence of chronic lymphocytic lymphoma (a subtype of NHL) with PCB exposure. Conclusions: Exposure to plastic-associated chemicals is associated with adverse outcomes across a wide range of human health domains, and every plastic-associated chemical group is associated with at least one adverse health outcome. Large gaps remain for many plastic-associated chemicals. Recommendations: For research, we recommend that efforts are harmonised globally to pool resources and extend beyond the chemicals included in this umbrella review. Priorities for primary research, with ensuing systematic reviews, could include micro- and nanoplastics as well as emerging plastic-associated chemicals of concern such as bisphenol analogues and replacement plasticisers and flame retardants. With respect to chemical regulation, we propose that safety for plastic-associated chemicals in humans cannot be assumed at market entry. We therefore recommend that improved independent, systematic hazard testing for all plastic-associated chemicals is undertaken before market release of products. In addition because of the limitations of laboratory-based testing for predicting harm from plastic in humans, independent and systematic post-market bio-monitoring and epidemiological studies are essential to detect potential unforeseen harms.

The association between air pollution and obesity: an umbrella review of meta-analyses and systematic reviews

The objective of this umbrella review was to investigate comprehensive and synthesized evidence of the association between ambient air pollution and obesity based on the current systematic reviews and meta-analyses. Related studies from databases including PubMed, EMBASE, Web of Science, and the Cochrane Library, published before July 16, 2023, were considered in the analysis. All selected systematic reviews and meta-analyses were included in accordance with PRISMA guidelines. The risk of bias and the methodological quality were evaluated using the AMSTAR 2 tool. The protocol for this umbrella review was documented in PROSPERO with the registration number: CRD42023450191. This umbrella review identified 7 studies, including 5 meta-analyses and 2 systematic reviews, to assess the impacts of air pollutants on obesity. Commonly examined air pollutants included PM1, PM2.5, PM10, NO2, SO2, O3. Most of the included studies presented that air pollution exposure was positively associated with the increased risk of obesity. The impact of air pollution on obesity varied by different ambient air pollutants. This study provided compelling evidence that exposure to air pollution had a positive association with the risk of obesity. These findings further indicate the importance of strengthening air pollution prevention and control. Future studies should elucidate the possible mechanisms and pathways linking air pollution to obesity.

AMSTAR 2 is only partially applicable to systematic reviews of non-intervention studies: a meta-research study

OBJECTIVES

A measurement tool to assess systematic reviews 2 (AMSTAR 2) was originally developed for systematic reviews (SRs) of health-care interventions. The aim of this study was to assess the applicability of AMSTAR 2 to SRs of non-intervention studies.

STUDY DESIGN AND SETTING

This was a meta-research study. We used 20 SRs for each of the following four types of SRs: Diagnostic Test Accuracy reviews, Etiology and/or Risk reviews, Prevalence and/or Incidence reviews, and Prognostic reviews (80 in total). Three authors applied AMSTAR 2 independently to each included SRs. Then, the authors assessed the applicability of each item to that SR type and any SR type.

RESULTS

Researchers unanimously indicated that 7 of 16 AMSTAR 2 items were applicable for all four specific SR types and any SR type (items 2, 5, 6, 7, 10, 14 and 16), but 8 of 16 items for any SR type. These items could cover generic SR methods that do not depend on a specific SR type.

CONCLUSION

AMSTAR 2 is only partially applicable for non-intervention SRs. There is a need to adapt/extend AMSTAR 2 for SRs of non-intervention studies. Our study can help to further define generic methodological aspects shared across SR types and methodological expectations for non-intervention SRs.

Association between COVID-19 and sexual health: an umbrella review

PURPOSE

We conducted this umbrella review to review the current evidence on the relationship between COVID-19 and sexual health in both men and women.

METHODS

We conducted searches in Pubmed, Embase, and the Cochrane dataset for meta-analyses that met our pre-set inclusion criteria. We included studies with detailed information investigating the link between COVID-19 and sexual health in men/women. We did not limit the language.

RESULTS

The results of the included studies frequently relied on the Female Sexual Function Index to assess sexual health in women. For men, the International Index of Male Function and hospital diagnoses were commonly used to assess sexual health. Currently, there is conflicting evidence regarding the impact of COVID-19 on sexual health. However, since most studies were observational in nature, additional study designs are necessary to draw definitive conclusions across different contexts.

CONCLUSION

Our findings highlight the importance of sexual health among COVID-19 patients and people affected due to COVID-19. Further critical studies should investigate the mechanism underlying the association between COVID-19 and sexual health.

Adverse effects associated with acupuncture therapies: An evidence mapping from 535 systematic reviews

BACKGROUND AND OBJECTIVE

Considering that physicians and patients widely use acupuncture, it is necessary to explore its adverse effects during treatment. Herein, an evidence map was generated based on published studies to identify acupuncture-induced adverse effects and assess their severity, with the overarching goal of providing references for safe and effective implementation.

METHODS

A comprehensive literature search was performed in four public databases (PubMed, Embase, Web of science, and the Cochrane Library) to identify relevant studies published up to 15^th June 2022. In addition, relevant studies were explored in the Epistemonikos database and reference lists were retrieved as a supplement. A MeaSurement Tool to Assess systematic Reviews, Version 2 (AMSTAR-2) quality assessment tool was applied to determine the methodological quality of included systematic reviews (SRs) and/or meta-analysis (MAs), whereas Microsoft Excel 2019 tool was used for data extraction and coding. Heatmaps were generated to display disease type, countries of origin for the first authors, and the sample sizes of original studies. Moreover, bubble charts comprehensively presented intervention categories, adverse reaction types, and evidence levels.

RESULTS

A total of 535 SRs involving 33 adverse reactions were included. Among them, 22 studies were rated as high quality, 28 as moderate, 106 as low, and the rest were of critically-low quality. Numerous adverse effects were described in the studies, including syncope (86 SRs), organ or tissue injury (233 SRs), systemic reactions (113 SRs), infection (19 SRs), and other adverse events (373 SRs). Importantly, these adverse reactions were mainly associated with 19 acupuncture techniques, including electroacupuncture (n = 67), manual acupuncture (n = 47) and acupoint catgut embedding (n = 41). Furthermore, the 535 SRs described 23 diseases, among which symptoms, signs or clinical findings (83 SRs), mental, behavioral or neurodevelopmental disorders (67 SRs), and diseases of the nervous system (66 SRs) had the highest incidence.

CONCLUSION

This evidence mapping explores the adverse effects of acupuncture, showing that there are multiple types of adverse reactions to acupuncture, with milder symptoms. The methodological assessment revealed that most of the included studies were of low- or critically low-quality. Therefore, there is a need for future randomized controlled trials and SRs to comprehensively analyze acupuncture-related adverse events in order to provide reliable and credible evidence.

Effect of internal limiting membrane peeling for idiopathic epiretinal membrane

Purpose

To further evaluate the necessity of internal limiting membrane (ILM) peeling for patients with idiopathic epiretinal membrane (iERM).

Method

We searched PubMed, Web of Science, Embase, Cochrane Library, and CNKI from their inception up to August 24, 2021. Eligible meta-analyses comparing iERM removal with and without ILM peeling were included. AMSTAR and GRADE classification was used to assess the methodological quality of each study and the quality for each outcome, respectively. The primary outcomes were best-corrected visual acuity (BCVA), central macular thickness (CMT), and recurrence.

Results

10 meta-analyses were included. 75.9% of studies revealed no statistically significant difference in BCVA between the groups, while only 10.3% showed better BCVA favorable to additional ILM peeling. 54.2% reported no significant difference in CMT between the groups, followed by 41.7% showing thicker CMT due to additional ILM peeling. Compared to iERM removal alone, additional ILM peeling provided a lower recurrence rate in 66.7% of studies.

Conclusion

ILM peeling could significantly reduce recurrence rate, but not significantly improve the recovery of visual outcome or decrease the thickness of central macula.

Association between dry eye disease and depression: An umbrella review

Purpose

This umbrella review aimed to summarize the available evidence on the association between dry eye disease and depression.

Methods

We searched the Pubmed, Embase, and Cochrane databases using the search string "(Dry eye syndrome OR Keratoconjunctivitis sicca OR KCS OR Aqueous tear deficiency OR Sjogren syndrome) AND (depression OR depressive symptoms) AND (meta-analysis OR systematic review)" from inception to 20 July 2022. We considered all meta-analyses investigating the association between dry eye disease and depression.

Results

After summarizing the included meta-analyses, it was concluded that dry eye disease is associated with depression. The symptoms of dry eye disease affect the daily lives of patients, thus affecting their mood. However, further evidence is required to confirm this association.

Conclusion

This finding highlights the importance of psychological support for patients with dry eye disease. Future clinical studies should investigate the mechanism underlying the association between dry eye disease and depression.

Systematic review registration

https://www.crd.york.ac.uk/PROSPERO/, identifier: CRD42022320619.

False-positivity results in rapid antigen tests for SARS-CoV-2: an umbrella review of meta-analyses and systematic reviews

INTRODUCTION

The rapid antigen detection tests (RADTs) for SARS-CoV-2 infection could contribute to the clinical and public health strategies for managing COVID-19. This umbrella review aimed to explore the accuracy and sensitivity of RADTs for SARS-CoV-2 by assessing the incidence of false positivity associated with them.

AREAS COVERED

Meta-analyses and systematic reviews on the sensitivity and specificity of commercially available RADTs with data on false-positive results were identified by searching the PubMed, EMBASE, Cochrane Library, and Web of Science databases from inception to March 31, 2022. All meta-analyses and systematic reviews on the sensitivity and specificity of rapid antigen tests were included. Data on the author and year, included studies, index tests, sample size, false negatives, false positives, and study quality based on AMSTAR 2 (Assessing the Methodological Quality of Systematic Reviews) rating were extracted from the included meta-analyses and systematic reviews.

EXPERT OPINION

We identified 12 meta-analyses and systematic review that presented data on the false-positive results in RADTs. The false positivity rates in the included studies ranged from 0.0% - 4.0%. This study summarizes the available evidence on the incidence of false positivity in RADTs and shows it is less than 4.0%. Therefore, our findings imply that RADTs can be an appropriate, economic, and rapid detection method for mass screening of COVID-19.

Adopting AMSTAR 2 critical appraisal tool for systematic reviews: speed of the tool uptake and barriers for its adoption

Background

In 2007, AMSTAR (A MeaSurement Tool to Assess systematic Reviews), a critical appraisal tool for systematic reviews (SRs), was published, and it has since become one of the most widely used instruments for SR appraisal. In September 2017, AMSTAR 2 was published as an updated version of the tool. This mixed-methods study aimed to analyze the extent of the AMSTAR 2 uptake and explore potential barriers to its uptake.

Methods

We analyzed the frequency of AMSTAR or AMSTAR 2 use in articles published in 2018, 2019 and 2020. We surveyed authors who have used AMSTAR but not AMSTAR 2 in the analyzed time frame to identify their reasons and barriers. The inclusion criterion for those authors was that the month of manuscript submission was after September 2017, i.e. after AMSTAR 2 was published.

Results

We included 871 studies. The majority (N = 451; 52%) used AMSTAR 2, while 44% (N = 382) used AMSTAR, 4% (N = 31) used R-AMSTAR and others used a combination of tools. In 2018, 81% of the analyzed studies used AMSTAR, while 16% used AMSTAR 2. In 2019, 52% used AMSTAR, while 44% used AMSTAR 2. Among articles published in 2020, 28% used AMSTAR, while AMSTAR 2 was used by 69%.

An author survey indicated that the authors did not use AMSTAR 2 mostly because they were not aware of it, their protocol was already established, or data collection completed at the time when the new tool was published. Barriers towards AMSTAR 2 use were lack of quantitative assessment, insufficient awareness, length, difficulties with a specific item.

Conclusion

In articles published in 2018-2020, that were submitted to a journal after AMSTAR 2 tool was published, almost half of the authors (44%) still used AMSTAR, the old version of the tool. However, the use of AMSTAR has been declining in each subsequent year. Our survey indicated that editors and peer-reviewers did not ask the authors to use the new version of the tool. Few barriers towards using AMSTAR 2 were identified, and thus it is anticipated that the use of the old version of AMSTAR will continue to decline.

Safety of Cinnamon: An Umbrella Review of Meta-Analyses and Systematic Reviews of Randomized Clinical Trials

Purpose: Many evidence-based studies have indicated that cinnamon has therapeutic effects. However, it may not be entirely safe and its adverse effects may be ignored. The present umbrella review was conducted to elucidate the safety of cinnamon.

Methods: Pertinent meta-analyses and systematic reviews of randomized controlled trials on cinnamon use in humans were identified by searching PubMed, EMBASE, and the Cochrane Library from their inception to September 15, 2021. All meta-analyses and systematic reviews on the safety or adverse effects of cinnamon were considered. PRISMA 2020 was used as the standard of reporting (PRISMA registration ID: 286746).

Results: We identified three meta-analyses and one systematic review that described the safety of cinnamon. The quality of the meta-analysis and systematic reviews was evaluated using “Assessing the Methodological Quality of Systematic Reviews.” Their quality was rated as low in two (50%) instances and moderate in two (50%). There were no significant toxic- or side effects between cinnamon group and placebo group regardless of dose and duration.

Conclusion: There is evidence to support that the use of cinnamon has no adverse reactions. It can improve the health status of patients as an adjuvant treatment. Future studies exploring better profile risks and protective factors for cinnamon use-related adverse effect are needed, in order that preventive approaches can be developed.

Evaluating Breast Reconstruction Reviews Using A Measurement Tool to Assess Systematic Reviews (AMSTAR)

Background:

Breast reconstruction is an important aspect in breast cancer treatment.

Methods:

A comprehensive search of MEDLINE, Embase, and the Cochrane Library of Systematic Reviews was performed. Systematic reviews and meta-analyses that focused on breast reconstruction and were published between 2000 and 2020 were included. Quality assessment was performed using A Measurement Tool to Assess Systematic Reviews (AMSTAR). Study characteristics were extracted, including journal and impact factor, year of publication, country affiliation, reporting adherence to Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines, number of citations, and number of studies included.

Results:

The average AMSTAR score was moderate (5.32). There was a significant increase in AMSTAR score (P < 0.01) and number of studies (P < 0.01) over time. There were no significant correlations between AMSTAR score and impact factor (P = 0.038), and AMSTAR score and number of citations (P = 0.52), but there was a significant association between AMSTAR score and number of studies (P = 0.013). Studies that adhered to the PRISMA statement had a higher AMSTAR score on average (P < 0.01).

Conclusions:

Systematic reviews and meta-analyses about breast reconstruction had, on average, a moderate AMSTAR score. The number of studies and methodological quality have increased over time. Study characteristics including adherence to PRISMA guidelines are associated with improved methodological quality. Further improvements in specific AMSTAR domains would improve the overall methodological quality.

Refractive Error and Eye Health: An Umbrella Review of Meta-Analyses

Purpose: To explore the associations between refractive errors and multiple eye health outcomes. Methods: This is an umbrella review based on systematic reviews with meta-analyses. In our study, refractive errors included myopia, hyperopia, astigmatism, and anisometropia. We reconducted the meta-analyses whose primary data were available in sufficient detail by random effect model. Heterogeneity was assessed by I ². The main outcomes included myopic macular degeneration (MMD), retinal detachment (RD), cataract, open-angle glaucoma (OAG), strabismus, age-related macular degeneration (AMD), and diabetic retinopathy (DR). Results: Myopia was associated with increased risk of MMD (relative risk = 102.11, 95% CI 52.6-198.22), RD (3.45, 1.08-11.00), nuclear cataract (2.15, 1.53-3.03), posterior subcapsular (PSC) cataract (1.74, 1.41-2.15), OAG (1.95, 1.74-2.19), exotropia (5.23, 2.26-12.09), but decreased risk of DR (0.83, 0.66-1.04), and early AMD (0.80, 0.67-0.94). From mild-to-high myopia, the association strengthened for MMD, RD, nuclear cataract, PSC cataract, OAG, and DR. Hyperopia was associated with an increased risk of early AMD (1.09, 1.01-1.18) and esotropia (22.94, 10.20-51.62). Astigmatism and anisometropia were associated with increased risk of both exotropia and esotropia. Conclusions: Myopia, especially high myopia, demonstrated the highest risk for eye health outcomes, such as MMD, RD, OAG, nuclear and PSC cataracts, and exotropia. However, myopia was associated with a lower risk of early AMD and DR. Individuals with hyperopia are more likely to suffer early AMD and esotropia. Astigmatism and anisometropia predispose to strabismus. A lot of research studies on the mechanism of the associations are needed. Systematic Review Registration: https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=239744; identifier: 239744.

Evaluating the Quality of Systematic Reviews and Meta-Analyses About Breast Augmentation Using AMSTAR

BACKGROUND

Breast augmentation is one of the most commonly performed cosmetic surgeries worldwide. Therefore, it is imperative to have evidence with high methodological quality to guide clinical decision making.

OBJECTIVES

To evaluate the methodological quality of the systematic reviews (SRs) focused on breast augmentation.

METHODS

A comprehensive search of MEDLINE, Embase, and the Cochrane Library of Systematic Reviews was performed. SRs that have a particular focus on breast augmentation and were published in the top 15 plastic and reconstructive surgery journals were included. Quality assessment was performed using a measurement tool to assess systematic reviews (AMSTAR). Study characteristics were extracted including journal and impact factor, year of publication, country affiliation of the corresponding author, reporting adherence to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, number of citations, and number of studies included.

RESULTS

Among the 22 studies included for analysis, the mean AMSTAR score was moderate (5.55), with no SR achieving good quality (AMSTAR score of ≥9). There were no significant associations between AMSTAR score and journal impact factor, number of citations, year of publication, or number of included studies. Studies that reported adherence to PRISMA guidelines on average scored higher on the AMSTAR tool (P = 0.03).

CONCLUSIONS

The methodological quality of reviews about breast augmentation was found to be moderate, with no significant increase in studies or quality over time. Adherence to PRISMA guidelines and increased appraisal of SRs about breast augmentation using methodological assessment tools would further strengthen methodological quality and confidence in study findings.

Chinese Herbal Medicine Xingnaojing Injection for Acute Ischemic Stroke: An Overview of Systematic Reviews and Meta-Analyses

Background: Xingnaojing injection (XNJ) is the only Chinese herbal injection approved for both intracerebral hemorrhage and ischemic stroke (IS) first-aid on ambulances in China; many systematic reviews (SRs) and meta-analyses (MAs) of XNJ on stroke have been published. The purpose of this research was to evaluate and summarize the current evidence on XNJ for IS. Methods: A comprehensive search was conducted for SRs and MAs of XNJ on IS in seven databases up to January 1, 2021. Two authors independently identified SRs and MAs, extracted data, assessed the quality of the included SRs and MAs using the Assessment of Multiple Systematic Reviews 2 (AMSTAR 2), and assessed quality of evidence using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE). Results: A total of 10 SRs met the inclusion criteria. The quality of included SRs using AMSTAR 2 was critically low as the critical items were poorly reported. Only 10% of SRs reported 50% of the 16 items, while the remaining 90% SRs reported just less than half of the items on AMSTAR 2. For GRADE, 7 (35%) of outcomes had low-quality evidence, 10 (50%) with very low, and 3 (15%) with moderate quality evidence. Very low to low quality of evidence indicated XNJ plus conventional therapy (CT) alleviated the neurological deficits of acute IS. Moderate-quality evidence showed XNJ plus CT reduced mortality when compared to Danshen injection plus CT, and very low-quality evidence showed XNJ plus CT could not improve the degree of coma, while low-quality evidence indicated the opposite. Mild adverse events in the CT group were less than those in the XNJ plus CT group, and there were no serious adverse events, but there was no statistical difference between the two groups. The included 10 SRs indicated that XNJ was used for acute IS, but only four SRs (40%) reported the course of disease. Conclusion: XNJ appears to be effective and safe for acute IS in improving the neurological deficits, but the evidence is not robust enough. However, whether administering XNJ immediately after or within 24 h of IS is best remains unknown due to the lack of data. Well-designed large-scale randomized controlled trials with measurable outcomes are required in future studies.

Neutrophil to lymphocyte ratio and cancer prognosis: an umbrella review of systematic reviews and meta-analyses of observational studies

BACKGROUND

Although neutrophils have been linked to the progression of cancer, uncertainty exists around their association with cancer outcomes, depending on the site, outcome and treatments considered. We aimed to evaluate the strength and validity of evidence on the association between either the neutrophil to lymphocyte ratio (NLR) or tumour-associated neutrophils (TAN) and cancer prognosis.

METHODS

We searched MEDLINE, Embase and Cochrane Database of Systematic Reviews from inception to 29 May 2020 for systematic reviews and meta-analyses of observational studies on neutrophil counts (here NLR or TAN) and specific cancer outcomes related to disease progression or survival. The available evidence was graded as strong, highly suggestive, suggestive, weak or uncertain through the application of pre-set GRADE criteria.

RESULTS

A total of 204 meta-analyses from 86 studies investigating the association between either NLR or TAN and cancer outcomes met the criteria for inclusion. All but one meta-analyses found a hazard ratio (HR) which increased risk (HR > 1). We did not find sufficient meta-analyses to evaluate TAN and cancer outcomes (N = 9). When assessed for magnitude of effect, significance and bias related to heterogeneity and small study effects, 18 (9%) associations between NLR and outcomes in composite cancer endpoints (combined analysis), cancers treated with immunotherapy and some site specific cancers (urinary, nasopharyngeal, gastric, breast, endometrial, soft tissue sarcoma and hepatocellular cancers) were supported by strong evidence.

CONCLUSION

In total, 60 (29%) meta-analyses presented strong or highly suggestive evidence. Although the NLR and TAN hold clinical promise in their association with poor cancer prognosis, further research is required to provide robust evidence, assess causality and test clinical utility.

TRIAL REGISTRATION

PROSPERO CRD42017069131 .

Exploring the equity impact of mobile health-based human immunodeficiency virus interventions: A systematic review of reviews and evidence synthesis

Objective

While mobile health-based human immunodeficiency virus (HIV) interventions are often designed to promote health equity, systematic differences in the use of and access to mobile technologies may counteract that and widen treatment gaps. This systematic review applies an equity lens to investigate whether existing research provides adequate evidence on the ethical implications of mHealth technologies in HIV treatment and prevention.

Methods

This study included a two-stage methodology, consisting of (a) a systematic review of systematic reviews and (b) an evidence synthesis of primary studies. For the review of reviews we searched eight electronic databases, eight electronic journals and Google Scholar. We also screened reference lists and consulted authors of included studies. Primary studies were extracted from eligible reviews. We based our data extraction and analysis on the Place of residence, Race, Occupation, Gender/Sex, Religion, Education, Socioeconomic status, Social capital and other disadvantage related characteristics (PROGRESS-Plus) framework and the use of harvest plots, focusing on the socio-demographic distribution of mHealth effects.

Results

A total of 8786 citations resulted in 19 eligible reviews and 39 eligible primary studies. Existing reviews did not provide any analyses of the equity impacts of mobile health-based HIV initiatives. Information availability was higher in primary studies, predominantly suggesting no social gradient of mobile health-based HIV interventions. Overall, evidence remains weak and not sufficient to allow for confident equity statements.

Conclusions

Despite the negative force of socio-demographic inequities and the emerging nature of mobile health technologies, evidence on the equity implications of mobile health interventions for HIV care remains scarce. Not knowing how the effects of mobile health technologies differ across population subgroups inevitably limits our capacities to equitably adopt, adjust and integrate mobile health interventions towards reaching those disproportionally affected by the epidemic.

Use of AMSTAR-2 in the methodological assessment of systematic reviews: protocol for a methodological study

BACKGROUND

Systematic reviews (SRs) with or without meta-analyses (MAs) are widely used in resolving questions in various healthcare areas (such as, traditional Chinese medicine, public health and surgery), and they are the cornerstone of evidence-based healthcare. However, the reliability of SRs is typically influenced by their methodological quality. AMSTAR (A Measurement Tool to Assess Systematic Reviews) and AMSTAR-2 tools can assess the methodological quality of SRs, and the use of AMSTAR has been investigated. However, AMSTAR-2 is now widely used to evaluate the methodological quality of SRs, but the use of AMSTAR-2 for determining the methodological quality of SRs has not yet been investigated and assessed thoroughly. Thus, we designed the present study to investigate the use of AMSTAR-2 in studies that assessed the methodological quality of a sample of SRs with the AMSTAR-2 and provide references to potential users of AMSTAR-2 tool.

METHODS

Four commonly used electronic databases including PubMed, EmBase, the Cochrane Library, and Web of Science will be searched following a comprehensive search strategy to identify and retrieve studies that have used AMSTAR-2 tool for evaluating the methodological quality of SRs. Two independent authors will retrieve bibliometric information and methodological data, including all author names, time of publication, and journal names, whether a specific score value was given for each item, and whether overall quality assessment was performed. Descriptive statistical analyses will be used to present the study results, e.g., frequencies and percentages, mean and standard deviation (SD) or median and interquartile range (IQR). In addition, subgroup analyses will be performed to identify the methodological differences (e.g., the reporting of study designs included in SRs) between overviews and methodological studies. The risk ratio (RR) with 95% confidence interval (95% CI) will be calculated to measure the methodological differences. Cytoscape 3.7.1 software tool will be used to construct collaboration network maps. Further, Microsoft Office Excel 2016 and Stata 12.0 will be used to manage and analyze data.

DISCUSSION

The results of this study will identify any gaps in the use of AMSTAR-2 and important bibliometric features, such as active researchers and journals, provide guidance to researchers in various healthcare areas (such as, traditional Chinese medicine and public health) for using AMSTAR-2 tool and help them in developing cooperation and submitting their manuscripts.

The quality of systematic reviews/meta-analyses published in the field of bariatrics: A cross-sectional systematic survey using AMSTAR 2 and ROBIS

High-quality systematic reviews (SR) and meta-analyses (MA) are considered to be reliable sources of information. This study aims to assess the quality of studies published as SR or MA in the field of bariatrics in 2016 and 2017. We identified SR and MA in the field of bariatrics by searching electronic databases (MEDLINE, Embase, and Cochrane Database of Systematic Reviews). Eligible studies were those identified as SR/MA in the title/abstract, which aimed to assess any outcome in patients with morbid obesity undergoing or scheduled to undergo bariatric surgery. Two authors independently reviewed all titles and abstracts, assessed full texts of potentially eligible studies, and assessed the quality of included studies. Any discrepancies were resolved by the third reviewer. We evaluated the quality and risk of bias of each SR/MA using AMSTAR 2 checklist and ROBIS tool, respectively. Seventy-eight of 4236 references met inclusion criteria and were assessed for their quality/risk of bias. The methodological quality of 99% of all papers was classified as "critically low." A total of 6% of the studies were at low risk of bias, and 78% were assessed as being at high risk of bias. The methodological quality of studies published in 2016 and 2017 as SR/MA is highly unsatisfactory.

Arthroscopic Versus Open Bankart Repairs in Recurrent Anterior Shoulder Instability: A Systematic Review of the Association Between Publication Date and Postoperative Recurrent Instability in Systematic Reviews

PURPOSE

To systematically review the results of systematic studies regarding open versus arthroscopic Bankart repairs for recurrent anterior shoulder instability and quantitatively analyze the effect of primary-literature publication dates on reported outcomes in these systematic studies.

METHODS

A systematic search was conducted to identify systematic studies reporting outcomes of both arthroscopic and open Bankart repairs for recurrent anterior shoulder instability. Patient-reported outcome measures, recurrent instability rates, definitions of instability, and procedure types reported by included study characteristics were qualitatively analyzed. Correlation coefficient analyses were performed to investigate if a systematic study's proportion of included primary literature published after 1999, 2000, 2001, or 2002 affected that study's reported mean difference in instability recurrence between open and arthroscopic procedures. The Assessment of Multiple Systematic Reviews criteria were used to assess the risk of bias of the included studies.

RESULTS

Of 130 identified articles, 6 met the inclusion criteria. Patient-reported outcome measures were poorly reported. Among mean differences in instability recurrence rates, the results were indeterminate: Although 5 studies reported arthroscopic surgical procedures as having a higher recurrence rate, only 1 reported a statistically significant difference. Within the 5 included systematic reviews reporting the number of included studies, 37 of 56 observations were published after 2000. The proportion of studies published after 2000 (Pearson r = 0.88, P = .052) was positively associated with differences in instability recurrence rates between open and arthroscopic procedures.

CONCLUSIONS

Systematic studies that included newer studies (published after 2000) were associated with more favorable arthroscopic outcomes.

LEVEL OF EVIDENCE

Level IV, systematic review of Level III and IV studies.

Umbrella review and meta-analysis of antiplatelet therapy for peripheral artery disease

Background

The literature on antiplatelet therapy for peripheral artery disease has historically been summarized inconsistently, leading to conflict between international guidelines. An umbrella review and meta-analysis was performed to summarize the literature, allow assessment of competing safety risks and clinical benefits, and identify weak areas for future research.

Methods

MEDLINE, Embase, DARE, PROSPERO and Cochrane databases were searched from inception until January 2019. All meta-analyses of antiplatelet therapy in peripheral artery disease were included. Quality was assessed using AMSTAR scores, and GRADE analysis was used to quantify the strength of evidence. Data were pooled using random-effects models.

Results

Twenty-eight meta-analyses were included. Thirty-three clinical outcomes and 41 antiplatelet comparisons in 72 181 patients were analysed. High-quality evidence showed that antiplatelet monotherapy reduced non-fatal strokes (3 (95 per cent c.i. 0 to 6) fewer per 1000 patients), In symptomatic patients, it reduced cardiovascular deaths (8 (0 to 16) fewer per 1000 patients), but increased the risk of major bleeding (7 (3 to 14) more events per 1000). In asymptomatic patients, monotherapy reduced non-fatal strokes (5 (0 to 8) fewer per 1000), but had no other clinical benefit. Dual antiplatelet therapy caused more major bleeding after intervention than monotherapy (37 (8 to 102) more events per 1000), with very low-quality evidence of improved endovascular patency (risk ratio 4·00, 95 per cent c.i. 0·91 to 17·68).

Conclusion

Antiplatelet monotherapy has minimal clinical benefit for asymptomatic peripheral artery disease, and limited benefit for symptomatic disease, with a clear risk of major bleeding. There is a lack of evidence to guide antiplatelet prescribing after peripheral endovascular intervention.

Insufficient Reporting of Factors Associated With Exercise Referral Scheme Uptake, Attendance, and Adherence: A Systematic Review of Reviews

BACKGROUND

Exercise referral schemes (ERS) are prescribed programs to tackle physical inactivity and associated noncommunicable disease. Inconsistencies in reporting, recording, and delivering ERS make it challenging to identify what works, why, and for whom.

METHODS

Preferred Reporting Items for Systematic Reviews and Meta-Analyses guided this narrative review of reviews. Electronic databases were searched for systematic reviews of ERS. Inclusion criteria and quality assessed through A Measurement Tool to Assess Systematic Reviews (AMSTAR). Data on uptake, attendance, and adherence were extracted.

RESULTS

Eleven reviews met inclusion criteria. AMSTAR quality was medium. Uptake ranged between 35% and 81%. Groups more likely to take up ERS included (1) females and (2) older adults. Attendance ranged from 12% to 49%. Men were more likely to attend ERS. Effect of medical diagnosis upon uptake and attendance was inconsistent. Exercises prescribed were unreported; therefore, adherence to exercise prescriptions was unreported. The influence of theoretically informed approaches on uptake, attendance, and adherence was generally lacking; however, self-determination, peer support, and supervision were reported as influencing attendance.

CONCLUSIONS

There was insufficient reporting across studies about uptake, attendance, and adherence. Complex interventions such as ERS require consistent definitions, recording, and reporting of these key facets, but this is not evident from the existing literature.

Mediterranean diet and health outcomes: a systematic meta-review

Background

The Mediterranean diet (MeDi) is considered a healthy dietary pattern, and greater adherence to this diet may improve health status. It also may reduce the social and economic costs of diet-related illnesses. This meta-review aims to summarize, synthesize and organize the effects of MeDi pattern on different health outcomes.

Methods

This meta-review was performed following the PRISMA guidelines. A systematic search was conducted in the electronic databases PubMed, Web of Science and Scopus. Two researchers screened all the records to eliminate any duplicate, and they selected the articles to be fully reviewed. A third researcher was consulted to resolve discrepancies and so reach a consensus agreement.

Results

Thirty-three articles were included, nine were systematic reviews and twenty-four were meta-analyses. Most of the diseases analysed are catalogued as non-communicable diseases (NCD), and the impact of these in populations may have major financial consequences for healthcare spending and national income. The results showed that the MeDi may improve health status, and it also may reduce total lifetime costs.

Conclusion

MeDi has been shown to be a healthy dietary pattern that may reduce risk related to NCD. The effect is larger if the pattern is combined with physical activity, and tobacco and excessive alcohol consumption are avoided. Promoting the MeDi as a healthy dietary pattern presents challenges which need the collaboration of all levels of society.

Hypothyroidism and related diseases: a methodological quality assessment of meta-analysis

OBJECTIVES

There is an increasing prevalence of hypothyroidism and there is a growing body of meta-analyses (MAs) on the association between hypothyroidism and other diseases. However, the methodological quality of the MAs significantly varies. Thus, this study aimed to evaluate and summarise data on the methodological quality of MAs on the associations between hypothyroidism and other diseases using the Assessment of Multiple Systematic Reviews (AMSTAR) scale, providing suggestions for clinical decision-making processes.

DESIGN

To assess the methodological quality of MAs using the AMSTAR scale.

DATA SOURCES

A systematic literature search was performed in PubMed, EMBASE, the Cochrane Library, web of science and Chinese Biomedicine Literature Database.

ELIGIBILITY CRITERIA

We included MAs that had assessed the association between hypothyroidism and other diseases in humans and that had full texts regardless of the publication status. No restriction applied on language or date.

DATA EXTRACTION AND SYNTHESIS

Two reviewers independently screened the titles and abstracts of all searched literature to acquire potentially eligible publications. The full texts of possible eligible publications were downloaded and assessed. Inconsistent comments were resolved through discussions with a third reviewer.

RESULTS

52 studies were included. The average AMSTAR score of the included articles was 8.6 (range: 5-10), and those of English and Chinese MAs were 8.8 and 7.0, respectively. A total of 52 MAs were evaluated, and 19 (36.5%) and 33 (63.5%) of these MAs were of moderate and high quality, respectively. None of the MAs were of low quality. Only two MAs had an a priori design. Items 3, 5 and 9 had the highest compliance (50/52, 96.2%), and aside from item 1, items 7 and 8 had the lowest compliance (33/52,63.5%). According to the results of these MAs, hypothyroidism was significantly associated with cardiovascular diseases, metabolic diseases, neuropsychiatric disorders, breast cancer and pregnancy outcome.

CONCLUSIONS

The methodological quality of the included MAs on the association between hypothyroidism and other diseases was moderate to high. MAs with high qualities confirmed that hypothyroidism was significantly associated with cardiovascular diseases, metabolic syndrome, preterm birth and neonatal outcomes. Consideration of scientific quality when formulating conclusions should be made explicit and more attention should be paid to improving the methodological quality of MAs, and increasing their applicability for clinical decision-making.

Gray literature in systematic reviews on population health in the Middle East and North Africa: protocol of an overview of systematic reviews and evidence mapping

BACKGROUND

Systematic review (SR) guidelines recommend extending literature search to gray literature in order to identify all available data related to the review topic. We aim to conduct an overview of SRs on population health in the Middle East and North Africa (MENA), to assess the methodology of these SRs, to produce an evidence map highlighting methodological gaps in SRs regarding gray literature searching, and to aid in developing future SRs by listing gray literature sources related to population health in MENA.

METHODS/DESIGN

We will conduct an overview of SRs based on the Cochrane Handbook for Systematic Reviews of Interventions. This overview will be reported following PRISMA 2009 guidelines. Using comprehensive search criteria, we will search the PubMed database to identify relevant SRs published since 2008. Our primary outcomes are gray literature sources and study-level quality in the gray literature. We will include MENA countries with Arabic, English, French, and/or Urdu as primary official languages and/or media of instruction in universities. Two reviewers will independently conduct a multilevel screening on Rayyan software. Extraction of relevant data will be done on Statistical Package for the Social Sciences (SPSS) software. The methodological quality of included SRs will be assessed using the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Any disagreements will be resolved by discussion and consensus. We will estimate the overall proportion of SRs that used gray literature as one of their data sources. Subgroup analyses will be conducted to identify characteristics of these gray literature sources. Chi-squared and t tests will be used to determine whether the differences between subgroups are statistically significant. Additionally, an evidence gap map will be constructed to highlight characteristics and quality of the gray literature used in SRs on population health in MENA and emphasize existing gaps in gray literature searching. We will also list gray literature sources identified in the included SRs stratified by country and research topic.

DISCUSSION

This overview will comprehensively assess the overall quality of the SRs on population health issues in MENA. Our findings will contribute to the improvement of population health research practices in MENA.

SYSTEMATIC REVIEW REGISTRATION

The systematic review protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) on 26 October 2018 (registration number CRD42017076736 (Syst Rev 2:4, 2013).

What causes psychosis? An umbrella review of risk and protective factors

Psychosis is a heterogeneous psychiatric condition for which a multitude of risk and protective factors have been suggested. This umbrella review aimed to classify the strength of evidence for the associations between each factor and psychotic disorders whilst controlling for several biases. The Web of Knowledge database was searched to identify systematic reviews and meta-analyses of observational studies which examined associations between socio-demographic, parental, perinatal, later factors or antecedents and psychotic disorders, and which included a comparison group of healthy controls, published from 1965 to January 31, 2017. The literature search and data extraction followed PRISMA and MOOSE guidelines. The association between each factor and ICD or DSM diagnoses of non-organic psychotic disorders was graded into convincing, highly suggestive, suggestive, weak, or non-significant according to a standardized classification based on: number of psychotic cases, random-effects p value, largest study 95% confidence interval, heterogeneity between studies, 95% prediction interval, small study effect, and excess significance bias. In order to assess evidence for temporality of association, we also conducted sensitivity analyses restricted to data from prospective studies. Fifty-five meta-analyses or systematic reviews were included in the umbrella review, corresponding to 683 individual studies and 170 putative risk or protective factors for psychotic disorders. Only the ultra-high-risk state for psychosis (odds ratio, OR=9.32, 95% CI: 4.91-17.72) and Black-Caribbean ethnicity in England (OR=4.87, 95% CI: 3.96-6.00) showed convincing evidence of association. Six factors were highly suggestive (ethnic minority in low ethnic density area, second generation immigrants, trait anhedonia, premorbid IQ, minor physical anomalies, and olfactory identification ability), and nine were suggestive (urbanicity, ethnic minority in high ethnic density area, first generation immigrants, North-African immigrants in Europe, winter/spring season of birth in Northern hemisphere, childhood social withdrawal, childhood trauma, Toxoplasma gondii IgG, and non-right handedness). When only prospective studies were considered, the evidence was convincing for ultra-high-risk state and suggestive for urbanicity only. In summary, this umbrella review found several factors to be associated with psychotic disorders with different levels of evidence. These risk or protective factors represent a starting point for further etiopathological research and for the improvement of the prediction of psychosis.

The health and wellbeing needs of veterans: a rapid review

BACKGROUND

For the majority of serving members, life in the military has a positive effect on wellbeing. However, the type, intensity and duration of service, along with the transition from fulltime military to civilian life, may have a negative effect on veterans' wellbeing. Such negative consequences, alongside the growing veteran population, indicate the need for greater exploration of veterans' physical, mental and social wellbeing.

METHODS

The current paper reports on the findings of a rapid review of the literature on the health and wellbeing needs of veterans, commissioned by the Australian Department of Veterans' Affairs to inform future programs and services. The databases Embase, Medline, Cinahl, PubMed, Web of Science and Cochrane Database were searched for systematic reviews reporting on veterans' physical, mental and social wellbeing published in English in peer-reviewed journals.

RESULTS

A total of 21 systematic reviews were included. The reviews reported on a range of mental, physical and social health problems affecting veterans. While there was limited information on prevalence rates of physical, mental and social health problems in veterans compared to civilian populations, the reviews demonstrated the interconnection between these domains and the effect of demographic and military service factors.

CONCLUSIONS

A key finding of the review is the interconnection of the mental, physical, and social health of veterans, highlighting the importance that an integrated approach to veterans' wellbeing is adopted. It is suggested that understanding key factors, such as demographic factors and factors relating to military service, can support improved service provision for veterans.

Coffee consumption and health: umbrella review of meta-analyses of multiple health outcomes

Objectives To evaluate the existing evidence for associations between coffee consumption and multiple health outcomes.Design Umbrella review of the evidence across meta-analyses of observational and interventional studies of coffee consumption and any health outcome.Data sources PubMed, Embase, CINAHL, Cochrane Database of Systematic Reviews, and screening of references.Eligibility criteria for selecting studies Meta-analyses of both observational and interventional studies that examined the associations between coffee consumption and any health outcome in any adult population in all countries and all settings. Studies of genetic polymorphisms for coffee metabolism were excluded.Results The umbrella review identified 201 meta-analyses of observational research with 67 unique health outcomes and 17 meta-analyses of interventional research with nine unique outcomes. Coffee consumption was more often associated with benefit than harm for a range of health outcomes across exposures including high versus low, any versus none, and one extra cup a day. There was evidence of a non-linear association between consumption and some outcomes, with summary estimates indicating largest relative risk reduction at intakes of three to four cups a day versus none, including all cause mortality (relative risk 0.83 (95% confidence interval 0.79 to 0.88), cardiovascular mortality (0.81, 0.72 to 0.90), and cardiovascular disease (0.85, 0.80 to 0.90). High versus low consumption was associated with an 18% lower risk of incident cancer (0.82, 0.74 to 0.89). Consumption was also associated with a lower risk of several specific cancers and neurological, metabolic, and liver conditions. Harmful associations were largely nullified by adequate adjustment for smoking, except in pregnancy, where high versus low/no consumption was associated with low birth weight (odds ratio 1.31, 95% confidence interval 1.03 to 1.67), preterm birth in the first (1.22, 1.00 to 1.49) and second (1.12, 1.02 to 1.22) trimester, and pregnancy loss (1.46, 1.06 to 1.99). There was also an association between coffee drinking and risk of fracture in women but not in men.Conclusion Coffee consumption seems generally safe within usual levels of intake, with summary estimates indicating largest risk reduction for various health outcomes at three to four cups a day, and more likely to benefit health than harm. Robust randomised controlled trials are needed to understand whether the observed associations are causal. Importantly, outside of pregnancy, existing evidence suggests that coffee could be tested as an intervention without significant risk of causing harm. Women at increased risk of fracture should possibly be excluded.

Quality of systematic reviews and meta-analyses published in pediatric surgery

AIMS

Systematic reviews (SRs) and meta-analyses (MAs) studies may influence and direct surgical practice. Against this background we have analyzed the quality of systematic reviews and meta-analyses published in the specialty field of pediatric surgery using the Assessment of Multiple Systematic Reviews 11-item tool (AMSTAR).

METHODS

MEDLINE and EMBASE databases and the three major journals in pediatric surgery were searched for SRs and MAs in pediatric surgery. Studies involving predominantly adult populations were excluded. Two reviewers independently scored included studies against AMSTAR criteria and disagreements were resolved by consensus. A total rating of 4 or less was considered 'poor' methodological quality, 5-8 as 'fair to good' and 9 or greater as 'good'.

RESULTS

Original searching retrieved 1,281 articles. 126 articles were included for final analysis. Examining recent trends, 4 studies were published in 1995-2000 compared to 78 in 2011-2014. Using AMSTAR scoring criteria, 35 reviews (28%) were regarded as 'poor' in terms of methodological quality, 59 (47%) 'fair', and 32 (25%) 'good' quality. We observed no improvement in AMSTAR score before and after the development of the tool (mean score pre-2008 6.8, post-2008 5.9, p = 0.136).

CONCLUSIONS

Despite an increase in the number of SRs / MAs published in pediatric surgery, a quarter of all studies were considered poor in terms of their quality and scientific validity. Journals must define and apply minimum criteria to ensure pediatric surgeons seeking to publish high quality SRs / MAs achieve these requirements.

The relationship between childhood body weight and dental caries experience: an umbrella systematic review protocol

BACKGROUND

Obesity and dental caries are global public health problems which can impact in childhood and throughout the life course. In simple terms, childhood dental caries and body weight are linked via the common risk factor of diet. An association between dental caries and obesity has been described in a number of studies and reviews. However, similarly, a relationship has also been noted between low body weight and caries experience in children. This protocol will provide the framework for an umbrella review to address the following question: Does the available evidence support a relationship between dental caries experience and body weight in the child population?

METHODS

This review protocol outlines the process to carry out an umbrella systematic review which will synthesise previous reviews of childhood dental caries experience and body weight. An umbrella review methodology will be used to examine the methodological and reporting quality of existing reviews.

DISCUSSION

The final umbrella review aims to aggregate the available evidence in order to provide a summary for policymakers and to inform healthcare interventions.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42016047304.

Methodological quality and reporting of systematic reviews in hand and wrist pathology

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions.

LEVEL OF EVIDENCE

I.

Poor methodological quality and reporting standards of systematic reviews in burn care management

The methodological and reporting quality of burn-specific systematic reviews has not been established. The aim of this study was to evaluate the methodological quality of systematic reviews in burn care management. Computerised searches were performed in Ovid MEDLINE, Ovid EMBASE and The Cochrane Library through to February 2016 for systematic reviews relevant to burn care using medical subject and free-text terms such as 'burn', 'systematic review' or 'meta-analysis'. Additional studies were identified by hand-searching five discipline-specific journals. Two authors independently screened papers, extracted and evaluated methodological quality using the 11-item A Measurement Tool to Assess Systematic Reviews (AMSTAR) tool and reporting quality using the 27-item Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist. Characteristics of systematic reviews associated with methodological and reporting quality were identified. Descriptive statistics and linear regression identified features associated with improved methodological quality. A total of 60 systematic reviews met the inclusion criteria. Six of the 11 AMSTAR items reporting on 'a priori' design, duplicate study selection, grey literature, included/excluded studies, publication bias and conflict of interest were reported in less than 50% of the systematic reviews. Of the 27 items listed for PRISMA, 13 items reporting on introduction, methods, results and the discussion were addressed in less than 50% of systematic reviews. Multivariable analyses showed that systematic reviews associated with higher methodological or reporting quality incorporated a meta-analysis (AMSTAR regression coefficient 2.1; 95% CI: 1.1, 3.1; PRISMA regression coefficient 6·3; 95% CI: 3·8, 8·7) were published in the Cochrane library (AMSTAR regression coefficient 2·9; 95% CI: 1·6, 4·2; PRISMA regression coefficient 6·1; 95% CI: 3·1, 9·2) and included a randomised control trial (AMSTAR regression coefficient 1·4; 95%CI: 0·4, 2·4; PRISMA regression coefficient 3·4; 95% CI: 0·9, 5·8). The methodological and reporting quality of systematic reviews in burn care requires further improvement with stricter adherence by authors to the PRISMA checklist and AMSTAR tool.

"Assessing the methodological quality of systematic reviews in radiation oncology: A systematic review"

OBJECTIVE

The objective of our study was to evaluate the methodological quality of systematic reviews and meta-analyses in Radiation Oncology.

METHODS

A systematic literature search was conducted for all eligible systematic reviews and meta-analyses in Radiation Oncology from 1966 to 2015. Methodological characteristics were abstracted from all works that satisfied the inclusion criteria and quality was assessed using the critical appraisal tool, AMSTAR. Regression analyses were performed to determine factors associated with a higher score of quality.

RESULTS

Following exclusion based on a priori criteria, 410 studies (157 systematic reviews and 253 meta-analyses) satisfied the inclusion criteria. Meta-analyses were found to be of fair to good quality while systematic reviews were found to be of less than fair quality. Factors associated with higher scores of quality in the multivariable analysis were including primary studies consisting of randomized control trials, performing a meta-analysis, and applying a recommended guideline related to establishing a systematic review protocol and/or reporting.

CONCLUSIONS

Systematic reviews and meta-analyses may introduce a high risk of bias if applied to inform decision-making based on AMSTAR. We recommend that decision-makers in Radiation Oncology scrutinize the methodological quality of systematic reviews and meta-analyses prior to assessing their utility to inform evidence-based medicine and researchers adhere to methodological standards outlined in validated guidelines when embarking on a systematic review.

Evidence on multimorbidity from definition to intervention: An overview of systematic reviews

The increasing challenge of multiple chronic diseases (multimorbidity) requires more evidence-based knowledge and effective practice. In order to better understand the existing evidence on multimorbidity, we performed a systematic review of systematic reviews on multimorbidity with pre-established search strategies and exclusion criteria by searching multiple databases and grey literature. Of 8006 articles found, 53 systematic reviews (including meta-analysis and qualitative research synthesis performed in some reviews) that stated multimorbidity as the main focus were included, with 79% published during 2013-2016. Existing evidence on definition, measurement, prevalence, risk factors, health outcomes, clinical practice and medication (polypharmacy), and intervention and management were identified and synthesised. There were three major definitions from three perspectives. Seven studies on prevalence reported a range from 3.5% to 100%. As six studies showed, depression, hypertension, diabetes, arthritis, asthma, and osteoarthritis were prone to be comorbid with other conditions. Four groups of risk factors and eight multimorbidity associated outcomes were explored by five and six studies, respectively. Nine studies evaluated interventions, which could be categorized into either organizational or patient-oriented, the effects of these interventions were varied. Self-management process, priority setting and decision making in multimorbidity were synthesised by evidence from 4 qualitative systematic reviews. We were unable to draw solid conclusions from this overview due to the heterogeneity in methodology and inconsistent findings among included reviews. As suggested by all included studies, there is a need for prospective research, especially longitudinal cohort studies and randomized control trials, to provide more definitive evidence on multimorbidity.

Relationship between surgeon volume and outcomes: a systematic review of systematic reviews

BACKGROUND

The surgeon volume-outcome relationship has been discussed for many years and its existence or nonexistence is of importance for various reasons. A lot of empirical work has been published on it. We aimed to summarize systematic reviews in order to present current evidence.

METHODS

Medline, Embase, Cochrane database of systematic reviews (CDSR), and health technology assessment websites were searched up to October 2015 for systematic reviews on the surgeon volume-outcome relationship. Reviews were critically appraised, and results were extracted and synthesized by type of surgical procedure/condition.

RESULTS

Thirty-two reviews reporting on 15 surgical procedures/conditions were included. Methodological quality of included systematic reviews assessed with the assessment of multiple systematic reviews (AMSTAR) was generally moderate to high albeit included literature partly neglected considering methodological issues specific to volume-outcome relationship. Most reviews tend to support the presence of a surgeon volume-outcome relationship. This is most clear-cut in colorectal cancer, bariatric surgery, and breast cancer where reviews of high quality show large effects.

CONCLUSIONS

When taking into account its limitations, this overview can serve as an informational basis for decision makers. Our results seem to support a positive volume-outcome relationship for most procedures/conditions. However, forthcoming reviews should pay more attention to methodology specific to volume-outcome relationship. Due to the lack of information, any numerical recommendations for minimum volume thresholds are not possible. Further research is needed for this issue.

Methodological quality of meta-analyses of the diagnostic accuracy of depression screening tools

OBJECTIVE

Concerns have been raised that primary studies of diagnostic accuracy of depression screening tools may exaggerate estimates of accuracy and that this could also influence the results of meta-analyses. No studies, however, have evaluated the quality of meta-analyses of depression screening tools. Our objective was to evaluate the quality of meta-analyses of the diagnostic accuracy of depression screening tools.

METHODS

We searched MEDLINE and PsycINFO from January 1, 2005 through March 13, 2016 for recent meta-analyses in any language on the diagnostic accuracy of depression screening tools. Two reviewers independently assessed methodological quality using the AMSTAR tool with appropriate adaptations made for studies of diagnostic test accuracy.

RESULTS

We identified 21 eligible meta-analyses. The majority provided a list of included studies (100%), included a comprehensive literature search (95%) and assessed risk of bias of included studies (71%). Meta-analyses less consistently included non-published evidence (38%), listed excluded studies (33%), incorporated risk of bias findings into conclusions (33%), and assessed selective cutoff reporting (29%). Meta-analyses rarely reported that duplicate study selection or data extraction occurred (14%), mentioned 'a priori' protocols (10%), or reported on conflicts of interest (0%) or funding sources (0%) of primary studies. Only 6 of 21 included meta-analyses complied with at least 7 of 14 adapted AMSTAR items.

CONCLUSIONS

The methodological quality of most meta-analyses of the diagnostic test accuracy of depression screening tools is suboptimal. Improving quality will reduce the risk of inaccurate estimates of accuracy and inappropriate inferences.

Limitations of A Measurement Tool to Assess Systematic Reviews (AMSTAR) and suggestions for improvement

A Measurement Tool to Assess Systematic Reviews (AMSTAR) is a commonly used tool to assess the quality of systematic reviews; however, modifications are needed to improve its usability, reliability, and validity. In this commentary, we summarize our experience and the experiences of others who have used AMSTAR and provide suggestions for its improvement. We propose that AMSTAR should modify a number of individual items and their instructions and responses to make them more congruent with an assessment of the methodologic quality of systematic reviews. We recommend adding new items and modifying existing items to assess the quality of the body of evidence and to address subgroup and sensitivity analyses. More detailed instructions are needed for scoring individual items across multiple reviewers, and we recommend that a total score should not be calculated. These suggestions need to be empirically tested prior to implementation.

Are nurses well placed as care co-ordinators in primary care and what is needed to develop their role: a rapid review?

Care co-ordination is reported to be an effective component of chronic disease (CD) management within primary care. While nurses often perform this role, it has not been reported if they or other disciplines are best placed to take on this role, and whether the discipline of the co-ordinator has any impact on clinical and health service outcomes. We conducted a rapid review of previous systematic reviews from 2006 to 2013 to answer these questions with a view to informing improvements in care co-ordination programmes. Eighteen systematic reviews from countries with developed health systems comparable to Australia were included. All but one included complex interventions and 12 of the 18 involved a range of multidisciplinary co-ordination strategies. This multi-strategy and multidisciplinarity made it difficult to isolate which were the most effective strategies and disciplines. Nurses required specific training for these roles, but performed co-ordination more often than any other discipline. There was, however, no evidence that discipline had a direct impact on clinical or service outcomes, although specific expertise gained through training and workforce organisational support for the co-ordinator was required. Hence, skill mix is an important consideration when employing care co-ordination, and a sustained consistent approach to workforce change is required if nurses are to be enabled to perform effective care co-ordination in CD management in primary care.

Systematic review and critical appraisal of the impact of acellular dermal matrix use on the outcomes of implant-based breast reconstruction

BACKGROUND

Acellular dermal matrix (ADM) may improve outcomes in implant-based breast reconstruction (IBBR). The aim of this study was critically to appraise and evaluate the current evidence for ADM-assisted IBBR.

METHODS

Comprehensive electronic searches identified complete papers published in English between January 2000 and August 2013, reporting any outcome of ADM-assisted IBBR. All systematic reviews, randomized clinical trials (RCTs) and non-randomized studies (NRSs) with more than 20 ADM recipients were included. Studies were critically appraised using AMSTAR for systematic reviews, the Cochrane risk-of-bias tool for RCTs and its adaptation for NRSs. Characteristics and results of identified studies were summarized.

RESULTS

A total of 69 papers (8 systematic reviews, 1 RCT, 40 comparative studies and 20 case series) were identified, all of which were considered at high risk of bias, mostly due to patient selection and selective outcome reporting. The median ADM group sample size was 51.0 (i.q.r. 33.0-127.0). Most studies were single-centre (54), and they were often single-surgeon (16). ADM was most commonly used for immediate (40) two-stage IBBR (36) using human ADM (47), with few studies evaluating ADM-assisted single-stage procedures (10). All reported clinical outcomes (for example implant loss) and more than half of the papers (33) assessed process outcomes, but few evaluated cosmesis (16) or patient-reported outcomes (10). Heterogeneity between study design and, especially, outcome measurement precluded meaningful data synthesis.

CONCLUSION

Current evidence for the value of ADMs in IBBR is limited. Use in practice should therefore be considered experimental, and evaluation within registries or well designed and conducted studies, ideally RCTs, is recommended to prevent widespread adoption of a potentially inferior intervention.

Developing and refining the methods for a 'one-stop shop' for research evidence about health systems

BACKGROUND

Policymakers, stakeholders and researchers have not been able to find research evidence about health systems using an easily understood taxonomy of topics, know when they have conducted a comprehensive search of the many types of research evidence relevant to them, or rapidly identify decision-relevant information in their search results.

METHODS

To address these gaps, we developed an approach to building a 'one-stop shop' for research evidence about health systems. We developed a taxonomy of health system topics and iteratively refined it by drawing on existing categorization schemes and by using it to categorize progressively larger bundles of research evidence. We identified systematic reviews, systematic review protocols, and review-derived products through searches of Medline, hand searches of several databases indexing systematic reviews, hand searches of journals, and continuous scanning of listservs and websites. We developed an approach to providing 'added value' to existing content (e.g., coding systematic reviews according to the countries in which included studies were conducted) and to expanding the types of evidence eligible for inclusion (e.g., economic evaluations and health system descriptions). Lastly, we developed an approach to continuously updating the online one-stop shop in seven supported languages.

RESULTS

The taxonomy is organized by governance, financial, and delivery arrangements and by implementation strategies. The 'one-stop shop', called Health Systems Evidence, contains a comprehensive inventory of evidence briefs, overviews of systematic reviews, systematic reviews, systematic review protocols, registered systematic review titles, economic evaluations and costing studies, health reform descriptions and health system descriptions, and many types of added-value coding. It is continuously updated and new content is regularly translated into Arabic, Chinese, English, French, Portuguese, Russian, and Spanish.

CONCLUSIONS

Policymakers and stakeholders can now easily access and use a wide variety of types of research evidence about health systems to inform decision-making and advocacy. Researchers and research funding agencies can use Health Systems Evidence to identify gaps in the current stock of research evidence and domains that could benefit from primary research, systematic reviews, and review overviews.

Systematic review found AMSTAR, but not R(evised)-AMSTAR, to have good measurement properties

OBJECTIVES

To summarize all available evidence on measurement properties in terms of reliability, validity, and feasibility of the Assessment of Multiple Systematic Reviews (AMSTAR) tool, including R(evised)-AMSTAR.

STUDY DESIGN AND SETTING

MEDLINE, EMBASE, Psycinfo, and CINAHL were searched for studies containing information on measurement properties of the tools in October 2013. We extracted data on study characteristics and measurement properties. These data were analyzed following measurement criteria.

RESULTS

We included 13 studies, four of them were labeled as validation studies. Nine articles dealt with AMSTAR, two articles dealt with R-AMSTAR, and one article dealt with both instruments. In terms of interrater reliability, most items showed a substantial agreement (>0.6). The median intraclass correlation coefficient (ICC) for the overall score of AMSTAR was 0.83 (range 0.60-0.98), indicating a high agreement. In terms of validity, ICCs were very high with all but one ICC lower than 0.8 when the AMSTAR score was compared with scores from other tools. Scoring AMSTAR takes between 10 and 20 minutes.

CONCLUSION

AMSTAR seems to be reliable and valid. Further investigations for systematic reviews of other study designs than randomized controlled trials are needed. R-AMSTAR should be further investigated as evidence for its use is limited and its measurement properties have not been studied sufficiently. In general, test-retest reliability should be investigated in future studies.