A guide and pragmatic considerations for applying GRADE to network meta-analysis

Benefits and Harms of Procalcitonin- or C-Reactive Protein-Guided Antimicrobial Discontinuation in Critically Ill Adults With Sepsis: A Systematic Review and Network Meta-Analysis

OBJECTIVES

In sepsis treatment, antibiotics are crucial, but overuse risks development of antibiotic resistance. Recent guidelines recommended the use of procalcitonin to guide antibiotic cessation, but solid evidence is insufficient. Recently, concerns were raised that this strategy would increase recurrence. Additionally, optimal protocol or difference from the commonly used C-reactive protein (CRP) are uncertain. We aimed to compare the effectiveness and safety of procalcitonin- or CRP-guided antibiotic cessation strategies with standard of care in sepsis.

DATA SOURCES

A systematic search of PubMed, Embase, CENTRAL, Igaku Chuo Zasshi, ClinicalTrials.gov, and World Health Organization International Clinical Trials Platform.

STUDY SELECTION

Randomized controlled trials involving adults with sepsis in intensive care.

DATA EXTRACTION

A systematic review with network meta-analyses was performed. The Grading of Recommendations, Assessments, Developments, and Evaluation method was used to assess certainty.

DATA SYNTHESIS

Eighteen studies involving 5023 participants were included. Procalcitonin-guided and CRP-guided strategies shortened antibiotic treatment (-1.89 days [95% CI, -2.30 to -1.47], -2.56 days [95% CI, -4.21 to -0.91]) with low- to moderate-certainty evidence. In procalcitonin-guided strategies, this benefit was consistent even in subsets with shorter baseline antimicrobial duration (7-10 d) or in Sepsis-3, and more pronounced in procalcitonin cutoff of "0.5 μg/L and 80% reduction." No benefit was observed when monitoring frequency was less than half of the initial 10 days. Procalcitonin-guided strategies lowered mortality (-27 per 1000 participants [95% CI, -45 to -7]) and this was pronounced in Sepsis-3, but CRP-guided strategies led to no difference in mortality. Recurrence did not increase significantly with either strategy (very low to low certainty).

CONCLUSIONS

In sepsis, procalcitonin- or CRP-guided antibiotic discontinuation strategies may be beneficial and safe. In particular, the usefulness of procalcitonin guidance for current Sepsis-3, where antimicrobials are used for more than 7 days, was supported. Well-designed studies are needed focusing on monitoring protocol and recurrence.

Comparative Efficacy and Acceptability of Treatment Strategies for Antipsychotic-Induced Akathisia: A Systematic Review and Network Meta-analysis

BACKGROUND

Antipsychotics are the treatment of choice for schizophrenia, but they often induce akathisia. However, comparative efficacy of treatment strategies for akathisia remains unclear.

DESIGN

We performed a systematic review and network meta-analyses (PROSPERO CRD42023450720). We searched multiple databases on July 24, 2023. We included randomized clinical trials comparing 1 or more treatment strategies for antipsychotic-induced akathisia against each other or control conditions. We included adults with schizophrenia or other psychiatric disorders treated with antipsychotics. The primary outcome was akathisia severity at posttreatment. Secondary outcomes included akathisia response, all-cause dropout, psychotic symptoms, and long-term akathisia severity. We synthesized data in random effects frequentist network meta-analyses and assessed confidence in the evidence using CINeMA.

RESULTS

We identified 19 trials with 661 randomized participants (mean age 35.9 [standard deviation 12.0]; 36.7% [195 of 532] women). No trials examined dose reduction or switching of antipsychotics. Findings suggested 5-HT2A antagonists (k = 6, n = 108; standardized mean difference [SMD] -1.07 [95% confidence interval, -1.42; -0.71]) and beta-blockers (k = 8, n = 105; SMD -0.46 [-0.85; -0.07]) may improve akathisia severity, but confidence in the evidence was deemed low. We also found that benzodiazepines (k = 2, n = 13; SMD -1.62 [-2.64; -0.59]) and vitamin B6 (k = 3, n = 67; SMD -0.99 [-1.49; -0.50]) might also be beneficial, but confidence in the evidence was very low. Analyses of secondary outcomes did not provide additional insights.

CONCLUSIONS

Our findings suggest that 5-HT2A antagonists, beta-blockers, and with a lesser certainty, benzodiazepines, and vitamin B6 might improve akathisia. Given the low to very low confidence in the evidence of add-on agents and the absence of evidence of their long-term efficacy, careful consideration of side effects is warranted. These recommendations are extremely preliminary and further trials are needed.

The efficacy and safety of Xiao-Ban-Xia-Tang in the treatment of chemotherapy-induced nausea and vomiting: A systematic review and meta-analysis

Background

Chemotherapy-induced nausea and vomiting (CINV) is one of the most frequent and critical side effects due to chemotherapeutics. In China, Xiao-Ban-Xia-Tang (XBXT) has already been applied extensively to prevent and treat CINV. However, there is limited testimony on the effectiveness and safety of this purpose, and there was no correlative systematic review. The aim of this review was to systematically evaluate the effectiveness and safety of XBXT in preventing and treating CINV.

Methods

The systematic search was conducted in eight databases to acquire randomized controlled trials (RCTs) that appraised the effect of XBXT in treating CINV. The vomiting and nausea relief efficiency, eating efficiency, quality of life, and adverse reactions were explored for efficacy assessment. Bias risk was rated by manipulating the Cochrane risk of bias tool 2.0 (RoB 2). The retrieved investigations were analyzed by utilizing ReviewManager 5.4 and Stata 17.0. The quality of evidence was evaluated adopting the GRADE tool.

Results

A total of 16 clinical RCTs of XBXT in the treatment of CINV were incorporated into the investigation, with a total of 1246 participants. The meta-analysis showed that compared with conventional antiemetic drugs, XBXT and antiemetics improved the vomiting relief efficiency (RR 1.35, 95% confidence interval: 1.25-1.46, p < 0.00001), nausea relief efficiency (N = 367, RR 1.23, 95% CI: 1.09-1.38, p < 0.00001), and quality of life (RR = 1.37, 95% CI: 1.14-1.65, p = 0.0009) and reduced the adverse events (N = 370, RR 0.53, 95% CI: 0.29-0.96, p = 0.04). XBXT and DARAs raised eating efficiency compared with DARAs (N = 208, RR 1.30, 95% CI: 1.07-1.57, p = 0.007). The data existed as statistically significant, and the publication bias was identified as relatively low from the funnel plot and trim and fill analysis. In addition, sensitivity analysis demonstrated robust outcomes. The quality of evidence for each outcome ranged from moderate to high.

Conclusion

There is some encouraging evidence that XBXT and antiemetics had better therapeutic effects and safety in treating CINV than antiemetic drugs alone. The quality assessment and low publication bias indicated that the overall criterion was scientific. Better research is required to verify the evidence designed with large-scale RCTs and rigorous methods.

Systematic Review Registration: https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=281046.

The effects of nonpharmacological sleep hygiene on sleep quality in nonelderly individuals: A systematic review and network meta-analysis of randomized controlled trials

The prevalence of locomotive syndrome naturally increases with age, but approximately half of nonelderly individuals also meet the criteria for locomotive syndrome, suggesting that even younger people need to pay attention to their own health status. Sleep is important for physical, cognitive, and psychological health. Some individuals with poor sleep quality may be at risk of developing negative health status. Although the effects of sleep hygiene strategies for elderly individuals have been well investigated, optimal nonpharmacological sleep hygiene strategies for improving sleep quality in nonelderly individuals has not been identified. We conducted a systematic review and network meta-analysis (NMA) of randomized controlled trials aimed to elucidate the effects of various nonpharmacological interventions on sleep quality in nonelderly individuals and to identify the optimal intervention. Cochrane Central Register of Controlled Trials, Medline, Cumulative Index to Nursing and Allied Health Literature, Physiotherapy Evidence Database, and Scopus were comprehensively searched. We identified 27 studies focusing on the effects of various nonpharmacological sleep hygiene strategies in nonelderly individuals, and 24 studies were applied into NMA. The present results showed that resistance training was the most effective intervention for improving sleep quality in nonelderly individuals. In addition, this study revealed the effects of nonpharmacological interventions, such as physical activity, nutritional intervention, as well as exercise interventions. This is the first report that utilized NMA to compare the effects of various nonpharmacological interventions on sleep quality in nonelderly individuals.

A Systematic Literature Review on Inflammatory Markers in the Saliva of Patients with Multiple Sclerosis: A Cause or a Consequence of Periodontal Diseases

Background and Objectives: Multiple sclerosis (MS) is a chronic neurodegenerative disease often linked with systemic conditions such as periodontal diseases (PDs). This systematic review aims to explore the association between inflammatory markers in saliva and PDs in MS patients, assessing the use of saliva as a non-invasive tool to monitor disease progression. Materials and Methods: 82 publications were examined after a thorough search of scholarly databases to determine whether inflammatory markers were present in MS patients and whether they were associated with periodontal disease (PD). Quality and bias were assessed using the Newcastle-Ottawa Scale, resulting in eight articles that were thoroughly analyzed. Results: The results point to a strong correlation between MS and periodontal disorders, which may point to the same pathophysiological mechanism. It does, however, underscore the necessity of additional study to determine a definitive causal association. Conclusions: The findings indicate a strong association between MS and PDs, likely mediated by systemic inflammatory responses detectable in saliva. The review highlights the importance of oral health in managing MS and supports the utility of saliva as a practical, non-invasive medium for monitoring systemic inflammation. Further research is necessary to confirm the causal relationships and to consider integrating salivary diagnostics into routine clinical management for MS patients.

Vibration of effects resulting from treatment selection in mixed-treatment comparisons: a multiverse analysis on network meta-analyses of antidepressants in major depressive disorder

OBJECTIVE

It is frequent to find overlapping network meta-analyses (NMAs) on the same topic with differences in terms of both treatments included and effect estimates. We aimed to evaluate the impact on effect estimates of selecting different treatment combinations (ie, network geometries) for inclusion in NMAs.

DESIGN

Multiverse analysis, covering all possible NMAs on different combinations of treatments.

SETTING

Data from a previously published NMA exploring the comparative effectiveness of 22 treatments (21 antidepressants and a placebo) for the treatment of acute major depressive disorder.

PARTICIPANTS

Cipriani et al explored a dataset of 116 477 patients included in 522 randomised controlled trials.

MAIN OUTCOME MEASURES

For each possible treatment selection, we performed an NMA to estimate comparative effectiveness on treatment response and treatment discontinuation for the treatments included (231 between-treatment comparisons). The distribution of effect estimates of between-treatment comparisons across NMAs was computed, and the direction, magnitude and statistical significance of the 1st and 99th percentiles were compared.

RESULTS

4 116 254 different NMAs concerned treatment response. Among possible network geometries, 172/231 (74%) pairwise comparisons exhibited opposite effects between the 1st and 99th percentiles, 57/231 (25%) comparisons exhibited statistically significant results in opposite directions, 118 of 231 (51%) comparisons derived results that were both significant and non-significant at 5% risk and 56/231 (24%) treatment pairs obtained consistent results with only significant differences (or only non-significant differences) at 5% risk. Comparisons based on indirect evidence only were associated with greater variability in effect estimates. Comparisons with small absolute values observed in the complete NMA more frequently obtained statistically significant results in opposite directions. Similar results were observed for treatment discontinuation.

CONCLUSION

In this multiverse analysis, we observed that the selection of treatments to be included in an NMA could have considerable consequences on treatment effect estimations.

TRIAL REGISTRATION

https://osf.io/mb5dy.

Understanding the certainty of evidence from systematic reviews in rehabilitation science: what do clinicians need to know about GRADE?

PURPOSE

Systematic reviews of interventions are published each year evaluating rehabilitation approaches such as exercise, manual therapy, or electrotherapy. Currently, important methodological approaches are available to make systematic reviews more robust and transparent. One of these approaches is the Grading of Recommendation, Assessment, Development, and Evaluation (GRADE) system.

MATERIAL AND METHODS

A perspective for rehabilitation was conducted aiming to (1) shed light on the meaning and relevance of the GRADE system in systematic reviews with meta-analysis of rehabilitation science, and (2) propose suggestions for helping clinicians improve the interpretation of the GRADE findings.

RESULTS

The meaning and relevance of GRADE in rehabilitation science was discussed. Suggestions were proposed to help clinicians in the interpretation of the GRADE findings. We discussed the use of meta-analyses, meta-regressions, subgroups meta-analyses, and sensitivity analyses to increase the objectivity of the domains of GRADE. Finally, a future agenda was provided.

CONCLUSION

The use of GRADE is essential for improving the synthesis of evidence that clinicians may often use in rehabilitation practice. However, GRADE is only one hallmark when the findings of systematic reviews are interpreted. The issues of sample size, futile research, pre-registration, switching outcomes, or narrative bias should be also considered.

Effectiveness of Fludrocortisone Plus Hydrocortisone versus Hydrocortisone Alone in Septic Shock: A Systematic Review and Network Meta-Analysis of Randomized Controlled Trials

Rationale: The use of hydrocortisone in adult patients with septic shock is controversial, and the effectiveness of adding fludrocortisone to hydrocortisone remains uncertain. Objectives: To assess the comparative effectiveness and safety of fludrocortisone plus hydrocortisone, hydrocortisone alone, and placebo or usual care in adults with septic shock. Methods: A systematic review and a Bayesian network meta-analysis of peer-reviewed randomized trials were conducted. The primary outcome was all-cause mortality at last follow-up. Treatment effects are presented as relative risks (RRs) with 95% credible intervals (CrIs). Placebo or usual care was the reference treatment. Measurements and Main Results: Among 7,553 references, we included 17 trials (7,688 patients). All-cause mortality at last follow-up was lowest with fludrocortisone plus hydrocortisone (RR, 0.85; 95% CrI, 0.72-0.99; 98.3% probability of superiority, moderate-certainty evidence), followed by hydrocortisone alone (RR, 0.97; 95% CrI, 0.87-1.07; 73.1% probability of superiority, low-certainty evidence). The comparison of fludrocortisone plus hydrocortisone versus hydrocortisone alone was based primarily on indirect evidence (only two trials with direct evidence). Fludrocortisone plus hydrocortisone was associated with a 12% lower risk of all-cause mortality compared with hydrocortisone alone (RR, 0.88; 95% CrI, 0.74-1.03; 94.2% probability of superiority, moderate-certainty evidence). Conclusions: In adult patients with septic shock, fludrocortisone plus hydrocortisone was associated with lower risk of all-cause mortality at last follow-up than placebo and hydrocortisone alone. The scarcity of head-to-head trials comparing fludrocortisone plus hydrocortisone versus hydrocortisone alone led our network meta-analysis to rely primarily on indirect evidence for this comparison. Although we undertook several sensitivity analyses and assessments, these findings should be considered while also acknowledging the heterogeneity of included trials.

Pharmacological prevention of bone loss and fractures following solid organ transplantations: Protocol for a systematic review and network meta-analysis

INTRODUCTION

Solid organ transplant (SOT) recipients can experience bone loss caused by underlying conditions and the use of immunosuppressants. As a result, SOT recipients are at risk for decreased bone mineral density (BMD) and increased fracture incidences. We propose a network meta-analysis (NMA) that incorporates all available randomized control trial (RCT) data to provide the most comprehensive ranking of anti-osteoporotic interventions according to their ability to decrease fracture incidences and increase BMD in SOT recipients.

METHODS

We will search MEDLINE, EMBASE, Web of Science, CINAHL, CENTRAL and CNKI for relevant RCTs that enrolled adult SOT recipients, assessed anti-osteoporotic therapies, and reported relevant outcomes. Title and full-text screening as well as data extraction will be performed in-duplicate. We will report changes in BMD as weighted or standardized mean differences, and fracture incidences as risk ratios. SUCRA scores will be used to provide rankings of interventions, and quality of evidence will be examined using RoB2 and CINeMA.

DISCUSSIONS

To our knowledge, this systematic review and NMA will be the most comprehensive quantitative analysis regarding the management of bone loss and fractures in SOT recipients. Our analysis should be able to provide physicians and patients with an up-to-date recommendation for pharmacotherapies in reducing incidences of bone loss and fractures associated with SOT. The findings of the NMA will be disseminated in a peer-reviewed journal.

Aerobic exercise interventions for promoting cardiovascular health and mobility after stroke: a systematic review with Bayesian network meta-analysis

OBJECTIVE

To determine the superiority of aerobic exercise (AE) interventions on key outcomes of stroke recovery, including cardiorespiratory fitness (V̇O2peak, primary outcome), systolic blood pressure (SBP) and mobility (6 min Walk Test (6MWT) distance and 10 m Usual Gait Speed) after stroke.

DATA SOURCES

MEDLINE, EMBASE, Web of Science, CINAHL, CENTRAL, SPORTDiscus, PsycINFO and AMED Allied and Complementary Medicine were searched from inception to February 2023.

ELIGIBILITY CRITERIA

Randomised controlled trials were included that compared the effects of any AE interventions (low-intensity, moderate-intensity, high-intensity continuous training (HICT), high-intensity interval training (HIIT)) to no exercise, usual care or other AE interventions in individuals poststroke.

ANALYSES

Systematic review with Bayesian network meta-analysis (NMA) methodology was employed. Surface under the cumulative ranking curve (SUCRA) values were used to rank interventions. The Grading of Recommendations, Assessment, Development and Evaluation minimally contextualised framework for NMA was followed.

RESULTS

There were 28 studies (n=1298) included in the NMA for V̇O2peak, 11 (n=648) for SBP, 28 (n=1494) for 6MWT and 18 (n=775) for the 10 m Usual Gait Speed. The greatest effect on V̇O2peak, 6MWT and 10 m Usual Gait Speed was observed after HIIT and HICT. No differences between interventions were found for SBP. SUCRA values identified HIIT as the superior AE intervention for all outcomes of interest. HIIT was the most effective intervention for improving V̇O2peak (2.9 mL/kg/min (95% credible interval 0.8 to 5.0) moderate certainty) compared with usual care.

CONCLUSION

This NMA suggests that higher-intensity AE is superior to traditional low-intensity to moderate-intensity AE for improving outcomes after stroke.

The use of network meta-analysis in updating WHO living maternal and perinatal health recommendations

Drawing on two recent examples of WHO living guidelines in maternal and perinatal health, this paper elucidates a pragmatic, stepwise approach to using network meta-analysis (NMA) in guideline development in the presence of multiple treatment options. NMA has important advantages. These include the ability to compare multiple interventions in a single coherent analysis, provide direct estimates of the relative effects of all available interventions, infer indirect effect estimates for interventions not directly compared and generate rankings of the available treatment options. It can be difficult to harness these advantages in the face of a lack of current guidance on using NMA evidence in guideline development, with several challenges emerging. Challenges include the choice of conceptual approach, the volume and complexity of the evidence, the contribution of treatment rankings, and the fact that the preferable treatment is not always obvious. This paper describes a layered approach to resolving these challenges, which supports systematic guideline decision-making and development of trustworthy clinical guidelines when multiple treatment options are available.