Network meta-analysis: a technique to gather evidence from direct and indirect comparisons

Temporal effectiveness of interventions to improve medication adherence: A network meta-analysis

Introduction

Adherence-enhancing interventions have been assessed in the literature, however heterogeneity and conflicting findings have prohibited a consensus on the most effective approach to maintain adherence over time. With the ageing population and growth of chronic conditions, evaluation of sustainable strategies to improve and maintain medication adherence long term is paramount. We aimed to determine the comparative effectiveness of interventions for improving medication adherence over time among adults with any clinical condition.

Materials and methods

Meta-analyses evaluating interventions to improve medication adherence were searched in PubMed in January 2019 and reviewed for primary studies. Experimental studies with a comparison group assessing an intervention to enhance medication adherence in adult patients with reported adherence outcomes were included. Two authors extracted data for study characteristics, interventions and adherence outcomes. Interventions were categorized into four groups or combinations: educational, attitudinal, technical and rewards. Four network meta-analyses were performed to compare interventions based on patient follow-up time. Medication adherence effect sizes were reported as odds ratios (OR) with a 95% credibility interval (CrI) and surface under the cumulative ranking curve (SUCRA) to allow ranking probabilities. Risk of bias was assessed as per Cochrane guidelines.

Results

Data was obtained from 69 meta-analyses with 468 primary studies being included in qualitative synthesis. The four networks compromised of 249 studies in total (0–3 month follow-up: 99 studies, 4–6 months: 104, 7–9 months: 18, ≥10 months: 94). Interventions showing success in follow-ups of less than 10 months varied across time. Significant effects compared to standard of care (SOC) were found in technical (4–6 months: OR 0.34, 95% CrI 0.25–0.45) and attitudinal interventions (7–9 months: 0.37, 0.17–0.84). Multicomponent interventions demonstrated effectiveness compared to standard of care with an additive effect displayed, particularly in longer follow-ups (educational + attitudinal + technical interventions ≥10 months: OR 0.49, 95% CrI 0.27–0.88).

Discussion

All interventions reviewed improved medication adherence compared to standard of care. Multicomponent interventions displayed the most promising results in maintenance of long-term medication adherence. Technical and reward components enhanced adherence on a short-term basis, while educational and attitudinal interventions evolved over time to be more effective in follow-ups greater than 7 months. Sustainability of adherence to medications over time is dependent upon multicomponent interventions including educational, attitudinal and technical aspects to modify and enhance patient medication-taking behavior. Future research should focus on the most cost-effective approaches able to be integrated into routine practice.

Assessment of Reported Comparative Effectiveness and Safety of Atypical Antipsychotics in the Treatment of Behavioral and Psychological Symptoms of Dementia: A Network Meta-analysis

IMPORTANCE

Atypical antipsychotics offer modest effectiveness compared with placebo but with serious safety risks, including a boxed warning for the risk of death in the treatment of behavioral and psychological symptoms of dementia (BPSD). Their comparative effectiveness and safety are not fully known.

OBJECTIVE

To assess the relative benefits and safety of atypical antipsychotics in the treatment of BPSD shown in randomized clinical trials using network meta-analysis.

DATA SOURCES

PubMed/MEDLINE, Embase, PsychINFO, and Cochrane Library were searched from their inception until May 31, 2018. Key terms included dementia and atypical antipsychotics.

STUDY SELECTION

Randomized clinical trials comparing any atypical antipsychotic with another atypical antipsychotic or with placebo were included in the analysis.

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers used a standardized data extraction and quality assessment form. Random-effects network meta-analyses were performed. Effect sizes were reported as standardized mean differences (SMDs) for continuous outcomes and odds ratios (ORs) for dichotomous outcomes with 95% CIs. In addition to ORs, the surface under the cumulative ranking curve (SUCRA) was ascertained, which represents the percentage of the effectiveness or safety for each treatment compared with a hypothetical treatment that would be ranked first without uncertainty.

MAIN OUTCOMES AND MEASURES

The primary effectiveness outcome assessed was the Neuropsychiatric Inventory (NPI); secondary effectiveness outcomes were the Brief Psychiatric Rating Scale (BPRS) and Cohen-Mansfield Agitation Inventory (CMAI). The primary safety outcomes were death and cerebrovascular adverse events (CVAEs). Secondary safety outcomes were extrapyramidal signs/symptoms; somnolence/sedation; falls, fracture, or injury; and urinary tract infection/incontinence.

RESULTS

Seventeen studies (5373 patients) were included. The mean (SD) age of all participants was 80.8 (3.1) years, and most were women (3748 [69.8%]). Compared with placebo, aripiprazole was associated with improvement in outcomes on the NPI (SMD, -0.17; 95% CI, -0.31 to -0.02), BPRS (SMD, -0.20; 95% CI, -0.35 to -0.05), and CMAI (SMD, -0.30; 95% CI, -0.55 to -0.05); quetiapine was associated with improvement in outcomes on the BPRS (SMD, -0.24; 95% CI, -0.46 to -0.01), and risperidone was associated with improvement in outcomes on the CMAI (SMD, -0.26; 95% CI, -0.37 to -0.15). Differences between atypical antipsychotics were not significant for effectiveness, death, or CVAE. Compared with placebo, risperidone (OR, 3.85; 95% CI, 1.55-9.55) and olanzapine (OR, 4.28; 95% CI, 1.26-14.56) were associated with increased risk of CVAEs. The SUCRA estimated relative ranking of treatments suggested that aripiprazole might be the most effective and safe atypical antipsychotic and that olanzapine provides the least benefit overall; however, these results should be interpreted with caution where point estimates (OR and SMD) show that there is no statistically significant difference.

CONCLUSIONS AND RELEVANCE

This network meta-analysis supports the existence of a trade-off between the effectiveness and safety of atypical antipsychotics in the treatment of BPSD and confirms that a single most effective and safe treatment option does not exist. Clinicians should individualize the assessment of safety risks against expected benefits when prescribing these medications to patients with dementia.

Protocol for a systematic literature review and network meta-analysis of the clinical benefit of inhaled maintenance therapies in chronic obstructive pulmonary disease

INTRODUCTION

Chronic obstructive pulmonary disease (COPD) exacerbations progress the course of disease and impair lung function. Inhaled maintenance therapy reduces exacerbations. It is not yet established which inhaled therapy combination is best to reduce exacerbations, lung function decline and symptom burden.

METHODS AND ANALYSIS

MEDLINE, EMBASE and the Cochrane Library will be searched for articles between January 2011 and May 2018 using a pre-specified search strategy. Conference proceedings will be searched. Systematic reviews (with or without meta-analysis), randomised controlled trials (RCTs), cohort studies and case controlled studies comparing six interventions comprising different combinations of long-acting bronchodilators and inhaled corticosteroids in unison or on their own. The primary outcome is the reduction in moderate-to-severe exacerbations. Secondary outcomes include: lung function, quality of life, mortality and other adverse events. Titles and abstracts will screened by the primary researcher. A second reviewer will repeat this on a proportion of records. The Population, Intervention, Comparator, Outcomes and Study framework will be used for data extraction. A network meta-analyses of outcomes from RCTs and real-world evidence will be integrated if feasible. The 95% credible interval will be used to assess the statistical significance of each summary effect. Ranking of interventions will be based on their surface under cumulative ranking area.

ETHICS AND DISSEMINATION

COPD exacerbations are burdensome to patients. We aim to report results that provide clinicians with a more informed choice of which inhaled therapy combinations are best to reduce exacerbations, improve disease burden and reduce lung function and exercise capacity decline, compared with the potential harms, in certain populations with COPD.

PROSPERO REGISTRATION NUMBER

CRD42018088013.

Description of network meta-analysis geometry: A metrics design study

Background

The conduction and report of network meta-analysis (NMA), including the presentation of the network-plot, should be transparent. We aimed to propose metrics adapted from graph theory and social network-analysis literature to numerically describe NMA geometry.

Methods

A previous systematic review of NMAs of pharmacological interventions was performed. Data on the graph’s presentation were collected. Network-plots were reproduced using Gephi 0.9.1. Eleven geometric metrics were tested. The Spearman test for non-parametric correlation analyses and the Bland-Altman and Lin’s Concordance tests were performed (IBM SPSS Statistics 24.0).

Results

From the 477 identified NMAs only 167 graphs could be reproduced because they provided enough information on the plot characteristics. The median nodes and edges were 8 (IQR 6–11) and 10 (IQR 6–16), respectively, with 22 included studies (IQR 13–35). Metrics such as density (median 0.39, ranged 0.07–1.00), median thickness (2.0, IQR 1.0–3.0), percentages of common comparators (median 68%), and strong edges (median 53%) were found to contribute to the description of NMA geometry. Mean thickness, average weighted degree and average path length produced similar results than other metrics, but they can lead to misleading conclusions.

Conclusions

We suggest the incorporation of seven simple metrics to report NMA geometry. Editors and peer-reviews should ensure that guidelines for NMA report are strictly followed before publication.

What have we learned from network meta-analyses applied to critical care?

It is widely accepted in modern medicine that medical decisions must be supported by scientific evidence. Identifying the best intervention when several options are available constitute a great challenge for every clinician. Traditional meta-analysis (TMA) allows summarizing evidence from studies that compare the same two interventions for one event (head to head studies or direct comparisons). Network meta-analysis (NMA) is a relatively new procedure that allows to compare multiple interventions for one event, even when non-head to head studies have been conducted (indirect evidence). Other advantages of NMA include increasing the accuracy of the results and ranking all the interventions according to their effectiveness. These features are of paramount importance as: 1) they summarize information from events (e.g. diseases or outcomes) that has more than two possible interventions (e.g. treatments or procedures); 2) they strengthen the level of guideline recommendations; and 3) they identify new hypotheses based on indirect comparison. As this is a narrative review, all manuscripts have been selected from PubMed according to our best knowledge with the aim to illustrate different features, options or applications of NMA in critical care. First, we provide a description of the usefulness, interpretation, assumptions and main plots related to NMAs. Second, we analyzed some examples of NMAs related to critical care medicine. Third, we include a pragmatic approach about how results from NMAs can improve the clinical practice as well an R script with a database to conduct an NMAs and reproduce figures and tables that have been shown here. As a conclusion, NMA is an established, robust, objective and reproducible statistic technique that has been applied to several critical care areas. Clinical practice guidelines have started to include NMA evidence to support their recommendations. In future years, it seems highly probable that this technique will increase it applicability in almost all areas of critical care medicine.

Brain Microdialysate Monoamines in Relation to Circadian Rhythms, Sleep, and Sleep Deprivation - a Systematic Review, Network Meta-analysis, and New Primary Data

Disruption of the monoaminergic system, e.g. by sleep deprivation (SD), seems to promote certain diseases. Assessment of monoamine levels over the circadian cycle, during different sleep stages and during SD is instrumental to understand the molecular dynamics during and after SD. To provide a complete overview of all available evidence, we performed a systematic review. A comprehensive search was performed for microdialysis and certain monoamines (dopamine, serotonin, noradrenaline, adrenaline), certain monoamine metabolites (3,4-dihydroxyphenylacetic acid (DOPAC), 5-hydroxyindoleacetic acid (5-HIAA)) and a precursor (5-hydroxytryptophan (5-HTP)) in PubMed and EMBASE. After screening of the search results by two independent reviewers, 94 publications were included. All results were tabulated and described qualitatively. Network-meta analyses (NMAs) were performed to compare noradrenaline and serotonin concentrations between sleep stages. We further present experimental monoamine data from the medial prefrontal cortical (mPFC). Monoamine levels varied with brain region and circadian cycle. During sleep, monoamine levels generally decreased compared to wake. These qualitative observations were supported by the NMAs: noradrenaline and serotonin levels decreased from wakefulness to slow wave sleep and decreased further during Rapid Eye Movement sleep. In contrast, monoamine levels generally increased during SD, and sometimes remained high even during subsequent recovery. Decreases during or after SD were only reported for serotonin. In our experiment, SD did not affect any of the mPFC monoamine levels. Concluding, monoamine levels vary over the light-dark cycle and between sleep stages. SD modifies the patterns, with effects sometimes lasting beyond the SD period.

Effectiveness of artificial pancreas in the non-adult population: A systematic review and network meta-analysis

OBJECTIVE

Artificial pancreas is a technology that minimizes user input by bridging continuous glucose monitoring and insulin pump treatment, and has proven safety in the adult population. The purpose of this systematic review and meta-analysis is to evaluate the efficacy of closed-loop (CL) systems in the glycemic control of non-adult type 1 diabetes patients in both a pairwise and network meta-analysis (NMA) context and investigate various parameters potentially affecting the outcome.

METHODS

Literature was systematically searched using the MEDLINE (1966-2018), Scopus (2004-2018), Cochrane Central Register of Controlled Trials (CENTRAL) (1999-2018), Clinicaltrials.gov (2008-2018) and Google Scholar (2004-2018) databases. Studies comparing the glycemic control in CL (either single- or dual-hormone) with continuous subcutaneous insulin infusion (CSII) in people with diabetes (PWD) aged <18 years old were deemed eligible. The primary outcome analysis was conducted with regard to time spent in the target glycemic range. All outcomes were evaluated in NMA in order to investigate potential between-algorithm differences. Pairwise meta-analysis and meta-regression were performed using the RevMan 5.3 and Open Meta-Analyst software. For NMA, the package pcnetmetain R 3.5.1 was used.

RESULTS

The meta-analysis was based on 25 studies with a total of 504 PWD. The CL group was associated with significantly higher percentage of time spent in the target glycemic range (Mean (SD): 67.59% (SD: 8.07%) in the target range and OL PWD spending 55.77% (SD: 11.73%), MD: -11.97%, 95% CI [-18.40, -5.54%]) and with lower percentages of time in hyperglycemia (MD: 3.01%, 95% CI [1.68, 4.34%]) and hypoglycemia (MD: 0.67%, 95% CI [0.21, 1.13%]. Mean glucose was also decreased in the CL group (MD: 0.75 mmol/L, 95% CI [0.18-1.33]). The NMA arm of the study showed that the bihormonal modality was superior to other algorithms and standard treatment in lowering mean glucose and increasing time spent in the target range. The DiAs platform was superior to PID in controlling hypoglycemia and mean glucose. Time in target range and mean glucose were unaffected by the confounding factors tested.

CONCLUSIONS

The findings of this meta-analysis suggest that artificial pancreas systems are superior to the standard sensor-augmented pump treatment of type 1 diabetes mellitus in non-adult PWD. Between-algorithm differences are also addressed, implying a superiority of the bihormonal treatment modality. Future large-scale studies are needed in the field to verify these outcomes and to determine the optimal algorithm to be used in the clinical setting.

Comparison of Interventions to Improve Long-Term Medication Adherence Across Different Clinical Conditions: A Systematic Review With Network Meta-Analysis

Background: Medication non-adherence has a dynamic, temporal and multifactorial nature with a significant impact on economic and clinical outcomes. Interventions to improve adherence are complex and require adaptation to patients' needs, which may include patient's medical conditions. The aim of this study was to assess the comparative effectiveness of medication adherence interventions per type of clinical condition on adult patients.

Methods: A systematic review with network meta-analysis was performed (PROSPERO registration number of CRD42018054598). An initial Pubmed search was conducted to select meta-analyses reporting results of interventions aiming to improve medication adherence. Primary studies were selected and those reporting results with a long-term follow up (≥10 months) on adult patients were included for data extraction. Study characteristics, description of interventions and adherence outcomes were extracted. Adherence interventions were classified in four groups: educational, attitudinal, technical, and rewards. Clinical conditions were classified in four groups: circulatory system and metabolic diseases, infectious diseases, musculoskeletal diseases, and mental, behavioral or neurodevelopmental disorders. Network meta-analyses with effect sizes expressed as odds ratio (OR) with a 95% credibility interval (CrI) were built. Ranking probabilities for each measure of adherence were calculated by using surface under the cumulative ranking analysis (SUCRA).

Results: A total of 61 meta-analysis and 149 primary studies were included in the qualitative synthesis and 80 primary studies in the quantitative analysis. The most effective interventions were: educational + technical 79.6% [OR: 0.44 (CrI: 0.26, 0.73)] and 73.3% [OR: 0.56 (0.36, 0.84)] in circulatory system and metabolic diseases and infectious diseases respectively. Attitudinal intervention had the greatest probability for musculoskeletal diseases of 92.3% in SUCRA [OR: 0.30 (0.10, 0.86)]. Finally, educational + attitudinal interventions had the greatest effect (SUCRA 73.8%) for mental, behavioral or neurodevelopmental disorders, although this was not significant according to consistency analysis.

Conclusion: Effectiveness of interventions seems to be related to the clinical condition. Educational and technical interventions resulted in a major effect on long-term management of medication adherence in patients with infectious diseases (HIV) and circulatory system and metabolic diseases whereas attitudinal components presented a higher effect on musculoskeletal and mental, behavioral or neurodevelopmental disorders.

The Optimal Treatment for Stage IIIA-N2 Non-Small Cell Lung Cancer: A Network Meta-Analysis

BACKGROUND

The optimal treatment for stage IIIA-N2 non-small cell lung cancer (NSCLC) is controversial. We aimed to address this important issue through a Bayesian network meta-analysis.

METHODS

We performed a search of electronic databases for randomized controlled trials comparing the following treatments: surgery, radiotherapy, chemotherapy, and their multiple combinations before March 25, 2018. Pooled data on overall survival and treatment-related deaths were analyzed within the Bayesian framework.

RESULTS

Eighteen eligible trials reporting 13 treatments were included. In terms of overall survival, neoadjuvant chemotherapy followed by surgery and adjuvant chemotherapy or radiotherapy, which tended to be consistent (hazard ratio [HR] 1.14, 95% credible interval [CrI] 0.21 to 5.93), ranked superior to other treatments. Notably, neoadjuvant chemotherapy followed by surgery and adjuvant radiotherapy was significantly more effective in prolonging survival than surgery alone (HR 0.38, 95% CrI 0.18 to 0.81), surgery plus adjuvant radiotherapy (HR 0.51, 95% CrI 0.29 to 0.92) and potentially surgery plus adjuvant chemotherapy (HR 0.49, 95% CrI 0.23 to 1.05). Overall, with 29% as the highest possibility of causing the fewest treatment-related deaths, neoadjuvant chemotherapy followed by surgery and adjuvant chemotherapy or radiotherapy was the safest treatment option.

CONCLUSIONS

Neoadjuvant chemotherapy followed by surgery and adjuvant chemotherapy or radiotherapy has the greatest possibility to be the optimal treatment with the best overall survival and fewest treatment-related deaths for stage IIIA-N2 NSCLC.

Efficacy and Safety Evaluation of the Various Therapeutic Options in Locally Advanced Cervix Cancer: A Systematic Review and Network Meta-Analysis of Randomized Clinical Trials

Treatment options in locally advanced cervix cancer (LACC) have evolved around radiation therapy (RT) and/or chemotherapy (CT), hypoxic cell sensitizers, immunomodulators (Imm), and locoregional moderate hyperthermia (HT). A systematic review and network meta-analysis was conducted to synthesize the evidence for efficacy and safety in terms of long-term locoregional control (LRC), overall survival (OS), and grade ≥3 acute morbidity (AM) and late morbidity (LM). Five databases were searched, and 6285 articles (1974-2018) were screened per the Preferred Reporting Items for Systematic Reviews and Meta-analysis guidelines. Fifty-nine randomized trials in untreated LACC without surgical intervention were shortlisted. These used 13 different interventions: RT alone and/or neoadjuvant CT (NACT), adjuvant CT (ACT), concurrent chemoradiation therapy (CTRT) (weekly cisplatin [CDDP]/3-weekly CDDP/combination CT with CDDP/non-CDDP-based CT), hypoxic cell sensitizers, Imm, or HT. Odds ratios (ORs) using random effects network meta-analysis were estimated. Interventions for each endpoint were ranked according to their corresponding surface under cumulative ranking curve values. Of the 9894 patients evaluated, the total events reported for LRC, OS, AM, and LM were 5431 of 8197, 4482 of 7958, 1710 of 7183, and 441 of 6333, respectively. ORs and 95% credible intervals (CrIs) for the 2 best strategies were HT + RT versus CTRT + ACT (OR, 1.23; 95% CrI, 0.49-3.19) for LRC, CTRT (3-weekly CDDP) versus HTCTRT (OR, 1.14; 95% CrI, 0.35-3.65) for OS, RT + ACT versus RT (OR, 0.01; 95% CrI, 0.00-1.04) for AM, and NACT + RT + ACT versus RT + Imm (OR, 0.42; 95% CrI, 0.02-7.39) for LM. The 3 interventions with the highest cumulative surface under cumulative ranking curve values for all 4 endpoints were HTRT, HTCTRT, and CTRT (3-weekly CDDP). Articles with low risk of bias and those published during 2004 to 2018 also retained these interventions as the best. Two-step cluster analysis grouped these 3 modalities in a single distinctive cluster. HTRT, HTCTRT, and CTRT with 3-weekly CDDP were identified as therapeutic modalities with the best comprehensive impact on key clinical endpoints in LACC. This warrants a phase 3 randomized trial among these strategies for a head-to-head comparison and additional validation.

Complications Related to the Initial Trocar Insertion of 3 Different Techniques: A Systematic Review and Meta-analysis

This systematic review aimed to investigate complications related to initial trocar insertion among 3 different laparoscopic techniques: Veress needle (VN) entry, direct trocar entry (DTE), and open entry (OE). A literature search was completed, and complications were assessed. Major vessel injury, gastrointestinal injury, and solid organ injury were defined as major complications. Minor complications were defined as subcutaneous emphysema, extraperitoneal insufflation, omental emphysema, trocar site bleeding, and trocar site infection. Arm-based network meta-analyses were performed to identify the differences in complications among the 3 techniques. Seventeen studies were included in the quantitative analysis. DTE resulted in fewer major complications when compared with VN entry although the difference was not significant (p = .23) as well as significantly fewer minor complications (p < .001). There were no significant differences in minor complications when comparing OE and DTE (p = .74). Fewer major complications were observed with OE compared with VN entry although the difference was not significant (p = .31). There were significantly fewer minor complications for patients who underwent OE (p = .01). DTE patients experienced the least number of minor complications followed by VN entry and OE. In conclusion, major complications are extremely rare, and all 3 insertion methods can be performed without mortality.

Very early versus delayed mobilisation after stroke

BACKGROUND

Very early mobilisation (VEM) is performed in some stroke units and recommended in some acute stroke clinical guidelines. However, it is unclear whether very early mobilisation independently improves outcome after stroke.

OBJECTIVES

To determine whether very early mobilisation (started as soon as possible, and no later than 48 hours after onset of symptoms) in people with acute stroke improves recovery (primarily the proportion of independent survivors) compared with usual care.

SEARCH METHODS

We searched the Cochrane Stroke Group Trials Register (last searched 31 July 2017). We also systematically searched 19 electronic databases including; CENTRAL; 2017, Issue 7 in the Cochrane Library (searched July 2017), MEDLINE Ovid (1950 to August 2017), Embase Ovid (1980 to August 2017), CINAHL EBSCO (Cumulative Index to Nursing and Allied Health Literature; 1937 to August 2017) , PsycINFO Ovid (1806 to August 2017), AMED Ovid (Allied and Complementary Medicine Database), SPORTDiscus EBSCO (1830 to August 2017). We searched relevant ongoing trials and research registers (searched December 2016), the Chinese medical database, Wanfangdata (searched to November 2016), and reference lists, and contacted researchers in the field.

SELECTION CRITERIA

Randomised controlled trials (RCTs) of people with acute stroke, comparing an intervention group that started out-of-bed mobilisation within 48 hours of stroke, and aimed to reduce time-to-first mobilisation, with or without an increase in the amount or frequency (or both) of mobilisation activities, with usual care, where time-to-first mobilisation was commenced later.

DATA COLLECTION AND ANALYSIS

Two review authors independently selected trials, extracted data, assessed risk of bias, and applied the GRADE approach to assess the quality of the evidence. The primary outcome was death or poor outcome (dependency or institutionalisation) at the end of scheduled follow-up. Secondary outcomes included death, dependency, institutionalisation, activities of daily living (ADL), extended ADL, quality of life, walking ability, complications (e.g. deep vein thrombosis), patient mood, and length of hospital stay. We also analysed outcomes at three-month follow-up.

MAIN RESULTS

We included nine RCTs with 2958 participants; one trial provided most of the information (2104 participants). The median (range) delay to starting mobilisation after stroke onset was 18.5 (13.1 to 43) hours in the VEM group and 33.3 (22.5 to 71.5) hours in the usual care group. The median difference within trials was 12.7 (4 to 45.6) hours. Other differences in intervention varied between trials; in five trials, the VEM group were also reported to have received more time in therapy, or more mobilisation activity.Primary outcome data were available for 2542 of 2618 (97.1%) participants randomized and followed up for a median of three months. VEM probably led to similar or slightly more deaths and participants who had a poor outcome, compared with delayed mobilisation (51% versus 49%; odds ratio (OR) 1.08, 95% confidence interval (CI) 0.92 to 1.26; P = 0.36; 8 trials; moderate-quality evidence). Death occurred in 7% of participants who received delayed mobilisation, and 8.5% of participants who received VEM (OR 1.27, 95% CI 0.95 to 1.70; P = 0.11; 8 trials, 2570 participants; moderate-quality evidence), and the effects on experiencing any complication were unclear (OR 0.88; 95% CI 0.73 to 1.06; P = 0.18; 7 trials, 2778 participants; low-quality evidence). Analysis using outcomes collected only at three-month follow-up did not alter the conclusions.The mean ADL score (measured at end of follow-up, with the 20-point Barthel Index) was higher in those who received VEM compared with the usual care group (mean difference (MD) 1.94, 95% CI 0.75 to 3.13, P = 0.001; 8 trials, 9 comparisons, 2630/2904 participants (90.6%); low-quality evidence), but there was substantial heterogeneity (93%). Effect sizes were smaller for outcomes collected at three-month follow-up, rather than later.The mean length of stay was shorter in those who received VEM compared with the usual care group (MD -1.44, 95% CI -2.28 to -0.60, P = 0.0008; 8 trials, 2532/2618 participants (96.7%); low-quality evidence). Confidence in the answer was limited by the variable definitions of length of stay. The other secondary outcome analyses (institutionalisation, extended activities of daily living, quality of life, walking ability, patient mood) were limited by lack of data.Sensitivity analyses by trial quality: none of the outcome conclusions were altered if we restricted analyses to trials with the lowest risk of bias (based on method of randomization, allocation concealment, completeness of follow-up, and blinding of final assessment), or information about the amount of mobilisation.Sensitivity analysis by intervention characteristics: analyses restricted to trials where the mean VEM time-to-first mobilisation was less than 24 hours, showed an odds of death of 1.35 (95% CI 0.99 to 1.83; P = 0.06; I² = 25%; 5 trials). Analyses restricted to the trials that clearly reported a more prolonged out-of-bed activity showed a similar primary outcome (OR 1.14; 0.96 to 1.35; P = 0.13; I² = 28%; 5 trials), and odds of death (OR 1.27; 0.93 to 1.73; P = 0.13; I² = 0%; 4 trials) to the main analysis.Exploratory network meta-analysis (NMA): we were unable to analyze by the amount of therapy, but low-quality evidence indicated that time-to-first mobilisation at around 24 hours was associated with the lowest odds of death or poor outcome, compared with earlier or later mobilisation.

AUTHORS' CONCLUSIONS

VEM, which usually involved first mobilisation within 24 hours of stroke onset, did not increase the number of people who survived or made a good recovery after their stroke. VEM may have reduced the length of stay in hospital by about one day, but this was based on low-quality evidence. Based on the potential hazards reported in the single largest RCT, the sensitivity analysis of trials commencing mobilisation within 24 hours, and the NMA, there was concern that VEM commencing within 24 hours may carry an increased risk, at least in some people with stroke. Given the uncertainty around these effect estimates, more detailed research is still required.

Efficacy and safety of drugs for attention deficit hyperactivity disorder in children and adolescents: a network meta-analysis

The aim of this study is to gather evidence of head-to-head double-blind randomized-controlled trials on the efficacy and safety of available treatments for attention deficit hyperactivity disorder (ADHD) in children and adolescents. A systematic review was conducted by two independent reviewers in ten electronic databases (PROSPERO register CRD42016043239). Methodological quality of included studies was evaluated according to the Jadad scale. Network meta-analyses were performed including double-blinded head-to-head trials comparing active allopathic drugs in patients (0-18 years old) diagnosed with ADHD. The results of efficacy and safety of atomoxetine (ATX), bupropion, buspirone (BSP), dexamphetamine, edivoxetine (EDX), guanfacine (GXR), lisdexamfetamine (LDX), methylphenidate (MPH), mixed amphetamine salts, modafinil, pindolol (PDL), reboxetine (RBX), selegiline, and venlafaxine were analyzed using ADDIS software v.1.16.5. Forty-eight trials were identified (n = 4169 participants), of which 12 were used for efficacy analysis and 33 for safety analysis. On the CGI-I scale, the analysis revealed that MPH was more effective than ATX and GXR. For the safety outcomes, according to drug ranks, LDX was more likely to cause sleep disorders (39%) as well as loss of appetite (65%) and behavior problems such as irritability (60%). BSP (71%) and EDX (44%) caused less appetite decrease. For behavioral effects, PDL was considered safest (50%). For any adverse events, RBX (89%) was the safest alternative. The lack of head-to-head trials properly reporting outcomes of interest limited some comparisons. Network meta-analysis offered a broader overview on the available treatments for ADHD, especially for safety issues, and contributes towards evidence gathering and clinical practice decisions. A core outcome set for ADHD should be designed to guide the conduction and report of clinical trials.

Comparative efficacy of adjuvant trastuzumab-containing chemotherapies for patients with early HER2-positive primary breast cancer: a network meta-analysis

BACKGROUND

Trastuzumab (H) with chemotherapy benefits patients with HER2+ breast cancer (BC); however, we lack head-to-head pairwise assessment of survival or cardiotoxicity for specific combinations. We sought to identify optimal combinations.

METHODS

We searched PubMed, updated October 2017, using keywords "Breast Neoplasms/drug therapy," "Trastuzumab," and "Clinical Trial" and searched Cochrane Library. Our search included randomized trials of adjuvant H plus chemotherapy for early-stage HER2+ BC, and excluding trials of neoadjuvant therapy or without data to obtain hazard ratios (HRs) for outcomes. Following PRISMA guidelines, one investigator did initial search; two others independently confirmed and extracted information; and consensus with another investigator resolved disagreements. Before gathering data, we set outcomes of overall survival (OS), event-free survival (EFS), and severe cardiac adverse events (SCAEs). Analyzing 6 trials and 13,621 patients, we made direct and indirect comparisons using network meta-analysis on HR for OS or EFS and on odds ratio (OR) for SCAE; ranked therapy was done based on outcomes using p scores.

RESULTS

Compared with anthracycline-cyclophosphamide with taxane (ACT), ACT with concurrent H (ACT+H) showed best OS (HR 0.63, 95% confidence interval [CI] 0.55, 0.72), followed by taxane and carboplatin (TC) with concurrent H (TC+H) (HR 0.77, 95% CI 0.59, 1) and ACT with sequential H (ACT-H) (HR 0.85, 95% CI 0.68, 1.05). Pairwise comparisons showed statistically significant OS benefit for ACT+H over others; similar results for EFS. TC+H showed statistically significant lower SCAE risk compared to ACT+H (OR 0.13, 95% CI 0.03, 0.61).

CONCLUSIONS

Concurrent H with ACT or TC showed most clinical benefit for early-stage HER2+ BC; TC+H had lowest cardiotoxicity.

Current treatment of ocular toxoplasmosis in immunocompetent patients: a network meta-analysis

Ocular toxoplasmosis (OT) is the most frequent form of infectious posterior uveitis caused by the protozoan parasite Toxoplasma gondii. To evaluate the available evidence in peer-reviewed publications about the most effective therapy for OT in immunocompetent patients, herein a systematic literature search was conducted using Embase, PubMed, Google Scholar, and the Cochrane Central Register of Controlled Trials (CENTRAL) database from January 1987 to October 2017, with search terms "OT", "retinochoroiditis", "treatment", and "immunocompetent"; search filters "controlled clinical trial", "randomized clinical trial", and "clinical trial". The included studies were performed to evaluate the various treatment modalities of OT. Different treatment regimens were compared with regard to the improvement of visual acuity, the resolution of vitreous inflammation, recurrence, and side-effects. We independently extracted data and assessed eligibility and risk of bias using the preferred reporting items for systematic reviews and meta-analysis, and resolved any disagreement through discussion. A Bayesian network meta-analysis model was used to evaluate the interesting outcomes of all the interventions. Total 10 trials of treatments for OT were found to meet the inclusion criteria. Six trials of treatments including clindamycin, azithromycin, and trimethoprim-sulfamethoxazole (TMP-SMX) were compared with conventional therapy (the combination of pyrimethamine, sulfadiazine, and corticosteroids) for evaluation of the effect on visual acuity, vitreous inflammation, recurrence of OT, and side-effects. Two trials were compared TMP-SMX with placebo. One trial was compared azithromycin with TMP-SMX. And another trial was compared among treatments with clindamycin, P-S, TMP-SMX, and placebo. Based on our network meta-analysis, therapy with TMP-SMX seems to be an alternative treatment of OT in immunocompetent patients.

Disease-Modifying Therapies for Relapsing-Remitting Multiple Sclerosis: A Network Meta-Analysis

BACKGROUND

A broad range of disease-modifying therapies (DMTs) for relapsing-remitting multiple sclerosis (RRMS) is available. However, the efficacy and safety of traditional DMTs compared with the recently developed DMTs remain unclear.

OBJECTIVE

Therefore, we have synthesised available evidence of clinical outcomes for DMTs in adults with RRMS.

METHODS

PubMed, Scopus and a manual search were performed. Bayesian network meta-analyses of randomised clinical trials assessing DMTs as monotherapies were conducted. SUCRA and GRADE were used to rank therapies and to assess quality of general evidence, respectively.

RESULTS

Thirty-three studies were included in the meta-analyses. The most effective therapies for the outcome of annualised relapse rate were alemtuzumab (96% probability), natalizumab (96%) and ocrelizumab (85%), compared with all other therapies (hazard ratio versus placebo, 0.31, 0.31 and 0.37, respectively; p < 0.05 for all comparisons) (high-quality evidence). However, no significant differences among these three therapies were found. Discontinuation due to adverse events revealed similarity across all therapies, except for alemtuzumab, which showed less discontinuation when compared with interferon-1a intramuscular (relative risk 0.37; p < 0.05).

CONCLUSION

High-quality evidence shows that alemtuzumab, natalizumab and ocrelizumab present the highest efficacy among DMTs, and other meta-analyses are required regarding adverse events frequency, to better understand the safety of therapies. Based on efficacy profile, guidelines should consider a three-category classification (i.e. high, intermediate and low efficacy).

Medical Treatments for Acromegaly: A Systematic Review and Network Meta-Analysis

BACKGROUND

Acromegaly results from the hypersecretion of growth hormone. Because of the low incidence rates of this disease worldwide, few clinical trials evaluating drug treatments have been conducted.

OBJECTIVES

To conduct the first network meta-analysis simultaneously comparing all available drugs used in acromegaly treatment so as to provide more robust evidence in this field.

METHODS

A systematic review was performed according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses and Cochrane Collaboration recommendations (PROSPERO database under the registration number CRD42017059880). The electronic searches were conducted in PubMed (MEDLINE), Scopus, and Web of Science databases. Randomized controlled trials comparing any drug for the treatment of acromegaly head-to-head or versus placebo were included. Outcomes concerning the efficacy and safety of treatments were evaluated. The statistical analyses were performed using Aggregate Data Drug Information System version 1.16.8 (drugis.org, Groningen, The Netherlands).

RESULTS

The initial search retrieved 2059 articles. Of these, 10 randomized controlled trials were included in a qualitative analysis and 7 in a quantitative analysis. The network meta-analysis for the efficacy outcome (number of patients achieving insulinlike growth factor 1 control) showed that pegvisomant and lanreotide autogel were statistically superior to placebo (odds ratio [95% credible interval] 0.06 [0.00-0.55] and 0.09 [0.01-0.88]). No further differences were found. The probability rank indicated that pegvisomant and pasireotide have the highest probabilities (33% and 34%, respectively) of being the best therapeutic options. No major side effects were noted.

CONCLUSIONS

Pegvisomant is still a good option for acromegaly treatment, but pasireotide seems to be a promising alternative. Nevertheless, other important key factors such as drug costs and effectiveness (real-world results) should be taken into account when selecting acromegaly treatment.

Indirect comparison of efficacy and safety between immune checkpoint inhibitors and antiangiogenic therapy in advanced non-small-cell lung cancer

In this study, we conducted an indirect comparison analysis to compare the efficacy and safety of immune checkpoint inhibitors with those of antiangiogenic therapy-two effective treatment methods for advanced non-small-cell lung cancer (NSCLC). Eligible randomised control trials of immune checkpoint inhibitors, antiangiogenic therapy, and doublet platinum-based therapy published up to July 2017 were comprehensively analysed. Through the indirect comparison analysis of 37 trials involving 16810 patients, treatments were compared for overall survival (OS) and grade 3-5 adverse events. For first-line treatment, the use of pembrolizumab alone (hazard ratio [HR]: 0.6; 95% confidence interval [CI]: 0.4-0.91) and a combination of bevacizumab and doublet platinum-based therapy (HR: 0.86; 95% CI: 0.75-0.99) demonstrated substantial survival benefits compared with doublet platinum-based therapy. For subsequent treatment, nivolumab may provide higher efficacy and lower toxicity than antiangiogenic therapy. Overall, anti-PD1 monoclonal antibodies may be superior to antiangiogenic therapy in terms of OS and grade 3-5 adverse events. This meta-analysis suggests that pembrolizumab and nivolumab might be favourable choices for first-line and subsequent treatment, respectively, for patients with advanced NSCLC. Additional randomised control trials are required for a comprehensive evaluation of the outcomes among regimens.

Reappraising the Efficacy and Acceptability of Multicomponent Interventions for Caregiver Depression in Dementia: The Utility of Network Meta-Analysis

Background

Previous meta-analyses have demonstrated the efficacy of interventions for caregiver depression in dementia. However, they generally lumped the interventions together without accounting for the multicomponent nature of most interventions. It is unknown which combination of components contributed to the efficacy and should be implemented in clinical practice.

Objectives

To reappraise the interventions for caregiver depression from a recent systematic review, and evaluate whether a network meta-analytic approach offers additional insight into the efficacy and acceptability of multicomponent interventions.

Research Design and Methods

This study built upon a recent systematic review which identified 33 RCTs on caregiver depression from multiple databases (Medline, EMBASE, CENTRAL, PsycINFO, PSYNDEX). The 33 RCTs had different combinations of components serving at least one of the three key functions: addressing the care needs of persons with dementia (“CN”), addressing caregiving competency (“CC”), and providing emotional support for loss and grief (“ES”). A Bayesian network meta-analysis was conducted to compare the efficacy and all-cause attrition across different combinations of interventions.

Results

CN–CC combination was significantly more efficacious than treatment-as-usual (standardized mean difference in depression scores, SMD = −0.25, 95% credible interval [CrI] = −0.41 to −0.08) and marginally better than CN (SMD = −0.43, 95% CrI = −0.85 to −0.00). While none of the interventions clearly had both high efficacy and acceptability, three combinations of interventions (CC, CN–CC, and CN–CC–ES) had a reasonable balance between efficacy and acceptability.

Discussion and Implications

Although interventions for caregiver depression in dementia are effective in general, the different components of interventions may not share the same efficacy and acceptability. In implementing interventions, policymakers may consider addressing CC first, introducing CN in a graded manner, and providing ES only when indicated. Future studies may also consider using network meta-analysis to gain additional insights on how to implement multicomponent interventions in geriatric care.

An innovative and comprehensive technique to evaluate different measures of medication adherence: The network meta-analysis

BACKGROUND

Poor medication adherence is associated with adverse health outcomes and higher costs of care. However, inconsistencies in the assessment of adherence are found in the literature.

OBJECTIVE

To evaluate the effect of different measures of adherence in the comparative effectiveness of complex interventions to enhance patients' adherence to prescribed medications.

METHODS

A systematic review with network meta-analysis was performed. Electronic searches for relevant pairwise meta-analysis including trials of interventions that aimed to improve medication adherence were performed in PubMed. Data extraction was conducted with eligible trials evaluating short-period adherence follow-up (until 3 months) using any measure of adherence: self-report, pill count, or MEMS (medication event monitoring system). To standardize the results obtained with these different measures, an overall composite measure and an objective composite measure were also calculated. Network meta-analyses for each measure of adherence were built. Rank order and surface under the cumulative ranking curve analyses (SUCRA) were performed.

RESULTS

Ninety-one trials were included in the network meta-analyses. The five network meta-analyses demonstrated robustness and reliability. Results obtained for all measures of adherence were similar across them and to both composite measures. For both composite measures, interventions comprising economic + technical components were the best option (90% of probability in SUCRA analysis) with statistical superiority against almost all other interventions and against standard care (odds ratio with 95% credibility interval ranging from 0.09 to 0.25 [0.02, 0.98]).

CONCLUSION

The use of network meta-analysis was reliable to compare different measures of adherence of complex interventions in short-periods follow-up. Analyses with longer follow-up periods are needed to confirm these results. Different measures of adherence produced similar results. The use of composite measures revealed reliable alternatives to establish a broader and more detailed picture of adherence.

Mapping the characteristics of network meta-analyses on drug therapy: A systematic review

BACKGROUND

Network meta-analysis (NMA) is a new tool developed to overcome some limitations of pairwise meta-analyses. NMAs provide evidence on more than two comparators simultaneously. This study aimed to map the characteristics of the published NMAs on drug therapy comparisons.

METHODS

A systematic review of NMAs comparing pharmacological interventions was performed. Searches in Medline (PubMed) and Scopus along with manual searches were conducted. The main characteristics of NMAs were systematically collected: publication metadata, criteria for drug inclusion, statistical methods used, and elements reported. A methodological quality score with 25 key elements was created and applied to the included NMAs. To identify potential trends, the median of the publication year distribution was used as a cut-off.

RESULTS

The study identified 365 NMAs published from 2003 to 2016 in more than 30 countries. Randomised controlled trials were the primary source of data, with only 5% including observational studies, and 230 NMAs used a placebo as a comparator. Less than 15% of NMAs were registered in PROSPERO or a similar system. One third of studies followed PRISMA and less than 9% Cochrane recommendations. Around 30% presented full-search strategies of the systematic review, and 146 NMAs stated the selection criteria for drug inclusion. Over 75% of NMAs presented network plots, but only half described their geometry. Statistical parameters (model fit, inconsistency, convergence) were properly reported by one third of NMAs. Although 216 studies exhibited supplemental material, no data set of primary studies was available. The methodological quality score (mean 13·9; SD 3·8) presented a slightly positive trend over the years.

CONCLUSION

The map of the published NMAs emphasises the potential of this tool to gather evidence in healthcare, but it also identified some weaknesses, especially in the report, which limits its transparency and reproducibility.

Efficacy of Pharmacist Based Diabetes Educational Interventions on Clinical Outcomes of Adults With Type 2 Diabetes Mellitus: A Network Meta-Analysis

Background: Comparative efficacy of different pharmacist based interventions on glycemic control of type 2 diabetes patients is unclear. This review aimed to evaluate and compare the efficacy of different pharmacist based interventions on clinical outcomes of type 2 diabetes patients. Methods: A systematic search was conducted across five databases from date of database inception to September 2017. All randomized clinical trials evaluating the efficacy of pharmacist based interventions on type 2 diabetes patients were included for network meta-analysis (NMA). The protocol is available with PROSPERO (CRD42017078854). Results: A total of 43 studies, involving 6259 type 2 diabetes patients, were included. NMA demonstrated that all interventions significantly lowered glycosylated hemoglobin (HbA1c) levels compared to usual care, but there was no statistical evidence from this study that one intervention was significantly better than the other for reducing HbA1c levels. Pharmacist based diabetes education plus pharmaceutical care showed maximum efficacy for reducing HbA1c levels [-0.86, 95% CI -0.983, -0.727; p < 0.001]. Pharmacist based diabetes education plus pharmaceutical care was observed to be statistically significant in lowering levels of systolic blood pressure [-4.94; 95%CI -8.65, -1.23] and triglycerides levels [-0.26, 95%CI -0.51, -0.01], as compared to the interventions which involved diabetes education by pharmacist, and for body mass index (BMI) [-0.57; 95%CI -1.25, -0.12] in comparison to diabetes education by health care team involving pharmacist as member. Conclusion: The findings of this review demonstrate that all interventions had a significantly positive effect on HbA1c, but there was no statistical evidence from this study that one intervention was significantly better than the other for achieving glycemic control.Pharmacist based diabetes education plus pharmaceutical care showed maximum efficacy on HbA1c and rest of the clinical outcomes.

Effect of oral premedication on the anaesthetic efficacy of inferior alveolar nerve block in patients with irreversible pulpitis - A systematic review and network meta-analysis of randomized controlled trials

This systematic review (SR; PROSPERO database: CRD42017075160) and network meta-analysis (NMA) identified the most effective oral premedication for anaesthetic success of inferior alveolar nerve blocks (IANB) in cases of irreversible pulpitis. Medline and Ebscohost databases were searched up until 10/2017. Randomized controlled trials (RCT) studying the effect of oral premedication, alone or in combination, on the success of IANB for cases of irreversible pulpitis, compared to placebo or other oral premedications, were included. Quality of the included studies was appraised by the revised Cochrane risk of bias tool for randomized trials. Pairwise analysis, NMA and quality of evidence assessment using GRADE criteria were performed. Nineteen studies (n = 1654 participants) were included. NMA demonstrated that compared to placebo, dexamethasone was most effective in increasing anaesthetic success (RR, 2.92 [95% CI 1.74,4.91]; SUCRA = 0.96), followed by NSAIDs (RR, 1.92 [95% CI 1.63,2.27], SUCRA = 0.738) and Tramadol (RR, 2.03 [95% CI 1.18,3.49], SUCRA = 0.737). Premedication with acetaminophen added to NSAIDs demonstrated similar efficacy as NSAIDs alone (RR, 1.06 [95% CI 0.79,1.43]). Sensitivity analyses proved the superiority of dexamethasone or NSAIDs over any other premedications. Subgroup analyses of specific dosages in comparison with placebo demonstrated that dexamethasone 0.5 mg was most effective, followed by ketorolac 10 mg, piroxicam 20 mg, ibuprofen 400 mg + acetaminophen 500 mg and Tramadol 50 mg. Ibuprofen 400 mg, 600 mg and 800 mg had a significantly improved IANB success, while Ibuprofen 300 mg had no effect. Oral premedication with dexamethasone, NSAIDs or Tramadol significantly increased anaesthetic success. More trials are needed to evaluate the premedication effects of dexamethasone or Tramadol for improved anaesthetic success of IANB when treating irreversible pulpitis.

Comparative efficacy and acceptability of interventions for major depression in older persons: protocol for Bayesian network meta-analysis

INTRODUCTION

Major depression is a leading cause of disability and has been associated with adverse effects in older persons. While many pharmacological and non-pharmacological interventions have been shown to be effective to address major depression in older persons, there has not been a meta-analysis that consolidates all the available interventions and compare the relative benefits of these available interventions. In this study, we aim to conduct a systematic review and network meta-analysis to compare the efficacy and acceptability of all the known pharmacological and non-pharmacological interventions for major depression in older persons.

METHODS AND ANALYSIS

We will search Medline, Embase, PsycINFO, Cumulative Index to Nursing and Allied Health, Cochrane Central Register of Controlled Trials and references of other review articles for articles related to the keywords of 'randomised trial', 'major depression', 'older persons' and 'treatments'. Two reviewers will independently select the eligible articles. For each included article, the two reviewers will independently extract the data and assess the risk of bias using the Cochrane revised tool for risk of bias. Bayesian network meta-analyses will be conducted to pool the depression scores (based on standardised mean difference) and the all-cause discontinuation across all included studies. The ranking probabilities for all interventions will be estimated and the hierarchy of each intervention will be summarised as surface under the cumulative ranking curve (SUCRA). Meta-regression and sub-group analyses will also be performed to evaluate the effect of study-level covariates. The quality of the evidence will be assessed using the Grading of Recommendations Assessment, Development and Evaluation approach.

ETHICS AND DISSEMINATION

The results will be disseminated through conference presentations and peer-reviewed publications. They will provide the consolidated evidence to inform clinicians on the best choice of intervention to address major depression in older persons.

PROSPERO REGISTRATION NUMBER

CRD42017075756.

Network meta-analysis: application and practice using Stata

This review aimed to arrange the concepts of a network meta-analysis (NMA) and to demonstrate the analytical process of NMA using Stata software under frequentist framework. The NMA tries to synthesize evidences for a decision making by evaluating the comparative effectiveness of more than two alternative interventions for the same condition. Before conducting a NMA, 3 major assumptions—similarity, transitivity, and consistency—should be checked. The statistical analysis consists of 5 steps. The first step is to draw a network geometry to provide an overview of the network relationship. The second step checks the assumption of consistency. The third step is to make the network forest plot or interval plot in order to illustrate the summary size of comparative effectiveness among various interventions. The fourth step calculates cumulative rankings for identifying superiority among interventions. The last step evaluates publication bias or effect modifiers for a valid inference from results. The synthesized evidences through five steps would be very useful to evidence-based decision-making in healthcare. Thus, NMA should be activated in order to guarantee the quality of healthcare system.