Serious Concerns About the RCT Study Quality of Traditional Chinese Medicine Injections for Treating Cardiovascular Diseases and COVID-19

The efficacy of Chinese herbal drugs for adults with angina pectoris: Bayesian network meta-analysis of 331 RCTs involving 36,467 individuals

ETHNOPHARMACOLOGICAL RELEVANCE

Hundreds of randomized controlled trials (RCT) on Chinese herbal drugs (CHDs) including Shexiang baoxin pill (BXP), compound Danshen dripping pill (DSP), compound Danshen tablet (DST), Suxiao jiuxin pill (JXP), Naoxintong capsule (NXT), Tongxinluo capsule (TXL), and Di'ao xinxuekang capsule (XXK) and conventional chemical drugs, such as isosorbide dinitrate (ISDN), for angina pectoris are available but have not been evaluated by a PRISMA-compliant network meta-analysis (NMA).

AIM OF THE STUDY

This study aimed to compare the efficacy of nine anti-anginal drugs through NMA on RCTs.

METHODS

RCTs of drug treatment for adult patients with angina pectoris for improvements in symptoms and electrocardiography were retrieved. Odds ratios and 95% credible intervals were computed to measure effect sizes. RCT quality was evaluated with the Cochrane risk of bias tool. Evidence synthesis was performed with Bayesian NMA. Essential analyses including subgroup analysis, sensitivity analysis, meta-regression analysis, publication bias analysis, and ranking analysis were conducted to assess the robustness of efficacies. Evidence strength was assessed with the GRADE approach.

RESULTS

A total of 331 RCTs with 36,467 participants were eligible. The overall quality of all included RCTs was low. Overall efficacy estimates from different approaches of evidential synthesis found that BXP, TXL, and DSP were more efficacious than DST and ISDN. Essential analyses indicated consistent efficacy estimates, insignificant publication bias, and corroborative ranking results. The overall GRADE evidence strength was low.

CONCLUSION

This comprehensive Bayesian NMA found BXP, TXL, and DSP to be the top three candidates among the seven tested CHDs for treating adults suffering from angina pectoris. However, the quality and the evidence strength of eligible RCTs were low. Further high-quality RCTs with more outcome measures and their NMAs are warranted.

REGISTRATION

PROSPERO CRD42014007035.

How efficacious are traditional Chinese medicine injections in treating angina pectoris? A network meta-analysis of randomized controlled trials

ETHNOPHARMACOLOGICAL RELEVANCE

Over 50 million adults in China suffer from angina pectoris, which are often treated with traditional Chinese medicine injections (TCMIs). However, the efficacies of TCMIs and conventional drugs as determined by randomized controlled trials (RCTs) were not rigorously compared with one another by network meta-analysis (NMA). This PRISMA-compliant NMA aimed to compare the efficacy and assess the evidence strengths of 24 TCMIs in treating adults with angina pectoris of RCTs.

MATERIALS AND METHODS

Following the protocol (PROSPERO registration number CRD42018117720), the RCTs that compared any TCMI with another TCMI or conventional drug on outcome measures including symptomatic and electrocardiography improvements were included. The quality of included RCTs was assessed with the Cochrane's risk of bias 2 tool. Frequentist statistical analyses were performed, including NMA, pairwise meta-analysis (PMA), subgroup analysis, sensitivity analysis, meta-regression, and publication bias analysis. The certainty of evidence was assessed with the GRADE approach.

RESULTS

Totally, 556 eligible RCTs with 57015 participants were identified while the quality of all but five included RCTs was poor. The significant efficacy estimates and insignificant heterogeneity assessment from PMA and NMA indicated that nearly all TCMIs were more efficacious than conventional treatments for angina pectoris. Adequate subgroup and sensitivity analyses found the robust and consistent results. However, the evidence strengths of meta-analyses were assessed as very low to low due to the high risk of RCTs. The comprehensive efficacy estimates suggested that 4 TCMIs (HH, Honghua injection; HHH, Honghua Huangsesu injection; GLP, Gualoupi injection; and SM, Shenmai injection) was the best anti-anginal drugs for adults with angina pectoris.

CONCLUSION

TCMIs appear to be efficacious for angina pectoris, although evidence evaluation of high-quality RCTs of TCMIs would be necessary. In particular, randomization and blinding procedures of the RCTs should be explicated to meet the CONSORT requirements.

Randomized controlled trials in patients with COVID-19: a systematic review and critical appraisal

OBJECTIVES

This study aimed to describe the prevalence of risks of bias in randomized trials of therapeutic interventions for COVID-19.

METHODS

Systematic review and risk of bias assessment performed by two independent reviewers of a random sample of 40 randomized trials of therapeutic interventions for moderate-severe COVID-19. We used the RoB 2.0 tool to assess the risk of bias, which evaluates bias under five domains as well as an overall assessment of each trial as high or low risk of bias.

RESULTS

Of the 40 included trials, 19 (47%) were at high risk of bias, and this was particularly frequent in trials from low-middle income countries (11/14, 79%). Potential deviations to intended interventions (i.e., control participants accessing experimental treatments) were considered a potential source of bias in some studies (14, 35%), as was the risk due to selective reporting of results (6, 15%). The randomization process was considered at low risk of bias in most studies (34, 95%), as were missing data (36, 90%) and measurement of the outcome (35, 87%).

CONCLUSION

Many randomized trials evaluating COVID-19 interventions are at risk of bias, particularly those conducted in low-middle income countries. Biases are mostly due to deviations from intended interventions and partly due to the selection of reported results. The use of placebo control and publicly available protocol can mitigate many of these risks.