Endorsement of the CONSORT statement by Chinese journals of Traditional Chinese Medicine: a survey of journal editors and review of journals' instructions for authors

The reporting quality of randomized controlled trials in Chinese herbal medicine (CHM) formulas for diabetes based on the consort statement and its extension for CHM formulas

Background: This study aimed to assess the overall reporting quality of randomized controlled trials (RCTs) in Chinese herbal medicine (CHM) formulas for patients with diabetes, and to identify factors associated with better reporting quality. Methods: Four databases including PubMed, Embase, Cochrane Library and Web of Science were systematically searched from their inception to December 2022. The reporting quality was assessed based on the Consolidated Standards of Reporting Trials (CONSORT) statement and its CHM formula extension. The overall CONSORT and its CHM formula extension scores were calculated and expressed as proportions separately. We also analyzed the pre-specified study characteristics and performed exploratory regressions to determine their associations with the reporting quality. Results: Seventy-two RCTs were included. Overall reporting quality (mean adherence) were 53.56% and 45.71% on the CONSORT statement and its CHM formula extension, respectively. The strongest associations with reporting quality based on the CONSORT statement were multiple centers and larger author numbers. Compliance with the CHM formula extension, particularly regarding the disclosure of the targeted traditional Chinese medicine (TCM) pattern (s), was generally insufficient. Conclusion: The reporting quality of RCTs in CHM formulas for diabetes remains unsatisfactory, and the adherence to the CHM formula extension is even poorer. In order to ensure transparent and standardized reporting of RCTs, it is essential to advocate for or even mandate adherence of the CONSORT statement and its CHM formula extension when reporting trials in CHM formulas for diabetes by both authors and editors.

A cross-sectional study of the endorsement proportion of reporting guidelines in 1039 Chinese medical journals

BACKGROUND

Reporting quality is a critical issue in health sciences. Adopting the reporting guidelines has been approved to be an effective way of enhancing the reporting quality and transparency of clinical research. In 2012, we found that only 7 (7/1221, 0.6%) journals adopted the Consolidated Standards of Reporting Trials (CONSORT) statement in China. The aim of the study was to know the implementation status of CONSORT and other reporting guidelines about clinical studies in China.

METHODS

A cross-sectional bibliometric study was conducted. Eight medical databases were systematically searched, and 1039 medical journals published in mainland China, Hong Kong, Macau, and Taiwan were included. The basic characteristics, including subject, language, publication place, journal-indexed databases, and journal impact factors were extracted. The endorsement of reporting guidelines was assessed by a modified 5-level evaluation tool, namely i) positive active, ii) positive weak, iii) passive moderate, iv) passive weak and v) none.

RESULTS

Among included journals, 24.1% endorsed CONSORT, and 0.8% endorsed CONSORT extensions. For STROBE (STrengthening the Reporting of Observational Studies in Epidemiology), PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses), STARD (An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies), CARE (CAse REport guidelines), the endorsement proportion were 17.2, 16.6, 16.4, and 14.8% respectively. The endorsement proportion for SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials), TRIPOD (Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis), AGREE (Appraisal of Guidelines, Research, and Evaluation), and RIGHT (Reporting Items for Practice Guidelines in Healthcare) were below 0.7%.

CONCLUSIONS

Our results showed that the implementation of reporting guidelines was low. We suggest the following initiatives including i) enhancing the level of journal endorsement for reporting guidelines; ii) strengthening the collaboration among authors, reviewers, editors, and other stakeholders; iii) providing training courses for stakeholders; iv) establishing bases for reporting guidelines network in China; v) adopting the endorsement of reporting guidelines in the policies of the China Periodicals Association (CPA); vi) promoting Chinese medical journals into the international evaluation system and publish in English.

Promoting the quality and transparency of health research in China

BACKGROUND AND OBJECTIVES

To review the efforts and progress in promoting quality and transparency of health research in China and to discuss how to improve.

METHODS

We focused on three different types of health research: clinical trials, systematic reviews, and clinical practice guidelines, and summarized China's progress from their registration, implementation, and reporting stages.

RESULTS

In the last 3 decades, China's major works include the following: 1) For registration, the trials and CPGs registries have been set up, and released policies to mandate registration and submission of protocols for trials. 2) For implementation, multiple clinical research and EBM centers have been established. The ResMan platform for data management has been created and required researchers to share results data. 3) For reporting, the Chinese EQUATOR Center has been set up. Translations and extensions of the CONSORT, PRISMA, and RIGHT have been published. 4) For traditional Chinese medicine (TCM), specific guidelines for the registration and reporting of TCM research have been developed.

CONCLUSION

China has made progress in promoting research quality and transparency, especially in research registration and reporting. Nevertheless, more can be done in data management and sharing for research implementation, and good publication practices in TCM.

Systematic review and meta-analyses of studies analysing instructions to authors from 1987 to 2017

To gain insight into changes of scholarly journals' recommendations, we conducted a systematic review of studies that analysed journals' Instructions to Authors (ItAs). We summarised results of 153 studies, and meta-analysed how often ItAs addressed: 1) authorship, 2) conflicts of interest, 3) data sharing, 4) ethics approval, 5) funding disclosure, and 6) International Committee of Medical Journal Editors' Uniform Requirements for Manuscripts. For each topic we found large between-study heterogeneity. Here, we show six factors that explained most of that heterogeneity: 1) time (addressing of topics generally increased over time), 2) country (large differences found between countries), 3) database indexation (large differences found between databases), 4) impact factor (topics were more often addressed in highest than in lowest impact factor journals), 5) discipline (topics were more often addressed in Health Sciences than in other disciplines), and 6) sub-discipline (topics were more often addressed in general than in sub-disciplinary journals).

Quality Evaluation of Randomized Controlled Trials of Rhodiola Species: A Systematic Review

Background

Rhodiola is a worldwide used medicinal plant for its various medicinal functions, and the number of randomized controlled trials (RCTs) of Rhodiola is increasing in recent years. This study aims to evaluate the reporting quality and risk of bias of the current RCT reports of different Rhodiola species.

Methods

Six databases including Embase, PubMed, Web of Science, the Cochrane Library, ClinicalTrial.gov, and China National Knowledge Infrastructure were searched to identify RCTs that used Rhodiola as a single intervention and were published in English or Chinese from inception to December 2020. The Consolidated Standards of Reporting Trials (CONSORT) 2010 statement was used as the checklist for assessment, and a scoring system was applied to the evaluation of RCTs. Score 0 represents no reporting or inadequate reporting, and score 1 represents adequate reporting. The risk of bias of the included studies was also assessed using the Cochrane Risk of Bias tool.

Results

A total of 39 RCTs were included in this study, including 23 RCTs of Rhodiola rosea (R. rosea), 8 RCTs of Rhodiola crenulata (R. crenulata), and 8 RCTs of Rhodiola wallichiana (R. wallichiana). None of the included studies met all the CONSORT statement criteria, and the reporting quality of RCTs of the three Rhodiola species was all generally poor. Based on the risk of bias assessment, the majority of included studies were judged to have an unclear risk of bias in most domains due to inadequate reporting.

Conclusions

There is inadequate reporting among the included RCTs of different Rhodiola species, and RCTs of Rhodiola with higher reporting quality and better methodological quality are needed.

Has the Reporting Quality of Systematic Review Abstracts in Nursing Improved Since the Release of PRISMA for Abstracts? A Survey of High-Profile Nursing Journals

BACKGROUND

The PRISMA for Abstracts (PRISMA-A) was developed to guide authors to present a structured abstract. However, the adherence of abstracts to these guidelines in some areas was of concern.

AIMS

To determine whether the publication of PRISMA-A resulted in an improvement in the abstracts reported with nursing systematic reviews (SRs).

METHODS

This was a cross-sectional study. We searched PubMed for randomized controlled trials-based SRs published in top-tier nursing journals. A PRISMA-A checklist was used to assess abstracts in the SR included. Total score on checklists, comparison of total scores between two periods, and effect factors were analyzed.

RESULTS

Overall, abstract reporting compliance with PRISMA-A has not improved significantly with the time span. Of the 81 SRs, 74.1% were structured. About half reported eligibility criteria, information sources, and description of the effect as recommended. Registration status was reported only in 4.9%. The reporting quality was significantly higher for journals with higher impact factors (p < .001).

LINKING EVIDENCE TO ACTION

Although not inclusive of all SRs in the nursing field, our sample reflects the general trend that there was no significant improvement in the compliance of SR abstracts reported in nursing with the release of PRISMA-A. There is room for improvement, as most items have not been fully reported.

Endorsement of Animal Research: Incorporation of In Vivo Experiments (ARRIVE) Guidelines/Gold Standard Publication Checklist (GSPC) by Chinese journals: A survey of journals' instructions for authors and editors

The objective was to determine the rate at which Chinese journals include Animal Research: Reporting of In Vivo Experiments (ARRIVE) Guidelines/Gold Standard Publication Checklist (GSPC) in their instructions for authors, and the awareness and recognition of editors. The survey was performed on Chinese journals. The most recent versions each journal's instructions for authors were downloaded, and the information related to the ARRIVE/GSPC was collected. A self-developed questionnaire was used to conduct the survey among the editors. Questionnaires were sent to 238 qualified journals and 198 of them returned them, achieving an 83.2% response rate. The results showed that none of the journals included the ARRIVE/GSPC in their instructions for authors, and the awareness rate was only 13.1% (26/198). The participants who were unaware of the ARRIVE/GSPC were less likely than those who were aware of them to believe it was necessary to include the ARRIVE/GSPC in the instructions for authors (23.3% vs. 61.5%), and less likely to request authors in their manuscript preparation (28.5% vs. 88.5%), editors in the editing and processing (28.5% vs. 84.6%) and reviewers in peer review stage (28.5% vs. 92.3%) to follow the ARRIVE/GSPC. Currently no Chinese journals include the ARRIVE/GSPC in their instructions for authors. The recognition rate of the ARRIVE/GSPC was low among the editors. So, we suggest that Chinese journals should promote inclusion of the ARRIVE/GSPC in journals' instructions for authors. It is also important to educate researchers and editors alike to increase their understanding of the ARRIVE/GSPC, so that the quality of reporting of animal study can be improved.

Acupuncture and clomiphene citrate for anovulatory infertility: a systematic review and meta-analysis

Objective:

To evaluate the comparative effectiveness of acupuncture or acupuncture combined with clomiphene citrate (CC) versus CC alone on the outcomes of anovulatory infertility.

Methods:

A literature search in eight databases yielded nine randomised controlled trials (RCTs) that evaluated the comparative effectiveness of acupuncture and CC in anovulatory infertility. Subsequently, data were extracted and the studies were assessed for the quality of their methodological designs and risk of bias. Meta-analyses of the RCT data were conducted.

Results:

Nine trials including 1441 women were included in the meta-analysis. There were no significant differences in the rates of pregnancy (odds ratio (OR) 1.18, 95% CI 0.83 to 1.69), ovulation (OR 2.57, 95% CI 0.59 to 11.29) or pregnancy loss (OR 0.98, 95% CI 0.59 to 1.63) when acupuncture was used as an adjuvant therapy alongside CC. Although acupuncture alone did not increase the ovulation rate (OR 0.41, 95% CI 0.11 to 1.49), our review demonstrated superior effects in patients who received acupuncture as a separate treatment modality with respect to both the pregnancy rate (OR 2.34, 95% CI 1.76 to 3.10) and the maximum follicular diameter (mean difference 0.50 mm, 95% CI 0.44 to 0.56 mm) when compared with CC alone. Statistical analysis also showed a reduction in the rate of pregnancy loss when acupuncture was used as a separate treatment compared with CC alone (OR 0.19, 95% CI 0.08 to 0.45).

Conclusions:

Based on the above pooled results of the studies, the use of acupuncture as a monotherapy significantly improved the rate of pregnancy among the study participants compared with the use of CC alone. However, any results drawn from these studies should be interpreted with caution when considering the context of clinical practice.

Reporting Characteristics and Risk of Bias in Randomised Controlled Trials of Acupuncture Analgesia Published in Pubmed-Listed Journals

Background

Acupuncture analgesia has been evaluated by a number of randomised controlled trials (RCTs); however, a systematic summary of reporting quality of RCTs in this specific field is lacking.

Objective

To examine the reporting characteristics and risk of bias of RCTs of acupuncture analgesia indexed in the PubMed database.

Methods

A PubMed search of RCTs of acupuncture analgesia was conducted through November 2015. The Cochrane Collaboration Risk of Bias Tool was used to assess the risk of bias of each trial.

Results

206 articles were identified across 59 journals (impact factor 0.4–20), of which 56% of articles and 86% of journals were Science Citation Index (SCI)-indexed. Nearly half of the articles were published in China. The next most represented countries of origin were the UK (22%) and USA (21%). Of the included trials, postoperative pain was the most prevalent phenotype, and manual acupuncture was the most frequently applied type of stimulation (46%). A total of 12% of articles reported on analgesic mechanisms. The most frequently used acupuncture points were LI4, ST36, PC6, SP6 and Shenmen. The overwhelming majority of trials were considered to be at high risk of bias (84%). Furthermore, 79% of trials enrolled <50 participants per treatment arm.

Conclusions

RCTs of acupuncture analgesia indexed in PubMed journals generally exhibited poor reporting of methodological and treatment details. Future studies should provide more information regarding clinical trial registration, blinding of participants (including sham procedures where applicable) and outcome assessors, as well as the training and qualification of acupuncturists.

Manual Acupuncture for Myofascial Pain Syndrome: A Systematic Review and Meta-Analysis

Objective

To assess the efficacy of manual acupuncture (MA) in the treatment of myofascial pain syndrome (MPS).

Methods

We searched for randomised controlled trials (RCTs) comparing MA versus sham/placebo or no intervention in patients with MPS in the following databases from inception to January 2016: PubMed; Cochrane Library; Embase; Web of Science; and China Biology Medicine. Two reviewers independently screened the literature extracted data and assessed the quality of the included studies according to the risk of bias tool recommended by the Cochrane Handbook (V.5.1.0). Then, a meta-analysis was performed using RevMan 5.3 software.

Results

Ten RCTs were combined in a meta-analysis of MA versus sham, which showed a favourable effect of MA on pain intensity after stimulation of myofascial trigger points (MTrPs; standardised mean difference (SMD) −0.90, 95% CI −1.48 to −0.32; p=0.002) but not traditional acupuncture points (p>0.05). Benefit was seen both after a single treatment (SMD −1.05, 95% CI −1.84 to −0.27; p=0.009) and course of eight sessions (weighted mean difference (WMD) −1.96, 95% CI −2.72 to −1.20; p<0.001). We also found a significant increase in pressure pain threshold following MA stimulation of MTrPs (WMD 1.00, 95% CI 0.32 to 1.67; p=0.004). Two of the included studies reported mild adverse events (soreness/haemorrhage) secondary to MA.

Conclusions

Through stimulation of MTrPs, MA might be efficacious in terms of pain relief and reduction of muscle irritability in MPS patients. Additional well-designed/reported studies are required to determine the optimal number of sessions for the treatment of MPS.

Effectiveness of Acupuncture in Women with Polycystic Ovarian Syndrome Undergoing in Vitro Fertilisation Or Intracytoplasmic Sperm Injection: A Systematic Review and Meta-Analysis

Objectives

The aim of this systematic review was to assess the evidence from randomised controlled trials (RCTs) on the efficacy, effectiveness and safety of acupuncture in women with polycystic ovarian syndrome (PCOS) undergoing in vitro fertilisation (IVF) or intracytoplasmic sperm injection (ICSI).

Methods

We searched a total of 15 databases through October 2015. The participants were women with PCOS (diagnosed using the Rotterdam criteria) undergoing IVF or ICSI. Eligible trials were those with intervention groups receiving manual acupuncture (MA) or electroacupuncture (EA), and control groups receiving sham acupuncture, no treatment or other treatments. Outcomes included the clinical pregnancy rate (CPR), live birth rate (LBR), ongoing pregnancy rate (OPR) and incidence of ovarian hyperstimulation syndrome (OHSS) and adverse events (AEs). For statistical pooling, the risk ratio (RR) and its 95% (confidence interval) CI was calculated using a random effects model.

Results

Four RCTs including 430 participants were selected. All trials compared acupuncture (MA/EA) against no treatment. Acupuncture significantly increased the CPR (RR 1.33, 95% CI 1.03 to 1.71) and OPR (RR 2.03, 95% CI 1.08 to 3.81) and decreased the risk of OHSS (RR 0.63, 95% CI 0.42 to 0.94); however, there was no significant difference in the LBR (RR 1.61, 95% CI 0.73 to 3.58). None of the RCTs reported on AEs.

Conclusions

Acupuncture may increase the CPR and OPR and decrease the risk of OHSS in women with PCOS undergoing IVF or ICSI. Further studies are needed to confirm the efficacy and safety of acupuncture as an adjunct to assisted reproductive technology in this particular population.

Assessment of reporting quality in randomised controlled trials of acupuncture for post-stroke rehabilitation using the CONSORT statement and STRICTA guidelines

OBJECTIVES

To evaluate the completeness of reporting of randomised controlled trials (RCTs) of acupuncture for post-stroke rehabilitation in order to provide information to facilitate transparent and more complete reporting of acupuncture RCTs in this field.

METHODS

Multiple databases were searched from their inception through September 2015. Quality of reporting for included papers was assessed against a subset of criteria adapted from the Consolidated Standards for Reporting Trials (CONSORT) 2010 statement and the Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) guidelines. Each item was scored 1 if it was reported, or 0 if it was not clearly stated. Descriptive statistical analysis was performed. Cohen's κ-statistics were calculated to assess agreement between the two reviewers.

RESULTS

A total of 87 RCTs were included in the full text. Based on CONSORT, good reporting was evident for items ''Randomised' in the title or abstract', 'Participants', 'Statistical methods', 'Recruitment', 'Baseline data', and 'Outcomes and estimation', with positive rates >80%. However, the quality of reporting for the items 'Trial design', 'Outcomes', 'Sample size', 'Allocation concealment', 'Implementation', 'Blinding', 'Flow chart', 'Intent-to-treat analysis', and 'Ancillary analyses' was very poor with positive rates <10%. Based on STRICTA, the items 'Number of needle insertions per subject per session', 'Responses sought', and 'Needle type' had poor reporting with positive rates <50%. Substantial agreement was observed for most items and good agreement was observed for some items.

CONCLUSIONS

The reporting quality of RCTs in acupuncture for post-stroke rehabilitation is unsatisfactory and needs improvement.