CONSORT in China: past development and future direction

STROBE, CONSORT, PRISMA, MOOSE, STARD, SPIRIT, and other guidelines - Overview and application

The purpose of research is to seek answers and new knowledge. When conducted properly and systematically, research adds to humanity's corpus of knowledge and hence to our general advancement. However, this is only possible if reported research is accurate and transparent. Guidelines for all the major types of studies (STROBE, CONSORT, PRISMA, MOOSE, STARD, and SPIRIT) have been developed and refined over the years, and their inception, development, and application are briefly discussed in this paper. Indeed, there are currently over 250 of these guidelines for various types of medical research, and these are published by the EQUATOR network. This paper will also briefly review progress in acceptance and adoption of these guidelines.

A cross-sectional study of the endorsement proportion of reporting guidelines in 1039 Chinese medical journals

BACKGROUND

Reporting quality is a critical issue in health sciences. Adopting the reporting guidelines has been approved to be an effective way of enhancing the reporting quality and transparency of clinical research. In 2012, we found that only 7 (7/1221, 0.6%) journals adopted the Consolidated Standards of Reporting Trials (CONSORT) statement in China. The aim of the study was to know the implementation status of CONSORT and other reporting guidelines about clinical studies in China.

METHODS

A cross-sectional bibliometric study was conducted. Eight medical databases were systematically searched, and 1039 medical journals published in mainland China, Hong Kong, Macau, and Taiwan were included. The basic characteristics, including subject, language, publication place, journal-indexed databases, and journal impact factors were extracted. The endorsement of reporting guidelines was assessed by a modified 5-level evaluation tool, namely i) positive active, ii) positive weak, iii) passive moderate, iv) passive weak and v) none.

RESULTS

Among included journals, 24.1% endorsed CONSORT, and 0.8% endorsed CONSORT extensions. For STROBE (STrengthening the Reporting of Observational Studies in Epidemiology), PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses), STARD (An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies), CARE (CAse REport guidelines), the endorsement proportion were 17.2, 16.6, 16.4, and 14.8% respectively. The endorsement proportion for SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials), TRIPOD (Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis), AGREE (Appraisal of Guidelines, Research, and Evaluation), and RIGHT (Reporting Items for Practice Guidelines in Healthcare) were below 0.7%.

CONCLUSIONS

Our results showed that the implementation of reporting guidelines was low. We suggest the following initiatives including i) enhancing the level of journal endorsement for reporting guidelines; ii) strengthening the collaboration among authors, reviewers, editors, and other stakeholders; iii) providing training courses for stakeholders; iv) establishing bases for reporting guidelines network in China; v) adopting the endorsement of reporting guidelines in the policies of the China Periodicals Association (CPA); vi) promoting Chinese medical journals into the international evaluation system and publish in English.

Promoting the quality and transparency of health research in China

BACKGROUND AND OBJECTIVES

To review the efforts and progress in promoting quality and transparency of health research in China and to discuss how to improve.

METHODS

We focused on three different types of health research: clinical trials, systematic reviews, and clinical practice guidelines, and summarized China's progress from their registration, implementation, and reporting stages.

RESULTS

In the last 3 decades, China's major works include the following: 1) For registration, the trials and CPGs registries have been set up, and released policies to mandate registration and submission of protocols for trials. 2) For implementation, multiple clinical research and EBM centers have been established. The ResMan platform for data management has been created and required researchers to share results data. 3) For reporting, the Chinese EQUATOR Center has been set up. Translations and extensions of the CONSORT, PRISMA, and RIGHT have been published. 4) For traditional Chinese medicine (TCM), specific guidelines for the registration and reporting of TCM research have been developed.

CONCLUSION

China has made progress in promoting research quality and transparency, especially in research registration and reporting. Nevertheless, more can be done in data management and sharing for research implementation, and good publication practices in TCM.

Drug Testing for Chronic Kidney Disease and Diabetes in Animals versus Humans: A Comparative Analysis of Study Designs and Reporting Qualities

INTRODUCTION

Diabetes is a highly prevalent accelerator or even cause of chronic kidney disease imposing a large unmet medical need at the global scale. Massive research activities continue to be in search of a cure but the yield of the classical bench-to-bedside research approach has been low. We speculated that a significant mismatch in design and quality of animal and clinical studies in this domain is a hurdle for translation.

METHODS

We performed a meta-analysis of matched pairs of animal and human studies that tested the efficacy of distinct drug interventions for diabetic kidney disease (DKD). We reviewed study designs and reporting quality of such studies over the last decade according to the standards listed in the CONSORT and ARRIVE recommendations, respectively.

RESULTS

We noted a wide diversity in the study designs of animal studies in terms of diabetes induction. Major mismatches with the respective human studies referred to age and sex distribution, comorbidities, stage of the kidney disease, and selection of primary endpoints. Usually, treatment was initiated before onset of kidney disease without any standard of care as a background therapy. The reporting quality of animal studies was poor for randomization procedures, blinding, sample size calculation for a prespecified primary endpoint or the safety analysis. Reporting quality of clinical studies had deficits in trial design-, recruitment-, allocation-, and outcome-related aspects.

CONCLUSION

Bench-to-bedside translation in the domain of DKD suffers from major deficits in the design of experimental studies in view of the projected clinical trials as well as from significant deficits in the reporting quality in preclinical and clinical studies.

Efficacy of the Jingxin Zhidong Formula for Tic Disorders: A Randomized, Double Blind, Double Dummy, Parallel Controlled Trial

BACKGROUND

The Jingxin Zhidong formula (JXZDF), a traditional Chinese medicine, has been widely used to treat tic disorder (TD) in China. However, its efficacy has not yet been evaluated in a randomized controlled trial. We aimed to compare the effectiveness and safety of JXZDF and aripiprazole in patients with TD.

METHODS

In this randomized, double-blind, double-dummy, parallel controlled trial, 120 patients with TD, aged 6-16 years were randomly assigned to receive either JXZDF (n = 60, 17.6 g/day) or aripiprazole (n = 60, 10 mg/day) for 12 weeks. The primary outcome was measured using the Yale Global Tic Severity Scale (YGTSS). Adverse events were assessed using the Treatment Emergent Symptom Scale.

RESULTS

JXZDF produced greater improvements than aripiprazole in the following YGTSS subscale scores at the endpoint: total tic scores (P = 0.004, 95% CI: 1.085-3.494) and total motor scores (P = 0.004, 95% CI: 0.313-1.739). The difference in rate between the groups was no significant (χ² = 0.702, degrees of freedom = 1, P = 0.402). The overall incidence of adverse events was significantly lower in the JXZDF group than in the aripiprazole group (0% vs 6.67%, P < 0.001).

CONCLUSION

JXZDF had a better safety profile than aripiprazole, and it was not inferior in terms of clinical efficacy. JXZDF warrants consideration as a potential treatment option for TD.

TRIAL REGISTRATION

CHiCTR, ChiCTR2000039601 (Registered November 2, 2020).

Systematic review and meta-analyses of studies analysing instructions to authors from 1987 to 2017

To gain insight into changes of scholarly journals' recommendations, we conducted a systematic review of studies that analysed journals' Instructions to Authors (ItAs). We summarised results of 153 studies, and meta-analysed how often ItAs addressed: 1) authorship, 2) conflicts of interest, 3) data sharing, 4) ethics approval, 5) funding disclosure, and 6) International Committee of Medical Journal Editors' Uniform Requirements for Manuscripts. For each topic we found large between-study heterogeneity. Here, we show six factors that explained most of that heterogeneity: 1) time (addressing of topics generally increased over time), 2) country (large differences found between countries), 3) database indexation (large differences found between databases), 4) impact factor (topics were more often addressed in highest than in lowest impact factor journals), 5) discipline (topics were more often addressed in Health Sciences than in other disciplines), and 6) sub-discipline (topics were more often addressed in general than in sub-disciplinary journals).

Assessment of the reporting quality of randomised controlled trials of massage

Objective

To assess the reporting quality of randomised controlled trials (RCTs) of massage, particularly whether necessary elements related to massage interventions were adequately reported.

Methods

A total of 8 electronic databases were systematically searched for massage RCTs published in English and Chinese from the date of their inception to June 22, 2020. Quality assessment was performed using three instruments, namely the CONSORT (Consolidated Standards of Reporting Trials) 2010 Checklist (37 items), the CONSORT Extension for NPT (Nonpharmacologic Treatments) 2017 checklist (18 items), and a self-designed massage-specific checklist (16 items) which included massage rationale, intervention and control group details. Descriptive statistics were additionally used to analyse the baseline characteristics of included trials.

Results

A total of 2,447 massage RCTs were identified, of which most (96.8%) were distributed in China. For the completeness of CONSORT, NPT Extension, and massage-specific checklists, the average reporting percentages were 50%, 10% and 45%, respectively. Of 68 assessed items in total (exclusion of 3 repeated items on intervention), 42 were poorly presented, including 18 CONSORT items, 15 NPT items, and 9 massage-specific items. Although the overall quality of reporting showed slightly improvement in articles published after 2010, the international (English) journals presented a higher score of the CONSORT and NPT items, while the Chinese journals were associated with the increased score of massage-specific items.

Conclusion

The quality of reporting of published massage RCTs is variable and in need of improvement. Reporting guideline “CONSORT extension for massage” should be developed.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13020-021-00475-6.

Quality of reporting and risk of bias: a review of randomised trials in occupational health

Objectives

To assess the reporting quality of randomisation and allocation methods in occupational health and safety (OHS) trials in relation to Consolidated Standards of Reporting Trials (CONSORT) requirements of journals, risk of bias (RoB) and publication year.

Methods

We systematically searched for randomised controlled trials (RCTs) in PubMed between 2010 and May 2019 in 18 OHS journals. We measured reporting quality as percentage compliance with the CONSORT 2010 checklist (items 8–10) and RoB with the ROB V.2.0 tool (first domain). We tested the mean difference (MD) in % in reporting quality between CONSORT-requiring and non-requiring journals, trials with low, some concern and high RoB and publications before and after 2015.

Results

In 135 articles reporting on 129 RCTs, average reporting quality was at 37.4% compliance (95% CI 31.9% to 43.0%), with 10% of articles reaching 100% compliance. Reporting quality was significantly better in CONSORT-requiring journals than non-requiring journals (MD 31.0% (95% CI 21.4% to 40.7%)), for studies at low RoB than high RoB (MD 33.1% (95% CI 16.1% to 50.2%)) and with RoB of some concern (MD 39.8% (95% CI 30.0% to 49.7%)). Reporting quality did not improve over time (MD −5.7% (95% CI −16.8% to 5.4%).

Conclusions

Articles in CONSORT-requiring journals and of low RoB studies show better reporting quality. Low reporting quality is linked to unclear RoB judgements (some concern). Reporting quality did not improve over the last 10 years and CONSORT is insufficiently implemented. Concerted efforts by editors and authors are needed to improve CONSORT implementation.

Traditional Chinese exercise for COVID-19: A protocol for systematic review and meta-analysis

BACKGROUND

A new type of coronavirus (COVID-19), is spreading all over the world. Under the background of the comprehensive medical treatment and strict prevention and control in China, the number of discharged patients increased substantially. By the end of July, more than 80,000 patients had been cured and discharged from hospital in China. In order to effectively promote the full recovery of the patient's physical and mental functions and quality of life, gradually shift the emphasis of clinical work to convalescence therapy is very important, thus Chinese experts draw up Expert Consensus on Rehabilitation of Chinese Medicine for COVID-19. This systematic review and meta-analysis will assess studies of the effects of traditional Chinese exercise (TCE) for COVID-19 patients.

METHODS AND ANALYSIS

We will search 6 English and 4 Chinese databases by 01, December 2020. After a series of screening, Randomized Clinic Trials (RCTs) will be included related to TCE for COVID-19. Two assessors will use the Cochrane bias risk assessment tool to assess the RCTs. Finally, the evidence grade of the results will be evaluated.

RESULTS

This study will provide a reliable evidence for the selection of TCE therapies for COVID-19.

CONCLUSION

The results of this study will provide references for the selection of TCE treatment for COVID-19, and provide decision making references for clinical research.

PROSPERO REGISTRATION NUMBER

CRD42020179095.

Scoping review on interventions to improve adherence to reporting guidelines in health research

OBJECTIVES

The goal of this study is to identify, analyse and classify interventions to improve adherence to reporting guidelines in order to obtain a wide picture of how the problem of enhancing the completeness of reporting of biomedical literature has been tackled so far.

DESIGN

Scoping review.

SEARCH STRATEGY

We searched the MEDLINE, EMBASE and Cochrane Library databases and conducted a grey literature search for (1) studies evaluating interventions to improve adherence to reporting guidelines in health research and (2) other types of references describing interventions that have been performed or suggested but never evaluated. The characteristics and effect of the evaluated interventions were analysed. Moreover, we explored the rationale of the interventions identified and determined the existing gaps in research on the evaluation of interventions to improve adherence to reporting guidelines.

RESULTS

109 references containing 31 interventions (11 evaluated) were included. These were grouped into five categories: (1) training on the use of reporting guidelines, (2) improving understanding, (3) encouraging adherence, (4) checking adherence and providing feedback, and (5) involvement of experts. Additionally, we identified lack of evaluated interventions (1) on training on the use of reporting guidelines and improving their understanding, (2) at early stages of research and (3) after the final acceptance of the manuscript.

CONCLUSIONS

This scoping review identified a wide range of strategies to improve adherence to reporting guidelines that can be taken by different stakeholders. Additional research is needed to assess the effectiveness of many of these interventions.

Quality of randomized controlled trials of new generation antidepressants and antipsychotics identified in the China National Knowledge Infrastructure (CNKI): a literature and telephone interview study

Background

We are witnessing an exponential increase in the number of randomized controlled trials (RCTs) reported from mainland China. The increase is particularly notable in the field of new generation antidepressants and antipsychotics. Several previous studies have raised doubts regarding their quality. However, the quality of most recent RCTs published in China may have improved.

Methods

We searched RCTs that examined new generation antidepressants and antipsychotics published between 2013 and 2016 in the China National Knowledge Infrastructure (CNKI), the largest database of scientific publications in China. We interviewed the authors of a random subset of the identified references. We assessed the methodological rigor of each study based on the published reports and telephone interviews with the authors using six methodological domains adapted from the Cochrane’s risk of bias tool.

Results

The final sample consisted of 138 studies, for which we interviewed 58 authors; the authors of 51 studies declined the interview, and the authors of 29 studies could not be contacted. The 51 studies with refused interviews were significantly less likely to be reported from university-affiliated hospitals and were less likely to be published in Chinese core journals. Based on the published reports, most of the 58 studies were assessed to be at unclear risk of bias in most methodological domains. After the interview, only 10 studies were assessed to be at low risk of bias for sequence generation and allocation concealment. Assuming that the studies for which the authors declined interviews had an unclear risk, the proportion of RCTs at low risk of bias in both sequence generation and allocation concealment was 9.2% (10/109, 95% confidence interval [CI]: 5.0 to 16.2). The interviews indicated that the studies were at high risk of bias for most of the other domains.

Conclusion

In general, RCTs that evaluate new generation antidepressants or antipsychotics and are indexed in the CNKI continue to be of low quality. When conducting systematic reviews and meta-analyses in this field, it would be wise to include a specialist from China as a coresearcher to help assess the risk of bias in the identified studies.

Electronic supplementary material

The online version of this article (10.1186/s12874-018-0554-2) contains supplementary material, which is available to authorized users.

Effectiveness of acupuncture for cancer pain: protocol for an umbrella review and meta-analyses of controlled trials

INTRODUCTION

The National Comprehensive Cancer Network guidelines for adult cancer pain indicate that acupuncture and related therapies may be valuable additions to pharmacological interventions for pain management. Of the systematic reviews related to this topic, some concluded that acupuncture was promising for alleviating cancer pain, while others argued that the evidence was insufficient to support its effectiveness.

METHODS AND ANALYSIS

This review will consist of three components: (1) synthesis of findings from existing systematic reviews; (2) updated meta-analyses of randomised clinical trials and (3) analyses of results of other types of clinical studies. We will search six English and four Chinese biomedical databases, dissertations and grey literature to identify systematic reviews and primary clinical studies. Two reviewers will screen results of the literature searches independently to identify included reviews and studies. Data from included articles will be abstracted for assessment, analysis and summary. Two assessors will appraise the quality of systematic reviews using Assessment of Multiple Systematic Reviews; assess the randomised controlled trials using the Cochrane Collaboration's risk of bias tool and other types of studies according to the Newcastle-Ottawa Scale. We will use 'summary of evidence' tables to present evidence from existing systematic reviews and meta-analyses. Using the primary clinical studies, we will conduct meta-analysis for each outcome, by grouping studies based on the type of acupuncture, the comparator and the specific type of pain. Sensitivity analyses are planned according to clinical factors, acupuncture method, methodological characteristics and presence of statistical heterogeneity as applicable. For the non-randomised studies, we will tabulate the characteristics, outcome measures and the reported results of each study. Consistencies and inconsistencies in evidence will be investigated and discussed. Finally, we will use the Grading of Recommendations Assessment, Development and Evaluation approach to evaluate the quality of the overall evidence.

ETHICS AND DISSEMINATION

There are no ethical considerations associated with this review. The findings will be disseminated in peer-reviewed journals or conference presentations.

PROSPERO REGISTRATION NUMBER

CRD42017064113.

Comparative evidence on harms in pediatric randomized clinical trials from less developed versus more developed countries is limited

OBJECTIVES

Evaluate comparative harm rates from medical interventions in pediatric randomized clinical trials (RCTs) from more developed (MDCs) and less developed countries (LDCs).

STUDY DESIGN AND SETTING

Meta-epidemiologic empirical evaluation of Cochrane Database of Systematic Reviews (June 2014) meta-analyses reporting clinically important harm-outcomes (severe adverse events [AEs], discontinuations due to AEs, any AE, and mortality) that included at least one pediatric RCT from MDCs and at least one from LDCs. We estimated relative odds ratios (RORs) for each harm, within each meta-analysis, between RCTs from MDCs and LDCs and calculated random-effects-summary-RORs (sRORs) for each harm across multiple meta-analyses.

RESULTS

Only 1% (26/2,363) of meta-analyses with clinically important harm-outcomes in the entire Cochrane Database of Systematic Reviews included pediatric RCTs both from MDCs and LDCs. We analyzed 26 meta-analyses with 244 data sets from pediatric RCTs, 116 from MDCs and 128 from LDCs (64 and 66 unique RCTs respectively). The summary ROR was 0.92 (95% confidence intervals: 0.78-1.08) for severe AEs; 1.13 (0.54-2.34) for discontinuations due to AEs; 1.10 (0.77-1.59) for any AE; and 0.99 (0.61-1.61) for mortality and for the all-harms-combined-end point 0.96 (0.83-1.10). Differences of ROR-point-estimates ≥2-fold between MDCs and LDCs were identified in 35% of meta-analyses.

CONCLUSION

We found no major systematic differences in harm rates in pediatric trials between MDCs and LDCs, but data on harms in children were overall very limited.

Adherence to CONSORT Items in Randomized Controlled Trials of Integrative Medicine for Colorectal Cancer Published in Chinese Journals

BACKGROUND

The majority of studies of integrative treatment for colorectal cancer (CRC) have been published in Chinese journals. These studies indicate potential benefits, but concerns have been raised over the quality of trials published in Chinese journals. The CONSORT statement provides a guide for study reporting that has been endorsed by more than 400 international journals. Previous studies have used the CONSORT checklist to assess the quality of randomized controlled trials (RCTs).

OBJECTIVES

This study focused on RCTs of integrative and traditional medicine for CRC published in Chinese journals and assessed: (1) the overall quality of reporting with a focus on methodological aspects; (2) change over time; and (3) the influence of study funding, level of institution conducting the trial, rank of the journal, and the length of the article.

DESIGN

Searches of seven databases identified RCTs. Quality was assessed using CONSORT 2010 with adaptations to facilitate scoring. Additional codes were added for publication year, hospital rank, report length, and status of the journal. Scores of each checklist item, total scores, and scores for eight items associated with RCT methodology were calculated.

RESULTS

Eighty-one studies were included in the main analyses. The RCT methodology subgroup scores were significantly higher in studies: with public funding, conducted by authors from university hospitals, published in higher ranked journals, and in longer articles.

CONCLUSIONS

Few Chinese journals mention CONSORT in their author guidelines. In these RCTs on CRC better reporting of RCT methodology was associated with ranking of the journal as "core," public funding of the RCT, and first or correspondent author from a university hospital but the quality of reporting had not significantly improved in 15 years. As the volume of scientific information produced in China grows, it is imperative that there is growth in the quality of this information.

Efficacy and Safety of Adjunctive Aripiprazole in Schizophrenia: Meta-Analysis of Randomized Controlled Trials

This meta-analysis of randomized controlled trials (RCTs) evaluated the efficacy and safety of adding aripiprazole to other antipsychotics in schizophrenia. A systematic computer search identified 55 RCTs including 4457 patients who were randomized to aripiprazole (14.0 ± 7.0 mg/d) versus placebo (18 RCTs) or open antipsychotic treatment (37 RCTs). Aripiprazole significantly outperformed the comparison interventions based on psychiatric scales: (1) total score in 43 RCTs (N = 3351) with a standardized mean difference (SMD) of -0.48 (95% confidence interval [CI], -0.68 to -0.28; P < 0.00001; I = 88%), (2) negative symptom score in 30 RCTs (N = 2294) with an SMD of -0.61(95% CI, -0.91 to -0.31; P < 0.00001; I = 91%), and (3) general psychopathology score in 13 RCTs (N = 1138) with a weighted mean difference (WMD) of -4.02 (95% CI, -7.23 to -0.81; P = 0.01; I = 99%), but not in positive symptoms in 29 RCTs (N = 2223) with a SMD of -0.01 (95% CI, 0.26 to 0.25; P = 0.95; I = 88%). Differences in total score based on psychiatric scales may be explained by the use of an antipsychotic for comparison rather than placebo in 31 RCTs with a nonblind design. Aripiprazole outperformed the comparison interventions for body weight in 9 RCTs (N = 505) with a WMD of -5.08 kg (95% CI, -7.14 to -3.02; P < 0.00001; I = 35%) and for body mass index (BMI) in 14 RCTs (N = 809) with a WMD of -1.78 (CI: -2.25 to -1.31; P < 0.00001; I = 54%). The BMI meta-regression analysis indicated aripiprazole's association with lower BMI was stronger in females. Adjunctive aripiprazole appears safe but better RCTs are needed to demonstrate efficacy. Chinese journals and scientific societies should encourage the publication of high-quality RCTs and require registration in a centralized Chinese database.

Endorsement of the CONSORT statement by Chinese journals of Traditional Chinese Medicine: a survey of journal editors and review of journals' instructions for authors

BACKGROUND

We aimed to assess the endorsement of the Consolidation Standards of Reporting Trials (CONSORT) statement by Chinese journals of Traditional Chinese Medicine (TCM) and its incorporation into their editorial processes.

METHODS

PubMed, Embase and major Chinese databases were searched to identify journals of TCM from China for inclusion. The latest 'instruction for authors' (IFA) of each included journal was obtained and any text mentioning CONSORT or CONSORT extension papers was extracted. Subsequently, the editor of each of the included journals was surveyed about their journal's endorsement of the CONSORT recommendations and their incorporation into editorial and peer review processes.

RESULTS

Sixty-three journals of TCM from China were examined. Of these, only three (5%) and one (2%) of the 63 journals mentioned the CONSORT statement and extension papers, respectively, in their IFA. Fifty-four of 63 (86%) of surveyed journals responded, with the majority of respondents being editors. Only 20% (11/54) of the respondents reported that they had any knowledge of the CONSORT statement. Only 6% (3/54) of the editors reported that they required authors to comply with the CONSORT statement or that they incorporated it into their peer review and editorial processes.

CONCLUSIONS

TCM journals in China endorsing the CONSORT statement constituted a small percentage of the total. The majority of editors surveyed were not familiar with the content of the CONSORT statement and extension papers. We strongly recommend that the China Periodicals Association issue a policy to promote the endorsement of the CONSORT statement and conduct relevant training for journal editors in China.