Quality of reporting of integrative Chinese and Western medicine intervention in randomized controlled trials of ulcerative colitis: a review

BACKGROUND

Integrative Chinese and Western medicine (ICWM) is commonly used for the treatment of ulcerative colitis (UC) in clinical practice. However, it is unclear whether the details of ICWM interventions, such as selection rationale, implementation design, and potential interactions, were adequately reported. Therefore, this study aimed to assess the quality of reporting in the ICWM interventional randomized controlled trials (RCTs) of UC and to identify the common problems if any.

METHODS

Through a search of 10 international electronic databases, we identified RCTs of UC with ICWM interventions published in English or Chinese from the inception date of each database up to 16 June 2023. Literature screening was strictly conducted based on the inclusion and exclusion criteria of the Population, Concept, and Context (PCC) framework. The general characteristics of the included studies were described. The quality of reporting was assessed according to three checklists, including the CONSORT (Consolidated Standards of Reporting Trials) with 36 items (except for one item 1b about abstract), the CONSORT for Abstracts (17 items), and a self-designed ICWM-related checklist (27 items covering design rationale, intervention details, outcome assessments, and analysis). The reporting scores of RCTs published before and after 2010 were compared.

RESULTS

A total of 1458 eligible RCTs were included. For the reporting compliance, the median score (interquartile ranges) of the CONSORT (72 score in total), the CONSORT for Abstract (34 score), and ICWM-related (54 score) items was 21 (18-25), 13 (12-15), and 18 (15-21), respectively. Although the time period comparisons showed that reporting quality of included publications improved significantly after the CONSORT 2010 issued (P < 0.01), more than 50% of items were evaluated as poor quality (reporting rate < 65%) among each checklist, especially in the CONSORT for Abstract and ICWM-specific items.

CONCLUSION

Although CONSORT appears to have enhanced the reporting of RCTs in UC, the quality of ICWM specifics is variable and in need of improvement. Reporting guidelines of the ICWM recommendations should be developed to improve their quality.

Development of consensus-driven SPIRIT and CONSORT extensions for early phase dose-finding trials: the DEFINE study

BACKGROUND

Early phase dose-finding (EPDF) trials are crucial for the development of a new intervention and influence whether it should be investigated in further trials. Guidance exists for clinical trial protocols and completed trial reports in the SPIRIT and CONSORT guidelines, respectively. However, both guidelines and their extensions do not adequately address the characteristics of EPDF trials. Building on the SPIRIT and CONSORT checklists, the DEFINE study aims to develop international consensus-driven guidelines for EPDF trial protocols (SPIRIT-DEFINE) and reports (CONSORT-DEFINE).

METHODS

The initial generation of candidate items was informed by reviewing published EPDF trial reports. The early draft items were refined further through a review of the published and grey literature, analysis of real-world examples, citation and reference searches, and expert recommendations, followed by a two-round modified Delphi process. Patient and public involvement and engagement (PPIE) was pursued concurrently with the quantitative and thematic analysis of Delphi participants' feedback.

RESULTS

The Delphi survey included 79 new or modified SPIRIT-DEFINE (n = 36) and CONSORT-DEFINE (n = 43) extension candidate items. In Round One, 206 interdisciplinary stakeholders from 24 countries voted and 151 stakeholders voted in Round Two. Following Round One feedback, one item for CONSORT-DEFINE was added in Round Two. Of the 80 items, 60 met the threshold for inclusion (≥ 70% of respondents voted critical: 26 SPIRIT-DEFINE, 34 CONSORT-DEFINE), with the remaining 20 items to be further discussed at the consensus meeting. The parallel PPIE work resulted in the development of an EPDF lay summary toolkit consisting of a template with guidance notes and an exemplar.

CONCLUSIONS

By detailing the development journey of the DEFINE study and the decisions undertaken, we envision that this will enhance understanding and help researchers in the development of future guidelines. The SPIRIT-DEFINE and CONSORT-DEFINE guidelines will allow investigators to effectively address essential items that should be present in EPDF trial protocols and reports, thereby promoting transparency, comprehensiveness, and reproducibility.

TRIAL REGISTRATION

SPIRIT-DEFINE and CONSORT-DEFINE are registered with the EQUATOR Network ( https://www.equator-network.org/ ).

Reporting quality of randomized controlled trials of angina pectoris with integrated traditional Chinese and western medicine interventions: a cross-sectional study

BACKGROUND AND OBJECTIVE

Integrated traditional Chinese and western medicine (ITCWM), as a representative type of complex intervention, is commonly used for the treatment of angina pectoris (AP) in clinical practice. However, it is unclear whether the details of ITCWM interventions, such as rationale for selection and design, implementation and potential interactions for different therapies, were adequately reported. Therefore, this study aimed to describe the reporting characteristics and quality in randomized controlled trials (RCTs) of AP with ITCWM interventions.

METHODS

Through a search of 7 electronic databases, we identified RCTs of AP with ITCWM interventions published in both English and Chinese from 1^st Jan 2017 to 6^th Aug 2022. The general characteristics of included studies were summarized, further, the quality of reporting was assessed based on three Checklists, including the CONSORT with 36 items (except for one item 1b about abstract), the CONSORT for abstracts (17 items), and a self-designed ITCWM-related checklist (21 items covering rationale and details of interventions, outcome assessment and analysis). The quality of RCTs published in English and Chinese, as well as journals and dissertations were also compared.

RESULTS

A total of 451 eligible RCTs were included. For the reporting compliance, the mean score (95% Confidence Interval) of the CONSORT (72 scores in total), CONSORT for abstract (34 scores in total), and ITCWM-related (42 scores in total) checklists was 27.82 (27.44-28.19), 14.17 (13.98-14.37) and 21.06 (20.69-21.43), respectively. More than half items were evaluated as poor quality (reporting rate < 50%) among each Checklist. Moreover, the reporting quality of publications in English journals was higher than that in Chinese journals in terms of the CONSORT items. The reporting of published dissertations was better than that in journal publications regarding both the CONSORT and ITCWM-specific items.

CONCLUSION

Although the CONSORT appears to have enhanced the reporting of RCTs in AP, the quality of ITCWM specifics is variable and in need of improvement. Reporting guideline of the ITCWM recommendations should be developed thus to improve their quality.

A Cross-sectional literature survey showed the reporting quality of multicenter randomized controlled trials should be improved

OBJECTIVE

To assess the reporting quality of randomized controlled trials (RCTs) with multicenter design, particularly whether necessary information related to multicenter characteristics was adequately reported.

STUDY DESIGN AND SETTING

Through a search of 4 international electronic databases, we identified multicenter RCTs published in English from 1975 to 2019. Reporting quality was assessed by the CONSORT (Consolidated Standards of Reporting Trials) checklist (37 items) and by a self-designed multicenter-specific checklist (27 items covering multicenter design, implement and analysis). The scores of trials published in three time periods (1975-1995; 1996-2009; and 2010-2019) were also compared.

RESULTS

A total of 2,844 multicenter RCTs were included. For the CONSORT checklist, the mean (standard deviation) reporting score was 24.1 (5.5), 12 items were assessed as excellent (>90%), 12 items as good (50%-90%), and 13 items as poor (<50%). For the multicenter checklist, the reporting score was 3.9 (2.2), only 3 items were excellent or good, and the remaining 24 items were poor. Time period comparison showed that reporting quality improved over time, especially after the CONSORT 2010 issued.

CONCLUSION

Although CONSORT appears to have enhanced the reporting quality of multicenter RCTs, further improvement is needed. A "CONSORT extension for multicenter trials" should be developed.

Problems of subgroup analysis in randomized controlled trial

Multiple subgroup analyses of the same data increase the risk of generating false positive findings. All outcomes and planned subgroup analyses should thus be prespecified and described in the original trial registry. When outcome changes during an ongoing trial seem justifiable, publications must disclose and explain such changes.