Endorsement for improving the quality of reports on randomized controlled trials of traditional medicine journals in Korea: a systematic review

Reporting Quality of the Abstracts for Randomized Controlled Trials in Pediatric Dentistry

OBJECTIVES

 The purpose of this study is to systematically appraise the reporting quality of abstracts for randomized controlled trials (RCT) published in pediatric dentistry using Consolidated Standards of Reporting Trials (CONSORT) for abstracts and to analyze the relationship between the characteristics of the RCT to the quality of abstracts.

MATERIALS AND METHODS

 RCTs published in Pediatric Dentistry were retrieved from the PubMed database from 2016 to 2021. The quality of abstracts was appraised using CONSORT for abstracts checklist by two independent reviewers.

STATISTICAL ANALYSIS

 In descriptive statistics, frequency and percentage analysis were used for categorical variables, whereas mean and standard deviation were used for continuous variables. To find the significant difference between the bivariate samples in independent groups, Mann-Whitney U test was employed. Multivariate analysis was performed using Kruskal-Wallis test and Mann-Whitney U tests. Probability value of p-value less than 0.05 was considered as statistically significant.

RESULTS

 Two hundred abstracts were included in the study. All the abstracts adequately reported the "objective" item, whereas only 2 and 4% of abstracts adequately addressed "randomization" and "harms" items, respectively. A significant relationship was observed between the continent of first author/corresponding author, number of authors, impact factor, adherence to CONSORT guidelines, word count, focus of study, and a priori protocol registration to the quality of abstracts (p < 0.05).

CONCLUSION

 The abstracts of the RCT included in the study did not adequately follow the CONSORT for abstract guidelines. Adherence to the reporting guidelines would improve the overall reporting quality of abstracts of RCT published in Pediatric Dentistry. The overall mean score of the abstracts was 6.80 out of 15 indicating that the abstracts did not adequately follow the CONSORT for abstract reporting guidelines.

Systematic review and meta-analyses of studies analysing instructions to authors from 1987 to 2017

To gain insight into changes of scholarly journals' recommendations, we conducted a systematic review of studies that analysed journals' Instructions to Authors (ItAs). We summarised results of 153 studies, and meta-analysed how often ItAs addressed: 1) authorship, 2) conflicts of interest, 3) data sharing, 4) ethics approval, 5) funding disclosure, and 6) International Committee of Medical Journal Editors' Uniform Requirements for Manuscripts. For each topic we found large between-study heterogeneity. Here, we show six factors that explained most of that heterogeneity: 1) time (addressing of topics generally increased over time), 2) country (large differences found between countries), 3) database indexation (large differences found between databases), 4) impact factor (topics were more often addressed in highest than in lowest impact factor journals), 5) discipline (topics were more often addressed in Health Sciences than in other disciplines), and 6) sub-discipline (topics were more often addressed in general than in sub-disciplinary journals).

Assessment of the Quality of Case Reports in the Journal of Acupuncture Research Using the CARE and STRICTA Guidelines

The purpose of this study was to assess the quality of the case reports in the Journal of Acupuncture Research (JAR). All case reports were retrieved from November 2017 to June 2020. There were 19 case reports included in this assessment based on the case report (CARE) guidelines and case report and standards for reporting interventions in clinical trials of acupuncture (STRICTA) guidelines. The overall quality of reporting was relatively high (83.08% on Case Report guidelines and 77.78% on Standards for Reporting Interventions in Clinical Trials of Acupuncture guidelines), but several crucial items remained substantially underreported, such as identifying as a case report (keywords), patient information and perspective, clinical findings, diagnostic assessment, and intervention information. In 18 out of 19 included case reports of acupuncturerelated interventions, several items remained considerably underreported such as acupuncture regimen variation, depth of needle insertion, response sought, and experience of acupuncturists. In the classification by disease, condition, or syndrome, 13 out of 19 included case reports were for musculoskeletal disorders (68.4%), which is the main clinical medical field of Korean medicine services. The results of this study may help develop more appropriate reporting guidelines for case reports published in JAR.

Scoping review on interventions to improve adherence to reporting guidelines in health research

OBJECTIVES

The goal of this study is to identify, analyse and classify interventions to improve adherence to reporting guidelines in order to obtain a wide picture of how the problem of enhancing the completeness of reporting of biomedical literature has been tackled so far.

DESIGN

Scoping review.

SEARCH STRATEGY

We searched the MEDLINE, EMBASE and Cochrane Library databases and conducted a grey literature search for (1) studies evaluating interventions to improve adherence to reporting guidelines in health research and (2) other types of references describing interventions that have been performed or suggested but never evaluated. The characteristics and effect of the evaluated interventions were analysed. Moreover, we explored the rationale of the interventions identified and determined the existing gaps in research on the evaluation of interventions to improve adherence to reporting guidelines.

RESULTS

109 references containing 31 interventions (11 evaluated) were included. These were grouped into five categories: (1) training on the use of reporting guidelines, (2) improving understanding, (3) encouraging adherence, (4) checking adherence and providing feedback, and (5) involvement of experts. Additionally, we identified lack of evaluated interventions (1) on training on the use of reporting guidelines and improving their understanding, (2) at early stages of research and (3) after the final acceptance of the manuscript.

CONCLUSIONS

This scoping review identified a wide range of strategies to improve adherence to reporting guidelines that can be taken by different stakeholders. Additional research is needed to assess the effectiveness of many of these interventions.

Quality of critical care clinical practice guidelines: Assessment with AGREE II instrument

STUDY OBJECTIVE

Clinical practice guidelines (CPGs) are cornerstones for the management of critically ill patients. Numerous CPGs have been generated in critical care medicine, but their qualities have never been systematically appraised. The aim of the present study was to systematically assess the quality of critical care CPGs.

DESIGN

A systematic electronic search was performed in PubMed and Scopus. All critical care CPGs were included for analysis.

SETTING

Not applicable.

PATIENTS

Not applicable.

INTERVENTION

None.

MEASUREMENTS

The Appraisal of guidelines for research & evaluation II (AGREE II) instrument was employed to appraise the quality. CPGs were assessed independently by three raters and intraclass correlation coefficient to represent the agreement among raters.

MAIN RESULTS

A total of 89 CPGs were included for quantitative analysis. The results showed that domain 1 (scope and purpose) had the highest scores (0.93, IQR: 0.89-0.98) and domain 2 (stakeholder involvement) had the lowest scores (0.37, IQR: 0.30-0.46). The overall score was 0.83 (IQR: 0.67-0.83). Publication year was not associated with scaled scores in each domain. Domain 2 (stakeholder involvement) was significantly associated with the number of societies (coefficient: 0.702, p = 0.033). Also, greater number of societies were associated with higher scaled scores of domain 3 (coefficient: 0.768, p = 0.027), 4 (coefficient: 0.730, p = 0.029) and 5 (coefficient: 0.995, p = 0.023).

CONCLUSIONS

The study showed that the reporting quality of critical care CPGs were suboptimal. The reporting quality varied across the six domains, with the highest quality in domain 1 and lowest quality in domain 2. Strenuous efforts need to be made to improve the reporting of critical care CPGs.

Does the medical literature remain inadequately described despite having reporting guidelines for 21 years? - A systematic review of reviews: an update

PURPOSE

Reporting guidelines (eg, Consolidated Standards of Reporting Trials [CONSORT] statement) are intended to improve reporting standards and enhance the transparency and reproducibility of research findings. Despite accessibility of such guidelines, researchers are not required to adhere to them. Our goal was to determine the current status of reporting quality in the medical literature and examine whether adherence of reporting guidelines has improved since the inception of reporting guidelines.

MATERIALS AND METHODS

Eight reporting guidelines, such as CONSORT, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), STrengthening the Reporting of OBservational studies in Epidemiology (STROBE), Quality of Reporting of Meta-analysis (QUOROM), STAndards for Reporting of Diagnostic accuracy (STARD), Animal Research: Reporting In Vivo Experiments (ARRIVE), Consolidated Health Economic Evaluation Reporting Standards (CHEERS), and Meta-analysis of Observational Studies in Epidemiology (MOOSE) were examined. Our inclusion criteria included reviews published between January 1996 to September 2016 which investigated the adherence to reporting guidelines in the literature that addressed clinical trials, systematic reviews, observational studies, meta-analysis, diagnostic accuracy, economic evaluations, and preclinical animal studies that were in English. All reviews were found on Web of Science, Excerpta Medical Database (EMBASE), MEDLINE, and Cumulative Index to Nursing and Allied Health Literature (CINAHL).

RESULTS

Among the general searching of 26,819 studies by using the designed searching method, 124 studies were included post screening. We found that 87.9% of the included studies reported suboptimal adherence to reporting guidelines. Factors associated with poor adherence included non-pharmacological interventions, year of publication, and trials concluding with significant results. Improved adherence was associated with better study designs such as allocation concealment, random sequence, large sample sizes, adequately powered studies, multiple authorships, and being published in journals endorsing guidelines.

CONCLUSION

We conclude that the level of adherence to reporting guidelines remains suboptimal. Endorsement of reporting guidelines by journals is important and recommended.

Adherence to the CONSORT Statement in the Reporting of Randomized Controlled Trials on Pharmacological Interventions Published in Iranian Medical Journals

BACKGROUND

Among manuscripts submitted to biomedical journals, randomized controlled trials (RCTs) form the backbone of evidence-based medicine. Hence, their protocol should be designed rigorously and their results should be reported clearly. To improve the quality of RCT reporting, researchers developed the CONSORT Statement in 1996 and updated it in 2010. This study was designed to assess the quality of RCT reporting vis-à-vis adherence to CONSORT among articles published in Iranian medical journals (English, Persian, CONSORT-endorsing, and non-CONSORT-endorsing).

METHODS

In this cross-sectional study, all RCTs published in all Iranian medical journals from September 2012 to September 2013 were retrieved to evaluate their adherence to CONSORT. The journals' instructions for authors were also reviewed to find out whether or not they endorsed CONSORT. The CONSORT 2010 Checklist was used. Microsoft Excel 2007 was applied to analyze the data, and MedCalc was employed to compare the groups.

RESULTS

Totally, 492 pharmacological RCTs that met our inclusion criteria were identified. Twenty-five items were reported in fewer than 50% of the articles. The differences between the articles published in Persian and English language journals were statistically significant in 17 items. The differences between the articles published in the CONSORT-endorsing and non-CONSORT-endorsing journals were significant in 8 items.

CONCLUSION

Our findings showed very weak adherence to CONSORT. Authors, reviewers, and editors should be trained to use standards expressed by the CONSORT Group in reporting RCTs.

The Current Status of Quality of Reporting in Acupuncture Treatment Case Reports: An Analysis of the Core Journal in Korea

OBJECTIVES

The present study aimed to evaluate the overall quality of case reports concerning acupuncture treatment in Korea.

METHODS

We selected a representative Korean journal and retrieved eligible case reports on acupuncture treatment published from 2009 to 2015. We assessed the quality of reporting based on CAse REport (CARE) and STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA) guideline checklists.

RESULTS

A total of 93 eligible case reports of acupuncture treatment were identified among the 107 articles screened. Overall quality of reporting in the case reports was generally acceptable (75.4% on CARE, 67.7% on STRICTA), but several crucial items remained substantially underreported.

CONCLUSIONS

Endorsement of the CARE and STRICTA guidelines is needed to improve the completeness of reporting. Our findings will be helpful in developing a more appropriate reporting guideline for case reports in acupuncture treatment.

The Content of Statistical Requirements for Authors in Biomedical Research Journals

BACKGROUND

Robust statistical designing, sound statistical analysis, and standardized presentation are important to enhance the quality and transparency of biomedical research. This systematic review was conducted to summarize the statistical reporting requirements introduced by biomedical research journals with an impact factor of 10 or above so that researchers are able to give statistical issues' serious considerations not only at the stage of data analysis but also at the stage of methodological design.

METHODS

Detailed statistical instructions for authors were downloaded from the homepage of each of the included journals or obtained from the editors directly via email. Then, we described the types and numbers of statistical guidelines introduced by different press groups. Items of statistical reporting guideline as well as particular requirements were summarized in frequency, which were grouped into design, method of analysis, and presentation, respectively. Finally, updated statistical guidelines and particular requirements for improvement were summed up.

RESULTS

Totally, 21 of 23 press groups introduced at least one statistical guideline. More than half of press groups can update their statistical instruction for authors gradually relative to issues of new statistical reporting guidelines. In addition, 16 press groups, covering 44 journals, address particular statistical requirements. The most of the particular requirements focused on the performance of statistical analysis and transparency in statistical reporting, including "address issues relevant to research design, including participant flow diagram, eligibility criteria, and sample size estimation," and "statistical methods and the reasons."

CONCLUSIONS

Statistical requirements for authors are becoming increasingly perfected. Statistical requirements for authors remind researchers that they should make sufficient consideration not only in regards to statistical methods during the research design, but also standardized statistical reporting, which would be beneficial in providing stronger evidence and making a greater critical appraisal of evidence more accessible.