A survey exploring biomedical editors' perceptions of editorial interventions to improve adherence to reporting guidelines

Effect of an editorial intervention to improve the completeness of reporting of randomised trials: a randomised controlled trial

OBJECTIVE

To evaluate the impact of an editorial intervention to improve completeness of reporting of reports of randomised trials.

DESIGN

Randomised controlled trial (RCT).

SETTING

BMJ Open's quality improvement programme.

PARTICIPANTS

24 manuscripts describing RCTs.

INTERVENTIONS

We used an R Shiny application to randomise manuscripts (1:1 allocation ratio, blocks of 4) to the intervention (n=12) or control (n=12) group. The intervention was performed by a researcher with expertise in the content of the Consolidated Standards of Reporting Trials (CONSORT) and consisted of an evaluation of completeness of reporting of eight core CONSORT items using the submitted checklist to locate information, and the production of a report containing specific requests for authors based on the reporting issues found, provided alongside the peer review reports. The control group underwent the usual peer review.

OUTCOMES

The primary outcome is the number of adequately reported items (0-8 scale) in the revised manuscript after the first round of peer review. The main analysis was intention-to-treat (n=24), and we imputed the scores of lost to follow-up manuscripts (rejected after peer review and not resubmitted). The secondary outcome is the proportion of manuscripts where each item was adequately reported. Two blinded reviewers assessed the outcomes independently and in duplicate and solved disagreements by consensus. We also recorded the amount of time to perform the intervention.

RESULTS

Manuscripts in the intervention group (mean: 7.01; SD: 1.47) were more completely reported than those in the control group (mean: 5.68; SD: 1.43) (mean difference 1.43, 95% CI 0.31 to 2.58). We observed the main differences in items 6a (outcomes), 9 (allocation concealment mechanism), 11a (blinding) and 17a (outcomes and estimation). The mean time to perform the intervention was 87 (SD 42) min.

CONCLUSIONS

We demonstrated the benefit of involving a reporting guideline expert in the editorial process. Improving the completeness of RCTs is essential to enhance their usability.

TRIAL REGISTRATION NUMBER

NCT03751878.

A survey exploring biomedical editors' perceptions of editorial interventions to improve adherence to reporting guidelines

Background: Improving the completeness of reporting of biomedical research is essential for improving its usability. For this reason, hundreds of reporting guidelines have been created in the last few decades but adherence to these remains suboptimal. This survey aims to inform future evaluations of interventions to improve adherence to reporting guidelines. In particular, it gathers editors' perceptions of a range of interventions at various stages in the editorial process.   Methods: We surveyed biomedical journal editors that were knowledgeable about this topic. The questionnaire included open and closed questions that explored (i) the current practice of their journals, (ii) their perceptions of the ease of implementation and the potential effectiveness of different interventions, (iii) the barriers and facilitators associated with these interventions, and (iv) suggestions for future interventions and incentives. Results: Of the 99 editors invited, 24 (24%) completed the survey. Involving trained editors or administrative staff was deemed the potentially most effective intervention but, at the same time, it was considered moderately difficult to implement due to logistic and resource issues. Participants believed that checking adherence to guidelines goes beyond the role of peer reviewers and could decrease the overall quality of reviews. Journals incentivising adherence, and publishers and medical institutions encouraging journals to adopt strategies to boost adherence were two recurrent themes. Conclusions: Further evaluation of interventions are required. These evaluations could take into account the points raised in this survey.

A survey exploring biomedical editors' perceptions of editorial interventions to improve adherence to reporting guidelines

Background: Improving the completeness of reporting of biomedical research is essential for improving its usability. For this reason, hundreds of reporting guidelines have been created in the last few decades but adherence to these remains suboptimal. This survey aims to inform future evaluations of interventions to improve adherence to reporting guidelines. In particular, it gathers editors' perceptions of a range of interventions at various stages in the editorial process.   Methods: We surveyed biomedical journal editors that were knowledgeable about this topic. The questionnaire included open and closed questions that explored (i) the current practice of their journals, (ii) their perceptions of the ease of implementation and the potential effectiveness of different interventions, (iii) the barriers and facilitators associated with these interventions, and (iv) suggestions for future interventions and incentives. Results: Of the 99 editors invited, 24 (24%) completed the survey. Involving trained editors or administrative staff was deemed the potentially most effective intervention but, at the same time, it was considered moderately difficult to implement due to logistic and resource issues. Participants believed that checking adherence to guidelines goes beyond the role of peer reviewers and could decrease the overall quality of reviews. Journals incentivising adherence, and publishers and medical institutions encouraging journals to adopt strategies to boost adherence were two recurrent themes. Conclusions: Further evaluation of interventions are required. These evaluations could take into account the points raised in this survey.