1
|
Wang P, Wolfram D, Gilbert E. Endorsements of five reporting guidelines for biomedical research by journals of prominent publishers. PLoS One 2024; 19:e0299806. [PMID: 38421981 PMCID: PMC10903802 DOI: 10.1371/journal.pone.0299806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 02/01/2024] [Indexed: 03/02/2024] Open
Abstract
Biomedical research reporting guidelines provide a framework by which journal editors and the researchers who conduct studies can ensure that the reported research is both complete and transparent. With more than 16 different guidelines for the 11 major study types of medical and health research, authors need to be familiar with journal reporting standards. To assess the current endorsements of reporting guidelines for biomedical and health research, this study examined the instructions for authors (IFAs) of 559 biomedical journals by 11 prominent publishers that publish original research or systematic reviews/meta-analyses. Data from the above original sources were cleaned and restructured, and analyzed in a database and text miner. Each journal's instructions or information for authors were examined to code if any of five prominent reporting guidelines were mentioned and what form the guideline adherence demonstration took. Seventeen journals published the reporting guidelines. Four of the five reporting guidelines listed journals as endorsers. For journals with open peer review reports, a sample of journals and peer reviews was analyzed for mention of adherence to reporting guidelines. The endorsement of research guidelines by publishers and their associated journals is inconsistent for some publishers, with only a small number of journals endorsing relevant guidelines. Based on the analysis of open peer reviews, there is evidence that some reviewers check the adherence to the endorsed reporting guidelines. Currently, there is no universal endorsement of reporting guidelines by publishers nor ways of demonstrating adherence to guidelines. Journals may not directly inform authors of their guideline endorsements, making it more difficult for authors to adhere to endorsed guidelines. Suggestions derived from the findings are provided for authors, journals, and reporting guidelines to ensure increased adequate use of endorsed reporting guidelines.
Collapse
Affiliation(s)
- Peiling Wang
- School of Information Sciences, University of Tennessee-Knoxville, Knoxville, Tennessee, United States of America
| | - Dietmar Wolfram
- School of Information Studies, University of Wisconsin-Milwaukee, Milwaukee, Wisconsin, United States of America
| | - Emrie Gilbert
- School of Information Sciences, University of Tennessee-Knoxville, Knoxville, Tennessee, United States of America
| |
Collapse
|
2
|
Zhong J, Xing Y, Lu J, Zhang G, Mao S, Chen H, Yin Q, Cen Q, Jiang R, Hu Y, Ding D, Ge X, Zhang H, Yao W. The endorsement of general and artificial intelligence reporting guidelines in radiological journals: a meta-research study. BMC Med Res Methodol 2023; 23:292. [PMID: 38093215 PMCID: PMC10717715 DOI: 10.1186/s12874-023-02117-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 12/01/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND Complete reporting is essential for clinical research. However, the endorsement of reporting guidelines in radiological journals is still unclear. Further, as a field extensively utilizing artificial intelligence (AI), the adoption of both general and AI reporting guidelines would be necessary for enhancing quality and transparency of radiological research. This study aims to investigate the endorsement of general reporting guidelines and those for AI applications in medical imaging in radiological journals, and explore associated journal characteristic variables. METHODS This meta-research study screened journals from the Radiology, Nuclear Medicine & Medical Imaging category, Science Citation Index Expanded of the 2022 Journal Citation Reports, and excluded journals not publishing original research, in non-English languages, and instructions for authors unavailable. The endorsement of fifteen general reporting guidelines and ten AI reporting guidelines was rated using a five-level tool: "active strong", "active weak", "passive moderate", "passive weak", and "none". The association between endorsement and journal characteristic variables was evaluated by logistic regression analysis. RESULTS We included 117 journals. The top-five endorsed reporting guidelines were CONSORT (Consolidated Standards of Reporting Trials, 58.1%, 68/117), PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses, 54.7%, 64/117), STROBE (STrengthening the Reporting of Observational Studies in Epidemiology, 51.3%, 60/117), STARD (Standards for Reporting of Diagnostic Accuracy, 50.4%, 59/117), and ARRIVE (Animal Research Reporting of In Vivo Experiments, 35.9%, 42/117). The most implemented AI reporting guideline was CLAIM (Checklist for Artificial Intelligence in Medical Imaging, 1.7%, 2/117), while other nine AI reporting guidelines were not mentioned. The Journal Impact Factor quartile and publisher were associated with endorsement of reporting guidelines in radiological journals. CONCLUSIONS The general reporting guideline endorsement was suboptimal in radiological journals. The implementation of reporting guidelines for AI applications in medical imaging was extremely low. Their adoption should be strengthened to facilitate quality and transparency of radiological study reporting.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Junjie Lu
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, 200433, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Qingqing Cen
- Department of Dermatology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Run Jiang
- Department of Pharmacovigilance, Shanghai Hansoh BioMedical Co., Ltd., Shanghai, 201203, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
3
|
Gopinath VK, Shetty RM, Renugalakshmi A, Dharmarajan L, Prakash PSG, Jayaraman J. Reporting Quality of the Abstracts for Randomized Controlled Trials in Pediatric Dentistry. Eur J Dent 2023; 18:341-348. [PMID: 37553078 PMCID: PMC10959622 DOI: 10.1055/s-0043-1770912] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/10/2023] Open
Abstract
OBJECTIVES The purpose of this study is to systematically appraise the reporting quality of abstracts for randomized controlled trials (RCT) published in pediatric dentistry using Consolidated Standards of Reporting Trials (CONSORT) for abstracts and to analyze the relationship between the characteristics of the RCT to the quality of abstracts. MATERIALS AND METHODS RCTs published in Pediatric Dentistry were retrieved from the PubMed database from 2016 to 2021. The quality of abstracts was appraised using CONSORT for abstracts checklist by two independent reviewers. STATISTICAL ANALYSIS In descriptive statistics, frequency and percentage analysis were used for categorical variables, whereas mean and standard deviation were used for continuous variables. To find the significant difference between the bivariate samples in independent groups, Mann-Whitney U test was employed. Multivariate analysis was performed using Kruskal-Wallis test and Mann-Whitney U tests. Probability value of p-value less than 0.05 was considered as statistically significant. RESULTS Two hundred abstracts were included in the study. All the abstracts adequately reported the "objective" item, whereas only 2 and 4% of abstracts adequately addressed "randomization" and "harms" items, respectively. A significant relationship was observed between the continent of first author/corresponding author, number of authors, impact factor, adherence to CONSORT guidelines, word count, focus of study, and a priori protocol registration to the quality of abstracts (p < 0.05). CONCLUSION The abstracts of the RCT included in the study did not adequately follow the CONSORT for abstract guidelines. Adherence to the reporting guidelines would improve the overall reporting quality of abstracts of RCT published in Pediatric Dentistry. The overall mean score of the abstracts was 6.80 out of 15 indicating that the abstracts did not adequately follow the CONSORT for abstract reporting guidelines.
Collapse
Affiliation(s)
- Vellore Kannan Gopinath
- University of Sharjah, College of Dental Medicine, Department of Preventive and Restorative Dentistry, Sharjah, United Arab Emirates
| | - Raghavendra M. Shetty
- Department of Clinical Sciences, College of Dentistry, Ajman University, United Arab Emirates
- Center of Medical and Bio-allied Health Sciences Research, Ajman University, United Arab Emirates
- Adjunct Faculty, Department of Pediatric and Preventive Dentistry, Sharad Pawar Dental College and Hospital, Datta Meghe Institute of Higher Education and Research (Declared as Deemed-to-be University), Wardha, Maharashtra, India
| | - Apathsakayan Renugalakshmi
- Department of Preventive Dental Sciences, Division of Pedodontics, College of Dentistry, Jazan University, Jazan, Saudi Arabia
- Department of Pediatric and Preventive Dentistry, Saveetha Institute of Medical and Technical Sciences, Saveetha University, Chennai, India
| | - Lalli Dharmarajan
- Department of Periodontics, S.R.M Dental College, Ramapuram, Chennai 600089, Tamil Nadu, India
| | | | - Jayakumar Jayaraman
- Department of Pediatric Dentistry, Virginia Commonwealth University School of Dentistry, Richmond 23298, Virginia, United States
| |
Collapse
|
4
|
Puljak L. Challenges with defining a meta-epidemiological study as "study in which the unit of analysis is a study, not a patient": author's reply. J Clin Epidemiol 2023; 154:220-221. [PMID: 36503006 DOI: 10.1016/j.jclinepi.2022.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 12/06/2022] [Indexed: 12/13/2022]
Affiliation(s)
- Livia Puljak
- Center for Evidence-Based Medicine and Health Care, Catholic University of Croatia, Zagreb, Croatia.
| |
Collapse
|
5
|
Kim SY. Suggestion of more suitable study designs and the corresponding reporting guidelines in articles published in the Journal of Educational Evaluation for Health Professions from 2021 to September 2022: a descriptive study. JOURNAL OF EDUCATIONAL EVALUATION FOR HEALTH PROFESSIONS 2022; 19:36. [PMID: 36567310 PMCID: PMC9889887 DOI: 10.3352/jeehp.2022.19.36] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Accepted: 12/24/2022] [Indexed: 06/17/2023]
Abstract
PURPOSE This study aimed to suggest a more suitable study design and the corresponding reporting guidelines in the papers published in the Journal of Educational Evaluation for Health Professionals from January 2021 to September 2022. METHODS Among 59 papers published in the Journal of Educational Evaluation for Health Professionals from January 2021 to September 2022, research articles, review articles, and brief reports were selected. The followings were analyzed: first, the percentage of articles describing the study design in the title, abstracts, or methods; second, the portion of articles describing reporting guidelines; third, the types of study design and corresponding reporting guidelines; and fourth, the suggestion of a more suitable study design based on the study design algorithm for medical literature on interventions, systematic reviews & other review types, and epidemiological studies overview. RESULTS Out of 45 articles, 44 described study designs (97.8%). Out of 44, 19 articles were suggested to be described with more suitable study designs, which mainly occurred in before-and-after studies, diagnostic research, and non-randomized trials. Of the 18 reporting guidelines mentioned, 8 (44.4%) were considered perfect. STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) was used for descriptive studies, before-and-after studies, and randomized controlled trials; however, its use should be reconsidered. CONCLUSION Some declarations of study design and reporting guidelines were suggested to be described with more suitable ones. Education and training on study design and reporting guidelines for researchers are needed, and reporting guideline policies for descriptive studies should also be implemented.
Collapse
Affiliation(s)
- Soo Young Kim
- Department of Family Medicine, Kangdong Sacred Heart Hospital, Hallym University College of Medicine, Seoul, Korea
| |
Collapse
|
6
|
Held U, Steigmiller K, Hediger M, Gosteli M, Reeve KA, von Felten S, Furrer E. Is reporting quality in medical publications associated with biostatisticians as co-authors? A registered report protocol. PLoS One 2020; 15:e0241897. [PMID: 33156885 PMCID: PMC7647072 DOI: 10.1371/journal.pone.0241897] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Accepted: 10/22/2020] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Quality in medical research has recently been criticized for being low, especially in observational research. Methodology is increasingly difficult, but collaboration between clinical researchers and biostatisticians may improve research and reporting quality. The aim of this study is to quantify the value of a biostatistician in the team of authors. METHODS Single-center, retrospective observational study following the STROBE reporting guidelines. We will systematically review all medical publications with biostatisticians from our center as co-authors or authors and review corresponding papers without biostatisticians from our center during the same time range. We will compare aspects of reporting quality, overall and for the three study types observational, randomized trial, and prognostic separately. DISCUSSION We anticipate that the results of the study will raise awareness of the importance of high methodological quality, as well as appropriate reporting quality in clinical research. CONCLUSION Our study will have a direct impact on our center by making each of us more aware of the reporting guidelines for various research designs. This in turn will enhance reporting quality in future research with our involvement. Our study will also raise awareness of the important role that biostatisticians play in the design and analysis of health research projects.
Collapse
Affiliation(s)
- Ulrike Held
- Department of Biostatistics at Epidemiology, Biostatistics, and Prevention Institute, University of Zurich, Zurich, Switzerland
- * E-mail:
| | - Klaus Steigmiller
- Department of Biostatistics at Epidemiology, Biostatistics, and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Michael Hediger
- Institute of Mathematics, University of Zurich, Zurich, Switzerland
| | | | - Kelly A. Reeve
- Department of Biostatistics at Epidemiology, Biostatistics, and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Stefanie von Felten
- Department of Biostatistics at Epidemiology, Biostatistics, and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Eva Furrer
- Department of Biostatistics at Epidemiology, Biostatistics, and Prevention Institute, University of Zurich, Zurich, Switzerland
| |
Collapse
|
7
|
McGowan J, Straus S, Moher D, Langlois EV, O'Brien KK, Horsley T, Aldcroft A, Zarin W, Garitty CM, Hempel S, Lillie E, Tunçalp Ӧ, Tricco AC. Reporting scoping reviews—PRISMA ScR extension. J Clin Epidemiol 2020; 123:177-179. [DOI: 10.1016/j.jclinepi.2020.03.016] [Citation(s) in RCA: 53] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2020] [Accepted: 03/24/2020] [Indexed: 12/23/2022]
|