1
|
Zhong J, Xing Y, Lu J, Zhang G, Mao S, Chen H, Yin Q, Cen Q, Jiang R, Hu Y, Ding D, Ge X, Zhang H, Yao W. The endorsement of general and artificial intelligence reporting guidelines in radiological journals: a meta-research study. BMC Med Res Methodol 2023; 23:292. [PMID: 38093215 PMCID: PMC10717715 DOI: 10.1186/s12874-023-02117-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 12/01/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND Complete reporting is essential for clinical research. However, the endorsement of reporting guidelines in radiological journals is still unclear. Further, as a field extensively utilizing artificial intelligence (AI), the adoption of both general and AI reporting guidelines would be necessary for enhancing quality and transparency of radiological research. This study aims to investigate the endorsement of general reporting guidelines and those for AI applications in medical imaging in radiological journals, and explore associated journal characteristic variables. METHODS This meta-research study screened journals from the Radiology, Nuclear Medicine & Medical Imaging category, Science Citation Index Expanded of the 2022 Journal Citation Reports, and excluded journals not publishing original research, in non-English languages, and instructions for authors unavailable. The endorsement of fifteen general reporting guidelines and ten AI reporting guidelines was rated using a five-level tool: "active strong", "active weak", "passive moderate", "passive weak", and "none". The association between endorsement and journal characteristic variables was evaluated by logistic regression analysis. RESULTS We included 117 journals. The top-five endorsed reporting guidelines were CONSORT (Consolidated Standards of Reporting Trials, 58.1%, 68/117), PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses, 54.7%, 64/117), STROBE (STrengthening the Reporting of Observational Studies in Epidemiology, 51.3%, 60/117), STARD (Standards for Reporting of Diagnostic Accuracy, 50.4%, 59/117), and ARRIVE (Animal Research Reporting of In Vivo Experiments, 35.9%, 42/117). The most implemented AI reporting guideline was CLAIM (Checklist for Artificial Intelligence in Medical Imaging, 1.7%, 2/117), while other nine AI reporting guidelines were not mentioned. The Journal Impact Factor quartile and publisher were associated with endorsement of reporting guidelines in radiological journals. CONCLUSIONS The general reporting guideline endorsement was suboptimal in radiological journals. The implementation of reporting guidelines for AI applications in medical imaging was extremely low. Their adoption should be strengthened to facilitate quality and transparency of radiological study reporting.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Junjie Lu
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, 200433, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Qingqing Cen
- Department of Dermatology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Run Jiang
- Department of Pharmacovigilance, Shanghai Hansoh BioMedical Co., Ltd., Shanghai, 201203, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
2
|
Shi Q, Ma Y, Zhang X, Jiao P, Zhang K, Barchi LC, Bedetti B, Wu J, Wei B, Ng CSH, Toker A, Shen J, Fruscio R, Gilbert S, Petersen RH, Hochwald S, Štupnik T, Elkhayat H, Scarci M, Levi Sandri GB, Abu Akar F, Waseda R, Sihoe ADL, Fiorelli A, Gonzalez M, Davoli F, Li GS, Tang X, Qiu B, Wang SD, Chen Y, Gao S. Reporting guidelines for surgical technique could be improved: a scoping review and a call for action. J Clin Epidemiol 2023; 155:1-12. [PMID: 36574532 DOI: 10.1016/j.jclinepi.2022.11.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Revised: 11/11/2022] [Accepted: 11/22/2022] [Indexed: 11/29/2022]
Abstract
OBJECTIVES To identify reporting guidelines related to surgical technique and propose recommendations for areas that require improvement. STUDY DESIGN AND SETTING A protocol-guided scoping review was conducted. A literature search of MEDLINE, the EQUATOR Network Library, Google Scholar, and Networked Digital Library of Theses and Dissertations was conducted to identify surgical technique reporting guidelines published up to December 31, 2021. RESULTS We finally included 55 surgical technique reporting guidelines, vascular surgery (n = 18, 32.7%) was the most common among the clinical specialties covered. The included guidelines generally showed a low degree of international and multidisciplinary cooperation. Few guidelines provided a detailed development process (n = 14, 25.5%), conducted a systematic literature review (n = 13, 23.6%), used the Delphi method (n = 4, 7.3%), or described post-publication strategy (n = 6, 10.9%). The vast majority guidelines focused on the reporting of intraoperative period (n = 50, 90.9%). However, of the guidelines requiring detailed descriptions of surgical technique methodology (n = 43, 78.2%), most failed to provide guidance on what constitutes an adequate description. CONCLUSION Our study demonstrates significant deficiencies in the development methodology and practicality of reporting guidelines for surgical technique. A standardized reporting guideline that is developed rigorously and focuses on details of surgical technique may serve as a necessary impetus for change.
Collapse
Affiliation(s)
- Qianling Shi
- Evidence-based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China; Lanzhou University Institute of Health Data Science, Lanzhou, China
| | - Yanfang Ma
- School of Chinese Medicine, Hong Kong Baptist University, Hong Kong, China
| | - Xianzhuo Zhang
- The First School of Clinical Medicine, Lanzhou University, Lanzhou, China
| | - Panpan Jiao
- The First School of Clinical Medicine, Lanzhou University, Lanzhou, China
| | - Kaiping Zhang
- Editorial Office, AME Publishing Company, Hong Kong, China
| | - Leandro Cardoso Barchi
- Digestive Surgery Division, Department of Gastroenterology, University of Sao Paulo School of Medicine, São Paulo, Brazil
| | - Benedetta Bedetti
- Department of Thoracic Surgery, Helios Clinic Bonn/Rhein Sieg, Bonn, Germany
| | - Jinlin Wu
- Department of Cardiovascular Surgery, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong, China
| | - Benjamin Wei
- Division of Cardiothoracic Surgery, Department of Surgery, University of Alabama Birmingham, Birmingham, USA
| | - Calvin S H Ng
- The Chinese University of Hong Kong, Prince of Wales Hospital, Shatin, New Territories, Hong Kong, China
| | - Alper Toker
- Department of Cardiovascular and Thoracic Surgery, West Virginia University Heart and Vascular Institute, Morgantown, WV, USA
| | - Jianfei Shen
- Department of Cardiothoracic Surgery, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
| | - Robert Fruscio
- Clinic of Obstetrics and Gynecology, University of Milan-Bicocca, San Gerardo Hospital, Monza, Italy
| | - Sebastien Gilbert
- Division of Thoracic Surgery, Department of Surgery, The Ottawa Hospital, University of Ottawa, Ottawa, Canada
| | - Rene Horsleben Petersen
- Department of Cardiothoracic Surgery, University Hospital of Copenhagen, Rigshospitalet, Copenhagen, Denmark
| | - Steven Hochwald
- Department of Surgical Oncology, Roswell Park Cancer Institute, Buffalo, NY, USA
| | - Tomaž Štupnik
- Department of Thoracic Surgery, University Medical Centre Ljubljana, Ljubljana, Slovenia
| | - Hussein Elkhayat
- Cardiothoracic Surgery, Assiut University, Faculty of Medicine, Assiut, Egypt
| | - Marco Scarci
- Department of Thoracic Surgery, S. Gerardo Hospital, Monza, Italy
| | | | - Firas Abu Akar
- Department of Cardiothoracic Surgery, Makassed Charitable Society Hospital, East Jerusalem, Palestine
| | - Ryuichi Waseda
- Department of General Thoracic, Breast and Pediatric Surgery, Fukuoka University, Fukuoka, Japan
| | | | - Alfonso Fiorelli
- Thoracic Surgery Unit, University of Campania "Luigi Vanvitelli", Naples, Italy
| | - Michel Gonzalez
- Service of Thoracic Surgery, Lausanne University Hospital (CHUV), Lausanne, Switzerland
| | - Fabio Davoli
- Department of Thoracic Surgery, AUSL Romagna, S. Maria delle Croci Teaching Hospital, Ravenna, Italy
| | - Grace S Li
- Editorial Office, AME Publishing Company, Hong Kong, China
| | - Xueqin Tang
- Editorial Office, AME Publishing Company, Hong Kong, China
| | - Bin Qiu
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Stephen D Wang
- Editorial Office, AME Publishing Company, Hong Kong, China
| | - Yaolong Chen
- Research Unit of Evidence-Based Evaluation and Guidelines, Chinese Academy of Medical Sciences (2021RU017), School of Basic Medical Sciences, Lanzhou University, Lanzhou, China; World Health Organization (WHO) Collaborating Centre for Guideline Implementation and Knowledge Translation, Lanzhou, China.
| | - Shugeng Gao
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
| |
Collapse
|
3
|
Kamioka H, Origasa H, Kitayuguchi J, Tsutani K. Compliance of Clinical Trial Protocols for Foods with Function Claims (FFC) in Japan: Consistency between Clinical Trial Registrations and Published Reports. Nutrients 2021; 14:nu14010081. [PMID: 35010956 PMCID: PMC8746435 DOI: 10.3390/nu14010081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 12/21/2021] [Accepted: 12/23/2021] [Indexed: 11/16/2022] Open
Abstract
Background: A new type of foods with a health claims notification system, the Foods with Function Claims (FFC), was introduced in Japan in April 2015. This cross-sectional study sought to clarify compliance of clinical trial protocols reported as the scientific basis of efficacy in the FFC system. Methods: All articles based on clinical trials published on the Consumer Affairs Agency website from 1 July 2018 to 30 June 2021 were reviewed. Items assessed included first author characteristics (for-profit or academia), journal name, year published, journal impact factor in 2020, article language, name of clinical trial registration (CTR), and seven compliance items (Title: T, Participant: P, Intervention: I, Comparison: C, Outcome: O, Study design: S, and Institutional Review Board, IRB). Among studies that conducted CTR, consistency with these seven compliance items was evaluated. Results: Out of 136 studies that met all inclusion criteria, 103 (76%) performed CTR, and CTR was either not performed or not specified for 33 (24%). Compliance between the protocol and the text was high (≥96%) for items P and S, but considerably lower for items T, I, C, O, and IRB (52%, 15%, 13%, 69%, and 27%, respectively). Furthermore, 43% of protocols did not include functional ingredients or food names in items T or I. The total score was 3.7 ± 1.1 pts (out of 7). Conclusions: Some CTs had no protocol registration, and even registered protocols were suboptimal in transparency. In addition to selective reporting, a new problem identified was that the content of the intervention (test food) was intentionally concealed.
Collapse
Affiliation(s)
- Hiroharu Kamioka
- Faculty of Regional Environment Science, Tokyo University of Agriculture, 1-1-1 Sakuragaoka, Setagaya-ku, Tokyo 156-8502, Japan
- Correspondence:
| | - Hideki Origasa
- Division of Biostatistics and Clinical Epidemiology, School of Medicine, University of Toyama, 2630 Sugiya, Toyama 930-0194, Japan;
| | - Jun Kitayuguchi
- Physical Education and Medicine Research Center Unnan, 328 Uji, Unnan City 699-1105, Japan;
| | - Kiichiro Tsutani
- Facult of Health Sciences, Tokyo Ariake Medical and Health Sciences University, 2-9-1 Ariake, Kouto-ku, Tokyo 135-0063, Japan;
| |
Collapse
|