1
|
Alnaimat F, Al-Halaseh S, AlSamhori ARF. Evolution of Research Reporting Standards: Adapting to the Influence of Artificial Intelligence, Statistics Software, and Writing Tools. J Korean Med Sci 2024; 39:e231. [PMID: 39164055 PMCID: PMC11333804 DOI: 10.3346/jkms.2024.39.e231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/20/2024] [Accepted: 07/01/2024] [Indexed: 08/22/2024] Open
Abstract
Reporting standards are essential to health research as they improve accuracy and transparency. Over time, significant changes have occurred to the requirements for reporting research to ensure comprehensive and transparent reporting across a range of study domains and foster methodological rigor. The establishment of the Declaration of Helsinki, Consolidated Standards of Reporting Trials (CONSORT), Strengthening the Reporting of Observational Studies in Epidemiology (STROBE), and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) are just a few of the historic initiatives that have increased research transparency. Through enhanced discoverability, statistical analysis facilitation, article quality enhancement, and language barrier reduction, artificial intelligence (AI)-in particular, large language models like ChatGPT-has transformed academic writing. However, problems with errors that could occur and the need for transparency while utilizing AI tools still exist. Modifying reporting rules to include AI-driven writing tools such as ChatGPT is ethically and practically challenging. In academic writing, precautions for truth, privacy, and responsibility are necessary due to concerns about biases, openness, data limits, and potential legal ramifications. The CONSORT-AI and Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT)-AI Steering Group expands the CONSORT guidelines for AI clinical trials-new checklists like METRICS and CLEAR help to promote transparency in AI studies. Responsible usage of technology in research and writing software adoption requires interdisciplinary collaboration and ethical assessment. This study explores the impact of AI technologies, specifically ChatGPT, on past reporting standards and the need for revised guidelines for open, reproducible, and robust scientific publications.
Collapse
Affiliation(s)
- Fatima Alnaimat
- Division of Rheumatology, Department of Internal Medicine, School of Medicine, University of Jordan, Amman, Jordan.
| | - Salameh Al-Halaseh
- Department of Internal Medicine, School of Medicine, University of Jordan, Amman, Jordan
| | | |
Collapse
|
2
|
Zhong J, Xing Y, Hu Y, Lu J, Yang J, Zhang G, Mao S, Chen H, Yin Q, Cen Q, Jiang R, Chu J, Song Y, Lu M, Ding D, Ge X, Zhang H, Yao W. The policies on the use of large language models in radiological journals are lacking: a meta-research study. Insights Imaging 2024; 15:186. [PMID: 39090273 PMCID: PMC11294318 DOI: 10.1186/s13244-024-01769-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 07/07/2024] [Indexed: 08/04/2024] Open
Abstract
OBJECTIVE To evaluate whether and how the radiological journals present their policies on the use of large language models (LLMs), and identify the journal characteristic variables that are associated with the presence. METHODS In this meta-research study, we screened Journals from the Radiology, Nuclear Medicine and Medical Imaging Category, 2022 Journal Citation Reports, excluding journals in non-English languages and relevant documents unavailable. We assessed their LLM use policies: (1) whether the policy is present; (2) whether the policy for the authors, the reviewers, and the editors is present; and (3) whether the policy asks the author to report the usage of LLMs, the name of LLMs, the section that used LLMs, the role of LLMs, the verification of LLMs, and the potential influence of LLMs. The association between the presence of policies and journal characteristic variables was evaluated. RESULTS The LLM use policies were presented in 43.9% (83/189) of journals, and those for the authors, the reviewers, and the editor were presented in 43.4% (82/189), 29.6% (56/189) and 25.9% (49/189) of journals, respectively. Many journals mentioned the aspects of the usage (43.4%, 82/189), the name (34.9%, 66/189), the verification (33.3%, 63/189), and the role (31.7%, 60/189) of LLMs, while the potential influence of LLMs (4.2%, 8/189), and the section that used LLMs (1.6%, 3/189) were seldomly touched. The publisher is related to the presence of LLM use policies (p < 0.001). CONCLUSION The presence of LLM use policies is suboptimal in radiological journals. A reporting guideline is encouraged to facilitate reporting quality and transparency. CRITICAL RELEVANCE STATEMENT It may facilitate the quality and transparency of the use of LLMs in scientific writing if a shared complete reporting guideline is developed by stakeholders and then endorsed by journals. KEY POINTS The policies on LLM use in radiological journals are unexplored. Some of the radiological journals presented policies on LLM use. A shared complete reporting guideline for LLM use is desired.
Collapse
Affiliation(s)
- Jingyu Zhong
- Laboratory of Key Technology and Materials in Minimally Invasive Spine Surgery, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Center for Spinal Minimally Invasive Research, Shanghai Jiao Tong University, Shanghai, China.
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Junjie Lu
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, USA
| | - Jiarui Yang
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qingqing Cen
- Department of Dermatology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Run Jiang
- Department of Pharmacovigilance, Shanghai Hansoh BioMedical Co., Ltd., Shanghai, China
| | - Jingshen Chu
- Editorial Office of Journal of Diagnostics Concepts & Practice, Department of Science and Technology Development, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yang Song
- MR Scientific Marketing, Siemens Healthineers Ltd., Shanghai, China
| | - Minda Lu
- MR Application, Siemens Healthineers Ltd., Shanghai, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| | - Weiwu Yao
- Laboratory of Key Technology and Materials in Minimally Invasive Spine Surgery, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Center for Spinal Minimally Invasive Research, Shanghai Jiao Tong University, Shanghai, China.
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| |
Collapse
|
3
|
Zufry H, Hariyanto TI. Comparative Efficacy and Safety of Radiofrequency Ablation and Microwave Ablation in the Treatment of Benign Thyroid Nodules: A Systematic Review and Meta-Analysis. Korean J Radiol 2024; 25:301-313. [PMID: 38413114 PMCID: PMC10912499 DOI: 10.3348/kjr.2023.1004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Revised: 11/29/2023] [Accepted: 12/29/2023] [Indexed: 02/29/2024] Open
Abstract
OBJECTIVE The current body of evidence lacks clarity regarding the comparative efficacy and safety of radiofrequency ablation (RFA) and microwave ablation (MWA) as minimally invasive treatments for benign thyroid nodules. The primary objective of this study is to clarify these concerns. MATERIALS AND METHODS A comprehensive search was conducted using the Cochrane Library, Scopus, Europe PMC, and Medline databases until October 10th, 2023, using a combination of relevant keywords. This study incorporated literature that compared RFA and MWA for benign thyroid nodules. The primary outcome was the volume reduction ratio (VRR) from baseline to follow-up. Secondary outcomes were symptom score, cosmetic score, ablation time, major complications rate, hemorrhage, hoarseness, skin burn, cough, and sympathetic nerve injury. We used Risk of Bias in Non-randomized Studies - of Interventions (ROBINS-I) tool to assess the risk of bias in the included studies. We employed random effects models to analyze the standardized mean difference (SMD) and odds ratio for the presentation of outcomes. RESULTS Nine studies with 2707 nodules were included. The results of our meta-analysis indicated similar efficacy between RFA and MWA in terms of VRR during the 1 (SMD 0.06; 95% confidence interval [CI]: -0.13 to 0.26; P = 0.52) and 3 (SMD 0.11; 95% CI: -0.03 to 0.25; P = 0.12) months of follow-up. VRR was significantly higher in RFA than in MWA at the 6 (SMD 0.25; 95% CI: 0.06-0.43; P = 0.008) and 12 month of follow-up (SMD 0.38; 95% CI: 0.17 to 0.59; P < 0.001). There were no significant differences between RFA and MWA in symptom scores, cosmetic scores, or the incidence of complications, including hemorrhage, hoarseness, skin burn, cough, and sympathetic nerve injury. CONCLUSION RFA showed a higher VRR than MWA at 6 and 12-month follow-ups, with a comparable safety profile.
Collapse
Affiliation(s)
- Hendra Zufry
- Department of Internal Medicine, Faculty of Medicine, Universitas Syiah Kuala, Banda Aceh, Indonesia
- Innovation and Research Center of Endocrinology, Faculty of Medicine, Universitas Syiah Kuala, Banda Aceh, Indonesia.
| | | |
Collapse
|
4
|
Wang Z, Wang Y, Shang W, Liu W, Lu C, Huang J, Lei C, Chen Z, Wang Z, Yang K, Li X, Lu C. Reporting quality and risk of bias of systematic reviews of ultra-processed foods: a methodological study. Eur J Clin Nutr 2024; 78:171-179. [PMID: 38093096 DOI: 10.1038/s41430-023-01383-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 11/22/2023] [Accepted: 11/27/2023] [Indexed: 03/13/2024]
Abstract
A dramatic shift in the global food system is occurring with the rapid growth of ultra-processed foods (UPFs) consumption, which poses potentially serious health risks. Systematic review (SR) method has been used to summarise the association between UPF consumption and multiple health outcomes; however, a suboptimal-quality SR may mislead the decision-making in clinical practices and health policies. Therefore, a methodological review was conducted to identify the areas that can be improved regarding the risk of bias and reporting quality of relevant SRs. Systematic searches to collect SRs with meta-analyses of UPFs were performed using four databases from their inception to April 14, 2023. The risk of bias and reporting quality were evaluated using ROBIS and PRISMA 2020, respectively. The key characteristics of the included SRs were summarised descriptively. Excel 2019 and R 4.2.3 were used to analyse the data and draw graphs. Finally, 16 relevant SRs written in English and published between 2020 and 2023 in 12 academic journals were included. Only one SR was rated as low risk of bias, and the others were rated as higher risk of bias mainly because the risk of bias in the original studies was not explicitly addressed when synthesising the evidence. The reporting was required to be advanced significantly, involving amendments of registration and protocol, data and analytic code statement, and lists of excluded studies with justifications. The reviews' results could improve the quality, strengthen future relevant SRs' robustness, and further underpin the evidence base for supporting clinical decisions and health policies.
Collapse
Affiliation(s)
- Ziyi Wang
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Yan Wang
- Shangluo Central Hospital of Shaanxi Provincial, Shangluo, 726000, China
| | - Wenru Shang
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Wendi Liu
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Cui Lu
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Jiayi Huang
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Chao Lei
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, 100700, Beijing, China
| | - Zijia Chen
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, 100700, Beijing, China
| | - Zhifei Wang
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, 100700, Beijing, China
| | - Kehu Yang
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Xiuxia Li
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China.
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China.
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China.
| | - Cuncun Lu
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, 100700, Beijing, China.
| |
Collapse
|
5
|
Zhong J, Xing Y, Lu J, Zhang G, Mao S, Chen H, Yin Q, Cen Q, Jiang R, Hu Y, Ding D, Ge X, Zhang H, Yao W. The endorsement of general and artificial intelligence reporting guidelines in radiological journals: a meta-research study. BMC Med Res Methodol 2023; 23:292. [PMID: 38093215 PMCID: PMC10717715 DOI: 10.1186/s12874-023-02117-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 12/01/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND Complete reporting is essential for clinical research. However, the endorsement of reporting guidelines in radiological journals is still unclear. Further, as a field extensively utilizing artificial intelligence (AI), the adoption of both general and AI reporting guidelines would be necessary for enhancing quality and transparency of radiological research. This study aims to investigate the endorsement of general reporting guidelines and those for AI applications in medical imaging in radiological journals, and explore associated journal characteristic variables. METHODS This meta-research study screened journals from the Radiology, Nuclear Medicine & Medical Imaging category, Science Citation Index Expanded of the 2022 Journal Citation Reports, and excluded journals not publishing original research, in non-English languages, and instructions for authors unavailable. The endorsement of fifteen general reporting guidelines and ten AI reporting guidelines was rated using a five-level tool: "active strong", "active weak", "passive moderate", "passive weak", and "none". The association between endorsement and journal characteristic variables was evaluated by logistic regression analysis. RESULTS We included 117 journals. The top-five endorsed reporting guidelines were CONSORT (Consolidated Standards of Reporting Trials, 58.1%, 68/117), PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses, 54.7%, 64/117), STROBE (STrengthening the Reporting of Observational Studies in Epidemiology, 51.3%, 60/117), STARD (Standards for Reporting of Diagnostic Accuracy, 50.4%, 59/117), and ARRIVE (Animal Research Reporting of In Vivo Experiments, 35.9%, 42/117). The most implemented AI reporting guideline was CLAIM (Checklist for Artificial Intelligence in Medical Imaging, 1.7%, 2/117), while other nine AI reporting guidelines were not mentioned. The Journal Impact Factor quartile and publisher were associated with endorsement of reporting guidelines in radiological journals. CONCLUSIONS The general reporting guideline endorsement was suboptimal in radiological journals. The implementation of reporting guidelines for AI applications in medical imaging was extremely low. Their adoption should be strengthened to facilitate quality and transparency of radiological study reporting.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Junjie Lu
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, 200433, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Qingqing Cen
- Department of Dermatology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Run Jiang
- Department of Pharmacovigilance, Shanghai Hansoh BioMedical Co., Ltd., Shanghai, 201203, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
6
|
Byon JH, Hwang S, Choi H, Choi EJ. Diagnostic Accuracy of Magnetic Resonance Imaging Features and Tumor-to-Nipple Distance for the Nipple-Areolar Complex Involvement of Breast Cancer: A Systematic Review and Meta-Analysis. Korean J Radiol 2023; 24:739-751. [PMID: 37500575 PMCID: PMC10400374 DOI: 10.3348/kjr.2022.0846] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Revised: 05/02/2023] [Accepted: 05/19/2023] [Indexed: 07/29/2023] Open
Abstract
OBJECTIVE This systematic review and meta-analysis evaluated the accuracy of preoperative breast magnetic resonance imaging (MRI) features and tumor-to-nipple distance (TND) for diagnosing occult nipple-areolar complex (NAC) involvement in breast cancer. MATERIALS AND METHODS The MEDLINE, Embase, and Cochrane databases were searched for articles published until March 20, 2022, excluding studies of patients with clinically evident NAC involvement or those treated with neoadjuvant chemotherapy. Study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Two reviewers independently evaluated studies that reported the diagnostic performance of MRI imaging features such as continuity to the NAC, unilateral NAC enhancement, non-mass enhancement (NME) type, mass size (> 20 mm), and TND. Summary estimates of the sensitivity and specificity curves and the summary receiver operating characteristic (SROC) curve of the MRI features for NAC involvement were calculated using random-effects models. We also calculated the TND cutoffs required to achieve predetermined specificity values. RESULTS Fifteen studies (n = 4002 breast lesions) were analyzed. The pooled sensitivity and specificity (with 95% confidence intervals) for NAC involvement diagnosis were 71% (58-81) and 94% (91-96), respectively, for continuity to the NAC; 58% (45-70) and 97% (95-99), respectively, for unilateral NAC enhancement; 55% (46-64) and 83% (75-88), respectively, for NME type; and 88% (68-96) and 58% (40-75), respectively, for mass size (> 20 mm). TND had an area under the SROC curve of 0.799 for NAC involvement. A TND of 11.5 mm achieved a predetermined specificity of 85% with a sensitivity of 64%, and a TND of 12.3 mm yielded a predetermined specificity of 83% with a sensitivity of 65%. CONCLUSION Continuity to the NAC and unilateral NAC enhancement may help predict occult NAC involvement in breast cancer. To achieve the desired diagnostic performance with TND, a suitable cutoff value should be considered.
Collapse
Affiliation(s)
- Jung Hee Byon
- Department of Radiology, Ulsan University Hospital, University of Ulsan College of Medicine, Ulsan, Republic of Korea
| | - Seungyong Hwang
- Department of Genetics, Stanford University, Stanford, CA, USA
| | - Hyemi Choi
- Department of Statistics and Institute of Applied Statistics, Jeonbuk National University, Jeonju, Republic of Korea.
| | - Eun Jung Choi
- Department of Radiology, Research Institute of Clinical Medicine of Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonbuk National University Medical School, Jeonju, Republic of Korea.
| |
Collapse
|
7
|
Hamilton DG, Hong K, Fraser H, Rowhani-Farid A, Fidler F, Page MJ. Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data. BMJ 2023; 382:e075767. [PMID: 37433624 PMCID: PMC10334349 DOI: 10.1136/bmj-2023-075767] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 06/07/2023] [Indexed: 07/13/2023]
Abstract
OBJECTIVES To synthesise research investigating data and code sharing in medicine and health to establish an accurate representation of the prevalence of sharing, how this frequency has changed over time, and what factors influence availability. DESIGN Systematic review with meta-analysis of individual participant data. DATA SOURCES Ovid Medline, Ovid Embase, and the preprint servers medRxiv, bioRxiv, and MetaArXiv were searched from inception to 1 July 2021. Forward citation searches were also performed on 30 August 2022. REVIEW METHODS Meta-research studies that investigated data or code sharing across a sample of scientific articles presenting original medical and health research were identified. Two authors screened records, assessed the risk of bias, and extracted summary data from study reports when individual participant data could not be retrieved. Key outcomes of interest were the prevalence of statements that declared that data or code were publicly or privately available (declared availability) and the success rates of retrieving these products (actual availability). The associations between data and code availability and several factors (eg, journal policy, type of data, trial design, and human participants) were also examined. A two stage approach to meta-analysis of individual participant data was performed, with proportions and risk ratios pooled with the Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis. RESULTS The review included 105 meta-research studies examining 2 121 580 articles across 31 specialties. Eligible studies examined a median of 195 primary articles (interquartile range 113-475), with a median publication year of 2015 (interquartile range 2012-2018). Only eight studies (8%) were classified as having a low risk of bias. Meta-analyses showed a prevalence of declared and actual public data availability of 8% (95% confidence interval 5% to 11%) and 2% (1% to 3%), respectively, between 2016 and 2021. For public code sharing, both the prevalence of declared and actual availability were estimated to be <0.5% since 2016. Meta-regressions indicated that only declared public data sharing prevalence estimates have increased over time. Compliance with mandatory data sharing policies ranged from 0% to 100% across journals and varied by type of data. In contrast, success in privately obtaining data and code from authors historically ranged between 0% and 37% and 0% and 23%, respectively. CONCLUSIONS The review found that public code sharing was persistently low across medical research. Declarations of data sharing were also low, increasing over time, but did not always correspond to actual sharing of data. The effectiveness of mandatory data sharing policies varied substantially by journal and type of data, a finding that might be informative for policy makers when designing policies and allocating resources to audit compliance. SYSTEMATIC REVIEW REGISTRATION Open Science Framework doi:10.17605/OSF.IO/7SX8U.
Collapse
Affiliation(s)
- Daniel G Hamilton
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, VIC, Australia
- Melbourne Medical School, Faculty of Medicine, Dentistry, and Health Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - Kyungwan Hong
- Department of Practice, Sciences, and Health Outcomes Research, University of Maryland School of Pharmacy, Baltimore, MD, USA
| | - Hannah Fraser
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, VIC, Australia
| | - Anisa Rowhani-Farid
- Department of Practice, Sciences, and Health Outcomes Research, University of Maryland School of Pharmacy, Baltimore, MD, USA
| | - Fiona Fidler
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, VIC, Australia
- School of Historical and Philosophical Studies, University of Melbourne, Melbourne, VIC, Australia
| | - Matthew J Page
- Methods in Evidence Synthesis Unit, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
8
|
Nolan CM, Brighton LJ, Mo Y, Bayly J, Higginson IJ, Man WDC, Maddocks M. Meditative movement for breathlessness in advanced COPD or cancer: a systematic review and meta-analysis. Eur Respir Rev 2023; 32:220243. [PMID: 37343961 PMCID: PMC10282812 DOI: 10.1183/16000617.0243-2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 03/23/2023] [Indexed: 06/23/2023] Open
Abstract
The effect of meditative movement, which includes yoga, tai chi and qi gong, on breathlessness in advanced disease is unknown. This systematic review aims to comprehensively assess the evidence on the effect of meditative movement on breathlessness (primary outcome), health-related quality of life, exercise capacity, functional performance and psychological symptoms (secondary outcomes) in advanced disease. 11 English and Chinese language databases were searched for relevant trials. Risk of bias was assessed using the Cochrane tool. Standardised mean differences (SMDs) with 95% confidence intervals were computed. 17 trials with 1125 participants (n=815 COPD, n=310 cancer), all with unclear or high risk of bias, were included. Pooled estimates (14 studies, n=671) showed no statistically significant difference in breathlessness between meditative movement and control interventions (SMD (95% CI) 0.10 (-0.15-0.34); Chi2=30.11; I2=57%; p=0.45), irrespective of comparator, intervention or disease category. Similar results were observed for health-related quality of life and exercise capacity. It was not possible to perform a meta-analysis for functional performance and psychological symptoms. In conclusion, in people with advanced COPD or cancer, meditative movement does not improve breathlessness, health-related quality of life or exercise capacity. Methodological limitations lead to low levels of certainty in the results.
Collapse
Affiliation(s)
- Claire M Nolan
- Brunel University London, College of Medicine, Health and Life Sciences, Department of Health Sciences, London, UK
- Harefield Respiratory Research Group, Royal Brompton and Harefield Hospitals, Guy's and St. Thomas' NHS Foundation Trust, London, UK
| | - Lisa Jane Brighton
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
- King's College London, Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, London, UK
| | - Yihan Mo
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
| | - Joanne Bayly
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
- St. Barnabas Hospices, Worthing, UK
| | - Irene J Higginson
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
| | - William D-C Man
- Harefield Respiratory Research Group, Royal Brompton and Harefield Hospitals, Guy's and St. Thomas' NHS Foundation Trust, London, UK
- King's College London, Faculty of Life Sciences and Medicine, London, UK
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Matthew Maddocks
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
| |
Collapse
|
9
|
Zhong J, Lu J, Zhang G, Mao S, Chen H, Yin Q, Hu Y, Xing Y, Ding D, Ge X, Zhang H, Yao W. An overview of meta-analyses on radiomics: more evidence is needed to support clinical translation. Insights Imaging 2023; 14:111. [PMID: 37336830 DOI: 10.1186/s13244-023-01437-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 04/14/2023] [Indexed: 06/21/2023] Open
Abstract
OBJECTIVE To conduct an overview of meta-analyses of radiomics studies assessing their study quality and evidence level. METHODS A systematical search was updated via peer-reviewed electronic databases, preprint servers, and systematic review protocol registers until 15 November 2022. Systematic reviews with meta-analysis of primary radiomics studies were included. Their reporting transparency, methodological quality, and risk of bias were assessed by PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 checklist, AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) tool, and ROBIS (Risk Of Bias In Systematic reviews) tool, respectively. The evidence level supporting the radiomics for clinical use was rated. RESULTS We identified 44 systematic reviews with meta-analyses on radiomics research. The mean ± standard deviation of PRISMA adherence rate was 65 ± 9%. The AMSTAR-2 tool rated 5 and 39 systematic reviews as low and critically low confidence, respectively. The ROBIS assessment resulted low, unclear and high risk in 5, 11, and 28 systematic reviews, respectively. We reperformed 53 meta-analyses in 38 included systematic reviews. There were 3, 7, and 43 meta-analyses rated as convincing, highly suggestive, and weak levels of evidence, respectively. The convincing level of evidence was rated in (1) T2-FLAIR radiomics for IDH-mutant vs IDH-wide type differentiation in low-grade glioma, (2) CT radiomics for COVID-19 vs other viral pneumonia differentiation, and (3) MRI radiomics for high-grade glioma vs brain metastasis differentiation. CONCLUSIONS The systematic reviews on radiomics were with suboptimal quality. A limited number of radiomics approaches were supported by convincing level of evidence. CLINICAL RELEVANCE STATEMENT The evidence supporting the clinical application of radiomics are insufficient, calling for researches translating radiomics from an academic tool to a practicable adjunct towards clinical deployment.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Junjie Lu
- Department of Social and Behavioral Sciences, Harvard T.H. Chan School of Public Health, Boston, MA, 02115, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, 200433, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
10
|
Alves F, Kalinowski P, Ayton S. Accelerated Brain Volume Loss Caused by Anti-β-Amyloid Drugs: A Systematic Review and Meta-analysis. Neurology 2023; 100:e2114-e2124. [PMID: 36973044 PMCID: PMC10186239 DOI: 10.1212/wnl.0000000000207156] [Citation(s) in RCA: 74] [Impact Index Per Article: 74.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Accepted: 01/20/2023] [Indexed: 03/29/2023] Open
Abstract
BACKGROUND AND OBJECTIVES To evaluate brain volume changes caused by different subclasses of anti-β-amyloid (Aβ) drugs trailed in patients with Alzheimer disease. METHODS PubMed, Embase, and ClinicalTrials.gov databases were searched for clinical trials of anti-Aβ drugs. This systematic review and meta-analysis included adults enrolled in randomized controlled trials of anti-Aβ drugs (n = 8,062-10,279). The inclusion criteria were as follows: (1) randomized controlled trials of patients treated with anti-Aβ drugs that have demonstrated to favorably change at least one biomarker of pathologic Aβ and (2) detailed MRI data sufficient to assess the volumetric changes in at least one brain region. MRI brain volumes were used as the primary outcome measure; brain regions commonly reported include hippocampus, lateral ventricle, and whole brain. Amyloid-related imaging abnormalities (ARIAs) were investigated when reported in clinical trials. Of the 145 trials reviewed, 31 were included in the final analyses. RESULTS A meta-analysis on the highest dose of each trial on hippocampus, ventricle, and whole brain revealed drug-induced acceleration of volume changes that varied by anti-Aβ drug class. Secretase inhibitors accelerated atrophy to the hippocampus (Δ placebo - Δ drug: -37.1 µL [19.6% more than placebo]; 95% CI -47.0 to -27.1) and whole brain (Δ placebo - Δ drug: -3.3 mL [21.8% more than placebo]; 95% CI -4.1 to 2.5). Conversely, ARIA-inducing monoclonal antibodies accelerated ventricular enlargement (Δ placebo - Δ drug: +2.1 mL [38.7% more than placebo]; 95% CI 1.5-2.8) where a striking correlation between ventricular volume and ARIA frequency was observed (r = 0.86, p = 6.22 × 10-7). Mild cognitively impaired participants treated with anti-Aβ drugs were projected to have a material regression toward brain volumes typical of Alzheimer dementia ∼8 months earlier than if they were untreated. DISCUSSION These findings reveal the potential for anti-Aβ therapies to compromise long-term brain health by accelerating brain atrophy and provide new insight into the adverse impact of ARIA. Six recommendations emerge from these findings.
Collapse
Affiliation(s)
- Francesca Alves
- From the The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Australia
| | - Pawel Kalinowski
- From the The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Australia
| | - Scott Ayton
- From the The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Australia.
| |
Collapse
|
11
|
Jang EB, Suh CH, Kim PH, Kim AY, Do KH, Lee JH, Gwon DI, Jung AY, Lee CW. Incidence and severity of nonionic low-osmolar iodinated contrast medium-related adverse drug reactions in the Republic of Korea: Comparison by generic. Medicine (Baltimore) 2023; 102:e33717. [PMID: 37171360 PMCID: PMC10174392 DOI: 10.1097/md.0000000000033717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/13/2023] Open
Abstract
We aimed to report the incidence and severity of nonionic low-osmolar iodine contrast medium (ICM)-related adverse drug reactions (ADRs) in the Republic of Korea, by analyzing data from our single tertiary institution and published Korean reports, and to determine whether there is a difference in the incidence of ICM-related ADR by ICM generics. A total of 1,161,419 consecutive contrast-enhanced computed tomography (CT) examinations between January 2016 and December 2021 at Asan Medical Center were included. A systematic search of the literature investigating the incidence of ICM-related ADR in the Republic of Korea published up to December 31, 2021 was performed. We pooled these outcomes with those of our study using a binomial-normal model, and the pooled incidences of ADRs were compared among ICM generics using chi-square tests. Seven studies with a total of 2,570,986 contrast-enhanced CT examinations from 12 institutions were included. The pooled incidences of overall, mild, moderate, and severe ICM-related ADRs in the Republic of Korea were 0.82% (95% CI: 0.61%-1.10%), 0.72% (95% CI: 0.50%-1.04%), 0.11% (95% CI: 0.08%-0.15%), and 0.013% (95% CI: 0.010%-0.018%), respectively. In multiple pairwise comparisons, there were no significant differences in the overall incidence of ADRs between ICM generics, except iomeprol versus iobitridol and iomeprol versus iohexol. For moderate and severe ADRs, there were no significant differences in ADR incidence between ICM generics. The incidence of moderate and severe ICM-related ADRs did not differ among ICM generics. Our results suggest that no restriction is required for selection among nonionic low-osmolar ICMs.
Collapse
Affiliation(s)
- Eun Bee Jang
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | | | | | | | | | | | | | | | | |
Collapse
|
12
|
Diagnostic yield of MR myelography in patients with newly diagnosed spontaneous intracranial hypotension: a systematic review and meta-analysis. Eur Radiol 2022; 32:7843-7853. [PMID: 35538263 DOI: 10.1007/s00330-022-08845-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Revised: 04/18/2022] [Accepted: 04/22/2022] [Indexed: 01/03/2023]
Abstract
OBJECTIVES To investigate the pooled diagnostic yield of MR myelography in patients with newly diagnosed spontaneous intracranial hypotension (SIH). METHODS A literature search of the MEDLINE/PubMed and Embase databases was conducted until July 25, 2021, including studies with the following inclusion criteria: (a) population: patients with newly diagnosed SIH; (b) diagnostic modality: MR myelography or MR myelography with intrathecal gadolinium for evaluation of CSF leakage; (c) outcomes: diagnostic yield of MR myelography or MR myelography with intrathecal gadolinium. The risk of bias was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. DerSimonian-Laird random-effects modeling was used to calculate the pooled estimates. Subgroup analysis regarding epidural fluid collection and meta-regression were additionally performed. RESULTS Fifteen studies with 643 patients were included. Eight studies used MR myelography with intrathecal gadolinium, and 11 used MR myelography. The overall quality of the included studies was moderate. The pooled diagnostic yield of MR myelography was 86% (95% CI, 80-91%) and that of MR myelography with intrathecal gadolinium was 83% (95% CI, 51-96%). There was no significant difference in pooled diagnostic yield between MR myelography and MR myelography with intrathecal gadolinium (p = 0.512). In subgroup analysis, the pooled diagnostic yield of the epidural fluid collection was 91% (95% CI, 84-94%). In meta-regression, the diagnostic yield was unaffected regardless of consecutive enrollment, magnet strength, or 2D/3D. CONCLUSIONS MR myelography had a high diagnostic yield in patients with SIH. MR myelography is non-invasive and not inferior to MR myelography with intrathecal gadolinium. KEY POINTS • The pooled diagnostic yield of MR myelography was 86% (95% CI, 80-91%) in patients with spontaneous intracranial hypotension. • There was no significant difference in pooled diagnostic yield between MR myelography and MR myelography with intrathecal gadolinium. • MR myelography is non-invasive and not inferior to MR myelography with intrathecal gadolinium.
Collapse
|
13
|
Park HY, Suh CH, Heo H, Shim WH, Kim SJ. Diagnostic performance of hippocampal volumetry in Alzheimer's disease or mild cognitive impairment: a meta-analysis. Eur Radiol 2022; 32:6979-6991. [PMID: 35507052 DOI: 10.1007/s00330-022-08838-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 04/18/2022] [Accepted: 04/22/2022] [Indexed: 11/25/2022]
Abstract
OBJECTIVE To evaluate the diagnostic performance of hippocampal volumetry for Alzheimer's disease (AD) or mild cognitive impairment (MCI). METHODS The MEDLINE and Embase databases were searched for articles that evaluated the diagnostic performance of hippocampal volumetry in differentiating AD or MCI from normal controls, published up to March 6, 2022. The quality of the articles was evaluated by the QUADAS-2 tool. A bivariate random-effects model was used to pool sensitivity, specificity, and area under the curve. Sensitivity analysis and meta-regression were conducted to explain study heterogeneity. The diagnostic performance of entorhinal cortex volumetry was also pooled. RESULTS Thirty-three articles (5157 patients) were included. The pooled sensitivity and specificity for AD were 82% (95% confidence interval [CI], 77-86%) and 87% (95% CI, 82-91%), whereas those for MCI were 60% (95% CI, 51-69%) and 75% (95% CI, 67-81%), respectively. No difference in the diagnostic performance was observed between automatic and manual segmentation (p = 0.11). MMSE scores, study design, and the reference standard being used were associated with study heterogeneity (p < 0.01). Subgroup analysis demonstrated a higher diagnostic performance of entorhinal cortex volumetry for both AD (pooled sensitivity: 88% vs. 79%, specificity: 92% vs. 89%, p = 0.07) and MCI (pooled sensitivity: 71% vs. 55%, specificity: 83% vs. 68%, p = 0.06). CONCLUSIONS Our meta-analysis demonstrated good diagnostic performance of hippocampal volumetry for AD or MCI. Entorhinal cortex volumetry might have superior diagnostic performance to hippocampal volumetry. However, due to a small number of studies, the diagnostic performance of entorhinal cortex volumetry is yet to be determined. KEY POINTS • The pooled sensitivity and specificity of hippocampal volumetry for Alzheimer's disease were 82% and 87%, whereas those for mild cognitive impairment were 60% and 75%, respectively. • No significant difference in the diagnostic performance was observed between automatic and manual segmentation. • Subgroup analysis demonstrated superior diagnostic performance of entorhinal cortex volumetry for AD (pooled sensitivity: 88%, specificity: 92%) and MCI (pooled sensitivity: 71%, specificity: 83%).
Collapse
Affiliation(s)
- Ho Young Park
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| | - Chong Hyun Suh
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea.
| | - Hwon Heo
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Woo Hyun Shim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| | - Sang Joon Kim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| |
Collapse
|