1
|
White SJ, Phua QS, Lu L, Yaxley KL, McInnes MDF, To MS. Heterogeneity in Systematic Reviews of Medical Imaging Diagnostic Test Accuracy Studies: A Systematic Review. JAMA Netw Open 2024; 7:e240649. [PMID: 38421646 PMCID: PMC10905313 DOI: 10.1001/jamanetworkopen.2024.0649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Accepted: 01/09/2024] [Indexed: 03/02/2024] Open
Abstract
Importance Systematic reviews of medical imaging diagnostic test accuracy (DTA) studies are affected by between-study heterogeneity due to a range of factors. Failure to appropriately assess the extent and causes of heterogeneity compromises the interpretability of systematic review findings. Objective To assess how heterogeneity has been examined in medical imaging DTA studies. Evidence Review The PubMed database was searched for systematic reviews of medical imaging DTA studies that performed a meta-analysis. The search was limited to the 40 journals with highest impact factor in the radiology, nuclear medicine, and medical imaging category in the InCites Journal Citation Reports of 2021 to reach a sample size of 200 to 300 included studies. Descriptive analysis was performed to characterize the imaging modality, target condition, type of meta-analysis model used, strategies for evaluating heterogeneity, and sources of heterogeneity identified. Multivariable logistic regression was performed to assess whether any factors were associated with at least 1 source of heterogeneity being identified in the included meta-analyses. Methodological quality evaluation was not performed. Data analysis occurred from October to December 2022. Findings A total of 242 meta-analyses involving a median (range) of 987 (119-441 510) patients across a diverse range of disease categories and imaging modalities were included. The extent of heterogeneity was adequately described (ie, whether it was absent, low, moderate, or high) in 220 studies (91%) and was most commonly assessed using the I2 statistic (185 studies [76%]) and forest plots (181 studies [75%]). Heterogeneity was rated as moderate to high in 191 studies (79%). Of all included meta-analyses, 122 (50%) performed subgroup analysis and 87 (36%) performed meta-regression. Of the 242 studies assessed, 189 (78%) included 10 or more primary studies. Of these 189 studies, 60 (32%) did not perform meta-regression or subgroup analysis. Reasons for being unable to investigate sources of heterogeneity included inadequate reporting of primary study characteristics and a low number of included primary studies. Use of meta-regression was associated with identification of at least 1 source of variability (odds ratio, 1.90; 95% CI, 1.11-3.23; P = .02). Conclusions and Relevance In this systematic review of assessment of heterogeneity in medical imaging DTA meta-analyses, most meta-analyses were impacted by a moderate to high level of heterogeneity, presenting interpretive challenges. These findings suggest that, despite the development and availability of more rigorous statistical models, heterogeneity appeared to be incomplete, inconsistently evaluated, or methodologically questionable in many cases, which lessened the interpretability of the analyses performed; comprehensive heterogeneity assessment should be addressed at the author level by improving personal familiarity with appropriate statistical methodology for assessing heterogeneity and involving biostatisticians and epidemiologists in study design, as well as at the editorial level, by mandating adherence to methodologic standards in primary DTA studies and DTA meta-analyses.
Collapse
Affiliation(s)
- Samuel J. White
- Adelaide Medical School Faculty of Health and Medical Sciences, University of Adelaide, Adelaide, South Australia, Australia
| | - Qi Sheng Phua
- College of Medicine and Public Health, Flinders University, Bedford Park, South Australia, Australia
| | - Lucy Lu
- College of Medicine and Public Health, Flinders University, Bedford Park, South Australia, Australia
| | - Kaspar L. Yaxley
- South Australia Medical Imaging, Flinders Medical Centre, Bedford Park, South Australia, Australia
| | - Matthew D. F. McInnes
- Department of Radiology, Ottawa Hospital Research Institute, University of Ottawa, Ottawa, Ontario, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, University of Ottawa, Ottawa, Ontario, Canada
| | - Minh-Son To
- College of Medicine and Public Health, Flinders University, Bedford Park, South Australia, Australia
- South Australia Medical Imaging, Flinders Medical Centre, Bedford Park, South Australia, Australia
| |
Collapse
|
2
|
Kim W, Kim JH, Cha YK, Chong S, Kim TJ. Completeness of Reporting of Systematic Reviews and Meta-Analysis of Diagnostic Test Accuracy (DTA) of Radiological Articles Based on the PRISMA-DTA Reporting Guideline. Acad Radiol 2023; 30:258-275. [PMID: 35491344 DOI: 10.1016/j.acra.2022.03.028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Revised: 03/19/2022] [Accepted: 03/29/2022] [Indexed: 01/11/2023]
Abstract
RATIONALE AND OBJECTIVES This study evaluated the completeness of systematic reviews and meta-analyses in radiology using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Diagnostic Test Accuracy (PRISMA-DTA) and PRISMA-DTA for Abstracts guidelines between articles published before and those published after the issuance of the guideline and identify areas that have been poorly reported. MATERIALS AND METHODS PubMed were searched for systematic reviews on DTA with or without meta-analyses published in general radiology journals between January 1, 2016 and December 31, 2020. The identified articles were assessed for completeness of reporting according to the PRISMA-DTA. Subgroup analyses were performed for association of completeness of reporting with multiple cofactors. RESULTS The search identified 183 reviews from 12 journals. The mean numbers (standard deviation) of reported PRISMA-DTA and PRISMA-DTA for Abstracts items in the full texts and abstracts were 18.45 (2.02) and 5.66 (1.28), respectively. Subgroup analysis showed that compared to the corresponding reference groups, a higher mean number of reported PRISMA-DTA items was associated with publication during July 2018-December 2020 [(17.82 (2.01) vs 18.89 (1.91); p = 0.034), citation of the PRISMA-DTA [17.62 (1.86) vs 20.27 (2.02); p < 0.001], and inclusion of supplementary materials [17.64 (2) vs 19.09 (1.8); p < 0.001] on multiple-linear regression analysis. CONCLUSION Completeness of reporting with respect to the PRISMA-DTA and PRISMA-DTA for Abstracts has improved modestly since the publication of the PRISMA-DTA guideline; however, increasing awareness of the specific weakness provides the chance for completeness improvement.
Collapse
Affiliation(s)
- Wook Kim
- Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81, Irwon-ro, Gangnam-Gu, Seoul, 06351, South Korea
| | - Jun Ho Kim
- Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81, Irwon-ro, Gangnam-Gu, Seoul, 06351, South Korea.
| | - Yoon Ki Cha
- Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81, Irwon-ro, Gangnam-Gu, Seoul, 06351, South Korea
| | - Semin Chong
- Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81, Irwon-ro, Gangnam-Gu, Seoul, 06351, South Korea
| | - Tae Jung Kim
- Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81, Irwon-ro, Gangnam-Gu, Seoul, 06351, South Korea
| |
Collapse
|
3
|
Duan SL, Qi L, Li MH, Liu LF, Wang Y, Guan X. The top 100 most-cited papers in pheochromocytomas and paragangliomas: A bibliometric study. Front Oncol 2022; 12:993921. [PMID: 36185194 PMCID: PMC9523535 DOI: 10.3389/fonc.2022.993921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 08/29/2022] [Indexed: 11/13/2022] Open
Abstract
BackgroundThe purpose of this study was to define and analyze the characteristics of the top 100 most-cited articles and reviews on the topic of pheochromocytomas and paragangliomas (PPGLs) by using bibliometric methods.MethodsWe explored the Web of Science Core Collection database to gather the 100 top-cited original articles and reviews of PPGL from 1985 to 20 December 2020. We conducted a bibliometric study to identify the most influential journals, authors, countries, and institutions in the PPGL field.ResultsThe 100 top-cited papers were cited a total number of 25,723 times, ranging from 131 to 1,144 (mean, 257.23 ± 173.64). All of these 100 top-cited papers were published between 1999 and 2017, and the number of top-cited papers published before 2008 (1999–2008) was significantly higher than that after 2008 (2009–2017) (p = 0.043). The journal with the highest number of published papers is the Journal of Clinical Endocrinology & Metabolism (n = 23). The United States was the most productive country in this topic, which published about half of these publications (n = 51). The National Institutes of Health (NIH) had the largest number of publications (n = 17). Genes or genetics is still the hottest topic in the field of PPGLs.ConclusionsWe defined and analyzed the top 100 most-cited papers in the field of PPGLs by gathering detailed information. These data provided insights into the most influential studies related to PPGL. We hoped to inspire researchers and readers in this field to improve their understanding of PPGL research trends and provide ideas for future research from unique perspectives.
Collapse
Affiliation(s)
- Sai-Li Duan
- National Clinical Research Center for Geriatric Disorders, Changsha, China
- Department of General Surgery, Xiangya Hospital Central South University, Changsha, China
| | - Lin Qi
- National Clinical Research Center for Geriatric Disorders, Changsha, China
- Department of Urology, Xiangya Hospital, Central South University, Changsha, China
| | - Ming-Hao Li
- National Clinical Research Center for Geriatric Disorders, Changsha, China
- Department of Urology, Xiangya Hospital, Central South University, Changsha, China
| | - Long-Fei Liu
- National Clinical Research Center for Geriatric Disorders, Changsha, China
- Department of Urology, Xiangya Hospital, Central South University, Changsha, China
| | - Yong Wang
- National Clinical Research Center for Geriatric Disorders, Changsha, China
- Department of Urology, Xiangya Hospital, Central South University, Changsha, China
- *Correspondence: Yong Wang, ; Xiao Guan,
| | - Xiao Guan
- National Clinical Research Center for Geriatric Disorders, Changsha, China
- Department of Urology, Xiangya Hospital, Central South University, Changsha, China
- *Correspondence: Yong Wang, ; Xiao Guan,
| |
Collapse
|
4
|
He R, Yin T, Pan S, Wang M, Zhang H, Qin R. One hundred most cited article related to pancreaticoduodenectomy surgery: A bibliometric analysis. Int J Surg 2022; 104:106775. [PMID: 35840048 DOI: 10.1016/j.ijsu.2022.106775] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 06/30/2022] [Accepted: 07/07/2022] [Indexed: 11/30/2022]
Abstract
BACKGROUND In light of the challenges associated with pancreaticoduodenectomy (PD) and recent key improvements, this bibliometric analysis aimed to analyze the 100 top-cited (T100) articles related to PD surgery to widen the awareness of relevant research on this procedure. METHODS The term "pancreaticoduodenectomy" was used to retrieve articles from the Web of Science Core Collection database. The 100 most cited manuscripts in the English language were identified and further analyzed by their countries of origin, publication journals, authors, and themes. RESULTS A thorough literature search was performed on the Web of Science until April 2020. The total number of citations for the T100 articles ranged from 227 to 3029. The T100 articles came from 18 different countries, with the USA accounting for the plurality (n = 72). Professor J.L. Cameron from Johns Hopkins Medicine USA published the most articles (n = 22), including one as the first author and two as a co-author. Furthermore, Johns Hopkins Medicine, USA, published the most articles on PD surgery (n = 24), with a total citation count of 14,151. The journal Annals of Surgery published 40 of the T100 articles, with 15,847 citations and an average citation count of 396. Among the T100 articles, the citation frequency following the year of publication showed a parabolic trend, with citations peaking in the 9th year following publication. CONCLUSION Our study identified and analyzed the T100 articles in PD surgery. The USA was the dominant country regarding articles, researchers, and institutions. The citations of the articles peaked in the 9th year after publication.
Collapse
Affiliation(s)
- Ruizhi He
- Department of Biliary-Pancreatic Surgery, Affiliated Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430030, China
| | - Taoyuan Yin
- Department of Biliary-Pancreatic Surgery, Affiliated Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430030, China; Department of Epidemiology and Biostatistics and State Key Laboratory of Environment Health, School of Public Health, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Shutao Pan
- Department of Biliary-Pancreatic Surgery, Affiliated Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430030, China
| | - Min Wang
- Department of Biliary-Pancreatic Surgery, Affiliated Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430030, China
| | - Hang Zhang
- Department of Biliary-Pancreatic Surgery, Affiliated Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430030, China
| | - Renyi Qin
- Department of Biliary-Pancreatic Surgery, Affiliated Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430030, China.
| |
Collapse
|
5
|
Castelló Cogollos L, Perez-Girbes A, Aleixandre-Benavent R, Valderrama-Zurián JC, Martí-Bonmatí L. Mapping the scientific research on radiology departments: Global trends in publication, collaboration and trending topics. Eur J Radiol 2021; 142:109841. [PMID: 34280595 DOI: 10.1016/j.ejrad.2021.109841] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Revised: 06/21/2021] [Accepted: 06/28/2021] [Indexed: 11/18/2022]
Abstract
PURPOSE To characterize the global research trend in radiology departments based on bibliometric indicators. MATERIAL AND METHOD As a source of information, Science Citation Index Expanded and Journal Citation Reports from Web of Science Core Collection (WoSCC) were used. Annual trends, journals of publication, subject categories of journals, collaboration indexes between authors and institutions, network of cowords and most cited papers were identified and analysed. The period of study was 2009-2018. RESULTS 283,587 downloaded papers were analysed. The number of articles was increasing, as well as the percentage of funded works. Papers were published in 7314 different journals, being the most productive Plos One (5077), followed by American Journal of Roentgenology (4602) and European Radiology (3644). Most productive subject categories of journals were Radiology, Nuclear Medicine & Medical Imaging (86,568 papers), Clinical Neurology (29,722) and Surgery (23,564). International collaboration has increased more than 5 points, from 15.2% in 2009 to 20.7% in 2018. CONCLUSIONS Most cited articles were published in high impact journals outside the scope of diagnostic imaging. Most influential topics included technical innovations within imaging modalities. MRI replaced conventional radiography and CT as the imaging technique of choice in imaging research.
Collapse
Affiliation(s)
- Lourdes Castelló Cogollos
- Departament de Sociologia i Antropologia Social. Universitat de València, Valencia, Spain; UISYS, Universitat de València, Valencia, Spain
| | - Alexandre Perez-Girbes
- Grupo de Investigación Biomédica en Imagen, Hospital Universitario y Politécnico La Fe, Valencia, Spain.
| | - Rafael Aleixandre-Benavent
- UISYS, Universitat de València, Valencia, Spain; Instituto de Gestión de la Innovación y del Conocimiento-Ingenio (CSIC-Universitat Politècnica de València), Spain
| | - Juan Carlos Valderrama-Zurián
- UISYS, Universitat de València, Valencia, Spain; Departament de Història de la Ciència I Documentació. Universitat de València, Valencia, Spain
| | - Luis Martí-Bonmatí
- Grupo de Investigación Biomédica en Imagen, Hospital Universitario y Politécnico La Fe, Valencia, Spain
| |
Collapse
|