1
|
Topcuoglu OM, Uzunoglu B, Orhan T, Basaran EB, Gormez A, Sarica O. A real-world comparison of the diagnostic performances of six different TI-RADS guidelines, including ACR-/Kwak-/K-/EU-/ATA-/C-TIRADS. Clin Imaging 2025; 117:110366. [PMID: 39586159 DOI: 10.1016/j.clinimag.2024.110366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2024] [Revised: 10/06/2024] [Accepted: 11/18/2024] [Indexed: 11/27/2024]
Abstract
PURPOSE To compare the diagnostic performance of six different currently available guidelines including the American College of Radiology Thyroid Imaging and Reporting Data System (ACR-TIRADS), Kwak-TIRADS, Korean TIRADS (K-TIRADS), European TIRADS (EU-TIRADS), American Thyroid Association (ATA) and Chinese TIRADS (C-TIRADS), in differentiating malignant from benign thyroid nodules (TN). MATERIALS AND METHODS In this single-center study, between January-2007 and September-2023, ultrasound (US) images of TNs that were pathologically proven either by surgery or by fine needle aspiration biopsy (FNAB), were retrospectively evaluated and categorized according to six different currently available guidelines. Area under curve (AUC), sensitivity, specificity, positive and negative predictive values (PPV and NPV, respectively) and miss rates for malignancy (MRM) were calculated for each guideline. RESULTS A total of 829 TNs (n = 234 malignant and n = 595 benign) were included. AUC, sensitivity, specificity, PPV, NPV and accuracy for ACR-TIRADS were 0.786, 99.8 %, 27.1 %, 31.92 %, 99.73 % and 54.6 %, respectively; for Kwak-TIRADS 0.839, 97.8 %, 42.1 %, 36.29 %, 98.11 % and 63.1 %, respectively; for K-TIRADS 0.797, 97.6 %, 41.6 %, 36.01 %, 84.85 % and 62.8, respectively, for EU-TIRADS 0.766, 97.8 %, 35.6 %, 33.89 %, 97.92 % and 59.1 %, respectively, for ATA 0.788, 97.5 %, 49.8 %, 32.86 %, 88.16 % and 64.2 %, respectively and for C-TIRADS 0.842, 0 %, 92.8 %, 54.3 %, 39.53 %, 90.42 %, and 68.8 % respectively. MRM regarding ACR-/Kwak-/K-/EU-/ATA-/C-TIRADS were 2.2 %, 0.5 %, 2.9 %, 2.5 %, 3.3 % and 0.1 %, respectively. CONCLUSION Six different currently available TIRADS guidelines can provide effective differentiation of malignant TNs from benign ones with similar diagnostic performances. However; C-TIRADS offered the highest AUC and the lowest MRM than the other guidelines, in this series.
Collapse
Affiliation(s)
- Osman Melih Topcuoglu
- Yeditepe University Hospitals, Department of Radiology, Kosuyolu 34718, Istanbul, Turkey.
| | - Betul Uzunoglu
- Yeditepe University Hospitals, Department of Radiology, Kosuyolu 34718, Istanbul, Turkey
| | - Tolga Orhan
- Yeditepe University Hospitals, Department of Radiology, Kosuyolu 34718, Istanbul, Turkey.
| | - Ekin Bora Basaran
- Yeditepe University Hospitals, Department of Radiology, Kosuyolu 34718, Istanbul, Turkey
| | - Ayşegul Gormez
- Yeditepe University Hospitals, Department of Radiology, Kosuyolu 34718, Istanbul, Turkey
| | - Ozgur Sarica
- Yeditepe University Hospitals, Department of Radiology, Kosuyolu 34718, Istanbul, Turkey.
| |
Collapse
|
2
|
Xu Z, Ye J, Luo W, Han L, Yin H, Li Y, Su Q, Su S, Lyu G, Li S. An assessment of ChatGPT in error detection for thyroid ultrasound reports: A comparative study with ultrasound physicians. Digit Health 2025; 11:20552076251326019. [PMID: 40093707 PMCID: PMC11907604 DOI: 10.1177/20552076251326019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2024] [Accepted: 02/18/2025] [Indexed: 03/19/2025] Open
Abstract
Background This study evaluates the performance of GPT-4o in detecting errors in ACR TIRADS ultrasound reports and its potential to reduce report generation time. Methods A retrospective analysis of 200 thyroid ultrasound reports from the Second Affiliated Hospital of Fujian Medical University was conducted, with reports categorized as correct or containing up to three errors. GPT-4o's performance was compared with ultrasound physicians of varying experience levels in error detection and processing time. Results GPT-4o detected 90.0% (180/200) of errors, slightly less than the best-performing senior ultrasound physician's 93.0% (186/200) with no significant difference (p = 0.281). GPT-4o's error detection rate was comparable to that of ultrasound physicians overall (p = 0.098 to 0.866). It outperformed Resident 2 in diagnostic errors (87% vs. 69%). Reader agreement was low (Cohen's kappa = 0 to 0.31). GPT-4o reviewed reports significantly faster than all ultrasound physicians (0.79 vs. 1.8 to 3.1 h, p < 0.001), making it a reliable and efficient tool for error detection in medical imaging. Conclusions GPT-4o is comparable to experienced ultrasound physicians in error detection and significantly improves report processing efficiency, offering a valuable tool for enhancing diagnostic accuracy and aiding junior residents.
Collapse
Affiliation(s)
- Zhirong Xu
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Jiayi Ye
- Department of Nuclear Medicine, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Weiwen Luo
- Department of Medical Ultrasound, Zhangzhou Municipal Hospital of Fujian Province and Zhangzhou Affiliated Hospital of Fujian Medical University, Zhangzhou, China
| | - Lina Han
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Hui Yin
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Yanru Li
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Qichen Su
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Shanshan Su
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Guorong Lyu
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Shaohui Li
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| |
Collapse
|
3
|
Giovanella L, Tuncel M, Aghaee A, Campenni A, De Virgilio A, Petranović Ovčariček P. Theranostics of Thyroid Cancer. Semin Nucl Med 2024; 54:470-487. [PMID: 38503602 DOI: 10.1053/j.semnuclmed.2024.01.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2024] [Revised: 01/29/2024] [Accepted: 01/30/2024] [Indexed: 03/21/2024]
Abstract
Molecular imaging is pivotal in evaluating and managing patients with different thyroid cancer histotypes. The existing, pathology-based, risk stratification systems can be usefully refined, by incorporating tumor-specific molecular and molecular imaging biomarkers with theranostic value, allowing patient-specific treatment decisions. Molecular imaging with different radioactive iodine isotopes (ie, I131, I123, I124) is a central component of differentiated carcinoma (DTC)'s risk stratification while [18F]F-fluorodeoxyglucose ([18F]FDG) PET/CT is interrogated about disease aggressiveness and presence of distant metastases. Moreover, it is particularly useful to assess and risk-stratify patients with radioiodine-refractory DTC, poorly differentiated, and anaplastic thyroid cancers. [18F]F-dihydroxyphenylalanine (6-[18F]FDOPA) PET/CT is the most specific and accurate molecular imaging procedure for patients with medullary thyroid cancer (MTC), a neuroendocrine tumor derived from thyroid C-cells. In addition, [18F]FDG PET/CT can be used in patients with more aggressive clinical or biochemical (ie, serum markers levels and kinetics) MTC phenotypes. In addition to conventional radioiodine therapy for DTC, new redifferentiation strategies are now available to restore uptake in radioiodine-refractory DTC. Moreover, peptide receptor theranostics showed promising results in patients with advanced and metastatic radioiodine-refractory DTC and MTC, respectively. The current appropriate role and future perspectives of molecular imaging and theranostics in thyroid cancer are discussed in our present review.
Collapse
Affiliation(s)
- Luca Giovanella
- Department of Nuclear Medicine, Gruppo Ospedaliero Moncucco, Lugano, Switzerland; Clinic for Nuclear Medicine, University Hospital Zürich, Zürich, Switzerland.
| | - Murat Tuncel
- Department of Nuclear Medicine, Hacettepe University, Ankara, Turkey
| | - Atena Aghaee
- Department of Nuclear Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Alfredo Campenni
- Nuclear Medicine Unit, Department of Biomedical and Dental Sciences and Morpho-Functional Imaging, University of Messina, Messina, Italy
| | - Armando De Virgilio
- Department of Head and Neck Surgery Humanitas Research Hospital, Rozzano, Italy
| | - Petra Petranović Ovčariček
- Department of Oncology and Nuclear Medicine, University Hospital Center Sestre Milosrdnice, Zagreb, Croatia; School of Medicine, University of Zagreb, Zagreb, Croatia
| |
Collapse
|
4
|
Trovato P, Simonetti I, Morrone A, Fusco R, Setola SV, Giacobbe G, Brunese MC, Pecchi A, Triggiani S, Pellegrino G, Petralia G, Sica G, Petrillo A, Granata V. Scientific Status Quo of Small Renal Lesions: Diagnostic Assessment and Radiomics. J Clin Med 2024; 13:547. [PMID: 38256682 PMCID: PMC10816509 DOI: 10.3390/jcm13020547] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 01/05/2024] [Accepted: 01/16/2024] [Indexed: 01/24/2024] Open
Abstract
Background: Small renal masses (SRMs) are defined as contrast-enhanced renal lesions less than or equal to 4 cm in maximal diameter, which can be compatible with stage T1a renal cell carcinomas (RCCs). Currently, 50-61% of all renal tumors are found incidentally. Methods: The characteristics of the lesion influence the choice of the type of management, which include several methods SRM of management, including nephrectomy, partial nephrectomy, ablation, observation, and also stereotactic body radiotherapy. Typical imaging methods available for differentiating benign from malignant renal lesions include ultrasound (US), contrast-enhanced ultrasound (CEUS), computed tomography (CT), and magnetic resonance imaging (MRI). Results: Although ultrasound is the first imaging technique used to detect small renal lesions, it has several limitations. CT is the main and most widely used imaging technique for SRM characterization. The main advantages of MRI compared to CT are the better contrast resolution and tissue characterization, the use of functional imaging sequences, the possibility of performing the examination in patients allergic to iodine-containing contrast medium, and the absence of exposure to ionizing radiation. For a correct evaluation during imaging follow-up, it is necessary to use a reliable method for the assessment of renal lesions, represented by the Bosniak classification system. This classification was initially developed based on contrast-enhanced CT imaging findings, and the 2019 revision proposed the inclusion of MRI features; however, the latest classification has not yet received widespread validation. Conclusions: The use of radiomics in the evaluation of renal masses is an emerging and increasingly central field with several applications such as characterizing renal masses, distinguishing RCC subtypes, monitoring response to targeted therapeutic agents, and prognosis in a metastatic context.
Collapse
Affiliation(s)
- Piero Trovato
- Radiology Division, Istituto Nazionale Tumori-IRCCS-Fondazione G. Pascale, 80131 Naples, Italy; (P.T.); (I.S.); (S.V.S.); (A.P.); (V.G.)
| | - Igino Simonetti
- Radiology Division, Istituto Nazionale Tumori-IRCCS-Fondazione G. Pascale, 80131 Naples, Italy; (P.T.); (I.S.); (S.V.S.); (A.P.); (V.G.)
| | - Alessio Morrone
- Division of Radiology, Università degli Studi della Campania Luigi Vanvitelli, 80138 Naples, Italy;
| | - Roberta Fusco
- Medical Oncology Division, Igea SpA, 80013 Naples, Italy
- Italian Society of Medical and Interventional Radiology (SIRM), SIRM Foundation, Via della Signora 2, 20122 Milan, Italy
| | - Sergio Venanzio Setola
- Radiology Division, Istituto Nazionale Tumori-IRCCS-Fondazione G. Pascale, 80131 Naples, Italy; (P.T.); (I.S.); (S.V.S.); (A.P.); (V.G.)
| | - Giuliana Giacobbe
- General and Emergency Radiology Department, “Antonio Cardarelli” Hospital, 80131 Naples, Italy;
| | - Maria Chiara Brunese
- Diagnostic Imaging Section, Department of Medical and Surgical Sciences & Neurosciences, University of Molise, 86100 Campobasso, Italy;
| | - Annarita Pecchi
- Department of Radiology, University of Modena and Reggio Emilia, 41121 Modena, Italy;
| | - Sonia Triggiani
- Postgraduate School of Radiodiagnostics, University of Milan, 20122 Milan, Italy; (S.T.); (G.P.)
| | - Giuseppe Pellegrino
- Postgraduate School of Radiodiagnostics, University of Milan, 20122 Milan, Italy; (S.T.); (G.P.)
| | - Giuseppe Petralia
- Department of Medical Imaging and Radiation Sciences, IEO European Institute of Oncology IRCCS, Via Ripamonti 435, 20141 Milan, Italy;
| | - Giacomo Sica
- Radiology Unit, Monaldi Hospital, Azienda Ospedaliera dei Colli, 80131 Naples, Italy;
| | - Antonella Petrillo
- Radiology Division, Istituto Nazionale Tumori-IRCCS-Fondazione G. Pascale, 80131 Naples, Italy; (P.T.); (I.S.); (S.V.S.); (A.P.); (V.G.)
| | - Vincenza Granata
- Radiology Division, Istituto Nazionale Tumori-IRCCS-Fondazione G. Pascale, 80131 Naples, Italy; (P.T.); (I.S.); (S.V.S.); (A.P.); (V.G.)
| |
Collapse
|
5
|
Granata V, Fusco R, Brunese MC, Ferrara G, Tatangelo F, Ottaiano A, Avallone A, Miele V, Normanno N, Izzo F, Petrillo A. Machine Learning and Radiomics Analysis for Tumor Budding Prediction in Colorectal Liver Metastases Magnetic Resonance Imaging Assessment. Diagnostics (Basel) 2024; 14:152. [PMID: 38248029 PMCID: PMC10814152 DOI: 10.3390/diagnostics14020152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Revised: 01/04/2024] [Accepted: 01/05/2024] [Indexed: 01/23/2024] Open
Abstract
PURPOSE We aimed to assess the efficacy of machine learning and radiomics analysis using magnetic resonance imaging (MRI) with a hepatospecific contrast agent, in a pre-surgical setting, to predict tumor budding in liver metastases. METHODS Patients with MRI in a pre-surgical setting were retrospectively enrolled. Manual segmentation was made by means 3D Slicer image computing, and 851 radiomics features were extracted as median values using the PyRadiomics Python package. Balancing was performed and inter- and intraclass correlation coefficients were calculated to assess the between observer and within observer reproducibility of all radiomics extracted features. A Wilcoxon-Mann-Whitney nonparametric test and receiver operating characteristics (ROC) analysis were carried out. Balancing and feature selection procedures were performed. Linear and non-logistic regression models (LRM and NLRM) and different machine learning-based classifiers including decision tree (DT), k-nearest neighbor (KNN) and support vector machine (SVM) were considered. RESULTS The internal training set included 49 patients and 119 liver metastases. The validation cohort consisted of a total of 28 single lesion patients. The best single predictor to classify tumor budding was original_glcm_Idn obtained in the T1-W VIBE sequence arterial phase with an accuracy of 84%; wavelet_LLH_firstorder_10Percentile was obtained in the T1-W VIBE sequence portal phase with an accuracy of 92%; wavelet_HHL_glcm_MaximumProbability was obtained in the T1-W VIBE sequence hepatobiliary excretion phase with an accuracy of 88%; and wavelet_LLH_glcm_Imc1 was obtained in T2-W SPACE sequences with an accuracy of 88%. Considering the linear regression analysis, a statistically significant increase in accuracy to 96% was obtained using a linear weighted combination of 13 radiomic features extracted from the T1-W VIBE sequence arterial phase. Moreover, the best classifier was a KNN trained with the 13 radiomic features extracted from the arterial phase of the T1-W VIBE sequence, obtaining an accuracy of 95% and an AUC of 0.96. The validation set reached an accuracy of 94%, a sensitivity of 86% and a specificity of 95%. CONCLUSIONS Machine learning and radiomics analysis are promising tools in predicting tumor budding. Considering the linear regression analysis, there was a statistically significant increase in accuracy to 96% using a weighted linear combination of 13 radiomics features extracted from the arterial phase compared to a single radiomics feature.
Collapse
Affiliation(s)
- Vincenza Granata
- Division of Radiology, “Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli”, 80131 Naples, Italy;
| | - Roberta Fusco
- Medical Oncology Division, Igea SpA, 80013 Naples, Italy;
| | - Maria Chiara Brunese
- Department of Medicine and Health Sciences V. Tiberio, University of Molise, 86100 Campobasso, Italy;
| | - Gerardo Ferrara
- Division of Pathology, “Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli”, 80131 Naples, Italy; (G.F.); (F.T.)
| | - Fabiana Tatangelo
- Division of Pathology, “Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli”, 80131 Naples, Italy; (G.F.); (F.T.)
| | - Alessandro Ottaiano
- Clinical Sperimental Abdominal Oncology Unit, Istituto Nazionale Tumori, IRCCS Fondazione G. Pascale, 80131 Naples, Italy; (A.O.); (A.A.)
| | - Antonio Avallone
- Clinical Sperimental Abdominal Oncology Unit, Istituto Nazionale Tumori, IRCCS Fondazione G. Pascale, 80131 Naples, Italy; (A.O.); (A.A.)
| | - Vittorio Miele
- Cell Biology and Biotherapy Unit, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy;
| | - Nicola Normanno
- Department of Radiology, University of Florence—Azienda Ospedaliero—Universitaria Careggi, 50134 Florence, Italy;
| | - Francesco Izzo
- Division of Epatobiliary Surgical Oncology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy;
| | - Antonella Petrillo
- Division of Radiology, “Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli”, 80131 Naples, Italy;
| |
Collapse
|