1
|
Lin S, Gao M, Yang Z, Yu R, Dai Z, Jiang C, Yao Y, Xu T, Chen J, Huang K, Lin D. CT-Based Radiomics Models for Differentiation of Benign and Malignant Thyroid Nodules: A Multicenter Development-and-Validation. AJR Am J Roentgenol 2024. [PMID: 38691415 DOI: 10.2214/ajr.24.31077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/03/2024]
Abstract
Background: CT is increasingly detecting thyroid nodules. Prior studies indicated a potential role of CT-based radiomics models in characterizing thyroid nodules, although lacked external validation. Objectives: To develop and validate a CT-based radiomics model for the differentiation of benign and malignant thyroid nodules. Methods: This retrospective study included 378 patients (mean age, 46.3±13.9 years; 86 men, 292 women) with 408 resected thyroid nodules (145 benign, 263 malignant) from two centers (center 1: 293 nodules, January 2018-December 2022; center 2: 115 nodules, January 2020-December 2022), who underwent preoperative multiphase neck CT (noncontrast, arterial, and venous phases). Nodules from center 1 were divided into training (n=206) and internal validation (n=87) sets; all nodules from center 2 formed an external validation set. Radiologists assessed nodules for morphologic CT features. Nodules were manually segmented on all phases, and radiomic features were extracted. Conventional (clinical and morphologic CT), noncontrast radiomics, arterial-phase radiomics, venous-phase radiomics, multiphase radiomics, and combined (clinical, morphologic, and multiphase radiomics) models were established using feature selection methods and evaluated by ROC curve analysis, calibration curves, and decision-curve analysis. Results: The combined model included patient age, three morphologic features (cystic change, edge interruption sign, abnormal cervical lymph nodes), and 28 radiomic features (from all three phases). In the external validation set, the combined model had AUC of 0.923 and, at an optimal threshold derived in the training set, sensitivity of 84.0%, specificity of 94.1%, and accuracy of 87.0%. In the external validation set, AUC was significantly higher for the combined model than for the conventional model (0.827), noncontrast radiomics model (0.847), arterial-phase radimoics model (0.826), venous-phase radiomics model (0.773), and multiphase radiomics model (0.824) (all p<.05). In the external validation set, the calibration curves indicated lowest (i.e., best) Brier score for the combined model; in decision-curve analysis, the combined model had the highest net benefit for most of the range of threshold probabilities. Conclusion: A combined model incorporating clinical, morphologic CT, and multiphasic radiomics CT features, exhibited robust performing in differentiating benign and malignant thyroid nodules. Clinical Impact: The combined radiomics model may help guide further management for thyroid nodules detected on CT.
Collapse
Affiliation(s)
- Shaofan Lin
- Department of Radiology, Shantou Central Hospital, No. 114 Waima Road, Shantou 515031, People's Republic of China
| | - Ming Gao
- Department of Radiology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou 510120, People's Republic of China
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou 510120, People's Republic of China
| | - Zehong Yang
- Department of Radiology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou 510120, People's Republic of China
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou 510120, People's Republic of China
| | - Ruihuan Yu
- Department of Radiology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou 510120, People's Republic of China
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou 510120, People's Republic of China
| | - Zhuozhi Dai
- Department of Radiology, Shantou Central Hospital, No. 114 Waima Road, Shantou 515031, People's Republic of China
| | - Chuling Jiang
- Department of Radiology, Shantou Central Hospital, No. 114 Waima Road, Shantou 515031, People's Republic of China
| | - Yubin Yao
- Department of Radiology, Shantou Central Hospital, No. 114 Waima Road, Shantou 515031, People's Republic of China
| | - Tingting Xu
- Department of Radiology, Shantou Central Hospital, No. 114 Waima Road, Shantou 515031, People's Republic of China
| | - Jiali Chen
- Department of Radiology, Shantou Central Hospital, No. 114 Waima Road, Shantou 515031, People's Republic of China
| | - Kainan Huang
- Department of Radiology, Shantou Central Hospital, No. 114 Waima Road, Shantou 515031, People's Republic of China
| | - Daiying Lin
- Department of Radiology, Shantou Central Hospital, No. 114 Waima Road, Shantou 515031, People's Republic of China
| |
Collapse
|
2
|
Cai F, Cheng L, Liao X, Xie Y, Wang W, Zhang H, Lu J, Chen R, Chen C, Zhou X, Mo X, Hu G, Huang L. An Integrated Clinical and Computerized Tomography-Based Radiomic Feature Model to Separate Benign from Malignant Pleural Effusion. Respiration 2024:1-11. [PMID: 38422997 DOI: 10.1159/000536517] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 01/24/2024] [Indexed: 03/02/2024] Open
Abstract
INTRODUCTION Distinguishing between malignant pleural effusion (MPE) and benign pleural effusion (BPE) poses a challenge in clinical practice. We aimed to construct and validate a combined model integrating radiomic features and clinical factors using computerized tomography (CT) images to differentiate between MPE and BPE. METHODS A retrospective inclusion of 315 patients with pleural effusion (PE) was conducted in this study (training cohort: n = 220; test cohort: n = 95). Radiomic features were extracted from CT images, and the dimensionality reduction and selection processes were carried out to obtain the optimal radiomic features. Logistic regression (LR), support vector machine (SVM), and random forest were employed to construct radiomic models. LR analyses were utilized to identify independent clinical risk factors to develop a clinical model. The combined model was created by integrating the optimal radiomic features with the independent clinical predictive factors. The discriminative ability of each model was assessed by receiver operating characteristic curves, calibration curves, and decision curve analysis (DCA). RESULTS Out of the total 1,834 radiomic features extracted, 15 optimal radiomic features explicitly related to MPE were picked to develop the radiomic model. Among the radiomic models, the SVM model demonstrated the highest predictive performance [area under the curve (AUC), training cohort: 0.876, test cohort: 0.774]. Six clinically independent predictive factors, including age, effusion laterality, procalcitonin, carcinoembryonic antigen, carbohydrate antigen 125 (CA125), and neuron-specific enolase (NSE), were selected for constructing the clinical model. The combined model (AUC: 0.932, 0.870) exhibited superior discriminative performance in the training and test cohorts compared to the clinical model (AUC: 0.850, 0.820) and the radiomic model (AUC: 0.876, 0.774). The calibration curves and DCA further confirmed the practicality of the combined model. CONCLUSION This study presented the development and validation of a combined model for distinguishing MPE and BPE. The combined model was a powerful tool for assisting in the clinical diagnosis of PE patients.
Collapse
Affiliation(s)
- Fangqi Cai
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China,
| | - Liwei Cheng
- Department of Spine Osteopathia, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Xiaoling Liao
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Yuping Xie
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Wu Wang
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Haofeng Zhang
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Jinhua Lu
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Ru Chen
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Chunxia Chen
- Department of Clinical Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Xing Zhou
- Department of Clinical Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Xiaoyun Mo
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Guoping Hu
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| | - Luying Huang
- Department of Respiratory and Critical Care Medicine, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China
| |
Collapse
|
3
|
Zhang R, Wei Y, Wang D, Chen B, Sun H, Lei Y, Zhou Q, Luo Z, Jiang L, Qiu R, Shi F, Li W. Deep learning for malignancy risk estimation of incidental sub-centimeter pulmonary nodules on CT images. Eur Radiol 2023:10.1007/s00330-023-10518-1. [PMID: 38114849 DOI: 10.1007/s00330-023-10518-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 09/18/2023] [Accepted: 11/11/2023] [Indexed: 12/21/2023]
Abstract
OBJECTIVES To establish deep learning models for malignancy risk estimation of sub-centimeter pulmonary nodules incidentally detected by chest CT and managed in clinical settings. MATERIALS AND METHODS Four deep learning models were trained using CT images of sub-centimeter pulmonary nodules from West China Hospital, internally tested, and externally validated on three cohorts. The four models respectively learned 3D deep features from the baseline whole lung region, baseline image patch where the nodule located, baseline nodule box, and baseline plus follow-up nodule boxes. All regions of interest were automatically segmented except that the nodule boxes were additionally manually checked. The performance of models was compared with each other and that of three respiratory clinicians. RESULTS There were 1822 nodules (981 malignant) in the training set, 806 (416 malignant) in the testing set, and 357 (253 malignant) totally in the external sets. The area under the curve (AUC) in the testing set was 0.754, 0.855, 0.928, and 0.942, respectively, for models derived from baseline whole lung, image patch, nodule box, and the baseline plus follow-up nodule boxes. When baseline models externally validated (follow-up images not available), the nodule-box model outperformed the other two with AUC being 0.808, 0.848, and 0.939 respectively in the three external datasets. The resident, junior, and senior clinicians achieved an accuracy of 67.0%, 82.5%, and 90.0%, respectively, in the testing set. The follow-up model performed comparably to the senior clinician. CONCLUSION The deep learning algorithms solely mining nodule information can efficiently predict malignancy of incidental sub-centimeter pulmonary nodules. CLINICAL RELEVANCE STATEMENT The established models may be valuable for supporting clinicians in routine clinical practice, potentially reducing the number of unnecessary examinations and also delays in diagnosis. KEY POINTS • According to different regions of interest, four deep learning models were developed and compared to evaluate the malignancy of sub-centimeter pulmonary nodules by CT images. • The models derived from baseline nodule box or baseline plus follow-up nodule boxes demonstrated sufficient diagnostic accuracy (86.4% and 90.4% in the testing set), outperforming the respiratory resident (67.0%) and junior clinician (82.5%). • The proposed deep learning methods may aid clinicians in optimizing follow-up recommendations for sub-centimeter pulmonary nodules and may lead to fewer unnecessary diagnostic interventions.
Collapse
Affiliation(s)
- Rui Zhang
- Department of Pulmonary and Critical Care Medicine, West China Hospital, Sichuan University, Chengdu, China
- General Practice Medical Center, West China Hospital, Sichuan University, Chengdu, China
| | - Ying Wei
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd, Shanghai, China
| | - Denian Wang
- Precision Medicine Center, Precision Medicine Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, China
| | - Bojiang Chen
- Department of Pulmonary and Critical Care Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Huaiqiang Sun
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
| | - Yi Lei
- General Practice Medical Center, West China Hospital, Sichuan University, Chengdu, China
| | - Qing Zhou
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd, Shanghai, China
| | - Zhuang Luo
- Department of Pulmonary and Critical Care Medicine, the First Affiliated Hospital of Kunming Medical University, Kunming, Yunnan, China
| | - Li Jiang
- Department of Respiratory and Critical Care Medicine, the Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, China
| | - Rong Qiu
- Department of Respiratory and Critical Care Medicine, Suining Central Hospital, Suining, Sichuan, China
| | - Feng Shi
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd, Shanghai, China.
| | - Weimin Li
- Department of Pulmonary and Critical Care Medicine, West China Hospital, Sichuan University, Chengdu, China.
| |
Collapse
|
4
|
Higgins H, Nakhla A, Lotfalla A, Khalil D, Doshi P, Thakkar V, Shirini D, Bebawy M, Ammari S, Lopci E, Schwartz LH, Postow M, Dercle L. Recent Advances in the Field of Artificial Intelligence for Precision Medicine in Patients with a Diagnosis of Metastatic Cutaneous Melanoma. Diagnostics (Basel) 2023; 13:3483. [PMID: 37998619 PMCID: PMC10670510 DOI: 10.3390/diagnostics13223483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 10/27/2023] [Accepted: 10/31/2023] [Indexed: 11/25/2023] Open
Abstract
Standard-of-care medical imaging techniques such as CT, MRI, and PET play a critical role in managing patients diagnosed with metastatic cutaneous melanoma. Advancements in artificial intelligence (AI) techniques, such as radiomics, machine learning, and deep learning, could revolutionize the use of medical imaging by enhancing individualized image-guided precision medicine approaches. In the present article, we will decipher how AI/radiomics could mine information from medical images, such as tumor volume, heterogeneity, and shape, to provide insights into cancer biology that can be leveraged by clinicians to improve patient care both in the clinic and in clinical trials. More specifically, we will detail the potential role of AI in enhancing detection/diagnosis, staging, treatment planning, treatment delivery, response assessment, treatment toxicity assessment, and monitoring of patients diagnosed with metastatic cutaneous melanoma. Finally, we will explore how these proof-of-concept results can be translated from bench to bedside by describing how the implementation of AI techniques can be standardized for routine adoption in clinical settings worldwide to predict outcomes with great accuracy, reproducibility, and generalizability in patients diagnosed with metastatic cutaneous melanoma.
Collapse
Affiliation(s)
- Hayley Higgins
- Department of Clinical Medicine, Touro College of Osteopathic Medicine, Middletown, NY 10940, USA; (A.L.); (M.B.)
| | - Abanoub Nakhla
- Department of Clinical Medicine, American University of the Caribbean School of Medicine, 33027 Cupecoy, Sint Maarten, The Netherlands;
| | - Andrew Lotfalla
- Department of Clinical Medicine, Touro College of Osteopathic Medicine, Middletown, NY 10940, USA; (A.L.); (M.B.)
| | - David Khalil
- Department of Clinical Medicine, Campbell University School of Osteopathic Medicine, Lillington, NC 27546, USA; (D.K.); (P.D.); (V.T.)
| | - Parth Doshi
- Department of Clinical Medicine, Campbell University School of Osteopathic Medicine, Lillington, NC 27546, USA; (D.K.); (P.D.); (V.T.)
| | - Vandan Thakkar
- Department of Clinical Medicine, Campbell University School of Osteopathic Medicine, Lillington, NC 27546, USA; (D.K.); (P.D.); (V.T.)
| | - Dorsa Shirini
- Department of Radiology, Shahid Beheshti University of Medical Sciences, Tehran 1981619573, Iran;
| | - Maria Bebawy
- Department of Clinical Medicine, Touro College of Osteopathic Medicine, Middletown, NY 10940, USA; (A.L.); (M.B.)
| | - Samy Ammari
- Département d’Imagerie Médicale Biomaps, UMR1281 INSERM, CEA, CNRS, Gustave Roussy, Université Paris-Saclay, 94800 Villejuif, France;
- ELSAN Département de Radiologie, Institut de Cancérologie Paris Nord, 95200 Sarcelles, France
| | - Egesta Lopci
- Nuclear Medicine Unit, IRCCS Humanitas Research Hospital, 20089 Rozzano, Italy;
| | - Lawrence H. Schwartz
- Department of Radiology, New York-Presbyterian, Columbia University Irving Medical Center, New York, NY 10032, USA;
| | - Michael Postow
- Melanoma Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
- Weill Cornell Medical College, New York, NY 10065, USA
| | - Laurent Dercle
- Department of Radiology, Shahid Beheshti University of Medical Sciences, Tehran 1981619573, Iran;
| |
Collapse
|