1
|
Yang Y, Cheng J, Chen L, Cui C, Liu S, Zuo M. Application of machine learning for the differentiation of thymomas and thymic cysts using deep transfer learning: A multi-center comparison of diagnostic performance based on different dimensional models. Thorac Cancer 2024; 15:2235-2247. [PMID: 39305057 PMCID: PMC11543273 DOI: 10.1111/1759-7714.15454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2024] [Revised: 09/02/2024] [Accepted: 09/04/2024] [Indexed: 11/09/2024] Open
Abstract
OBJECTIVE This study aimed to evaluate the feasibility and performance of deep transfer learning (DTL) networks with different types and dimensions in differentiating thymomas from thymic cysts in a retrospective cohort. MATERIALS AND METHODS Based on chest-enhanced computed tomography (CT), the region of interest was delineated, and the maximum cross section of the lesion was selected as the input image. Five convolutional neural networks (CNNs) and Vision Transformer (ViT) were used to construct a 2D DTL model. The 2D model constructed by the maximum section (n) and the upper and lower layers (n - 1, n + 1) of the lesion was used for feature extraction, and the features were selected. The remaining features were pre-fused to construct a 2.5D model. The whole lesion image was selected for input and constructing a 3D model. RESULTS In the 2D model, the area under curve (AUC) of Resnet50 was 0.950 in the training cohort and 0.907 in the internal validation cohort. In the 2.5D model, the AUCs of Vgg11 in the internal validation cohort and external validation cohort 1 were 0.937 and 0.965, respectively. The AUCs of Inception_v3 in the training cohort and external validation cohort 2 were 0.981 and 0.950, respectively. The AUC values of 3D_Resnet50 in the four cohorts were 0.987, 0.937, 0.938, and 0.905. CONCLUSIONS The DTL model based on multiple different dimensions can be used as a highly sensitive and specific tool for the non-invasive differential diagnosis of thymomas and thymic cysts to assist clinicians in decision-making.
Collapse
Affiliation(s)
- Yuhua Yang
- Department of Radiology, The Second Affiliated Hospital, Jiangxi Medical CollegeNanchang UniversityNanchangChina
- Intelligent Medical Imaging of Jiangxi Key LaboratoryNanchangChina
| | - Jia Cheng
- Department of RadiologyThe First Affiliated Hospital of Gannan Medical UniversityGanzhouChina
| | - Liang Chen
- Department of RadiologyAffiliated Hospital of Jiujiang UniversityJiujiangChina
| | - Can Cui
- Department of Radiology, The Second Affiliated Hospital, Jiangxi Medical CollegeNanchang UniversityNanchangChina
- Intelligent Medical Imaging of Jiangxi Key LaboratoryNanchangChina
| | - Shaoqiang Liu
- Department of RadiologyThe First Affiliated Hospital of Gannan Medical UniversityGanzhouChina
| | - Minjing Zuo
- Department of Radiology, The Second Affiliated Hospital, Jiangxi Medical CollegeNanchang UniversityNanchangChina
- Intelligent Medical Imaging of Jiangxi Key LaboratoryNanchangChina
| |
Collapse
|
2
|
Yang Y, Cheng J, Peng Z, Yi L, Lin Z, He A, Jin M, Cui C, Liu Y, Zhong Q, Zuo M. Development and Validation of Contrast-Enhanced CT-Based Deep Transfer Learning and Combined Clinical-Radiomics Model to Discriminate Thymomas and Thymic Cysts: A Multicenter Study. Acad Radiol 2024; 31:1615-1628. [PMID: 37949702 DOI: 10.1016/j.acra.2023.10.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 10/04/2023] [Accepted: 10/07/2023] [Indexed: 11/12/2023]
Abstract
RATIONALE AND OBJECTIVES This study aims to evaluate the feasibility and effectiveness of deep transfer learning (DTL) and clinical-radiomics in differentiating thymoma from thymic cysts. MATERIALS AND METHODS Clinical and imaging data of 196 patients pathologically diagnosed with thymoma and thymic cysts were retrospectively collected from center 1. (training cohort: n = 137; internal validation cohort: n = 59). An independent external validation cohort comprised 68 thymoma and thymic cyst patients from center 2. Region of interest (ROI) delineation was performed on contrast-enhanced chest computed tomography (CT) images, and eight DTL models including Densenet 169, Mobilenet V2, Resnet 101, Resnet 18, Resnet 34, Resnet 50, Vgg 13, Vgg 16 were constructed. Radiomics features were extracted from the ROI on the CT images of thymoma and thymic cyst patients, and feature selection was performed using intra-observer correlation coefficient (ICC), Spearman correlation analysis, and least absolute shrinkage and selection operator (LASSO) algorithm. Univariate analysis and multivariable logistic regression (LR) were used to select clinical-radiological features. Six machine learning classifiers, including LR, support vector machine (SVM), k-nearest neighbors (KNN), Light Gradient Boosting Machine (LightGBM), Adaptive Boosting (AdaBoost), and Multilayer Perceptron (MLP), were used to construct Radiomics and Clinico-radiologic models. The selected features from the Radiomics and Clinico-radiologic models were fused to build a Combined model. Receiver operating characteristic curve (ROC), calibration curve, and decision curve analysis (DCA) were used to evaluate the discrimination, calibration, and clinical utility of the models, respectively. The Delong test was used to compare the AUC between different models. K-means clustering was used to subdivide the lesions of thymomas or thymic cysts into subregions, and traditional radiomics methods were used to extract features and compare the ability of Radiomics and DTL models to reflect intratumoral heterogeneity using correlation analysis. RESULTS The Densenet 169 based on DTL performed the best, with AUC of 0.933 (95% CI: 0.875-0.991) in the internal validation cohort and 0.962 (95% CI: 0.923-1.000) in the external validation cohort. The AdaBoost classifier achieved AUC of 0.965 (95% CI: 0.923-1.000) and 0.959 (95% CI: 0.919-1.000) in the internal and external validation cohorts, respectively, for the Radiomics model. The LightGBM classifier achieved AUC of 0.805 (95% CI: 0.690-0.920) and 0.839 (95% CI: 0.736-0.943) in the Clinico-radiologic model. The AUC of the Combined model in the internal and external validation cohorts was 0.933 (95% CI: 0.866-1.000) and 0.945 (95% CI: 0.897-0.994), respectively. The results of the Delong test showed that the Radiomics model, DTL model, and Combined model outperformed the Clinico-radiologic model in both internal and external validation cohorts (p-values were 0.002, 0.004, and 0.033 in the internal validation cohort, while in the external validation cohort, the p-values were 0.014, 0.006, and 0.015, respectively). But there was no statistical difference in performance among the three models (all p-values <0.05). Correlation analysis showed that radiomics performed better than DTL in quantifying intratumoral heterogeneity differences between thymoma and thymic cysts. CONCLUSION The developed DTL model and the Combined model based on radiomics and clinical-radiologic features achieved excellent diagnostic performance in differentiating thymic cysts from thymoma. They can serve as potential tools to assist clinical decision-making, particularly when endoscopic biopsy carries a high risk.
Collapse
Affiliation(s)
- Yuhua Yang
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - Jia Cheng
- Department of Radiology, the First Affiliated Hospital of Gannan Medical University, Ganzhou, China (J.C.)
| | - Zhiwei Peng
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - Li Yi
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - Ze Lin
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - Anjing He
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - Mengni Jin
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - Can Cui
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - Ying Liu
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - QiWen Zhong
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.)
| | - Minjing Zuo
- Department of Radiology, the Second Affiliated Hospital of Nanchang University, Nanchang, China (Y.Y., Z.P., L.Y., Z.L., A.H., M.J., C.C., Y.L., Q.Z., M.Z.).
| |
Collapse
|
4
|
Del Vecchio Blanco G, Palmieri G, Giannarelli D, Formica V, Portarena I, Nardecchia A, Troncone E, Benassi M, Giudice E, Anselmo A, Tisone G, Roselli M, Monteleone G, Paoluzi OA. Factors influencing diagnostic accuracy of endoscopic ultrasound-guided fine-needle aspiration (EUS-FNA) in pancreatic and biliary tumors. Scand J Gastroenterol 2021; 56:498-504. [PMID: 33539716 DOI: 10.1080/00365521.2021.1880628] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
BACKGROUND AND AIM Diagnostic accuracy of endoscopic ultrasound-guided fine-needle aspiration (EUS-FNA) is influenced by several factors, primarily operator expertise. Formal training in EUS-FNA, as suggested by the European Society of Gastrointestinal Endoscopy and the American Society for Gastrointestinal Endoscopy guidelines, is not always available and is often expensive and time-consuming. In this study we evaluate factors influencing the diagnostic accuracy of pancreatic EUS-FNA. METHODS In a retrospective study, 557 consecutive EUS-FNAs were evaluated. Several variables relating to the procedures were considered to calculate the EUS-FNA performance over eight years. RESULTS A total of 308 out of 557 EUS-FNAs were selected. Overall sensitivity of EUS-FNA was 66% (95% CI: 60.8-71.8), specificity 100%, and diagnostic accuracy 69% (95% CI: 64.0-74.4). An increase in diagnostic accuracy was observed to >90% using a new fine-needle biopsy (FNB) needle and in the case of simultaneous sampling of primary and metastatic lesions. Diagnostic accuracy >80% was observed after 250 procedures, in the absence of rapid on-site cytopathological examination (ROSE). Multivariate logistic regression analysis confirmed that the FNB needle, operator skill, and double EUS-FNA sampling are associated with high diagnostic accuracy. CONCLUSIONS The learning curve for EUS-FNA may be longer and a considerable number of procedures are needed to achieve high diagnostic accuracy in the absence of ROSE. However, the use of FNB needles and the simultaneous sampling of primary and metastatic lesions can rapidly improve the diagnostic accuracy of the procedure.
Collapse
Affiliation(s)
| | - Giampiero Palmieri
- Anatomic Pathology Unit, Department of Biomedicine and Prevention, University of Rome Tor Vergata, Rome, Italy
| | - Diana Giannarelli
- Biostatistical Unit, Regina Elena Institute-Hospital Physiotherapy Institutes, Rome, Italy
| | | | | | | | - Edoardo Troncone
- Gastroenterology Unit, Department of Systems Medicine, University of Rome Tor Vergata, Rome, Italy
| | - Michela Benassi
- Radiotherapy Unit, Department of Oncohematology, University of Rome Tor Vergata, Rome, Italy
| | - Emilia Giudice
- Radiotherapy Unit, Department of Oncohematology, University of Rome Tor Vergata, Rome, Italy
| | - Alessandro Anselmo
- Transplant Surgery Unit, Department of Surgery, University of Rome Tor Vergata, Rome, Italy
| | - Giuseppe Tisone
- Transplant Surgery Unit, Department of Surgery, University of Rome Tor Vergata, Rome, Italy
| | - Mario Roselli
- Oncology Unit, University of Rome Tor Vergata, Rome, Italy
| | - Giovanni Monteleone
- Gastroenterology Unit, Department of Systems Medicine, University of Rome Tor Vergata, Rome, Italy
| | - Omero Alessandro Paoluzi
- Gastroenterology Unit, Department of Systems Medicine, University of Rome Tor Vergata, Rome, Italy
| |
Collapse
|
5
|
Liu L, Lu F, Pang P, Shao G. Can computed tomography-based radiomics potentially discriminate between anterior mediastinal cysts and type B1 and B2 thymomas? Biomed Eng Online 2020; 19:89. [PMID: 33246468 PMCID: PMC7694435 DOI: 10.1186/s12938-020-00833-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2020] [Accepted: 11/17/2020] [Indexed: 01/04/2023] Open
Abstract
Background Anterior mediastinal cysts (AMC) are often misdiagnosed as thymomas and undergo surgical resection, which caused unnecessary treatment and medical resource waste. The purpose of this study is to explore potential possibility of computed tomography (CT)-based radiomics for the diagnosis of AMC and type B1 and B2 thymomas. Methods A group of 188 patients with pathologically confirmed AMC (106 cases misdiagnosed as thymomas in CT) and thymomas (82 cases) and underwent routine chest CT from January 2010 to December 2018 were retrospectively analyzed. The lesions were manually delineated using ITK-SNAP software, and radiomics features were performed using the artificial intelligence kit (AK) software. A total of 180 tumour texture features were extracted from enhanced CT and unenhanced CT, respectively. The general test, correlation analysis, and LASSO were used to features selection and then the radiomics signature (radscore) was obtained. The combined model including radscore and independent clinical factors was developed. The model performances were evaluated on discrimination, calibration curve. Results Two radscore models were constructed from the unenhanced and enhanced phases based on the selected four and three features, respectively. The AUC, sensitivity, and specificity of the enhanced radscore model were 0.928, 89.3%, and 83.8% in the training dataset and 0.899, 84.6%, and 87.5% in the test dataset (higher than the unenhanced radscore model). The combined model of enhanced CT including radiomics features and independent clinical factors yielded an AUC, sensitivity and specificity of 0.941, 82.1%, and 94.6% in the training dataset and 0.938, 92.3%, and 87.5% in the test dataset (higher than the unenhanced combined model and enhanced radscore model). Conclusions The study suggested the possibility that the combined model in enhanced CT provided a potential tool to facilitate the differential diagnosis of AMC and type B1 and B2 thymomas.
Collapse
Affiliation(s)
- Lulu Liu
- Institute of Cancer and Basic Medicine (ICBM), Chinese Academy of Sciences, Hangzhou, China.,Department of Radiology, Cancer Hospital of the University of Chinese Academy of Sciences, Hangzhou, China.,Department of Radiology, Zhejiang Cancer Hospital, No. 1 Banshan Street, Gongshu District, Hangzhou, 321022, Zhejiang, People's Republic of China
| | - Fangxiao Lu
- Institute of Cancer and Basic Medicine (ICBM), Chinese Academy of Sciences, Hangzhou, China.,Department of Radiology, Cancer Hospital of the University of Chinese Academy of Sciences, Hangzhou, China.,Department of Radiology, Zhejiang Cancer Hospital, No. 1 Banshan Street, Gongshu District, Hangzhou, 321022, Zhejiang, People's Republic of China
| | - Peipei Pang
- Life Sciences, GE Healthcare, Hangzhou, 310000, Zhejiang, China
| | - Guoliang Shao
- Institute of Cancer and Basic Medicine (ICBM), Chinese Academy of Sciences, Hangzhou, China. .,Department of Radiology, Cancer Hospital of the University of Chinese Academy of Sciences, Hangzhou, China. .,Department of Radiology, Zhejiang Cancer Hospital, No. 1 Banshan Street, Gongshu District, Hangzhou, 321022, Zhejiang, People's Republic of China.
| |
Collapse
|