1
|
Zhan Y, Dai R, Li F, Cheng Z, Zhuo Y, Shan F, Zhou L. Repeatability and reproducibility of deep learning features for lung adenocarcinoma subtypes with nodules less than 10 mm in size: a multicenter thin-slice computed tomography phantom and clinical validation study. Quant Imaging Med Surg 2024; 14:5396-5407. [PMID: 39144035 PMCID: PMC11320509 DOI: 10.21037/qims-24-77] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Accepted: 07/01/2024] [Indexed: 08/16/2024]
Abstract
Background Deep learning features (DLFs) derived from radiomics features (RFs) fused with deep learning have shown potential in enhancing diagnostic capability. However, the limited repeatability and reproducibility of DLFs across multiple centers represents a challenge in the clinically validation of these features. This study thus aimed to evaluate the repeatability and reproducibility of DLFs and their potential efficiency in differentiating subtypes of lung adenocarcinoma less than 10 mm in size and manifesting as ground-glass nodules (GGNs). Methods A chest phantom with nodules was scanned repeatedly using different thin-slice computed tomography (TSCT) scanners with varying acquisition and reconstruction parameters. The robustness of the DLFs was measured using the concordance correlation coefficient (CCC) and intraclass correlation coefficient (ICC). A deep learning approach was used for visualizing the DLFs. To assess the clinical effectiveness and generalizability of the stable and informative DLFs, three hospitals were used to source 275 patients, in whom 405 nodules were pathologically differentially diagnosed as GGN lung adenocarcinoma less than 10 mm in size and were retrospectively reviewed for clinical validation. Results A total of 64 DLFs were analyzed, which revealed that the variables of slice thickness and slice interval (ICC, 0.79±0.18) and reconstruction kernel (ICC, 0.82±0.07) were significantly associated with the robustness of DLFs. Feature visualization showed that the DLFs were mainly focused around the nodule areas. In the external validation, a subset of 28 robust DLFs identified as stable under all sources of variability achieved the highest area under curve [AUC =0.65, 95% confidence interval (CI): 0.53-0.76] compared to other DLF models and the radiomics model. Conclusions Although different manufacturers and scanning schemes affect the reproducibility of DLFs, certain DLFs demonstrated excellent stability and effectively improved diagnostic the efficacy for identifying subtypes of lung adenocarcinoma. Therefore, as the first step, screening stable DLFs in multicenter DLFs research may improve diagnostic efficacy and promote the application of these features.
Collapse
Affiliation(s)
- Yi Zhan
- Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, China
| | - Renxiang Dai
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| | - Fangyun Li
- Lianren Digital Health Technology Co., Ltd., Shanghai, China
| | - Zenghui Cheng
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yaoyao Zhuo
- Department of Radiology, Zhongshan Hospital, Fudan University School of Medicine, Shanghai, China
| | - Fei Shan
- Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, China
| | - Lingxiao Zhou
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| |
Collapse
|
2
|
Liu J, Yang X, Li Y, Xu H, He C, Zhou P, Qing H. Predicting the Invasiveness of Pulmonary Adenocarcinomas in Pure Ground-Glass Nodules Using the Nodule Diameter: A Systematic Review, Meta-Analysis, and Validation in an Independent Cohort. Diagnostics (Basel) 2024; 14:147. [PMID: 38248024 PMCID: PMC10814052 DOI: 10.3390/diagnostics14020147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2023] [Revised: 12/30/2023] [Accepted: 01/05/2024] [Indexed: 01/23/2024] Open
Abstract
The nodule diameter was commonly used to predict the invasiveness of pulmonary adenocarcinomas in pure ground-glass nodules (pGGNs). However, the diagnostic performance and optimal cut-off values were inconsistent. We conducted a meta-analysis to evaluate the diagnostic performance of the nodule diameter for predicting the invasiveness of pulmonary adenocarcinomas in pGGNs and validated the cut-off value of the diameter in an independent cohort. Relevant studies were searched through PubMed, MEDLINE, Embase, and the Cochrane Library, from inception until December 2022. The inclusion criteria comprised studies that evaluated the diagnostic accuracy of the nodule diameter to differentiate invasive adenocarcinomas (IAs) from non-invasive adenocarcinomas (non-IAs) in pGGNs. A bivariate mixed-effects regression model was used to obtain the diagnostic performance. Meta-regression analysis was performed to explore the heterogeneity. An independent sample of 220 pGGNs (82 IAs and 128 non-IAs) was enrolled as the validation cohort to evaluate the performance of the cut-off values. This meta-analysis finally included 16 studies and 2564 pGGNs (761 IAs and 1803 non-IAs). The pooled area under the curve, the sensitivity, and the specificity were 0.85 (95% confidence interval (CI), 0.82-0.88), 0.82 (95% CI, 0.78-0.86), and 0.73 (95% CI, 0.67-0.78). The diagnostic performance was affected by the measure of the diameter, the reconstruction matrix, and patient selection bias. Using the prespecified cut-off value of 10.4 mm for the mean diameter and 13.2 mm for the maximal diameter, the mean diameter showed higher sensitivity than the maximal diameter in the validation cohort (0.85 vs. 0.72, p < 0.01), while there was no significant difference in specificity (0.83 vs. 0.86, p = 0.13). The nodule diameter had adequate diagnostic performance in differentiating IAs from non-IAs in pGGNs and could be replicated in a validation cohort. The mean diameter with a cut-off value of 10.4 mm was recommended.
Collapse
Affiliation(s)
| | | | | | | | | | - Peng Zhou
- Department of Radiology, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital and Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu 610041, China; (J.L.); (X.Y.); (Y.L.); (H.X.); (C.H.)
| | - Haomiao Qing
- Department of Radiology, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital and Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu 610041, China; (J.L.); (X.Y.); (Y.L.); (H.X.); (C.H.)
| |
Collapse
|
3
|
Zhou J, Hu B, Feng W, Zhang Z, Fu X, Shao H, Wang H, Jin L, Ai S, Ji Y. An ensemble deep learning model for risk stratification of invasive lung adenocarcinoma using thin-slice CT. NPJ Digit Med 2023; 6:119. [PMID: 37407729 DOI: 10.1038/s41746-023-00866-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Accepted: 06/26/2023] [Indexed: 07/07/2023] Open
Abstract
Lung cancer screening using computed tomography (CT) has increased the detection rate of small pulmonary nodules and early-stage lung adenocarcinoma. It would be clinically meaningful to accurate assessment of the nodule histology by CT scans with advanced deep learning algorithms. However, recent studies mainly focus on predicting benign and malignant nodules, lacking of model for the risk stratification of invasive adenocarcinoma. We propose an ensemble multi-view 3D convolutional neural network (EMV-3D-CNN) model to study the risk stratification of lung adenocarcinoma. We include 1075 lung nodules (≤30 mm and ≥4 mm) with preoperative thin-section CT scans and definite pathology confirmed by surgery. Our model achieves a state-of-art performance of 91.3% and 92.9% AUC for diagnosis of benign/malignant and pre-invasive/invasive nodules, respectively. Importantly, our model outperforms senior doctors in risk stratification of invasive adenocarcinoma with 77.6% accuracy [i.e., Grades 1, 2, 3]). It provides detailed predictive histological information for the surgical management of pulmonary nodules. Finally, for user-friendly access, the proposed model is implemented as a web-based system ( https://seeyourlung.com.cn ).
Collapse
Affiliation(s)
- Jing Zhou
- Center for Applied Statistics, School of Statistics, Renmin University of China, Beijing, China
| | - Bin Hu
- Department of Thoracic Surgery, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Wei Feng
- Department of Cardiothoracic Surgery, The Third Xiangya Hospital of Central South University, Changsha, China
| | - Zhang Zhang
- Department of Thoracic Surgery, Changsha Central Hospital, Changsha, China
| | - Xiaotong Fu
- Center for Applied Statistics, School of Statistics, Renmin University of China, Beijing, China
| | - Handie Shao
- Center for Applied Statistics, School of Statistics, Renmin University of China, Beijing, China
| | - Hansheng Wang
- Guanghua School of Management, Peking University, Beijing, China
| | - Longyu Jin
- Department of Cardiothoracic Surgery, The Third Xiangya Hospital of Central South University, Changsha, China
| | - Siyuan Ai
- Department of Thoracic Surgery, Beijing LIANGXIANG Hospital, Beijing, China
| | - Ying Ji
- Department of Thoracic Surgery, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China.
| |
Collapse
|
4
|
An ordinal radiomic model to predict the differentiation grade of invasive non-mucinous pulmonary adenocarcinoma based on low-dose computed tomography in lung cancer screening. Eur Radiol 2023; 33:3072-3082. [PMID: 36790469 DOI: 10.1007/s00330-023-09453-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 11/16/2022] [Accepted: 01/18/2023] [Indexed: 02/16/2023]
Abstract
OBJECTIVES To construct a radiomic model of low-dose CT (LDCT) to predict the differentiation grade of invasive non-mucinous pulmonary adenocarcinoma (IPA) and compare its diagnostic performance with quantitative-semantic model and radiologists. METHODS A total of 682 pulmonary nodules were divided into the primary cohort (181 grade 1; 254 grade 2; 64 grade 3) and validation cohort (69 grade 1; 99 grade 2; 15 grade 3) according to scanners. The radiomic and quantitative-semantic models were built using ordinal logistic regression. The diagnostic performance of the models and radiologists was assessed by the area under the curve (AUC) of the receiver operating characteristic curve and accuracy. RESULTS The radiomic model demonstrated excellent diagnostic performance in the validation cohort (AUC, 0.900 (95%CI: 0.847-0.939) for Grade 1 vs. Grade 2/Grade 3; AUC, 0.929 (95%CI: 0.882-0.962) for Grade 1/Grade 2 vs. Grade 3; accuracy, 0.803 (95%CI: 0.737-0.857)). No significant difference in diagnostic performance was found between the radiomic model and radiological expert (AUC, 0.840 (95%CI: 0.779-0.890) for Grade 1 vs. Grade 2/Grade 3, p = 0.130; AUC, 0.852 (95%CI: 0.793-0.900) for Grade 1/Grade 2 vs. Grade 3, p = 0.170; accuracy, 0.743 (95%CI: 0.673-0.804), p = 0.079), but the radiomic model outperformed the quantitative-semantic model and inexperienced radiologists (all p < 0.05). CONCLUSIONS The radiomic model of LDCT can be used to predict the differentiation grade of IPA in lung cancer screening, and its diagnostic performance is comparable to that of radiological expert. KEY POINTS • Early identifying the novel differentiation grade of invasive non-mucinous pulmonary adenocarcinoma may provide guidance for further surveillance, surgical strategy, or more adjuvant treatment. • The diagnostic performance of the radiomic model is comparable to that of a radiological expert and superior to that of the quantitative-semantic model and inexperienced radiologists. • The radiomic model of low-dose CT can be used to predict the differentiation grade of invasive non-mucinous pulmonary adenocarcinoma in lung cancer screening.
Collapse
|
5
|
Li Y, Liu J, Yang X, Xu F, Wang L, He C, Lin L, Qing H, Ren J, Zhou P. Radiomic and quantitative-semantic models of low-dose computed tomography for predicting the poorly differentiated invasive non-mucinous pulmonary adenocarcinoma. LA RADIOLOGIA MEDICA 2023; 128:191-202. [PMID: 36637740 DOI: 10.1007/s11547-023-01591-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 01/04/2023] [Indexed: 01/14/2023]
Abstract
PURPOSE Poorly differentiated invasive non-mucinous pulmonary adenocarcinoma (IPA), based on the novel grading system, was related to poor prognosis, with a high risk of lymph node metastasis and local recurrence. This study aimed to build the radiomic and quantitative-semantic models of low-dose computed tomography (LDCT) to preoperatively predict the poorly differentiated IPA in nodules with solid component, and compare their diagnostic performance with radiologists. MATERIALS AND METHODS A total of 396 nodules from 388 eligible patients, who underwent LDCT scan within 2 weeks before surgery and were pathologically diagnosed with IPA, were retrospectively enrolled between July 2018 and December 2021. Nodules were divided into two independent cohorts according to scanners: primary cohort (195 well/moderate differentiated and 64 poorly differentiated) and validation cohort (104 well/moderate differentiated and 33 poorly differentiated). The radiomic and quantitative-semantic models were built using multivariable logistic regression. The diagnostic performance of the models and radiologists was assessed by area under curve (AUC) of receiver operating characteristic (ROC) curve, accuracy, sensitivity, and specificity. RESULTS No significant differences of AUCs were found between the radiomic and quantitative-semantic model in primary and validation cohorts (0.921 vs. 0.923, P = 0.846 and 0.938 vs. 0.911, P = 0.161). Both the models outperformed three radiologists in the validation cohort (all P < 0.05). CONCLUSIONS The radiomic and quantitative-semantic models of LDCT, which could identify the poorly differentiated IPA with excellent diagnostic performance, might provide guidance for therapeutic decision making, such as choosing appropriate surgical method or adjuvant chemotherapy.
Collapse
Affiliation(s)
- Yong Li
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Jieke Liu
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Xi Yang
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Fuyang Xu
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Lu Wang
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Changjiu He
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Libo Lin
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Haomiao Qing
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Jing Ren
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Peng Zhou
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China.
| |
Collapse
|
6
|
Zhang Z, Yin F, Kang S, Tuo X, Zhang X, Han D. Dual-layer spectral detector CT (SDCT) can improve the detection of mixed ground-glass lung nodules. J Cancer Res Clin Oncol 2023:10.1007/s00432-022-04543-8. [PMID: 36595045 PMCID: PMC9808726 DOI: 10.1007/s00432-022-04543-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Accepted: 12/16/2022] [Indexed: 01/04/2023]
Abstract
BACKGROUND Mixed ground-glass lung nodules are a high-risk factor for lung adenocarcinoma. This study aimed to analyze the value of SDCT electron density imaging in the detection of mixed ground-glass lung nodules (GGNs). METHOD 150 patients with GGNs confirmed by chest SDCT and surgical pathology were retrospectively analyzed. GGNs were screened by two senior radiologists by the double-blind method based on conventional CT and SDCT electron density images. Average CT values and electron density (ED) values of GGNs were measured for all, solid and ground-glass. RESULT Thirty pGGN cases determined by conventional CT were found to be mGGN on electron density images, including 23 in the invasive adenocarcinoma group (detection rate of 35.38%), which was significantly higher than that of the PGL group (14.89%, P < 0.05). In electron density images, average CT values and ED values in the PGL and invasive adenocarcinoma groups with pGGNs were no difference. The average CT value and ED value were significantly higher in the mGGN invasive adenocarcinoma group compared with the PGL group (P < 0.05). Meanwhile, ROC curve analysis of average CT value and ED value revealed AUC values for mGGN infiltration of 0.759 and 0.752. CONCLUSION SDCT can improve GGN visualization and increase the detection rate of mGGN compared with conventional CT. Attention should be paid to invasive adenocarcinoma for lung GGNs detected as mGGNs with high average CT value or ED value.
Collapse
Affiliation(s)
- Zhenghua Zhang
- Medical Imaging Department, First Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Fang Yin
- Medical Imaging Department, First Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Shaolei Kang
- Medical Imaging Department, First Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Xiaoyu Tuo
- Pathology Department, First Affiliated Hospital of Kunming Medical University, Kunming, China
| | | | - Dan Han
- Medical Imaging Department, First Affiliated Hospital of Kunming Medical University, Kunming, China.
| |
Collapse
|
7
|
Wu YJ, Wu FZ, Yang SC, Tang EK, Liang CH. Radiomics in Early Lung Cancer Diagnosis: From Diagnosis to Clinical Decision Support and Education. Diagnostics (Basel) 2022; 12:diagnostics12051064. [PMID: 35626220 PMCID: PMC9139351 DOI: 10.3390/diagnostics12051064] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 04/14/2022] [Accepted: 04/22/2022] [Indexed: 12/19/2022] Open
Abstract
Lung cancer is the most frequent cause of cancer-related death around the world. With the recent introduction of low-dose lung computed tomography for lung cancer screening, there has been an increasing number of smoking- and non-smoking-related lung cancer cases worldwide that are manifesting with subsolid nodules, especially in Asian populations. However, the pros and cons of lung cancer screening also follow the implementation of lung cancer screening programs. Here, we review the literature related to radiomics for early lung cancer diagnosis. There are four main radiomics applications: the classification of lung nodules as being malignant/benign; determining the degree of invasiveness of the lung adenocarcinoma; histopathologic subtyping; and prognostication in lung cancer prediction models. In conclusion, radiomics offers great potential to improve diagnosis and personalized risk stratification in early lung cancer diagnosis through patient–doctor cooperation and shared decision making.
Collapse
Affiliation(s)
- Yun-Ju Wu
- Department of Software Engineering and Management, National Kaohsiung Normal University, Kaohsiung 80201, Taiwan;
| | - Fu-Zong Wu
- Institute of Education, National Sun Yat-Sen University, 70, Lien-Hai Road, Kaohsiung 804241, Taiwan;
- Department of Radiology, Kaohsiung Veterans General Hospital, Kaohsiung 813414, Taiwan
- Faculty of Clinical Medicine, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan
- Faculty of Medicine, School of Medicine, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan
- Correspondence:
| | - Shu-Ching Yang
- Institute of Education, National Sun Yat-Sen University, 70, Lien-Hai Road, Kaohsiung 804241, Taiwan;
| | - En-Kuei Tang
- Department of Surgery, Kaohsiung Veterans General Hospital, Kaohsiung 813414, Taiwan;
| | - Chia-Hao Liang
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan;
| |
Collapse
|