1
|
Jannatdoust P, Valizadeh P, Pahlevan-Fallahy MT, Hassankhani A, Amoukhteh M, Behrouzieh S, Ghadimi DJ, Bilgin C, Gholamrezanezhad A. Diagnostic accuracy of CT-based radiomics and deep learning for predicting lymph node metastasis in esophageal cancer. Clin Imaging 2024; 113:110225. [PMID: 38905878 DOI: 10.1016/j.clinimag.2024.110225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 05/26/2024] [Accepted: 06/04/2024] [Indexed: 06/23/2024]
Abstract
BACKGROUND Esophageal cancer remains a global challenge due to late diagnoses and limited treatments. Lymph node metastasis (LNM) is crucial for prognosis, yet traditional diagnostics fall short. Integrating radiomics and deep learning (DL) with CT imaging for LNM diagnosis could revolutionize prognostic assessment and treatment planning. METHODS A systematic review and meta-analysis were conducted by searching PubMed, Scopus, Web of Science, and Embase up to October 1, 2023. The focus was on studies developing CT-based radiomics and/or DL models for preoperative LNM detection in esophageal cancer. Methodological quality was assessed using the METhodological RadiomICs Score (METRICS). RESULTS Twelve studies were reviewed, and seven were included in the meta-analysis, most showing excellent methodological quality. Training sets revealed a pooled AUC of 87 % (95 % CI: 78 %-90 %), and internal validation sets showed an AUC of 85 % (95 % CI: 76 %-89 %), with no significant difference (p = 0.39). Sensitivity and specificity for training sets were 78.7 % and 81.8 %, respectively, with validation sets at 81.2 % and 76.2 %. DL models in training sets showed better diagnostic accuracy than radiomics (p = 0.054), significant after removing outliers (p < 0.01). Incorporating clinical data improved sensitivity in validation sets (p = 0.029). No significant difference was found between models based on CE or non-CE imaging (p = 0.281) or arterial or venous phase imaging (p = 0.927). CONCLUSION Integrating CT-based radiomics and DL improves LNM detection in esophageal cancer. Including clinical data could enhance model performance. Future research should focus on multicenter studies with independent validations to confirm these findings and promote broader clinical adoption.
Collapse
Affiliation(s)
- Payam Jannatdoust
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Parya Valizadeh
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | | | - Amir Hassankhani
- Department of Radiology, Keck School of Medicine, University of Southern California (USC), Los Angeles, CA, USA; Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Melika Amoukhteh
- Department of Radiology, Keck School of Medicine, University of Southern California (USC), Los Angeles, CA, USA; Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Sadra Behrouzieh
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Delaram J Ghadimi
- School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Cem Bilgin
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Ali Gholamrezanezhad
- Department of Radiology, Keck School of Medicine, University of Southern California (USC), Los Angeles, CA, USA.
| |
Collapse
|
2
|
Liu L, Liao H, Zhao Y, Yin J, Wang C, Duan L, Xie P, Wei W, Xu M, Su D. CT-based radiomics for predicting lymph node metastasis in esophageal cancer: a systematic review and meta-analysis. Front Oncol 2024; 14:1267596. [PMID: 38577325 PMCID: PMC10993774 DOI: 10.3389/fonc.2024.1267596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 03/07/2024] [Indexed: 04/06/2024] Open
Abstract
Objective We aimed to evaluate the diagnostic effectiveness of computed tomography (CT)-based radiomics for predicting lymph node metastasis (LNM) in patients diagnosed with esophageal cancer (EC). Methods The present study conducted a comprehensive search by accessing the following databases: PubMed, Embase, Cochrane Library, and Web of Science, with the aim of identifying relevant studies published until July 10th, 2023. The diagnostic accuracy was summarized using the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and area under the curve (AUC). The researchers utilized Spearman's correlation coefficient for assessing the threshold effect, besides performing meta-regression and subgroup analysis for the exploration of possible heterogeneity sources. The quality assessment was conducted using the Quality Assessment of Diagnostic Accuracy Studies-2 and the Radiomics Quality Score (RQS). Results The meta-analysis included six studies conducted from 2018 to 2022, with 483 patients enrolled and LNM rates ranging from 27.2% to 59.4%. The pooled sensitivity, specificity, PLR, NLR, DOR, and AUC, along with their corresponding 95% CI, were 0.73 (0.67, 0.79), 0.76 (0.69, 0.83), 3.1 (2.3, 4.2), 0.35 (0.28, 0.44), 9 (6, 14), and 0.78 (0.74, 0.81), respectively. The results demonstrated the absence of significant heterogeneity in sensitivity, while significant heterogeneity was observed in specificity; no threshold effect was detected. The observed heterogeneity in the specificity was attributed to the sample size and CT-scan phases (P < 0.05). The included studies exhibited suboptimal quality, with RQS ranging from 14 to 16 out of 36. However, most of the enrolled studies exhibited a low-risk bias and minimal concerns relating to applicability. Conclusion The present meta-analysis indicated that CT-based radiomics demonstrated a favorable diagnostic performance in predicting LNM in EC. Nevertheless, additional high-quality, large-scale, and multicenter trials are warranted to corroborate these findings. Systematic Review Registration Open Science Framework platform at https://osf.io/5zcnd.
Collapse
Affiliation(s)
- Liangsen Liu
- Department of Medical Imaging Center, Guangxi Medical University Cancer Hospital, Nanning, China
- Department of Nuclear Medicine, The Fifth Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Hai Liao
- Department of Medical Imaging Center, Guangxi Medical University Cancer Hospital, Nanning, China
| | - Yang Zhao
- Department of Medical Imaging Center, Guangxi Medical University Cancer Hospital, Nanning, China
| | - Jiayu Yin
- Department of Medical Imaging Center, Guangxi Medical University Cancer Hospital, Nanning, China
- Department of Radiology, The Fifth Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Chen Wang
- Department of Medical Imaging Center, Guangxi Medical University Cancer Hospital, Nanning, China
| | - Lixia Duan
- Department of Medical Imaging Center, Guangxi Medical University Cancer Hospital, Nanning, China
| | - Peihan Xie
- Department of Medical Imaging Center, Guangxi Medical University Cancer Hospital, Nanning, China
| | - Wupeng Wei
- Department of Radiology, The Second Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Meihai Xu
- Department of Radiology, The Fifth Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Danke Su
- Department of Medical Imaging Center, Guangxi Medical University Cancer Hospital, Nanning, China
| |
Collapse
|
3
|
Geng X, Zhang Y, Li Y, Cai Y, Liu J, Geng T, Meng X, Hao F. Radiomics-clinical nomogram for preoperative lymph node metastasis prediction in esophageal carcinoma. Br J Radiol 2024; 97:652-659. [PMID: 38268475 PMCID: PMC11027331 DOI: 10.1093/bjr/tqae009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Revised: 11/10/2023] [Accepted: 12/18/2023] [Indexed: 01/26/2024] Open
Abstract
OBJECTIVES This research aimed to develop a radiomics-clinical nomogram based on enhanced thin-section CT radiomics and clinical features for the purpose of predicting the presence or absence of metastasis in lymph nodes among patients with resectable esophageal squamous cell carcinoma (ESCC). METHODS This study examined the data of 256 patients with ESCC, including 140 cases with lymph node metastasis. Clinical information was gathered for each case, and radiomics features were derived from thin-section contrast-enhanced CT with the help of a 3D slicer. To validate risk factors that are independent of the clinical and radiomics models, least absolute shrinkage and selection operator logistic regression analysis was used. A nomogram pattern was constructed based on the radiomics features and clinical characteristics. The receiver operating characteristic curve and Brier Score were used to evaluate the model's discriminatory ability, the calibration plot to evaluate the model's calibration, and the decision curve analysis to evaluate the model's clinical utility. The confusion matrix was used to evaluate the applicability of the model. To evaluate the efficacy of the model, 1000 rounds of 5-fold cross-validation were conducted. RESULTS The clinical model identified esophageal wall thickness and clinical T (cT) stage as independent risk factors, whereas the radiomics pattern was built based on 4 radiomics features chosen at random. Area under the curve (AUC) values of 0.684 and 0.701 are observed for the radiomics approach and clinical model, respectively. The AUC of nomogram combining radiomics and clinical features was 0.711. The calibration plot showed good agreement between the incidence of lymph node metastasis predicted by the nomogram and the actual probability of occurrence. The nomogram model displayed acceptable levels of performance. After 1000 rounds of 5-fold cross-validation, the AUC and Brier score had median values of 0.702 (IQR: 0.65, 7.49) and 0.21 (IQR: 0.20, 0.23), respectively. High-risk patients (risk point >110) were found to have an increased risk of lymph node metastasis [odds ratio (OR) = 5.15, 95% CI, 2.95-8.99] based on the risk categorization. CONCLUSION A successful preoperative prediction performance for metastasis to the lymph nodes among patients with ESCC was demonstrated by the nomogram that incorporated CT radiomics, wall thickness, and cT stage. ADVANCES IN KNOWLEDGE This study demonstrates a novel radiomics-clinical nomogram for lymph node metastasis prediction in ESCC, which helps physicians determine lymph node status preoperatively.
Collapse
Affiliation(s)
- Xiaotao Geng
- Shandong University Cancer Center, Shandong University, 440 Jiyan Road, Jinan, 250117, China
- Department of Radiation Oncology, Weifang People’s Hospital, 151 Guangwen Street, Weifang, 261000, China
| | - Yaping Zhang
- Department of Radiology, Weifang People’s Hospital, 151 Guangwen Street, Weifang, 261000, China
| | - Yang Li
- Department of Radiation Oncology, Weifang People’s Hospital, 151 Guangwen Street, Weifang, 261000, China
| | - Yuanyuan Cai
- Department of Radiation Oncology, Weifang People’s Hospital, 151 Guangwen Street, Weifang, 261000, China
| | - Jie Liu
- Department of Radiation Oncology, Weifang People’s Hospital, 151 Guangwen Street, Weifang, 261000, China
| | - Tianxiang Geng
- Department of Biomaterials, Faculty of Dentistry, University of Oslo, Oslo, 0455, Norway
| | - Xiangdi Meng
- Department of Radiation Oncology, Weifang People’s Hospital, 151 Guangwen Street, Weifang, 261000, China
| | - Furong Hao
- Department of Radiation Oncology, Weifang People’s Hospital, 151 Guangwen Street, Weifang, 261000, China
| |
Collapse
|
4
|
Yan X, Mou X, Yang Y, Ren J, Zhou X, Huang Y, Yuan H. Predicting central lymph node metastasis in patients with papillary thyroid carcinoma based on ultrasound radiomic and morphological features analysis. BMC Med Imaging 2023; 23:111. [PMID: 37620767 PMCID: PMC10463837 DOI: 10.1186/s12880-023-01085-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Accepted: 08/21/2023] [Indexed: 08/26/2023] Open
Abstract
OBJECTIVES To build a combined model based on the ultrasound radiomic and morphological features, and evaluate its diagnostic performance for preoperative prediction of central lymph node metastasis (CLNM) in patients with papillary thyroid carcinoma (PTC). METHOD A total of 295 eligible patients, who underwent preoperative ultrasound scan and were pathologically diagnosed with unifocal PTC were included at our hospital from October 2019 to July 2022. According to ultrasound scanners, patients were divided into the training set (115 with CLNM; 97 without CLNM) and validation set (45 with CLNM; 38 without CLNM). Ultrasound radiomic, morphological, and combined models were constructed using multivariate logistic regression. The diagnostic performance was assessed by the area under the curve (AUC) of the receiver operating characteristic curve, accuracy, sensitivity, and specificity. RESULTS A combined model was built based on the morphology, boundary, length diameter, and radiomic score. The AUC was 0.960 (95% CI, 0.924-0.982) and 0.966 (95% CI, 0.901-0.993) in the training and validation set, respectively. Calibration curves showed good consistency between prediction and observation, and DCA demonstrated the clinical benefit of the combined model. CONCLUSION Based on ultrasound radiomic and morphological features, the combined model showed a good performance in predicting CLNM of patients with PTC preoperatively.
Collapse
Affiliation(s)
- Xiang Yan
- Sichuan Key Laboratory of Medical Imaging, Department of Ultrasound, Affiliated Hospital of North Sichuan Medical College, Nanchong, 637000, China
| | - Xurong Mou
- Sichuan Key Laboratory of Medical Imaging, Department of Ultrasound, Affiliated Hospital of North Sichuan Medical College, Nanchong, 637000, China
| | - Yanan Yang
- Sichuan Key Laboratory of Medical Imaging, Department of Ultrasound, Affiliated Hospital of North Sichuan Medical College, Nanchong, 637000, China
| | - Jing Ren
- Sichuan Key Laboratory of Medical Imaging, Department of Ultrasound, Affiliated Hospital of North Sichuan Medical College, Nanchong, 637000, China
| | - Xingxu Zhou
- Sichuan Key Laboratory of Medical Imaging, Department of Ultrasound, Affiliated Hospital of North Sichuan Medical College, Nanchong, 637000, China
| | - Yifei Huang
- Sichuan Key Laboratory of Medical Imaging, Department of Ultrasound, Affiliated Hospital of North Sichuan Medical College, Nanchong, 637000, China
| | - Hongmei Yuan
- Sichuan Key Laboratory of Medical Imaging, Department of Ultrasound, Affiliated Hospital of North Sichuan Medical College, Nanchong, 637000, China.
| |
Collapse
|
5
|
Xu L, Guo J, Qi S, Xie HN, Wei XF, Yu YK, Cao P, Zhang RX, Chen XK, Li Y. Development and validation of a nomogram model for the prediction of 4L lymph node metastasis in thoracic esophageal squamous cell carcinoma. Front Oncol 2022; 12:887047. [PMID: 36263210 PMCID: PMC9573997 DOI: 10.3389/fonc.2022.887047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Accepted: 09/13/2022] [Indexed: 11/29/2022] Open
Abstract
Objectives The left tracheobronchial (4L) lymph nodes (LNs) are considered as regional LNs for esophageal squamous cell carcinoma (ESCC), but there is a controversy about routine prophylactic 4L LN dissection for all resectable ESCCs. This study aimed to develop a nomogram for preoperative prediction of station 4L lymph node metastases (LNMs). Methods A total of 522 EC patients in the training cohort and 370 in the external validation cohort were included. The prognostic impact of station 4L LNM was evaluated, and multivariable logistic regression analyses were performed to identify independent risk factors of station 4L LNM. A nomogram model was developed based on multivariable logistic regression analysis. Model performance was evaluated in both cohorts in terms of calibration, discrimination, and clinical usefulness. Results The incidence of station 4L LNM was 7.9% (41/522) in the training cohort. Patients with station 4L LNM exhibited a poorer 5-year overall survival rate than those without (43.2% vs. 71.6%, p < 0.001). In multivariate logistic regression analyses, six variables were confirmed as independent 4L LNM risk factors: sex (p = 0.039), depth of invasion (p = 0.002), tumor differentiation (p = 0.016), short axis of the largest 4L LNs (p = 0.001), 4L conglomeration (p = 0.006), and 4L necrosis (p = 0.002). A nomogram model, containing six independent risk factors, demonstrated a good performance, with the area under the curve (AUC) of 0.921 (95% CI: 0.878–0.964) in the training cohort and 0.892 (95% CI: 0.830–0.954) in the validation cohort. The calibration curve showed a good agreement on the presence of station 4L LNM between the risk estimation according to the model and histopathologic results on surgical specimens. The Hosmer–Lemeshow test demonstrated a non-significant statistic (p = 0.691 and 0.897) in the training and validation cohorts, which indicated no departure from the perfect fit. Decision curve analysis indicated that the model had better diagnostic power for 4L LNM than the traditional LN size criteria. Conclusions This model integrated the available clinical and radiological risk factors, facilitating in the precise prediction of 4L LNM in patients with ESCC and aiding in personalized therapeutic decision-making regarding the need for routine prophylactic 4L lymphadenectomy.
Collapse
Affiliation(s)
- Lei Xu
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jia Guo
- Department of Radiology, Beijing Shijitan Hospital, Capital Medical University, Beijing, China
| | - Shu Qi
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Hou-nai Xie
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Xiu-feng Wei
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yong-kui Yu
- Department of Thoracic Surgery, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Ping Cao
- Department of Radiology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Rui-xiang Zhang
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Xian-kai Chen
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
- *Correspondence: Yin Li, ; Xian-kai Chen,
| | - Yin Li
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
- *Correspondence: Yin Li, ; Xian-kai Chen,
| |
Collapse
|